2024-01-19T03:59:11.348 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T03:59:11.348 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983 --owner scheduled_yuriw@teuthology --name yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/orig.config.yaml 2024-01-19T03:59:11.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T03:59:11.488 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983 branch: wip-yuri8-testing-2024-01-18-0823 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: yweinste@redhat.com first_in_suite: false job_id: '7520983' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri8-testing-2024-01-18-0823 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0edf41a622739843d6b978b179ff3227b476dd9d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0edf41a622739843d6b978b179ff3227b476dd9d kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2024-01-18-0823 sha1: 0edf41a622739843d6b978b179ff3227b476dd9d owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 6631 sha1: 0edf41a622739843d6b978b179ff3227b476dd9d sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2024-01-18-0823 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0edf41a622739843d6b978b179ff3227b476dd9d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmDdSsxv9WcJ1PZ9Jkx++eMHWGS8ZjfY//Ppc41DiHzNz2a0RfpIlaepu8H+26Ti/KB+0ITqjumF9g3TjIJb3I= smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ/Mu9fYV8m1G+znEw6THx2hpuWOW7pGAgxKZxsI2PI3OgYKsM9ZT+Dz2MR6wxX8wK+xWWAAILMLzdjTFAWUtZ8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-18_21:19:14 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-19T03:59:11.488 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa; will attempt to use it 2024-01-19T03:59:11.489 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks 2024-01-19T03:59:11.489 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-19T03:59:11.491 INFO:teuthology.task.internal:Checking packages... 2024-01-19T03:59:11.519 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0edf41a622739843d6b978b179ff3227b476dd9d' 2024-01-19T03:59:11.519 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-19T03:59:11.519 INFO:teuthology.packaging:ref: None 2024-01-19T03:59:11.519 INFO:teuthology.packaging:tag: None 2024-01-19T03:59:11.520 INFO:teuthology.packaging:branch: wip-yuri8-testing-2024-01-18-0823 2024-01-19T03:59:11.520 INFO:teuthology.packaging:sha1: 0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T03:59:11.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri8-testing-2024-01-18-0823 2024-01-19T03:59:11.663 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-766-g0edf41a6-1jammy 2024-01-19T03:59:11.665 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-19T03:59:11.671 INFO:teuthology.task.internal:no buildpackages task found 2024-01-19T03:59:11.671 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-19T03:59:11.687 INFO:teuthology.task.internal:Saving configuration 2024-01-19T03:59:11.703 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-19T03:59:11.711 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T03:59:11.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 03:53:27.773425', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDHTPkJD5vTUu4A4D7rgrU1sXJN/qSLc1mAxHyp2w3vU'} 2024-01-19T03:59:11.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 03:53:27.771838', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG50kgxcPceNT7AbruSAeuzu9YGLhEXxo3lsW9HwdrHD'} 2024-01-19T03:59:11.758 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-19T03:59:11.764 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-19T03:59:11.764 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-01-19T03:59:11.764 INFO:teuthology.run_tasks:Running task console_log... 2024-01-19T03:59:11.830 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0962a233a0>, signals=[15]) 2024-01-19T03:59:11.830 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-19T03:59:11.836 INFO:teuthology.task.internal:Opening connections... 2024-01-19T03:59:11.836 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T03:59:11.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T03:59:11.920 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T03:59:11.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T03:59:12.001 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-19T03:59:12.007 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-01-19T03:59:12.013 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-01-19T03:59:12.013 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-01-19T03:59:12.064 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-19T03:59:12.064 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-01-19T03:59:12.064 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-01-19T03:59:12.064 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-19T03:59:12.064 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-01-19T03:59:12.064 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-01-19T03:59:12.064 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-01-19T03:59:12.065 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-19T03:59:12.065 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-19T03:59:12.065 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-19T03:59:12.065 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-19T03:59:12.065 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-01-19T03:59:12.065 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-01-19T03:59:12.084 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-01-19T03:59:12.089 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-01-19T03:59:12.089 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-01-19T03:59:12.137 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-19T03:59:12.137 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Ubuntu" 2024-01-19T03:59:12.137 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="22.04" 2024-01-19T03:59:12.137 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-19T03:59:12.137 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_CODENAME=jammy 2024-01-19T03:59:12.137 INFO:teuthology.orchestra.run.smithi067.stdout:ID=ubuntu 2024-01-19T03:59:12.138 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE=debian 2024-01-19T03:59:12.138 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-19T03:59:12.138 INFO:teuthology.orchestra.run.smithi067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-19T03:59:12.138 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-19T03:59:12.138 INFO:teuthology.orchestra.run.smithi067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-19T03:59:12.138 INFO:teuthology.orchestra.run.smithi067.stdout:UBUNTU_CODENAME=jammy 2024-01-19T03:59:12.138 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-01-19T03:59:12.167 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-19T03:59:12.181 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-19T03:59:12.185 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-19T03:59:12.186 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-01-19T03:59:12.188 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-01-19T03:59:12.192 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-19T03:59:12.199 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-19T03:59:12.199 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-01-19T03:59:12.234 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-01-19T03:59:12.249 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-19T03:59:12.294 INFO:teuthology.run_tasks:Running task kernel... 2024-01-19T03:59:12.308 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-01-19T03:59:12.308 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-01-19T03:59:12.309 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-01-19T03:59:12.309 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-19T03:59:12.309 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-19T03:59:12.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T03:59:12.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-19T03:59:12.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T03:59:12.319 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-19T03:59:12.488 DEBUG:teuthology.task.kernel:sha1 for client.0 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-19T03:59:12.488 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-19T03:59:12.488 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-01-19T03:59:12.493 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-56-generic 2024-01-19T03:59:12.494 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-19T03:59:12.494 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-19T03:59:12.494 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-19T03:59:12.494 DEBUG:teuthology.orchestra.run.smithi032:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-19T03:59:12.508 DEBUG:teuthology.task.kernel:sha1 for client.1 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-19T03:59:12.508 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-19T03:59:12.509 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-01-19T03:59:12.514 INFO:teuthology.orchestra.run.smithi067.stdout:5.15.0-56-generic 2024-01-19T03:59:12.514 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-19T03:59:12.515 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-19T03:59:12.515 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-01-19T03:59:12.515 DEBUG:teuthology.orchestra.run.smithi067:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-19T03:59:12.555 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-19T03:59:12.571 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-19T03:59:12.669 INFO:teuthology.orchestra.run.smithi032.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-19T03:59:12.669 INFO:teuthology.orchestra.run.smithi032.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: git config --global init.defaultBranch 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:hint: git branch -m 2024-01-19T03:59:12.670 INFO:teuthology.orchestra.run.smithi032.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-19T03:59:12.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-19T03:59:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-19T03:59:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-19T03:59:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-19T03:59:12.715 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 2024-01-19T03:59:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:hint: git config --global init.defaultBranch 2024-01-19T03:59:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 2024-01-19T03:59:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-19T03:59:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-19T03:59:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 2024-01-19T03:59:12.716 INFO:teuthology.orchestra.run.smithi067.stderr:hint: git branch -m 2024-01-19T03:59:12.717 INFO:teuthology.orchestra.run.smithi067.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-19T03:59:12.719 DEBUG:teuthology.orchestra.run.smithi067:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-19T03:59:12.742 DEBUG:teuthology.orchestra.run.smithi032:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-19T03:59:12.787 DEBUG:teuthology.orchestra.run.smithi067:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-19T03:59:12.798 DEBUG:teuthology.orchestra.run.smithi032:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-19T03:59:12.842 DEBUG:teuthology.orchestra.run.smithi067:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-19T04:00:10.532 INFO:teuthology.orchestra.run.smithi032.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-19T04:00:10.532 INFO:teuthology.orchestra.run.smithi032.stderr: * [new branch] main -> origin/main 2024-01-19T04:00:10.559 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190312 -> 20190312 2024-01-19T04:00:10.559 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190416 -> 20190416 2024-01-19T04:00:10.560 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190514 -> 20190514 2024-01-19T04:00:10.560 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190618 -> 20190618 2024-01-19T04:00:10.560 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190717 -> 20190717 2024-01-19T04:00:10.560 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190815 -> 20190815 2024-01-19T04:00:10.560 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190923 -> 20190923 2024-01-19T04:00:10.560 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20191022 -> 20191022 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20191215 -> 20191215 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200122 -> 20200122 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200316 -> 20200316 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200421 -> 20200421 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200519 -> 20200519 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200619 -> 20200619 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200721 -> 20200721 2024-01-19T04:00:10.562 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200817 -> 20200817 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200918 -> 20200918 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201022 -> 20201022 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201118 -> 20201118 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201218 -> 20201218 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210208 -> 20210208 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210315 -> 20210315 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210511 -> 20210511 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210716 -> 20210716 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210818 -> 20210818 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210919 -> 20210919 2024-01-19T04:00:10.563 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20211027 -> 20211027 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20211216 -> 20211216 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220209 -> 20220209 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220310 -> 20220310 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220411 -> 20220411 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220509 -> 20220509 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220610 -> 20220610 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220708 -> 20220708 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220815 -> 20220815 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220913 -> 20220913 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221012 -> 20221012 2024-01-19T04:00:10.566 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221109 -> 20221109 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221214 -> 20221214 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230117 -> 20230117 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230210 -> 20230210 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230310 -> 20230310 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230404 -> 20230404 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230515 -> 20230515 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230625 -> 20230625 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230804 -> 20230804 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230919 -> 20230919 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231030 -> 20231030 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231111 -> 20231111 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231211 -> 20231211 2024-01-19T04:00:10.567 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240115 -> 20240115 2024-01-19T04:00:14.867 INFO:teuthology.orchestra.run.smithi032.stderr:Updating files: 47% (1621/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 63% (2160/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 76% (2613/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2854/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-01-19T04:00:14.872 INFO:teuthology.orchestra.run.smithi032.stdout:HEAD is now at bf0987d3 Merge branch 'robot/patch-0-1705440424' into 'main' 2024-01-19T04:00:14.894 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-19T04:00:14.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-19T04:00:15.111 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ 2024-01-19T04:00:15.111 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ --input-file=- 2024-01-19T04:00:15.114 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi032.front.sepia.ceph.com to complete... 2024-01-19T04:00:16.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19 04:00:17 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb [39110148/39110148] -> "/tmp/linux-image.deb" [1] 2024-01-19T04:00:16.981 INFO:teuthology.orchestra.run.smithi032.stderr:FINISHED --2024-01-19 04:00:17-- 2024-01-19T04:00:16.981 INFO:teuthology.orchestra.run.smithi032.stderr:Total wall clock time: 1.8s 2024-01-19T04:00:16.981 INFO:teuthology.orchestra.run.smithi032.stderr:Downloaded: 1 files, 37M in 1.6s (22.8 MB/s) 2024-01-19T04:00:16.988 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-19T04:00:16.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo dpkg -i /tmp/linux-image.deb 2024-01-19T04:00:17.200 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-6.7.0-g06652275eb93. 2024-01-19T04:00:18.964 INFO:teuthology.orchestra.run.smithi067.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-19T04:00:18.965 INFO:teuthology.orchestra.run.smithi067.stderr: * [new branch] main -> origin/main 2024-01-19T04:00:18.992 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190312 -> 20190312 2024-01-19T04:00:18.993 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190416 -> 20190416 2024-01-19T04:00:18.993 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190514 -> 20190514 2024-01-19T04:00:18.993 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190618 -> 20190618 2024-01-19T04:00:18.993 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190717 -> 20190717 2024-01-19T04:00:18.993 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190815 -> 20190815 2024-01-19T04:00:18.993 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190923 -> 20190923 2024-01-19T04:00:18.994 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20191022 -> 20191022 2024-01-19T04:00:18.994 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20191215 -> 20191215 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200122 -> 20200122 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200316 -> 20200316 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200421 -> 20200421 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200519 -> 20200519 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200619 -> 20200619 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200721 -> 20200721 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200817 -> 20200817 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200918 -> 20200918 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20201022 -> 20201022 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20201118 -> 20201118 2024-01-19T04:00:18.995 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20201218 -> 20201218 2024-01-19T04:00:18.997 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210208 -> 20210208 2024-01-19T04:00:18.997 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210315 -> 20210315 2024-01-19T04:00:18.997 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210511 -> 20210511 2024-01-19T04:00:18.997 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210716 -> 20210716 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210818 -> 20210818 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210919 -> 20210919 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20211027 -> 20211027 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20211216 -> 20211216 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220209 -> 20220209 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220310 -> 20220310 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220411 -> 20220411 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220509 -> 20220509 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220610 -> 20220610 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220708 -> 20220708 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220815 -> 20220815 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220913 -> 20220913 2024-01-19T04:00:18.998 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20221012 -> 20221012 2024-01-19T04:00:19.000 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20221109 -> 20221109 2024-01-19T04:00:19.000 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20221214 -> 20221214 2024-01-19T04:00:19.000 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230117 -> 20230117 2024-01-19T04:00:19.000 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230210 -> 20230210 2024-01-19T04:00:19.000 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230310 -> 20230310 2024-01-19T04:00:19.000 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230404 -> 20230404 2024-01-19T04:00:19.000 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230515 -> 20230515 2024-01-19T04:00:19.001 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230625 -> 20230625 2024-01-19T04:00:19.001 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230804 -> 20230804 2024-01-19T04:00:19.001 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230919 -> 20230919 2024-01-19T04:00:19.001 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20231030 -> 20231030 2024-01-19T04:00:19.001 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20231111 -> 20231111 2024-01-19T04:00:19.001 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20231211 -> 20231211 2024-01-19T04:00:19.001 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20240115 -> 20240115 2024-01-19T04:00:19.183 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-19T04:00:19.188 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-19T04:00:19.313 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-19T04:00:22.721 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-19T04:00:22.823 INFO:teuthology.orchestra.run.smithi032.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-g06652275eb93 2024-01-19T04:00:23.306 INFO:teuthology.orchestra.run.smithi067.stderr:Updating files: 46% (1596/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 62% (2149/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 76% (2613/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2852/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-01-19T04:00:23.311 INFO:teuthology.orchestra.run.smithi067.stdout:HEAD is now at bf0987d3 Merge branch 'robot/patch-0-1705440424' into 'main' 2024-01-19T04:00:23.335 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-19T04:00:23.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-19T04:00:23.483 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ 2024-01-19T04:00:23.483 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/ --input-file=- 2024-01-19T04:00:23.486 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi067.front.sepia.ceph.com to complete... 2024-01-19T04:00:25.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19 04:00:25 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g06652275eb93/linux-image-6.7.0-g06652275eb93_6.7.0-g06652275eb93-1_amd64.deb [39110148/39110148] -> "/tmp/linux-image.deb" [1] 2024-01-19T04:00:25.385 INFO:teuthology.orchestra.run.smithi067.stderr:FINISHED --2024-01-19 04:00:25-- 2024-01-19T04:00:25.385 INFO:teuthology.orchestra.run.smithi067.stderr:Total wall clock time: 1.9s 2024-01-19T04:00:25.385 INFO:teuthology.orchestra.run.smithi067.stderr:Downloaded: 1 files, 37M in 1.7s (22.2 MB/s) 2024-01-19T04:00:25.389 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-19T04:00:25.389 DEBUG:teuthology.orchestra.run.smithi067:> sudo dpkg -i /tmp/linux-image.deb 2024-01-19T04:00:25.644 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-image-6.7.0-g06652275eb93. 2024-01-19T04:00:27.590 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-19T04:00:27.594 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-19T04:00:27.694 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-19T04:00:31.244 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-6.7.0-g06652275eb93 (6.7.0-g06652275eb93-1) ... 2024-01-19T04:00:31.348 INFO:teuthology.orchestra.run.smithi067.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-g06652275eb93 2024-01-19T04:00:43.462 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-01-19T04:00:43.468 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:00:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-01-19T04:00:43.761 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-19T04:00:43.779 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-19T04:00:44.061 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:00:44.070 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:00:44.135 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:00:44.141 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:00:44.279 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:00:44.280 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:00:44.280 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:00:44.325 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-01-19T04:00:44.505 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-deb -c /tmp/linux-image.deb 2024-01-19T04:00:44.512 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./ 2024-01-19T04:00:44.512 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./boot/ 2024-01-19T04:00:44.512 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4444641 2024-01-18 11:42 ./boot/System.map-6.7.0-g06652275eb93 2024-01-19T04:00:44.525 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 170149 2024-01-18 11:42 ./boot/config-6.7.0-g06652275eb93 2024-01-19T04:00:44.525 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11441152 2024-01-18 11:42 ./boot/vmlinuz-6.7.0-g06652275eb93 2024-01-19T04:00:44.545 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/ 2024-01-19T04:00:44.545 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/ 2024-01-19T04:00:44.545 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postinst.d/ 2024-01-19T04:00:44.545 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postrm.d/ 2024-01-19T04:00:44.545 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/preinst.d/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/prerm.d/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ 2024-01-19T04:00:44.546 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 490345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 106729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 152241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-19T04:00:44.549 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/ 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/ 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/ 2024-01-19T04:00:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-19T04:00:44.551 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpuid.ko 2024-01-19T04:00:44.551 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/msr.ko 2024-01-19T04:00:44.551 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/ 2024-01-19T04:00:44.551 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 353705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-19T04:00:44.551 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 881649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-19T04:00:44.551 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2276625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-19T04:00:44.566 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ 2024-01-19T04:00:44.566 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/af_alg.ko 2024-01-19T04:00:44.566 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_hash.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_skcipher.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/ 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/ 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-19T04:00:44.567 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cryptd.ko 2024-01-19T04:00:44.568 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_simd.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lrw.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-19T04:00:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 149481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-19T04:00:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xts.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_extlog.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/ 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/einj.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-19T04:00:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 88401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-19T04:00:44.572 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_legacy.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-19T04:00:44.573 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_radisys.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rz1000.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-19T04:00:44.574 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-19T04:00:44.575 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/ 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/ 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/ 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-19T04:00:44.576 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/ 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 965305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 173353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/ 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 116321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/ 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 110737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-19T04:00:44.577 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-19T04:00:44.633 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 263769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/ 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/ 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/applicom.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/ 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-19T04:00:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 148609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 139313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/ 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/nvram.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/ 2024-01-19T04:00:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/ 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/ 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-palmas.ko 2024-01-19T04:00:44.636 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-si5351.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-twl6040.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-wm831x.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/ 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 246841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/ 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/ 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 517033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-19T04:00:44.637 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/ 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/ 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/ 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-19T04:00:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-19T04:00:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/ 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-gpio.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max14577.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max77693.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max8997.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-palmas.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/ 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/ 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-19T04:00:44.640 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/ 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-arizona.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9052.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9055.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-dln2.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-generic.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-kempld.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-19T04:00:44.641 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max7300.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max730x.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max732x.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-vx855.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-19T04:00:44.642 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/ 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-a4tech.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-apple.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-belkin.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cherry.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-chicony.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cp2112.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cypress.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-19T04:00:44.643 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ezkey.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-generic.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kensington.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-19T04:00:44.644 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lg-g15.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-magicmouse.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-microsoft.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-monterey.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ntrig.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-19T04:00:44.645 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-19T04:00:44.646 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-19T04:00:44.647 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 143473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 269281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/ 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-19T04:00:44.648 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 217873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/ 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 305321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-19T04:00:44.649 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-19T04:00:44.650 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc2103.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-19T04:00:44.651 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hih6130.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-19T04:00:44.652 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 130449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/jc42.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-19T04:00:44.653 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-19T04:00:44.654 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-19T04:00:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-19T04:00:44.656 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-19T04:00:44.657 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-19T04:00:44.658 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/ 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/ 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/ 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-19T04:00:44.659 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-19T04:00:44.660 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-19T04:00:44.661 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/ 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-19T04:00:44.662 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 273609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 883681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 324329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 282601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 493217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/ 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 420561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/ 2024-01-19T04:00:44.663 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 741449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 296881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 153801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/ 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 168969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 263081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-19T04:00:44.664 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 111425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 128753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 129529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/evbug.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ff-memless.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/ 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-19T04:00:44.665 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/ 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8323.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8333.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-19T04:00:44.666 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt1070.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt2160.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/stowaway.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/matrix-keymap.ko 2024-01-19T04:00:44.667 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/ 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 123417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 335953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/psmouse.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/ 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ 2024-01-19T04:00:44.668 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ct82c710.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/parkbd.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/pcips2.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ps2mult.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serport.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/ 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-88pm860x.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-adp5520.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-bd2802.ko 2024-01-19T04:00:44.669 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da903x.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da9052.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-gpio.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3533.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm355x.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3642.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp8788.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-max8997.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-mc13783.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-19T04:00:44.670 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca9532.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca955x.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca963x.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-tca6507.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm8350.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-19T04:00:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/ 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/ 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 647193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bufio.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 155897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-era.ko 2024-01-19T04:00:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-mirror.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-region-hash.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-snapshot.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 181865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-19T04:00:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-zero.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/ 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 199937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 158657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 393777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/ 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/ 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 178137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-19T04:00:44.674 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 123321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm800.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm805.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm80x.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona-i2c.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 123721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/bcm590xx.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/dln2.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/janz-cmodio.ko 2024-01-19T04:00:44.675 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/kempld-core.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-core.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lp3943.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/max8907.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/menf21bmc.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633.ko 2024-01-19T04:00:44.676 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/retu-mfd.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/si476x-core.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps65010.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps6507x.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wm8994.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot.ko 2024-01-19T04:00:44.677 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/ 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/ 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/core.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/ 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ds1682.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/dummy-irq.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/ 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/echo.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/ 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-19T04:00:44.678 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/ 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 152201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hmc6352.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ics932s401.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/ 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-19T04:00:44.679 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/ 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 313641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/phantom.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/ 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/ 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 183609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-19T04:00:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/ 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 490849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/ 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/ 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 106033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 455065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/ 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-19T04:00:44.681 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 130553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/ 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/ 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/ 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/ 2024-01-19T04:00:44.682 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/ 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/ 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-19T04:00:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-19T04:00:44.684 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/ 2024-01-19T04:00:44.684 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-19T04:00:44.684 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 176761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-19T04:00:44.684 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-19T04:00:44.684 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1421529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-19T04:00:44.753 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 128569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-19T04:00:44.753 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-19T04:00:44.753 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-19T04:00:44.753 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 314553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-19T04:00:44.753 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 323745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 193497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 347257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1044793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 166193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-19T04:00:44.754 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/ 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 204345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/ 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 141225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/ 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-19T04:00:44.755 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/ 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 281137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/ 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 295481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-19T04:00:44.756 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 584497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 246209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 937673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 287305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 514569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 734353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-19T04:00:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 151769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/ 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/ 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 727473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 278961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1118201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ 2024-01-19T04:00:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 95665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/ 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/ 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 150905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/ 2024-01-19T04:00:44.759 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 136721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/ 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/ 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 227897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 671937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/ 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/ 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-19T04:00:44.760 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 192353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/ 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/ 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1064737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/ 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/ 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/ 2024-01-19T04:00:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/ 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 487593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/ 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 166097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-19T04:00:44.762 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/ 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/ 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/ 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/ 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/ 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/ 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/defxx.ko 2024-01-19T04:00:44.763 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/ 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 216985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/ 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 236225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/ 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/ 2024-01-19T04:00:44.764 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/ 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-19T04:00:44.765 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 95561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-19T04:00:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/ 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/plip.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sb1000.ko 2024-01-19T04:00:44.767 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/ 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/ 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/ 2024-01-19T04:00:44.768 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/ 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 301281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/ 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/ 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/ 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 265777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/ 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-19T04:00:44.769 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/ 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/ 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pci-stub.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/ 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 146289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-19T04:00:44.770 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/ 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/ 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/ 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/ 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/ 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/ 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/ 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-19T04:00:44.771 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 132025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-19T04:00:44.772 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/ 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-19T04:00:44.773 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/ 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9030_battery.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9052-battery.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-19T04:00:44.774 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/gpio-charger.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max14577_charger.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max17042_battery.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8903_charger.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8925_power.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/sbs-battery.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/test_power.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-19T04:00:44.775 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_power.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm8350_power.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/ 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/ 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/ 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/ 2024-01-19T04:00:44.776 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9052.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9055.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9063.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-19T04:00:44.777 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8907.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8925.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8997.ko 2024-01-19T04:00:44.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8998.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-palmas.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-19T04:00:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 135185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-19T04:00:44.780 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/ 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 271113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/ 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 356929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 296049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/ 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 189185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/ 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 106881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/ 2024-01-19T04:00:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 247009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/ 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1171945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/ 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 237721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/ 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/ 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 308921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/ 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-19T04:00:44.782 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 146625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 75553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/ 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 212425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/ 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 158505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fdomain.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/ 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 263489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 201817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-19T04:00:44.783 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/imm.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 266537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/ 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 317153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/ 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 315209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 145585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-19T04:00:44.784 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/ 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 216441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/ 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2197481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/ 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 310841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/ 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 659801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/ 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-19T04:00:44.785 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/ 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/ 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 366401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ppa.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/ 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-19T04:00:44.786 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/ 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 559033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qlogicfas408.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 261241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 173937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 279313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 164961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-19T04:00:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/xen-scsifront.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 129441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/ 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/ 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 736769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/ 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 930697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-19T04:00:44.788 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/ 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 75593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/ 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/ 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-19T04:00:44.789 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/moxa.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/mxser.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-19T04:00:44.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/ 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/ 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_uart.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/ 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/rp2.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/ 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 535985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-19T04:00:44.791 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/ 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_mf624.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_netx.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/ 2024-01-19T04:00:44.792 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/ 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/ 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ulpi.ko 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/ 2024-01-19T04:00:44.793 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/ 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 454385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/ 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/ 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 92489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-19T04:00:44.794 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/ 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-19T04:00:44.795 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 161225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/ 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 157681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-19T04:00:44.796 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 75073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 156409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-19T04:00:44.797 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811_cs.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/ 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cytherm.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ehset.ko 2024-01-19T04:00:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/lvstest.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/ 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-19T04:00:44.799 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbtest.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/ 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/usbmon.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/ 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 301697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/ 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ 2024-01-19T04:00:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/f81232.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 175193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 137081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-19T04:00:44.801 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/metro-usb.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mxuport.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-19T04:00:44.802 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 191801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-19T04:00:44.803 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usbserial.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-19T04:00:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 180225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/ 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/ 2024-01-19T04:00:44.805 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/ 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 154297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/ 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/ 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/ 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-19T04:00:44.806 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/bd6107.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-19T04:00:44.807 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/ 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/ 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-19T04:00:44.808 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/acquirewdt.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/advantechwdt.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-19T04:00:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/dw_wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-19T04:00:44.810 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-19T04:00:44.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/retu_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-19T04:00:44.812 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/ 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/ 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 176441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-scsiback.ko 2024-01-19T04:00:44.813 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 166753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/adfs.ko 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 163449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 935033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/kafs.ko 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/autofs4.ko 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/ 2024-01-19T04:00:44.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/ 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/bfs.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/ 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 3455857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/ 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 306009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1336985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/ 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/ 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/configfs.ko 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/ 2024-01-19T04:00:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-19T04:00:44.816 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/ 2024-01-19T04:00:44.816 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 644073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-19T04:00:44.816 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/ 2024-01-19T04:00:44.816 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/efs.ko 2024-01-19T04:00:44.816 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/ 2024-01-19T04:00:44.816 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1506641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/ 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/ 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/freevxfs.ko 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/ 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 226481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/ 2024-01-19T04:00:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/ 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1229913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/ 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 141985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/ 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 223225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/ 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 193569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/hpfs.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/ 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/ 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 419881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/ 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 282049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-19T04:00:44.863 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/ 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/ 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/ 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/ 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/ 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/ 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 117465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1057969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv2.ko 2024-01-19T04:00:44.864 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 120265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2042153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/ 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/ 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1563929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/ 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 590713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/ 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-19T04:00:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ascii.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-19T04:00:44.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 142673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 165745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 118121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-19T04:00:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-19T04:00:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 220553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ntfs.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 244737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 440737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2593521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-19T04:00:44.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/ 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/omfs.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/ 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 370697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/ 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/qnx4.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/ 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/qnx6.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/ 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_tree.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v1.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v2.ko 2024-01-19T04:00:44.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 532025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2683249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 134777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/ 2024-01-19T04:00:44.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 248425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 162537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/ 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4014433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/ 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/ 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/locktorture.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/ 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/test_udelay.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc7.ko 2024-01-19T04:00:44.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/ 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/interval_tree_test.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/ 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/ 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/memory-notifier-error-inject.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/notifier-error-inject.ko 2024-01-19T04:00:44.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/percpu_test.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/pm-notifier-error-inject.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/ 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 143353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/rbtree_test.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/ 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-kstrtox.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-string_helpers.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_bpf.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_firmware.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_module.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_user_copy.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-19T04:00:44.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/ 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/xz_dec_test.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/ 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/ 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-19T04:00:44.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/ 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/ 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/ 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 198905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-19T04:00:44.876 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/ 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 649977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/ 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 785817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-19T04:00:44.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-19T04:00:44.878 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/ 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1047033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/ 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 126041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/ 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 194529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/ 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 390129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/ 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/hsr.ko 2024-01-19T04:00:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 255849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-19T04:00:44.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-19T04:00:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-19T04:00:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-19T04:00:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_gre.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/mip6.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-19T04:00:44.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-19T04:00:44.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/ 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/ 2024-01-19T04:00:44.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/ 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/lapb.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/ 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 268265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc2.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/ 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 290441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/ 2024-01-19T04:00:44.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 118801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-19T04:00:44.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 110753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 412561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-19T04:00:44.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 411489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 118193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-19T04:00:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 96545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-19T04:00:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 614025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-19T04:00:44.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_osf.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_synproxy.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tproxy.ko 2024-01-19T04:00:44.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/x_tables.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-19T04:00:44.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-19T04:00:44.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-19T04:00:44.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-19T04:00:44.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpudp.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-19T04:00:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/ 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/ 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/ 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 383481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/ 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/ 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/phonet.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/pn_pep.ko 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/ 2024-01-19T04:00:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 252953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 164937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/ 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 818777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/rxrpc.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/ 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-19T04:00:44.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_cgroup.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-19T04:00:44.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq_codel.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-19T04:00:44.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/ 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 932169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/ 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/ 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 336777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-19T04:00:44.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1518417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/ 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 708281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/ 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 866345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/ 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/ 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-19T04:00:44.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/ 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/x25.ko 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/ 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_algo.ko 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_user.ko 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/ 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/ 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 641009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 625033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7677 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23634 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9916 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70653 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 147734 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-19T04:00:44.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 234045 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 210 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72797 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 879 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 255175 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 309826 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/ 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/ 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/ 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/ 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 172 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/changelog.Debian.gz 2024-01-19T04:00:44.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 691 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/copyright 2024-01-19T04:00:44.907 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-19T04:00:44.907 INFO:teuthology.task.kernel:searching for kernel 6.7.0-g06652275eb93 2024-01-19T04:00:44.907 DEBUG:teuthology.orchestra.run.smithi032:> egrep '(submenu|menuentry.*6.7.0-g06652275eb93).*{' /boot/grub/grub.cfg 2024-01-19T04:00:44.914 INFO:teuthology.orchestra.run.smithi032.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-19T04:00:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-19T04:00:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-19T04:00:44.915 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-19T04:00:44.915 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-g06652275eb93 2024-01-19T04:00:44.915 DEBUG:teuthology.orchestra.run.smithi032:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-19T04:00:44.960 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi032.front.sepia.ceph.com to complete... 2024-01-19T04:00:45.355 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-01-19T04:00:45.356 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:00:45.377 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-01-19T04:00:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-19T04:00:45.572 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-19T04:00:45.788 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:00:45.794 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:00:45.838 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:00:45.843 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:00:45.966 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:00:45.966 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:00:45.966 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:00:45.994 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-01-19T04:00:52.619 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub' 2024-01-19T04:00:52.626 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:00:52.660 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-01-19T04:00:52.942 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-19T04:00:52.959 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-19T04:00:53.217 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:00:53.226 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:00:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:00:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:00:53.433 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:00:53.433 INFO:teuthology.orchestra.run.smithi067.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:00:53.433 INFO:teuthology.orchestra.run.smithi067.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:00:53.473 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-01-19T04:00:53.645 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-deb -c /tmp/linux-image.deb 2024-01-19T04:00:53.652 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./ 2024-01-19T04:00:53.653 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./boot/ 2024-01-19T04:00:53.653 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 4444641 2024-01-18 11:42 ./boot/System.map-6.7.0-g06652275eb93 2024-01-19T04:00:53.662 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 170149 2024-01-18 11:42 ./boot/config-6.7.0-g06652275eb93 2024-01-19T04:00:53.663 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11441152 2024-01-18 11:42 ./boot/vmlinuz-6.7.0-g06652275eb93 2024-01-19T04:00:53.680 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/ 2024-01-19T04:00:53.680 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/ 2024-01-19T04:00:53.680 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postinst.d/ 2024-01-19T04:00:53.680 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/postrm.d/ 2024-01-19T04:00:53.680 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/preinst.d/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./etc/kernel/prerm.d/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ 2024-01-19T04:00:53.681 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 490345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 106729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 152241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-19T04:00:53.684 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/ 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/ 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/ 2024-01-19T04:00:53.685 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-19T04:00:53.686 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpuid.ko 2024-01-19T04:00:53.686 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/msr.ko 2024-01-19T04:00:53.686 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/ 2024-01-19T04:00:53.686 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 353705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-19T04:00:53.686 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 881649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-19T04:00:53.686 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2276625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-19T04:00:53.764 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ 2024-01-19T04:00:53.764 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/af_alg.ko 2024-01-19T04:00:53.764 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_hash.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/algif_skcipher.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/ 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/ 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-19T04:00:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-19T04:00:53.766 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cryptd.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_simd.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-19T04:00:53.767 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lrw.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 149481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-19T04:00:53.768 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xts.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_extlog.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-19T04:00:53.769 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/ 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/apei/einj.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 104729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 88401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-19T04:00:53.770 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-19T04:00:53.771 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_legacy.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-19T04:00:53.772 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_radisys.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rz1000.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-19T04:00:53.773 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-19T04:00:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/ 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/ 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/ 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/ 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 965305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 173353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/ 2024-01-19T04:00:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 94297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 116321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/ 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 110737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 98281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 263769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/ 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 98185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/ 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/applicom.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/ 2024-01-19T04:00:53.776 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 148609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 139313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-19T04:00:53.777 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/ 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 84097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/nvram.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/ 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/ 2024-01-19T04:00:53.778 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/ 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-palmas.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-si5351.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-twl6040.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/clk/clk-wm831x.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/ 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ 2024-01-19T04:00:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 246841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/ 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/ 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 517033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/ 2024-01-19T04:00:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/ 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/ 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 79953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-19T04:00:53.781 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/ 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-gpio.ko 2024-01-19T04:00:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max14577.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max77693.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-max8997.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-palmas.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/ 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/ 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/ 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-19T04:00:53.783 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-arizona.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9052.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-da9055.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-dln2.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 77849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-generic.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-kempld.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max7300.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max730x.ko 2024-01-19T04:00:53.784 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-max732x.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-vx855.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-19T04:00:53.785 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/ 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-a4tech.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-apple.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-belkin.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cherry.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-chicony.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cp2112.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-cypress.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-19T04:00:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ezkey.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-generic.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kensington.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-19T04:00:53.787 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lg-g15.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-magicmouse.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-microsoft.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-monterey.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ntrig.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-19T04:00:53.788 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-19T04:00:53.789 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-19T04:00:53.790 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 143473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 269281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/ 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 217873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/ 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-19T04:00:53.791 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 305321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-19T04:00:53.792 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-19T04:00:53.793 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 99601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc2103.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 94689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-19T04:00:53.794 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hih6130.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 130449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/jc42.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-19T04:00:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-19T04:00:53.796 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-19T04:00:53.797 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 119689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-19T04:00:53.798 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-19T04:00:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-19T04:00:53.800 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 119505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/ 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/ 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-19T04:00:53.801 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/ 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-19T04:00:53.802 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-19T04:00:53.803 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/ 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-19T04:00:53.804 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 273609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 883681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 324329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 282601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 493217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/ 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 420561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-19T04:00:53.805 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 741449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 296881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 153801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 168969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 263081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ 2024-01-19T04:00:53.806 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 111425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 128753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 129529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/evbug.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/ff-memless.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/ 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/ 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-19T04:00:53.807 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8323.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/lm8333.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-19T04:00:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt1070.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/qt2160.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/stowaway.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/matrix-keymap.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/ 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 123417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-19T04:00:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 335953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/psmouse.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/ 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 109873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ct82c710.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-19T04:00:53.810 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/parkbd.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/pcips2.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/ps2mult.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serport.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/ 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-88pm860x.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-adp5520.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-bd2802.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da903x.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-da9052.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-gpio.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-19T04:00:53.811 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3533.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm355x.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3642.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp8788.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-max8997.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-mc13783.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca9532.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca955x.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-pca963x.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-tca6507.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-19T04:00:53.812 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-wm8350.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/ 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/ 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 647193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-19T04:00:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bufio.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 155897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 107257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-era.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-mirror.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-region-hash.ko 2024-01-19T04:00:53.814 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 109529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-snapshot.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 181865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-zero.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/ 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 199937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-19T04:00:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 158657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 393777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/ 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/ 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 178137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 123321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ 2024-01-19T04:00:53.816 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm800.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm805.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/88pm80x.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona-i2c.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 123721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/arizona.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/bcm590xx.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/dln2.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/janz-cmodio.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/kempld-core.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-core.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-19T04:00:53.817 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lp3943.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/max8907.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/menf21bmc.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/pcf50633.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/retu-mfd.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/si476x-core.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-19T04:00:53.818 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps65010.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/tps6507x.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wm8994.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ad525x_dpot.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/ 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/ 2024-01-19T04:00:53.819 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/c2port/core.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/ 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ds1682.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/dummy-irq.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/ 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/echo/echo.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/ 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/ 2024-01-19T04:00:53.820 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 152201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hmc6352.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ics932s401.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/ 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/ 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 313641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-19T04:00:53.821 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/phantom.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/ 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/ 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 183609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/ 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 490849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/ 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/ 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 106033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-19T04:00:53.822 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 455065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/ 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 130553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-19T04:00:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 99049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/ 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/ 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/ 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/ 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/ 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-19T04:00:53.824 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/ 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 90345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/ 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 176761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-19T04:00:53.825 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1421529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 128569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 131337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 314553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/ 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 323745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/ 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 193497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 347257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1044793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-19T04:00:53.826 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 166193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/ 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 204345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/ 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 141225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-19T04:00:53.827 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/ 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/ 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 281137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/ 2024-01-19T04:00:53.828 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 90369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 295481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 584497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 246209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 937673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 287305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/ 2024-01-19T04:00:53.829 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 514569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-19T04:00:53.974 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-19T04:00:53.974 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-19T04:00:53.974 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-19T04:00:53.974 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 734353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-19T04:00:53.974 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-19T04:00:53.974 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 151769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/ 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/ 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 727473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 278961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1118201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-19T04:00:53.975 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 95665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/ 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/ 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 150905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/ 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 136721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-19T04:00:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/ 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/ 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 227897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 671937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/ 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/ 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-19T04:00:53.977 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 192353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/ 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 104241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/ 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1064737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/ 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/ 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/ 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-19T04:00:53.978 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/ 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 487593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/ 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 166097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/ 2024-01-19T04:00:53.979 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/ 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/ 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/ 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/ 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/ 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/defxx.ko 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/ 2024-01-19T04:00:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 216985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/ 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 236225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/ 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/ 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-19T04:00:53.981 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/ 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-19T04:00:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 76409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 95561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/ 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/plip/plip.ko 2024-01-19T04:00:53.983 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sb1000.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/ 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-19T04:00:53.984 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/ 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 107089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/ 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 144361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-19T04:00:53.985 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/ 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 301281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/ 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 144001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/ 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/ 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 265777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/ 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 131249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/ 2024-01-19T04:00:53.986 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/ 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pci-stub.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/ 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 146289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/ 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/ 2024-01-19T04:00:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/ 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/ 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/ 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/ 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/ 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-19T04:00:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 132025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-19T04:00:53.989 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/ 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-19T04:00:53.990 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/ 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-19T04:00:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9030_battery.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/da9052-battery.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-19T04:00:53.992 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/gpio-charger.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max14577_charger.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max17042_battery.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8903_charger.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/max8925_power.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/sbs-battery.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/test_power.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm831x_power.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/power/supply/wm8350_power.ko 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/ 2024-01-19T04:00:53.993 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/ 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/ 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/ 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-19T04:00:53.994 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9052.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9055.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-da9063.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-19T04:00:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8907.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8925.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8997.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max8998.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-19T04:00:53.996 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-palmas.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-19T04:00:53.997 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 77617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 135185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/ 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 271113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-19T04:00:53.998 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/ 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 356929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 296049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/ 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 189185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/ 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 106881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/ 2024-01-19T04:00:53.999 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 247009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/ 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1171945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/ 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 237721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/ 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 115369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/ 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 308921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/ 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 76145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-19T04:00:54.000 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 101449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 146625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 75553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/ 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 212425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/ 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 158505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fdomain.ko 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/ 2024-01-19T04:00:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 263489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 201817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/imm.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 266537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 101473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/ 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 317153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/ 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 315209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-19T04:00:54.002 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 145585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/ 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 216441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/ 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2197481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/ 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 310841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 84649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/ 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 659801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/ 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 119561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-19T04:00:54.003 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/ 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/ 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 366401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ppa.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/ 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-19T04:00:54.004 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/ 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 559033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qlogicfas408.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 261241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 173937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 279313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 115889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-19T04:00:54.005 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 164961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/xen-scsifront.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 129441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/ 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/ 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 736769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/ 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-19T04:00:54.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 930697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/ 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 75593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/ 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/ 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-19T04:00:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-19T04:00:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/moxa.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/mxser.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/ 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/ 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/altera_uart.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-19T04:00:54.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/ 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/rp2.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/ 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 535985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/ 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-19T04:00:54.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_mf624.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_netx.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/ 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/ 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 144617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-19T04:00:54.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/ 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/common/ulpi.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/ 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/ 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-19T04:00:54.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 454385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/ 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/ 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 92489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-19T04:00:54.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-19T04:00:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-19T04:00:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-19T04:00:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-19T04:00:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-19T04:00:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/ 2024-01-19T04:00:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-19T04:00:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-19T04:00:54.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-19T04:00:54.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-19T04:00:54.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-19T04:00:54.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-19T04:00:54.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-19T04:00:54.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-19T04:00:54.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-19T04:00:54.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-19T04:00:54.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-19T04:00:54.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-19T04:00:54.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-19T04:00:54.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-19T04:00:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 161225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-19T04:00:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/ 2024-01-19T04:00:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-19T04:00:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-19T04:00:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 157681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-19T04:00:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-19T04:00:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-19T04:00:54.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-19T04:00:54.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-19T04:00:54.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 76057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-19T04:00:54.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 75073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-19T04:00:54.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-19T04:00:54.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 65809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 156409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811_cs.ko 2024-01-19T04:00:54.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/ 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/cytherm.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ehset.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-19T04:00:54.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/lvstest.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/ 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-19T04:00:54.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbtest.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/ 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/mon/usbmon.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/ 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 301697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/ 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-19T04:00:54.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/f81232.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 175193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 137081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-19T04:00:54.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 107521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/metro-usb.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mxuport.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-19T04:00:54.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 191801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-19T04:00:54.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33201 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usbserial.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-19T04:00:54.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 180225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/ 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/ 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/ 2024-01-19T04:00:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 154297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 77609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/ 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/ 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/ 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-19T04:00:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/bd6107.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-19T04:00:54.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/ 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/ 2024-01-19T04:00:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/acquirewdt.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/advantechwdt.ko 2024-01-19T04:00:54.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/dw_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-19T04:00:54.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/retu_wdt.ko 2024-01-19T04:00:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-19T04:00:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/ 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/ 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 176441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-scsiback.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/ 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ 2024-01-19T04:00:54.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/ 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 166753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/ 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/adfs/adfs.ko 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/ 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 163449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/ 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 935033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/afs/kafs.ko 2024-01-19T04:00:54.036 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/ 2024-01-19T04:00:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/autofs/autofs4.ko 2024-01-19T04:00:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/ 2024-01-19T04:00:54.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/ 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/bfs/bfs.ko 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/ 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 3455857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/ 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 306009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1336985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/ 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/ 2024-01-19T04:00:54.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/configfs/configfs.ko 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/ 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/ 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 644073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/ 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/efs/efs.ko 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/ 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1506641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/ 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/ 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/freevxfs/freevxfs.ko 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/ 2024-01-19T04:00:54.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 226481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/ 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/ 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1229913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/ 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 141985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/ 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 223225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/ 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 193569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/hpfs/hpfs.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/ 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/ 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 419881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-19T04:00:54.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/ 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 282049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/ 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/ 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/ 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/ 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/ 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/ 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 117465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1057969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv2.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 120265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-19T04:00:54.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2042153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/ 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/ 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1563929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/ 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 590713 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/ 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-19T04:00:54.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ascii.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-19T04:00:54.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-19T04:00:54.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 94137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 142673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 165745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 118121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-19T04:00:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 220553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ntfs/ntfs.ko 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ 2024-01-19T04:00:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 244737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 440737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2593521 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/ 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/omfs/omfs.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/ 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 370697 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ 2024-01-19T04:00:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/ 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx4/qnx4.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/ 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46689 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/qnx6/qnx6.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/ 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_tree.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v1.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/quota/quota_v2.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/ 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 532025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/ 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/ 2024-01-19T04:00:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/ 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2683249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/ 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/ 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 134777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/ 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 91249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/ 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 248425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ 2024-01-19T04:00:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 162537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/ 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 4014433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/ 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/ 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/locking/locktorture.ko 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/ 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/time/test_udelay.ko 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ 2024-01-19T04:00:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6833 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc7.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/ 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/interval_tree_test.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/ 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/ 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-19T04:00:54.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/memory-notifier-error-inject.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/notifier-error-inject.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/percpu_test.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/pm-notifier-error-inject.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/ 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 143353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/rbtree_test.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/ 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-kstrtox.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test-string_helpers.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 4876633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_bpf.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_firmware.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_module.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/test_user_copy.ko 2024-01-19T04:00:54.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/ 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/lib/xz/xz_dec_test.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/ 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/ 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-19T04:00:54.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/ 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/ 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/ 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 198905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-19T04:00:54.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/ 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 649977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/ 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 65137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 785817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-19T04:00:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9145 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13217 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9593 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11641 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-19T04:00:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/ 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1047033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/ 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 126041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/ 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 194529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/ 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 390129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-19T04:00:54.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7721 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/ 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 99881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/hsr/hsr.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 255849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-19T04:00:54.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-19T04:00:54.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-19T04:00:54.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-19T04:00:54.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11361 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39705 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-19T04:00:54.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_gre.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93977 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/mip6.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14137 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14273 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-19T04:00:54.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25225 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-19T04:00:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/ 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 84433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/ 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125305 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-19T04:00:54.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/ 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48121 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/lapb/lapb.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/ 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 268265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc2.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/ 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 290441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/ 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9393 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ 2024-01-19T04:00:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 118801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 110753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-19T04:00:54.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 412561 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-19T04:00:54.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49265 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 411489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 118193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-19T04:00:54.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11233 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10113 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 91737 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 96545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10129 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-19T04:00:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 614025 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42609 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9601 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11513 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-19T04:00:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13673 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_osf.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10081 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_synproxy.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tproxy.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/x_tables.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-19T04:00:54.074 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13369 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38873 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13889 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-19T04:00:54.075 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11073 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14337 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10433 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8321 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13193 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-19T04:00:54.076 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10969 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8801 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10657 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7865 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11785 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-19T04:00:54.077 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8001 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10209 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11825 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10105 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9729 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7633 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11985 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-19T04:00:54.078 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8257 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36457 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13329 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16913 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9505 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8809 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8553 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpudp.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11065 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/ 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/ 2024-01-19T04:00:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12425 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/ 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 383481 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9585 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/ 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13569 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/ 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112057 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/phonet.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54857 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/phonet/pn_pep.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/ 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 252953 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 164937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-19T04:00:54.080 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/ 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 818777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/rxrpc/rxrpc.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/ 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32241 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34097 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23401 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43449 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31961 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20289 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35297 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36665 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26465 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-19T04:00:54.081 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34353 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_cgroup.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32377 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61529 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7441 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33313 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7897 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21769 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20849 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-19T04:00:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34681 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35817 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31617 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq_codel.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35545 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49937 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22089 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66577 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30385 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10905 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26185 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36249 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27497 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10745 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-19T04:00:54.083 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24841 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48625 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26881 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28945 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28153 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/ 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 932169 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/ 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/ 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 336777 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54993 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-19T04:00:54.084 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1518417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/ 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 708281 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/ 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10489 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 866345 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/ 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/ 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86417 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68049 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 98017 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11177 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17761 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/ 2024-01-19T04:00:54.085 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125409 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/x25/x25.ko 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/ 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23041 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_algo.ko 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20649 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 104161 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_user.ko 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/ 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/ 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15537 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 641009 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 625033 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7677 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23634 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9916 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70653 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 147734 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-19T04:00:54.086 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 234045 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 210 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72797 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 879 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 255175 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 309826 2024-01-18 11:42 ./lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/ 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/ 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/ 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/ 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 172 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/changelog.Debian.gz 2024-01-19T04:00:54.087 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 691 2024-01-18 11:42 ./usr/share/doc/linux-image-6.7.0-g06652275eb93/copyright 2024-01-19T04:00:54.088 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-19T04:00:54.088 INFO:teuthology.task.kernel:searching for kernel 6.7.0-g06652275eb93 2024-01-19T04:00:54.088 DEBUG:teuthology.orchestra.run.smithi067:> egrep '(submenu|menuentry.*6.7.0-g06652275eb93).*{' /boot/grub/grub.cfg 2024-01-19T04:00:54.095 INFO:teuthology.orchestra.run.smithi067.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-19T04:00:54.095 INFO:teuthology.orchestra.run.smithi067.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-19T04:00:54.095 INFO:teuthology.orchestra.run.smithi067.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g06652275eb93 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g06652275eb93-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-19T04:00:54.096 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-19T04:00:54.096 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-g06652275eb93 2024-01-19T04:00:54.096 DEBUG:teuthology.orchestra.run.smithi067:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-19T04:00:54.141 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi067.front.sepia.ceph.com to complete... 2024-01-19T04:00:54.537 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub' 2024-01-19T04:00:54.538 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T04:00:54.552 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-01-19T04:00:54.732 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-6.7.0-g06652275eb93 2024-01-19T04:00:54.738 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-6.7.0-g06652275eb93 2024-01-19T04:00:54.962 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T04:00:54.967 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T04:00:55.007 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T04:00:55.012 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T04:00:55.175 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T04:00:55.176 INFO:teuthology.orchestra.run.smithi067.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T04:00:55.176 INFO:teuthology.orchestra.run.smithi067.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T04:00:55.201 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-01-19T04:01:17.193 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-19T04:01:17.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-19T04:01:17.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:01:26.337 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-19T04:01:26.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-19T04:01:26.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:01:35.548 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-19T04:01:44.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-19T04:01:44.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:01:44.768 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-19T04:01:53.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-19T04:01:53.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:01:56.828 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-19T04:02:02.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-19T04:02:08.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-19T04:02:08.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:02:14.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-19T04:02:14.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:02:18.016 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-19T04:02:33.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-19T04:02:33.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:02:33.299 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-01-19T04:02:34.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-19T04:02:34.036 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-g06652275eb93"... 2024-01-19T04:02:34.036 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-01-19T04:02:34.084 INFO:teuthology.orchestra.run.smithi032.stdout:6.7.0-g06652275eb93 2024-01-19T04:02:34.084 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-19T04:02:34.084 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-19T04:02:34.084 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-19T04:02:35.086 DEBUG:teuthology.parallel:result is None 2024-01-19T04:03:08.835 DEBUG:teuthology.orchestra.remote:timed out 2024-01-19T04:03:23.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-19T04:03:23.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:03:24.079 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-01-19T04:03:24.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-19T04:03:24.778 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.7.0-g06652275eb93"... 2024-01-19T04:03:24.778 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-01-19T04:03:24.826 INFO:teuthology.orchestra.run.smithi067.stdout:6.7.0-g06652275eb93 2024-01-19T04:03:24.826 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-19T04:03:24.826 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-19T04:03:24.826 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-19T04:03:25.827 DEBUG:teuthology.parallel:result is None 2024-01-19T04:03:25.827 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-19T04:03:25.837 INFO:teuthology.task.internal:Creating test directory... 2024-01-19T04:03:25.838 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-19T04:03:25.841 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-19T04:03:25.850 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-19T04:03:25.935 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-19T04:03:25.945 INFO:teuthology.task.internal:Creating archive directory... 2024-01-19T04:03:25.945 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-19T04:03:25.948 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-19T04:03:25.973 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-19T04:03:25.979 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-19T04:03:25.980 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-19T04:03:26.011 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-19T04:03:26.098 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:03:26.106 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:03:26.126 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:03:26.131 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T04:03:26.134 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-19T04:03:26.141 INFO:teuthology.task.internal:Configuring sudo... 2024-01-19T04:03:26.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-19T04:03:26.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-19T04:03:26.168 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-19T04:03:26.177 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-19T04:03:26.177 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-19T04:03:26.211 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-19T04:03:26.220 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-19T04:03:26.269 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-19T04:03:26.321 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:03:26.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-19T04:03:26.393 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-19T04:03:26.402 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-19T04:03:26.459 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:03:26.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-19T04:03:26.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-01-19T04:03:26.537 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-01-19T04:03:26.676 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-19T04:03:26.684 INFO:teuthology.task.internal:Starting timer... 2024-01-19T04:03:26.684 INFO:teuthology.run_tasks:Running task pcp... 2024-01-19T04:03:26.694 INFO:teuthology.run_tasks:Running task selinux... 2024-01-19T04:03:26.702 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2024-01-19T04:03:26.702 DEBUG:teuthology.task.selinux:Excluding smithi067: OS 'ubuntu' does not support SELinux 2024-01-19T04:03:26.702 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-19T04:03:26.702 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-19T04:03:26.702 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-19T04:03:26.702 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-19T04:03:26.713 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-19T04:03:26.718 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-19T04:03:26.874 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-19T04:03:26.893 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-19T04:03:26.895 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi067.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-19T04:10:58.027 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com')] 2024-01-19T04:10:58.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-19T04:10:58.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:10:58.111 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-01-19T04:10:58.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-19T04:10:58.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-19T04:10:58.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T04:10:58.351 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-01-19T04:10:58.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-19T04:10:58.467 INFO:teuthology.run_tasks:Running task clock... 2024-01-19T04:10:58.479 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-19T04:10:58.479 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-19T04:10:58.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T04:10:58.483 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-19T04:10:58.483 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Command line: ntpd -gq 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: ---------------------------------------------------- 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: ntp-4 is maintained by Network Time Foundation, 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: corporation. Support and training for ntp-4 are 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: available at https://www.nwtime.org/support 2024-01-19T04:10:58.521 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: ---------------------------------------------------- 2024-01-19T04:10:58.522 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: proto: precision = 0.043 usec (-24) 2024-01-19T04:10:58.522 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: basedate set to 2022-02-04 2024-01-19T04:10:58.522 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: gps base set to 2022-02-06 (week 2196) 2024-01-19T04:10:58.522 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:10:58.522 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:10:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Listen and drop on 0 v6wildcard [::]:123 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Listen normally on 2 lo 127.0.0.1:123 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Listen normally on 3 ens1f0 172.21.15.32:123 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Listen normally on 4 lo [::1]:123 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%4]:123 2024-01-19T04:10:58.524 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:10:58 ntpd[16749]: Listening on routing socket on fd #22 for interface updates 2024-01-19T04:10:58.548 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-19T04:10:58.548 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Command line: ntpd -gq 2024-01-19T04:10:58.548 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: ---------------------------------------------------- 2024-01-19T04:10:58.548 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: ntp-4 is maintained by Network Time Foundation, 2024-01-19T04:10:58.549 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-19T04:10:58.549 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: corporation. Support and training for ntp-4 are 2024-01-19T04:10:58.549 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: available at https://www.nwtime.org/support 2024-01-19T04:10:58.549 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: ---------------------------------------------------- 2024-01-19T04:10:58.549 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: proto: precision = 0.042 usec (-24) 2024-01-19T04:10:58.549 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: basedate set to 2022-02-04 2024-01-19T04:10:58.550 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: gps base set to 2022-02-06 (week 2196) 2024-01-19T04:10:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:10:58.550 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T04:10:58.550 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:10:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-19T04:10:58.551 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Listen and drop on 0 v6wildcard [::]:123 2024-01-19T04:10:58.551 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-19T04:10:58.552 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Listen normally on 2 lo 127.0.0.1:123 2024-01-19T04:10:58.552 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Listen normally on 3 enp3s0f1 172.21.15.67:123 2024-01-19T04:10:58.552 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Listen normally on 4 lo [::1]:123 2024-01-19T04:10:58.552 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:fc0b%5]:123 2024-01-19T04:10:58.552 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:10:58 ntpd[16829]: Listening on routing socket on fd #22 for interface updates 2024-01-19T04:10:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:10:59 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:10:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:10:59 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:10:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:10:59 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:10:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:10:59 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:10:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:10:59 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:10:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:10:59 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:00.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:00 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:00.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:00 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:00.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:00 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:00.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:00 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:00.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:00 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:00.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:00 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:00 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:00 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:01.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:01 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:01.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:01.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:01 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:02.521 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:02 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:02.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:02 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:02.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:02 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:02.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:02 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:02.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:02 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:02.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:02 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:03.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:03.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:03.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:03.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:03 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:03.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.550 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:03 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:04.521 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:04 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:04.521 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:04 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:04.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:04 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:04.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:04 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:04.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:04 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:04.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:04 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:05.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.522 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:05.523 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:05 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:05.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.551 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:05.553 INFO:teuthology.orchestra.run.smithi067.stdout:19 Jan 04:11:05 ntpd[16829]: ntpd: time slew -0.000640 s 2024-01-19T04:11:05.553 INFO:teuthology.orchestra.run.smithi067.stdout:ntpd: time slew -0.000640s 2024-01-19T04:11:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-19T04:11:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:19 Jan 04:11:05 ntpd[16829]: can't open /var/log/ntpstats/loopstats.20240119: Permission denied 2024-01-19T04:11:05.646 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T04:11:05.646 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-01-19T04:11:05.646 INFO:teuthology.orchestra.run.smithi067.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:05.646 INFO:teuthology.orchestra.run.smithi067.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:05.646 INFO:teuthology.orchestra.run.smithi067.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:05.646 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stdout:19 Jan 04:11:06 ntpd[16749]: ntpd: time slew -0.001230 s 2024-01-19T04:11:06.525 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew -0.001230s 2024-01-19T04:11:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-19T04:11:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:19 Jan 04:11:06 ntpd[16749]: can't open /var/log/ntpstats/loopstats.20240119: Permission denied 2024-01-19T04:11:06.616 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T04:11:06.616 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-01-19T04:11:06.616 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:06.616 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:06.616 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:06.616 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:11:06.617 INFO:teuthology.run_tasks:Running task install... 2024-01-19T04:11:06.626 DEBUG:teuthology.task.install:project ceph 2024-01-19T04:11:06.627 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}} 2024-01-19T04:11:06.627 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'} 2024-01-19T04:11:06.627 INFO:teuthology.task.install:Using flavor: default 2024-01-19T04:11:06.633 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-19T04:11:06.633 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-19T04:11:06.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2024-01-19T04:11:06.634 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-key list | grep Ceph 2024-01-19T04:11:06.742 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-19T04:11:06.770 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-19T04:11:06.795 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-19T04:11:06.795 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph.com (release key) 2024-01-19T04:11:06.796 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-19T04:11:06.796 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-19T04:11:06.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:11:06.823 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-19T04:11:06.823 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2024-01-19T04:11:06.824 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-19T04:11:06.824 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-19T04:11:06.824 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:11:07.013 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-19T04:11:07.013 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:11:07.042 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-19T04:11:07.042 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:11:07.191 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:11:07.191 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-19T04:11:07.211 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2024-01-19T04:11:07.214 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:11:07.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-19T04:11:07.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-01-19T04:11:07.404 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:11:07.404 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T04:11:07.414 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T04:11:07.442 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T04:11:07.476 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-19T04:11:07.497 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-19T04:11:07.516 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-19T04:11:07.519 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-19T04:11:07.540 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-19T04:11:07.552 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-19T04:11:07.562 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T04:11:07.563 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T04:11:07.583 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-19T04:11:07.590 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-19T04:11:07.625 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T04:11:07.626 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-19T04:11:07.675 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-19T04:11:07.707 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T04:11:08.011 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 28.9 kB in 1s (50.4 kB/s) 2024-01-19T04:11:08.169 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 28.9 kB in 1s (41.1 kB/s) 2024-01-19T04:11:08.966 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-01-19T04:11:08.980 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:11:09.056 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-01-19T04:11:09.137 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-01-19T04:11:09.151 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:11:09.224 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-01-19T04:11:09.225 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-01-19T04:11:09.227 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-01-19T04:11:09.386 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:11:09.387 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:11:09.387 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:11:09.387 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:11:09.387 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:11:09.388 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:11:09.388 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:11:09.388 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-01-19T04:11:09.388 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-19T04:11:09.388 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-19T04:11:09.388 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T04:11:09.388 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-19T04:11:09.390 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-19T04:11:09.391 INFO:teuthology.orchestra.run.smithi067.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-19T04:11:09.392 INFO:teuthology.orchestra.run.smithi067.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-19T04:11:09.392 INFO:teuthology.orchestra.run.smithi067.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-19T04:11:09.392 INFO:teuthology.orchestra.run.smithi067.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-19T04:11:09.392 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2024-01-19T04:11:09.392 INFO:teuthology.orchestra.run.smithi067.stdout: btrfs-tools 2024-01-19T04:11:09.397 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-01-19T04:11:09.398 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-19T04:11:09.543 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-19T04:11:09.544 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-19T04:11:09.545 INFO:teuthology.orchestra.run.smithi067.stdout: socat unzip xmlstarlet zip 2024-01-19T04:11:09.558 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:11:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:11:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:11:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:11:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:11:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:11:09.559 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-19T04:11:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-19T04:11:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-01-19T04:11:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2024-01-19T04:11:09.719 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-19T04:11:09.720 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-19T04:11:09.721 INFO:teuthology.orchestra.run.smithi032.stdout: socat unzip xmlstarlet zip 2024-01-19T04:11:09.739 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-19T04:11:09.739 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 173 MB of archives. 2024-01-19T04:11:09.739 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-19T04:11:09.739 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-19T04:11:09.768 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-19T04:11:09.795 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-19T04:11:09.795 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 173 MB of archives. 2024-01-19T04:11:09.795 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-19T04:11:09.795 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-19T04:11:09.816 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-19T04:11:09.821 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-19T04:11:09.828 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-19T04:11:09.867 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-19T04:11:09.869 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-19T04:11:09.879 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-19T04:11:09.904 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-19T04:11:09.907 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-19T04:11:09.921 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-19T04:11:09.994 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-19T04:11:09.999 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-19T04:11:10.015 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-19T04:11:10.020 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-19T04:11:10.021 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-19T04:11:10.032 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-19T04:11:10.034 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-19T04:11:10.038 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-19T04:11:10.039 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-19T04:11:10.040 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-19T04:11:10.063 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-19T04:11:10.065 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-19T04:11:10.068 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-19T04:11:10.068 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-19T04:11:10.069 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-19T04:11:10.069 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-19T04:11:10.070 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-19T04:11:10.085 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-19T04:11:10.086 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-19T04:11:10.086 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-19T04:11:10.086 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-19T04:11:10.110 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-19T04:11:10.110 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-19T04:11:10.112 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-19T04:11:10.113 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-19T04:11:10.113 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-19T04:11:10.114 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-19T04:11:10.117 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-19T04:11:10.130 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-19T04:11:10.131 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-19T04:11:10.131 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-19T04:11:10.132 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-19T04:11:10.151 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-19T04:11:10.151 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-19T04:11:10.157 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-19T04:11:10.157 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-19T04:11:10.158 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-19T04:11:10.158 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-19T04:11:10.163 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-19T04:11:10.172 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-19T04:11:10.174 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-19T04:11:10.175 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-19T04:11:10.176 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-19T04:11:10.176 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-19T04:11:10.192 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-19T04:11:10.196 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-19T04:11:10.196 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-19T04:11:10.197 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-19T04:11:10.199 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-19T04:11:10.227 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-19T04:11:10.252 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-19T04:11:10.275 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-19T04:11:10.276 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-19T04:11:10.277 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-19T04:11:10.277 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-19T04:11:10.278 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-19T04:11:10.279 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-19T04:11:10.289 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-19T04:11:10.290 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-19T04:11:10.296 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-19T04:11:10.298 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-19T04:11:10.309 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-19T04:11:10.311 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-19T04:11:10.314 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-19T04:11:10.314 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-19T04:11:10.346 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-19T04:11:10.354 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-19T04:11:10.355 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-19T04:11:10.355 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-19T04:11:10.356 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-19T04:11:10.357 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-19T04:11:10.388 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-19T04:11:10.388 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-19T04:11:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-19T04:11:10.395 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-19T04:11:10.397 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-19T04:11:10.401 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-19T04:11:10.404 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-19T04:11:10.410 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-19T04:11:10.422 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-19T04:11:10.426 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-19T04:11:10.429 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-19T04:11:10.430 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-19T04:11:10.431 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-19T04:11:10.438 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-19T04:11:10.445 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-19T04:11:10.451 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-19T04:11:10.457 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-19T04:11:10.458 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-19T04:11:10.461 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-19T04:11:10.461 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-19T04:11:10.478 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-19T04:11:10.479 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-19T04:11:10.481 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-19T04:11:10.482 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-19T04:11:10.492 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-19T04:11:10.509 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-19T04:11:10.510 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-19T04:11:10.513 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-19T04:11:10.514 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-19T04:11:10.562 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-19T04:11:10.566 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-19T04:11:10.590 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-19T04:11:10.609 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-19T04:11:10.825 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-19T04:11:10.920 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-19T04:11:10.972 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-19T04:11:10.973 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-19T04:11:10.999 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-19T04:11:11.008 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-19T04:11:11.053 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-19T04:11:11.191 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-19T04:11:11.206 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-19T04:11:11.222 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-19T04:11:11.230 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-19T04:11:11.231 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-19T04:11:11.247 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-19T04:11:11.285 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-19T04:11:11.298 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-19T04:11:11.301 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-19T04:11:11.302 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-19T04:11:11.471 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-19T04:11:11.553 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-19T04:11:11.575 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-19T04:11:11.583 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-19T04:11:11.634 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-19T04:11:11.677 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-19T04:11:11.699 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-19T04:11:11.720 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-19T04:11:11.796 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-19T04:11:11.804 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-19T04:11:11.809 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-19T04:11:11.875 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-19T04:11:11.892 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-19T04:11:11.907 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-19T04:11:11.908 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-19T04:11:11.914 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-19T04:11:11.919 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-19T04:11:11.921 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-19T04:11:11.991 INFO:teuthology.orchestra.run.smithi067.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-19T04:11:12.103 INFO:teuthology.orchestra.run.smithi067.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-19T04:11:12.147 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-19T04:11:12.186 INFO:teuthology.orchestra.run.smithi067.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-19T04:11:12.201 INFO:teuthology.orchestra.run.smithi067.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-19T04:11:12.387 INFO:teuthology.orchestra.run.smithi067.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-19T04:11:12.438 INFO:teuthology.orchestra.run.smithi067.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-19T04:11:12.450 INFO:teuthology.orchestra.run.smithi067.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-19T04:11:12.608 INFO:teuthology.orchestra.run.smithi067.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-19T04:11:12.609 INFO:teuthology.orchestra.run.smithi067.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-19T04:11:12.614 INFO:teuthology.orchestra.run.smithi067.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-19T04:11:12.618 INFO:teuthology.orchestra.run.smithi067.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-19T04:11:12.632 INFO:teuthology.orchestra.run.smithi067.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-19T04:11:12.819 INFO:teuthology.orchestra.run.smithi067.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-19T04:11:13.076 INFO:teuthology.orchestra.run.smithi067.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-19T04:11:13.129 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-19T04:11:13.130 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-19T04:11:13.157 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-19T04:11:13.207 INFO:teuthology.orchestra.run.smithi067.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-19T04:11:13.249 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-19T04:11:13.251 INFO:teuthology.orchestra.run.smithi067.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-19T04:11:13.280 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-19T04:11:13.288 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-19T04:11:13.340 INFO:teuthology.orchestra.run.smithi067.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-19T04:11:13.350 INFO:teuthology.orchestra.run.smithi067.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-19T04:11:13.362 INFO:teuthology.orchestra.run.smithi067.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-19T04:11:13.368 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-19T04:11:13.404 INFO:teuthology.orchestra.run.smithi067.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-19T04:11:13.669 INFO:teuthology.orchestra.run.smithi067.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-19T04:11:13.669 INFO:teuthology.orchestra.run.smithi067.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-19T04:11:13.671 INFO:teuthology.orchestra.run.smithi067.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-19T04:11:13.748 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-19T04:11:13.748 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-19T04:11:13.835 INFO:teuthology.orchestra.run.smithi067.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-19T04:11:14.177 INFO:teuthology.orchestra.run.smithi067.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-19T04:11:14.577 INFO:teuthology.orchestra.run.smithi067.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-19T04:11:14.587 INFO:teuthology.orchestra.run.smithi067.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-19T04:11:14.588 INFO:teuthology.orchestra.run.smithi067.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-19T04:11:14.660 INFO:teuthology.orchestra.run.smithi067.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-19T04:11:14.661 INFO:teuthology.orchestra.run.smithi067.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-19T04:11:14.662 INFO:teuthology.orchestra.run.smithi067.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-19T04:11:14.662 INFO:teuthology.orchestra.run.smithi067.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-19T04:11:14.663 INFO:teuthology.orchestra.run.smithi067.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-19T04:11:14.664 INFO:teuthology.orchestra.run.smithi067.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-19T04:11:14.828 INFO:teuthology.orchestra.run.smithi067.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-19T04:11:15.031 INFO:teuthology.orchestra.run.smithi067.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-19T04:11:15.105 INFO:teuthology.orchestra.run.smithi067.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-19T04:11:15.354 INFO:teuthology.orchestra.run.smithi067.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-19T04:11:15.400 INFO:teuthology.orchestra.run.smithi067.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-19T04:11:15.427 INFO:teuthology.orchestra.run.smithi067.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-19T04:11:15.436 INFO:teuthology.orchestra.run.smithi067.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-19T04:11:15.481 INFO:teuthology.orchestra.run.smithi067.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-19T04:11:15.508 INFO:teuthology.orchestra.run.smithi067.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-19T04:11:15.509 INFO:teuthology.orchestra.run.smithi067.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-19T04:11:15.516 INFO:teuthology.orchestra.run.smithi067.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-19T04:11:15.519 INFO:teuthology.orchestra.run.smithi067.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-19T04:11:15.715 INFO:teuthology.orchestra.run.smithi067.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-19T04:11:15.800 INFO:teuthology.orchestra.run.smithi067.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-19T04:11:15.826 INFO:teuthology.orchestra.run.smithi067.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-19T04:11:15.844 INFO:teuthology.orchestra.run.smithi067.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-19T04:11:15.887 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-19T04:11:15.888 INFO:teuthology.orchestra.run.smithi032.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-19T04:11:15.890 INFO:teuthology.orchestra.run.smithi032.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-19T04:11:15.891 INFO:teuthology.orchestra.run.smithi032.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-19T04:11:15.891 INFO:teuthology.orchestra.run.smithi032.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-19T04:11:15.892 INFO:teuthology.orchestra.run.smithi032.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-19T04:11:15.973 INFO:teuthology.orchestra.run.smithi067.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-19T04:11:16.015 INFO:teuthology.orchestra.run.smithi067.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-19T04:11:16.235 INFO:teuthology.orchestra.run.smithi067.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-19T04:11:16.237 INFO:teuthology.orchestra.run.smithi067.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-19T04:11:16.253 INFO:teuthology.orchestra.run.smithi067.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-19T04:11:16.258 INFO:teuthology.orchestra.run.smithi067.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-19T04:11:16.296 INFO:teuthology.orchestra.run.smithi067.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-19T04:11:16.310 INFO:teuthology.orchestra.run.smithi067.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-19T04:11:16.401 INFO:teuthology.orchestra.run.smithi067.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-19T04:11:16.402 INFO:teuthology.orchestra.run.smithi067.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-19T04:11:16.403 INFO:teuthology.orchestra.run.smithi067.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-19T04:11:16.466 INFO:teuthology.orchestra.run.smithi032.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-19T04:11:16.577 INFO:teuthology.orchestra.run.smithi067.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-19T04:11:16.583 INFO:teuthology.orchestra.run.smithi067.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-19T04:11:16.855 INFO:teuthology.orchestra.run.smithi067.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-19T04:11:17.126 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 173 MB in 7s (25.7 MB/s) 2024-01-19T04:11:17.275 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-19T04:11:17.344 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-19T04:11:17.348 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-19T04:11:17.390 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-19T04:11:17.717 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-19T04:11:17.731 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-19T04:11:17.776 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:11:17.885 INFO:teuthology.orchestra.run.smithi067.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-19T04:11:17.886 INFO:teuthology.orchestra.run.smithi067.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-19T04:11:17.924 INFO:teuthology.orchestra.run.smithi067.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-19T04:11:18.066 INFO:teuthology.orchestra.run.smithi067.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-19T04:11:18.087 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cmd2. 2024-01-19T04:11:18.101 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-19T04:11:18.145 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-19T04:11:18.195 INFO:teuthology.orchestra.run.smithi067.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-19T04:11:18.196 INFO:teuthology.orchestra.run.smithi067.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-19T04:11:18.395 INFO:teuthology.orchestra.run.smithi067.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-19T04:11:18.490 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-19T04:11:18.504 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-19T04:11:18.590 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:11:18.927 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-19T04:11:18.942 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-19T04:11:18.977 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:11:19.296 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-19T04:11:19.311 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-19T04:11:19.355 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:11:19.644 INFO:teuthology.orchestra.run.smithi067.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-19T04:11:19.644 INFO:teuthology.orchestra.run.smithi067.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-19T04:11:19.791 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-19T04:11:19.807 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:11:19.891 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:11:20.386 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-19T04:11:20.401 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:11:20.444 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:11:20.730 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-19T04:11:20.746 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:11:20.788 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:11:21.150 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-19T04:11:21.165 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-19T04:11:21.458 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:11:21.702 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librados2. 2024-01-19T04:11:21.718 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:21.760 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:22.180 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librbd1. 2024-01-19T04:11:22.196 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:22.238 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:22.641 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2024-01-19T04:11:22.655 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:22.699 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:22.977 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2024-01-19T04:11:22.991 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:23.026 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:23.321 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-19T04:11:23.335 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:23.379 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:23.632 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2024-01-19T04:11:23.647 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:23.690 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:23.984 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-19T04:11:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:24.395 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2024-01-19T04:11:24.410 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-19T04:11:24.453 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-19T04:11:24.698 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2024-01-19T04:11:24.713 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:24.747 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:24.860 INFO:teuthology.orchestra.run.smithi067.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-19T04:11:24.861 INFO:teuthology.orchestra.run.smithi067.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-19T04:11:24.877 INFO:teuthology.orchestra.run.smithi067.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-19T04:11:24.895 INFO:teuthology.orchestra.run.smithi067.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-19T04:11:24.896 INFO:teuthology.orchestra.run.smithi067.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-19T04:11:24.896 INFO:teuthology.orchestra.run.smithi067.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-19T04:11:25.059 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-19T04:11:25.074 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-19T04:11:25.117 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:11:25.420 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-19T04:11:25.435 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-19T04:11:25.478 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:11:25.789 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-19T04:11:25.805 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-19T04:11:25.847 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:11:26.073 INFO:teuthology.orchestra.run.smithi067.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-19T04:11:26.192 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua5.1. 2024-01-19T04:11:26.207 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-19T04:11:26.250 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:11:26.629 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-any. 2024-01-19T04:11:26.644 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-19T04:11:26.687 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-19T04:11:26.742 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 173 MB in 17s (10.5 MB/s) 2024-01-19T04:11:26.892 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-19T04:11:26.948 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package zip. 2024-01-19T04:11:26.961 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-19T04:11:26.963 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-19T04:11:26.964 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-19T04:11:27.006 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking zip (3.0-12build2) ... 2024-01-19T04:11:27.007 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-19T04:11:27.326 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package unzip. 2024-01-19T04:11:27.335 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-19T04:11:27.341 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-19T04:11:27.349 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-19T04:11:27.384 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:11:27.393 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:11:27.788 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cmd2. 2024-01-19T04:11:27.796 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package luarocks. 2024-01-19T04:11:27.802 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-19T04:11:27.811 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-19T04:11:27.838 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-19T04:11:27.854 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:11:28.149 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-19T04:11:28.163 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-19T04:11:28.241 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:11:28.253 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2024-01-19T04:11:28.268 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:28.311 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:28.545 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-19T04:11:28.559 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-19T04:11:28.602 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:11:28.789 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2024-01-19T04:11:28.803 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:28.856 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:28.930 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-19T04:11:28.946 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-19T04:11:28.989 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:11:29.192 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-19T04:11:29.206 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-19T04:11:29.250 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:11:29.401 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-19T04:11:29.416 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:11:29.458 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:11:29.536 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2024-01-19T04:11:29.551 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:29.594 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:29.837 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-19T04:11:29.852 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:11:29.895 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:11:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2024-01-19T04:11:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:30.223 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-19T04:11:30.238 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T04:11:30.273 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:11:30.593 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-19T04:11:30.608 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-19T04:11:30.651 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:11:30.987 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librados2. 2024-01-19T04:11:31.002 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:31.045 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:31.227 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2024-01-19T04:11:31.243 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:31.303 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:31.623 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librbd1. 2024-01-19T04:11:31.638 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:31.681 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:32.034 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2. 2024-01-19T04:11:32.049 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:32.082 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-19T04:11:32.084 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:32.096 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-19T04:11:32.148 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:11:32.353 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rados. 2024-01-19T04:11:32.368 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:32.411 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:32.509 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cheroot. 2024-01-19T04:11:32.525 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-19T04:11:32.576 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:11:32.722 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-19T04:11:32.737 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:32.772 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:32.970 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-19T04:11:32.982 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cephfs. 2024-01-19T04:11:32.986 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-19T04:11:32.998 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:33.037 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:11:33.043 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:33.343 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-19T04:11:33.359 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:33.402 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:33.440 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-19T04:11:33.456 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-19T04:11:33.506 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:11:33.730 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-prettytable. 2024-01-19T04:11:33.745 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-19T04:11:33.788 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-19T04:11:33.901 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-19T04:11:33.917 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-19T04:11:33.959 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:11:34.049 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rbd. 2024-01-19T04:11:34.064 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:34.107 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:34.337 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempora. 2024-01-19T04:11:34.353 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-19T04:11:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-19T04:11:34.403 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-19T04:11:34.409 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-19T04:11:34.443 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:11:34.729 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-19T04:11:34.744 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-19T04:11:34.775 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-portend. 2024-01-19T04:11:34.787 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:11:34.790 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-19T04:11:34.841 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-19T04:11:35.073 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-19T04:11:35.089 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-19T04:11:35.132 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:11:35.177 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-19T04:11:35.194 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-19T04:11:35.236 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-19T04:11:35.476 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua5.1. 2024-01-19T04:11:35.492 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-19T04:11:35.526 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:11:35.564 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-19T04:11:35.580 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-19T04:11:35.621 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:11:35.788 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-any. 2024-01-19T04:11:35.802 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-19T04:11:35.846 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-19T04:11:35.925 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2024-01-19T04:11:35.940 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-19T04:11:35.975 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-19T04:11:36.081 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package zip. 2024-01-19T04:11:36.097 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-19T04:11:36.140 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking zip (3.0-12build2) ... 2024-01-19T04:11:36.245 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2024-01-19T04:11:36.260 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-19T04:11:36.303 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-19T04:11:36.485 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package unzip. 2024-01-19T04:11:36.500 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-19T04:11:36.543 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:11:36.639 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-19T04:11:36.654 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-19T04:11:36.697 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2024-01-19T04:11:37.016 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-19T04:11:37.021 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package luarocks. 2024-01-19T04:11:37.037 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-19T04:11:37.058 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:11:37.071 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:11:37.411 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-19T04:11:37.412 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2. 2024-01-19T04:11:37.426 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:37.427 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-19T04:11:37.469 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:11:37.470 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:37.764 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-19T04:11:37.780 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-19T04:11:37.814 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:11:37.906 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rgw. 2024-01-19T04:11:37.920 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:37.964 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:38.083 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2024-01-19T04:11:38.099 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-19T04:11:38.143 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:11:38.300 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-19T04:11:38.315 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-19T04:11:38.358 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:11:38.486 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2024-01-19T04:11:38.502 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-19T04:11:38.547 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:11:38.645 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1. 2024-01-19T04:11:38.660 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:38.694 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:38.872 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2024-01-19T04:11:38.888 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-19T04:11:38.930 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:11:39.081 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common. 2024-01-19T04:11:39.096 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:39.139 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:39.217 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2024-01-19T04:11:39.233 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-19T04:11:39.266 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:11:39.603 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-19T04:11:39.619 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-19T04:11:39.669 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:11:40.056 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-19T04:11:40.072 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-19T04:11:40.122 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:11:40.236 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-base. 2024-01-19T04:11:40.251 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:40.303 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:40.500 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2024-01-19T04:11:40.516 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-19T04:11:40.566 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-19T04:11:40.832 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-19T04:11:40.847 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-19T04:11:40.889 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:11:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2024-01-19T04:11:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-19T04:11:40.994 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:11:41.185 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cheroot. 2024-01-19T04:11:41.199 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-19T04:11:41.234 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:11:41.340 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-certifi. 2024-01-19T04:11:41.355 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-19T04:11:41.399 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-19T04:11:41.521 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-19T04:11:41.536 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-19T04:11:41.624 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:11:41.710 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-idna. 2024-01-19T04:11:41.724 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-19T04:11:41.776 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-19T04:11:42.304 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-urllib3. 2024-01-19T04:11:42.320 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-19T04:11:42.371 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:11:42.640 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-19T04:11:42.655 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-19T04:11:42.698 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:11:42.968 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-19T04:11:42.983 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-19T04:11:43.018 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:11:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempora. 2024-01-19T04:11:43.336 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-19T04:11:43.379 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-19T04:11:43.432 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests. 2024-01-19T04:11:43.449 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-19T04:11:43.499 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:11:43.681 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-portend. 2024-01-19T04:11:43.697 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-19T04:11:43.739 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-19T04:11:43.894 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-19T04:11:43.909 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-19T04:11:43.960 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:11:44.059 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-19T04:11:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-19T04:11:44.117 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-19T04:11:44.296 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-19T04:11:44.312 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:44.346 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:44.387 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-19T04:11:44.402 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-19T04:11:44.445 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:11:44.743 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-19T04:11:44.758 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:44.765 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-natsort. 2024-01-19T04:11:44.780 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-19T04:11:44.800 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:44.815 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-19T04:11:45.095 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-19T04:11:45.110 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-logutils. 2024-01-19T04:11:45.111 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-19T04:11:45.125 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-19T04:11:45.153 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:11:45.168 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-19T04:11:45.456 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2024-01-19T04:11:45.471 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-19T04:11:45.472 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-19T04:11:45.486 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-19T04:11:45.506 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-19T04:11:45.529 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:11:45.809 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2024-01-19T04:11:45.825 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:45.840 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-mako. 2024-01-19T04:11:45.856 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-19T04:11:45.867 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:45.898 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:11:46.252 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-19T04:11:46.253 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2024-01-19T04:11:46.267 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-19T04:11:46.269 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:46.301 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:11:46.312 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:46.571 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-19T04:11:46.586 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-19T04:11:46.629 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:11:46.915 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webob. 2024-01-19T04:11:46.915 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2024-01-19T04:11:46.930 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:46.931 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-19T04:11:46.965 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:46.973 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:11:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-waitress. 2024-01-19T04:11:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-19T04:11:47.373 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:11:47.656 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempita. 2024-01-19T04:11:47.672 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-19T04:11:47.706 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:11:47.718 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2024-01-19T04:11:47.733 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:47.776 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:47.992 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-paste. 2024-01-19T04:11:48.008 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-19T04:11:48.050 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:11:48.104 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2024-01-19T04:11:48.120 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:48.162 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:48.320 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-19T04:11:48.335 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-19T04:11:48.370 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:11:48.473 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2024-01-19T04:11:48.489 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:48.532 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:48.682 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-19T04:11:48.697 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-19T04:11:48.739 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:11:48.926 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2024-01-19T04:11:48.942 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:48.984 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:49.051 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webtest. 2024-01-19T04:11:49.067 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-19T04:11:49.109 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-19T04:11:49.304 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-19T04:11:49.320 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-19T04:11:49.362 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pecan. 2024-01-19T04:11:49.362 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-19T04:11:49.377 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-19T04:11:49.420 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:11:49.682 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-19T04:11:49.697 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:11:49.740 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:11:49.750 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-certifi. 2024-01-19T04:11:49.765 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-19T04:11:49.800 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-19T04:11:50.111 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-idna. 2024-01-19T04:11:50.127 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-19T04:11:50.169 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-19T04:11:50.489 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-urllib3. 2024-01-19T04:11:50.504 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-19T04:11:50.547 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:11:50.711 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-babel. 2024-01-19T04:11:50.726 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:11:50.761 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:11:50.867 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests. 2024-01-19T04:11:50.882 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-19T04:11:50.925 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:11:51.080 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2024-01-19T04:11:51.094 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-19T04:11:51.138 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-19T04:11:51.236 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-19T04:11:51.252 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-19T04:11:51.319 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:11:51.466 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-19T04:11:51.481 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:51.516 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:51.606 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-19T04:11:51.622 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:51.664 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:51.820 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-19T04:11:51.834 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-19T04:11:51.869 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-19T04:11:52.035 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-19T04:11:52.051 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:52.269 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:52.389 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2024-01-19T04:11:52.404 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-19T04:11:52.447 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:11:52.571 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-19T04:11:52.586 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-19T04:11:52.630 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:11:52.725 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-19T04:11:52.740 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:52.774 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:52.932 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-openssl. 2024-01-19T04:11:52.948 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-19T04:11:52.990 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-19T04:11:53.228 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-19T04:11:53.243 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-19T04:11:53.286 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr. 2024-01-19T04:11:53.286 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:11:53.301 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:53.335 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:53.722 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon. 2024-01-19T04:11:53.738 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:53.780 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:53.806 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2024-01-19T04:11:53.821 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-19T04:11:53.856 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:11:54.226 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-19T04:11:54.241 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-19T04:11:54.343 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd. 2024-01-19T04:11:54.358 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:54.371 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:11:54.400 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:54.664 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2024-01-19T04:11:54.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-19T04:11:54.714 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:11:55.170 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph. 2024-01-19T04:11:55.185 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:55.228 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:55.423 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-19T04:11:55.437 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:55.481 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:55.556 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse. 2024-01-19T04:11:55.571 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:55.614 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:55.917 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds. 2024-01-19T04:11:55.933 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:55.967 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:56.337 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephadm. 2024-01-19T04:11:56.352 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:11:56.394 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:56.442 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2024-01-19T04:11:56.458 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-19T04:11:56.501 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-19T04:11:56.706 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-19T04:11:56.721 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-19T04:11:56.762 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-19T04:11:56.777 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-19T04:11:56.781 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-19T04:11:56.820 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:11:57.092 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-19T04:11:57.107 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:11:57.140 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-19T04:11:57.150 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:11:57.156 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-19T04:11:57.198 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:11:57.534 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2024-01-19T04:11:57.550 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-19T04:11:57.601 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-19T04:11:57.921 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2024-01-19T04:11:57.937 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-19T04:11:57.987 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-19T04:11:58.130 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-babel. 2024-01-19T04:11:58.144 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T04:11:58.179 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:11:58.307 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-19T04:11:58.324 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-19T04:11:58.365 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:11:58.483 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jinja2. 2024-01-19T04:11:58.497 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-19T04:11:58.532 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-19T04:11:58.660 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2024-01-19T04:11:58.676 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-19T04:11:58.710 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-19T04:11:58.869 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-19T04:11:58.883 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:58.918 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:59.013 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-19T04:11:59.029 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-19T04:11:59.071 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:11:59.206 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-19T04:11:59.220 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-19T04:11:59.255 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-19T04:11:59.517 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-routes. 2024-01-19T04:11:59.531 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-19T04:11:59.575 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:11:59.818 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-19T04:11:59.833 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:59.876 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:11:59.877 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-19T04:11:59.892 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:11:59.927 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:00.196 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-19T04:12:00.210 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-19T04:12:00.254 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:12:00.314 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-19T04:12:00.328 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-19T04:12:00.372 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:12:00.523 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-19T04:12:00.538 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:12:00.573 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:12:00.851 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2024-01-19T04:12:00.866 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:12:00.876 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-joblib. 2024-01-19T04:12:00.890 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-19T04:12:00.918 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-19T04:12:00.934 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:12:01.170 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2024-01-19T04:12:01.185 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-19T04:12:01.228 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:12:01.262 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-19T04:12:01.276 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-19T04:12:01.398 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:12:01.523 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2024-01-19T04:12:01.538 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-19T04:12:01.581 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:12:01.684 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn. 2024-01-19T04:12:01.699 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-19T04:12:01.742 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:12:01.927 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2024-01-19T04:12:01.942 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:01.985 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:02.426 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-19T04:12:02.440 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:02.476 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:03.504 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cachetools. 2024-01-19T04:12:03.520 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-19T04:12:03.562 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-19T04:12:03.874 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-19T04:12:03.890 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-19T04:12:03.932 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:12:03.989 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2024-01-19T04:12:04.006 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:04.039 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:04.294 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-19T04:12:04.309 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-19T04:12:04.351 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:12:04.418 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-19T04:12:04.434 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:04.468 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:04.638 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rsa. 2024-01-19T04:12:04.654 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-19T04:12:04.687 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-19T04:12:04.779 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-colorama. 2024-01-19T04:12:04.795 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-19T04:12:04.837 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-19T04:12:04.992 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-google-auth. 2024-01-19T04:12:05.008 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-19T04:12:05.049 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-19T04:12:05.081 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-shell. 2024-01-19T04:12:05.097 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:05.139 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:05.378 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-19T04:12:05.394 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-19T04:12:05.425 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-top. 2024-01-19T04:12:05.436 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:12:05.442 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:05.483 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:05.731 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-websocket. 2024-01-19T04:12:05.745 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-19T04:12:05.747 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-19T04:12:05.761 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:05.789 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-19T04:12:05.794 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:06.030 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-19T04:12:06.046 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-19T04:12:06.080 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:12:06.134 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-19T04:12:06.150 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-19T04:12:06.192 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:12:06.409 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-19T04:12:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-19T04:12:06.467 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:12:06.864 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-19T04:12:06.871 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2024-01-19T04:12:06.879 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:06.887 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-19T04:12:06.922 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:06.929 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:12:07.225 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-19T04:12:07.240 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-19T04:12:07.283 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:12:07.568 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pkg-config. 2024-01-19T04:12:07.583 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-19T04:12:07.660 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:12:07.811 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-19T04:12:07.827 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:12:07.869 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:12:07.887 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-19T04:12:07.903 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-19T04:12:07.937 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:12:08.139 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package jq. 2024-01-19T04:12:08.155 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T04:12:08.197 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-19T04:12:08.324 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-19T04:12:08.339 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-19T04:12:08.373 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-19T04:12:08.450 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package socat. 2024-01-19T04:12:08.467 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-19T04:12:08.508 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:12:08.643 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2024-01-19T04:12:08.658 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-19T04:12:08.701 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-19T04:12:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package xmlstarlet. 2024-01-19T04:12:08.811 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-19T04:12:08.844 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:12:09.054 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2024-01-19T04:12:09.070 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-19T04:12:09.112 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:12:09.199 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test. 2024-01-19T04:12:09.215 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:09.257 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:09.424 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2024-01-19T04:12:09.440 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-19T04:12:09.482 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-19T04:12:09.818 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2024-01-19T04:12:09.834 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-19T04:12:09.910 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-19T04:12:10.238 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pygments. 2024-01-19T04:12:10.254 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-19T04:12:10.296 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:12:10.683 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-19T04:12:10.698 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-19T04:12:10.732 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:12:11.069 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-toml. 2024-01-19T04:12:11.084 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-19T04:12:11.094 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-volume. 2024-01-19T04:12:11.111 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:11.127 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-19T04:12:11.152 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:11.430 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2024-01-19T04:12:11.445 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-19T04:12:11.488 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:12:11.565 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-19T04:12:11.581 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:11.623 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:11.824 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2024-01-19T04:12:11.839 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-19T04:12:11.882 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:12:11.935 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-colorama. 2024-01-19T04:12:11.951 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-19T04:12:11.993 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-19T04:12:12.177 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-19T04:12:12.192 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-19T04:12:12.220 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-shell. 2024-01-19T04:12:12.236 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:12.237 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:12:12.270 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:12.531 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-top. 2024-01-19T04:12:12.547 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T04:12:12.589 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:12.842 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-19T04:12:12.858 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:12.900 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:13.091 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2024-01-19T04:12:13.106 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:13.141 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:13.194 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-19T04:12:13.211 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-19T04:12:13.269 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:12:13.590 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-19T04:12:13.607 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-19T04:12:13.648 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:12:13.727 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2024-01-19T04:12:13.743 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:13.785 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:14.011 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package nvme-cli. 2024-01-19T04:12:14.027 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-19T04:12:14.069 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:12:14.088 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-19T04:12:14.366 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:12:14.449 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pkg-config. 2024-01-19T04:12:14.465 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-19T04:12:14.492 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:12:14.498 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:12:14.743 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-19T04:12:14.755 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-19T04:12:14.759 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-19T04:12:14.801 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:12:15.138 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-19T04:12:15.221 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-19T04:12:15.237 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-19T04:12:15.279 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-19T04:12:15.591 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastescript. 2024-01-19T04:12:15.607 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-19T04:12:15.649 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-19T04:12:15.689 INFO:teuthology.orchestra.run.smithi032.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-19T04:12:15.735 INFO:teuthology.orchestra.run.smithi032.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-19T04:12:15.777 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:15.944 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pluggy. 2024-01-19T04:12:15.960 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-19T04:12:15.993 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:12:16.280 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-psutil. 2024-01-19T04:12:16.296 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-19T04:12:16.330 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2024-01-19T04:12:16.338 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-19T04:12:16.516 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:12:16.649 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-py. 2024-01-19T04:12:16.666 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-19T04:12:16.707 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-19T04:12:16.826 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:12:17.027 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pygments. 2024-01-19T04:12:17.044 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-19T04:12:17.085 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:12:17.102 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:12:17.194 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:12:17.446 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-19T04:12:17.548 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-19T04:12:17.563 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-19T04:12:17.606 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:12:17.713 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:12:17.848 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-19T04:12:17.917 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-toml. 2024-01-19T04:12:17.934 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-19T04:12:17.975 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-19T04:12:18.158 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:12:18.270 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pytest. 2024-01-19T04:12:18.286 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-19T04:12:18.328 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:12:18.535 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-19T04:12:18.665 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplejson. 2024-01-19T04:12:18.682 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-19T04:12:18.750 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:12:18.803 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-19T04:12:19.026 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-19T04:12:19.043 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-19T04:12:19.071 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-19T04:12:19.084 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:12:19.347 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:12:19.574 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:12:19.788 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw. 2024-01-19T04:12:19.803 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:19.833 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:12:19.837 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:20.109 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:12:20.376 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:20.382 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse. 2024-01-19T04:12:20.398 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T04:12:20.440 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:20.628 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:12:20.728 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:12:20.752 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-19T04:12:20.888 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-19T04:12:21.028 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T04:12:21.154 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T04:12:21.156 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:12:21.256 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:12:21.427 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-19T04:12:21.516 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:12:21.825 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-19T04:12:21.905 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-19T04:12:21.938 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-19T04:12:22.027 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:12:22.128 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-19T04:12:22.419 INFO:teuthology.orchestra.run.smithi067.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-19T04:12:22.471 INFO:teuthology.orchestra.run.smithi067.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-19T04:12:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:12:22.523 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:22.622 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-19T04:12:22.899 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:12:23.175 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:12:23.319 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user cephadm....done 2024-01-19T04:12:23.471 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T04:12:23.492 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up zip (3.0-12build2) ... 2024-01-19T04:12:23.618 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:12:23.830 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-19T04:12:24.090 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-19T04:12:24.225 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-19T04:12:24.320 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:12:24.467 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-19T04:12:24.588 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:12:24.714 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:12:24.735 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T04:12:24.840 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:12:24.861 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-19T04:12:25.158 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-19T04:12:25.179 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T04:12:25.556 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-19T04:12:25.567 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-19T04:12:25.816 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-19T04:12:25.835 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:12:26.075 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-19T04:12:26.228 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:12:26.368 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-19T04:12:26.521 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-19T04:12:26.603 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-19T04:12:26.839 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:12:26.888 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-19T04:12:27.164 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-19T04:12:27.199 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:12:27.423 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:27.491 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:12:27.617 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:27.685 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T04:12:27.810 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T04:12:27.927 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-idna (3.3-1) ... 2024-01-19T04:12:28.112 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-19T04:12:28.278 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:12:28.387 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T04:12:28.513 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-19T04:12:28.781 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-19T04:12:29.184 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-19T04:12:29.211 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-19T04:12:29.284 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T04:12:29.385 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-19T04:12:29.543 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:12:29.753 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T04:12:29.819 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:12:29.879 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-19T04:12:29.937 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-19T04:12:30.155 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T04:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:12:30.331 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:12:30.431 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-19T04:12:30.456 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:12:30.741 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up zip (3.0-12build2) ... 2024-01-19T04:12:30.808 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:12:30.850 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T04:12:31.084 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-19T04:12:31.352 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:12:31.478 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:12:31.594 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T04:12:31.780 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:12:31.870 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T04:12:31.996 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-19T04:12:32.039 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-19T04:12:32.122 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T04:12:32.315 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-19T04:12:32.448 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-19T04:12:32.591 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:12:32.840 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-19T04:12:32.858 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-19T04:12:33.100 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T04:12:33.135 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:12:33.252 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-19T04:12:33.502 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T04:12:33.545 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:12:33.671 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:12:33.811 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-19T04:12:34.014 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:12:34.137 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T04:12:34.357 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:12:34.497 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-19T04:12:34.625 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:12:34.748 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-19T04:12:34.750 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:12:34.849 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:34.876 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:12:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-19T04:12:35.175 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-idna (3.3-1) ... 2024-01-19T04:12:35.220 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:12:35.329 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:12:35.501 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T04:12:35.714 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:12:35.990 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-19T04:12:36.116 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-19T04:12:36.376 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:12:36.476 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-19T04:12:36.765 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T04:12:36.794 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:12:37.025 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:12:37.103 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:12:37.134 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-19T04:12:37.380 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-19T04:12:37.394 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T04:12:37.520 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-19T04:12:37.591 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-19T04:12:37.646 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T04:12:37.851 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-19T04:12:37.956 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-19T04:12:38.118 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:12:38.223 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-19T04:12:38.387 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:12:38.474 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:12:38.592 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-19T04:12:38.814 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-19T04:12:38.894 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-19T04:12:39.115 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:12:39.153 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-19T04:12:39.429 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-19T04:12:39.467 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:12:39.618 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:39.697 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-19T04:12:39.744 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:39.845 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:12:39.973 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-19T04:12:40.157 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:40.232 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T04:12:40.283 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:40.333 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-19T04:12:40.409 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-19T04:12:40.643 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T04:12:40.719 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:40.744 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T04:12:40.844 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:40.970 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:41.036 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-19T04:12:41.198 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:12:41.199 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:12:41.354 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-19T04:12:41.630 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T04:12:41.756 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-19T04:12:41.805 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:41.882 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T04:12:41.931 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:41.971 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-19T04:12:42.057 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:42.166 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:42.226 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T04:12:42.267 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:12:42.360 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T04:12:42.786 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-19T04:12:43.062 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-19T04:12:43.188 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-19T04:12:43.481 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T04:12:43.588 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:43.607 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-19T04:12:43.950 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T04:12:44.039 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:44.168 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:44.288 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T04:12:44.290 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:44.416 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:44.542 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:44.569 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-19T04:12:44.763 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-19T04:12:45.031 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-19T04:12:45.079 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2024-01-19T04:12:45.291 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T04:12:45.463 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2024-01-19T04:12:45.567 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-19T04:12:45.616 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2024-01-19T04:12:45.635 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-19T04:12:45.783 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-19T04:12:45.936 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-19T04:12:46.196 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-19T04:12:46.237 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T04:12:46.640 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T04:12:46.765 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:46.860 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:46.891 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:47.009 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-19T04:12:47.074 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:12:47.074 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:12:47.329 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:47.454 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:47.572 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-19T04:12:47.753 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:47.857 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:47.879 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:47.991 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:48.134 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:48.350 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:12:48.350 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T04:12:48.410 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:12:48.411 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:12:48.981 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:49.027 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:49.154 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:49.279 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:49.367 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-19T04:12:49.405 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:49.531 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T04:12:49.983 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:50.196 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:12:50.196 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:12:50.776 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:50.868 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:50.994 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:51.004 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:12:51.004 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:12:51.120 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:51.246 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:51.372 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:51.473 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:51.695 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:51.998 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:12:51.998 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:12:52.002 INFO:teuthology.orchestra.run.smithi067.stdout:Adding group ceph....done 2024-01-19T04:12:52.494 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user ceph....done 2024-01-19T04:12:52.655 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:52.680 INFO:teuthology.orchestra.run.smithi067.stdout:Setting system user ceph properties....done 2024-01-19T04:12:52.698 INFO:teuthology.orchestra.run.smithi067.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-19T04:12:52.789 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:52.851 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-19T04:12:52.931 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:53.148 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:12:53.148 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:12:53.268 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-19T04:12:53.749 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:53.909 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:53.916 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:54.035 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:54.114 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:12:54.114 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T04:12:54.177 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:54.539 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-19T04:12:54.648 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:12:54.717 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:54.800 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:12:54.851 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:55.398 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:12:55.398 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T04:12:55.934 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:12:56.003 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:56.372 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-19T04:12:56.649 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:12:56.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-19T04:12:56.729 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-01-19T04:12:56.898 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-01-19T04:12:56.898 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-01-19T04:12:57.051 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:12:57.054 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:12:57.055 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:12:57.055 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:12:57.056 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-01-19T04:12:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-19T04:12:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-19T04:12:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-19T04:12:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-19T04:12:57.056 INFO:teuthology.orchestra.run.smithi032.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:12:57.057 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-01-19T04:12:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-19T04:12:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-19T04:12:57.057 INFO:teuthology.orchestra.run.smithi032.stdout: libengine-pkcs11-openssl 2024-01-19T04:12:57.107 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-01-19T04:12:57.108 INFO:teuthology.orchestra.run.smithi032.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-19T04:12:57.108 INFO:teuthology.orchestra.run.smithi032.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-19T04:12:57.108 INFO:teuthology.orchestra.run.smithi032.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-19T04:12:57.108 INFO:teuthology.orchestra.run.smithi032.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-19T04:12:57.109 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-19T04:12:57.109 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-19T04:12:57.109 INFO:teuthology.orchestra.run.smithi032.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:12:57.110 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-01-19T04:12:57.110 INFO:teuthology.orchestra.run.smithi032.stdout: libssl3 2024-01-19T04:12:57.292 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:12:57.292 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T04:12:57.294 INFO:teuthology.orchestra.run.smithi032.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-19T04:12:57.294 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 54.6 MB of archives. 2024-01-19T04:12:57.294 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-19T04:12:57.294 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-19T04:12:57.787 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-19T04:12:57.915 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:58.045 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-19T04:12:58.079 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-19T04:12:58.082 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-19T04:12:58.086 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-19T04:12:58.090 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-19T04:12:58.091 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-19T04:12:58.093 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-19T04:12:58.096 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-19T04:12:58.118 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:12:58.119 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T04:12:58.261 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-19T04:12:58.261 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-19T04:12:58.517 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-19T04:12:58.951 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:59.242 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:12:59.242 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T04:12:59.547 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-19T04:12:59.549 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-19T04:12:59.549 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-19T04:12:59.552 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-19T04:12:59.553 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-19T04:12:59.557 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-19T04:12:59.575 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-19T04:12:59.582 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-19T04:12:59.747 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-19T04:12:59.836 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:12:59.962 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:13:00.105 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:13:00.321 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:13:00.321 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T04:13:00.487 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-19T04:13:00.487 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-19T04:13:00.514 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-19T04:13:00.591 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-19T04:13:00.600 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-19T04:13:00.601 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-19T04:13:00.601 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-19T04:13:00.602 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-19T04:13:00.630 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-19T04:13:00.633 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-19T04:13:01.023 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:13:01.157 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:13:01.261 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-19T04:13:01.283 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:13:01.344 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-19T04:13:01.344 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-19T04:13:01.344 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-19T04:13:01.426 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T04:13:01.440 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-19T04:13:01.457 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-19T04:13:01.813 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-19T04:13:01.901 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-19T04:13:01.904 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-19T04:13:01.922 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:13:02.159 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:13:02.308 INFO:teuthology.orchestra.run.smithi032.stdout:Preconfiguring packages ... 2024-01-19T04:13:02.451 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2024-01-19T04:13:02.617 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package flex. 2024-01-19T04:13:02.689 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140578 files and directories currently installed.) 2024-01-19T04:13:02.693 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-19T04:13:02.732 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-19T04:13:03.278 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:13:03.406 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:13:03.422 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-19T04:13:03.821 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:13:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:13:04.177 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-19T04:13:04.252 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-01-19T04:13:04.428 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-01-19T04:13:04.428 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-01-19T04:13:04.432 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package bison. 2024-01-19T04:13:04.505 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140651 files and directories currently installed.) 2024-01-19T04:13:04.508 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-19T04:13:04.551 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:13:04.584 INFO:teuthology.orchestra.run.smithi067.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-19T04:13:04.584 INFO:teuthology.orchestra.run.smithi067.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-19T04:13:04.584 INFO:teuthology.orchestra.run.smithi067.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:13:04.584 INFO:teuthology.orchestra.run.smithi067.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-19T04:13:04.584 INFO:teuthology.orchestra.run.smithi067.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-19T04:13:04.584 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T04:13:04.585 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T04:13:04.585 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T04:13:04.585 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T04:13:04.585 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T04:13:04.585 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T04:13:04.586 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T04:13:04.586 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-01-19T04:13:04.586 INFO:teuthology.orchestra.run.smithi067.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-19T04:13:04.586 INFO:teuthology.orchestra.run.smithi067.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-19T04:13:04.586 INFO:teuthology.orchestra.run.smithi067.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-19T04:13:04.586 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-19T04:13:04.587 INFO:teuthology.orchestra.run.smithi067.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:13:04.587 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-01-19T04:13:04.587 INFO:teuthology.orchestra.run.smithi067.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-19T04:13:04.587 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-19T04:13:04.587 INFO:teuthology.orchestra.run.smithi067.stdout: libengine-pkcs11-openssl 2024-01-19T04:13:04.638 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-01-19T04:13:04.639 INFO:teuthology.orchestra.run.smithi067.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-19T04:13:04.639 INFO:teuthology.orchestra.run.smithi067.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-19T04:13:04.639 INFO:teuthology.orchestra.run.smithi067.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-19T04:13:04.639 INFO:teuthology.orchestra.run.smithi067.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-19T04:13:04.640 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-19T04:13:04.640 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-19T04:13:04.640 INFO:teuthology.orchestra.run.smithi067.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T04:13:04.641 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2024-01-19T04:13:04.641 INFO:teuthology.orchestra.run.smithi067.stdout: libssl3 2024-01-19T04:13:04.825 INFO:teuthology.orchestra.run.smithi067.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-19T04:13:04.825 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 54.6 MB of archives. 2024-01-19T04:13:04.826 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-19T04:13:04.826 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-19T04:13:04.976 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-19T04:13:04.991 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-19T04:13:05.034 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:13:05.319 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-19T04:13:05.354 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package dump. 2024-01-19T04:13:05.369 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-19T04:13:05.404 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking dump (0.4b47-3) ... 2024-01-19T04:13:05.577 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-19T04:13:05.611 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-19T04:13:05.613 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-19T04:13:05.618 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-19T04:13:05.622 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-19T04:13:05.622 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-19T04:13:05.627 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-19T04:13:05.629 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-19T04:13:05.630 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-19T04:13:05.649 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package indent. 2024-01-19T04:13:05.664 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:05.707 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:13:05.794 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-19T04:13:05.985 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-19T04:13:06.000 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-19T04:13:06.043 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:13:06.130 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-19T04:13:06.380 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-19T04:13:06.396 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-19T04:13:06.438 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:13:06.666 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-19T04:13:06.682 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-19T04:13:06.716 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:13:07.061 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-19T04:13:07.077 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-19T04:13:07.119 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:07.198 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-19T04:13:07.200 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-19T04:13:07.201 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-19T04:13:07.203 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-19T04:13:07.204 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-19T04:13:07.208 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-19T04:13:07.210 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-19T04:13:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-19T04:13:07.227 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-19T04:13:07.372 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-19T04:13:07.388 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-19T04:13:07.430 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:07.470 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-19T04:13:07.553 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-19T04:13:07.674 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjson-perl. 2024-01-19T04:13:07.690 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-19T04:13:07.732 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-19T04:13:08.019 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-19T04:13:08.028 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-19T04:13:08.035 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-19T04:13:08.077 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:13:08.157 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-19T04:13:08.169 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-19T04:13:08.169 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-19T04:13:08.170 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-19T04:13:08.171 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-19T04:13:08.206 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-19T04:13:08.208 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-19T04:13:08.651 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-19T04:13:08.816 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-19T04:13:08.899 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-19T04:13:08.899 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-19T04:13:08.981 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-19T04:13:08.989 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-19T04:13:09.456 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-19T04:13:09.458 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-19T04:13:09.460 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-19T04:13:09.472 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:13:09.514 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:09.783 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-19T04:13:09.799 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:13:09.833 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:09.864 INFO:teuthology.orchestra.run.smithi067.stdout:Preconfiguring packages ... 2024-01-19T04:13:10.016 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-01-19T04:13:10.085 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-19T04:13:10.102 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:13:10.135 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:10.157 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package flex. 2024-01-19T04:13:10.232 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140578 files and directories currently installed.) 2024-01-19T04:13:10.236 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-19T04:13:10.280 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-19T04:13:10.522 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-19T04:13:10.538 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-19T04:13:10.580 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:13:10.759 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:13:10.891 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-19T04:13:10.907 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:13:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-19T04:13:10.949 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:13:11.244 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-19T04:13:11.260 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:11.293 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:11.310 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:13:11.638 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-19T04:13:11.654 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:11.698 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:11.912 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package bison. 2024-01-19T04:13:11.976 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-19T04:13:11.984 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140651 files and directories currently installed.) 2024-01-19T04:13:11.988 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-19T04:13:11.992 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:12.031 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:13:12.059 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:12.270 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-19T04:13:12.286 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:13:12.320 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:13:12.440 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-19T04:13:12.455 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-19T04:13:12.498 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:13:12.807 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-19T04:13:12.823 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-19T04:13:12.834 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package dump. 2024-01-19T04:13:12.850 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-19T04:13:12.865 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:13:12.893 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking dump (0.4b47-3) ... 2024-01-19T04:13:13.180 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package indent. 2024-01-19T04:13:13.195 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:13.218 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package modemmanager. 2024-01-19T04:13:13.229 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:13:13.235 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:13:13.276 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:13.448 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-19T04:13:13.465 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-19T04:13:13.523 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:13:13.861 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-19T04:13:13.877 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-19T04:13:13.891 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager. 2024-01-19T04:13:13.908 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:13:13.919 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:13:13.958 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:13:14.222 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-19T04:13:14.239 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-19T04:13:14.280 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:13:14.558 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-19T04:13:14.575 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-19T04:13:14.608 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:14.853 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-19T04:13:14.869 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-19T04:13:14.911 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:15.025 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ppp. 2024-01-19T04:13:15.042 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-19T04:13:15.163 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjson-perl. 2024-01-19T04:13:15.180 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-19T04:13:15.221 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-19T04:13:15.340 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:13:15.583 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-19T04:13:15.599 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-19T04:13:15.633 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:13:15.646 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pptp-linux. 2024-01-19T04:13:15.661 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-19T04:13:15.704 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-19T04:13:15.982 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-19T04:13:15.997 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-19T04:13:16.041 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-19T04:13:16.319 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-19T04:13:16.334 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-19T04:13:16.369 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-common (238) ... 2024-01-19T04:13:16.673 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-19T04:13:16.689 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:16.731 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:16.969 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-19T04:13:16.985 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:13:17.027 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:17.313 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-19T04:13:17.319 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-common. 2024-01-19T04:13:17.330 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T04:13:17.335 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-19T04:13:17.371 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:17.396 INFO:teuthology.orchestra.run.smithi032.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-19T04:13:17.426 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-common (238) ... 2024-01-19T04:13:17.699 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-19T04:13:17.715 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:13:17.757 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:17.894 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-14. 2024-01-19T04:13:17.909 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:17.955 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:18.035 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-19T04:13:18.051 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-19T04:13:18.101 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:13:18.429 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-19T04:13:18.446 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:13:18.487 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:13:18.832 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-19T04:13:18.849 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:18.890 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:19.064 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql. 2024-01-19T04:13:19.079 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-19T04:13:19.122 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql (14+238) ... 2024-01-19T04:13:19.252 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-19T04:13:19.269 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:19.311 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:19.399 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client. 2024-01-19T04:13:19.415 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-19T04:13:19.458 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client (14+238) ... 2024-01-19T04:13:19.580 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-19T04:13:19.595 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:19.638 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:19.685 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-19T04:13:19.701 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-19T04:13:19.752 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-19T04:13:19.882 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-19T04:13:19.898 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T04:13:19.940 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:13:20.038 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package tcl8.6. 2024-01-19T04:13:20.054 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-19T04:13:20.088 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:13:20.374 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package tcl. 2024-01-19T04:13:20.390 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-19T04:13:20.437 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-19T04:13:20.451 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-19T04:13:20.467 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-19T04:13:20.512 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:13:20.769 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package wpasupplicant. 2024-01-19T04:13:20.785 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-19T04:13:20.827 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:13:20.856 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package modemmanager. 2024-01-19T04:13:20.872 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T04:13:20.915 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:21.173 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-19T04:13:21.189 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-19T04:13:21.231 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-19T04:13:21.563 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager. 2024-01-19T04:13:21.580 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T04:13:21.629 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:13:21.643 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-19T04:13:21.660 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-19T04:13:21.710 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:13:22.014 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-common (238) ... 2024-01-19T04:13:22.185 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ppp. 2024-01-19T04:13:22.202 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-19T04:13:22.224 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-19T04:13:22.350 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:13:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:22.554 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:13:22.736 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:13:22.862 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:13:22.882 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pptp-linux. 2024-01-19T04:13:22.897 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-19T04:13:22.940 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-19T04:13:22.988 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:23.193 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-19T04:13:23.208 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-19T04:13:23.317 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-19T04:13:23.579 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-19T04:13:23.594 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-19T04:13:23.629 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-common (238) ... 2024-01-19T04:13:23.932 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-19T04:13:23.948 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:23.968 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-19T04:13:23.990 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:13:24.437 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:13:24.437 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:13:24.772 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-common. 2024-01-19T04:13:24.788 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-19T04:13:24.849 INFO:teuthology.orchestra.run.smithi067.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-19T04:13:24.879 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-common (238) ... 2024-01-19T04:13:25.122 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:13:25.248 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:13:25.354 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-14. 2024-01-19T04:13:25.370 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T04:13:25.374 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-19T04:13:25.415 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:25.509 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:13:25.618 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:25.727 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:13:25.862 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:13:26.516 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql. 2024-01-19T04:13:26.525 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:13:26.531 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-19T04:13:26.565 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql (14+238) ... 2024-01-19T04:13:26.652 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up dump (0.4b47-3) ... 2024-01-19T04:13:26.739 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-19T04:13:26.776 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client. 2024-01-19T04:13:26.791 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-19T04:13:26.795 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:26.834 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client (14+238) ... 2024-01-19T04:13:26.932 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:13:27.056 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-19T04:13:27.078 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-19T04:13:27.094 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-19T04:13:27.136 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-19T04:13:27.181 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-19T04:13:27.307 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:13:27.406 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-19T04:13:27.448 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl8.6. 2024-01-19T04:13:27.463 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-19T04:13:27.476 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:13:27.505 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:13:27.594 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:13:27.767 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl. 2024-01-19T04:13:27.782 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-19T04:13:27.821 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-19T04:13:27.895 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:13:28.013 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:28.172 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-19T04:13:28.177 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package wpasupplicant. 2024-01-19T04:13:28.194 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-19T04:13:28.235 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:13:28.340 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client (14+238) ... 2024-01-19T04:13:28.466 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:13:28.607 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-19T04:13:28.623 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-19T04:13:28.656 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-19T04:13:29.018 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-19T04:13:29.034 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-19T04:13:29.050 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:29.050 INFO:teuthology.orchestra.run.smithi032.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-19T04:13:29.050 INFO:teuthology.orchestra.run.smithi032.stdout:which means they are currently configured by ifupdown: 2024-01-19T04:13:29.051 INFO:teuthology.orchestra.run.smithi032.stdout:- ens1f0 2024-01-19T04:13:29.051 INFO:teuthology.orchestra.run.smithi032.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-19T04:13:29.051 INFO:teuthology.orchestra.run.smithi032.stdout:remove their configuration from /etc/network/interfaces. 2024-01-19T04:13:29.051 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:29.084 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:13:29.190 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-19T04:13:29.363 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-common (238) ... 2024-01-19T04:13:29.586 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-19T04:13:29.874 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-19T04:13:29.984 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-19T04:13:30.016 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T04:13:30.142 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:30.252 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T04:13:30.353 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T04:13:30.453 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:30.628 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:30.762 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-19T04:13:31.023 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-common (238) ... 2024-01-19T04:13:31.406 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-19T04:13:31.501 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T04:13:31.836 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:13:31.836 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T04:13:31.967 INFO:teuthology.orchestra.run.smithi032.stdout:Adding user postgres to group ssl-cert 2024-01-19T04:13:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:32.242 INFO:teuthology.orchestra.run.smithi032.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-19T04:13:32.511 INFO:teuthology.orchestra.run.smithi032.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-19T04:13:32.511 INFO:teuthology.orchestra.run.smithi032.stdout:Removing obsolete dictionary files: 2024-01-19T04:13:32.537 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T04:13:32.663 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T04:13:32.789 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-19T04:13:32.915 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T04:13:33.041 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:33.167 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T04:13:33.193 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-19T04:13:33.293 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T04:13:33.683 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:33.932 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T04:13:34.058 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up dump (0.4b47-3) ... 2024-01-19T04:13:34.153 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-19T04:13:34.209 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:34.214 INFO:teuthology.orchestra.run.smithi032.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-19T04:13:34.232 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout:This user must also own the server process. 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout:The database cluster will be initialized with locale "en_US". 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout:The default text search configuration will be set to "english". 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:34.287 INFO:teuthology.orchestra.run.smithi032.stdout:Data page checksums are disabled. 2024-01-19T04:13:34.288 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:34.288 INFO:teuthology.orchestra.run.smithi032.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-19T04:13:34.288 INFO:teuthology.orchestra.run.smithi032.stdout:creating subdirectories ... ok 2024-01-19T04:13:34.288 INFO:teuthology.orchestra.run.smithi032.stdout:selecting dynamic shared memory implementation ... posix 2024-01-19T04:13:34.310 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T04:13:34.312 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default max_connections ... 100 2024-01-19T04:13:34.347 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default shared_buffers ... 128MB 2024-01-19T04:13:34.361 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default time zone ... Etc/UTC 2024-01-19T04:13:34.362 INFO:teuthology.orchestra.run.smithi032.stdout:creating configuration files ... ok 2024-01-19T04:13:34.411 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-19T04:13:34.536 INFO:teuthology.orchestra.run.smithi032.stdout:running bootstrap script ... ok 2024-01-19T04:13:34.904 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-19T04:13:35.031 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T04:13:35.121 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-19T04:13:35.160 INFO:teuthology.orchestra.run.smithi032.stdout:performing post-bootstrap initialization ... ok 2024-01-19T04:13:35.182 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T04:13:35.308 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T04:13:35.518 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T04:13:35.644 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:35.718 INFO:teuthology.orchestra.run.smithi032.stdout:syncing data to disk ... ok 2024-01-19T04:13:35.761 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-19T04:13:35.896 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client (14+238) ... 2024-01-19T04:13:36.014 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-19T04:13:36.213 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-19T04:13:36.595 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:36.595 INFO:teuthology.orchestra.run.smithi067.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-19T04:13:36.595 INFO:teuthology.orchestra.run.smithi067.stdout:which means they are currently configured by ifupdown: 2024-01-19T04:13:36.595 INFO:teuthology.orchestra.run.smithi067.stdout:- enp3s0f1 2024-01-19T04:13:36.595 INFO:teuthology.orchestra.run.smithi067.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-19T04:13:36.595 INFO:teuthology.orchestra.run.smithi067.stdout:remove their configuration from /etc/network/interfaces. 2024-01-19T04:13:36.595 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:36.734 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-19T04:13:37.119 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-19T04:13:37.513 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-19T04:13:38.175 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T04:13:38.326 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T04:13:38.452 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-19T04:13:38.578 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-common (238) ... 2024-01-19T04:13:39.250 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:39.376 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-19T04:13:39.467 INFO:teuthology.orchestra.run.smithi067.stdout:Adding user postgres to group ssl-cert 2024-01-19T04:13:39.502 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql (14+238) ... 2024-01-19T04:13:39.628 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:39.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:39.727 INFO:teuthology.orchestra.run.smithi067.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-19T04:13:39.754 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:39.981 INFO:teuthology.orchestra.run.smithi067.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-19T04:13:39.981 INFO:teuthology.orchestra.run.smithi067.stdout:Removing obsolete dictionary files: 2024-01-19T04:13:40.023 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:13:40.023 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:13:40.690 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-19T04:13:40.698 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-19T04:13:41.000 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:13:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:13:41.179 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T04:13:41.540 INFO:teuthology.orchestra.run.smithi067.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-19T04:13:41.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-19T04:13:41.611 INFO:teuthology.orchestra.run.smithi067.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout:This user must also own the server process. 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout:The database cluster will be initialized with locale "en_US". 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout:The default text search configuration will be set to "english". 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout:Data page checksums are disabled. 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:41.612 INFO:teuthology.orchestra.run.smithi067.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-19T04:13:41.613 INFO:teuthology.orchestra.run.smithi067.stdout:creating subdirectories ... ok 2024-01-19T04:13:41.613 INFO:teuthology.orchestra.run.smithi067.stdout:selecting dynamic shared memory implementation ... posix 2024-01-19T04:13:41.638 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default max_connections ... 100 2024-01-19T04:13:41.673 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default shared_buffers ... 128MB 2024-01-19T04:13:41.688 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default time zone ... Etc/UTC 2024-01-19T04:13:41.688 INFO:teuthology.orchestra.run.smithi067.stdout:creating configuration files ... ok 2024-01-19T04:13:41.861 INFO:teuthology.orchestra.run.smithi067.stdout:running bootstrap script ... ok 2024-01-19T04:13:42.503 INFO:teuthology.orchestra.run.smithi067.stdout:performing post-bootstrap initialization ... ok 2024-01-19T04:13:42.530 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-19T04:13:42.631 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:13:43.146 INFO:teuthology.orchestra.run.smithi067.stdout:syncing data to disk ... ok 2024-01-19T04:13:43.162 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:13:43.169 DEBUG:teuthology.parallel:result is None 2024-01-19T04:13:43.653 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-19T04:13:46.620 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:46.730 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-19T04:13:46.855 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql (14+238) ... 2024-01-19T04:13:46.981 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T04:13:47.107 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T04:13:47.375 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:13:47.375 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T04:13:48.093 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-19T04:13:48.453 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T04:13:48.588 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T04:13:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-19T04:13:50.099 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T04:13:50.623 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T04:13:50.630 DEBUG:teuthology.parallel:result is None 2024-01-19T04:13:50.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:13:50.769 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2024-01-19T04:13:50.794 INFO:teuthology.orchestra.run.smithi032.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:13:50.794 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:13:50.794 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-19T04:13:50.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T04:13:51.007 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-query -W -f '${Version}' ceph 2024-01-19T04:13:51.030 INFO:teuthology.orchestra.run.smithi067.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:13:51.030 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T04:13:51.030 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-19T04:13:51.032 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-19T04:13:51.032 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:51.032 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-19T04:13:51.054 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:51.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-19T04:13:51.091 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-19T04:13:51.091 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:51.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-01-19T04:13:51.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-19T04:13:51.181 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:51.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-01-19T04:13:51.200 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-19T04:13:51.262 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-19T04:13:51.262 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:51.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-19T04:13:51.284 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-19T04:13:51.349 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:51.349 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-19T04:13:51.368 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-19T04:13:51.430 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-19T04:13:51.430 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:51.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-01-19T04:13:51.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-19T04:13:51.513 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:51.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-01-19T04:13:51.532 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-19T04:13:51.594 INFO:teuthology.run_tasks:Running task ceph... 2024-01-19T04:13:51.669 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-19T04:13:51.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-01-19T04:13:51.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-01-19T04:13:51.692 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-19T04:13:51.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-19T04:13:51.735 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-19T04:13:51.755 INFO:tasks.ceph:Creating extra log directories... 2024-01-19T04:13:51.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-19T04:13:51.799 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-19T04:13:51.825 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-19T04:13:51.826 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-19T04:13:51.826 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-19T04:13:51.826 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:51.826 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-19T04:13:51.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-19T04:13:51.963 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:51.963 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-19T04:13:51.971 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-19T04:13:52.063 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-19T04:13:52.063 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-19T04:13:52.063 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983', 'branch': 'wip-yuri8-testing-2024-01-18-0823', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7520983', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2024-01-18-0823'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2024-01-18-0823', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 6631, 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2024-01-18-0823', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmDdSsxv9WcJ1PZ9Jkx++eMHWGS8ZjfY//Ppc41DiHzNz2a0RfpIlaepu8H+26Ti/KB+0ITqjumF9g3TjIJb3I=', 'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ/Mu9fYV8m1G+znEw6THx2hpuWOW7pGAgxKZxsI2PI3OgYKsM9ZT+Dz2MR6wxX8wK+xWWAAILMLzdjTFAWUtZ8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-18_21:19:14', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-19T04:13:52.064 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-19T04:13:52.067 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-19T04:13:52.112 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-01-19T04:13:52.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-01-19T04:13:52.175 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:52.175 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-01-19T04:13:52.189 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-19T04:13:52.189 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-01-19T04:13:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-19T04:13:52.241 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:52.241 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-01-19T04:13:52.241 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:52.242 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-01-19 04:07:25.477137404 +0000 2024-01-19T04:13:52.242 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-01-19 04:07:25.185140012 +0000 2024-01-19T04:13:52.242 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-01-19 04:07:25.185140012 +0000 2024-01-19T04:13:52.242 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-01-19 04:07:25.185140012 +0000 2024-01-19T04:13:52.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-19T04:13:52.303 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-01-19T04:13:52.303 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-01-19T04:13:52.303 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000268768 s, 1.9 MB/s 2024-01-19T04:13:52.305 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-19T04:13:52.359 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-01-19 04:07:25.977132937 +0000 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-01-19 04:07:25.717135260 +0000 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-01-19 04:07:25.717135260 +0000 2024-01-19T04:13:52.413 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-01-19 04:07:25.717135260 +0000 2024-01-19T04:13:52.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-19T04:13:52.475 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-01-19T04:13:52.475 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-01-19T04:13:52.475 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000268479 s, 1.9 MB/s 2024-01-19T04:13:52.477 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-19T04:13:52.531 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-01-19 04:07:26.493128329 +0000 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-01-19 04:07:26.217130794 +0000 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-01-19 04:07:26.217130794 +0000 2024-01-19T04:13:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-01-19 04:07:26.217130794 +0000 2024-01-19T04:13:52.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-19T04:13:52.647 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-01-19T04:13:52.647 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-01-19T04:13:52.647 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000266167 s, 1.9 MB/s 2024-01-19T04:13:52.649 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-19T04:13:52.703 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-01-19T04:13:52.753 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-19T04:13:52.754 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:52.754 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 953 Links: 1 2024-01-19T04:13:52.754 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:52.754 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-01-19 04:07:27.013123683 +0000 2024-01-19T04:13:52.754 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-01-19 04:07:26.753126006 +0000 2024-01-19T04:13:52.754 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-01-19 04:07:26.753126006 +0000 2024-01-19T04:13:52.754 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-01-19 04:07:26.753126006 +0000 2024-01-19T04:13:52.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-19T04:13:52.815 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-01-19T04:13:52.816 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-01-19T04:13:52.816 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000264983 s, 1.9 MB/s 2024-01-19T04:13:52.818 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-19T04:13:52.874 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:13:52.874 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:52.875 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-01-19T04:13:52.884 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-19T04:13:52.884 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-01-19T04:13:52.936 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-19T04:13:52.936 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:52.936 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-01-19T04:13:52.936 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:52.936 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-19 04:07:25.474784697 +0000 2024-01-19T04:13:52.937 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-19 04:07:25.206787089 +0000 2024-01-19T04:13:52.937 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-19 04:07:25.206787089 +0000 2024-01-19T04:13:52.937 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-19 04:07:25.206787089 +0000 2024-01-19T04:13:52.937 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-19T04:13:52.998 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-19T04:13:52.998 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-19T04:13:52.998 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000386693 s, 1.3 MB/s 2024-01-19T04:13:53.000 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-19T04:13:53.058 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-01-19T04:13:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-19T04:13:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:53.113 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-01-19T04:13:53.113 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:53.113 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-19 04:07:26.002779981 +0000 2024-01-19T04:13:53.113 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-19 04:07:25.726782446 +0000 2024-01-19T04:13:53.113 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-19 04:07:25.726782446 +0000 2024-01-19T04:13:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-19 04:07:25.726782446 +0000 2024-01-19T04:13:53.113 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-19T04:13:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-19T04:13:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-19T04:13:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000364911 s, 1.4 MB/s 2024-01-19T04:13:53.176 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-19T04:13:53.229 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-19 04:07:26.278777515 +0000 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-19 04:07:26.274777551 +0000 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-19 04:07:26.274777551 +0000 2024-01-19T04:13:53.280 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-19 04:07:26.274777551 +0000 2024-01-19T04:13:53.281 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-19T04:13:53.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-19T04:13:53.342 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-19T04:13:53.342 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000358764 s, 1.4 MB/s 2024-01-19T04:13:53.343 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-19T04:13:53.398 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-01-19T04:13:53.447 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-19T04:13:53.448 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T04:13:53.448 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 944 Links: 1 2024-01-19T04:13:53.448 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T04:13:53.448 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-19 04:07:27.110770083 +0000 2024-01-19T04:13:53.448 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-19 04:07:26.818772692 +0000 2024-01-19T04:13:53.448 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-19 04:07:26.818772692 +0000 2024-01-19T04:13:53.448 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-19 04:07:26.818772692 +0000 2024-01-19T04:13:53.448 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-19T04:13:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-19T04:13:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-19T04:13:53.510 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000378093 s, 1.4 MB/s 2024-01-19T04:13:53.512 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-19T04:13:53.566 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:13:53.566 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-19T04:13:53.566 INFO:tasks.ceph:Generating config... 2024-01-19T04:13:53.567 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-19T04:13:53.567 INFO:tasks.ceph:[client] debug client = 20 2024-01-19T04:13:53.567 INFO:tasks.ceph:[client] debug ms = 1 2024-01-19T04:13:53.567 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-19T04:13:53.567 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-19T04:13:53.567 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-19T04:13:53.567 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-19T04:13:53.568 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-19T04:13:53.568 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-19T04:13:53.569 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-19T04:13:53.570 INFO:tasks.ceph:Setting up mon.a... 2024-01-19T04:13:53.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-19T04:13:53.618 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2024-01-19T04:13:53.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-19T04:13:53.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T04:13:53.703 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.67'), ('mon.c', '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]')] 2024-01-19T04:13:53.703 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-19T04:13:53.704 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:53.704 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-19T04:13:53.753 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.67 --addv c '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid d7445317-ddd8-4205-bf5b-c51cd46cffd9 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = quincy 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:fsid d7445317-ddd8-4205-bf5b-c51cd46cffd9 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2024-01-19T04:13:53.851010+0000 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-01-19T04:13:53.851010+0000 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 17 (quincy) 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2024-01-19T04:13:53.852 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-01-19T04:13:53.853 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-01-19T04:13:53.853 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-19T04:13:53.853 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-19T04:13:53.861 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d7445317-ddd8-4205-bf5b-c51cd46cffd9... 2024-01-19T04:13:53.862 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-19T04:13:53.907 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-19T04:13:53.948 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-01-19T04:13:53.948 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-01-19T04:13:53.948 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-19T04:13:53.948 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-01-19T04:13:53.948 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.948 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.949 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.950 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on skipped message = False 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = d7445317-ddd8-4205-bf5b-c51cd46cffd9 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-01-19T04:13:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-01-19T04:13:53.952 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-01-19T04:13:53.953 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.954 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.955 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-19T04:13:53.956 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-01-19T04:13:53.957 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-01-19T04:13:53.958 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-19T04:13:53.959 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.960 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.32,172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790]" 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on skipped message = False 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = d7445317-ddd8-4205-bf5b-c51cd46cffd9 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-01-19T04:13:53.961 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-01-19T04:13:53.962 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: bdev async discard = True 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: bdev enable discard = True 2024-01-19T04:13:53.963 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore allocator = bitmap 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 1/20 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 1/20 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 4/10 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.964 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-01-19T04:13:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-01-19T04:13:53.966 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-01-19T04:13:53.967 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-01-19T04:13:53.968 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-01-19T04:13:53.969 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-01-19T04:13:53.971 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-19T04:13:53.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-19T04:13:54.069 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-19T04:13:54.070 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:54.070 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-19T04:13:54.078 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:54.079 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-19T04:13:54.128 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:13:54.128 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:54.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-19T04:13:54.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T04:13:54.203 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:13:54.203 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:13:54.252 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:13:54.252 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:54.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-19T04:13:54.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T04:13:54.288 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:13:54.288 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:13:54.344 INFO:tasks.ceph:Setting up mon nodes... 2024-01-19T04:13:54.344 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-19T04:13:54.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-19T04:13:54.401 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-19T04:13:54.406 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-19T04:13:54.468 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-19T04:13:54.526 INFO:tasks.ceph:Setting up mds nodes... 2024-01-19T04:13:54.526 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-19T04:13:54.582 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-19T04:13:54.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-19T04:13:54.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-19T04:13:54.704 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-19T04:13:54.708 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-19T04:13:54.729 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-19T04:13:54.790 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-19T04:13:54.795 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-19T04:13:54.816 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-19T04:13:54.917 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-19T04:13:54.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-19T04:13:54.942 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-19T04:13:54.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-19T04:13:54.986 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-19T04:13:55.003 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-19T04:13:55.047 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-19T04:13:55.064 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-19T04:13:55.064 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-19T04:13:55.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-19T04:13:55.083 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:13:55.084 INFO:tasks.ceph:role: osd.0 2024-01-19T04:13:55.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:13:55.084 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-19T04:13:55.142 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:13:55.143 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:13:55.167 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-01-19T04:13:55.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-01-19T04:13:55.170 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-19T04:13:55.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-19T04:13:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:13:55.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:13:55.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-19T04:13:55.363 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:13:55.363 INFO:tasks.ceph:role: osd.1 2024-01-19T04:13:55.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:13:55.363 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:13:55.423 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:13:55.447 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-01-19T04:13:55.450 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-01-19T04:13:55.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-19T04:13:55.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-19T04:13:55.576 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:13:55.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:13:55.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-19T04:13:55.640 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:13:55.640 INFO:tasks.ceph:role: osd.2 2024-01-19T04:13:55.640 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:13:55.640 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:13:55.699 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:13:55.723 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-01-19T04:13:55.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-01-19T04:13:55.727 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-19T04:13:55.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-19T04:13:55.856 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:13:55.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:13:55.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-19T04:13:55.923 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T04:13:55.923 INFO:tasks.ceph:role: osd.3 2024-01-19T04:13:55.923 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:13:55.923 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-19T04:13:55.982 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:13:55.982 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:13:55.982 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:13:55.983 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:13:55.983 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:13:55.983 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:13:55.983 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:13:55.983 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:13:55.983 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:13:55.983 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:13:56.007 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-01-19T04:13:56.009 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-01-19T04:13:56.010 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-19T04:13:56.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-19T04:13:56.139 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:13:56.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:13:56.140 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:13:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:56.262+0000 7f4a76f38640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-19T04:13:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:56.262+0000 7f4a76f38640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-19T04:13:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:56.262+0000 7f4a76f38640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T04:13:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:56.262+0000 7f4a76f38640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T04:13:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:56.262+0000 7f4a76f38640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T04:13:56.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:56.266+0000 7f4a76f38640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-19T04:13:59.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-19T04:13:59.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:13:59.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:59.362+0000 7f3946fa2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-19T04:13:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:59.362+0000 7f3946fa2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-19T04:13:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:59.362+0000 7f3946fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T04:13:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:59.362+0000 7f3946fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T04:13:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:59.362+0000 7f3946fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T04:13:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:13:59.366+0000 7f3946fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-19T04:14:02.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-19T04:14:02.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:02.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:02.438+0000 7f128f763640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-19T04:14:02.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:02.442+0000 7f128f763640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-19T04:14:02.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:02.442+0000 7f128f763640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T04:14:02.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:02.442+0000 7f128f763640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T04:14:02.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:02.442+0000 7f128f763640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T04:14:02.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:02.442+0000 7f128f763640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-19T04:14:05.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-19T04:14:05.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:05.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:05.514+0000 7f1e9c54c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-19T04:14:05.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:05.514+0000 7f1e9c54c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-19T04:14:05.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:05.514+0000 7f1e9c54c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T04:14:05.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:05.514+0000 7f1e9c54c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T04:14:05.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:05.514+0000 7f1e9c54c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T04:14:05.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:05.518+0000 7f1e9c54c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-19T04:14:08.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-19T04:14:08.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-19T04:14:08.535 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:14:08.535 INFO:tasks.ceph:role: osd.4 2024-01-19T04:14:08.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:14:08.535 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-19T04:14:08.612 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:14:08.612 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:14:08.612 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:14:08.612 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:14:08.612 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:14:08.612 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:14:08.613 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:14:08.613 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:14:08.613 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:14:08.613 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:14:09.099 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-19T04:14:09.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-19T04:14:09.102 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-19T04:14:09.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-19T04:14:09.281 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:14:09.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:14:09.282 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-19T04:14:09.348 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:14:09.348 INFO:tasks.ceph:role: osd.5 2024-01-19T04:14:09.348 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:14:09.348 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:14:09.420 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:14:09.421 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:14:09.421 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:14:09.864 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-19T04:14:09.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-19T04:14:09.868 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-19T04:14:09.973 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-19T04:14:09.990 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:14:09.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:14:09.991 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-19T04:14:10.052 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:14:10.052 INFO:tasks.ceph:role: osd.6 2024-01-19T04:14:10.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:14:10.052 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-19T04:14:10.123 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:14:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:14:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:14:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:14:10.124 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:14:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:14:10.124 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:14:10.124 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:14:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:14:10.124 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:14:10.586 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-19T04:14:10.589 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-19T04:14:10.589 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-19T04:14:10.722 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-19T04:14:10.739 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:14:10.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:14:10.740 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-19T04:14:10.807 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T04:14:10.808 INFO:tasks.ceph:role: osd.7 2024-01-19T04:14:10.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:14:10.808 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T04:14:10.881 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T04:14:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-19T04:14:11.394 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-19T04:14:11.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-19T04:14:11.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-19T04:14:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T04:14:11.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:14:11.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:11.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:11.705+0000 7fe889e80640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-19T04:14:11.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:11.709+0000 7fe889e80640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-19T04:14:11.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:11.709+0000 7fe889e80640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T04:14:11.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:11.709+0000 7fe889e80640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T04:14:11.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:11.709+0000 7fe889e80640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T04:14:11.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:11.713+0000 7fe889e80640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-19T04:14:14.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-19T04:14:14.722 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:14.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:14.817+0000 7f0fc75b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-19T04:14:14.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:14.821+0000 7f0fc75b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-19T04:14:14.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:14.821+0000 7f0fc75b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T04:14:14.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:14.821+0000 7f0fc75b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T04:14:14.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:14.821+0000 7f0fc75b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T04:14:14.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:14.821+0000 7f0fc75b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-19T04:14:17.787 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-19T04:14:17.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:17.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:17.909+0000 7fc660380640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-19T04:14:17.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:17.909+0000 7fc660380640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-19T04:14:17.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:17.909+0000 7fc660380640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T04:14:17.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:17.909+0000 7fc660380640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T04:14:17.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:17.909+0000 7fc660380640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T04:14:17.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:17.913+0000 7fc660380640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-19T04:14:20.890 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-19T04:14:20.911 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:21.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:21.013+0000 7f4a536b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-19T04:14:21.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:21.013+0000 7f4a536b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-19T04:14:21.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:21.013+0000 7f4a536b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T04:14:21.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:21.013+0000 7f4a536b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T04:14:21.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:21.013+0000 7f4a536b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T04:14:21.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:21.017+0000 7f4a536b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-19T04:14:22.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:14:22.069 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:14:23.998 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-19T04:14:24.020 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-19T04:14:24.020 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-19T04:14:24.043 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-19T04:14:24.109 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-19T04:14:24.177 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.177 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-19T04:14:24.244 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-19T04:14:24.312 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-19T04:14:24.381 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-19T04:14:24.448 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.448 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-19T04:14:24.470 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.470 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-19T04:14:24.532 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.533 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-19T04:14:24.596 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-19T04:14:24.660 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-19T04:14:24.725 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.725 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-19T04:14:24.788 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.788 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-19T04:14:24.852 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:24.852 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-19T04:14:24.861 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:24.861 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-19T04:14:24.903 INFO:tasks.ceph:Adding keys to all mons... 2024-01-19T04:14:24.903 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-19T04:14:24.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96llu+oOGBAAAeqd9zD1YxEG+kXxhgkPUA== 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96llsgveIhAArI1FfqpAbZbP5H/QNDKrQQ== 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96ll/F8cKhAAq6nC5ppnbAIpyfxBqU9v+w== 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAE96llXf/LDxAA6FgZ7EGq0C9TUTaB/CiGAw== 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAH96llm63KFRAAyoUf8Z0jVpxh86JaeudxpA== 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAK96ll4IdoGhAAkyqz5g83r8gpFWdpV+JHAw== 2024-01-19T04:14:24.951 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAN96ll0o3YHhAAXaXcV6Ew3ARVzOeheB2Qdg== 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96ll838IHBAAatsDTMrKtOZVb2U6Jkhyvg== 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96llsvlALxAADpa3U031IE67W85H0Rma6w== 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96ll61LHNhAAOWD4NF6ea4C6MYxR8v55lw== 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAT96lluolMKhAAhtGB4RrqfaeFoh0Cw+FWcw== 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAW96llGp39MBAArcnkxmH6H79g0uLV/tbMYg== 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAZ96ll5MxcNhAAt6AgzeQup4/mAyqV/A4/ug== 2024-01-19T04:14:24.952 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-01-19T04:14:24.953 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAd96ll193uABAA/uFXx3ffBrEgBS+jU7LwYA== 2024-01-19T04:14:24.953 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-01-19T04:14:24.953 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q== 2024-01-19T04:14:24.953 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-01-19T04:14:24.953 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ== 2024-01-19T04:14:24.965 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAC96llu+oOGBAAAeqd9zD1YxEG+kXxhgkPUA== 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAC96llsgveIhAArI1FfqpAbZbP5H/QNDKrQQ== 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAC96ll/F8cKhAAq6nC5ppnbAIpyfxBqU9v+w== 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAE96llXf/LDxAA6FgZ7EGq0C9TUTaB/CiGAw== 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAH96llm63KFRAAyoUf8Z0jVpxh86JaeudxpA== 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAK96ll4IdoGhAAkyqz5g83r8gpFWdpV+JHAw== 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAN96ll0o3YHhAAXaXcV6Ew3ARVzOeheB2Qdg== 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-01-19T04:14:24.966 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAC96ll838IHBAAatsDTMrKtOZVb2U6Jkhyvg== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAC96llsvlALxAADpa3U031IE67W85H0Rma6w== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAC96ll61LHNhAAOWD4NF6ea4C6MYxR8v55lw== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAT96lluolMKhAAhtGB4RrqfaeFoh0Cw+FWcw== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAW96llGp39MBAArcnkxmH6H79g0uLV/tbMYg== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAZ96ll5MxcNhAAt6AgzeQup4/mAyqV/A4/ug== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAd96ll193uABAA/uFXx3ffBrEgBS+jU7LwYA== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q== 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2024-01-19T04:14:24.967 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ== 2024-01-19T04:14:24.968 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:14:25.003 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:14:25.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.075 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.140 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.202 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.259 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.314 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:14:25.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T04:14:25.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.493 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T04:14:25.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.674 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.728 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.786 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.789 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T04:14:25.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T04:14:25.847 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T04:14:25.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T04:14:25.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T04:14:25.966 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-19T04:14:25.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-19T04:14:25.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T04:14:26.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-19T04:14:26.115 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-19T04:14:26.135 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T04:14:26.246 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-19T04:14:26.266 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-19T04:14:26.326 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T04:14:26.433 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-19T04:14:26.453 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:26.456 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-19T04:14:26.503 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-19T04:14:26.503 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-19T04:14:26.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-19T04:14:26.506 INFO:tasks.ceph.mon.a:Started 2024-01-19T04:14:26.507 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-19T04:14:26.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-19T04:14:26.546 INFO:tasks.ceph.mon.b:Started 2024-01-19T04:14:26.546 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-19T04:14:26.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-19T04:14:26.549 INFO:tasks.ceph.mon.c:Started 2024-01-19T04:14:26.549 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-19T04:14:26.550 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-19T04:14:26.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-19T04:14:26.553 INFO:tasks.ceph.mgr.y:Started 2024-01-19T04:14:26.553 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-19T04:14:26.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-19T04:14:26.557 INFO:tasks.ceph.mgr.x:Started 2024-01-19T04:14:26.558 INFO:tasks.ceph:Setting crush tunables to default 2024-01-19T04:14:26.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2024-01-19T04:14:26.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f4800640 1 Processor -- start 2024-01-19T04:14:26.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f4800640 1 -- start start 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f4800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f4800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec0a7660 con 0x7ff0ec0c7260 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f4800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec0c4200 con 0x7ff0ec0c27f0 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f4800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec06ecd0 con 0x7ff0ec06fdb0 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f1e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff0ec0c7260 0x7ff0ec152f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33676/0 (socket says 172.21.15.32:33676) 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 learned_addr learned my addr 172.21.15.32:0/697027650 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.701+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:14:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.905+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.905+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.905+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.905+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:26.905+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:14:27.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:27.309+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:27.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:27.309+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:27.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:27.309+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:27.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:27.309+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:27.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:27.309+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:28.113+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:28.113+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:28.113+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:28.113+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:28.113+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:14:29.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec0701d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:14:29.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0ec0701d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:29.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> v1:172.21.15.67:6789/0 conn(0x7ff0ec0c27f0 legacy=0x7ff0ec0c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:29.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> v1:172.21.15.32:6789/0 conn(0x7ff0ec0c7260 legacy=0x7ff0ec152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:29.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec06ecd0 con 0x7ff0c40061d0 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c4008d40 con 0x7ff0c4003720 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:14:29.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.701+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:14:29.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:29.905+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:14:30.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:30.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:30.309+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:14:31.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:31.113+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 msgr2=0x7ff0c4008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c40061d0 0x7ff0c4008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0f2800640 1 -- 172.21.15.32:0/697027650 reap_dead start 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec0c44e0 con 0x7ff0c4006680 2024-01-19T04:14:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec06ecd0 con 0x7ff0c4003720 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4008d40 con 0x7ff0ec06fdb0 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.701+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.705+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.705+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.705+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.705+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:14:32.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:32.909+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:14:33.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:33.313+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:34.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:34.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:34.117+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-19T04:14:35.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0c400b100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:14:35.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0c400b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:35.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 msgr2=0x7ff0c4005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.67:3300/0 conn(0x7ff0c4003720 0x7ff0c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 >> v1:172.21.15.32:6789/0 conn(0x7ff0c4006680 legacy=0x7ff0c400b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c400de30 con 0x7ff0c400d970 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.701+0000 7ff0eb400640 1 -- 172.21.15.32:0/697027650 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec06ecd0 con 0x7ff0c400cec0 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.705+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.705+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 msgr2=0x7ff0c400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.705+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 msgr2=0x7ff0c400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.705+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:35.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.705+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T04:14:35.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.909+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:35.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.909+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 msgr2=0x7ff0c400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:35.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.909+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 msgr2=0x7ff0c400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:35.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.909+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:35.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:35.909+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T04:14:36.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.313+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:36.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.313+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 msgr2=0x7ff0c400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T04:14:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.313+0000 7ff0f1e00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 msgr2=0x7ff0c400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T04:14:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.313+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T04:14:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.313+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-19T04:14:36.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.877+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711413840 0 0) 0x7ff0c400de30 con 0x7ff0c400d970 2024-01-19T04:14:36.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.877+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc003530 con 0x7ff0c400d970 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3916874210 0 0) 0x7ff0cc003530 con 0x7ff0c400d970 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 msgr2=0x7ff0c400d2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 --2- 172.21.15.32:0/697027650 >> v2:172.21.15.32:3300/0 conn(0x7ff0c400cec0 0x7ff0c400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40148d0 con 0x7ff0c400d970 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7ff0d4016790 con 0x7ff0c400d970 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 >> v1:172.21.15.67:6789/0 conn(0x7ff0c400d970 legacy=0x7ff0c4012020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f2800640 1 -- 172.21.15.32:0/697027650 reap_dead start 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0cc003980 0x7ff0cc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec06ecd0 con 0x7ff0cc004d10 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc00bc10 con 0x7ff0cc003980 2024-01-19T04:14:36.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc00bdd0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0cc003980 0x7ff0cc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f2800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f1400640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f2800640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f2800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f2800640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0cc003980 msgr2=0x7ff0cc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f2800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0cc003980 0x7ff0cc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.881+0000 7ff0f2800640 1 -- 172.21.15.32:0/697027650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc003530 con 0x7ff0cc004d10 2024-01-19T04:14:36.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.885+0000 7ff0f2800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0cc005190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec073070 tx=0x7ff0e401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71eeeda032ab4d5c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:36.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.885+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4005d50 con 0x7ff0cc004d10 2024-01-19T04:14:36.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.885+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e40a7070 con 0x7ff0cc004d10 2024-01-19T04:14:36.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.885+0000 7ff0f0a00640 1 -- 172.21.15.32:0/697027650 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40072b0 con 0x7ff0cc004d10 2024-01-19T04:14:36.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- 172.21.15.32:0/697027650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 msgr2=0x7ff0cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:36.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0cc005190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec073070 tx=0x7ff0e401c3a0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- 172.21.15.32:0/697027650 shutdown_connections 2024-01-19T04:14:36.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0cc005190 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0ec06fdb0 0x7ff0cc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 --2- 172.21.15.32:0/697027650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0cc003980 0x7ff0cc003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- 172.21.15.32:0/697027650 >> 172.21.15.32:0/697027650 conn(0x7ff0ec0c7d00 msgr2=0x7ff0ec0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:36.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- 172.21.15.32:0/697027650 shutdown_connections 2024-01-19T04:14:36.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- 172.21.15.32:0/697027650 wait complete. 2024-01-19T04:14:36.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 Processor -- start 2024-01-19T04:14:36.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- start start 2024-01-19T04:14:36.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0cc003980 0x7ff0ec0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:36.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0ec14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:36.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0ec06fdb0 0x7ff0ec1e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:36.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec070710 con 0x7ff0cc004d10 2024-01-19T04:14:36.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec14ac80 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.889+0000 7ff0f4800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec154f00 con 0x7ff0cc003980 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0ec06fdb0 0x7ff0ec1e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0ec06fdb0 0x7ff0ec1e9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:40808/0 (socket says 172.21.15.32:40808) 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 -- 172.21.15.32:0/1775024532 learned_addr learned my addr 172.21.15.32:0/1775024532 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0cc003980 0x7ff0ec0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f1400640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0ec14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 -- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0cc003980 msgr2=0x7ff0ec0aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0cc003980 0x7ff0ec0aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 -- 172.21.15.32:0/1775024532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 msgr2=0x7ff0ec14ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0ec14ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 -- 172.21.15.32:0/1775024532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0abe20 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f1400640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0ec14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f1e00640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0cc003980 0x7ff0ec0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f2800640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0ec06fdb0 0x7ff0ec1e9210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4000f90 tx=0x7ff0cc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:36.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0ea000640 1 -- 172.21.15.32:0/1775024532 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4007470 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0ea000640 1 -- 172.21.15.32:0/1775024532 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e40075f0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0ea000640 1 -- 172.21.15.32:0/1775024532 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40079a0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec0704b0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec154300 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0ea000640 1 -- 172.21.15.32:0/1775024532 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ff0e40bf7e0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0ea000640 1 -- 172.21.15.32:0/1775024532 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff0e40aca70 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.893+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec0749f0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.897+0000 7ff0ea000640 1 -- 172.21.15.32:0/1775024532 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7ff0e40018e0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.961+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff0ec0749f0 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.969+0000 7ff0ea000640 1 -- 172.21.15.32:0/1775024532 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff0e40acc80 con 0x7ff0ec06fdb0 2024-01-19T04:14:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-01-19T04:14:36.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.969+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0ec06fdb0 msgr2=0x7ff0ec1e9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:36.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.969+0000 7ff0f4800640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0ec06fdb0 0x7ff0ec1e9210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4000f90 tx=0x7ff0cc005800 comp rx=0 tx=0).stop 2024-01-19T04:14:36.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.973+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 shutdown_connections 2024-01-19T04:14:36.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.973+0000 7ff0f4800640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0ec06fdb0 0x7ff0ec1e9210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.973+0000 7ff0f4800640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0cc004d10 0x7ff0ec14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.973+0000 7ff0f4800640 1 --2- 172.21.15.32:0/1775024532 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0cc003980 0x7ff0ec0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:36.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.973+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 >> 172.21.15.32:0/1775024532 conn(0x7ff0ec0c7d00 msgr2=0x7ff0ec0a8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:36.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.973+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 shutdown_connections 2024-01-19T04:14:36.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:36.973+0000 7ff0f4800640 1 -- 172.21.15.32:0/1775024532 wait complete. 2024-01-19T04:14:36.995 INFO:tasks.ceph:check_enable_crimson: False 2024-01-19T04:14:36.995 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-19T04:14:36.996 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:36.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-19T04:14:37.016 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:37.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-19T04:14:37.080 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:37.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-19T04:14:37.116 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:37.116+0000 7f9c2842e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-19T04:14:37.144 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:14:37.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-19T04:14:37.208 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:37.208 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-19T04:14:37.228 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:37.228 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-19T04:14:37.264 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:37.261+0000 7fd3db028180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-19T04:14:37.291 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:37.291 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-19T04:14:37.351 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:14:37.351 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-19T04:14:37.411 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 740b2d0c-0b17-4d22-b7fe-389e3ef160bb 0 2024-01-19T04:14:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.592+0000 7f59d5200640 1 Processor -- start 2024-01-19T04:14:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.592+0000 7f59d5200640 1 -- start start 2024-01-19T04:14:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59d5200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d01565d0 0x7f59d00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59d5200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f59d006eeb0 0x7f59d006f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59d5200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00c6470 con 0x7f59d00c82f0 2024-01-19T04:14:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59d5200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d00c6ff0 con 0x7f59d006eeb0 2024-01-19T04:14:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59d5200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00c88a0 con 0x7f59d01565d0 2024-01-19T04:14:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59cde00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d01565d0 0x7f59d00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59cd400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f59d00c82f0 0x7f59d00c3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43864/0 (socket says 172.21.15.67:43864) 2024-01-19T04:14:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59cd400640 1 -- 172.21.15.67:0/3042682984 learned_addr learned my addr 172.21.15.67:0/3042682984 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-19T04:14:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59ce800640 1 --2- 172.21.15.67:0/3042682984 >> v2:172.21.15.32:3300/0 conn(0x7f59d006eeb0 0x7f59d006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59cde00640 1 -- 172.21.15.67:0/3042682984 >> v2:172.21.15.32:3300/0 conn(0x7f59d006eeb0 msgr2=0x7f59d006f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59cde00640 1 --2- 172.21.15.67:0/3042682984 >> v2:172.21.15.32:3300/0 conn(0x7f59d006eeb0 0x7f59d006f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59cde00640 1 -- 172.21.15.67:0/3042682984 >> v1:172.21.15.67:6789/0 conn(0x7f59d00c82f0 legacy=0x7f59d00c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.596+0000 7f59cde00640 1 -- 172.21.15.67:0/3042682984 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00c66c0 con 0x7f59d01565d0 2024-01-19T04:14:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59cde00640 1 --2- 172.21.15.67:0/3042682984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d01565d0 0x7f59d00c7db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59c00097c0 tx=0x7f59c001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8017ebb6448a938b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59cca00640 1 -- 172.21.15.67:0/3042682984 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00ab5f0 con 0x7f59d01565d0 2024-01-19T04:14:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59cca00640 1 -- 172.21.15.67:0/3042682984 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c00ab750 con 0x7f59d01565d0 2024-01-19T04:14:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59cca00640 1 -- 172.21.15.67:0/3042682984 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00abae0 con 0x7f59d01565d0 2024-01-19T04:14:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 -- 172.21.15.67:0/3042682984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d01565d0 msgr2=0x7f59d00c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 --2- 172.21.15.67:0/3042682984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d01565d0 0x7f59d00c7db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59c00097c0 tx=0x7f59c001c3f0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 -- 172.21.15.67:0/3042682984 shutdown_connections 2024-01-19T04:14:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 --2- 172.21.15.67:0/3042682984 >> v2:172.21.15.32:3300/0 conn(0x7f59d006eeb0 0x7f59d006f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 --2- 172.21.15.67:0/3042682984 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d01565d0 0x7f59d00c7db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 -- 172.21.15.67:0/3042682984 >> 172.21.15.67:0/3042682984 conn(0x7f59d00726d0 msgr2=0x7f59d00663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 -- 172.21.15.67:0/3042682984 shutdown_connections 2024-01-19T04:14:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 -- 172.21.15.67:0/3042682984 wait complete. 2024-01-19T04:14:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 Processor -- start 2024-01-19T04:14:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.600+0000 7f59d5200640 1 -- start start 2024-01-19T04:14:37.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d006eeb0 0x7f59d015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59d00c82f0 0x7f59d006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59d01565d0 0x7f59d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d014c940 con 0x7f59d01565d0 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d0150fd0 con 0x7f59d00c82f0 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d014c4b0 con 0x7f59d006eeb0 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cde00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d006eeb0 0x7f59d015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59d00c82f0 0x7f59d006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cde00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d006eeb0 0x7f59d015b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48234/0 (socket says 172.21.15.67:48234) 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cde00640 1 -- 172.21.15.67:0/800968402 learned_addr learned my addr 172.21.15.67:0/800968402 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59ce800640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59d01565d0 0x7f59d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cd400640 1 -- 172.21.15.67:0/800968402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d006eeb0 msgr2=0x7f59d015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cd400640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d006eeb0 0x7f59d015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cd400640 1 -- 172.21.15.67:0/800968402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59d01565d0 msgr2=0x7f59d006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cd400640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59d01565d0 0x7f59d006d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cd400640 1 -- 172.21.15.67:0/800968402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c0009420 con 0x7f59d00c82f0 2024-01-19T04:14:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59cd400640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59d00c82f0 0x7f59d006ce50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c3f0 tx=0x7f59b800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59c6000640 1 -- 172.21.15.67:0/800968402 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8005cf0 con 0x7f59d00c82f0 2024-01-19T04:14:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59c6000640 1 -- 172.21.15.67:0/800968402 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8005e50 con 0x7f59d00c82f0 2024-01-19T04:14:37.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d0153d30 con 0x7f59d00c82f0 2024-01-19T04:14:37.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59c6000640 1 -- 172.21.15.67:0/800968402 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80072f0 con 0x7f59d00c82f0 2024-01-19T04:14:37.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d0151500 con 0x7f59d00c82f0 2024-01-19T04:14:37.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59c6000640 1 -- 172.21.15.67:0/800968402 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f59b801c440 con 0x7f59d00c82f0 2024-01-19T04:14:37.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59c6000640 1 -- 172.21.15.67:0/800968402 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f59b8012a60 con 0x7f59d00c82f0 2024-01-19T04:14:37.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.604+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d00c2590 con 0x7f59d00c82f0 2024-01-19T04:14:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.608+0000 7f59c6000640 1 -- 172.21.15.67:0/800968402 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f59b8017070 con 0x7f59d00c82f0 2024-01-19T04:14:37.631 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:37.628+0000 7f9c2842e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-19T04:14:37.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.676+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "740b2d0c-0b17-4d22-b7fe-389e3ef160bb", "id": 0} v 0) v1 -- 0x7f59d00749f0 con 0x7f59d00c82f0 2024-01-19T04:14:37.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59c6000640 1 -- 172.21.15.67:0/800968402 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "740b2d0c-0b17-4d22-b7fe-389e3ef160bb", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f59b801c8d0 con 0x7f59d00c82f0 2024-01-19T04:14:37.684 INFO:teuthology.orchestra.run.smithi067.stdout:0 2024-01-19T04:14:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59d00c82f0 msgr2=0x7f59d006ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59d00c82f0 0x7f59d006ce50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c3f0 tx=0x7f59b800c8b0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 shutdown_connections 2024-01-19T04:14:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f59d01565d0 0x7f59d006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59d00c82f0 0x7f59d006ce50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 --2- 172.21.15.67:0/800968402 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59d006eeb0 0x7f59d015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 >> 172.21.15.67:0/800968402 conn(0x7f59d00726d0 msgr2=0x7f59d015c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 shutdown_connections 2024-01-19T04:14:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.684+0000 7f59d5200640 1 -- 172.21.15.67:0/800968402 wait complete. 2024-01-19T04:14:37.705 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 53cdbb2c-7315-41b5-8d5b-9529b19ae589 1 2024-01-19T04:14:37.783 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:37.781+0000 7fd3db028180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-19T04:14:37.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899f000640 1 Processor -- start 2024-01-19T04:14:37.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899f000640 1 -- start start 2024-01-19T04:14:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899f000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89980c1bc0 0x7f899806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899f000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8998157d60 con 0x7f89980c8290 2024-01-19T04:14:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899f000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8998158040 con 0x7f899806fe50 2024-01-19T04:14:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899f000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8998158320 con 0x7f89980c1bc0 2024-01-19T04:14:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899d000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f899806fe50 0x7f8998154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43868/0 (socket says 172.21.15.67:43868) 2024-01-19T04:14:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f899d000640 1 -- 172.21.15.67:0/3312835105 learned_addr learned my addr 172.21.15.67:0/3312835105 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-19T04:14:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f8997400640 1 --2- 172.21.15.67:0/3312835105 >> v2:172.21.15.32:3300/0 conn(0x7f89980c1bc0 0x7f899806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f8996a00640 1 -- 172.21.15.67:0/3312835105 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584721859 0 0) 0x7f8998158040 con 0x7f899806fe50 2024-01-19T04:14:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f8996a00640 1 -- 172.21.15.67:0/3312835105 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8978003530 con 0x7f899806fe50 2024-01-19T04:14:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f8997400640 1 -- 172.21.15.67:0/3312835105 >> v1:172.21.15.67:6789/0 conn(0x7f899806fe50 legacy=0x7f8998154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f8997400640 1 -- 172.21.15.67:0/3312835105 >> v1:172.21.15.32:6789/0 conn(0x7f89980c8290 legacy=0x7f89980a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.844+0000 7f8997400640 1 -- 172.21.15.67:0/3312835105 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998158600 con 0x7f89980c1bc0 2024-01-19T04:14:37.849 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f9c2842e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-19T04:14:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f8997400640 1 --2- 172.21.15.67:0/3312835105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 0x7f899806f910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89800097f0 tx=0x7f898001cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486019c118f685a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f8996a00640 1 -- 172.21.15.67:0/3312835105 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800ab600 con 0x7f89980c1bc0 2024-01-19T04:14:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f8996a00640 1 -- 172.21.15.67:0/3312835105 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89800a7050 con 0x7f89980c1bc0 2024-01-19T04:14:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f8996a00640 1 -- 172.21.15.67:0/3312835105 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800ab980 con 0x7f89980c1bc0 2024-01-19T04:14:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f899f000640 1 -- 172.21.15.67:0/3312835105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 msgr2=0x7f899806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f899f000640 1 --2- 172.21.15.67:0/3312835105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 0x7f899806f910 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89800097f0 tx=0x7f898001cdc0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f899f000640 1 -- 172.21.15.67:0/3312835105 shutdown_connections 2024-01-19T04:14:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f899f000640 1 --2- 172.21.15.67:0/3312835105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 0x7f899806f910 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f899f000640 1 -- 172.21.15.67:0/3312835105 >> 172.21.15.67:0/3312835105 conn(0x7f89980726d0 msgr2=0x7f89980663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f899f000640 1 -- 172.21.15.67:0/3312835105 shutdown_connections 2024-01-19T04:14:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.848+0000 7f899f000640 1 -- 172.21.15.67:0/3312835105 wait complete. 2024-01-19T04:14:37.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 Processor -- start 2024-01-19T04:14:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 -- start start 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f899806fe50 0x7f8998150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 0x7f8998154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89980c8290 0x7f89980abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980ab510 con 0x7f89980c1bc0 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980ab7f0 con 0x7f899806fe50 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89980aad20 con 0x7f89980c8290 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f899806fe50 0x7f8998150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899d000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89980c8290 0x7f89980abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 0x7f8998154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899d000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89980c8290 0x7f89980abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48250/0 (socket says 172.21.15.67:48250) 2024-01-19T04:14:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899d000640 1 -- 172.21.15.67:0/3871605023 learned_addr learned my addr 172.21.15.67:0/3871605023 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f899806fe50 0x7f8998150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47026/0 (socket says 172.21.15.67:47026) 2024-01-19T04:14:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 -- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89980c8290 msgr2=0x7f89980abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89980c8290 0x7f89980abc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 -- 172.21.15.67:0/3871605023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 msgr2=0x7f8998154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 0x7f8998154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 -- 172.21.15.67:0/3871605023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8980009420 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899d000640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89980c8290 0x7f89980abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f8997e00640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f899806fe50 0x7f8998150da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f898800c3c0 tx=0x7f898800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f898fe00640 1 -- 172.21.15.67:0/3871605023 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880052d0 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f898fe00640 1 -- 172.21.15.67:0/3871605023 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8988005430 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899815e600 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f898fe00640 1 -- 172.21.15.67:0/3871605023 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988007260 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899815ebc0 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f898fe00640 1 -- 172.21.15.67:0/3871605023 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f89880067e0 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.852+0000 7f898fe00640 1 -- 172.21.15.67:0/3871605023 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8988003d60 con 0x7f899806fe50 2024-01-19T04:14:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.856+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899806f3f0 con 0x7f899806fe50 2024-01-19T04:14:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.856+0000 7f898fe00640 1 -- 172.21.15.67:0/3871605023 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f8988020060 con 0x7f899806fe50 2024-01-19T04:14:37.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.924+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "53cdbb2c-7315-41b5-8d5b-9529b19ae589", "id": 1} v 0) v1 -- 0x7f89980749f0 con 0x7f899806fe50 2024-01-19T04:14:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f898fe00640 1 -- 172.21.15.67:0/3871605023 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53cdbb2c-7315-41b5-8d5b-9529b19ae589", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89880290b0 con 0x7f899806fe50 2024-01-19T04:14:37.934 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:14:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f899806fe50 msgr2=0x7f8998150da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f899806fe50 0x7f8998150da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f898800c3c0 tx=0x7f898800c880 comp rx=0 tx=0).stop 2024-01-19T04:14:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 shutdown_connections 2024-01-19T04:14:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89980c8290 0x7f89980abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89980c1bc0 0x7f8998154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 --2- 172.21.15.67:0/3871605023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f899806fe50 0x7f8998150da0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 >> 172.21.15.67:0/3871605023 conn(0x7f89980726d0 msgr2=0x7f89980663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 shutdown_connections 2024-01-19T04:14:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:37.932+0000 7f899f000640 1 -- 172.21.15.67:0/3871605023 wait complete. 2024-01-19T04:14:37.955 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new d57a1047-f559-494c-a108-633177df81c8 2 2024-01-19T04:14:38.018 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:38.017+0000 7fd3db028180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-19T04:14:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.092+0000 7fcda8a00640 1 Processor -- start 2024-01-19T04:14:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.092+0000 7fcda8a00640 1 -- start start 2024-01-19T04:14:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.092+0000 7fcda8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcda00c1750 0x7fcda014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.092+0000 7fcda8a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda00c4e40 con 0x7fcda00726c0 2024-01-19T04:14:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda8a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda0158dc0 con 0x7fcda014e970 2024-01-19T04:14:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda8a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda006f540 con 0x7fcda00c1750 2024-01-19T04:14:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda5600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcda00c1750 0x7fcda014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda6000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcda014e970 0x7fcda0070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43884/0 (socket says 172.21.15.67:43884) 2024-01-19T04:14:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda6000640 1 -- 172.21.15.67:0/2189972234 learned_addr learned my addr 172.21.15.67:0/2189972234 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-19T04:14:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda5600640 1 -- 172.21.15.67:0/2189972234 >> v1:172.21.15.67:6789/0 conn(0x7fcda014e970 legacy=0x7fcda0070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda5600640 1 -- 172.21.15.67:0/2189972234 >> v1:172.21.15.32:6789/0 conn(0x7fcda00726c0 legacy=0x7fcda006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda5600640 1 -- 172.21.15.67:0/2189972234 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00c4b60 con 0x7fcda00c1750 2024-01-19T04:14:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda4c00640 1 -- 172.21.15.67:0/2189972234 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131023714 0 0) 0x7fcda0158dc0 con 0x7fcda014e970 2024-01-19T04:14:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.096+0000 7fcda5600640 1 --2- 172.21.15.67:0/2189972234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00c1750 0x7fcda014ed50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097c0 tx=0x7fcd8801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1b8ec80007da715 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda4c00640 1 -- 172.21.15.67:0/2189972234 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880ab600 con 0x7fcda00c1750 2024-01-19T04:14:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda4c00640 1 -- 172.21.15.67:0/2189972234 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd880a7050 con 0x7fcda00c1750 2024-01-19T04:14:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda4c00640 1 -- 172.21.15.67:0/2189972234 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880ab980 con 0x7fcda00c1750 2024-01-19T04:14:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 -- 172.21.15.67:0/2189972234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00c1750 msgr2=0x7fcda014ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 --2- 172.21.15.67:0/2189972234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00c1750 0x7fcda014ed50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097c0 tx=0x7fcd8801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 -- 172.21.15.67:0/2189972234 shutdown_connections 2024-01-19T04:14:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 --2- 172.21.15.67:0/2189972234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00c1750 0x7fcda014ed50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 -- 172.21.15.67:0/2189972234 >> 172.21.15.67:0/2189972234 conn(0x7fcda00c6b30 msgr2=0x7fcda00c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 -- 172.21.15.67:0/2189972234 shutdown_connections 2024-01-19T04:14:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 -- 172.21.15.67:0/2189972234 wait complete. 2024-01-19T04:14:38.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 Processor -- start 2024-01-19T04:14:38.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 -- start start 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00726c0 0x7fcda01ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.100+0000 7fcda8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcda00c1750 0x7fcda01516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcda014e970 0x7fcda01f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda8a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01f1250 con 0x7fcda014e970 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0152270 con 0x7fcda00726c0 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01551a0 con 0x7fcda00c1750 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda6000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00726c0 0x7fcda01ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcda00c1750 0x7fcda01516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcda00c1750 0x7fcda01516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48262/0 (socket says 172.21.15.67:48262) 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 -- 172.21.15.67:0/435790441 learned_addr learned my addr 172.21.15.67:0/435790441 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda6a00640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcda014e970 0x7fcda01f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 -- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00726c0 msgr2=0x7fcda01ed900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00726c0 0x7fcda01ed900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 -- 172.21.15.67:0/435790441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcda014e970 msgr2=0x7fcda01f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcda014e970 0x7fcda01f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 -- 172.21.15.67:0/435790441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88009420 con 0x7fcda00c1750 2024-01-19T04:14:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda6000640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00726c0 0x7fcda01ed900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda6a00640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcda014e970 0x7fcda01f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda5600640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcda00c1750 0x7fcda01516d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcd88019000 tx=0x7fcd8801ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcd9e000640 1 -- 172.21.15.67:0/435790441 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880b7650 con 0x7fcda00c1750 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcd9e000640 1 -- 172.21.15.67:0/435790441 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd880b77d0 con 0x7fcda00c1750 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda0155480 con 0x7fcda00c1750 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcd9e000640 1 -- 172.21.15.67:0/435790441 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880b7b80 con 0x7fcda00c1750 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda0151c10 con 0x7fcda00c1750 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcd9e000640 1 -- 172.21.15.67:0/435790441 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fcd880c0780 con 0x7fcda00c1750 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcd9e000640 1 -- 172.21.15.67:0/435790441 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fcd880b5aa0 con 0x7fcda00c1750 2024-01-19T04:14:38.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.104+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda00749f0 con 0x7fcda00c1750 2024-01-19T04:14:38.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.116+0000 7fcd9e000640 1 -- 172.21.15.67:0/435790441 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fcd880decf0 con 0x7fcda00c1750 2024-01-19T04:14:38.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.188+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d57a1047-f559-494c-a108-633177df81c8", "id": 2} v 0) v1 -- 0x7fcda00724a0 con 0x7fcda00c1750 2024-01-19T04:14:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcd9e000640 1 -- 172.21.15.67:0/435790441 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d57a1047-f559-494c-a108-633177df81c8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd880cd030 con 0x7fcda00c1750 2024-01-19T04:14:38.194 INFO:teuthology.orchestra.run.smithi067.stdout:2 2024-01-19T04:14:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcda00c1750 msgr2=0x7fcda01516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcda00c1750 0x7fcda01516d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcd88019000 tx=0x7fcd8801ac30 comp rx=0 tx=0).stop 2024-01-19T04:14:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 shutdown_connections 2024-01-19T04:14:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcda014e970 0x7fcda01f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcda00c1750 0x7fcda01516d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 --2- 172.21.15.67:0/435790441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcda00726c0 0x7fcda01ed900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 >> 172.21.15.67:0/435790441 conn(0x7fcda00c6b30 msgr2=0x7fcda00bb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 shutdown_connections 2024-01-19T04:14:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.192+0000 7fcda8a00640 1 -- 172.21.15.67:0/435790441 wait complete. 2024-01-19T04:14:38.215 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new ba489804-04eb-44d3-a7c5-d2d6b09ee0f2 3 2024-01-19T04:14:38.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9ee400640 1 Processor -- start 2024-01-19T04:14:38.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9ee400640 1 -- start start 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9ee400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc9e80c1750 0x7fc9e814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9ee400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9ee400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e80c4e40 con 0x7fc9e814e970 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9ee400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e806f540 con 0x7fc9e80c1750 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9ee400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80c24c0 con 0x7fc9e80726c0 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48274/0 (socket says 172.21.15.67:48274) 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3933160977 learned_addr learned my addr 172.21.15.67:0/3933160977 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc9e814e970 0x7fc9e8070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43892/0 (socket says 172.21.15.67:43892) 2024-01-19T04:14:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e6a00640 1 --2- 172.21.15.67:0/3933160977 >> v2:172.21.15.32:3300/0 conn(0x7fc9e80c1750 0x7fc9e814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3933160977 >> v2:172.21.15.32:3300/0 conn(0x7fc9e80c1750 msgr2=0x7fc9e814ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7e00640 1 --2- 172.21.15.67:0/3933160977 >> v2:172.21.15.32:3300/0 conn(0x7fc9e80c1750 0x7fc9e814ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3933160977 >> v1:172.21.15.67:6789/0 conn(0x7fc9e814e970 legacy=0x7fc9e8070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e6000640 1 -- 172.21.15.67:0/3933160977 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270249964 0 0) 0x7fc9e80c4e40 con 0x7fc9e814e970 2024-01-19T04:14:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.356+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3933160977 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e8158dc0 con 0x7fc9e80726c0 2024-01-19T04:14:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9e7e00640 1 --2- 172.21.15.67:0/3933160977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80c2ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009e50 tx=0x7fc9e001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b77080d39884ec3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9e6000640 1 -- 172.21.15.67:0/3933160977 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00090d0 con 0x7fc9e80726c0 2024-01-19T04:14:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9e6000640 1 -- 172.21.15.67:0/3933160977 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0009230 con 0x7fc9e80726c0 2024-01-19T04:14:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9e6000640 1 -- 172.21.15.67:0/3933160977 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00a5a30 con 0x7fc9e80726c0 2024-01-19T04:14:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 -- 172.21.15.67:0/3933160977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 msgr2=0x7fc9e80c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 --2- 172.21.15.67:0/3933160977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80c2ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009e50 tx=0x7fc9e001c950 comp rx=0 tx=0).stop 2024-01-19T04:14:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 -- 172.21.15.67:0/3933160977 shutdown_connections 2024-01-19T04:14:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 --2- 172.21.15.67:0/3933160977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80c2ff0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 --2- 172.21.15.67:0/3933160977 >> v2:172.21.15.32:3300/0 conn(0x7fc9e80c1750 0x7fc9e814ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 -- 172.21.15.67:0/3933160977 >> 172.21.15.67:0/3933160977 conn(0x7fc9e80c6b30 msgr2=0x7fc9e80c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 -- 172.21.15.67:0/3933160977 shutdown_connections 2024-01-19T04:14:38.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.360+0000 7fc9ee400640 1 -- 172.21.15.67:0/3933160977 wait complete. 2024-01-19T04:14:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 Processor -- start 2024-01-19T04:14:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 -- start start 2024-01-19T04:14:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80bbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9e80c1750 0x7fc9e80bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e814e970 0x7fc9e80bf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8152600 con 0x7fc9e80c1750 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8152b30 con 0x7fc9e814e970 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8153030 con 0x7fc9e80726c0 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e814e970 0x7fc9e80bf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80bbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e814e970 0x7fc9e80bf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47058/0 (socket says 172.21.15.67:47058) 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3682855968 learned_addr learned my addr 172.21.15.67:0/3682855968 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e6a00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9e80c1750 0x7fc9e80bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3682855968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 msgr2=0x7fc9e80bbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80bbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3682855968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9e80c1750 msgr2=0x7fc9e80bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9e80c1750 0x7fc9e80bf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 -- 172.21.15.67:0/3682855968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0009b30 con 0x7fc9e814e970 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e6a00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9e80c1750 0x7fc9e80bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9e7e00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e814e970 0x7fc9e80bf7e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009e50 tx=0x7fc9e00196f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9df400640 1 -- 172.21.15.67:0/3682855968 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00090d0 con 0x7fc9e814e970 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9df400640 1 -- 172.21.15.67:0/3682855968 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0009510 con 0x7fc9e814e970 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9df400640 1 -- 172.21.15.67:0/3682855968 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00b8880 con 0x7fc9e814e970 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 -- 172.21.15.67:0/3682855968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e81ed250 con 0x7fc9e814e970 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9ee400640 1 -- 172.21.15.67:0/3682855968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e80bed80 con 0x7fc9e814e970 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9df400640 1 -- 172.21.15.67:0/3682855968 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fc9e00b89e0 con 0x7fc9e814e970 2024-01-19T04:14:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.364+0000 7fc9df400640 1 -- 172.21.15.67:0/3682855968 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc9e00c18a0 con 0x7fc9e814e970 2024-01-19T04:14:38.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.368+0000 7fc9dcc00640 1 -- 172.21.15.67:0/3682855968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e80bef70 con 0x7fc9e814e970 2024-01-19T04:14:38.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.368+0000 7fc9df400640 1 -- 172.21.15.67:0/3682855968 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fc9e00bc030 con 0x7fc9e814e970 2024-01-19T04:14:38.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.436+0000 7fc9dcc00640 1 -- 172.21.15.67:0/3682855968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba489804-04eb-44d3-a7c5-d2d6b09ee0f2", "id": 3} v 0) v1 -- 0x7fc9e80749f0 con 0x7fc9e814e970 2024-01-19T04:14:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.440+0000 7fc9df400640 1 -- 172.21.15.67:0/3682855968 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba489804-04eb-44d3-a7c5-d2d6b09ee0f2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9e00c1df0 con 0x7fc9e814e970 2024-01-19T04:14:38.443 INFO:teuthology.orchestra.run.smithi067.stdout:3 2024-01-19T04:14:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 -- 172.21.15.67:0/3682855968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e814e970 msgr2=0x7fc9e80bf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e814e970 0x7fc9e80bf7e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009e50 tx=0x7fc9e00196f0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 -- 172.21.15.67:0/3682855968 shutdown_connections 2024-01-19T04:14:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9e814e970 0x7fc9e80bf7e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9e80c1750 0x7fc9e80bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 --2- 172.21.15.67:0/3682855968 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9e80726c0 0x7fc9e80bbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 -- 172.21.15.67:0/3682855968 >> 172.21.15.67:0/3682855968 conn(0x7fc9e80c6b30 msgr2=0x7fc9e806e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 -- 172.21.15.67:0/3682855968 shutdown_connections 2024-01-19T04:14:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.444+0000 7fc9dcc00640 1 -- 172.21.15.67:0/3682855968 wait complete. 2024-01-19T04:14:38.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 0d6b8553-b674-45ed-a527-fd8c9d5726ae 4 2024-01-19T04:14:38.510 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:38.508+0000 7f9c2842e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-19T04:14:38.576 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:38.572+0000 7f9c2842e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-19T04:14:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.600+0000 7f0f06600640 1 Processor -- start 2024-01-19T04:14:38.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.600+0000 7f0f06600640 1 -- start start 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0f06600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f0006f810 0x7f0f000a7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0f06600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f0006fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0f06600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f00151fe0 con 0x7f0f00158580 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0f06600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f000c1970 con 0x7f0f0006f810 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0f06600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00157b30 con 0x7f0f000a7000 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0efea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f0006fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0effe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0f00158580 0x7f0f001545b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43896/0 (socket says 172.21.15.67:43896) 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0effe00640 1 -- 172.21.15.67:0/1522611896 learned_addr learned my addr 172.21.15.67:0/1522611896 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-19T04:14:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0eff400640 1 --2- 172.21.15.67:0/1522611896 >> v2:172.21.15.32:3300/0 conn(0x7f0f0006f810 0x7f0f000a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0efe000640 1 -- 172.21.15.67:0/1522611896 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796060763 0 0) 0x7f0ef80014a0 con 0x7f0f00158580 2024-01-19T04:14:38.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0efe000640 1 -- 172.21.15.67:0/1522611896 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee0003530 con 0x7f0f00158580 2024-01-19T04:14:38.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0efea00640 1 -- 172.21.15.67:0/1522611896 >> v2:172.21.15.32:3300/0 conn(0x7f0f0006f810 msgr2=0x7f0f000a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:38.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0efea00640 1 --2- 172.21.15.67:0/1522611896 >> v2:172.21.15.32:3300/0 conn(0x7f0f0006f810 0x7f0f000a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0efea00640 1 -- 172.21.15.67:0/1522611896 >> v1:172.21.15.67:6789/0 conn(0x7f0f00158580 legacy=0x7f0f001545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0efea00640 1 -- 172.21.15.67:0/1522611896 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f001580f0 con 0x7f0f000a7000 2024-01-19T04:14:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.604+0000 7f0eff400640 1 --2- 172.21.15.67:0/1522611896 >> v2:172.21.15.32:3300/0 conn(0x7f0f0006f810 0x7f0f000a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0efea00640 1 --2- 172.21.15.67:0/1522611896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f0006fbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097c0 tx=0x7f0ee801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e33bf7895f25fbd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0efe000640 1 -- 172.21.15.67:0/1522611896 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80ab600 con 0x7f0f000a7000 2024-01-19T04:14:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0efe000640 1 -- 172.21.15.67:0/1522611896 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee80a7050 con 0x7f0f000a7000 2024-01-19T04:14:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0efe000640 1 -- 172.21.15.67:0/1522611896 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80ab980 con 0x7f0f000a7000 2024-01-19T04:14:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 -- 172.21.15.67:0/1522611896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 msgr2=0x7f0f0006fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 --2- 172.21.15.67:0/1522611896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f0006fbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097c0 tx=0x7f0ee801c480 comp rx=0 tx=0).stop 2024-01-19T04:14:38.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 -- 172.21.15.67:0/1522611896 shutdown_connections 2024-01-19T04:14:38.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 --2- 172.21.15.67:0/1522611896 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f0006fbf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 --2- 172.21.15.67:0/1522611896 >> v2:172.21.15.32:3300/0 conn(0x7f0f0006f810 0x7f0f000a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 -- 172.21.15.67:0/1522611896 >> 172.21.15.67:0/1522611896 conn(0x7f0f000726d0 msgr2=0x7f0f000663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 -- 172.21.15.67:0/1522611896 shutdown_connections 2024-01-19T04:14:38.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.608+0000 7f0f06600640 1 -- 172.21.15.67:0/1522611896 wait complete. 2024-01-19T04:14:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 Processor -- start 2024-01-19T04:14:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 -- start start 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f0006f810 0x7f0f001ec760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f001559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f00158580 0x7f0f0006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00145c60 con 0x7f0f0006f810 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00149ab0 con 0x7f0f00158580 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0006d470 con 0x7f0f000a7000 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f001559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f001559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48294/0 (socket says 172.21.15.67:48294) 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0effe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f00158580 0x7f0f0006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0eff400640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f0006f810 0x7f0f001ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 -- 172.21.15.67:0/1549277376 learned_addr learned my addr 172.21.15.67:0/1549277376 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 -- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f00158580 msgr2=0x7f0f0006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f00158580 0x7f0f0006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 -- 172.21.15.67:0/1549277376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f0006f810 msgr2=0x7f0f001ec760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f0006f810 0x7f0f001ec760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 -- 172.21.15.67:0/1549277376 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0009420 con 0x7f0f000a7000 2024-01-19T04:14:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0effe00640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f00158580 0x7f0f0006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0efea00640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f001559f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ee801a0b0 tx=0x7f0ee8019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0ef7400640 1 -- 172.21.15.67:0/1549277376 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80b4410 con 0x7f0f000a7000 2024-01-19T04:14:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0ef7400640 1 -- 172.21.15.67:0/1549277376 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee80b4590 con 0x7f0f000a7000 2024-01-19T04:14:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0ef7400640 1 -- 172.21.15.67:0/1549277376 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80b4940 con 0x7f0f000a7000 2024-01-19T04:14:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.612+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee8009420 con 0x7f0f000a7000 2024-01-19T04:14:38.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.616+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f001f0880 con 0x7f0f000a7000 2024-01-19T04:14:38.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.616+0000 7f0ef7400640 1 -- 172.21.15.67:0/1549277376 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f0ee80b2040 con 0x7f0f000a7000 2024-01-19T04:14:38.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.616+0000 7f0ef7400640 1 -- 172.21.15.67:0/1549277376 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0ee80c0d70 con 0x7f0f000a7000 2024-01-19T04:14:38.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.616+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f000749f0 con 0x7f0f000a7000 2024-01-19T04:14:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.616+0000 7f0ef7400640 1 -- 172.21.15.67:0/1549277376 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f0ee80b0070 con 0x7f0f000a7000 2024-01-19T04:14:38.644 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:38.644+0000 7f9c2842e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-19T04:14:38.653 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:38.653+0000 7fd3db028180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-19T04:14:38.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.688+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d6b8553-b674-45ed-a527-fd8c9d5726ae", "id": 4} v 0) v1 -- 0x7f0f000c1750 con 0x7f0f000a7000 2024-01-19T04:14:38.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0ef7400640 1 -- 172.21.15.67:0/1549277376 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d6b8553-b674-45ed-a527-fd8c9d5726ae", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ee80c0460 con 0x7f0f000a7000 2024-01-19T04:14:38.693 INFO:teuthology.orchestra.run.smithi067.stdout:4 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 msgr2=0x7f0f001559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f001559f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ee801a0b0 tx=0x7f0ee8019220 comp rx=0 tx=0).stop 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 shutdown_connections 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f00158580 0x7f0f0006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f000a7000 0x7f0f001559f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 --2- 172.21.15.67:0/1549277376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f0006f810 0x7f0f001ec760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 >> 172.21.15.67:0/1549277376 conn(0x7f0f000726d0 msgr2=0x7f0f000c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 shutdown_connections 2024-01-19T04:14:38.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.692+0000 7f0f06600640 1 -- 172.21.15.67:0/1549277376 wait complete. 2024-01-19T04:14:38.714 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 335150a5-8328-44fe-9d7f-86b0c525ee43 5 2024-01-19T04:14:38.719 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:38.717+0000 7fd3db028180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-19T04:14:38.739 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:38.736+0000 7f9c2842e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-19T04:14:38.782 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:38.781+0000 7fd3db028180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-19T04:14:38.803 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:38.800+0000 7f9c2842e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-19T04:14:38.875 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:38.873+0000 7fd3db028180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-19T04:14:38.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.876+0000 7f3166400640 1 Processor -- start 2024-01-19T04:14:38.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.876+0000 7f3166400640 1 -- start start 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f3166400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31600c3230 0x7f31600c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f3166400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f316006eeb0 0x7f316006f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f3166400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600c6470 con 0x7f31601565d0 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f3166400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31600c6ff0 con 0x7f31600c3230 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f3166400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600c88a0 con 0x7f316006eeb0 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f316006eeb0 0x7f316006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315f400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f31601565d0 0x7f31600c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43902/0 (socket says 172.21.15.67:43902) 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f316006eeb0 0x7f316006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48308/0 (socket says 172.21.15.67:48308) 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315f400640 1 -- 172.21.15.67:0/1208512987 learned_addr learned my addr 172.21.15.67:0/1208512987 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315ea00640 1 --2- 172.21.15.67:0/1208512987 >> v2:172.21.15.67:3300/0 conn(0x7f31600c3230 0x7f31600c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315fe00640 1 -- 172.21.15.67:0/1208512987 >> v2:172.21.15.67:3300/0 conn(0x7f31600c3230 msgr2=0x7f31600c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315fe00640 1 --2- 172.21.15.67:0/1208512987 >> v2:172.21.15.67:3300/0 conn(0x7f31600c3230 0x7f31600c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315fe00640 1 -- 172.21.15.67:0/1208512987 >> v1:172.21.15.67:6789/0 conn(0x7f31601565d0 legacy=0x7f31600c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315fe00640 1 -- 172.21.15.67:0/1208512987 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600c66c0 con 0x7f316006eeb0 2024-01-19T04:14:38.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.880+0000 7f315e000640 1 -- 172.21.15.67:0/1208512987 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774407368 0 0) 0x7f31600c6470 con 0x7f31601565d0 2024-01-19T04:14:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f315fe00640 1 --2- 172.21.15.67:0/1208512987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f316006eeb0 0x7f316006f360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3158009d90 tx=0x7f315801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc50b202da6e5fef server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f315e000640 1 -- 172.21.15.67:0/1208512987 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580a5890 con 0x7f316006eeb0 2024-01-19T04:14:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f315e000640 1 -- 172.21.15.67:0/1208512987 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580a59f0 con 0x7f316006eeb0 2024-01-19T04:14:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f315e000640 1 -- 172.21.15.67:0/1208512987 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580a5d80 con 0x7f316006eeb0 2024-01-19T04:14:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 -- 172.21.15.67:0/1208512987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f316006eeb0 msgr2=0x7f316006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 --2- 172.21.15.67:0/1208512987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f316006eeb0 0x7f316006f360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3158009d90 tx=0x7f315801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 -- 172.21.15.67:0/1208512987 shutdown_connections 2024-01-19T04:14:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 --2- 172.21.15.67:0/1208512987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f316006eeb0 0x7f316006f360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 --2- 172.21.15.67:0/1208512987 >> v2:172.21.15.67:3300/0 conn(0x7f31600c3230 0x7f31600c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 -- 172.21.15.67:0/1208512987 >> 172.21.15.67:0/1208512987 conn(0x7f31600726d0 msgr2=0x7f31600663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 -- 172.21.15.67:0/1208512987 shutdown_connections 2024-01-19T04:14:38.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 -- 172.21.15.67:0/1208512987 wait complete. 2024-01-19T04:14:38.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 Processor -- start 2024-01-19T04:14:38.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.884+0000 7f3166400640 1 -- start start 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f316006eeb0 0x7f31600a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600c3230 0x7f316014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31601565d0 0x7f3160150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31601570b0 con 0x7f31600c3230 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3160070080 con 0x7f316006eeb0 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3160157820 con 0x7f31601565d0 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f316006eeb0 0x7f31600a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f316006eeb0 0x7f31600a9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47084/0 (socket says 172.21.15.67:47084) 2024-01-19T04:14:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 -- 172.21.15.67:0/3023241133 learned_addr learned my addr 172.21.15.67:0/3023241133 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315fe00640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31601565d0 0x7f3160150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315ea00640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600c3230 0x7f316014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:38.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 -- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31601565d0 msgr2=0x7f3160150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31601565d0 0x7f3160150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 -- 172.21.15.67:0/3023241133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600c3230 msgr2=0x7f316014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600c3230 0x7f316014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 -- 172.21.15.67:0/3023241133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3158009a70 con 0x7f316006eeb0 2024-01-19T04:14:38.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315fe00640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31601565d0 0x7f3160150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:38.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315ea00640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600c3230 0x7f316014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f315f400640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f316006eeb0 0x7f31600a9e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f315000c4b0 tx=0x7f315000c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3157400640 1 -- 172.21.15.67:0/3023241133 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500074e0 con 0x7f316006eeb0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3157400640 1 -- 172.21.15.67:0/3023241133 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150007660 con 0x7f316006eeb0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3160157d50 con 0x7f316006eeb0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3157400640 1 -- 172.21.15.67:0/3023241133 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150004a30 con 0x7f316006eeb0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31600ac4e0 con 0x7f316006eeb0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3157400640 1 -- 172.21.15.67:0/3023241133 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f315001d440 con 0x7f316006eeb0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3157400640 1 -- 172.21.15.67:0/3023241133 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3150012c00 con 0x7f316006eeb0 2024-01-19T04:14:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.888+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31600c2590 con 0x7f316006eeb0 2024-01-19T04:14:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.892+0000 7f3157400640 1 -- 172.21.15.67:0/3023241133 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f3150018070 con 0x7f316006eeb0 2024-01-19T04:14:38.901 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:38.900+0000 7f9c2842e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-19T04:14:38.939 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:38.937+0000 7fd3db028180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-19T04:14:38.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.960+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "335150a5-8328-44fe-9d7f-86b0c525ee43", "id": 5} v 0) v1 -- 0x7f31600749f0 con 0x7f316006eeb0 2024-01-19T04:14:38.963 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:38.960+0000 7f9c2842e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-19T04:14:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3157400640 1 -- 172.21.15.67:0/3023241133 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "335150a5-8328-44fe-9d7f-86b0c525ee43", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3150012750 con 0x7f316006eeb0 2024-01-19T04:14:38.966 INFO:teuthology.orchestra.run.smithi067.stdout:5 2024-01-19T04:14:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f316006eeb0 msgr2=0x7f31600a9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f316006eeb0 0x7f31600a9e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f315000c4b0 tx=0x7f315000c970 comp rx=0 tx=0).stop 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 shutdown_connections 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31601565d0 0x7f3160150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600c3230 0x7f316014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 --2- 172.21.15.67:0/3023241133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f316006eeb0 0x7f31600a9e10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 >> 172.21.15.67:0/3023241133 conn(0x7f31600726d0 msgr2=0x7f31600c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 shutdown_connections 2024-01-19T04:14:38.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:38.964+0000 7f3166400640 1 -- 172.21.15.67:0/3023241133 wait complete. 2024-01-19T04:14:38.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 07623ff6-1566-4024-8990-269e377b9068 6 2024-01-19T04:14:39.032 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:39.029+0000 7fd3db028180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-19T04:14:39.094 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:39.093+0000 7fd3db028180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-19T04:14:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb9a00640 1 Processor -- start 2024-01-19T04:14:39.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb9a00640 1 -- start start 2024-01-19T04:14:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb9a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1eb406d5c0 0x7f1eb4157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb9a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb9a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb40c18d0 con 0x7f1eb4151bb0 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb9a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb40c3050 con 0x7f1eb406d5c0 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb9a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb406b4d0 con 0x7f1eb41584d0 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb415ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48320/0 (socket says 172.21.15.67:48320) 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb2000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1eb406d5c0 0x7f1eb4157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb3400640 1 -- 172.21.15.67:0/1303554886 learned_addr learned my addr 172.21.15.67:0/1303554886 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb2a00640 1 --1- 172.21.15.67:0/1303554886 >> v1:172.21.15.32:6789/0 conn(0x7f1eb4151bb0 0x7f1eb406dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.67:53702/0 (socket says 172.21.15.67:53702) 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb3400640 1 -- 172.21.15.67:0/1303554886 >> v2:172.21.15.32:3300/0 conn(0x7f1eb406d5c0 msgr2=0x7f1eb4157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb3400640 1 --2- 172.21.15.67:0/1303554886 >> v2:172.21.15.32:3300/0 conn(0x7f1eb406d5c0 0x7f1eb4157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb3400640 1 -- 172.21.15.67:0/1303554886 >> v1:172.21.15.32:6789/0 conn(0x7f1eb4151bb0 legacy=0x7f1eb406dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb3400640 1 -- 172.21.15.67:0/1303554886 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40c1410 con 0x7f1eb41584d0 2024-01-19T04:14:39.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.124+0000 7f1eb1600640 1 -- 172.21.15.67:0/1303554886 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970551970 0 0) 0x7f1eb40c18d0 con 0x7f1eb4151bb0 2024-01-19T04:14:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb3400640 1 --2- 172.21.15.67:0/1303554886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb415ef40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009e50 tx=0x7f1eac01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb5db0bd1a88dca9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:39.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb1600640 1 -- 172.21.15.67:0/1303554886 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0a5810 con 0x7f1eb41584d0 2024-01-19T04:14:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb1600640 1 -- 172.21.15.67:0/1303554886 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac0a5970 con 0x7f1eb41584d0 2024-01-19T04:14:39.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb1600640 1 -- 172.21.15.67:0/1303554886 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0a5d00 con 0x7f1eb41584d0 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 -- 172.21.15.67:0/1303554886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 msgr2=0x7f1eb415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 --2- 172.21.15.67:0/1303554886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb415ef40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009e50 tx=0x7f1eac01c950 comp rx=0 tx=0).stop 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 -- 172.21.15.67:0/1303554886 shutdown_connections 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 --2- 172.21.15.67:0/1303554886 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb415ef40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 --2- 172.21.15.67:0/1303554886 >> v2:172.21.15.32:3300/0 conn(0x7f1eb406d5c0 0x7f1eb4157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 -- 172.21.15.67:0/1303554886 >> 172.21.15.67:0/1303554886 conn(0x7f1eb40c39d0 msgr2=0x7f1eb40c3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 -- 172.21.15.67:0/1303554886 shutdown_connections 2024-01-19T04:14:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.128+0000 7f1eb9a00640 1 -- 172.21.15.67:0/1303554886 wait complete. 2024-01-19T04:14:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 Processor -- start 2024-01-19T04:14:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 -- start start 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb406d5c0 0x7f1eb4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1eb4151bb0 0x7f1eb40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb41edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4154ae0 con 0x7f1eb4151bb0 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41f05c0 con 0x7f1eb406d5c0 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41f0af0 con 0x7f1eb41584d0 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb406d5c0 0x7f1eb4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb41edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb41edb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48334/0 (socket says 172.21.15.67:48334) 2024-01-19T04:14:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 -- 172.21.15.67:0/790539944 learned_addr learned my addr 172.21.15.67:0/790539944 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:39.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb2000640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1eb4151bb0 0x7f1eb40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.136 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f9c2842e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-19T04:14:39.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 -- 172.21.15.67:0/790539944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb406d5c0 msgr2=0x7f1eb4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb406d5c0 0x7f1eb4154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 -- 172.21.15.67:0/790539944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1eb4151bb0 msgr2=0x7f1eb40712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1eb4151bb0 0x7f1eb40712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 -- 172.21.15.67:0/790539944 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac009b30 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb2000640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1eb4151bb0 0x7f1eb40712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb3400640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb41edb20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0af040 tx=0x7f1eac0196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eaaa00640 1 -- 172.21.15.67:0/790539944 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0b8670 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eaaa00640 1 -- 172.21.15.67:0/790539944 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac0b87d0 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb41f0810 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eaaa00640 1 -- 172.21.15.67:0/790539944 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0b8b60 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.132+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb4154770 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.136+0000 7f1eaaa00640 1 -- 172.21.15.67:0/790539944 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f1eac0b8cc0 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.136+0000 7f1eaaa00640 1 -- 172.21.15.67:0/790539944 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1eac0b6a30 con 0x7f1eb41584d0 2024-01-19T04:14:39.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.136+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb4154c90 con 0x7f1eb41584d0 2024-01-19T04:14:39.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.140+0000 7f1eaaa00640 1 -- 172.21.15.67:0/790539944 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f1eb4154c90 con 0x7f1eb41584d0 2024-01-19T04:14:39.209 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:39.208+0000 7f9c2842e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-19T04:14:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.208+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "07623ff6-1566-4024-8990-269e377b9068", "id": 6} v 0) v1 -- 0x7f1eb4072b30 con 0x7f1eb41584d0 2024-01-19T04:14:39.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eaaa00640 1 -- 172.21.15.67:0/790539944 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07623ff6-1566-4024-8990-269e377b9068", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1eac0bc020 con 0x7f1eb41584d0 2024-01-19T04:14:39.215 INFO:teuthology.orchestra.run.smithi067.stdout:6 2024-01-19T04:14:39.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 msgr2=0x7f1eb41edb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eb9a00640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb41edb20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0af040 tx=0x7f1eac0196f0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 shutdown_connections 2024-01-19T04:14:39.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eb9a00640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1eb41584d0 0x7f1eb41edb20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eb9a00640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1eb4151bb0 0x7f1eb40712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eb9a00640 1 --2- 172.21.15.67:0/790539944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb406d5c0 0x7f1eb4154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.212+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 >> 172.21.15.67:0/790539944 conn(0x7f1eb40c39d0 msgr2=0x7f1eb41507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:39.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.216+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 shutdown_connections 2024-01-19T04:14:39.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.216+0000 7f1eb9a00640 1 -- 172.21.15.67:0/790539944 wait complete. 2024-01-19T04:14:39.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd new 9788335f-6ed0-4675-8937-356278be3f0e 7 2024-01-19T04:14:39.259 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:39.257+0000 7fd3db028180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-19T04:14:39.331 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:39.329+0000 7fd3db028180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-19T04:14:39.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd9c00640 1 Processor -- start 2024-01-19T04:14:39.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd9c00640 1 -- start start 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd9c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c8290 0x7f6cd40a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd9c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6cd4154650 0x7f6cd4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd9c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd4157d60 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd9c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd4158040 con 0x7f6cd4154650 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd9c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd4158320 con 0x7f6cd40c8290 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c8290 0x7f6cd40a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c8290 0x7f6cd40a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48336/0 (socket says 172.21.15.67:48336) 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2557411475 learned_addr learned my addr 172.21.15.67:0/2557411475 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd3400640 1 --2- 172.21.15.67:0/2557411475 >> v2:172.21.15.32:3300/0 conn(0x7f6cd4154650 0x7f6cd4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2557411475 >> v2:172.21.15.32:3300/0 conn(0x7f6cd4154650 msgr2=0x7f6cd4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:39.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd2a00640 1 --2- 172.21.15.67:0/2557411475 >> v2:172.21.15.32:3300/0 conn(0x7f6cd4154650 0x7f6cd4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2557411475 >> v1:172.21.15.32:6789/0 conn(0x7f6cd40c1bc0 legacy=0x7f6cd406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.372+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2557411475 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4158600 con 0x7f6cd40c8290 2024-01-19T04:14:39.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd2a00640 1 --2- 172.21.15.67:0/2557411475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c8290 0x7f6cd40a7190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009870 tx=0x7f6cc401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=337ab2a82ae454aa server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:39.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd1600640 1 -- 172.21.15.67:0/2557411475 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40ab600 con 0x7f6cd40c8290 2024-01-19T04:14:39.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd1600640 1 -- 172.21.15.67:0/2557411475 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc40a7050 con 0x7f6cd40c8290 2024-01-19T04:14:39.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd1600640 1 -- 172.21.15.67:0/2557411475 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40ab980 con 0x7f6cd40c8290 2024-01-19T04:14:39.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2557411475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c8290 msgr2=0x7f6cd40a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd9c00640 1 --2- 172.21.15.67:0/2557411475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c8290 0x7f6cd40a7190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009870 tx=0x7f6cc401c4b0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2557411475 shutdown_connections 2024-01-19T04:14:39.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd9c00640 1 --2- 172.21.15.67:0/2557411475 >> v2:172.21.15.32:3300/0 conn(0x7f6cd4154650 0x7f6cd4154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd9c00640 1 --2- 172.21.15.67:0/2557411475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c8290 0x7f6cd40a7190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.376+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2557411475 >> 172.21.15.67:0/2557411475 conn(0x7f6cd40726d0 msgr2=0x7f6cd40663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:39.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2557411475 shutdown_connections 2024-01-19T04:14:39.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2557411475 wait complete. 2024-01-19T04:14:39.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 Processor -- start 2024-01-19T04:14:39.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 -- start start 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c1bc0 0x7f6cd415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40c8290 0x7f6cd41510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6cd4154650 0x7f6cd41515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd40c7f60 con 0x7f6cd4154650 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd4159050 con 0x7f6cd40c8290 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd9c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd40a6e50 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c1bc0 0x7f6cd415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40c8290 0x7f6cd41510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c1bc0 0x7f6cd415e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.67:48346/0 (socket says 172.21.15.67:48346) 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40c8290 0x7f6cd41510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47094/0 (socket says 172.21.15.67:47094) 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2188324999 learned_addr learned my addr 172.21.15.67:0/2188324999 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd3400640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6cd4154650 0x7f6cd41515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2188324999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40c8290 msgr2=0x7f6cd41510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40c8290 0x7f6cd41510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2188324999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6cd4154650 msgr2=0x7f6cd41515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6cd4154650 0x7f6cd41515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 -- 172.21.15.67:0/2188324999 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40094d0 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.380+0000 7f6cd2a00640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c1bc0 0x7f6cd415e1b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40ae040 tx=0x7f6cc401acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6ccaa00640 1 -- 172.21.15.67:0/2188324999 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40b6420 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6ccaa00640 1 -- 172.21.15.67:0/2188324999 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc40b6580 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6ccaa00640 1 -- 172.21.15.67:0/2188324999 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40b6910 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd40a7130 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd40ac990 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6ccaa00640 1 -- 172.21.15.67:0/2188324999 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f6cc40b2040 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6ccaa00640 1 -- 172.21.15.67:0/2188324999 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6cc40bfa90 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd40749f0 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.384+0000 7f6ccaa00640 1 -- 172.21.15.67:0/2188324999 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f6cc40c4060 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.460+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9788335f-6ed0-4675-8937-356278be3f0e", "id": 7} v 0) v1 -- 0x7f6cd40c17a0 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6ccaa00640 1 -- 172.21.15.67:0/2188324999 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9788335f-6ed0-4675-8937-356278be3f0e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6cc40ba070 con 0x7f6cd40c1bc0 2024-01-19T04:14:39.465 INFO:teuthology.orchestra.run.smithi067.stdout:7 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c1bc0 msgr2=0x7f6cd415e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c1bc0 0x7f6cd415e1b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40ae040 tx=0x7f6cc401acf0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 shutdown_connections 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6cd4154650 0x7f6cd41515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6cd40c8290 0x7f6cd41510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 --2- 172.21.15.67:0/2188324999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6cd40c1bc0 0x7f6cd415e1b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 >> 172.21.15.67:0/2188324999 conn(0x7f6cd40726d0 msgr2=0x7f6cd406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 shutdown_connections 2024-01-19T04:14:39.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-19T04:14:39.464+0000 7f6cd9c00640 1 -- 172.21.15.67:0/2188324999 wait complete. 2024-01-19T04:14:39.485 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-19T04:14:39.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-19T04:14:39.488 INFO:tasks.ceph.osd.0:Started 2024-01-19T04:14:39.488 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-19T04:14:39.488 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-19T04:14:39.491 INFO:tasks.ceph.osd.1:Started 2024-01-19T04:14:39.492 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-19T04:14:39.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-19T04:14:39.495 INFO:tasks.ceph.osd.2:Started 2024-01-19T04:14:39.495 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-19T04:14:39.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-19T04:14:39.498 INFO:tasks.ceph.osd.3:Started 2024-01-19T04:14:39.498 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-19T04:14:39.498 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-19T04:14:39.502 INFO:tasks.ceph.osd.4:Started 2024-01-19T04:14:39.502 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-19T04:14:39.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-19T04:14:39.505 INFO:tasks.ceph.osd.5:Started 2024-01-19T04:14:39.505 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-19T04:14:39.505 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-19T04:14:39.508 INFO:tasks.ceph.osd.6:Started 2024-01-19T04:14:39.508 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-19T04:14:39.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-19T04:14:39.514 INFO:tasks.ceph.osd.7:Started 2024-01-19T04:14:39.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:14:39.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 Processor -- start 2024-01-19T04:14:39.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 -- start start 2024-01-19T04:14:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd46806f520 0x7fd46806f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd468158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd46806ecf0 0x7fd4680a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4680a8d80 con 0x7fd46806f520 2024-01-19T04:14:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd468158fe0 con 0x7fd46806ecf0 2024-01-19T04:14:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.669+0000 7fd46f400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680c3c50 con 0x7fd46806e8a0 2024-01-19T04:14:39.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd468158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd468158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:37630/0 (socket says 172.21.15.32:37630) 2024-01-19T04:14:39.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 -- 172.21.15.32:0/341148517 learned_addr learned my addr 172.21.15.32:0/341148517 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:39.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd46de00640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.67:3300/0 conn(0x7fd46806ecf0 0x7fd4680a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd46ca00640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.32:3300/0 conn(0x7fd46806f520 0x7fd46806f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 -- 172.21.15.32:0/341148517 >> v2:172.21.15.67:3300/0 conn(0x7fd46806ecf0 msgr2=0x7fd4680a9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.67:3300/0 conn(0x7fd46806ecf0 0x7fd4680a9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 -- 172.21.15.32:0/341148517 >> v2:172.21.15.32:3300/0 conn(0x7fd46806f520 msgr2=0x7fd46806f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.32:3300/0 conn(0x7fd46806f520 0x7fd46806f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd467e00640 1 -- 172.21.15.32:0/341148517 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46806b250 con 0x7fd46806e8a0 2024-01-19T04:14:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd46de00640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.67:3300/0 conn(0x7fd46806ecf0 0x7fd4680a9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.673+0000 7fd46ca00640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.32:3300/0 conn(0x7fd46806f520 0x7fd46806f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:14:39.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd467e00640 1 --2- 172.21.15.32:0/341148517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd468158aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd4681249e0 tx=0x7fd45001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52f7d7554ed65aeb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:39.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd467400640 1 -- 172.21.15.32:0/341148517 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500ab600 con 0x7fd46806e8a0 2024-01-19T04:14:39.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd467400640 1 -- 172.21.15.32:0/341148517 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4500a7050 con 0x7fd46806e8a0 2024-01-19T04:14:39.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd467400640 1 -- 172.21.15.32:0/341148517 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500ab980 con 0x7fd46806e8a0 2024-01-19T04:14:39.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 -- 172.21.15.32:0/341148517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 msgr2=0x7fd468158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 --2- 172.21.15.32:0/341148517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd468158aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd4681249e0 tx=0x7fd45001c3e0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 -- 172.21.15.32:0/341148517 shutdown_connections 2024-01-19T04:14:39.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.67:3300/0 conn(0x7fd46806ecf0 0x7fd4680a9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 --2- 172.21.15.32:0/341148517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd468158aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 --2- 172.21.15.32:0/341148517 >> v2:172.21.15.32:3300/0 conn(0x7fd46806f520 0x7fd46806f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 -- 172.21.15.32:0/341148517 >> 172.21.15.32:0/341148517 conn(0x7fd46806d6c0 msgr2=0x7fd46806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:39.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 -- 172.21.15.32:0/341148517 shutdown_connections 2024-01-19T04:14:39.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.677+0000 7fd46f400640 1 -- 172.21.15.32:0/341148517 wait complete. 2024-01-19T04:14:39.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 Processor -- start 2024-01-19T04:14:39.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 -- start start 2024-01-19T04:14:39.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd46814dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd46806ecf0 0x7fd4681f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806f520 0x7fd4680ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:39.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681f5330 con 0x7fd46806f520 2024-01-19T04:14:39.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd468157280 con 0x7fd46806ecf0 2024-01-19T04:14:39.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46f400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd468157560 con 0x7fd46806e8a0 2024-01-19T04:14:39.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46ca00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd46814dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46ca00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd46814dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:37632/0 (socket says 172.21.15.32:37632) 2024-01-19T04:14:39.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.681+0000 7fd46ca00640 1 -- 172.21.15.32:0/3201054434 learned_addr learned my addr 172.21.15.32:0/3201054434 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:39.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd467e00640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd46806ecf0 0x7fd4681f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46de00640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806f520 0x7fd4680ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:39.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46ca00640 1 -- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd46806ecf0 msgr2=0x7fd4681f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46ca00640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd46806ecf0 0x7fd4681f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46ca00640 1 -- 172.21.15.32:0/3201054434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806f520 msgr2=0x7fd4680ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46ca00640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806f520 0x7fd4680ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46ca00640 1 -- 172.21.15.32:0/3201054434 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460009a70 con 0x7fd46806e8a0 2024-01-19T04:14:39.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46de00640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806f520 0x7fd4680ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:39.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46ca00640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd46814dcc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c7f0 tx=0x7fd45800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:39.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd464c00640 1 -- 172.21.15.32:0/3201054434 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458007820 con 0x7fd46806e8a0 2024-01-19T04:14:39.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd464c00640 1 -- 172.21.15.32:0/3201054434 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458007980 con 0x7fd46806e8a0 2024-01-19T04:14:39.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4500094d0 con 0x7fd46806e8a0 2024-01-19T04:14:39.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd464c00640 1 -- 172.21.15.32:0/3201054434 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458007d30 con 0x7fd46806e8a0 2024-01-19T04:14:39.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.685+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4681505b0 con 0x7fd46806e8a0 2024-01-19T04:14:39.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.689+0000 7fd464c00640 1 -- 172.21.15.32:0/3201054434 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fd45801a450 con 0x7fd46806e8a0 2024-01-19T04:14:39.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.689+0000 7fd464c00640 1 -- 172.21.15.32:0/3201054434 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd458022350 con 0x7fd46806e8a0 2024-01-19T04:14:39.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.689+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4680acd60 con 0x7fd46806e8a0 2024-01-19T04:14:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.689+0000 7fd464c00640 1 -- 172.21.15.32:0/3201054434 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fd458039cf0 con 0x7fd46806e8a0 2024-01-19T04:14:39.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.773+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd46804e980 con 0x7fd46806e8a0 2024-01-19T04:14:39.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.773+0000 7fd464c00640 1 -- 172.21.15.32:0/3201054434 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fd458028030 con 0x7fd46806e8a0 2024-01-19T04:14:39.777 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:14:39.777 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:14:39.463353+0000","last_up_change":"0.000000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 msgr2=0x7fd46814dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd46814dcc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c7f0 tx=0x7fd45800ccb0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 shutdown_connections 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806f520 0x7fd4680ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd46806ecf0 0x7fd4681f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 --2- 172.21.15.32:0/3201054434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd46806e8a0 0x7fd46814dcc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 >> 172.21.15.32:0/3201054434 conn(0x7fd46806d6c0 msgr2=0x7fd468073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 shutdown_connections 2024-01-19T04:14:39.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:39.777+0000 7fd46f400640 1 -- 172.21.15.32:0/3201054434 wait complete. 2024-01-19T04:14:39.797 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-19T04:14:39.797 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-19T04:14:39.912 INFO:tasks.ceph.mgr.x.smithi067.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-19T04:14:39.912 INFO:tasks.ceph.mgr.x.smithi067.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-19T04:14:39.912 INFO:tasks.ceph.mgr.x.smithi067.stderr: from numpy import show_config as show_numpy_config 2024-01-19T04:14:39.967 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:39.964+0000 7f9c2842e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-19T04:14:39.989 INFO:tasks.ceph.mgr.y.smithi032.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-19T04:14:39.990 INFO:tasks.ceph.mgr.y.smithi032.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-19T04:14:39.990 INFO:tasks.ceph.mgr.y.smithi032.stderr: from numpy import show_config as show_numpy_config 2024-01-19T04:14:40.033 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:40.029+0000 7fd3db028180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-19T04:14:40.111 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:40.108+0000 7f9c2842e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:14:40.142 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-01-19T04:14:40.141+0000 7f51c65b0640 -1 Falling back to public interface 2024-01-19T04:14:40.154 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-01-19T04:14:40.153+0000 7f177048c640 -1 Falling back to public interface 2024-01-19T04:14:40.162 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-01-19T04:14:40.161+0000 7f1ebdda7640 -1 Falling back to public interface 2024-01-19T04:14:40.162 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-01-19T04:14:40.161+0000 7f7e64f05640 -1 Falling back to public interface 2024-01-19T04:14:40.182 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:40.181+0000 7fd3db028180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:14:40.197 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-01-19T04:14:40.196+0000 7f443a977640 -1 Falling back to public interface 2024-01-19T04:14:40.206 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-01-19T04:14:40.204+0000 7fe6ceb96640 -1 Falling back to public interface 2024-01-19T04:14:40.206 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-01-19T04:14:40.204+0000 7f8266cea640 -1 Falling back to public interface 2024-01-19T04:14:40.245 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-01-19T04:14:40.244+0000 7f7646872640 -1 Falling back to public interface 2024-01-19T04:14:40.289 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:40.288+0000 7f9c2842e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-19T04:14:40.365 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:40.364+0000 7f9c2842e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-19T04:14:40.374 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:40.373+0000 7fd3db028180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-19T04:14:40.450 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:40.449+0000 7fd3db028180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-19T04:14:40.510 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:40.508+0000 7f9c2842e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:14:40.598 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:40.597+0000 7fd3db028180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-19T04:14:40.601 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T04:14:40.733 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f594bc00640 1 Processor -- start 2024-01-19T04:14:40.733 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f594bc00640 1 -- start start 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f594bc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f594414fb70 0x7f59440c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f594bc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5944070980 0x7f5944152860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f594bc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594406fae0 con 0x7f59440a74e0 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f594bc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594414ff50 con 0x7f5944070980 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f594bc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440c7640 con 0x7f594414fb70 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5943e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5944070980 0x7f5944152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5943e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5944070980 0x7f5944152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44478/0 (socket says 172.21.15.32:44478) 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5943e00640 1 -- 172.21.15.32:0/311964479 learned_addr learned my addr 172.21.15.32:0/311964479 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:40.735 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5949200640 1 --2- 172.21.15.32:0/311964479 >> v2:172.21.15.67:3300/0 conn(0x7f594414fb70 0x7f59440c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:40.736 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5943e00640 1 -- 172.21.15.32:0/311964479 >> v2:172.21.15.67:3300/0 conn(0x7f594414fb70 msgr2=0x7f59440c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:40.736 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5943e00640 1 --2- 172.21.15.32:0/311964479 >> v2:172.21.15.67:3300/0 conn(0x7f594414fb70 0x7f59440c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.736 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5943e00640 1 -- 172.21.15.32:0/311964479 >> v1:172.21.15.67:6789/0 conn(0x7f59440a74e0 legacy=0x7f5944152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:40.736 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.733+0000 7f5943e00640 1 -- 172.21.15.32:0/311964479 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440c71c0 con 0x7f5944070980 2024-01-19T04:14:40.740 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.737+0000 7f5943e00640 1 --2- 172.21.15.32:0/311964479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5944070980 0x7f5944152860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f59440c7ce0 tx=0x7f592c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34564764c77a0b2e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:40.741 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.737+0000 7f5943400640 1 -- 172.21.15.32:0/311964479 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0ab600 con 0x7f5944070980 2024-01-19T04:14:40.741 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f5943400640 1 -- 172.21.15.32:0/311964479 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0a7050 con 0x7f5944070980 2024-01-19T04:14:40.741 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f5943400640 1 -- 172.21.15.32:0/311964479 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0ab980 con 0x7f5944070980 2024-01-19T04:14:40.741 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- 172.21.15.32:0/311964479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5944070980 msgr2=0x7f5944152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:40.741 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 --2- 172.21.15.32:0/311964479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5944070980 0x7f5944152860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f59440c7ce0 tx=0x7f592c01c3e0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.742 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- 172.21.15.32:0/311964479 shutdown_connections 2024-01-19T04:14:40.742 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 --2- 172.21.15.32:0/311964479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5944070980 0x7f5944152860 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.742 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 --2- 172.21.15.32:0/311964479 >> v2:172.21.15.67:3300/0 conn(0x7f594414fb70 0x7f59440c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.742 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- 172.21.15.32:0/311964479 >> 172.21.15.32:0/311964479 conn(0x7f59440a9a30 msgr2=0x7f59440a9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:40.742 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- 172.21.15.32:0/311964479 shutdown_connections 2024-01-19T04:14:40.742 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- 172.21.15.32:0/311964479 wait complete. 2024-01-19T04:14:40.744 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 Processor -- start 2024-01-19T04:14:40.744 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- start start 2024-01-19T04:14:40.745 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5944070980 0x7f594415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:40.745 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59440a74e0 0x7f5944145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:40.745 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f594414fb70 0x7f59441f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:40.745 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594414a630 con 0x7f594414fb70 2024-01-19T04:14:40.745 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441ed2d0 con 0x7f5944070980 2024-01-19T04:14:40.746 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.741+0000 7f594bc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59441ed5b0 con 0x7f59440a74e0 2024-01-19T04:14:40.746 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f594414fb70 0x7f59441f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:40.746 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5944070980 0x7f594415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:40.746 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5943e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59440a74e0 0x7f5944145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:40.746 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f594414fb70 0x7f59441f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44494/0 (socket says 172.21.15.32:44494) 2024-01-19T04:14:40.746 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 -- 172.21.15.32:0/1959783604 learned_addr learned my addr 172.21.15.32:0/1959783604 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 -- 172.21.15.32:0/1959783604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59440a74e0 msgr2=0x7f5944145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 --2- 172.21.15.32:0/1959783604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59440a74e0 0x7f5944145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 -- 172.21.15.32:0/1959783604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5944070980 msgr2=0x7f594415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 --2- 172.21.15.32:0/1959783604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5944070980 0x7f594415c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 -- 172.21.15.32:0/1959783604 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0094d0 con 0x7f594414fb70 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5949c00640 1 --2- 172.21.15.32:0/1959783604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f594414fb70 0x7f59441f0580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c770 tx=0x7f593c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5940c00640 1 -- 172.21.15.32:0/1959783604 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c003b80 con 0x7f594414fb70 2024-01-19T04:14:40.747 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5940c00640 1 -- 172.21.15.32:0/1959783604 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c003ce0 con 0x7f594414fb70 2024-01-19T04:14:40.748 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5940c00640 1 -- 172.21.15.32:0/1959783604 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00aa90 con 0x7f594414fb70 2024-01-19T04:14:40.748 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59441ed890 con 0x7f594414fb70 2024-01-19T04:14:40.748 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59441ecfc0 con 0x7f594414fb70 2024-01-19T04:14:40.748 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5940c00640 1 -- 172.21.15.32:0/1959783604 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f593c0050d0 con 0x7f594414fb70 2024-01-19T04:14:40.748 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f5940c00640 1 -- 172.21.15.32:0/1959783604 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f593c012420 con 0x7f594414fb70 2024-01-19T04:14:40.748 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.745+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59441eddb0 con 0x7f594414fb70 2024-01-19T04:14:40.750 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.749+0000 7f5940c00640 1 -- 172.21.15.32:0/1959783604 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f59441eddb0 con 0x7f594414fb70 2024-01-19T04:14:40.809 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f594404f1d0 con 0x7f594414fb70 2024-01-19T04:14:40.810 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f5940c00640 1 -- 172.21.15.32:0/1959783604 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f593c003e50 con 0x7f594414fb70 2024-01-19T04:14:40.810 INFO:teuthology.misc.health.smithi032.stdout: 2024-01-19T04:14:40.810 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:14:39.463353+0000","last_up_change":"0.000000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:14:40.811 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f594414fb70 msgr2=0x7f59441f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:40.811 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 --2- 172.21.15.32:0/1959783604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f594414fb70 0x7f59441f0580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c770 tx=0x7f593c00cc30 comp rx=0 tx=0).stop 2024-01-19T04:14:40.811 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 shutdown_connections 2024-01-19T04:14:40.812 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 --2- 172.21.15.32:0/1959783604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f594414fb70 0x7f59441f0580 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.812 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 --2- 172.21.15.32:0/1959783604 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f59440a74e0 0x7f5944145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.812 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 --2- 172.21.15.32:0/1959783604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5944070980 0x7f594415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:40.812 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 >> 172.21.15.32:0/1959783604 conn(0x7f59440a9a30 msgr2=0x7f594414ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:40.812 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 shutdown_connections 2024-01-19T04:14:40.812 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:40.809+0000 7f594bc00640 1 -- 172.21.15.32:0/1959783604 wait complete. 2024-01-19T04:14:40.829 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-19T04:14:41.216 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:41.212+0000 7f9c2842e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-19T04:14:41.306 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:41.304+0000 7f9c2842e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-19T04:14:41.314 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:41.313+0000 7fd3db028180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-19T04:14:41.407 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:41.405+0000 7fd3db028180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-19T04:14:41.505 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:41.504+0000 7f9c2842e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-19T04:14:41.594 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:41.592+0000 7f9c2842e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-19T04:14:41.607 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:41.605+0000 7fd3db028180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-19T04:14:41.698 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:41.697+0000 7fd3db028180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-19T04:14:41.936 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:41.932+0000 7f9c2842e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-19T04:14:42.009 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:42.008+0000 7f9c2842e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-19T04:14:42.046 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:42.045+0000 7fd3db028180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-19T04:14:42.121 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-01-19T04:14:42.121+0000 7fd3db028180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-19T04:14:43.031 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:43.028+0000 7f9bcd800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-19T04:14:43.031 INFO:tasks.ceph.mgr.x.smithi067.stderr:2024-01-19T04:14:43.028+0000 7f9bcd800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-19T04:14:44.005 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-01-19T04:14:44.000+0000 7f7e64f05640 -1 osd.3 0 log_to_monitors true 2024-01-19T04:14:44.077 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-01-19T04:14:44.076+0000 7f8266cea640 -1 osd.6 0 log_to_monitors true 2024-01-19T04:14:44.081 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-01-19T04:14:44.080+0000 7f443a977640 -1 osd.4 0 log_to_monitors true 2024-01-19T04:14:44.095 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-01-19T04:14:44.092+0000 7f1ebdda7640 -1 osd.0 0 log_to_monitors true 2024-01-19T04:14:44.127 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-01-19T04:14:44.124+0000 7fe6ceb96640 -1 osd.5 0 log_to_monitors true 2024-01-19T04:14:44.259 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-01-19T04:14:44.256+0000 7f7646872640 -1 osd.7 0 log_to_monitors true 2024-01-19T04:14:44.266 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-01-19T04:14:44.264+0000 7f51c65b0640 -1 osd.2 0 log_to_monitors true 2024-01-19T04:14:44.312 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-01-19T04:14:44.308+0000 7f177048c640 -1 osd.1 0 log_to_monitors true 2024-01-19T04:14:46.143 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-01-19T04:14:46.140+0000 7f7e5f400640 -1 osd.3 0 waiting for initial osdmap 2024-01-19T04:14:46.186 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-01-19T04:14:46.184+0000 7f7e55e00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:47.437 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-01-19T04:14:47.436+0000 7f51c0a00640 -1 osd.2 0 waiting for initial osdmap 2024-01-19T04:14:47.450 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-01-19T04:14:47.448+0000 7f176aa00640 -1 osd.1 0 waiting for initial osdmap 2024-01-19T04:14:47.463 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-01-19T04:14:47.460+0000 7f51b7400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:47.468 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-01-19T04:14:47.464+0000 7f1eb8200640 -1 osd.0 0 waiting for initial osdmap 2024-01-19T04:14:47.478 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-01-19T04:14:47.476+0000 7f1761400640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:47.498 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-01-19T04:14:47.496+0000 7f1eaec00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:47.635 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T04:14:47.766 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9caa00640 1 Processor -- start 2024-01-19T04:14:47.766 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9caa00640 1 -- start start 2024-01-19T04:14:47.767 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9caa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9c414fba0 0x7fb9c406e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:47.767 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9caa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c4073620 0x7fb9c4152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:47.767 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9caa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c406bec0 con 0x7fb9c41529a0 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9caa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40c5f60 con 0x7fb9c414fba0 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9caa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c406bc20 con 0x7fb9c4073620 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9c414fba0 0x7fb9c406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9c414fba0 0x7fb9c406e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44538/0 (socket says 172.21.15.32:44538) 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3e00640 1 -- 172.21.15.32:0/2288123735 learned_addr learned my addr 172.21.15.32:0/2288123735 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c8a00640 1 --1- 172.21.15.32:0/2288123735 >> v1:172.21.15.32:6789/0 conn(0x7fb9c41529a0 0x7fb9c40c21a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55332/0 (socket says 172.21.15.32:55332) 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3400640 1 --2- 172.21.15.32:0/2288123735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c4073620 0x7fb9c4152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:47.768 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3e00640 1 -- 172.21.15.32:0/2288123735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c4073620 msgr2=0x7fb9c4152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:47.769 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3e00640 1 --2- 172.21.15.32:0/2288123735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c4073620 0x7fb9c4152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.769 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3e00640 1 -- 172.21.15.32:0/2288123735 >> v1:172.21.15.32:6789/0 conn(0x7fb9c41529a0 legacy=0x7fb9c40c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:47.769 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3e00640 1 -- 172.21.15.32:0/2288123735 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c406dd20 con 0x7fb9c414fba0 2024-01-19T04:14:47.769 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c2a00640 1 -- 172.21.15.32:0/2288123735 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968354187 0 0) 0x7fb9c406bec0 con 0x7fb9c41529a0 2024-01-19T04:14:47.769 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.764+0000 7fb9c3400640 1 --2- 172.21.15.32:0/2288123735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c4073620 0x7fb9c4152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:47.771 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9c3e00640 1 --2- 172.21.15.32:0/2288123735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c414fba0 0x7fb9c406e520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40098a0 tx=0x7fb9b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ed22c0c555da71 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:47.771 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9c2a00640 1 -- 172.21.15.32:0/2288123735 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ac600 con 0x7fb9c414fba0 2024-01-19T04:14:47.771 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9c2a00640 1 -- 172.21.15.32:0/2288123735 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40a8050 con 0x7fb9c414fba0 2024-01-19T04:14:47.771 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9c2a00640 1 -- 172.21.15.32:0/2288123735 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ac980 con 0x7fb9c414fba0 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 -- 172.21.15.32:0/2288123735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c414fba0 msgr2=0x7fb9c406e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 --2- 172.21.15.32:0/2288123735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c414fba0 0x7fb9c406e520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40098a0 tx=0x7fb9b401c490 comp rx=0 tx=0).stop 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 -- 172.21.15.32:0/2288123735 shutdown_connections 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 --2- 172.21.15.32:0/2288123735 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c4073620 0x7fb9c4152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 --2- 172.21.15.32:0/2288123735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c414fba0 0x7fb9c406e520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 -- 172.21.15.32:0/2288123735 >> 172.21.15.32:0/2288123735 conn(0x7fb9c406a650 msgr2=0x7fb9c406aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 -- 172.21.15.32:0/2288123735 shutdown_connections 2024-01-19T04:14:47.772 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.768+0000 7fb9caa00640 1 -- 172.21.15.32:0/2288123735 wait complete. 2024-01-19T04:14:47.773 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 Processor -- start 2024-01-19T04:14:47.775 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 -- start start 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c4073620 0x7fb9c4149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c414fba0 0x7fb9c4146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c41529a0 0x7fb9c4146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c414b870 con 0x7fb9c4073620 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4155f80 con 0x7fb9c41529a0 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4072070 con 0x7fb9c414fba0 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c4073620 0x7fb9c4149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c4073620 0x7fb9c4149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:44544/0 (socket says 172.21.15.32:44544) 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 -- 172.21.15.32:0/919774368 learned_addr learned my addr 172.21.15.32:0/919774368 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3400640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c414fba0 0x7fb9c4146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c8a00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c41529a0 0x7fb9c4146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 -- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c414fba0 msgr2=0x7fb9c4146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:47.777 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c414fba0 0x7fb9c4146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 -- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c41529a0 msgr2=0x7fb9c4146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c41529a0 0x7fb9c4146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 -- 172.21.15.32:0/919774368 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40094d0 con 0x7fb9c4073620 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c8a00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c41529a0 0x7fb9c4146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9c3e00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c4073620 0x7fb9c4149630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9b401ab40 tx=0x7fb9b401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9bbe00640 1 -- 172.21.15.32:0/919774368 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b7620 con 0x7fb9c4073620 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9bbe00640 1 -- 172.21.15.32:0/919774368 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40ace90 con 0x7fb9c4073620 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c414b2b0 con 0x7fb9c4073620 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9bbe00640 1 -- 172.21.15.32:0/919774368 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b79e0 con 0x7fb9c4073620 2024-01-19T04:14:47.778 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c4155c10 con 0x7fb9c4073620 2024-01-19T04:14:47.779 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.772+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c4155a70 con 0x7fb9c4073620 2024-01-19T04:14:47.779 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.776+0000 7fb9bbe00640 1 -- 172.21.15.32:0/919774368 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7fb9b40b3040 con 0x7fb9c4073620 2024-01-19T04:14:47.779 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.776+0000 7fb9bbe00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb99c066470 0x7fb99c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:47.779 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.776+0000 7fb9bbe00640 1 -- 172.21.15.32:0/919774368 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7fb9b411d4b0 con 0x7fb9c4073620 2024-01-19T04:14:47.779 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.776+0000 7fb9c3400640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb99c066470 0x7fb99c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:47.780 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.776+0000 7fb9c3400640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb99c066470 0x7fb99c068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4066720 tx=0x7fb9ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:47.784 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.780+0000 7fb9bbe00640 1 -- 172.21.15.32:0/919774368 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb9c4155a70 con 0x7fb9c4073620 2024-01-19T04:14:47.945 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.940+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9c4155a70 con 0x7fb9c4073620 2024-01-19T04:14:47.945 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9bbe00640 1 -- 172.21.15.32:0/919774368 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7555 (secure 0 0 0) 0x7fb9c4155a70 con 0x7fb9c4073620 2024-01-19T04:14:47.946 INFO:teuthology.misc.health.smithi032.stdout: 2024-01-19T04:14:47.946 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":14,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:14:47.050116+0000","last_up_change":"2024-01-19T04:14:47.050116+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:14:47.947 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb99c066470 msgr2=0x7fb99c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb99c066470 0x7fb99c068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4066720 tx=0x7fb9ac008040 comp rx=0 tx=0).stop 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c4073620 msgr2=0x7fb9c4149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c4073620 0x7fb9c4149630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9b401ab40 tx=0x7fb9b401acd0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 shutdown_connections 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb99c066470 0x7fb99c068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c41529a0 0x7fb9c4146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9c414fba0 0x7fb9c4146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 --2- 172.21.15.32:0/919774368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9c4073620 0x7fb9c4149630 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 >> 172.21.15.32:0/919774368 conn(0x7fb9c406a650 msgr2=0x7fb9c4151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 shutdown_connections 2024-01-19T04:14:47.948 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:47.944+0000 7fb9caa00640 1 -- 172.21.15.32:0/919774368 wait complete. 2024-01-19T04:14:47.965 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-01-19T04:14:48.364 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-01-19T04:14:48.360+0000 7f7640e00640 -1 osd.7 0 waiting for initial osdmap 2024-01-19T04:14:48.371 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-01-19T04:14:48.368+0000 7f8261200640 -1 osd.6 0 waiting for initial osdmap 2024-01-19T04:14:48.392 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-01-19T04:14:48.392+0000 7fe6c9000640 -1 osd.5 0 waiting for initial osdmap 2024-01-19T04:14:48.411 INFO:tasks.ceph.osd.6.smithi067.stderr:2024-01-19T04:14:48.400+0000 7f8257c00640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:48.411 INFO:tasks.ceph.osd.7.smithi067.stderr:2024-01-19T04:14:48.400+0000 7f7637800640 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:48.411 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-01-19T04:14:48.404+0000 7f4434e00640 -1 osd.4 0 waiting for initial osdmap 2024-01-19T04:14:48.417 INFO:tasks.ceph.osd.5.smithi067.stderr:2024-01-19T04:14:48.416+0000 7fe6bfa00640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:48.453 INFO:tasks.ceph.osd.4.smithi067.stderr:2024-01-19T04:14:48.452+0000 7f442b800640 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T04:14:52.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:14:52.158 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:14:54.770 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T04:14:54.913 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.908+0000 7f1625800640 1 Processor -- start 2024-01-19T04:14:54.913 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.908+0000 7f1625800640 1 -- start start 2024-01-19T04:14:54.914 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f1625800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f162014eed0 0x7f16200c0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:54.914 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f1625800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1620071150 con 0x7f16200c5760 2024-01-19T04:14:54.914 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f1625800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1620072b30 con 0x7f16200a4f40 2024-01-19T04:14:54.915 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f1625800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1620071380 con 0x7f162014eed0 2024-01-19T04:14:54.915 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f162014eed0 0x7f16200c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:54.915 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f162014eed0 0x7f16200c0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40796/0 (socket says 172.21.15.32:40796) 2024-01-19T04:14:54.915 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161f400640 1 -- 172.21.15.32:0/1380615001 learned_addr learned my addr 172.21.15.32:0/1380615001 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:54.915 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161e000640 1 --1- 172.21.15.32:0/1380615001 >> v1:172.21.15.32:6789/0 conn(0x7f16200c5760 0x7f162014e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49884/0 (socket says 172.21.15.32:49884) 2024-01-19T04:14:54.915 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161f400640 1 -- 172.21.15.32:0/1380615001 >> v1:172.21.15.67:6789/0 conn(0x7f16200a4f40 legacy=0x7f1620072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:54.915 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161f400640 1 -- 172.21.15.32:0/1380615001 >> v1:172.21.15.32:6789/0 conn(0x7f16200c5760 legacy=0x7f162014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:54.916 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161d600640 1 -- 172.21.15.32:0/1380615001 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884355810 0 0) 0x7f1620072b30 con 0x7f16200a4f40 2024-01-19T04:14:54.916 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.912+0000 7f161f400640 1 -- 172.21.15.32:0/1380615001 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620071660 con 0x7f162014eed0 2024-01-19T04:14:54.918 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f161f400640 1 --2- 172.21.15.32:0/1380615001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f162014eed0 0x7f16200c0680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f161800d150 tx=0x7f161801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e650e30df7a842d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:54.918 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f161d600640 1 -- 172.21.15.32:0/1380615001 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161800b2d0 con 0x7f162014eed0 2024-01-19T04:14:54.918 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f161d600640 1 -- 172.21.15.32:0/1380615001 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800b430 con 0x7f162014eed0 2024-01-19T04:14:54.918 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f161d600640 1 -- 172.21.15.32:0/1380615001 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180a7bc0 con 0x7f162014eed0 2024-01-19T04:14:54.919 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 -- 172.21.15.32:0/1380615001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f162014eed0 msgr2=0x7f16200c0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:54.919 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 --2- 172.21.15.32:0/1380615001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f162014eed0 0x7f16200c0680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f161800d150 tx=0x7f161801eb30 comp rx=0 tx=0).stop 2024-01-19T04:14:54.919 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 -- 172.21.15.32:0/1380615001 shutdown_connections 2024-01-19T04:14:54.919 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 --2- 172.21.15.32:0/1380615001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f162014eed0 0x7f16200c0680 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:54.919 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 -- 172.21.15.32:0/1380615001 >> 172.21.15.32:0/1380615001 conn(0x7f16200a7a30 msgr2=0x7f16200a7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:54.919 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 -- 172.21.15.32:0/1380615001 shutdown_connections 2024-01-19T04:14:54.919 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 -- 172.21.15.32:0/1380615001 wait complete. 2024-01-19T04:14:54.921 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 Processor -- start 2024-01-19T04:14:54.921 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.916+0000 7f1625800640 1 -- start start 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16200a4f40 0x7f16200a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16200c5760 0x7f16201e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f162014eed0 0x7f16201ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16201edfb0 con 0x7f16200c5760 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200a8ed0 con 0x7f16200a4f40 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200a91b0 con 0x7f162014eed0 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16200c5760 0x7f16201e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:54.922 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16200c5760 0x7f16201e9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40804/0 (socket says 172.21.15.32:40804) 2024-01-19T04:14:54.923 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 -- 172.21.15.32:0/266866052 learned_addr learned my addr 172.21.15.32:0/266866052 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:54.923 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161f400640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f162014eed0 0x7f16201ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:54.923 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161ea00640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16200a4f40 0x7f16200a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 -- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f162014eed0 msgr2=0x7f16201ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f162014eed0 0x7f16201ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 -- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16200a4f40 msgr2=0x7f16200a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16200a4f40 0x7f16200a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 -- 172.21.15.32:0/266866052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161800bd40 con 0x7f16200c5760 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161f400640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f162014eed0 0x7f16201ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f161e000640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16200c5760 0x7f16201e9ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1608009ec0 tx=0x7f160800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:54.924 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1616a00640 1 -- 172.21.15.32:0/266866052 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608007a30 con 0x7f16200c5760 2024-01-19T04:14:54.925 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1616a00640 1 -- 172.21.15.32:0/266866052 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608007b90 con 0x7f16200c5760 2024-01-19T04:14:54.925 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1616a00640 1 -- 172.21.15.32:0/266866052 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800ce70 con 0x7f16200c5760 2024-01-19T04:14:54.925 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162014f460 con 0x7f16200c5760 2024-01-19T04:14:54.925 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16200a7280 con 0x7f16200c5760 2024-01-19T04:14:54.925 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.920+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620067c00 con 0x7f16200c5760 2024-01-19T04:14:54.925 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.924+0000 7f1616a00640 1 -- 172.21.15.32:0/266866052 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1608009070 con 0x7f16200c5760 2024-01-19T04:14:54.926 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.924+0000 7f1616a00640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15f8066500 0x7f15f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:54.926 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.924+0000 7f1616a00640 1 -- 172.21.15.32:0/266866052 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1608085a60 con 0x7f16200c5760 2024-01-19T04:14:54.927 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.924+0000 7f161ea00640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15f8066500 0x7f15f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:54.927 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.924+0000 7f161ea00640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15f8066500 0x7f15f80689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16201eabf0 tx=0x7f1610009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:54.931 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:54.928+0000 7f1616a00640 1 -- 172.21.15.32:0/266866052 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f16080530f0 con 0x7f16200c5760 2024-01-19T04:14:55.092 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.088+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f162014f650 con 0x7f16200c5760 2024-01-19T04:14:55.093 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.088+0000 7f1616a00640 1 -- 172.21.15.32:0/266866052 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12755 (secure 0 0 0) 0x7f1608019020 con 0x7f16200c5760 2024-01-19T04:14:55.093 INFO:teuthology.misc.health.smithi032.stdout: 2024-01-19T04:14:55.094 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":19,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:14:52.412106+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:14:55.095 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15f8066500 msgr2=0x7f15f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.095 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15f8066500 0x7f15f80689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16201eabf0 tx=0x7f1610009040 comp rx=0 tx=0).stop 2024-01-19T04:14:55.095 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16200c5760 msgr2=0x7f16201e9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.095 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16200c5760 0x7f16201e9ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1608009ec0 tx=0x7f160800c430 comp rx=0 tx=0).stop 2024-01-19T04:14:55.095 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 shutdown_connections 2024-01-19T04:14:55.096 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15f8066500 0x7f15f80689c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.096 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f162014eed0 0x7f16201ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.096 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16200c5760 0x7f16201e9ac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.096 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 --2- 172.21.15.32:0/266866052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16200a4f40 0x7f16200a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.096 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 >> 172.21.15.32:0/266866052 conn(0x7f16200a7a30 msgr2=0x7f16200a7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:55.096 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 shutdown_connections 2024-01-19T04:14:55.096 INFO:teuthology.misc.health.smithi032.stderr:2024-01-19T04:14:55.092+0000 7f1625800640 1 -- 172.21.15.32:0/266866052 wait complete. 2024-01-19T04:14:55.113 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-19T04:14:55.113 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-19T04:14:55.114 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-19T04:14:55.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-19T04:14:55.118 INFO:tasks.ceph.mds.a:Started 2024-01-19T04:14:55.118 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-19T04:14:55.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-19T04:14:55.121 INFO:tasks.ceph.mds.c:Started 2024-01-19T04:14:55.121 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-19T04:14:55.121 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-19T04:14:55.125 INFO:tasks.ceph.mds.b:Started 2024-01-19T04:14:55.125 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-19T04:14:55.125 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-19T04:14:55.128 INFO:tasks.ceph.mds.d:Started 2024-01-19T04:14:55.129 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-19T04:14:55.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:14:55.213 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-01-19T04:14:55.214 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-01-19T04:14:55.227 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2024-01-19T04:14:55.228 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2024-01-19T04:14:55.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7b06200640 1 Processor -- start 2024-01-19T04:14:55.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7b06200640 1 -- start start 2024-01-19T04:14:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7b06200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b000a6d30 0x7f7b000c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7b06200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b001533a0 con 0x7f7b000c6e20 2024-01-19T04:14:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7b06200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b00152800 con 0x7f7b0006fda0 2024-01-19T04:14:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7b06200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b00156380 con 0x7f7b000a6d30 2024-01-19T04:14:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7afea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b000a6d30 0x7f7b000c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7aff400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7b000c6e20 0x7f7b00152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49896/0 (socket says 172.21.15.32:49896) 2024-01-19T04:14:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.272+0000 7f7aff400640 1 -- 172.21.15.32:0/3991881273 learned_addr learned my addr 172.21.15.32:0/3991881273 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:14:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7afea00640 1 -- 172.21.15.32:0/3991881273 >> v1:172.21.15.67:6789/0 conn(0x7f7b0006fda0 legacy=0x7f7b0015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7afea00640 1 -- 172.21.15.32:0/3991881273 >> v1:172.21.15.32:6789/0 conn(0x7f7b000c6e20 legacy=0x7f7b00152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7afea00640 1 -- 172.21.15.32:0/3991881273 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00156590 con 0x7f7b000a6d30 2024-01-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7afea00640 1 --2- 172.21.15.32:0/3991881273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000a6d30 0x7f7b000c7200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ae80097c0 tx=0x7f7ae801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4240db185708fc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7afe000640 1 -- 172.21.15.32:0/3991881273 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80ab600 con 0x7f7b000a6d30 2024-01-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7afe000640 1 -- 172.21.15.32:0/3991881273 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae80a7050 con 0x7f7b000a6d30 2024-01-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7afe000640 1 -- 172.21.15.32:0/3991881273 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80ab980 con 0x7f7b000a6d30 2024-01-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7b06200640 1 -- 172.21.15.32:0/3991881273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000a6d30 msgr2=0x7f7b000c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.276+0000 7f7b06200640 1 --2- 172.21.15.32:0/3991881273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000a6d30 0x7f7b000c7200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ae80097c0 tx=0x7f7ae801c3b0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- 172.21.15.32:0/3991881273 shutdown_connections 2024-01-19T04:14:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 --2- 172.21.15.32:0/3991881273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000a6d30 0x7f7b000c7200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- 172.21.15.32:0/3991881273 >> 172.21.15.32:0/3991881273 conn(0x7f7b000a9870 msgr2=0x7f7b000a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- 172.21.15.32:0/3991881273 shutdown_connections 2024-01-19T04:14:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- 172.21.15.32:0/3991881273 wait complete. 2024-01-19T04:14:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 Processor -- start 2024-01-19T04:14:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- start start 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b0006fda0 0x7f7b000abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b000a6d30 0x7f7b0014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000c6e20 0x7f7b000aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b001ef060 con 0x7f7b000c6e20 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000ac830 con 0x7f7b000a6d30 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7b06200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b001ee3e0 con 0x7f7b0006fda0 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000c6e20 0x7f7b000aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000c6e20 0x7f7b000aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40840/0 (socket says 172.21.15.32:40840) 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 -- 172.21.15.32:0/247829420 learned_addr learned my addr 172.21.15.32:0/247829420 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7afea00640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b000a6d30 0x7f7b0014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7aff400640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b0006fda0 0x7f7b000abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 -- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b0006fda0 msgr2=0x7f7b000abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b0006fda0 0x7f7b000abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 -- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b000a6d30 msgr2=0x7f7b0014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b000a6d30 0x7f7b0014e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 -- 172.21.15.32:0/247829420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae8009420 con 0x7f7b000c6e20 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7aff400640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b0006fda0 0x7f7b000abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.280+0000 7f7affe00640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000c6e20 0x7f7b000aa880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c780 tx=0x7f7af800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7af7400640 1 -- 172.21.15.32:0/247829420 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8004b70 con 0x7f7b000c6e20 2024-01-19T04:14:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7af7400640 1 -- 172.21.15.32:0/247829420 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af800ce90 con 0x7f7b000c6e20 2024-01-19T04:14:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7af7400640 1 -- 172.21.15.32:0/247829420 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af800a850 con 0x7f7b000c6e20 2024-01-19T04:14:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b001ee6c0 con 0x7f7b000c6e20 2024-01-19T04:14:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b001eec80 con 0x7f7b000c6e20 2024-01-19T04:14:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b001ef1a0 con 0x7f7b000c6e20 2024-01-19T04:14:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7af7400640 1 -- 172.21.15.32:0/247829420 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7af800a9b0 con 0x7f7b000c6e20 2024-01-19T04:14:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7af7400640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7ad8066500 0x7f7ad80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7af7400640 1 -- 172.21.15.32:0/247829420 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7af8083cd0 con 0x7f7b000c6e20 2024-01-19T04:14:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.284+0000 7f7aff400640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7ad8066500 0x7f7ad80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.288+0000 7f7aff400640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7ad8066500 0x7f7ad80689c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000f70 tx=0x7f7af0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.288+0000 7f7af7400640 1 -- 172.21.15.32:0/247829420 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7b001ef1a0 con 0x7f7b000c6e20 2024-01-19T04:14:55.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b001ef1a0 con 0x7f7b000c6e20 2024-01-19T04:14:55.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7af7400640 1 -- 172.21.15.32:0/247829420 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12755 (secure 0 0 0) 0x7f7b001ef1a0 con 0x7f7b000c6e20 2024-01-19T04:14:55.455 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:14:55.455 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":19,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:14:52.412106+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:14:55.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7ad8066500 msgr2=0x7f7ad80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7ad8066500 0x7f7ad80689c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000f70 tx=0x7f7af0009040 comp rx=0 tx=0).stop 2024-01-19T04:14:55.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000c6e20 msgr2=0x7f7b000aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000c6e20 0x7f7b000aa880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c780 tx=0x7f7af800cc40 comp rx=0 tx=0).stop 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 shutdown_connections 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7ad8066500 0x7f7ad80689c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b000c6e20 0x7f7b000aa880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b000a6d30 0x7f7b0014e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 --2- 172.21.15.32:0/247829420 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7b0006fda0 0x7f7b000abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.452+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 >> 172.21.15.32:0/247829420 conn(0x7f7b000a9870 msgr2=0x7f7b0006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.456+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 shutdown_connections 2024-01-19T04:14:55.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.456+0000 7f7b06200640 1 -- 172.21.15.32:0/247829420 wait complete. 2024-01-19T04:14:55.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:14:55.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:14:55.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.616+0000 7f81b6a00640 1 Processor -- start 2024-01-19T04:14:55.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.616+0000 7f81b6a00640 1 -- start start 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81b6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f81b00723b0 0x7f81b0152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81b6a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81b00c2080 0x7f81b0155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81b6a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b00a4ea0 con 0x7f81b006d440 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81b6a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b01524a0 con 0x7f81b00c2080 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81b6a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b0152a20 con 0x7f81b00723b0 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81af400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81b00c2080 0x7f81b0155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81af400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81b00c2080 0x7f81b0155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40856/0 (socket says 172.21.15.32:40856) 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81af400640 1 -- 172.21.15.32:0/3515996555 learned_addr learned my addr 172.21.15.32:0/3515996555 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:55.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81afe00640 1 --2- 172.21.15.32:0/3515996555 >> v2:172.21.15.67:3300/0 conn(0x7f81b00723b0 0x7f81b0152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81af400640 1 -- 172.21.15.32:0/3515996555 >> v2:172.21.15.67:3300/0 conn(0x7f81b00723b0 msgr2=0x7f81b0152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:55.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81af400640 1 --2- 172.21.15.32:0/3515996555 >> v2:172.21.15.67:3300/0 conn(0x7f81b00723b0 0x7f81b0152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81af400640 1 -- 172.21.15.32:0/3515996555 >> v1:172.21.15.67:6789/0 conn(0x7f81b006d440 legacy=0x7f81b00c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.620+0000 7f81af400640 1 -- 172.21.15.32:0/3515996555 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b01533f0 con 0x7f81b00c2080 2024-01-19T04:14:55.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81af400640 1 --2- 172.21.15.32:0/3515996555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00c2080 0x7f81b0155a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81b00a8790 tx=0x7f819801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edccc07303ae404d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81aea00640 1 -- 172.21.15.32:0/3515996555 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980ac640 con 0x7f81b00c2080 2024-01-19T04:14:55.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81aea00640 1 -- 172.21.15.32:0/3515996555 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81980ac7a0 con 0x7f81b00c2080 2024-01-19T04:14:55.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81aea00640 1 -- 172.21.15.32:0/3515996555 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980acb30 con 0x7f81b00c2080 2024-01-19T04:14:55.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 -- 172.21.15.32:0/3515996555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00c2080 msgr2=0x7f81b0155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 --2- 172.21.15.32:0/3515996555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00c2080 0x7f81b0155a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81b00a8790 tx=0x7f819801c3e0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 -- 172.21.15.32:0/3515996555 shutdown_connections 2024-01-19T04:14:55.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 --2- 172.21.15.32:0/3515996555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00c2080 0x7f81b0155a90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 --2- 172.21.15.32:0/3515996555 >> v2:172.21.15.67:3300/0 conn(0x7f81b00723b0 0x7f81b0152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 -- 172.21.15.32:0/3515996555 >> 172.21.15.32:0/3515996555 conn(0x7f81b00c25a0 msgr2=0x7f81b00c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:55.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 -- 172.21.15.32:0/3515996555 shutdown_connections 2024-01-19T04:14:55.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 -- 172.21.15.32:0/3515996555 wait complete. 2024-01-19T04:14:55.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 Processor -- start 2024-01-19T04:14:55.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.624+0000 7f81b6a00640 1 -- start start 2024-01-19T04:14:55.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81b006d440 0x7f81b01ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00723b0 0x7f81b0150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00c2080 0x7f81b0155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b014d790 con 0x7f81b00723b0 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00a9bc0 con 0x7f81b00c2080 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b01548e0 con 0x7f81b006d440 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00723b0 0x7f81b0150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00723b0 0x7f81b0150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40860/0 (socket says 172.21.15.32:40860) 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 -- 172.21.15.32:0/205978470 learned_addr learned my addr 172.21.15.32:0/205978470 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81afe00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81b006d440 0x7f81b01ecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b4a00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00c2080 0x7f81b0155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 -- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81b006d440 msgr2=0x7f81b01ecab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81b006d440 0x7f81b01ecab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 -- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00c2080 msgr2=0x7f81b0155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00c2080 0x7f81b0155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 -- 172.21.15.32:0/205978470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980094d0 con 0x7f81b00723b0 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81af400640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00723b0 0x7f81b0150570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f819801a010 tx=0x7f819801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81a7e00640 1 -- 172.21.15.32:0/205978470 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980b7650 con 0x7f81b00723b0 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81a7e00640 1 -- 172.21.15.32:0/205978470 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81980b77d0 con 0x7f81b00723b0 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81a7e00640 1 -- 172.21.15.32:0/205978470 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980b7b80 con 0x7f81b00723b0 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b01ecff0 con 0x7f81b00723b0 2024-01-19T04:14:55.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b01ed570 con 0x7f81b00723b0 2024-01-19T04:14:55.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.628+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0152670 con 0x7f81b00723b0 2024-01-19T04:14:55.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.632+0000 7f81a7e00640 1 -- 172.21.15.32:0/205978470 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f81980b3070 con 0x7f81b00723b0 2024-01-19T04:14:55.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.632+0000 7f81a7e00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8188066500 0x7f81880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.632+0000 7f81a7e00640 1 -- 172.21.15.32:0/205978470 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f819811e0f0 con 0x7f81b00723b0 2024-01-19T04:14:55.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.632+0000 7f81afe00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8188066500 0x7f81880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.632+0000 7f81afe00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8188066500 0x7f81880689c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009b60 tx=0x7f81a0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.636+0000 7f81a7e00640 1 -- 172.21.15.32:0/205978470 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f81980eb820 con 0x7f81b00723b0 2024-01-19T04:14:55.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.792+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81b00749f0 con 0x7f81b00723b0 2024-01-19T04:14:55.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.792+0000 7f81a7e00640 1 -- 172.21.15.32:0/205978470 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81980eee40 con 0x7f81b00723b0 2024-01-19T04:14:55.796 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:14:55.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8188066500 msgr2=0x7f81880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8188066500 0x7f81880689c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009b60 tx=0x7f81a0009190 comp rx=0 tx=0).stop 2024-01-19T04:14:55.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00723b0 msgr2=0x7f81b0150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00723b0 0x7f81b0150570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f819801a010 tx=0x7f819801ac20 comp rx=0 tx=0).stop 2024-01-19T04:14:55.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 shutdown_connections 2024-01-19T04:14:55.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8188066500 0x7f81880689c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81b00c2080 0x7f81b0155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81b00723b0 0x7f81b0150570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 --2- 172.21.15.32:0/205978470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f81b006d440 0x7f81b01ecab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 >> 172.21.15.32:0/205978470 conn(0x7f81b00c25a0 msgr2=0x7f81b00a5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:55.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 shutdown_connections 2024-01-19T04:14:55.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.796+0000 7f81b6a00640 1 -- 172.21.15.32:0/205978470 wait complete. 2024-01-19T04:14:55.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:14:55.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7951e00640 1 Processor -- start 2024-01-19T04:14:55.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7951e00640 1 -- start start 2024-01-19T04:14:55.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7951e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c14ac10 0x7f794c0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7951e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f794c071820 0x7f794c071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7951e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c1514a0 con 0x7f794c06a980 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7951e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c1519d0 con 0x7f794c071820 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7951e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0a85e0 con 0x7f794c14ac10 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f794c071820 0x7f794c071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794aa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c14ac10 0x7f794c0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7943e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f794c06a980 0x7f794c06ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49912/0 (socket says 172.21.15.32:49912) 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f7943e00640 1 -- 172.21.15.32:0/2003425921 learned_addr learned my addr 172.21.15.32:0/2003425921 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:14:55.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794be00640 1 --2- 172.21.15.32:0/2003425921 >> v2:172.21.15.32:3300/0 conn(0x7f794c071820 0x7f794c071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40872/0 (socket says 172.21.15.32:40872) 2024-01-19T04:14:55.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794be00640 1 -- 172.21.15.32:0/2003425921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c14ac10 msgr2=0x7f794c0c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:55.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794be00640 1 --2- 172.21.15.32:0/2003425921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c14ac10 0x7f794c0c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794be00640 1 -- 172.21.15.32:0/2003425921 >> v1:172.21.15.32:6789/0 conn(0x7f794c06a980 legacy=0x7f794c06ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794a000640 1 -- 172.21.15.32:0/2003425921 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14462165 0 0) 0x7f794c1514a0 con 0x7f794c06a980 2024-01-19T04:14:55.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.956+0000 7f794be00640 1 -- 172.21.15.32:0/2003425921 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c1516f0 con 0x7f794c071820 2024-01-19T04:14:55.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f794be00640 1 --2- 172.21.15.32:0/2003425921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c071820 0x7f794c071c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f794400bfa0 tx=0x7f794401ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c88e783ae45fce server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f794a000640 1 -- 172.21.15.32:0/2003425921 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400b2d0 con 0x7f794c071820 2024-01-19T04:14:55.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f794a000640 1 -- 172.21.15.32:0/2003425921 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79440a7820 con 0x7f794c071820 2024-01-19T04:14:55.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f794a000640 1 -- 172.21.15.32:0/2003425921 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440a7bb0 con 0x7f794c071820 2024-01-19T04:14:55.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f7951e00640 1 -- 172.21.15.32:0/2003425921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c071820 msgr2=0x7f794c071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f7951e00640 1 --2- 172.21.15.32:0/2003425921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c071820 0x7f794c071c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f794400bfa0 tx=0x7f794401ea30 comp rx=0 tx=0).stop 2024-01-19T04:14:55.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f7951e00640 1 -- 172.21.15.32:0/2003425921 shutdown_connections 2024-01-19T04:14:55.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f7951e00640 1 --2- 172.21.15.32:0/2003425921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c071820 0x7f794c071c90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f7951e00640 1 --2- 172.21.15.32:0/2003425921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c14ac10 0x7f794c0c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.960+0000 7f7951e00640 1 -- 172.21.15.32:0/2003425921 >> 172.21.15.32:0/2003425921 conn(0x7f794c06d6c0 msgr2=0x7f794c06dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:55.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 -- 172.21.15.32:0/2003425921 shutdown_connections 2024-01-19T04:14:55.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 -- 172.21.15.32:0/2003425921 wait complete. 2024-01-19T04:14:55.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 Processor -- start 2024-01-19T04:14:55.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 -- start start 2024-01-19T04:14:55.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c06a980 0x7f794c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c071820 0x7f794c143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c14ac10 0x7f794c1442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c1ed850 con 0x7f794c06a980 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0c1ea0 con 0x7f794c14ac10 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7951e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c154ef0 con 0x7f794c071820 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c06a980 0x7f794c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c06a980 0x7f794c150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40876/0 (socket says 172.21.15.32:40876) 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 -- 172.21.15.32:0/2570551581 learned_addr learned my addr 172.21.15.32:0/2570551581 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7943e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c071820 0x7f794c143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794be00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c14ac10 0x7f794c1442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 -- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c071820 msgr2=0x7f794c143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c071820 0x7f794c143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 -- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c14ac10 msgr2=0x7f794c1442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:55.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c14ac10 0x7f794c1442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:55.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 -- 172.21.15.32:0/2570551581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794400bc80 con 0x7f794c06a980 2024-01-19T04:14:55.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f794aa00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c06a980 0x7f794c150750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e870 tx=0x7f793c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7943400640 1 -- 172.21.15.32:0/2570551581 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c009510 con 0x7f794c06a980 2024-01-19T04:14:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.964+0000 7f7943400640 1 -- 172.21.15.32:0/2570551581 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c00eec0 con 0x7f794c06a980 2024-01-19T04:14:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c1ed2d0 con 0x7f794c06a980 2024-01-19T04:14:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7943400640 1 -- 172.21.15.32:0/2570551581 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c00cb40 con 0x7f794c06a980 2024-01-19T04:14:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c0c3a80 con 0x7f794c06a980 2024-01-19T04:14:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0726c0 con 0x7f794c06a980 2024-01-19T04:14:55.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7943400640 1 -- 172.21.15.32:0/2570551581 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f793c00ccc0 con 0x7f794c06a980 2024-01-19T04:14:55.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7943400640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7924066500 0x7f79240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:55.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7943400640 1 -- 172.21.15.32:0/2570551581 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f793c083f10 con 0x7f794c06a980 2024-01-19T04:14:55.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7943e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7924066500 0x7f79240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:55.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.968+0000 7f7943e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7924066500 0x7f79240689c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f794c155110 tx=0x7f7934007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:55.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:55.972+0000 7f7943400640 1 -- 172.21.15.32:0/2570551581 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f793c0515a0 con 0x7f794c06a980 2024-01-19T04:14:56.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.164+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f794c04e980 con 0x7f794c06a980 2024-01-19T04:14:56.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.164+0000 7f7943400640 1 -- 172.21.15.32:0/2570551581 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f793c021540 con 0x7f794c06a980 2024-01-19T04:14:56.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:14:56.169 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 2 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7924066500 msgr2=0x7f79240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7924066500 0x7f79240689c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f794c155110 tx=0x7f7934007d60 comp rx=0 tx=0).stop 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c06a980 msgr2=0x7f794c150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c06a980 0x7f794c150750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e870 tx=0x7f793c00ec70 comp rx=0 tx=0).stop 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 shutdown_connections 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7924066500 0x7f79240689c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f794c14ac10 0x7f794c1442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f794c071820 0x7f794c143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:56.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 --2- 172.21.15.32:0/2570551581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f794c06a980 0x7f794c150750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:56.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 >> 172.21.15.32:0/2570551581 conn(0x7f794c06d6c0 msgr2=0x7f794c06ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:56.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 shutdown_connections 2024-01-19T04:14:56.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:56.168+0000 7f7951e00640 1 -- 172.21.15.32:0/2570551581 wait complete. 2024-01-19T04:14:58.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:14:58.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46e1600640 1 Processor -- start 2024-01-19T04:14:58.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46e1600640 1 -- start start 2024-01-19T04:14:58.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46e1600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46dc0c42b0 0x7f46dc0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46e1600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc0c0c90 con 0x7f46dc0c1120 2024-01-19T04:14:58.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46e1600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc150cb0 con 0x7f46dc0c5740 2024-01-19T04:14:58.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46e1600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc150f90 con 0x7f46dc0c42b0 2024-01-19T04:14:58.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46daa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46dc0c42b0 0x7f46dc0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46db400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f46dc0c1120 0x7f46dc15b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35744/0 (socket says 172.21.15.32:35744) 2024-01-19T04:14:58.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46db400640 1 -- 172.21.15.32:0/2805423915 learned_addr learned my addr 172.21.15.32:0/2805423915 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:14:58.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46daa00640 1 -- 172.21.15.32:0/2805423915 >> v1:172.21.15.67:6789/0 conn(0x7f46dc0c5740 legacy=0x7f46dc06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46daa00640 1 -- 172.21.15.32:0/2805423915 >> v1:172.21.15.32:6789/0 conn(0x7f46dc0c1120 legacy=0x7f46dc15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.344+0000 7f46daa00640 1 -- 172.21.15.32:0/2805423915 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc0c0640 con 0x7f46dc0c42b0 2024-01-19T04:14:58.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.340+0000 7f46d9600640 1 -- 172.21.15.32:0/2805423915 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493066447 0 0) 0x7f46dc0c0c90 con 0x7f46dc0c1120 2024-01-19T04:14:58.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.344+0000 7f46daa00640 1 --2- 172.21.15.32:0/2805423915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c42b0 0x7f46dc0c4690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0097c0 tx=0x7f46cc01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17d2d5dbc68a85d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:58.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.344+0000 7f46d9600640 1 -- 172.21.15.32:0/2805423915 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0ac640 con 0x7f46dc0c42b0 2024-01-19T04:14:58.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.344+0000 7f46d9600640 1 -- 172.21.15.32:0/2805423915 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc0ac7a0 con 0x7f46dc0c42b0 2024-01-19T04:14:58.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.344+0000 7f46d9600640 1 -- 172.21.15.32:0/2805423915 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0acb30 con 0x7f46dc0c42b0 2024-01-19T04:14:58.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.344+0000 7f46e1600640 1 -- 172.21.15.32:0/2805423915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c42b0 msgr2=0x7f46dc0c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.344+0000 7f46e1600640 1 --2- 172.21.15.32:0/2805423915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c42b0 0x7f46dc0c4690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0097c0 tx=0x7f46cc01ce20 comp rx=0 tx=0).stop 2024-01-19T04:14:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- 172.21.15.32:0/2805423915 shutdown_connections 2024-01-19T04:14:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 --2- 172.21.15.32:0/2805423915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c42b0 0x7f46dc0c4690 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- 172.21.15.32:0/2805423915 >> 172.21.15.32:0/2805423915 conn(0x7f46dc0c5b20 msgr2=0x7f46dc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- 172.21.15.32:0/2805423915 shutdown_connections 2024-01-19T04:14:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- 172.21.15.32:0/2805423915 wait complete. 2024-01-19T04:14:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 Processor -- start 2024-01-19T04:14:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- start start 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c1120 0x7f46dc1eb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46dc0c42b0 0x7f46dc1ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46dc0c5740 0x7f46dc148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0aab70 con 0x7f46dc0c1120 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1edf30 con 0x7f46dc0c42b0 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46e1600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0aa520 con 0x7f46dc0c5740 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c1120 0x7f46dc1eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c1120 0x7f46dc1eb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40778/0 (socket says 172.21.15.32:40778) 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 -- 172.21.15.32:0/1928417242 learned_addr learned my addr 172.21.15.32:0/1928417242 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46da000640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46dc0c42b0 0x7f46dc1ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46db400640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46dc0c5740 0x7f46dc148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 -- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46dc0c5740 msgr2=0x7f46dc148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46dc0c5740 0x7f46dc148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 -- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46dc0c42b0 msgr2=0x7f46dc1ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46dc0c42b0 0x7f46dc1ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 -- 172.21.15.32:0/1928417242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc009420 con 0x7f46dc0c1120 2024-01-19T04:14:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.348+0000 7f46daa00640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c1120 0x7f46dc1eb140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46cc018fd0 tx=0x7f46cc01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46d2a00640 1 -- 172.21.15.32:0/1928417242 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0ac640 con 0x7f46dc0c1120 2024-01-19T04:14:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46d2a00640 1 -- 172.21.15.32:0/1928417242 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc0b8880 con 0x7f46dc0c1120 2024-01-19T04:14:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46d2a00640 1 -- 172.21.15.32:0/1928417242 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0b8c30 con 0x7f46dc0c1120 2024-01-19T04:14:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc0aa800 con 0x7f46dc0c1120 2024-01-19T04:14:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc0ab9a0 con 0x7f46dc0c1120 2024-01-19T04:14:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46dc0c4eb0 con 0x7f46dc0c1120 2024-01-19T04:14:58.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46d2a00640 1 -- 172.21.15.32:0/1928417242 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f46cc0b6400 con 0x7f46dc0c1120 2024-01-19T04:14:58.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46d2a00640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f46b4066500 0x7f46b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46d2a00640 1 -- 172.21.15.32:0/1928417242 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f46cc11e840 con 0x7f46dc0c1120 2024-01-19T04:14:58.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.352+0000 7f46da000640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f46b4066500 0x7f46b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.356+0000 7f46da000640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f46b4066500 0x7f46b40689c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0bf700 tx=0x7f46c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:58.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.356+0000 7f46d2a00640 1 -- 172.21.15.32:0/1928417242 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f46cc0ebe20 con 0x7f46dc0c1120 2024-01-19T04:14:58.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46dc0aa660 con 0x7f46dc0c1120 2024-01-19T04:14:58.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46d2a00640 1 -- 172.21.15.32:0/1928417242 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f46cc0b1e80 con 0x7f46dc0c1120 2024-01-19T04:14:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:14:58.555 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-19T04:14:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 3 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f46b4066500 msgr2=0x7f46b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f46b4066500 0x7f46b40689c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0bf700 tx=0x7f46c4009040 comp rx=0 tx=0).stop 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c1120 msgr2=0x7f46dc1eb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c1120 0x7f46dc1eb140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46cc018fd0 tx=0x7f46cc01ac00 comp rx=0 tx=0).stop 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 shutdown_connections 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f46b4066500 0x7f46b40689c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46dc0c5740 0x7f46dc148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46dc0c42b0 0x7f46dc1ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 --2- 172.21.15.32:0/1928417242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46dc0c1120 0x7f46dc1eb140 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 >> 172.21.15.32:0/1928417242 conn(0x7f46dc0c5b20 msgr2=0x7f46dc073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 shutdown_connections 2024-01-19T04:14:58.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.552+0000 7f46e1600640 1 -- 172.21.15.32:0/1928417242 wait complete. 2024-01-19T04:14:58.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:14:58.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7face2600640 1 Processor -- start 2024-01-19T04:14:58.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7face2600640 1 -- start start 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7face2600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7facdc14fb50 0x7facdc06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7face2600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7facdc0a4ec0 0x7facdc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7face2600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc071e80 con 0x7facdc0c04a0 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7face2600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc1535c0 con 0x7facdc14fb50 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7face2600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc0726c0 con 0x7facdc0a4ec0 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7facdb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7facdc14fb50 0x7facdc06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7facdb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7facdc14fb50 0x7facdc06fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40786/0 (socket says 172.21.15.32:40786) 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7facdb400640 1 -- 172.21.15.32:0/4093981276 learned_addr learned my addr 172.21.15.32:0/4093981276 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:58.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.716+0000 7facdbe00640 1 --2- 172.21.15.32:0/4093981276 >> v2:172.21.15.67:3300/0 conn(0x7facdc0a4ec0 0x7facdc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facdb400640 1 -- 172.21.15.32:0/4093981276 >> v2:172.21.15.67:3300/0 conn(0x7facdc0a4ec0 msgr2=0x7facdc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:58.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facdb400640 1 --2- 172.21.15.32:0/4093981276 >> v2:172.21.15.67:3300/0 conn(0x7facdc0a4ec0 0x7facdc15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facdb400640 1 -- 172.21.15.32:0/4093981276 >> v1:172.21.15.67:6789/0 conn(0x7facdc0c04a0 legacy=0x7facdc0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facdb400640 1 -- 172.21.15.32:0/4093981276 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc0c0a20 con 0x7facdc14fb50 2024-01-19T04:14:58.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facdb400640 1 --2- 172.21.15.32:0/4093981276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc06fec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7facdc072ef0 tx=0x7faccc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2909834fbb1d243 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:58.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facda000640 1 -- 172.21.15.32:0/4093981276 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0ab600 con 0x7facdc14fb50 2024-01-19T04:14:58.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facda000640 1 -- 172.21.15.32:0/4093981276 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0a7050 con 0x7facdc14fb50 2024-01-19T04:14:58.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7facda000640 1 -- 172.21.15.32:0/4093981276 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0ab980 con 0x7facdc14fb50 2024-01-19T04:14:58.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7face2600640 1 -- 172.21.15.32:0/4093981276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 msgr2=0x7facdc06fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.720+0000 7face2600640 1 --2- 172.21.15.32:0/4093981276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc06fec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7facdc072ef0 tx=0x7faccc01c470 comp rx=0 tx=0).stop 2024-01-19T04:14:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- 172.21.15.32:0/4093981276 shutdown_connections 2024-01-19T04:14:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 --2- 172.21.15.32:0/4093981276 >> v2:172.21.15.67:3300/0 conn(0x7facdc0a4ec0 0x7facdc15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 --2- 172.21.15.32:0/4093981276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc06fec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- 172.21.15.32:0/4093981276 >> 172.21.15.32:0/4093981276 conn(0x7facdc0c5b20 msgr2=0x7facdc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- 172.21.15.32:0/4093981276 shutdown_connections 2024-01-19T04:14:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- 172.21.15.32:0/4093981276 wait complete. 2024-01-19T04:14:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 Processor -- start 2024-01-19T04:14:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- start start 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facdc0a4ec0 0x7facdc0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facdc0c04a0 0x7facdc1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc06beb0 con 0x7facdc14fb50 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc14b8b0 con 0x7facdc0a4ec0 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7face2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0a7040 con 0x7facdc0c04a0 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40790/0 (socket says 172.21.15.32:40790) 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facdc0a4ec0 0x7facdc0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 -- 172.21.15.32:0/96957577 learned_addr learned my addr 172.21.15.32:0/96957577 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdaa00640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facdc0c04a0 0x7facdc1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 -- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facdc0c04a0 msgr2=0x7facdc1473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facdc0c04a0 0x7facdc1473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 -- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facdc0a4ec0 msgr2=0x7facdc0bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facdc0a4ec0 0x7facdc0bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.724+0000 7facdbe00640 1 -- 172.21.15.32:0/96957577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0094d0 con 0x7facdc14fb50 2024-01-19T04:14:58.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facdbe00640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc147910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facd4009d20 tx=0x7facd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:58.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facd3400640 1 -- 172.21.15.32:0/96957577 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4009b10 con 0x7facdc14fb50 2024-01-19T04:14:58.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facd3400640 1 -- 172.21.15.32:0/96957577 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd400f040 con 0x7facdc14fb50 2024-01-19T04:14:58.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facd3400640 1 -- 172.21.15.32:0/96957577 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40146c0 con 0x7facdc14fb50 2024-01-19T04:14:58.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7face2600640 1 -- 172.21.15.32:0/96957577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc06c3e0 con 0x7facdc14fb50 2024-01-19T04:14:58.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7face2600640 1 -- 172.21.15.32:0/96957577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc14add0 con 0x7facdc14fb50 2024-01-19T04:14:58.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7face2600640 1 -- 172.21.15.32:0/96957577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc072b30 con 0x7facdc14fb50 2024-01-19T04:14:58.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facd3400640 1 -- 172.21.15.32:0/96957577 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7facd4014820 con 0x7facdc14fb50 2024-01-19T04:14:58.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facd3400640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facb4066500 0x7facb40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:58.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facd3400640 1 -- 172.21.15.32:0/96957577 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facd40845f0 con 0x7facdc14fb50 2024-01-19T04:14:58.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.728+0000 7facdb400640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facb4066500 0x7facb40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:58.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.732+0000 7facdb400640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facb4066500 0x7facb40689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ad000 tx=0x7faccc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:58.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.732+0000 7facd3400640 1 -- 172.21.15.32:0/96957577 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7facdc072b30 con 0x7facdc14fb50 2024-01-19T04:14:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.896+0000 7face2600640 1 -- 172.21.15.32:0/96957577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facdc072b30 con 0x7facdc14fb50 2024-01-19T04:14:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.896+0000 7facd3400640 1 -- 172.21.15.32:0/96957577 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12755 (secure 0 0 0) 0x7facdc072b30 con 0x7facdc14fb50 2024-01-19T04:14:58.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:14:58.900 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":19,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:14:52.412106+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 -- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facb4066500 msgr2=0x7facb40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facb4066500 0x7facb40689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ad000 tx=0x7faccc0a6000 comp rx=0 tx=0).stop 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 -- 172.21.15.32:0/96957577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 msgr2=0x7facdc147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc147910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facd4009d20 tx=0x7facd400c490 comp rx=0 tx=0).stop 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 -- 172.21.15.32:0/96957577 shutdown_connections 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facb4066500 0x7facb40689c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facdc14fb50 0x7facdc147910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7facdc0c04a0 0x7facdc1473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 --2- 172.21.15.32:0/96957577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facdc0a4ec0 0x7facdc0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 -- 172.21.15.32:0/96957577 >> 172.21.15.32:0/96957577 conn(0x7facdc0c5b20 msgr2=0x7facdc14f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 -- 172.21.15.32:0/96957577 shutdown_connections 2024-01-19T04:14:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:58.900+0000 7face2600640 1 -- 172.21.15.32:0/96957577 wait complete. 2024-01-19T04:14:58.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:14:58.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:14:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.060+0000 7fce1c200640 1 Processor -- start 2024-01-19T04:14:59.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.060+0000 7fce1c200640 1 -- start start 2024-01-19T04:14:59.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce1c200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fce1406cab0 0x7fce1406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce1c200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce140c0eb0 con 0x7fce140705b0 2024-01-19T04:14:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce1c200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce140a5330 con 0x7fce140c55d0 2024-01-19T04:14:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce1c200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1406e5c0 con 0x7fce1406cab0 2024-01-19T04:14:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce19800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fce1406cab0 0x7fce1406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce1a200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fce140705b0 0x7fce1415b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35756/0 (socket says 172.21.15.32:35756) 2024-01-19T04:14:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce1a200640 1 -- 172.21.15.32:0/2202089496 learned_addr learned my addr 172.21.15.32:0/2202089496 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:14:59.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce19800640 1 -- 172.21.15.32:0/2202089496 >> v1:172.21.15.67:6789/0 conn(0x7fce140c55d0 legacy=0x7fce140c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:59.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce19800640 1 -- 172.21.15.32:0/2202089496 >> v1:172.21.15.32:6789/0 conn(0x7fce140705b0 legacy=0x7fce1415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce19800640 1 -- 172.21.15.32:0/2202089496 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce141516f0 con 0x7fce1406cab0 2024-01-19T04:14:59.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.064+0000 7fce13e00640 1 -- 172.21.15.32:0/2202089496 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255472450 0 0) 0x7fce140c0eb0 con 0x7fce140705b0 2024-01-19T04:14:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce19800640 1 --2- 172.21.15.32:0/2202089496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1406ce90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce040097c0 tx=0x7fce0401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dcd4d8dcc253e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce13e00640 1 -- 172.21.15.32:0/2202089496 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040ab610 con 0x7fce1406cab0 2024-01-19T04:14:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce13e00640 1 -- 172.21.15.32:0/2202089496 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce040ab770 con 0x7fce1406cab0 2024-01-19T04:14:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce13e00640 1 -- 172.21.15.32:0/2202089496 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040abb00 con 0x7fce1406cab0 2024-01-19T04:14:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 -- 172.21.15.32:0/2202089496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 msgr2=0x7fce1406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 --2- 172.21.15.32:0/2202089496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1406ce90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce040097c0 tx=0x7fce0401c410 comp rx=0 tx=0).stop 2024-01-19T04:14:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 -- 172.21.15.32:0/2202089496 shutdown_connections 2024-01-19T04:14:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 --2- 172.21.15.32:0/2202089496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1406ce90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 -- 172.21.15.32:0/2202089496 >> 172.21.15.32:0/2202089496 conn(0x7fce140c25a0 msgr2=0x7fce140c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 -- 172.21.15.32:0/2202089496 shutdown_connections 2024-01-19T04:14:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 -- 172.21.15.32:0/2202089496 wait complete. 2024-01-19T04:14:59.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 Processor -- start 2024-01-19T04:14:59.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.068+0000 7fce1c200640 1 -- start start 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce140705b0 0x7fce14151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce140c55d0 0x7fce1414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce141f0780 con 0x7fce1406cab0 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce141f0a60 con 0x7fce140c55d0 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce141f0d40 con 0x7fce140705b0 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1414a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40806/0 (socket says 172.21.15.32:40806) 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 -- 172.21.15.32:0/3422544345 learned_addr learned my addr 172.21.15.32:0/3422544345 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1a200640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce140c55d0 0x7fce1414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce18e00640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce140705b0 0x7fce14151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 -- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce140705b0 msgr2=0x7fce14151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce140705b0 0x7fce14151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 -- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce140c55d0 msgr2=0x7fce1414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce140c55d0 0x7fce1414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 -- 172.21.15.32:0/3422544345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009420 con 0x7fce1406cab0 2024-01-19T04:14:59.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce18e00640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce140705b0 0x7fce14151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:14:59.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce19800640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1414a470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce04019020 tx=0x7fce0401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce11600640 1 -- 172.21.15.32:0/3422544345 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040b5810 con 0x7fce1406cab0 2024-01-19T04:14:59.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce11600640 1 -- 172.21.15.32:0/3422544345 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce040b5990 con 0x7fce1406cab0 2024-01-19T04:14:59.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce141f1020 con 0x7fce1406cab0 2024-01-19T04:14:59.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce11600640 1 -- 172.21.15.32:0/3422544345 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040b5d40 con 0x7fce1406cab0 2024-01-19T04:14:59.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce141f1540 con 0x7fce1406cab0 2024-01-19T04:14:59.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.072+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce141f08c0 con 0x7fce1406cab0 2024-01-19T04:14:59.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.076+0000 7fce11600640 1 -- 172.21.15.32:0/3422544345 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fce040bf410 con 0x7fce1406cab0 2024-01-19T04:14:59.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.076+0000 7fce11600640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcdec066500 0x7fcdec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.076+0000 7fce11600640 1 -- 172.21.15.32:0/3422544345 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce0411eaf0 con 0x7fce1406cab0 2024-01-19T04:14:59.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.076+0000 7fce18e00640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcdec066500 0x7fcdec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.076+0000 7fce18e00640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcdec066500 0x7fcdec0689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a830 tx=0x7fcdfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.080+0000 7fce11600640 1 -- 172.21.15.32:0/3422544345 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fce141f08c0 con 0x7fce1406cab0 2024-01-19T04:14:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.236+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce141f08c0 con 0x7fce1406cab0 2024-01-19T04:14:59.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce11600640 1 -- 172.21.15.32:0/3422544345 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce141f08c0 con 0x7fce1406cab0 2024-01-19T04:14:59.242 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:14:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcdec066500 msgr2=0x7fcdec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcdec066500 0x7fcdec0689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a830 tx=0x7fcdfc008040 comp rx=0 tx=0).stop 2024-01-19T04:14:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 msgr2=0x7fce1414a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1414a470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce04019020 tx=0x7fce0401ac50 comp rx=0 tx=0).stop 2024-01-19T04:14:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 shutdown_connections 2024-01-19T04:14:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcdec066500 0x7fcdec0689c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce140c55d0 0x7fce1414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce140705b0 0x7fce14151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 --2- 172.21.15.32:0/3422544345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce1406cab0 0x7fce1414a470 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 >> 172.21.15.32:0/3422544345 conn(0x7fce140c25a0 msgr2=0x7fce14070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 shutdown_connections 2024-01-19T04:14:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.240+0000 7fce1c200640 1 -- 172.21.15.32:0/3422544345 wait complete. 2024-01-19T04:14:59.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:14:59.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.400+0000 7f755dc00640 1 Processor -- start 2024-01-19T04:14:59.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.400+0000 7f755dc00640 1 -- start start 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f755dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7558151f30 0x7f75580c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f755dc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f755806fda0 0x7f75580c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f755dc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75580c5b40 con 0x7f755806eb70 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f755dc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75581551e0 con 0x7f7558151f30 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f755dc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7558155710 con 0x7f755806fda0 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7558151f30 0x7f75580c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7558151f30 0x7f75580c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40820/0 (socket says 172.21.15.32:40820) 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7557400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f755806eb70 0x7f755806efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35772/0 (socket says 172.21.15.32:35772) 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556a00640 1 -- 172.21.15.32:0/46076038 learned_addr learned my addr 172.21.15.32:0/46076038 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556000640 1 --2- 172.21.15.32:0/46076038 >> v2:172.21.15.67:3300/0 conn(0x7f755806fda0 0x7f75580c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556a00640 1 -- 172.21.15.32:0/46076038 >> v2:172.21.15.67:3300/0 conn(0x7f755806fda0 msgr2=0x7f75580c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556a00640 1 --2- 172.21.15.32:0/46076038 >> v2:172.21.15.67:3300/0 conn(0x7f755806fda0 0x7f75580c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556a00640 1 -- 172.21.15.32:0/46076038 >> v1:172.21.15.32:6789/0 conn(0x7f755806eb70 legacy=0x7f755806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.404+0000 7f7556a00640 1 -- 172.21.15.32:0/46076038 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75580c3fa0 con 0x7f7558151f30 2024-01-19T04:14:59.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f7556a00640 1 --2- 172.21.15.32:0/46076038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7558151f30 0x7f75580c4430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f755806da70 tx=0x7f754801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de285c5e5ef2832f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f7555600640 1 -- 172.21.15.32:0/46076038 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480ad680 con 0x7f7558151f30 2024-01-19T04:14:59.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f7555600640 1 -- 172.21.15.32:0/46076038 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75480ad7e0 con 0x7f7558151f30 2024-01-19T04:14:59.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f7555600640 1 -- 172.21.15.32:0/46076038 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480adb70 con 0x7f7558151f30 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- 172.21.15.32:0/46076038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7558151f30 msgr2=0x7f75580c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 --2- 172.21.15.32:0/46076038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7558151f30 0x7f75580c4430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f755806da70 tx=0x7f754801c470 comp rx=0 tx=0).stop 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- 172.21.15.32:0/46076038 shutdown_connections 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 --2- 172.21.15.32:0/46076038 >> v2:172.21.15.67:3300/0 conn(0x7f755806fda0 0x7f75580c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 --2- 172.21.15.32:0/46076038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7558151f30 0x7f75580c4430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- 172.21.15.32:0/46076038 >> 172.21.15.32:0/46076038 conn(0x7f75580a9870 msgr2=0x7f75580a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- 172.21.15.32:0/46076038 shutdown_connections 2024-01-19T04:14:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- 172.21.15.32:0/46076038 wait complete. 2024-01-19T04:14:59.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 Processor -- start 2024-01-19T04:14:59.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- start start 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755806eb70 0x7f755806ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755806fda0 0x7f7558153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7558151f30 0x7f7558154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75581edcb0 con 0x7f755806fda0 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75581545c0 con 0x7f755806eb70 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.408+0000 7f755dc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75581ed130 con 0x7f7558151f30 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755806fda0 0x7f7558153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755806fda0 0x7f7558153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40836/0 (socket says 172.21.15.32:40836) 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 -- 172.21.15.32:0/1536720852 learned_addr learned my addr 172.21.15.32:0/1536720852 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556a00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755806eb70 0x7f755806ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7557400640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7558151f30 0x7f7558154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 -- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7558151f30 msgr2=0x7f7558154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7558151f30 0x7f7558154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 -- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755806eb70 msgr2=0x7f755806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755806eb70 0x7f755806ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 -- 172.21.15.32:0/1536720852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480094d0 con 0x7f755806fda0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7557400640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7558151f30 0x7f7558154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f7556000640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755806fda0 0x7f7558153b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f754000d7d0 tx=0x7f754000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f754ea00640 1 -- 172.21.15.32:0/1536720852 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754000b6c0 con 0x7f755806fda0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f754ea00640 1 -- 172.21.15.32:0/1536720852 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754000b820 con 0x7f755806fda0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f754ea00640 1 -- 172.21.15.32:0/1536720852 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754000bbd0 con 0x7f755806fda0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75581ed410 con 0x7f755806fda0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75581ed9d0 con 0x7f755806fda0 2024-01-19T04:14:59.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75580749f0 con 0x7f755806fda0 2024-01-19T04:14:59.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.412+0000 7f754ea00640 1 -- 172.21.15.32:0/1536720852 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f754000bd30 con 0x7f755806fda0 2024-01-19T04:14:59.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.416+0000 7f754ea00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7530066500 0x7f75300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.416+0000 7f754ea00640 1 -- 172.21.15.32:0/1536720852 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7540083fb0 con 0x7f755806fda0 2024-01-19T04:14:59.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.416+0000 7f7556a00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7530066500 0x7f75300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.416+0000 7f7556a00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7530066500 0x7f75300689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75480af000 tx=0x7f75480a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.420+0000 7f754ea00640 1 -- 172.21.15.32:0/1536720852 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7540051590 con 0x7f755806fda0 2024-01-19T04:14:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.580+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7558067b80 con 0x7f755806fda0 2024-01-19T04:14:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.580+0000 7f754ea00640 1 -- 172.21.15.32:0/1536720852 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7540054bb0 con 0x7f755806fda0 2024-01-19T04:14:59.584 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:14:59.584 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-01-19T04:14:59.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:14:59.585 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-01-19T04:14:59.585 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-01-19T04:14:59.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:14:59.585 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-01-19T04:14:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7530066500 msgr2=0x7f75300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7530066500 0x7f75300689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75480af000 tx=0x7f75480a7000 comp rx=0 tx=0).stop 2024-01-19T04:14:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755806fda0 msgr2=0x7f7558153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755806fda0 0x7f7558153b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f754000d7d0 tx=0x7f754000dc90 comp rx=0 tx=0).stop 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 shutdown_connections 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7530066500 0x7f75300689c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7558151f30 0x7f7558154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f755806fda0 0x7f7558153b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 --2- 172.21.15.32:0/1536720852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755806eb70 0x7f755806ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 >> 172.21.15.32:0/1536720852 conn(0x7f75580a9870 msgr2=0x7f755806ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 shutdown_connections 2024-01-19T04:14:59.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.584+0000 7f755dc00640 1 -- 172.21.15.32:0/1536720852 wait complete. 2024-01-19T04:14:59.606 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-19T04:14:59.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-19T04:14:59.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 Processor -- start 2024-01-19T04:14:59.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 -- start start 2024-01-19T04:14:59.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe4881553d0 0x7fe4880bf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe48806d990 0x7fe48806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4880a4d10 0x7fe4880a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880c3a40 con 0x7fe4881553d0 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880c0a70 con 0x7fe48806d990 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe48dc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880c44f0 con 0x7fe4880a4d10 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe4881553d0 0x7fe4880bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe4881553d0 0x7fe4880bf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40844/0 (socket says 172.21.15.32:40844) 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 -- 172.21.15.32:0/2059119370 learned_addr learned my addr 172.21.15.32:0/2059119370 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486000640 1 --2- 172.21.15.32:0/2059119370 >> v2:172.21.15.67:3300/0 conn(0x7fe48806d990 0x7fe48806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe487400640 1 --2- 172.21.15.32:0/2059119370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4880a4d10 0x7fe4880a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 -- 172.21.15.32:0/2059119370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4880a4d10 msgr2=0x7fe4880a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 --2- 172.21.15.32:0/2059119370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4880a4d10 0x7fe4880a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 -- 172.21.15.32:0/2059119370 >> v2:172.21.15.67:3300/0 conn(0x7fe48806d990 msgr2=0x7fe48806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:14:59.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 --2- 172.21.15.32:0/2059119370 >> v2:172.21.15.67:3300/0 conn(0x7fe48806d990 0x7fe48806c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486a00640 1 -- 172.21.15.32:0/2059119370 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880bfdf0 con 0x7fe4881553d0 2024-01-19T04:14:59.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.748+0000 7fe486000640 1 --2- 172.21.15.32:0/2059119370 >> v2:172.21.15.67:3300/0 conn(0x7fe48806d990 0x7fe48806c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:14:59.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe486a00640 1 --2- 172.21.15.32:0/2059119370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe4880bf520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe48806e400 tx=0x7fe47801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c261b35a2f1e4bb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe485600640 1 -- 172.21.15.32:0/2059119370 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780ab600 con 0x7fe4881553d0 2024-01-19T04:14:59.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe485600640 1 -- 172.21.15.32:0/2059119370 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4780ab760 con 0x7fe4881553d0 2024-01-19T04:14:59.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe485600640 1 -- 172.21.15.32:0/2059119370 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780abaf0 con 0x7fe4881553d0 2024-01-19T04:14:59.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 -- 172.21.15.32:0/2059119370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 msgr2=0x7fe4880bf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 --2- 172.21.15.32:0/2059119370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe4880bf520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe48806e400 tx=0x7fe47801c440 comp rx=0 tx=0).stop 2024-01-19T04:14:59.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 -- 172.21.15.32:0/2059119370 shutdown_connections 2024-01-19T04:14:59.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 --2- 172.21.15.32:0/2059119370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe4880a4d10 0x7fe4880a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 --2- 172.21.15.32:0/2059119370 >> v2:172.21.15.67:3300/0 conn(0x7fe48806d990 0x7fe48806c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 --2- 172.21.15.32:0/2059119370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe4880bf520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 -- 172.21.15.32:0/2059119370 >> 172.21.15.32:0/2059119370 conn(0x7fe4880c5b40 msgr2=0x7fe4880c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:14:59.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 -- 172.21.15.32:0/2059119370 shutdown_connections 2024-01-19T04:14:59.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.752+0000 7fe48dc00640 1 -- 172.21.15.32:0/2059119370 wait complete. 2024-01-19T04:14:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 Processor -- start 2024-01-19T04:14:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 -- start start 2024-01-19T04:14:59.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48806d990 0x7fe4880714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4880a4d10 0x7fe488071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe488146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe488071f60 con 0x7fe4881553d0 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4881ed620 con 0x7fe4880a4d10 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4881f1910 con 0x7fe48806d990 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe488146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe488146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40852/0 (socket says 172.21.15.32:40852) 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 -- 172.21.15.32:0/851148076 learned_addr learned my addr 172.21.15.32:0/851148076 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe486a00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48806d990 0x7fe4880714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe486000640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4880a4d10 0x7fe488071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 -- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48806d990 msgr2=0x7fe4880714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48806d990 0x7fe4880714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 -- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4880a4d10 msgr2=0x7fe488071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4880a4d10 0x7fe488071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:14:59.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 -- 172.21.15.32:0/851148076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780094d0 con 0x7fe4881553d0 2024-01-19T04:14:59.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe487400640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe488146910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe480007e40 tx=0x7fe48000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe47ea00640 1 -- 172.21.15.32:0/851148076 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480014620 con 0x7fe4881553d0 2024-01-19T04:14:59.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe47ea00640 1 -- 172.21.15.32:0/851148076 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000ee90 con 0x7fe4881553d0 2024-01-19T04:14:59.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe47ea00640 1 -- 172.21.15.32:0/851148076 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800149e0 con 0x7fe4881553d0 2024-01-19T04:14:59.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4881ed8e0 con 0x7fe4881553d0 2024-01-19T04:14:59.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.756+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4881edea0 con 0x7fe4881553d0 2024-01-19T04:14:59.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.760+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48804e980 con 0x7fe4881553d0 2024-01-19T04:14:59.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.760+0000 7fe47ea00640 1 -- 172.21.15.32:0/851148076 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe480014b40 con 0x7fe4881553d0 2024-01-19T04:14:59.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.760+0000 7fe47ea00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe460066500 0x7fe4600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:14:59.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.760+0000 7fe47ea00640 1 -- 172.21.15.32:0/851148076 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe480084360 con 0x7fe4881553d0 2024-01-19T04:14:59.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.760+0000 7fe486a00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe460066500 0x7fe4600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:14:59.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.760+0000 7fe486a00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe460066500 0x7fe4600689c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4780af000 tx=0x7fe4780b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:14:59.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.764+0000 7fe47ea00640 1 -- 172.21.15.32:0/851148076 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe4800519f0 con 0x7fe4881553d0 2024-01-19T04:14:59.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:14:59.924+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe488072670 con 0x7fe4881553d0 2024-01-19T04:15:00.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.624+0000 7fe47ea00640 1 -- 172.21.15.32:0/851148076 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe480055010 con 0x7fe4881553d0 2024-01-19T04:15:00.628 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-01-19T04:15:00.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe460066500 msgr2=0x7fe4600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:00.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe460066500 0x7fe4600689c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4780af000 tx=0x7fe4780b6040 comp rx=0 tx=0).stop 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 msgr2=0x7fe488146910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe488146910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe480007e40 tx=0x7fe48000e4b0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 shutdown_connections 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe460066500 0x7fe4600689c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4881553d0 0x7fe488146910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4880a4d10 0x7fe488071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 --2- 172.21.15.32:0/851148076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe48806d990 0x7fe4880714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 >> 172.21.15.32:0/851148076 conn(0x7fe4880c5b40 msgr2=0x7fe4880c4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:00.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 shutdown_connections 2024-01-19T04:15:00.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.628+0000 7fe48dc00640 1 -- 172.21.15.32:0/851148076 wait complete. 2024-01-19T04:15:00.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:15:00.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 Processor -- start 2024-01-19T04:15:00.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 -- start start 2024-01-19T04:15:00.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc8151b80 0x7f3bc8155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:00.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3bc8157cc0 0x7f3bc80c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3bc80c4cd0 0x7f3bc80c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc80c34a0 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc8155730 con 0x7f3bc8157cc0 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bce800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80c2d30 con 0x7f3bc8151b80 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3bc80c4cd0 0x7f3bc80c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3bc80c4cd0 0x7f3bc80c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40866/0 (socket says 172.21.15.32:40866) 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 -- 172.21.15.32:0/2809944590 learned_addr learned my addr 172.21.15.32:0/2809944590 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc6a00640 1 --2- 172.21.15.32:0/2809944590 >> v2:172.21.15.67:3300/0 conn(0x7f3bc8157cc0 0x7f3bc80c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7400640 1 --2- 172.21.15.32:0/2809944590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc8151b80 0x7f3bc8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 -- 172.21.15.32:0/2809944590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc8151b80 msgr2=0x7f3bc8155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 --2- 172.21.15.32:0/2809944590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc8151b80 0x7f3bc8155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 -- 172.21.15.32:0/2809944590 >> v2:172.21.15.67:3300/0 conn(0x7f3bc8157cc0 msgr2=0x7f3bc80c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:00.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 --2- 172.21.15.32:0/2809944590 >> v2:172.21.15.67:3300/0 conn(0x7f3bc8157cc0 0x7f3bc80c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.808+0000 7f3bc7e00640 1 -- 172.21.15.32:0/2809944590 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80c3010 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bc7e00640 1 --2- 172.21.15.32:0/2809944590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc80c4cd0 0x7f3bc80c6360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bc806b360 tx=0x7f3bc001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef0b21fdcbdb4e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:00.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bc6000640 1 -- 172.21.15.32:0/2809944590 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00af400 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bc6000640 1 -- 172.21.15.32:0/2809944590 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00ab050 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bc6000640 1 -- 172.21.15.32:0/2809944590 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00af780 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 -- 172.21.15.32:0/2809944590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc80c4cd0 msgr2=0x7f3bc80c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:00.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 --2- 172.21.15.32:0/2809944590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc80c4cd0 0x7f3bc80c6360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bc806b360 tx=0x7f3bc001f1c0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 -- 172.21.15.32:0/2809944590 shutdown_connections 2024-01-19T04:15:00.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 --2- 172.21.15.32:0/2809944590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc80c4cd0 0x7f3bc80c6360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 --2- 172.21.15.32:0/2809944590 >> v2:172.21.15.67:3300/0 conn(0x7f3bc8157cc0 0x7f3bc80c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 --2- 172.21.15.32:0/2809944590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc8151b80 0x7f3bc8155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 -- 172.21.15.32:0/2809944590 >> 172.21.15.32:0/2809944590 conn(0x7f3bc80c7d40 msgr2=0x7f3bc80c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:00.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 -- 172.21.15.32:0/2809944590 shutdown_connections 2024-01-19T04:15:00.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.812+0000 7f3bce800640 1 -- 172.21.15.32:0/2809944590 wait complete. 2024-01-19T04:15:00.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 Processor -- start 2024-01-19T04:15:00.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 -- start start 2024-01-19T04:15:00.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc80c4cd0 0x7f3bc81eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:00.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc8151b80 0x7f3bc8153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:00.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc8157cc0 0x7f3bc81ed340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc81ee020 con 0x7f3bc8157cc0 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc81533f0 con 0x7f3bc8151b80 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc81edd40 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc8157cc0 0x7f3bc81ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc80c4cd0 0x7f3bc81eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc8157cc0 0x7f3bc81ed340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40880/0 (socket says 172.21.15.32:40880) 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7e00640 1 -- 172.21.15.32:0/1548523238 learned_addr learned my addr 172.21.15.32:0/1548523238 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc6a00640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc8151b80 0x7f3bc8153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7400640 1 -- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc8151b80 msgr2=0x7f3bc8153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7400640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc8151b80 0x7f3bc8153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7400640 1 -- 172.21.15.32:0/1548523238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc8157cc0 msgr2=0x7f3bc81ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7400640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc8157cc0 0x7f3bc81ed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7400640 1 -- 172.21.15.32:0/1548523238 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0009b30 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7e00640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc8157cc0 0x7f3bc81ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:00.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc6a00640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc8151b80 0x7f3bc8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:00.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bc7400640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc80c4cd0 0x7f3bc81eafe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800d5d0 tx=0x7f3bb800da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:00.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bbf400640 1 -- 172.21.15.32:0/1548523238 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8014620 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bbf400640 1 -- 172.21.15.32:0/1548523238 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb80147a0 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bbf400640 1 -- 172.21.15.32:0/1548523238 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8014b50 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc8153080 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc81547c0 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.816+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc80749f0 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.820+0000 7f3bbf400640 1 -- 172.21.15.32:0/1548523238 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3bb8014cb0 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.820+0000 7f3bbf400640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ba0066530 0x7f3ba00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:00.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.820+0000 7f3bbf400640 1 -- 172.21.15.32:0/1548523238 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3bb8084230 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.820+0000 7f3bc6a00640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ba0066530 0x7f3ba00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:00.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.820+0000 7f3bc6a00640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ba0066530 0x7f3ba00689f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80a9d20 tx=0x7f3bb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:00.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.824+0000 7f3bbf400640 1 -- 172.21.15.32:0/1548523238 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3bb8051750 con 0x7f3bc80c4cd0 2024-01-19T04:15:00.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:00.988+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3bc81ede80 con 0x7f3bc80c4cd0 2024-01-19T04:15:01.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.632+0000 7f3bbf400640 1 -- 172.21.15.32:0/1548523238 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3bc81ede80 con 0x7f3bc80c4cd0 2024-01-19T04:15:01.637 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-01-19T04:15:01.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.636+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ba0066530 msgr2=0x7f3ba00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:01.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.636+0000 7f3bce800640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ba0066530 0x7f3ba00689f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80a9d20 tx=0x7f3bb0008040 comp rx=0 tx=0).stop 2024-01-19T04:15:01.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc80c4cd0 msgr2=0x7f3bc81eafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:01.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc80c4cd0 0x7f3bc81eafe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800d5d0 tx=0x7f3bb800da90 comp rx=0 tx=0).stop 2024-01-19T04:15:01.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 shutdown_connections 2024-01-19T04:15:01.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ba0066530 0x7f3ba00689f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bc8157cc0 0x7f3bc81ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bc8151b80 0x7f3bc8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 --2- 172.21.15.32:0/1548523238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bc80c4cd0 0x7f3bc81eafe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 >> 172.21.15.32:0/1548523238 conn(0x7f3bc80c7d40 msgr2=0x7f3bc8156c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:01.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 shutdown_connections 2024-01-19T04:15:01.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.640+0000 7f3bce800640 1 -- 172.21.15.32:0/1548523238 wait complete. 2024-01-19T04:15:01.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-19T04:15:01.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27eac00640 1 Processor -- start 2024-01-19T04:15:01.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27eac00640 1 -- start start 2024-01-19T04:15:01.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27eac00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f27e40c3230 0x7f27e40c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:01.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27eac00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40c6470 con 0x7f27e41565d0 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27eac00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40c6ff0 con 0x7f27e406eeb0 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27eac00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40c88a0 con 0x7f27e40c3230 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27e3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f27e40c3230 0x7f27e40c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27e3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f27e41565d0 0x7f27e40c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35782/0 (socket says 172.21.15.32:35782) 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27e3e00640 1 -- 172.21.15.32:0/296243135 learned_addr learned my addr 172.21.15.32:0/296243135 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27e3400640 1 -- 172.21.15.32:0/296243135 >> v1:172.21.15.67:6789/0 conn(0x7f27e406eeb0 legacy=0x7f27e406f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27e3400640 1 -- 172.21.15.32:0/296243135 >> v1:172.21.15.32:6789/0 conn(0x7f27e41565d0 legacy=0x7f27e40c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:01.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.828+0000 7f27e3400640 1 -- 172.21.15.32:0/296243135 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40c66c0 con 0x7f27e40c3230 2024-01-19T04:15:01.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27e3400640 1 --2- 172.21.15.32:0/296243135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e40c3690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0097c0 tx=0x7f27cc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1551d2930891b87 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:01.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27e2a00640 1 -- 172.21.15.32:0/296243135 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0ab600 con 0x7f27e40c3230 2024-01-19T04:15:01.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27e2a00640 1 -- 172.21.15.32:0/296243135 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc0a7050 con 0x7f27e40c3230 2024-01-19T04:15:01.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27e2a00640 1 -- 172.21.15.32:0/296243135 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0ab980 con 0x7f27e40c3230 2024-01-19T04:15:01.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27eac00640 1 -- 172.21.15.32:0/296243135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 msgr2=0x7f27e40c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:01.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27eac00640 1 --2- 172.21.15.32:0/296243135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e40c3690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0097c0 tx=0x7f27cc01c3b0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27eac00640 1 -- 172.21.15.32:0/296243135 shutdown_connections 2024-01-19T04:15:01.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27eac00640 1 --2- 172.21.15.32:0/296243135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e40c3690 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27eac00640 1 -- 172.21.15.32:0/296243135 >> 172.21.15.32:0/296243135 conn(0x7f27e40726d0 msgr2=0x7f27e40663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:01.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27eac00640 1 -- 172.21.15.32:0/296243135 shutdown_connections 2024-01-19T04:15:01.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.832+0000 7f27eac00640 1 -- 172.21.15.32:0/296243135 wait complete. 2024-01-19T04:15:01.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 Processor -- start 2024-01-19T04:15:01.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 -- start start 2024-01-19T04:15:01.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e406eeb0 0x7f27e406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e41525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e41565d0 0x7f27e41491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e414cf50 con 0x7f27e40c3230 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41f0ec0 con 0x7f27e406eeb0 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41f1140 con 0x7f27e41565d0 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e41525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e41525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40896/0 (socket says 172.21.15.32:40896) 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 -- 172.21.15.32:0/1225645847 learned_addr learned my addr 172.21.15.32:0/1225645847 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3e00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e406eeb0 0x7f27e406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e8c00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e41565d0 0x7f27e41491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 -- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e41565d0 msgr2=0x7f27e41491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e41565d0 0x7f27e41491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 -- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e406eeb0 msgr2=0x7f27e406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:01.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e406eeb0 0x7f27e406d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:01.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 -- 172.21.15.32:0/1225645847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009420 con 0x7f27e40c3230 2024-01-19T04:15:01.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27e3400640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e41525e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0097c0 tx=0x7f27cc01abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:01.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27dbe00640 1 -- 172.21.15.32:0/1225645847 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0b7450 con 0x7f27e40c3230 2024-01-19T04:15:01.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27dbe00640 1 -- 172.21.15.32:0/1225645847 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc0b75b0 con 0x7f27e40c3230 2024-01-19T04:15:01.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27dbe00640 1 -- 172.21.15.32:0/1225645847 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0b7960 con 0x7f27e40c3230 2024-01-19T04:15:01.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e414c890 con 0x7f27e40c3230 2024-01-19T04:15:01.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.836+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e4152b20 con 0x7f27e40c3230 2024-01-19T04:15:01.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.840+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e40c2590 con 0x7f27e40c3230 2024-01-19T04:15:01.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.840+0000 7f27dbe00640 1 -- 172.21.15.32:0/1225645847 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f27cc0b7ac0 con 0x7f27e40c3230 2024-01-19T04:15:01.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.840+0000 7f27dbe00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f27bc066500 0x7f27bc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:01.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.840+0000 7f27dbe00640 1 -- 172.21.15.32:0/1225645847 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f27cc11e580 con 0x7f27e40c3230 2024-01-19T04:15:01.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.840+0000 7f27e3e00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f27bc066500 0x7f27bc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:01.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.840+0000 7f27e3e00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f27bc066500 0x7f27bc0689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f70 tx=0x7f27d4007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:01.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:01.844+0000 7f27dbe00640 1 -- 172.21.15.32:0/1225645847 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f27cc0eb920 con 0x7f27e40c3230 2024-01-19T04:15:02.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.036+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27e414c6f0 con 0x7f27e40c3230 2024-01-19T04:15:02.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.648+0000 7f27dbe00640 1 -- 172.21.15.32:0/1225645847 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f27e414c6f0 con 0x7f27e40c3230 2024-01-19T04:15:02.655 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 2 and data pool 3 2024-01-19T04:15:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f27bc066500 msgr2=0x7f27bc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f27bc066500 0x7f27bc0689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f70 tx=0x7f27d4007e90 comp rx=0 tx=0).stop 2024-01-19T04:15:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 msgr2=0x7f27e41525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e41525e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0097c0 tx=0x7f27cc01abf0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 shutdown_connections 2024-01-19T04:15:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f27bc066500 0x7f27bc0689c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f27e41565d0 0x7f27e41491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27e40c3230 0x7f27e41525e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 --2- 172.21.15.32:0/1225645847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e406eeb0 0x7f27e406d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 >> 172.21.15.32:0/1225645847 conn(0x7f27e40726d0 msgr2=0x7f27e41557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:02.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 shutdown_connections 2024-01-19T04:15:02.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.664+0000 7f27eac00640 1 -- 172.21.15.32:0/1225645847 wait complete. 2024-01-19T04:15:02.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:02.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.840+0000 7f0397200640 1 Processor -- start 2024-01-19T04:15:02.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f0397200640 1 -- start start 2024-01-19T04:15:02.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f0397200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f03900c5740 0x7f03900c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:02.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f0397200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900c0c90 con 0x7f03900c42b0 2024-01-19T04:15:02.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f0397200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0390150cb0 con 0x7f03900c1120 2024-01-19T04:15:02.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f0397200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0390150f90 con 0x7f03900c5740 2024-01-19T04:15:02.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f038fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f03900c42b0 0x7f039006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35794/0 (socket says 172.21.15.32:35794) 2024-01-19T04:15:02.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f038fe00640 1 -- 172.21.15.32:0/3909848714 learned_addr learned my addr 172.21.15.32:0/3909848714 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:02.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f038f400640 1 --2- 172.21.15.32:0/3909848714 >> v2:172.21.15.32:3300/0 conn(0x7f03900c5740 0x7f03900c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:02.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f038f400640 1 -- 172.21.15.32:0/3909848714 >> v1:172.21.15.67:6789/0 conn(0x7f03900c1120 legacy=0x7f039015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:02.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f038f400640 1 -- 172.21.15.32:0/3909848714 >> v1:172.21.15.32:6789/0 conn(0x7f03900c42b0 legacy=0x7f039006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:02.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.844+0000 7f038f400640 1 -- 172.21.15.32:0/3909848714 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03900c0640 con 0x7f03900c5740 2024-01-19T04:15:02.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f038f400640 1 --2- 172.21.15.32:0/3909848714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c5740 0x7f03900c4690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f03780097c0 tx=0x7f037801df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb1f662fc89a68b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:02.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f038ea00640 1 -- 172.21.15.32:0/3909848714 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780ac680 con 0x7f03900c5740 2024-01-19T04:15:02.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f038ea00640 1 -- 172.21.15.32:0/3909848714 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780ac7e0 con 0x7f03900c5740 2024-01-19T04:15:02.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f038ea00640 1 -- 172.21.15.32:0/3909848714 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780acb70 con 0x7f03900c5740 2024-01-19T04:15:02.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 -- 172.21.15.32:0/3909848714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c5740 msgr2=0x7f03900c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:02.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 --2- 172.21.15.32:0/3909848714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c5740 0x7f03900c4690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f03780097c0 tx=0x7f037801df30 comp rx=0 tx=0).stop 2024-01-19T04:15:02.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 -- 172.21.15.32:0/3909848714 shutdown_connections 2024-01-19T04:15:02.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 --2- 172.21.15.32:0/3909848714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c5740 0x7f03900c4690 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 -- 172.21.15.32:0/3909848714 >> 172.21.15.32:0/3909848714 conn(0x7f03900c5b20 msgr2=0x7f03900c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:02.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 -- 172.21.15.32:0/3909848714 shutdown_connections 2024-01-19T04:15:02.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 -- 172.21.15.32:0/3909848714 wait complete. 2024-01-19T04:15:02.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 Processor -- start 2024-01-19T04:15:02.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.848+0000 7f0397200640 1 -- start start 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c1120 0x7f0390149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03900c42b0 0x7f03901f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03900c5740 0x7f039014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039015c210 con 0x7f03900c1120 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900a8b70 con 0x7f03900c5740 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03900a8e50 con 0x7f03900c42b0 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c1120 0x7f0390149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c1120 0x7f0390149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40916/0 (socket says 172.21.15.32:40916) 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 -- 172.21.15.32:0/2595325159 learned_addr learned my addr 172.21.15.32:0/2595325159 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:02.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03900c42b0 0x7f03901f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:02.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0395200640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03900c5740 0x7f039014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:02.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 -- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03900c42b0 msgr2=0x7f03901f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:02.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03900c42b0 0x7f03901f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 -- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03900c5740 msgr2=0x7f039014ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:02.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03900c5740 0x7f039014ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:02.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 -- 172.21.15.32:0/2595325159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378009420 con 0x7f03900c1120 2024-01-19T04:15:02.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f038fe00640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c1120 0x7f0390149920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f038000c500 tx=0x7f038000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0387e00640 1 -- 172.21.15.32:0/2595325159 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380005cf0 con 0x7f03900c1120 2024-01-19T04:15:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0387e00640 1 -- 172.21.15.32:0/2595325159 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380005e50 con 0x7f03900c1120 2024-01-19T04:15:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0387e00640 1 -- 172.21.15.32:0/2595325159 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800072f0 con 0x7f03900c1120 2024-01-19T04:15:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03900a92e0 con 0x7f03900c1120 2024-01-19T04:15:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039014a100 con 0x7f03900c1120 2024-01-19T04:15:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.852+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03900c4eb0 con 0x7f03900c1120 2024-01-19T04:15:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.856+0000 7f0387e00640 1 -- 172.21.15.32:0/2595325159 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0380007450 con 0x7f03900c1120 2024-01-19T04:15:02.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.856+0000 7f0387e00640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0368066530 0x7f03680689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:02.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.856+0000 7f0387e00640 1 -- 172.21.15.32:0/2595325159 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0380083340 con 0x7f03900c1120 2024-01-19T04:15:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.856+0000 7f038f400640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0368066530 0x7f03680689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.856+0000 7f038f400640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0368066530 0x7f03680689f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03780b0000 tx=0x7f0378008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:02.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:02.860+0000 7f0387e00640 1 -- 172.21.15.32:0/2595325159 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0380050680 con 0x7f03900c1120 2024-01-19T04:15:03.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.020+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03900749f0 con 0x7f03900c1120 2024-01-19T04:15:03.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.020+0000 7f0387e00640 1 -- 172.21.15.32:0/2595325159 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16423 (secure 0 0 0) 0x7f0380053ca0 con 0x7f03900c1120 2024-01-19T04:15:03.024 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:03.024 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:02.043178+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.020+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0368066530 msgr2=0x7f03680689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.020+0000 7f0397200640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0368066530 0x7f03680689f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03780b0000 tx=0x7f0378008040 comp rx=0 tx=0).stop 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.020+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c1120 msgr2=0x7f0390149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.020+0000 7f0397200640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c1120 0x7f0390149920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f038000c500 tx=0x7f038000c9c0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 shutdown_connections 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0368066530 0x7f03680689f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03900c5740 0x7f039014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03900c42b0 0x7f03901f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 --2- 172.21.15.32:0/2595325159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03900c1120 0x7f0390149920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 >> 172.21.15.32:0/2595325159 conn(0x7f03900c5b20 msgr2=0x7f0390071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 shutdown_connections 2024-01-19T04:15:03.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.024+0000 7f0397200640 1 -- 172.21.15.32:0/2595325159 wait complete. 2024-01-19T04:15:03.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:03.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdef800640 1 Processor -- start 2024-01-19T04:15:03.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdef800640 1 -- start start 2024-01-19T04:15:03.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdef800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbde80a6d30 0x7fbde80c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdef800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbde806fda0 0x7fbde80c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdef800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde81533a0 con 0x7fbde80c6e20 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdef800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde8156380 con 0x7fbde806fda0 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdef800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde814fe40 con 0x7fbde80a6d30 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbded800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbde806fda0 0x7fbde80c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbded800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbde806fda0 0x7fbde80c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40924/0 (socket says 172.21.15.32:40924) 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbded800640 1 -- 172.21.15.32:0/3451147167 learned_addr learned my addr 172.21.15.32:0/3451147167 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbdece00640 1 --1- 172.21.15.32:0/3451147167 >> v1:172.21.15.32:6789/0 conn(0x7fbde80c6e20 0x7fbde8152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35804/0 (socket says 172.21.15.32:35804) 2024-01-19T04:15:03.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbde7e00640 1 --2- 172.21.15.32:0/3451147167 >> v2:172.21.15.67:3300/0 conn(0x7fbde80a6d30 0x7fbde80c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbded800640 1 -- 172.21.15.32:0/3451147167 >> v2:172.21.15.67:3300/0 conn(0x7fbde80a6d30 msgr2=0x7fbde80c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:03.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbded800640 1 --2- 172.21.15.32:0/3451147167 >> v2:172.21.15.67:3300/0 conn(0x7fbde80a6d30 0x7fbde80c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbded800640 1 -- 172.21.15.32:0/3451147167 >> v1:172.21.15.32:6789/0 conn(0x7fbde80c6e20 legacy=0x7fbde8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbded800640 1 -- 172.21.15.32:0/3451147167 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8152800 con 0x7fbde806fda0 2024-01-19T04:15:03.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.184+0000 7fbde7400640 1 -- 172.21.15.32:0/3451147167 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564587595 0 0) 0x7fbdd8001120 con 0x7fbde80c6e20 2024-01-19T04:15:03.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbded800640 1 --2- 172.21.15.32:0/3451147167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde806fda0 0x7fbde80c5b40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbde8067390 tx=0x7fbde001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cddcf61d93d7797 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:03.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbde7400640 1 -- 172.21.15.32:0/3451147167 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00a5800 con 0x7fbde806fda0 2024-01-19T04:15:03.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbde7400640 1 -- 172.21.15.32:0/3451147167 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde00a5960 con 0x7fbde806fda0 2024-01-19T04:15:03.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbde7400640 1 -- 172.21.15.32:0/3451147167 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00a5cf0 con 0x7fbde806fda0 2024-01-19T04:15:03.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 -- 172.21.15.32:0/3451147167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde806fda0 msgr2=0x7fbde80c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 --2- 172.21.15.32:0/3451147167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde806fda0 0x7fbde80c5b40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbde8067390 tx=0x7fbde001c940 comp rx=0 tx=0).stop 2024-01-19T04:15:03.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 -- 172.21.15.32:0/3451147167 shutdown_connections 2024-01-19T04:15:03.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 --2- 172.21.15.32:0/3451147167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde806fda0 0x7fbde80c5b40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 --2- 172.21.15.32:0/3451147167 >> v2:172.21.15.67:3300/0 conn(0x7fbde80a6d30 0x7fbde80c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 -- 172.21.15.32:0/3451147167 >> 172.21.15.32:0/3451147167 conn(0x7fbde80a9870 msgr2=0x7fbde80a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:03.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 -- 172.21.15.32:0/3451147167 shutdown_connections 2024-01-19T04:15:03.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.188+0000 7fbdef800640 1 -- 172.21.15.32:0/3451147167 wait complete. 2024-01-19T04:15:03.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 Processor -- start 2024-01-19T04:15:03.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 -- start start 2024-01-19T04:15:03.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbde806fda0 0x7fbde81eab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbde80a6d30 0x7fbde81eb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde80c6e20 0x7fbde8149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde814b250 con 0x7fbde80c6e20 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8151b70 con 0x7fbde806fda0 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8151e50 con 0x7fbde80a6d30 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde80c6e20 0x7fbde8149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdece00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbde806fda0 0x7fbde81eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde80c6e20 0x7fbde8149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40930/0 (socket says 172.21.15.32:40930) 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 -- 172.21.15.32:0/1710889875 learned_addr learned my addr 172.21.15.32:0/1710889875 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbde7e00640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbde80a6d30 0x7fbde81eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 -- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbde80a6d30 msgr2=0x7fbde81eb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbde80a6d30 0x7fbde81eb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 -- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbde806fda0 msgr2=0x7fbde81eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbde806fda0 0x7fbde81eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 -- 172.21.15.32:0/1710889875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0009b30 con 0x7fbde80c6e20 2024-01-19T04:15:03.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbded800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde80c6e20 0x7fbde8149ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbde00af040 tx=0x7fbde00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:03.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbde4c00640 1 -- 172.21.15.32:0/1710889875 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00b8470 con 0x7fbde80c6e20 2024-01-19T04:15:03.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbde4c00640 1 -- 172.21.15.32:0/1710889875 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde00b85f0 con 0x7fbde80c6e20 2024-01-19T04:15:03.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde8152130 con 0x7fbde80c6e20 2024-01-19T04:15:03.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbde4c00640 1 -- 172.21.15.32:0/1710889875 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00b89a0 con 0x7fbde80c6e20 2024-01-19T04:15:03.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.192+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde81eb5b0 con 0x7fbde80c6e20 2024-01-19T04:15:03.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.196+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde80749f0 con 0x7fbde80c6e20 2024-01-19T04:15:03.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.196+0000 7fbde4c00640 1 -- 172.21.15.32:0/1710889875 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbde00b8b00 con 0x7fbde80c6e20 2024-01-19T04:15:03.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.196+0000 7fbde4c00640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbdc0066530 0x7fbdc00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.196+0000 7fbde4c00640 1 -- 172.21.15.32:0/1710889875 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbde011eeb0 con 0x7fbde80c6e20 2024-01-19T04:15:03.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.196+0000 7fbdece00640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbdc0066530 0x7fbdc00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.196+0000 7fbdece00640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbdc0066530 0x7fbdc00689f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8007fd0 tx=0x7fbdd8007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:03.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.200+0000 7fbde4c00640 1 -- 172.21.15.32:0/1710889875 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbde00ec1f0 con 0x7fbde80c6e20 2024-01-19T04:15:03.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.364+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbde814b670 con 0x7fbde80c6e20 2024-01-19T04:15:03.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.364+0000 7fbde4c00640 1 -- 172.21.15.32:0/1710889875 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16423 (secure 0 0 0) 0x7fbde00ef810 con 0x7fbde80c6e20 2024-01-19T04:15:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:03.367 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:02.043178+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.364+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbdc0066530 msgr2=0x7fbdc00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.364+0000 7fbdef800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbdc0066530 0x7fbdc00689f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8007fd0 tx=0x7fbdd8007ba0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.364+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde80c6e20 msgr2=0x7fbde8149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.364+0000 7fbdef800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde80c6e20 0x7fbde8149ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbde00af040 tx=0x7fbde00196e0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 shutdown_connections 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbdc0066530 0x7fbdc00689f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbde80c6e20 0x7fbde8149ce0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbde80a6d30 0x7fbde81eb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 --2- 172.21.15.32:0/1710889875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbde806fda0 0x7fbde81eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 >> 172.21.15.32:0/1710889875 conn(0x7fbde80a9870 msgr2=0x7fbde80c3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 shutdown_connections 2024-01-19T04:15:03.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.368+0000 7fbdef800640 1 -- 172.21.15.32:0/1710889875 wait complete. 2024-01-19T04:15:03.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-19T04:15:03.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcee00640 1 Processor -- start 2024-01-19T04:15:03.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcee00640 1 -- start start 2024-01-19T04:15:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcee00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fefc8155150 0x7fefc8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcee00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc80c2d30 con 0x7fefc80c6360 2024-01-19T04:15:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcee00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc80c3010 con 0x7fefc8151b80 2024-01-19T04:15:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcee00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80c34a0 con 0x7fefc8155150 2024-01-19T04:15:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefc7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fefc8155150 0x7fefc8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcce00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fefc80c6360 0x7fefc80c67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35806/0 (socket says 172.21.15.32:35806) 2024-01-19T04:15:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefcce00640 1 -- 172.21.15.32:0/1469930993 learned_addr learned my addr 172.21.15.32:0/1469930993 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:03.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefc7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fefc8155150 0x7fefc8157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40936/0 (socket says 172.21.15.32:40936) 2024-01-19T04:15:03.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefc7400640 1 -- 172.21.15.32:0/1469930993 >> v1:172.21.15.67:6789/0 conn(0x7fefc8151b80 legacy=0x7fefc80c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefc6a00640 1 -- 172.21.15.32:0/1469930993 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346452464 0 0) 0x7fefc80c2d30 con 0x7fefc80c6360 2024-01-19T04:15:03.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefc7400640 1 -- 172.21.15.32:0/1469930993 >> v1:172.21.15.32:6789/0 conn(0x7fefc80c6360 legacy=0x7fefc80c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.532+0000 7fefc7400640 1 -- 172.21.15.32:0/1469930993 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80c7700 con 0x7fefc8155150 2024-01-19T04:15:03.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefc7400640 1 --2- 172.21.15.32:0/1469930993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc8157cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fefb00097c0 tx=0x7fefb001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db022f796cf11bc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:03.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefc6a00640 1 -- 172.21.15.32:0/1469930993 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb00ab610 con 0x7fefc8155150 2024-01-19T04:15:03.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefc6a00640 1 -- 172.21.15.32:0/1469930993 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb00ab770 con 0x7fefc8155150 2024-01-19T04:15:03.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefc6a00640 1 -- 172.21.15.32:0/1469930993 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb00abb00 con 0x7fefc8155150 2024-01-19T04:15:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefcee00640 1 -- 172.21.15.32:0/1469930993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 msgr2=0x7fefc8157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefcee00640 1 --2- 172.21.15.32:0/1469930993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc8157cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fefb00097c0 tx=0x7fefb001c450 comp rx=0 tx=0).stop 2024-01-19T04:15:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefcee00640 1 -- 172.21.15.32:0/1469930993 shutdown_connections 2024-01-19T04:15:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefcee00640 1 --2- 172.21.15.32:0/1469930993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc8157cc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefcee00640 1 -- 172.21.15.32:0/1469930993 >> 172.21.15.32:0/1469930993 conn(0x7fefc80c7d40 msgr2=0x7fefc80c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefcee00640 1 -- 172.21.15.32:0/1469930993 shutdown_connections 2024-01-19T04:15:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.536+0000 7fefcee00640 1 -- 172.21.15.32:0/1469930993 wait complete. 2024-01-19T04:15:03.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 Processor -- start 2024-01-19T04:15:03.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 -- start start 2024-01-19T04:15:03.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80c6360 0x7fefc8149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefc8151b80 0x7fefc814a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc81ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8155730 con 0x7fefc8155150 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc81496b0 con 0x7fefc80c6360 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8153ef0 con 0x7fefc8151b80 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc81ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc81ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40946/0 (socket says 172.21.15.32:40946) 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 -- 172.21.15.32:0/2226077685 learned_addr learned my addr 172.21.15.32:0/2226077685 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefc7400640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefc8151b80 0x7fefc814a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefc7e00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80c6360 0x7fefc8149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 -- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefc8151b80 msgr2=0x7fefc814a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefc8151b80 0x7fefc814a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 -- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80c6360 msgr2=0x7fefc8149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80c6360 0x7fefc8149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 -- 172.21.15.32:0/2226077685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009420 con 0x7fefc8155150 2024-01-19T04:15:03.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcce00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc81ee100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c700 tx=0x7fefc000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:03.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefbfe00640 1 -- 172.21.15.32:0/2226077685 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000ce10 con 0x7fefc8155150 2024-01-19T04:15:03.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefbfe00640 1 -- 172.21.15.32:0/2226077685 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc000a640 con 0x7fefc8155150 2024-01-19T04:15:03.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc814a8a0 con 0x7fefc8155150 2024-01-19T04:15:03.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefbfe00640 1 -- 172.21.15.32:0/2226077685 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000aa70 con 0x7fefc8155150 2024-01-19T04:15:03.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.540+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc8153b50 con 0x7fefc8155150 2024-01-19T04:15:03.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.544+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc8154030 con 0x7fefc8155150 2024-01-19T04:15:03.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.544+0000 7fefbfe00640 1 -- 172.21.15.32:0/2226077685 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fefc000abd0 con 0x7fefc8155150 2024-01-19T04:15:03.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.544+0000 7fefbfe00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fefa0066500 0x7fefa00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:03.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.544+0000 7fefbfe00640 1 -- 172.21.15.32:0/2226077685 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefc0083440 con 0x7fefc8155150 2024-01-19T04:15:03.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.544+0000 7fefc7e00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fefa0066500 0x7fefa00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:03.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.544+0000 7fefc7e00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fefa0066500 0x7fefa00689c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefb8000f70 tx=0x7fefb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:03.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.548+0000 7fefbfe00640 1 -- 172.21.15.32:0/2226077685 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fefc8154030 con 0x7fefc8155150 2024-01-19T04:15:03.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:03.748+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fefc8154030 con 0x7fefc8155150 2024-01-19T04:15:04.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.660+0000 7fefbfe00640 1 -- 172.21.15.32:0/2226077685 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fefc8154030 con 0x7fefc8155150 2024-01-19T04:15:04.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fefa0066500 msgr2=0x7fefa00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fefa0066500 0x7fefa00689c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefb8000f70 tx=0x7fefb8009040 comp rx=0 tx=0).stop 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 msgr2=0x7fefc81ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc81ee100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c700 tx=0x7fefc000cbc0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 shutdown_connections 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fefa0066500 0x7fefa00689c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc8155150 0x7fefc81ee100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fefc8151b80 0x7fefc814a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 --2- 172.21.15.32:0/2226077685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefc80c6360 0x7fefc8149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 >> 172.21.15.32:0/2226077685 conn(0x7fefc80c7d40 msgr2=0x7fefc80c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 shutdown_connections 2024-01-19T04:15:04.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.664+0000 7fefcee00640 1 -- 172.21.15.32:0/2226077685 wait complete. 2024-01-19T04:15:04.690 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T04:15:04.691 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-19T04:15:04.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8f000640 1 Processor -- start 2024-01-19T04:15:04.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8f000640 1 -- start start 2024-01-19T04:15:04.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8f000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b880723b0 0x7f1b88152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:04.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8f000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1b8806d440 0x7f1b880c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:04.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8f000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880a4ea0 con 0x7f1b880c2080 2024-01-19T04:15:04.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8f000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b881524a0 con 0x7f1b880723b0 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8f000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b88152a20 con 0x7f1b8806d440 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b87e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b880723b0 0x7f1b88152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b87e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b880723b0 0x7f1b88152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40958/0 (socket says 172.21.15.32:40958) 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b87e00640 1 -- 172.21.15.32:0/2330300698 learned_addr learned my addr 172.21.15.32:0/2330300698 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b8d000640 1 --2- 172.21.15.32:0/2330300698 >> v2:172.21.15.67:3300/0 conn(0x7f1b8806d440 0x7f1b880c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b87e00640 1 -- 172.21.15.32:0/2330300698 >> v2:172.21.15.67:3300/0 conn(0x7f1b8806d440 msgr2=0x7f1b880c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b87e00640 1 --2- 172.21.15.32:0/2330300698 >> v2:172.21.15.67:3300/0 conn(0x7f1b8806d440 0x7f1b880c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b87e00640 1 -- 172.21.15.32:0/2330300698 >> v1:172.21.15.67:6789/0 conn(0x7f1b880c2080 legacy=0x7f1b88155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:04.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.836+0000 7f1b87e00640 1 -- 172.21.15.32:0/2330300698 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b881533f0 con 0x7f1b880723b0 2024-01-19T04:15:04.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b87e00640 1 --2- 172.21.15.32:0/2330300698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880723b0 0x7f1b88152eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b88072d10 tx=0x7f1b7801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cec65cd14a6c26 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:04.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b86a00640 1 -- 172.21.15.32:0/2330300698 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780ab600 con 0x7f1b880723b0 2024-01-19T04:15:04.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b86a00640 1 -- 172.21.15.32:0/2330300698 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b780a7050 con 0x7f1b880723b0 2024-01-19T04:15:04.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b86a00640 1 -- 172.21.15.32:0/2330300698 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780ab980 con 0x7f1b880723b0 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 -- 172.21.15.32:0/2330300698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880723b0 msgr2=0x7f1b88152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 --2- 172.21.15.32:0/2330300698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880723b0 0x7f1b88152eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b88072d10 tx=0x7f1b7801c3a0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 -- 172.21.15.32:0/2330300698 shutdown_connections 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 --2- 172.21.15.32:0/2330300698 >> v2:172.21.15.67:3300/0 conn(0x7f1b8806d440 0x7f1b880c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 --2- 172.21.15.32:0/2330300698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880723b0 0x7f1b88152eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 -- 172.21.15.32:0/2330300698 >> 172.21.15.32:0/2330300698 conn(0x7f1b880c25a0 msgr2=0x7f1b880c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 -- 172.21.15.32:0/2330300698 shutdown_connections 2024-01-19T04:15:04.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.840+0000 7f1b8f000640 1 -- 172.21.15.32:0/2330300698 wait complete. 2024-01-19T04:15:04.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 Processor -- start 2024-01-19T04:15:04.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 -- start start 2024-01-19T04:15:04.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b8806d440 0x7f1b8814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:04.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b880723b0 0x7f1b88154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:04.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880c2080 0x7f1b8814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:04.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880abd40 con 0x7f1b880c2080 2024-01-19T04:15:04.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8814f4f0 con 0x7f1b880723b0 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880ab780 con 0x7f1b8806d440 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880c2080 0x7f1b8814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880c2080 0x7f1b8814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40972/0 (socket says 172.21.15.32:40972) 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 -- 172.21.15.32:0/3032122954 learned_addr learned my addr 172.21.15.32:0/3032122954 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b87400640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b880723b0 0x7f1b88154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b87e00640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b8806d440 0x7f1b8814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 -- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b8806d440 msgr2=0x7f1b8814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b8806d440 0x7f1b8814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 -- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b880723b0 msgr2=0x7f1b88154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b880723b0 0x7f1b88154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 -- 172.21.15.32:0/3032122954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780094d0 con 0x7f1b880c2080 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8d000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880c2080 0x7f1b8814e370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b80007e60 tx=0x7f1b8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:04.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b7fe00640 1 -- 172.21.15.32:0/3032122954 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80014420 con 0x7f1b880c2080 2024-01-19T04:15:04.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b7fe00640 1 -- 172.21.15.32:0/3032122954 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b800145a0 con 0x7f1b880c2080 2024-01-19T04:15:04.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b880aba60 con 0x7f1b880c2080 2024-01-19T04:15:04.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b7fe00640 1 -- 172.21.15.32:0/3032122954 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80014950 con 0x7f1b880c2080 2024-01-19T04:15:04.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.844+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88155270 con 0x7f1b880c2080 2024-01-19T04:15:04.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.848+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8814d570 con 0x7f1b880c2080 2024-01-19T04:15:04.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.848+0000 7f1b7fe00640 1 -- 172.21.15.32:0/3032122954 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1b80014ab0 con 0x7f1b880c2080 2024-01-19T04:15:04.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.848+0000 7f1b7fe00640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1b60066500 0x7f1b600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:04.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.848+0000 7f1b7fe00640 1 -- 172.21.15.32:0/3032122954 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b80084680 con 0x7f1b880c2080 2024-01-19T04:15:04.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.848+0000 7f1b87e00640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1b60066500 0x7f1b600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:04.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.852+0000 7f1b87e00640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1b60066500 0x7f1b600689c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b780ad000 tx=0x7f1b780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:04.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:04.852+0000 7f1b7fe00640 1 -- 172.21.15.32:0/3032122954 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1b8814d570 con 0x7f1b880c2080 2024-01-19T04:15:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.044+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1b8814d570 con 0x7f1b880c2080 2024-01-19T04:15:05.229 INFO:tasks.ceph.mds.a.smithi032.stderr:2024-01-19T04:15:05.224+0000 7f9ac8600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:15:05.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b7fe00640 1 -- 172.21.15.32:0/3032122954 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b8814d570 con 0x7f1b880c2080 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1b60066500 msgr2=0x7f1b600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1b60066500 0x7f1b600689c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b780ad000 tx=0x7f1b780a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880c2080 msgr2=0x7f1b8814e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880c2080 0x7f1b8814e370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b80007e60 tx=0x7f1b8000e4b0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 shutdown_connections 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1b60066500 0x7f1b600689c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b880c2080 0x7f1b8814e370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b880723b0 0x7f1b88154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 --2- 172.21.15.32:0/3032122954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1b8806d440 0x7f1b8814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 >> 172.21.15.32:0/3032122954 conn(0x7f1b880c25a0 msgr2=0x7f1b88150510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:05.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 shutdown_connections 2024-01-19T04:15:05.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.664+0000 7f1b8f000640 1 -- 172.21.15.32:0/3032122954 wait complete. 2024-01-19T04:15:05.692 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-19T04:15:05.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:05.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.832+0000 7f2fc9400640 1 Processor -- start 2024-01-19T04:15:05.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc9400640 1 -- start start 2024-01-19T04:15:05.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2fc40c5740 0x7f2fc40c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:05.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc9400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2fc40c1120 0x7f2fc415b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:05.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc9400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40c0c90 con 0x7f2fc40c42b0 2024-01-19T04:15:05.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc9400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc4150f90 con 0x7f2fc40c1120 2024-01-19T04:15:05.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc9400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc4150cb0 con 0x7f2fc40c5740 2024-01-19T04:15:05.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc2800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2fc40c42b0 0x7f2fc406beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35814/0 (socket says 172.21.15.32:35814) 2024-01-19T04:15:05.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc2800640 1 -- 172.21.15.32:0/143081556 learned_addr learned my addr 172.21.15.32:0/143081556 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:05.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc3200640 1 --2- 172.21.15.32:0/143081556 >> v2:172.21.15.32:3300/0 conn(0x7f2fc40c1120 0x7f2fc415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:05.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc1e00640 1 --2- 172.21.15.32:0/143081556 >> v2:172.21.15.67:3300/0 conn(0x7f2fc40c5740 0x7f2fc40c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:05.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc3200640 1 -- 172.21.15.32:0/143081556 >> v2:172.21.15.67:3300/0 conn(0x7f2fc40c5740 msgr2=0x7f2fc40c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:05.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc3200640 1 --2- 172.21.15.32:0/143081556 >> v2:172.21.15.67:3300/0 conn(0x7f2fc40c5740 0x7f2fc40c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc3200640 1 -- 172.21.15.32:0/143081556 >> v1:172.21.15.32:6789/0 conn(0x7f2fc40c42b0 legacy=0x7f2fc406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:05.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc3200640 1 -- 172.21.15.32:0/143081556 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40c0640 con 0x7f2fc40c1120 2024-01-19T04:15:05.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.836+0000 7f2fc1e00640 1 --2- 172.21.15.32:0/143081556 >> v2:172.21.15.67:3300/0 conn(0x7f2fc40c5740 0x7f2fc40c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc3200640 1 --2- 172.21.15.32:0/143081556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c1120 0x7f2fc415b440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4070270 tx=0x7f2fbc01d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f4106848f6356 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc1400640 1 -- 172.21.15.32:0/143081556 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0a5930 con 0x7f2fc40c1120 2024-01-19T04:15:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc1400640 1 -- 172.21.15.32:0/143081556 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0a5a90 con 0x7f2fc40c1120 2024-01-19T04:15:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc1400640 1 -- 172.21.15.32:0/143081556 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0a5e20 con 0x7f2fc40c1120 2024-01-19T04:15:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 -- 172.21.15.32:0/143081556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c1120 msgr2=0x7f2fc415b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 --2- 172.21.15.32:0/143081556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c1120 0x7f2fc415b440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4070270 tx=0x7f2fbc01d2b0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 -- 172.21.15.32:0/143081556 shutdown_connections 2024-01-19T04:15:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 --2- 172.21.15.32:0/143081556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c1120 0x7f2fc415b440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 --2- 172.21.15.32:0/143081556 >> v2:172.21.15.67:3300/0 conn(0x7f2fc40c5740 0x7f2fc40c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 -- 172.21.15.32:0/143081556 >> 172.21.15.32:0/143081556 conn(0x7f2fc40c5b20 msgr2=0x7f2fc40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 -- 172.21.15.32:0/143081556 shutdown_connections 2024-01-19T04:15:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 -- 172.21.15.32:0/143081556 wait complete. 2024-01-19T04:15:05.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 Processor -- start 2024-01-19T04:15:05.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.840+0000 7f2fc9400640 1 -- start start 2024-01-19T04:15:05.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fc40c1120 0x7f2fc4152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:05.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fc40c42b0 0x7f2fc41ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:05.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c5740 0x7f2fc41ea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:05.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc4144a60 con 0x7f2fc40c5740 2024-01-19T04:15:05.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41edc90 con 0x7f2fc40c42b0 2024-01-19T04:15:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41f0bb0 con 0x7f2fc40c1120 2024-01-19T04:15:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c5740 0x7f2fc41ea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c5740 0x7f2fc41ea3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40992/0 (socket says 172.21.15.32:40992) 2024-01-19T04:15:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 -- 172.21.15.32:0/1525435055 learned_addr learned my addr 172.21.15.32:0/1525435055 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc2800640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fc40c1120 0x7f2fc4152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:05.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc1e00640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fc40c42b0 0x7f2fc41ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:05.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 -- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fc40c1120 msgr2=0x7f2fc4152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:05.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fc40c1120 0x7f2fc4152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 -- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fc40c42b0 msgr2=0x7f2fc41ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:05.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fc40c42b0 0x7f2fc41ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:05.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 -- 172.21.15.32:0/1525435055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009a70 con 0x7f2fc40c5740 2024-01-19T04:15:05.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc3200640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c5740 0x7f2fc41ea3b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0b0040 tx=0x7f2fbc0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:05.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fbaa00640 1 -- 172.21.15.32:0/1525435055 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0add90 con 0x7f2fc40c5740 2024-01-19T04:15:05.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fbaa00640 1 -- 172.21.15.32:0/1525435055 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0b8420 con 0x7f2fc40c5740 2024-01-19T04:15:05.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fbaa00640 1 -- 172.21.15.32:0/1525435055 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0b87d0 con 0x7f2fc40c5740 2024-01-19T04:15:05.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc4152ac0 con 0x7f2fc40c5740 2024-01-19T04:15:05.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc41f0560 con 0x7f2fc40c5740 2024-01-19T04:15:05.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.844+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc40749f0 con 0x7f2fc40c5740 2024-01-19T04:15:05.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.848+0000 7f2fbaa00640 1 -- 172.21.15.32:0/1525435055 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2fbc0b4040 con 0x7f2fc40c5740 2024-01-19T04:15:05.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.848+0000 7f2fbaa00640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f9c066500 0x7f2f9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:05.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.848+0000 7f2fbaa00640 1 -- 172.21.15.32:0/1525435055 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fbc11ece0 con 0x7f2fc40c5740 2024-01-19T04:15:05.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.848+0000 7f2fc2800640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f9c066500 0x7f2f9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:05.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.848+0000 7f2fc2800640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f9c066500 0x7f2f9c0689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000f70 tx=0x7f2fb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:05.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:05.852+0000 7f2fbaa00640 1 -- 172.21.15.32:0/1525435055 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2fbc0ec030 con 0x7f2fc40c5740 2024-01-19T04:15:06.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fc41f0cf0 con 0x7f2fc40c5740 2024-01-19T04:15:06.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fbaa00640 1 -- 172.21.15.32:0/1525435055 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f2fbc0ef650 con 0x7f2fc40c5740 2024-01-19T04:15:06.047 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:06.047 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:06.047 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f9c066500 msgr2=0x7f2f9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f9c066500 0x7f2f9c0689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000f70 tx=0x7f2fb4009040 comp rx=0 tx=0).stop 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c5740 msgr2=0x7f2fc41ea3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c5740 0x7f2fc41ea3b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0b0040 tx=0x7f2fbc0195f0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 shutdown_connections 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f9c066500 0x7f2f9c0689c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40c5740 0x7f2fc41ea3b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fc40c42b0 0x7f2fc41ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 --2- 172.21.15.32:0/1525435055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2fc40c1120 0x7f2fc4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 >> 172.21.15.32:0/1525435055 conn(0x7f2fc40c5b20 msgr2=0x7f2fc40c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 shutdown_connections 2024-01-19T04:15:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.044+0000 7f2fc9400640 1 -- 172.21.15.32:0/1525435055 wait complete. 2024-01-19T04:15:06.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:06.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.204+0000 7f4b6ae00640 1 Processor -- start 2024-01-19T04:15:06.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.204+0000 7f4b6ae00640 1 -- start start 2024-01-19T04:15:06.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b6ae00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4b64155060 0x7f4b640c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b6ae00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4b6406fa50 0x7f4b640c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b6ae00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b640c6570 con 0x7f4b640c78d0 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b6ae00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b64155560 con 0x7f4b64155060 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b6ae00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b640c5c40 con 0x7f4b6406fa50 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4b64155060 0x7f4b640c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4b64155060 0x7f4b640c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40998/0 (socket says 172.21.15.32:40998) 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63400640 1 -- 172.21.15.32:0/2844199380 learned_addr learned my addr 172.21.15.32:0/2844199380 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63e00640 1 --1- 172.21.15.32:0/2844199380 >> v1:172.21.15.32:6789/0 conn(0x7f4b640c78d0 0x7f4b640c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35818/0 (socket says 172.21.15.32:35818) 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b68e00640 1 --2- 172.21.15.32:0/2844199380 >> v2:172.21.15.67:3300/0 conn(0x7f4b6406fa50 0x7f4b640c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63400640 1 -- 172.21.15.32:0/2844199380 >> v2:172.21.15.67:3300/0 conn(0x7f4b6406fa50 msgr2=0x7f4b640c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63400640 1 --2- 172.21.15.32:0/2844199380 >> v2:172.21.15.67:3300/0 conn(0x7f4b6406fa50 0x7f4b640c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63400640 1 -- 172.21.15.32:0/2844199380 >> v1:172.21.15.32:6789/0 conn(0x7f4b640c78d0 legacy=0x7f4b640c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.208+0000 7f4b63400640 1 -- 172.21.15.32:0/2844199380 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b640c5f20 con 0x7f4b64155060 2024-01-19T04:15:06.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b63400640 1 --2- 172.21.15.32:0/2844199380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b64155060 0x7f4b640c6a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b64158c70 tx=0x7f4b4c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3866422aa16bde95 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b62a00640 1 -- 172.21.15.32:0/2844199380 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0ab660 con 0x7f4b64155060 2024-01-19T04:15:06.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b62a00640 1 -- 172.21.15.32:0/2844199380 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c0ab7c0 con 0x7f4b64155060 2024-01-19T04:15:06.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b62a00640 1 -- 172.21.15.32:0/2844199380 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0abb50 con 0x7f4b64155060 2024-01-19T04:15:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2844199380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b64155060 msgr2=0x7f4b640c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2844199380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b64155060 0x7f4b640c6a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b64158c70 tx=0x7f4b4c01c440 comp rx=0 tx=0).stop 2024-01-19T04:15:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2844199380 shutdown_connections 2024-01-19T04:15:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2844199380 >> v2:172.21.15.67:3300/0 conn(0x7f4b6406fa50 0x7f4b640c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2844199380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b64155060 0x7f4b640c6a00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2844199380 >> 172.21.15.32:0/2844199380 conn(0x7f4b6406ddb0 msgr2=0x7f4b6406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:06.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2844199380 shutdown_connections 2024-01-19T04:15:06.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2844199380 wait complete. 2024-01-19T04:15:06.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 Processor -- start 2024-01-19T04:15:06.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 -- start start 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.212+0000 7f4b6ae00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b6406fa50 0x7f4b64159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b640c78d0 0x7f4b641eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b64155060 0x7f4b641ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b641596e0 con 0x7f4b640c78d0 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640a6dc0 con 0x7f4b64155060 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b641590d0 con 0x7f4b6406fa50 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b640c78d0 0x7f4b641eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b640c78d0 0x7f4b641eeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41004/0 (socket says 172.21.15.32:41004) 2024-01-19T04:15:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 -- 172.21.15.32:0/2016052617 learned_addr learned my addr 172.21.15.32:0/2016052617 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:06.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b68e00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b64155060 0x7f4b641ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63e00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b6406fa50 0x7f4b64159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 -- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b6406fa50 msgr2=0x7f4b64159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b6406fa50 0x7f4b64159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 -- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b64155060 msgr2=0x7f4b641ed070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b64155060 0x7f4b641ed070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 -- 172.21.15.32:0/2016052617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0094d0 con 0x7f4b640c78d0 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b63400640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b640c78d0 0x7f4b641eeec0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0ad040 tx=0x7f4b4c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b5be00640 1 -- 172.21.15.32:0/2016052617 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0b5810 con 0x7f4b640c78d0 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b5be00640 1 -- 172.21.15.32:0/2016052617 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c0b5990 con 0x7f4b640c78d0 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b641f1190 con 0x7f4b640c78d0 2024-01-19T04:15:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b5be00640 1 -- 172.21.15.32:0/2016052617 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0b5d40 con 0x7f4b640c78d0 2024-01-19T04:15:06.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b641f1470 con 0x7f4b640c78d0 2024-01-19T04:15:06.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b64159540 con 0x7f4b640c78d0 2024-01-19T04:15:06.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.216+0000 7f4b5be00640 1 -- 172.21.15.32:0/2016052617 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4b4c0a9070 con 0x7f4b640c78d0 2024-01-19T04:15:06.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.220+0000 7f4b5be00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4b3c066500 0x7f4b3c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.220+0000 7f4b5be00640 1 -- 172.21.15.32:0/2016052617 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b4c11ea50 con 0x7f4b640c78d0 2024-01-19T04:15:06.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.220+0000 7f4b63e00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4b3c066500 0x7f4b3c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.220+0000 7f4b63e00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4b3c066500 0x7f4b3c0689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b54000f70 tx=0x7f4b54007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.224+0000 7f4b5be00640 1 -- 172.21.15.32:0/2016052617 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4b64159540 con 0x7f4b640c78d0 2024-01-19T04:15:06.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.380+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b64159540 con 0x7f4b640c78d0 2024-01-19T04:15:06.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b5be00640 1 -- 172.21.15.32:0/2016052617 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f4b64159540 con 0x7f4b640c78d0 2024-01-19T04:15:06.386 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:06.386 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4b3c066500 msgr2=0x7f4b3c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4b3c066500 0x7f4b3c0689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b54000f70 tx=0x7f4b54007cd0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b640c78d0 msgr2=0x7f4b641eeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b640c78d0 0x7f4b641eeec0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0ad040 tx=0x7f4b4c0191e0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 shutdown_connections 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4b3c066500 0x7f4b3c0689c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b64155060 0x7f4b641ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b640c78d0 0x7f4b641eeec0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 --2- 172.21.15.32:0/2016052617 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4b6406fa50 0x7f4b64159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 >> 172.21.15.32:0/2016052617 conn(0x7f4b6406ddb0 msgr2=0x7f4b64154630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 shutdown_connections 2024-01-19T04:15:06.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.384+0000 7f4b6ae00640 1 -- 172.21.15.32:0/2016052617 wait complete. 2024-01-19T04:15:06.408 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:15:06.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70df800640 1 Processor -- start 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70df800640 1 -- start start 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70df800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70d814fb50 0x7f70d806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70df800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f70d80a4ec0 0x7f70d815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70df800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d8071e80 con 0x7f70d80c04a0 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70df800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d81535c0 con 0x7f70d80a4ec0 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70df800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d80726c0 con 0x7f70d814fb50 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70dd800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f70d80a4ec0 0x7f70d815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70dd800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f70d80a4ec0 0x7f70d815cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41006/0 (socket says 172.21.15.32:41006) 2024-01-19T04:15:06.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.544+0000 7f70dd800640 1 -- 172.21.15.32:0/1152051752 learned_addr learned my addr 172.21.15.32:0/1152051752 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70dce00640 1 --2- 172.21.15.32:0/1152051752 >> v2:172.21.15.67:3300/0 conn(0x7f70d814fb50 0x7f70d806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70dd800640 1 -- 172.21.15.32:0/1152051752 >> v2:172.21.15.67:3300/0 conn(0x7f70d814fb50 msgr2=0x7f70d806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70dd800640 1 --2- 172.21.15.32:0/1152051752 >> v2:172.21.15.67:3300/0 conn(0x7f70d814fb50 0x7f70d806fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70dd800640 1 -- 172.21.15.32:0/1152051752 >> v1:172.21.15.67:6789/0 conn(0x7f70d80c04a0 legacy=0x7f70d80c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70dd800640 1 -- 172.21.15.32:0/1152051752 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80c0a20 con 0x7f70d80a4ec0 2024-01-19T04:15:06.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70dd800640 1 --2- 172.21.15.32:0/1152051752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80a4ec0 0x7f70d815cf00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70d806f5f0 tx=0x7f70d001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be012f34878252c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70d7400640 1 -- 172.21.15.32:0/1152051752 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00a55c0 con 0x7f70d80a4ec0 2024-01-19T04:15:06.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70d7400640 1 -- 172.21.15.32:0/1152051752 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d00a5720 con 0x7f70d80a4ec0 2024-01-19T04:15:06.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70d7400640 1 -- 172.21.15.32:0/1152051752 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00a5ab0 con 0x7f70d80a4ec0 2024-01-19T04:15:06.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70df800640 1 -- 172.21.15.32:0/1152051752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80a4ec0 msgr2=0x7f70d815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.548+0000 7f70df800640 1 --2- 172.21.15.32:0/1152051752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80a4ec0 0x7f70d815cf00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70d806f5f0 tx=0x7f70d001c900 comp rx=0 tx=0).stop 2024-01-19T04:15:06.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- 172.21.15.32:0/1152051752 shutdown_connections 2024-01-19T04:15:06.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 --2- 172.21.15.32:0/1152051752 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80a4ec0 0x7f70d815cf00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 --2- 172.21.15.32:0/1152051752 >> v2:172.21.15.67:3300/0 conn(0x7f70d814fb50 0x7f70d806fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- 172.21.15.32:0/1152051752 >> 172.21.15.32:0/1152051752 conn(0x7f70d80c5b20 msgr2=0x7f70d80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:06.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- 172.21.15.32:0/1152051752 shutdown_connections 2024-01-19T04:15:06.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- 172.21.15.32:0/1152051752 wait complete. 2024-01-19T04:15:06.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 Processor -- start 2024-01-19T04:15:06.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- start start 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70d80a4ec0 0x7f70d80a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80c04a0 0x7f70d8149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70d814fb50 0x7f70d8154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81543f0 con 0x7f70d80c04a0 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81566c0 con 0x7f70d814fb50 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70df800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81569a0 con 0x7f70d80a4ec0 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80c04a0 0x7f70d8149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80c04a0 0x7f70d8149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41008/0 (socket says 172.21.15.32:41008) 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 -- 172.21.15.32:0/3220596687 learned_addr learned my addr 172.21.15.32:0/3220596687 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70dce00640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70d80a4ec0 0x7f70d80a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70dd800640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70d814fb50 0x7f70d8154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 -- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70d80a4ec0 msgr2=0x7f70d80a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70d80a4ec0 0x7f70d80a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 -- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70d814fb50 msgr2=0x7f70d8154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70d814fb50 0x7f70d8154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.552+0000 7f70d7e00640 1 -- 172.21.15.32:0/3220596687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009b30 con 0x7f70d80c04a0 2024-01-19T04:15:06.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70d7e00640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80c04a0 0x7f70d8149fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c450 tx=0x7f70c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70d4c00640 1 -- 172.21.15.32:0/3220596687 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0012830 con 0x7f70d80c04a0 2024-01-19T04:15:06.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70d4c00640 1 -- 172.21.15.32:0/3220596687 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c00129b0 con 0x7f70d80c04a0 2024-01-19T04:15:06.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d814a970 con 0x7f70d80c04a0 2024-01-19T04:15:06.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70d4c00640 1 -- 172.21.15.32:0/3220596687 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0012d60 con 0x7f70d80c04a0 2024-01-19T04:15:06.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d814af30 con 0x7f70d80c04a0 2024-01-19T04:15:06.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d8149d90 con 0x7f70d80c04a0 2024-01-19T04:15:06.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70d4c00640 1 -- 172.21.15.32:0/3220596687 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f70c001c460 con 0x7f70d80c04a0 2024-01-19T04:15:06.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70d4c00640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f70b0066500 0x7f70b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.556+0000 7f70d4c00640 1 -- 172.21.15.32:0/3220596687 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c0083c90 con 0x7f70d80c04a0 2024-01-19T04:15:06.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.560+0000 7f70dce00640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f70b0066500 0x7f70b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.560+0000 7f70dce00640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f70b0066500 0x7f70b00689c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70c80079c0 tx=0x7f70c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.560+0000 7f70d4c00640 1 -- 172.21.15.32:0/3220596687 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f70c0050f40 con 0x7f70d80c04a0 2024-01-19T04:15:06.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.720+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70d8156b10 con 0x7f70b0066500 2024-01-19T04:15:06.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.728+0000 7f70d4c00640 1 -- 172.21.15.32:0/3220596687 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264657 (secure 0 0 0) 0x7f70d8156b10 con 0x7f70b0066500 2024-01-19T04:15:06.736 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:06.738 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f70b0066500 msgr2=0x7f70b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f70b0066500 0x7f70b00689c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70c80079c0 tx=0x7f70c8008040 comp rx=0 tx=0).stop 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80c04a0 msgr2=0x7f70d8149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80c04a0 0x7f70d8149fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c450 tx=0x7f70c000c910 comp rx=0 tx=0).stop 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 shutdown_connections 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f70b0066500 0x7f70b00689c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70d814fb50 0x7f70d8154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70d80c04a0 0x7f70d8149fd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.732+0000 7f70df800640 1 --2- 172.21.15.32:0/3220596687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f70d80a4ec0 0x7f70d80a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.736+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 >> 172.21.15.32:0/3220596687 conn(0x7f70d80c5b20 msgr2=0x7f70d81503f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:06.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.736+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 shutdown_connections 2024-01-19T04:15:06.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.736+0000 7f70df800640 1 -- 172.21.15.32:0/3220596687 wait complete. 2024-01-19T04:15:06.757 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-01-19T04:15:06.029052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235804,"kb_used_data":2980,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738916,"statfs":{"total":773094113280,"available":772852649984,"internally_reserved":0,"allocated":3051520,"data_stored":1805080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.398678"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793727+0000","last_change":"2024-01-19T04:15:02.673206+0000","last_active":"2024-01-19T04:15:03.793727+0000","last_peered":"2024-01-19T04:15:03.793727+0000","last_clean":"2024-01-19T04:15:03.793727+0000","last_became_active":"2024-01-19T04:15:02.672837+0000","last_became_peered":"2024-01-19T04:15:02.672837+0000","last_unstale":"2024-01-19T04:15:03.793727+0000","last_undegraded":"2024-01-19T04:15:03.793727+0000","last_fullsized":"2024-01-19T04:15:03.793727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793881+0000","last_change":"2024-01-19T04:15:02.660330+0000","last_active":"2024-01-19T04:15:03.793881+0000","last_peered":"2024-01-19T04:15:03.793881+0000","last_clean":"2024-01-19T04:15:03.793881+0000","last_became_active":"2024-01-19T04:15:02.660069+0000","last_became_peered":"2024-01-19T04:15:02.660069+0000","last_unstale":"2024-01-19T04:15:03.793881+0000","last_undegraded":"2024-01-19T04:15:03.793881+0000","last_fullsized":"2024-01-19T04:15:03.793881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793227+0000","last_change":"2024-01-19T04:15:02.671714+0000","last_active":"2024-01-19T04:15:03.793227+0000","last_peered":"2024-01-19T04:15:03.793227+0000","last_clean":"2024-01-19T04:15:03.793227+0000","last_became_active":"2024-01-19T04:15:02.667718+0000","last_became_peered":"2024-01-19T04:15:02.667718+0000","last_unstale":"2024-01-19T04:15:03.793227+0000","last_undegraded":"2024-01-19T04:15:03.793227+0000","last_fullsized":"2024-01-19T04:15:03.793227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793901+0000","last_change":"2024-01-19T04:15:02.683062+0000","last_active":"2024-01-19T04:15:03.793901+0000","last_peered":"2024-01-19T04:15:03.793901+0000","last_clean":"2024-01-19T04:15:03.793901+0000","last_became_active":"2024-01-19T04:15:02.682769+0000","last_became_peered":"2024-01-19T04:15:02.682769+0000","last_unstale":"2024-01-19T04:15:03.793901+0000","last_undegraded":"2024-01-19T04:15:03.793901+0000","last_fullsized":"2024-01-19T04:15:03.793901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794606+0000","last_change":"2024-01-19T04:15:02.675817+0000","last_active":"2024-01-19T04:15:03.794606+0000","last_peered":"2024-01-19T04:15:03.794606+0000","last_clean":"2024-01-19T04:15:03.794606+0000","last_became_active":"2024-01-19T04:15:02.673948+0000","last_became_peered":"2024-01-19T04:15:02.673948+0000","last_unstale":"2024-01-19T04:15:03.794606+0000","last_undegraded":"2024-01-19T04:15:03.794606+0000","last_fullsized":"2024-01-19T04:15:03.794606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793668+0000","last_change":"2024-01-19T04:15:02.680536+0000","last_active":"2024-01-19T04:15:03.793668+0000","last_peered":"2024-01-19T04:15:03.793668+0000","last_clean":"2024-01-19T04:15:03.793668+0000","last_became_active":"2024-01-19T04:15:02.680182+0000","last_became_peered":"2024-01-19T04:15:02.680182+0000","last_unstale":"2024-01-19T04:15:03.793668+0000","last_undegraded":"2024-01-19T04:15:03.793668+0000","last_fullsized":"2024-01-19T04:15:03.793668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:13:26.044664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793083+0000","last_change":"2024-01-19T04:15:02.667084+0000","last_active":"2024-01-19T04:15:03.793083+0000","last_peered":"2024-01-19T04:15:03.793083+0000","last_clean":"2024-01-19T04:15:03.793083+0000","last_became_active":"2024-01-19T04:15:02.666773+0000","last_became_peered":"2024-01-19T04:15:02.666773+0000","last_unstale":"2024-01-19T04:15:03.793083+0000","last_undegraded":"2024-01-19T04:15:03.793083+0000","last_fullsized":"2024-01-19T04:15:03.793083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.685434+0000","last_change":"2024-01-19T04:15:02.681046+0000","last_active":"2024-01-19T04:15:02.685434+0000","last_peered":"2024-01-19T04:15:02.685434+0000","last_clean":"2024-01-19T04:15:02.685434+0000","last_became_active":"2024-01-19T04:15:02.680748+0000","last_became_peered":"2024-01-19T04:15:02.680748+0000","last_unstale":"2024-01-19T04:15:02.685434+0000","last_undegraded":"2024-01-19T04:15:02.685434+0000","last_fullsized":"2024-01-19T04:15:02.685434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:45.165612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793875+0000","last_change":"2024-01-19T04:15:02.686021+0000","last_active":"2024-01-19T04:15:03.793875+0000","last_peered":"2024-01-19T04:15:03.793875+0000","last_clean":"2024-01-19T04:15:03.793875+0000","last_became_active":"2024-01-19T04:15:02.685239+0000","last_became_peered":"2024-01-19T04:15:02.685239+0000","last_unstale":"2024-01-19T04:15:03.793875+0000","last_undegraded":"2024-01-19T04:15:03.793875+0000","last_fullsized":"2024-01-19T04:15:03.793875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793470+0000","last_change":"2024-01-19T04:15:02.685444+0000","last_active":"2024-01-19T04:15:03.793470+0000","last_peered":"2024-01-19T04:15:03.793470+0000","last_clean":"2024-01-19T04:15:03.793470+0000","last_became_active":"2024-01-19T04:15:02.685184+0000","last_became_peered":"2024-01-19T04:15:02.685184+0000","last_unstale":"2024-01-19T04:15:03.793470+0000","last_undegraded":"2024-01-19T04:15:03.793470+0000","last_fullsized":"2024-01-19T04:15:03.793470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794527+0000","last_change":"2024-01-19T04:15:02.686028+0000","last_active":"2024-01-19T04:15:03.794527+0000","last_peered":"2024-01-19T04:15:03.794527+0000","last_clean":"2024-01-19T04:15:03.794527+0000","last_became_active":"2024-01-19T04:15:02.685561+0000","last_became_peered":"2024-01-19T04:15:02.685561+0000","last_unstale":"2024-01-19T04:15:03.794527+0000","last_undegraded":"2024-01-19T04:15:03.794527+0000","last_fullsized":"2024-01-19T04:15:03.794527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663222+0000","last_change":"2024-01-19T04:15:02.671711+0000","last_active":"2024-01-19T04:15:03.663222+0000","last_peered":"2024-01-19T04:15:03.663222+0000","last_clean":"2024-01-19T04:15:03.663222+0000","last_became_active":"2024-01-19T04:15:02.671331+0000","last_became_peered":"2024-01-19T04:15:02.671331+0000","last_unstale":"2024-01-19T04:15:03.663222+0000","last_undegraded":"2024-01-19T04:15:03.663222+0000","last_fullsized":"2024-01-19T04:15:03.663222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:48.803204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.675437+0000","last_change":"2024-01-19T04:15:02.672095+0000","last_active":"2024-01-19T04:15:02.675437+0000","last_peered":"2024-01-19T04:15:02.675437+0000","last_clean":"2024-01-19T04:15:02.675437+0000","last_became_active":"2024-01-19T04:15:02.671811+0000","last_became_peered":"2024-01-19T04:15:02.671811+0000","last_unstale":"2024-01-19T04:15:02.675437+0000","last_undegraded":"2024-01-19T04:15:02.675437+0000","last_fullsized":"2024-01-19T04:15:02.675437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:12:11.568122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792698+0000","last_change":"2024-01-19T04:15:02.659658+0000","last_active":"2024-01-19T04:15:03.792698+0000","last_peered":"2024-01-19T04:15:03.792698+0000","last_clean":"2024-01-19T04:15:03.792698+0000","last_became_active":"2024-01-19T04:15:02.659343+0000","last_became_peered":"2024-01-19T04:15:02.659343+0000","last_unstale":"2024-01-19T04:15:03.792698+0000","last_undegraded":"2024-01-19T04:15:03.792698+0000","last_fullsized":"2024-01-19T04:15:03.792698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:37.529811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793549+0000","last_change":"2024-01-19T04:15:02.661052+0000","last_active":"2024-01-19T04:15:03.793549+0000","last_peered":"2024-01-19T04:15:03.793549+0000","last_clean":"2024-01-19T04:15:03.793549+0000","last_became_active":"2024-01-19T04:15:02.660725+0000","last_became_peered":"2024-01-19T04:15:02.660725+0000","last_unstale":"2024-01-19T04:15:03.793549+0000","last_undegraded":"2024-01-19T04:15:03.793549+0000","last_fullsized":"2024-01-19T04:15:03.793549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794007+0000","last_change":"2024-01-19T04:15:02.674681+0000","last_active":"2024-01-19T04:15:03.794007+0000","last_peered":"2024-01-19T04:15:03.794007+0000","last_clean":"2024-01-19T04:15:03.794007+0000","last_became_active":"2024-01-19T04:15:02.674302+0000","last_became_peered":"2024-01-19T04:15:02.674302+0000","last_unstale":"2024-01-19T04:15:03.794007+0000","last_undegraded":"2024-01-19T04:15:03.794007+0000","last_fullsized":"2024-01-19T04:15:03.794007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794556+0000","last_change":"2024-01-19T04:15:02.680651+0000","last_active":"2024-01-19T04:15:03.794556+0000","last_peered":"2024-01-19T04:15:03.794556+0000","last_clean":"2024-01-19T04:15:03.794556+0000","last_became_active":"2024-01-19T04:15:02.680263+0000","last_became_peered":"2024-01-19T04:15:02.680263+0000","last_unstale":"2024-01-19T04:15:03.794556+0000","last_undegraded":"2024-01-19T04:15:03.794556+0000","last_fullsized":"2024-01-19T04:15:03.794556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661205+0000","last_change":"2024-01-19T04:15:02.669777+0000","last_active":"2024-01-19T04:15:03.661205+0000","last_peered":"2024-01-19T04:15:03.661205+0000","last_clean":"2024-01-19T04:15:03.661205+0000","last_became_active":"2024-01-19T04:15:02.669488+0000","last_became_peered":"2024-01-19T04:15:02.669488+0000","last_unstale":"2024-01-19T04:15:03.661205+0000","last_undegraded":"2024-01-19T04:15:03.661205+0000","last_fullsized":"2024-01-19T04:15:03.661205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:10.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793826+0000","last_change":"2024-01-19T04:15:02.666101+0000","last_active":"2024-01-19T04:15:03.793826+0000","last_peered":"2024-01-19T04:15:03.793826+0000","last_clean":"2024-01-19T04:15:03.793826+0000","last_became_active":"2024-01-19T04:15:02.665664+0000","last_became_peered":"2024-01-19T04:15:02.665664+0000","last_unstale":"2024-01-19T04:15:03.793826+0000","last_undegraded":"2024-01-19T04:15:03.793826+0000","last_fullsized":"2024-01-19T04:15:03.793826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793385+0000","last_change":"2024-01-19T04:15:02.682696+0000","last_active":"2024-01-19T04:15:03.793385+0000","last_peered":"2024-01-19T04:15:03.793385+0000","last_clean":"2024-01-19T04:15:03.793385+0000","last_became_active":"2024-01-19T04:15:02.682337+0000","last_became_peered":"2024-01-19T04:15:02.682337+0000","last_unstale":"2024-01-19T04:15:03.793385+0000","last_undegraded":"2024-01-19T04:15:03.793385+0000","last_fullsized":"2024-01-19T04:15:03.793385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793229+0000","last_change":"2024-01-19T04:15:02.675046+0000","last_active":"2024-01-19T04:15:03.793229+0000","last_peered":"2024-01-19T04:15:03.793229+0000","last_clean":"2024-01-19T04:15:03.793229+0000","last_became_active":"2024-01-19T04:15:02.674569+0000","last_became_peered":"2024-01-19T04:15:02.674569+0000","last_unstale":"2024-01-19T04:15:03.793229+0000","last_undegraded":"2024-01-19T04:15:03.793229+0000","last_fullsized":"2024-01-19T04:15:03.793229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793823+0000","last_change":"2024-01-19T04:15:02.679833+0000","last_active":"2024-01-19T04:15:03.793823+0000","last_peered":"2024-01-19T04:15:03.793823+0000","last_clean":"2024-01-19T04:15:03.793823+0000","last_became_active":"2024-01-19T04:15:02.679450+0000","last_became_peered":"2024-01-19T04:15:02.679450+0000","last_unstale":"2024-01-19T04:15:03.793823+0000","last_undegraded":"2024-01-19T04:15:03.793823+0000","last_fullsized":"2024-01-19T04:15:03.793823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.679751+0000","last_change":"2024-01-19T04:15:02.675672+0000","last_active":"2024-01-19T04:15:02.679751+0000","last_peered":"2024-01-19T04:15:02.679751+0000","last_clean":"2024-01-19T04:15:02.679751+0000","last_became_active":"2024-01-19T04:15:02.668805+0000","last_became_peered":"2024-01-19T04:15:02.668805+0000","last_unstale":"2024-01-19T04:15:02.679751+0000","last_undegraded":"2024-01-19T04:15:02.679751+0000","last_fullsized":"2024-01-19T04:15:02.679751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:44.185890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794204+0000","last_change":"2024-01-19T04:15:02.679845+0000","last_active":"2024-01-19T04:15:03.794204+0000","last_peered":"2024-01-19T04:15:03.794204+0000","last_clean":"2024-01-19T04:15:03.794204+0000","last_became_active":"2024-01-19T04:15:02.679512+0000","last_became_peered":"2024-01-19T04:15:02.679512+0000","last_unstale":"2024-01-19T04:15:03.794204+0000","last_undegraded":"2024-01-19T04:15:03.794204+0000","last_fullsized":"2024-01-19T04:15:03.794204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.670076+0000","last_change":"2024-01-19T04:15:02.668029+0000","last_active":"2024-01-19T04:15:02.670076+0000","last_peered":"2024-01-19T04:15:02.670076+0000","last_clean":"2024-01-19T04:15:02.670076+0000","last_became_active":"2024-01-19T04:15:02.667742+0000","last_became_peered":"2024-01-19T04:15:02.667742+0000","last_unstale":"2024-01-19T04:15:02.670076+0000","last_undegraded":"2024-01-19T04:15:02.670076+0000","last_fullsized":"2024-01-19T04:15:02.670076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:41:18.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793620+0000","last_change":"2024-01-19T04:15:02.684316+0000","last_active":"2024-01-19T04:15:03.793620+0000","last_peered":"2024-01-19T04:15:03.793620+0000","last_clean":"2024-01-19T04:15:03.793620+0000","last_became_active":"2024-01-19T04:15:02.681947+0000","last_became_peered":"2024-01-19T04:15:02.681947+0000","last_unstale":"2024-01-19T04:15:03.793620+0000","last_undegraded":"2024-01-19T04:15:03.793620+0000","last_fullsized":"2024-01-19T04:15:03.793620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793691+0000","last_change":"2024-01-19T04:15:02.672775+0000","last_active":"2024-01-19T04:15:03.793691+0000","last_peered":"2024-01-19T04:15:03.793691+0000","last_clean":"2024-01-19T04:15:03.793691+0000","last_became_active":"2024-01-19T04:15:02.672561+0000","last_became_peered":"2024-01-19T04:15:02.672561+0000","last_unstale":"2024-01-19T04:15:03.793691+0000","last_undegraded":"2024-01-19T04:15:03.793691+0000","last_fullsized":"2024-01-19T04:15:03.793691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.665140+0000","last_change":"2024-01-19T04:15:02.661526+0000","last_active":"2024-01-19T04:15:02.665140+0000","last_peered":"2024-01-19T04:15:02.665140+0000","last_clean":"2024-01-19T04:15:02.665140+0000","last_became_active":"2024-01-19T04:15:02.661278+0000","last_became_peered":"2024-01-19T04:15:02.661278+0000","last_unstale":"2024-01-19T04:15:02.665140+0000","last_undegraded":"2024-01-19T04:15:02.665140+0000","last_fullsized":"2024-01-19T04:15:02.665140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:44:12.189687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793056+0000","last_change":"2024-01-19T04:15:02.660175+0000","last_active":"2024-01-19T04:15:03.793056+0000","last_peered":"2024-01-19T04:15:03.793056+0000","last_clean":"2024-01-19T04:15:03.793056+0000","last_became_active":"2024-01-19T04:15:02.659887+0000","last_became_peered":"2024-01-19T04:15:02.659887+0000","last_unstale":"2024-01-19T04:15:03.793056+0000","last_undegraded":"2024-01-19T04:15:03.793056+0000","last_fullsized":"2024-01-19T04:15:03.793056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.796302+0000","last_change":"2024-01-19T04:15:02.680673+0000","last_active":"2024-01-19T04:15:03.796302+0000","last_peered":"2024-01-19T04:15:03.796302+0000","last_clean":"2024-01-19T04:15:03.796302+0000","last_became_active":"2024-01-19T04:15:02.679966+0000","last_became_peered":"2024-01-19T04:15:02.679966+0000","last_unstale":"2024-01-19T04:15:03.796302+0000","last_undegraded":"2024-01-19T04:15:03.796302+0000","last_fullsized":"2024-01-19T04:15:03.796302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661036+0000","last_change":"2024-01-19T04:15:02.684219+0000","last_active":"2024-01-19T04:15:03.661036+0000","last_peered":"2024-01-19T04:15:03.661036+0000","last_clean":"2024-01-19T04:15:03.661036+0000","last_became_active":"2024-01-19T04:15:02.683973+0000","last_became_peered":"2024-01-19T04:15:02.683973+0000","last_unstale":"2024-01-19T04:15:03.661036+0000","last_undegraded":"2024-01-19T04:15:03.661036+0000","last_fullsized":"2024-01-19T04:15:03.661036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793375+0000","last_change":"2024-01-19T04:15:02.682448+0000","last_active":"2024-01-19T04:15:03.793375+0000","last_peered":"2024-01-19T04:15:03.793375+0000","last_clean":"2024-01-19T04:15:03.793375+0000","last_became_active":"2024-01-19T04:15:02.673199+0000","last_became_peered":"2024-01-19T04:15:02.673199+0000","last_unstale":"2024-01-19T04:15:03.793375+0000","last_undegraded":"2024-01-19T04:15:03.793375+0000","last_fullsized":"2024-01-19T04:15:03.793375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.662776+0000","last_change":"2024-01-19T04:15:02.661774+0000","last_active":"2024-01-19T04:15:03.662776+0000","last_peered":"2024-01-19T04:15:03.662776+0000","last_clean":"2024-01-19T04:15:03.662776+0000","last_became_active":"2024-01-19T04:15:02.661479+0000","last_became_peered":"2024-01-19T04:15:02.661479+0000","last_unstale":"2024-01-19T04:15:03.662776+0000","last_undegraded":"2024-01-19T04:15:03.662776+0000","last_fullsized":"2024-01-19T04:15:03.662776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:45.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.693344+0000","last_change":"2024-01-19T04:15:01.664062+0000","last_active":"2024-01-19T04:15:02.693344+0000","last_peered":"2024-01-19T04:15:02.693344+0000","last_clean":"2024-01-19T04:15:02.693344+0000","last_became_active":"2024-01-19T04:15:01.663666+0000","last_became_peered":"2024-01-19T04:15:01.663666+0000","last_unstale":"2024-01-19T04:15:02.693344+0000","last_undegraded":"2024-01-19T04:15:02.693344+0000","last_fullsized":"2024-01-19T04:15:02.693344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:26.787644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793174+0000","last_change":"2024-01-19T04:15:02.664100+0000","last_active":"2024-01-19T04:15:03.793174+0000","last_peered":"2024-01-19T04:15:03.793174+0000","last_clean":"2024-01-19T04:15:03.793174+0000","last_became_active":"2024-01-19T04:15:02.663834+0000","last_became_peered":"2024-01-19T04:15:02.663834+0000","last_unstale":"2024-01-19T04:15:03.793174+0000","last_undegraded":"2024-01-19T04:15:03.793174+0000","last_fullsized":"2024-01-19T04:15:03.793174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793267+0000","last_change":"2024-01-19T04:15:01.663996+0000","last_active":"2024-01-19T04:15:03.793267+0000","last_peered":"2024-01-19T04:15:03.793267+0000","last_clean":"2024-01-19T04:15:03.793267+0000","last_became_active":"2024-01-19T04:15:01.663681+0000","last_became_peered":"2024-01-19T04:15:01.663681+0000","last_unstale":"2024-01-19T04:15:03.793267+0000","last_undegraded":"2024-01-19T04:15:03.793267+0000","last_fullsized":"2024-01-19T04:15:03.793267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.653659+0000","last_change":"2024-01-19T04:15:01.656029+0000","last_active":"2024-01-19T04:15:02.653659+0000","last_peered":"2024-01-19T04:15:02.653659+0000","last_clean":"2024-01-19T04:15:02.653659+0000","last_became_active":"2024-01-19T04:15:01.655545+0000","last_became_peered":"2024-01-19T04:15:01.655545+0000","last_unstale":"2024-01-19T04:15:02.653659+0000","last_undegraded":"2024-01-19T04:15:02.653659+0000","last_fullsized":"2024-01-19T04:15:02.653659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:14:53.257377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.665892+0000","last_change":"2024-01-19T04:15:02.662372+0000","last_active":"2024-01-19T04:15:02.665892+0000","last_peered":"2024-01-19T04:15:02.665892+0000","last_clean":"2024-01-19T04:15:02.665892+0000","last_became_active":"2024-01-19T04:15:02.662169+0000","last_became_peered":"2024-01-19T04:15:02.662169+0000","last_unstale":"2024-01-19T04:15:02.665892+0000","last_undegraded":"2024-01-19T04:15:02.665892+0000","last_fullsized":"2024-01-19T04:15:02.665892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:54:28.197250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794296+0000","last_change":"2024-01-19T04:15:01.654399+0000","last_active":"2024-01-19T04:15:03.794296+0000","last_peered":"2024-01-19T04:15:03.794296+0000","last_clean":"2024-01-19T04:15:03.794296+0000","last_became_active":"2024-01-19T04:15:01.652845+0000","last_became_peered":"2024-01-19T04:15:01.652845+0000","last_unstale":"2024-01-19T04:15:03.794296+0000","last_undegraded":"2024-01-19T04:15:03.794296+0000","last_fullsized":"2024-01-19T04:15:03.794296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793429+0000","last_change":"2024-01-19T04:15:02.655914+0000","last_active":"2024-01-19T04:15:03.793429+0000","last_peered":"2024-01-19T04:15:03.793429+0000","last_clean":"2024-01-19T04:15:03.793429+0000","last_became_active":"2024-01-19T04:15:02.655614+0000","last_became_peered":"2024-01-19T04:15:02.655614+0000","last_unstale":"2024-01-19T04:15:03.793429+0000","last_undegraded":"2024-01-19T04:15:03.793429+0000","last_fullsized":"2024-01-19T04:15:03.793429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793903+0000","last_change":"2024-01-19T04:15:01.659225+0000","last_active":"2024-01-19T04:15:03.793903+0000","last_peered":"2024-01-19T04:15:03.793903+0000","last_clean":"2024-01-19T04:15:03.793903+0000","last_became_active":"2024-01-19T04:15:01.658937+0000","last_became_peered":"2024-01-19T04:15:01.658937+0000","last_unstale":"2024-01-19T04:15:03.793903+0000","last_undegraded":"2024-01-19T04:15:03.793903+0000","last_fullsized":"2024-01-19T04:15:03.793903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793665+0000","last_change":"2024-01-19T04:15:02.679479+0000","last_active":"2024-01-19T04:15:03.793665+0000","last_peered":"2024-01-19T04:15:03.793665+0000","last_clean":"2024-01-19T04:15:03.793665+0000","last_became_active":"2024-01-19T04:15:02.678631+0000","last_became_peered":"2024-01-19T04:15:02.678631+0000","last_unstale":"2024-01-19T04:15:03.793665+0000","last_undegraded":"2024-01-19T04:15:03.793665+0000","last_fullsized":"2024-01-19T04:15:03.793665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793772+0000","last_change":"2024-01-19T04:15:01.657478+0000","last_active":"2024-01-19T04:15:03.793772+0000","last_peered":"2024-01-19T04:15:03.793772+0000","last_clean":"2024-01-19T04:15:03.793772+0000","last_became_active":"2024-01-19T04:15:01.654337+0000","last_became_peered":"2024-01-19T04:15:01.654337+0000","last_unstale":"2024-01-19T04:15:03.793772+0000","last_undegraded":"2024-01-19T04:15:03.793772+0000","last_fullsized":"2024-01-19T04:15:03.793772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793644+0000","last_change":"2024-01-19T04:15:02.684918+0000","last_active":"2024-01-19T04:15:03.793644+0000","last_peered":"2024-01-19T04:15:03.793644+0000","last_clean":"2024-01-19T04:15:03.793644+0000","last_became_active":"2024-01-19T04:15:02.684209+0000","last_became_peered":"2024-01-19T04:15:02.684209+0000","last_unstale":"2024-01-19T04:15:03.793644+0000","last_undegraded":"2024-01-19T04:15:03.793644+0000","last_fullsized":"2024-01-19T04:15:03.793644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793630+0000","last_change":"2024-01-19T04:15:01.649235+0000","last_active":"2024-01-19T04:15:03.793630+0000","last_peered":"2024-01-19T04:15:03.793630+0000","last_clean":"2024-01-19T04:15:03.793630+0000","last_became_active":"2024-01-19T04:15:01.648890+0000","last_became_peered":"2024-01-19T04:15:01.648890+0000","last_unstale":"2024-01-19T04:15:03.793630+0000","last_undegraded":"2024-01-19T04:15:03.793630+0000","last_fullsized":"2024-01-19T04:15:03.793630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663313+0000","last_change":"2024-01-19T04:15:02.666858+0000","last_active":"2024-01-19T04:15:03.663313+0000","last_peered":"2024-01-19T04:15:03.663313+0000","last_clean":"2024-01-19T04:15:03.663313+0000","last_became_active":"2024-01-19T04:15:02.666581+0000","last_became_peered":"2024-01-19T04:15:02.666581+0000","last_unstale":"2024-01-19T04:15:03.663313+0000","last_undegraded":"2024-01-19T04:15:03.663313+0000","last_fullsized":"2024-01-19T04:15:03.663313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794002+0000","last_change":"2024-01-19T04:15:01.652327+0000","last_active":"2024-01-19T04:15:03.794002+0000","last_peered":"2024-01-19T04:15:03.794002+0000","last_clean":"2024-01-19T04:15:03.794002+0000","last_became_active":"2024-01-19T04:15:01.651986+0000","last_became_peered":"2024-01-19T04:15:01.651986+0000","last_unstale":"2024-01-19T04:15:03.794002+0000","last_undegraded":"2024-01-19T04:15:03.794002+0000","last_fullsized":"2024-01-19T04:15:03.794002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:02.668704+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:02.668254+0000","last_became_peered":"2024-01-19T04:15:02.668254+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793263+0000","last_change":"2024-01-19T04:15:01.656572+0000","last_active":"2024-01-19T04:15:03.793263+0000","last_peered":"2024-01-19T04:15:03.793263+0000","last_clean":"2024-01-19T04:15:03.793263+0000","last_became_active":"2024-01-19T04:15:01.655927+0000","last_became_peered":"2024-01-19T04:15:01.655927+0000","last_unstale":"2024-01-19T04:15:03.793263+0000","last_undegraded":"2024-01-19T04:15:03.793263+0000","last_fullsized":"2024-01-19T04:15:03.793263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:10:35.666423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792925+0000","last_change":"2024-01-19T04:15:02.665136+0000","last_active":"2024-01-19T04:15:03.792925+0000","last_peered":"2024-01-19T04:15:03.792925+0000","last_clean":"2024-01-19T04:15:03.792925+0000","last_became_active":"2024-01-19T04:15:02.659894+0000","last_became_peered":"2024-01-19T04:15:02.659894+0000","last_unstale":"2024-01-19T04:15:03.792925+0000","last_undegraded":"2024-01-19T04:15:03.792925+0000","last_fullsized":"2024-01-19T04:15:03.792925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:15.849417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794290+0000","last_change":"2024-01-19T04:15:01.656361+0000","last_active":"2024-01-19T04:15:03.794290+0000","last_peered":"2024-01-19T04:15:03.794290+0000","last_clean":"2024-01-19T04:15:03.794290+0000","last_became_active":"2024-01-19T04:15:01.655933+0000","last_became_peered":"2024-01-19T04:15:01.655933+0000","last_unstale":"2024-01-19T04:15:03.794290+0000","last_undegraded":"2024-01-19T04:15:03.794290+0000","last_fullsized":"2024-01-19T04:15:03.794290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794647+0000","last_change":"2024-01-19T04:15:02.675994+0000","last_active":"2024-01-19T04:15:03.794647+0000","last_peered":"2024-01-19T04:15:03.794647+0000","last_clean":"2024-01-19T04:15:03.794647+0000","last_became_active":"2024-01-19T04:15:02.673959+0000","last_became_peered":"2024-01-19T04:15:02.673959+0000","last_unstale":"2024-01-19T04:15:03.794647+0000","last_undegraded":"2024-01-19T04:15:03.794647+0000","last_fullsized":"2024-01-19T04:15:03.794647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:22.472681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794344+0000","last_change":"2024-01-19T04:15:01.661165+0000","last_active":"2024-01-19T04:15:03.794344+0000","last_peered":"2024-01-19T04:15:03.794344+0000","last_clean":"2024-01-19T04:15:03.794344+0000","last_became_active":"2024-01-19T04:15:01.656873+0000","last_became_peered":"2024-01-19T04:15:01.656873+0000","last_unstale":"2024-01-19T04:15:03.794344+0000","last_undegraded":"2024-01-19T04:15:03.794344+0000","last_fullsized":"2024-01-19T04:15:03.794344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793545+0000","last_change":"2024-01-19T04:15:02.682133+0000","last_active":"2024-01-19T04:15:03.793545+0000","last_peered":"2024-01-19T04:15:03.793545+0000","last_clean":"2024-01-19T04:15:03.793545+0000","last_became_active":"2024-01-19T04:15:02.672918+0000","last_became_peered":"2024-01-19T04:15:02.672918+0000","last_unstale":"2024-01-19T04:15:03.793545+0000","last_undegraded":"2024-01-19T04:15:03.793545+0000","last_fullsized":"2024-01-19T04:15:03.793545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.660994+0000","last_change":"2024-01-19T04:15:01.660206+0000","last_active":"2024-01-19T04:15:03.660994+0000","last_peered":"2024-01-19T04:15:03.660994+0000","last_clean":"2024-01-19T04:15:03.660994+0000","last_became_active":"2024-01-19T04:15:01.659875+0000","last_became_peered":"2024-01-19T04:15:01.659875+0000","last_unstale":"2024-01-19T04:15:03.660994+0000","last_undegraded":"2024-01-19T04:15:03.660994+0000","last_fullsized":"2024-01-19T04:15:03.660994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793220+0000","last_change":"2024-01-19T04:15:02.668873+0000","last_active":"2024-01-19T04:15:03.793220+0000","last_peered":"2024-01-19T04:15:03.793220+0000","last_clean":"2024-01-19T04:15:03.793220+0000","last_became_active":"2024-01-19T04:15:02.668553+0000","last_became_peered":"2024-01-19T04:15:02.668553+0000","last_unstale":"2024-01-19T04:15:03.793220+0000","last_undegraded":"2024-01-19T04:15:03.793220+0000","last_fullsized":"2024-01-19T04:15:03.793220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663364+0000","last_change":"2024-01-19T04:15:01.661192+0000","last_active":"2024-01-19T04:15:03.663364+0000","last_peered":"2024-01-19T04:15:03.663364+0000","last_clean":"2024-01-19T04:15:03.663364+0000","last_became_active":"2024-01-19T04:15:01.660673+0000","last_became_peered":"2024-01-19T04:15:01.660673+0000","last_unstale":"2024-01-19T04:15:03.663364+0000","last_undegraded":"2024-01-19T04:15:03.663364+0000","last_fullsized":"2024-01-19T04:15:03.663364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:16.106132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794632+0000","last_change":"2024-01-19T04:15:02.670249+0000","last_active":"2024-01-19T04:15:03.794632+0000","last_peered":"2024-01-19T04:15:03.794632+0000","last_clean":"2024-01-19T04:15:03.794632+0000","last_became_active":"2024-01-19T04:15:02.669945+0000","last_became_peered":"2024-01-19T04:15:02.669945+0000","last_unstale":"2024-01-19T04:15:03.794632+0000","last_undegraded":"2024-01-19T04:15:03.794632+0000","last_fullsized":"2024-01-19T04:15:03.794632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661228+0000","last_change":"2024-01-19T04:15:01.651897+0000","last_active":"2024-01-19T04:15:03.661228+0000","last_peered":"2024-01-19T04:15:03.661228+0000","last_clean":"2024-01-19T04:15:03.661228+0000","last_became_active":"2024-01-19T04:15:01.651557+0000","last_became_peered":"2024-01-19T04:15:01.651557+0000","last_unstale":"2024-01-19T04:15:03.661228+0000","last_undegraded":"2024-01-19T04:15:03.661228+0000","last_fullsized":"2024-01-19T04:15:03.661228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794447+0000","last_change":"2024-01-19T04:15:02.676980+0000","last_active":"2024-01-19T04:15:03.794447+0000","last_peered":"2024-01-19T04:15:03.794447+0000","last_clean":"2024-01-19T04:15:03.794447+0000","last_became_active":"2024-01-19T04:15:02.676586+0000","last_became_peered":"2024-01-19T04:15:02.676586+0000","last_unstale":"2024-01-19T04:15:03.794447+0000","last_undegraded":"2024-01-19T04:15:03.794447+0000","last_fullsized":"2024-01-19T04:15:03.794447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793684+0000","last_change":"2024-01-19T04:15:01.660626+0000","last_active":"2024-01-19T04:15:03.793684+0000","last_peered":"2024-01-19T04:15:03.793684+0000","last_clean":"2024-01-19T04:15:03.793684+0000","last_became_active":"2024-01-19T04:15:01.660299+0000","last_became_peered":"2024-01-19T04:15:01.660299+0000","last_unstale":"2024-01-19T04:15:03.793684+0000","last_undegraded":"2024-01-19T04:15:03.793684+0000","last_fullsized":"2024-01-19T04:15:03.793684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794140+0000","last_change":"2024-01-19T04:15:02.689947+0000","last_active":"2024-01-19T04:15:03.794140+0000","last_peered":"2024-01-19T04:15:03.794140+0000","last_clean":"2024-01-19T04:15:03.794140+0000","last_became_active":"2024-01-19T04:15:02.689658+0000","last_became_peered":"2024-01-19T04:15:02.689658+0000","last_unstale":"2024-01-19T04:15:03.794140+0000","last_undegraded":"2024-01-19T04:15:03.794140+0000","last_fullsized":"2024-01-19T04:15:03.794140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661163+0000","last_change":"2024-01-19T04:15:01.659005+0000","last_active":"2024-01-19T04:15:03.661163+0000","last_peered":"2024-01-19T04:15:03.661163+0000","last_clean":"2024-01-19T04:15:03.661163+0000","last_became_active":"2024-01-19T04:15:01.658686+0000","last_became_peered":"2024-01-19T04:15:01.658686+0000","last_unstale":"2024-01-19T04:15:03.661163+0000","last_undegraded":"2024-01-19T04:15:03.661163+0000","last_fullsized":"2024-01-19T04:15:03.661163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793563+0000","last_change":"2024-01-19T04:15:02.682480+0000","last_active":"2024-01-19T04:15:03.793563+0000","last_peered":"2024-01-19T04:15:03.793563+0000","last_clean":"2024-01-19T04:15:03.793563+0000","last_became_active":"2024-01-19T04:15:02.681651+0000","last_became_peered":"2024-01-19T04:15:02.681651+0000","last_unstale":"2024-01-19T04:15:03.793563+0000","last_undegraded":"2024-01-19T04:15:03.793563+0000","last_fullsized":"2024-01-19T04:15:03.793563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.655130+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:02.655130+0000","last_peered":"2024-01-19T04:15:02.655130+0000","last_clean":"2024-01-19T04:15:02.655130+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:02.655130+0000","last_undegraded":"2024-01-19T04:15:02.655130+0000","last_fullsized":"2024-01-19T04:15:02.655130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793217+0000","last_change":"2024-01-19T04:15:01.653219+0000","last_active":"2024-01-19T04:15:03.793217+0000","last_peered":"2024-01-19T04:15:03.793217+0000","last_clean":"2024-01-19T04:15:03.793217+0000","last_became_active":"2024-01-19T04:15:01.651102+0000","last_became_peered":"2024-01-19T04:15:01.651102+0000","last_unstale":"2024-01-19T04:15:03.793217+0000","last_undegraded":"2024-01-19T04:15:03.793217+0000","last_fullsized":"2024-01-19T04:15:03.793217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.685553+0000","last_change":"2024-01-19T04:15:02.682206+0000","last_active":"2024-01-19T04:15:02.685553+0000","last_peered":"2024-01-19T04:15:02.685553+0000","last_clean":"2024-01-19T04:15:02.685553+0000","last_became_active":"2024-01-19T04:15:02.681769+0000","last_became_peered":"2024-01-19T04:15:02.681769+0000","last_unstale":"2024-01-19T04:15:02.685553+0000","last_undegraded":"2024-01-19T04:15:02.685553+0000","last_fullsized":"2024-01-19T04:15:02.685553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.437963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:01.662658+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:01.662354+0000","last_became_peered":"2024-01-19T04:15:01.662354+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792635+0000","last_change":"2024-01-19T04:15:02.663011+0000","last_active":"2024-01-19T04:15:03.792635+0000","last_peered":"2024-01-19T04:15:03.792635+0000","last_clean":"2024-01-19T04:15:03.792635+0000","last_became_active":"2024-01-19T04:15:02.661355+0000","last_became_peered":"2024-01-19T04:15:02.661355+0000","last_unstale":"2024-01-19T04:15:03.792635+0000","last_undegraded":"2024-01-19T04:15:03.792635+0000","last_fullsized":"2024-01-19T04:15:03.792635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:28:40.149191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661294+0000","last_change":"2024-01-19T04:15:01.656500+0000","last_active":"2024-01-19T04:15:03.661294+0000","last_peered":"2024-01-19T04:15:03.661294+0000","last_clean":"2024-01-19T04:15:03.661294+0000","last_became_active":"2024-01-19T04:15:01.654782+0000","last_became_peered":"2024-01-19T04:15:01.654782+0000","last_unstale":"2024-01-19T04:15:03.661294+0000","last_undegraded":"2024-01-19T04:15:03.661294+0000","last_fullsized":"2024-01-19T04:15:03.661294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793289+0000","last_change":"2024-01-19T04:15:02.663704+0000","last_active":"2024-01-19T04:15:03.793289+0000","last_peered":"2024-01-19T04:15:03.793289+0000","last_clean":"2024-01-19T04:15:03.793289+0000","last_became_active":"2024-01-19T04:15:02.663466+0000","last_became_peered":"2024-01-19T04:15:02.663466+0000","last_unstale":"2024-01-19T04:15:03.793289+0000","last_undegraded":"2024-01-19T04:15:03.793289+0000","last_fullsized":"2024-01-19T04:15:03.793289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:01.649482+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:01.649196+0000","last_became_peered":"2024-01-19T04:15:01.649196+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663035+0000","last_change":"2024-01-19T04:15:02.666162+0000","last_active":"2024-01-19T04:15:03.663035+0000","last_peered":"2024-01-19T04:15:03.663035+0000","last_clean":"2024-01-19T04:15:03.663035+0000","last_became_active":"2024-01-19T04:15:02.664211+0000","last_became_peered":"2024-01-19T04:15:02.664211+0000","last_unstale":"2024-01-19T04:15:03.663035+0000","last_undegraded":"2024-01-19T04:15:03.663035+0000","last_fullsized":"2024-01-19T04:15:03.663035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:20.226272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:01.661604+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:01.661344+0000","last_became_peered":"2024-01-19T04:15:01.661344+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:02.678390+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:02.678101+0000","last_became_peered":"2024-01-19T04:15:02.678101+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793948+0000","last_change":"2024-01-19T04:15:01.666935+0000","last_active":"2024-01-19T04:15:03.793948+0000","last_peered":"2024-01-19T04:15:03.793948+0000","last_clean":"2024-01-19T04:15:03.793948+0000","last_became_active":"2024-01-19T04:15:01.666614+0000","last_became_peered":"2024-01-19T04:15:01.666614+0000","last_unstale":"2024-01-19T04:15:03.793948+0000","last_undegraded":"2024-01-19T04:15:03.793948+0000","last_fullsized":"2024-01-19T04:15:03.793948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793500+0000","last_change":"2024-01-19T04:15:02.670747+0000","last_active":"2024-01-19T04:15:03.793500+0000","last_peered":"2024-01-19T04:15:03.793500+0000","last_clean":"2024-01-19T04:15:03.793500+0000","last_became_active":"2024-01-19T04:15:02.670497+0000","last_became_peered":"2024-01-19T04:15:02.670497+0000","last_unstale":"2024-01-19T04:15:03.793500+0000","last_undegraded":"2024-01-19T04:15:03.793500+0000","last_fullsized":"2024-01-19T04:15:03.793500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793865+0000","last_change":"2024-01-19T04:15:01.655738+0000","last_active":"2024-01-19T04:15:03.793865+0000","last_peered":"2024-01-19T04:15:03.793865+0000","last_clean":"2024-01-19T04:15:03.793865+0000","last_became_active":"2024-01-19T04:15:01.655435+0000","last_became_peered":"2024-01-19T04:15:01.655435+0000","last_unstale":"2024-01-19T04:15:03.793865+0000","last_undegraded":"2024-01-19T04:15:03.793865+0000","last_fullsized":"2024-01-19T04:15:03.793865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.683746+0000","last_change":"2024-01-19T04:15:02.676099+0000","last_active":"2024-01-19T04:15:02.683746+0000","last_peered":"2024-01-19T04:15:02.683746+0000","last_clean":"2024-01-19T04:15:02.683746+0000","last_became_active":"2024-01-19T04:15:02.675858+0000","last_became_peered":"2024-01-19T04:15:02.675858+0000","last_unstale":"2024-01-19T04:15:02.683746+0000","last_undegraded":"2024-01-19T04:15:02.683746+0000","last_fullsized":"2024-01-19T04:15:02.683746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:49.255283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794005+0000","last_change":"2024-01-19T04:15:01.664964+0000","last_active":"2024-01-19T04:15:03.794005+0000","last_peered":"2024-01-19T04:15:03.794005+0000","last_clean":"2024-01-19T04:15:03.794005+0000","last_became_active":"2024-01-19T04:15:01.664666+0000","last_became_peered":"2024-01-19T04:15:01.664666+0000","last_unstale":"2024-01-19T04:15:03.794005+0000","last_undegraded":"2024-01-19T04:15:03.794005+0000","last_fullsized":"2024-01-19T04:15:03.794005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:02.655983+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:02.655720+0000","last_became_peered":"2024-01-19T04:15:02.655720+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:01.663296+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:01.663010+0000","last_became_peered":"2024-01-19T04:15:01.663010+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663043+0000","last_change":"2024-01-19T04:15:02.662528+0000","last_active":"2024-01-19T04:15:03.663043+0000","last_peered":"2024-01-19T04:15:03.663043+0000","last_clean":"2024-01-19T04:15:03.663043+0000","last_became_active":"2024-01-19T04:15:02.661397+0000","last_became_peered":"2024-01-19T04:15:02.661397+0000","last_unstale":"2024-01-19T04:15:03.663043+0000","last_undegraded":"2024-01-19T04:15:03.663043+0000","last_fullsized":"2024-01-19T04:15:03.663043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:21.142628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793634+0000","last_change":"2024-01-19T04:15:01.664514+0000","last_active":"2024-01-19T04:15:03.793634+0000","last_peered":"2024-01-19T04:15:03.793634+0000","last_clean":"2024-01-19T04:15:03.793634+0000","last_became_active":"2024-01-19T04:15:01.662668+0000","last_became_peered":"2024-01-19T04:15:01.662668+0000","last_unstale":"2024-01-19T04:15:03.793634+0000","last_undegraded":"2024-01-19T04:15:03.793634+0000","last_fullsized":"2024-01-19T04:15:03.793634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.671419+0000","last_change":"2024-01-19T04:15:02.663292+0000","last_active":"2024-01-19T04:15:02.671419+0000","last_peered":"2024-01-19T04:15:02.671419+0000","last_clean":"2024-01-19T04:15:02.671419+0000","last_became_active":"2024-01-19T04:15:02.663012+0000","last_became_peered":"2024-01-19T04:15:02.663012+0000","last_unstale":"2024-01-19T04:15:02.671419+0000","last_undegraded":"2024-01-19T04:15:02.671419+0000","last_fullsized":"2024-01-19T04:15:02.671419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:09.478479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793469+0000","last_change":"2024-01-19T04:15:01.652378+0000","last_active":"2024-01-19T04:15:03.793469+0000","last_peered":"2024-01-19T04:15:03.793469+0000","last_clean":"2024-01-19T04:15:03.793469+0000","last_became_active":"2024-01-19T04:15:01.652057+0000","last_became_peered":"2024-01-19T04:15:01.652057+0000","last_unstale":"2024-01-19T04:15:03.793469+0000","last_undegraded":"2024-01-19T04:15:03.793469+0000","last_fullsized":"2024-01-19T04:15:03.793469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.675417+0000","last_change":"2024-01-19T04:15:02.669867+0000","last_active":"2024-01-19T04:15:02.675417+0000","last_peered":"2024-01-19T04:15:02.675417+0000","last_clean":"2024-01-19T04:15:02.675417+0000","last_became_active":"2024-01-19T04:15:02.669483+0000","last_became_peered":"2024-01-19T04:15:02.669483+0000","last_unstale":"2024-01-19T04:15:02.675417+0000","last_undegraded":"2024-01-19T04:15:02.675417+0000","last_fullsized":"2024-01-19T04:15:02.675417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:15:00.270142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794715+0000","last_change":"2024-01-19T04:15:01.664685+0000","last_active":"2024-01-19T04:15:03.794715+0000","last_peered":"2024-01-19T04:15:03.794715+0000","last_clean":"2024-01-19T04:15:03.794715+0000","last_became_active":"2024-01-19T04:15:01.664311+0000","last_became_peered":"2024-01-19T04:15:01.664311+0000","last_unstale":"2024-01-19T04:15:03.794715+0000","last_undegraded":"2024-01-19T04:15:03.794715+0000","last_fullsized":"2024-01-19T04:15:03.794715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:21:02.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793441+0000","last_change":"2024-01-19T04:15:02.668202+0000","last_active":"2024-01-19T04:15:03.793441+0000","last_peered":"2024-01-19T04:15:03.793441+0000","last_clean":"2024-01-19T04:15:03.793441+0000","last_became_active":"2024-01-19T04:15:02.667661+0000","last_became_peered":"2024-01-19T04:15:02.667661+0000","last_unstale":"2024-01-19T04:15:03.793441+0000","last_undegraded":"2024-01-19T04:15:03.793441+0000","last_fullsized":"2024-01-19T04:15:03.793441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794134+0000","last_change":"2024-01-19T04:15:02.679928+0000","last_active":"2024-01-19T04:15:03.794134+0000","last_peered":"2024-01-19T04:15:03.794134+0000","last_clean":"2024-01-19T04:15:03.794134+0000","last_became_active":"2024-01-19T04:15:02.679629+0000","last_became_peered":"2024-01-19T04:15:02.679629+0000","last_unstale":"2024-01-19T04:15:03.794134+0000","last_undegraded":"2024-01-19T04:15:03.794134+0000","last_fullsized":"2024-01-19T04:15:03.794134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793812+0000","last_change":"2024-01-19T04:15:01.665948+0000","last_active":"2024-01-19T04:15:03.793812+0000","last_peered":"2024-01-19T04:15:03.793812+0000","last_clean":"2024-01-19T04:15:03.793812+0000","last_became_active":"2024-01-19T04:15:01.665641+0000","last_became_peered":"2024-01-19T04:15:01.665641+0000","last_unstale":"2024-01-19T04:15:03.793812+0000","last_undegraded":"2024-01-19T04:15:03.793812+0000","last_fullsized":"2024-01-19T04:15:03.793812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:09.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794795+0000","last_change":"2024-01-19T04:15:02.681662+0000","last_active":"2024-01-19T04:15:03.794795+0000","last_peered":"2024-01-19T04:15:03.794795+0000","last_clean":"2024-01-19T04:15:03.794795+0000","last_became_active":"2024-01-19T04:15:02.681303+0000","last_became_peered":"2024-01-19T04:15:02.681303+0000","last_unstale":"2024-01-19T04:15:03.794795+0000","last_undegraded":"2024-01-19T04:15:03.794795+0000","last_fullsized":"2024-01-19T04:15:03.794795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793675+0000","last_change":"2024-01-19T04:15:01.671175+0000","last_active":"2024-01-19T04:15:03.793675+0000","last_peered":"2024-01-19T04:15:03.793675+0000","last_clean":"2024-01-19T04:15:03.793675+0000","last_became_active":"2024-01-19T04:15:01.670934+0000","last_became_peered":"2024-01-19T04:15:01.670934+0000","last_unstale":"2024-01-19T04:15:03.793675+0000","last_undegraded":"2024-01-19T04:15:03.793675+0000","last_fullsized":"2024-01-19T04:15:03.793675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:02.685102+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:02.684653+0000","last_became_peered":"2024-01-19T04:15:02.684653+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.689927+0000","last_change":"2024-01-19T04:15:01.657663+0000","last_active":"2024-01-19T04:15:02.689927+0000","last_peered":"2024-01-19T04:15:02.689927+0000","last_clean":"2024-01-19T04:15:02.689927+0000","last_became_active":"2024-01-19T04:15:01.657372+0000","last_became_peered":"2024-01-19T04:15:01.657372+0000","last_unstale":"2024-01-19T04:15:02.689927+0000","last_undegraded":"2024-01-19T04:15:02.689927+0000","last_fullsized":"2024-01-19T04:15:02.689927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:24:30.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.676302+0000","last_change":"2024-01-19T04:15:02.670659+0000","last_active":"2024-01-19T04:15:02.676302+0000","last_peered":"2024-01-19T04:15:02.676302+0000","last_clean":"2024-01-19T04:15:02.676302+0000","last_became_active":"2024-01-19T04:15:02.668710+0000","last_became_peered":"2024-01-19T04:15:02.668710+0000","last_unstale":"2024-01-19T04:15:02.676302+0000","last_undegraded":"2024-01-19T04:15:02.676302+0000","last_fullsized":"2024-01-19T04:15:02.676302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:34:19.305228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793688+0000","last_change":"2024-01-19T04:15:01.665080+0000","last_active":"2024-01-19T04:15:03.793688+0000","last_peered":"2024-01-19T04:15:03.793688+0000","last_clean":"2024-01-19T04:15:03.793688+0000","last_became_active":"2024-01-19T04:15:01.663889+0000","last_became_peered":"2024-01-19T04:15:01.663889+0000","last_unstale":"2024-01-19T04:15:03.793688+0000","last_undegraded":"2024-01-19T04:15:03.793688+0000","last_fullsized":"2024-01-19T04:15:03.793688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:03:13.418483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":670753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]}]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":73503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":73663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":670809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:06.762 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:06.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef20000640 1 Processor -- start 2024-01-19T04:15:06.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef20000640 1 -- start start 2024-01-19T04:15:06.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef20000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 0x7fef180c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef20000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef181530d0 con 0x7fef180c7050 2024-01-19T04:15:06.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef20000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef181524c0 con 0x7fef180acee0 2024-01-19T04:15:06.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef20000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef181527a0 con 0x7fef18070230 2024-01-19T04:15:06.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fef180c7050 0x7fef180c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35828/0 (socket says 172.21.15.32:35828) 2024-01-19T04:15:06.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 -- 172.21.15.32:0/1738395961 learned_addr learned my addr 172.21.15.32:0/1738395961 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1e000640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 0x7fef180c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165677676 0 0) 0x7fef181530d0 con 0x7fef180c7050 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feef8003530 con 0x7fef180c7050 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254619231 0 0) 0x7feef8003530 con 0x7fef180c7050 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 msgr2=0x7fef180c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 0x7fef180c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 >> v1:172.21.15.67:6789/0 conn(0x7fef180acee0 legacy=0x7fef180c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef18152a80 con 0x7fef180c7050 2024-01-19T04:15:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fef08001680 con 0x7fef180c7050 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 >> v1:172.21.15.32:6789/0 conn(0x7fef180c7050 legacy=0x7fef180c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7feef8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 0x7feef80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feef8004d10 0x7feef8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef181527a0 con 0x7feef80039b0 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef800bac0 con 0x7feef8004d10 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef800bc80 con 0x7fef18070230 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7feef8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1cc00640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 0x7feef80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1e000640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feef8004d10 0x7feef8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 -- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 msgr2=0x7feef80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef18070230 0x7feef80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 -- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feef8004d10 msgr2=0x7feef8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feef8004d10 0x7feef8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.944+0000 7fef1d600640 1 -- 172.21.15.32:0/1738395961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8003530 con 0x7feef80039b0 2024-01-19T04:15:06.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef1d600640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7feef8003dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c240 tx=0x7fef0801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de7a098cc23699d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08005ae0 con 0x7feef80039b0 2024-01-19T04:15:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08005c40 con 0x7feef80039b0 2024-01-19T04:15:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef17e00640 1 -- 172.21.15.32:0/1738395961 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08007070 con 0x7feef80039b0 2024-01-19T04:15:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef20000640 1 -- 172.21.15.32:0/1738395961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 msgr2=0x7feef8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef20000640 1 --2- 172.21.15.32:0/1738395961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7feef8003dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c240 tx=0x7fef0801cb80 comp rx=0 tx=0).stop 2024-01-19T04:15:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef1e000640 1 -- 172.21.15.32:0/1738395961 reap_dead start 2024-01-19T04:15:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef20000640 1 -- 172.21.15.32:0/1738395961 shutdown_connections 2024-01-19T04:15:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef20000640 1 -- 172.21.15.32:0/1738395961 >> 172.21.15.32:0/1738395961 conn(0x7fef180a99f0 msgr2=0x7fef180a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef20000640 1 -- 172.21.15.32:0/1738395961 shutdown_connections 2024-01-19T04:15:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.948+0000 7fef20000640 1 -- 172.21.15.32:0/1738395961 wait complete. 2024-01-19T04:15:06.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 Processor -- start 2024-01-19T04:15:06.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 -- start start 2024-01-19T04:15:06.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7fef180c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef180c1790 0x7fef180c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef1814eff0 0x7fef1814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18157650 con 0x7feef80039b0 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef181ed9e0 con 0x7fef1814eff0 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef181ece40 con 0x7fef180c1790 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7fef180c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7fef180c2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41028/0 (socket says 172.21.15.32:41028) 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 -- 172.21.15.32:0/1985804255 learned_addr learned my addr 172.21.15.32:0/1985804255 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1e000640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef1814eff0 0x7fef1814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1cc00640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef180c1790 0x7fef180c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 -- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef180c1790 msgr2=0x7fef180c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef180c1790 0x7fef180c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 -- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef1814eff0 msgr2=0x7fef1814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef1814eff0 0x7fef1814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 -- 172.21.15.32:0/1985804255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1814f9b0 con 0x7feef80039b0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef1d600640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7fef180c2d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef0801c9b0 tx=0x7feef8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef15600640 1 -- 172.21.15.32:0/1985804255 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080b4070 con 0x7feef80039b0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef15600640 1 -- 172.21.15.32:0/1985804255 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08005e70 con 0x7feef80039b0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef15600640 1 -- 172.21.15.32:0/1985804255 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080072a0 con 0x7feef80039b0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef181ed0b0 con 0x7feef80039b0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.952+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef181ed670 con 0x7feef80039b0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.956+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef180749f0 con 0x7feef80039b0 2024-01-19T04:15:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.956+0000 7fef15600640 1 -- 172.21.15.32:0/1985804255 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fef08007400 con 0x7feef80039b0 2024-01-19T04:15:06.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.956+0000 7fef15600640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feef0066500 0x7feef00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:06.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.956+0000 7fef15600640 1 -- 172.21.15.32:0/1985804255 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef0811d860 con 0x7feef80039b0 2024-01-19T04:15:06.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.956+0000 7fef1cc00640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feef0066500 0x7feef00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:06.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.956+0000 7fef1cc00640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feef0066500 0x7feef00689c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef181f13e0 tx=0x7fef00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:06.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:06.960+0000 7fef15600640 1 -- 172.21.15.32:0/1985804255 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fef080eaba0 con 0x7feef80039b0 2024-01-19T04:15:07.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.116+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef1815e470 con 0x7feef0066500 2024-01-19T04:15:07.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.124+0000 7fef15600640 1 -- 172.21.15.32:0/1985804255 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264657 (secure 0 0 0) 0x7fef00012910 con 0x7feef0066500 2024-01-19T04:15:07.130 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:07.131 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feef0066500 msgr2=0x7feef00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feef0066500 0x7feef00689c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef181f13e0 tx=0x7fef00009040 comp rx=0 tx=0).stop 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 msgr2=0x7fef180c2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7fef180c2d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef0801c9b0 tx=0x7feef8005800 comp rx=0 tx=0).stop 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 shutdown_connections 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feef0066500 0x7feef00689c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef1814eff0 0x7fef1814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef180c1790 0x7fef180c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 --2- 172.21.15.32:0/1985804255 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feef80039b0 0x7fef180c2d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 >> 172.21.15.32:0/1985804255 conn(0x7fef180a99f0 msgr2=0x7fef1815b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:07.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 shutdown_connections 2024-01-19T04:15:07.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.128+0000 7fef20000640 1 -- 172.21.15.32:0/1985804255 wait complete. 2024-01-19T04:15:07.151 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-01-19T04:15:06.029052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235804,"kb_used_data":2980,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738916,"statfs":{"total":773094113280,"available":772852649984,"internally_reserved":0,"allocated":3051520,"data_stored":1805080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.398678"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793727+0000","last_change":"2024-01-19T04:15:02.673206+0000","last_active":"2024-01-19T04:15:03.793727+0000","last_peered":"2024-01-19T04:15:03.793727+0000","last_clean":"2024-01-19T04:15:03.793727+0000","last_became_active":"2024-01-19T04:15:02.672837+0000","last_became_peered":"2024-01-19T04:15:02.672837+0000","last_unstale":"2024-01-19T04:15:03.793727+0000","last_undegraded":"2024-01-19T04:15:03.793727+0000","last_fullsized":"2024-01-19T04:15:03.793727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793881+0000","last_change":"2024-01-19T04:15:02.660330+0000","last_active":"2024-01-19T04:15:03.793881+0000","last_peered":"2024-01-19T04:15:03.793881+0000","last_clean":"2024-01-19T04:15:03.793881+0000","last_became_active":"2024-01-19T04:15:02.660069+0000","last_became_peered":"2024-01-19T04:15:02.660069+0000","last_unstale":"2024-01-19T04:15:03.793881+0000","last_undegraded":"2024-01-19T04:15:03.793881+0000","last_fullsized":"2024-01-19T04:15:03.793881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793227+0000","last_change":"2024-01-19T04:15:02.671714+0000","last_active":"2024-01-19T04:15:03.793227+0000","last_peered":"2024-01-19T04:15:03.793227+0000","last_clean":"2024-01-19T04:15:03.793227+0000","last_became_active":"2024-01-19T04:15:02.667718+0000","last_became_peered":"2024-01-19T04:15:02.667718+0000","last_unstale":"2024-01-19T04:15:03.793227+0000","last_undegraded":"2024-01-19T04:15:03.793227+0000","last_fullsized":"2024-01-19T04:15:03.793227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793901+0000","last_change":"2024-01-19T04:15:02.683062+0000","last_active":"2024-01-19T04:15:03.793901+0000","last_peered":"2024-01-19T04:15:03.793901+0000","last_clean":"2024-01-19T04:15:03.793901+0000","last_became_active":"2024-01-19T04:15:02.682769+0000","last_became_peered":"2024-01-19T04:15:02.682769+0000","last_unstale":"2024-01-19T04:15:03.793901+0000","last_undegraded":"2024-01-19T04:15:03.793901+0000","last_fullsized":"2024-01-19T04:15:03.793901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794606+0000","last_change":"2024-01-19T04:15:02.675817+0000","last_active":"2024-01-19T04:15:03.794606+0000","last_peered":"2024-01-19T04:15:03.794606+0000","last_clean":"2024-01-19T04:15:03.794606+0000","last_became_active":"2024-01-19T04:15:02.673948+0000","last_became_peered":"2024-01-19T04:15:02.673948+0000","last_unstale":"2024-01-19T04:15:03.794606+0000","last_undegraded":"2024-01-19T04:15:03.794606+0000","last_fullsized":"2024-01-19T04:15:03.794606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793668+0000","last_change":"2024-01-19T04:15:02.680536+0000","last_active":"2024-01-19T04:15:03.793668+0000","last_peered":"2024-01-19T04:15:03.793668+0000","last_clean":"2024-01-19T04:15:03.793668+0000","last_became_active":"2024-01-19T04:15:02.680182+0000","last_became_peered":"2024-01-19T04:15:02.680182+0000","last_unstale":"2024-01-19T04:15:03.793668+0000","last_undegraded":"2024-01-19T04:15:03.793668+0000","last_fullsized":"2024-01-19T04:15:03.793668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:13:26.044664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793083+0000","last_change":"2024-01-19T04:15:02.667084+0000","last_active":"2024-01-19T04:15:03.793083+0000","last_peered":"2024-01-19T04:15:03.793083+0000","last_clean":"2024-01-19T04:15:03.793083+0000","last_became_active":"2024-01-19T04:15:02.666773+0000","last_became_peered":"2024-01-19T04:15:02.666773+0000","last_unstale":"2024-01-19T04:15:03.793083+0000","last_undegraded":"2024-01-19T04:15:03.793083+0000","last_fullsized":"2024-01-19T04:15:03.793083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.685434+0000","last_change":"2024-01-19T04:15:02.681046+0000","last_active":"2024-01-19T04:15:02.685434+0000","last_peered":"2024-01-19T04:15:02.685434+0000","last_clean":"2024-01-19T04:15:02.685434+0000","last_became_active":"2024-01-19T04:15:02.680748+0000","last_became_peered":"2024-01-19T04:15:02.680748+0000","last_unstale":"2024-01-19T04:15:02.685434+0000","last_undegraded":"2024-01-19T04:15:02.685434+0000","last_fullsized":"2024-01-19T04:15:02.685434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:45.165612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793875+0000","last_change":"2024-01-19T04:15:02.686021+0000","last_active":"2024-01-19T04:15:03.793875+0000","last_peered":"2024-01-19T04:15:03.793875+0000","last_clean":"2024-01-19T04:15:03.793875+0000","last_became_active":"2024-01-19T04:15:02.685239+0000","last_became_peered":"2024-01-19T04:15:02.685239+0000","last_unstale":"2024-01-19T04:15:03.793875+0000","last_undegraded":"2024-01-19T04:15:03.793875+0000","last_fullsized":"2024-01-19T04:15:03.793875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793470+0000","last_change":"2024-01-19T04:15:02.685444+0000","last_active":"2024-01-19T04:15:03.793470+0000","last_peered":"2024-01-19T04:15:03.793470+0000","last_clean":"2024-01-19T04:15:03.793470+0000","last_became_active":"2024-01-19T04:15:02.685184+0000","last_became_peered":"2024-01-19T04:15:02.685184+0000","last_unstale":"2024-01-19T04:15:03.793470+0000","last_undegraded":"2024-01-19T04:15:03.793470+0000","last_fullsized":"2024-01-19T04:15:03.793470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794527+0000","last_change":"2024-01-19T04:15:02.686028+0000","last_active":"2024-01-19T04:15:03.794527+0000","last_peered":"2024-01-19T04:15:03.794527+0000","last_clean":"2024-01-19T04:15:03.794527+0000","last_became_active":"2024-01-19T04:15:02.685561+0000","last_became_peered":"2024-01-19T04:15:02.685561+0000","last_unstale":"2024-01-19T04:15:03.794527+0000","last_undegraded":"2024-01-19T04:15:03.794527+0000","last_fullsized":"2024-01-19T04:15:03.794527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663222+0000","last_change":"2024-01-19T04:15:02.671711+0000","last_active":"2024-01-19T04:15:03.663222+0000","last_peered":"2024-01-19T04:15:03.663222+0000","last_clean":"2024-01-19T04:15:03.663222+0000","last_became_active":"2024-01-19T04:15:02.671331+0000","last_became_peered":"2024-01-19T04:15:02.671331+0000","last_unstale":"2024-01-19T04:15:03.663222+0000","last_undegraded":"2024-01-19T04:15:03.663222+0000","last_fullsized":"2024-01-19T04:15:03.663222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:48.803204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.675437+0000","last_change":"2024-01-19T04:15:02.672095+0000","last_active":"2024-01-19T04:15:02.675437+0000","last_peered":"2024-01-19T04:15:02.675437+0000","last_clean":"2024-01-19T04:15:02.675437+0000","last_became_active":"2024-01-19T04:15:02.671811+0000","last_became_peered":"2024-01-19T04:15:02.671811+0000","last_unstale":"2024-01-19T04:15:02.675437+0000","last_undegraded":"2024-01-19T04:15:02.675437+0000","last_fullsized":"2024-01-19T04:15:02.675437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:12:11.568122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792698+0000","last_change":"2024-01-19T04:15:02.659658+0000","last_active":"2024-01-19T04:15:03.792698+0000","last_peered":"2024-01-19T04:15:03.792698+0000","last_clean":"2024-01-19T04:15:03.792698+0000","last_became_active":"2024-01-19T04:15:02.659343+0000","last_became_peered":"2024-01-19T04:15:02.659343+0000","last_unstale":"2024-01-19T04:15:03.792698+0000","last_undegraded":"2024-01-19T04:15:03.792698+0000","last_fullsized":"2024-01-19T04:15:03.792698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:37.529811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793549+0000","last_change":"2024-01-19T04:15:02.661052+0000","last_active":"2024-01-19T04:15:03.793549+0000","last_peered":"2024-01-19T04:15:03.793549+0000","last_clean":"2024-01-19T04:15:03.793549+0000","last_became_active":"2024-01-19T04:15:02.660725+0000","last_became_peered":"2024-01-19T04:15:02.660725+0000","last_unstale":"2024-01-19T04:15:03.793549+0000","last_undegraded":"2024-01-19T04:15:03.793549+0000","last_fullsized":"2024-01-19T04:15:03.793549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794007+0000","last_change":"2024-01-19T04:15:02.674681+0000","last_active":"2024-01-19T04:15:03.794007+0000","last_peered":"2024-01-19T04:15:03.794007+0000","last_clean":"2024-01-19T04:15:03.794007+0000","last_became_active":"2024-01-19T04:15:02.674302+0000","last_became_peered":"2024-01-19T04:15:02.674302+0000","last_unstale":"2024-01-19T04:15:03.794007+0000","last_undegraded":"2024-01-19T04:15:03.794007+0000","last_fullsized":"2024-01-19T04:15:03.794007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794556+0000","last_change":"2024-01-19T04:15:02.680651+0000","last_active":"2024-01-19T04:15:03.794556+0000","last_peered":"2024-01-19T04:15:03.794556+0000","last_clean":"2024-01-19T04:15:03.794556+0000","last_became_active":"2024-01-19T04:15:02.680263+0000","last_became_peered":"2024-01-19T04:15:02.680263+0000","last_unstale":"2024-01-19T04:15:03.794556+0000","last_undegraded":"2024-01-19T04:15:03.794556+0000","last_fullsized":"2024-01-19T04:15:03.794556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661205+0000","last_change":"2024-01-19T04:15:02.669777+0000","last_active":"2024-01-19T04:15:03.661205+0000","last_peered":"2024-01-19T04:15:03.661205+0000","last_clean":"2024-01-19T04:15:03.661205+0000","last_became_active":"2024-01-19T04:15:02.669488+0000","last_became_peered":"2024-01-19T04:15:02.669488+0000","last_unstale":"2024-01-19T04:15:03.661205+0000","last_undegraded":"2024-01-19T04:15:03.661205+0000","last_fullsized":"2024-01-19T04:15:03.661205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:10.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793826+0000","last_change":"2024-01-19T04:15:02.666101+0000","last_active":"2024-01-19T04:15:03.793826+0000","last_peered":"2024-01-19T04:15:03.793826+0000","last_clean":"2024-01-19T04:15:03.793826+0000","last_became_active":"2024-01-19T04:15:02.665664+0000","last_became_peered":"2024-01-19T04:15:02.665664+0000","last_unstale":"2024-01-19T04:15:03.793826+0000","last_undegraded":"2024-01-19T04:15:03.793826+0000","last_fullsized":"2024-01-19T04:15:03.793826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793385+0000","last_change":"2024-01-19T04:15:02.682696+0000","last_active":"2024-01-19T04:15:03.793385+0000","last_peered":"2024-01-19T04:15:03.793385+0000","last_clean":"2024-01-19T04:15:03.793385+0000","last_became_active":"2024-01-19T04:15:02.682337+0000","last_became_peered":"2024-01-19T04:15:02.682337+0000","last_unstale":"2024-01-19T04:15:03.793385+0000","last_undegraded":"2024-01-19T04:15:03.793385+0000","last_fullsized":"2024-01-19T04:15:03.793385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793229+0000","last_change":"2024-01-19T04:15:02.675046+0000","last_active":"2024-01-19T04:15:03.793229+0000","last_peered":"2024-01-19T04:15:03.793229+0000","last_clean":"2024-01-19T04:15:03.793229+0000","last_became_active":"2024-01-19T04:15:02.674569+0000","last_became_peered":"2024-01-19T04:15:02.674569+0000","last_unstale":"2024-01-19T04:15:03.793229+0000","last_undegraded":"2024-01-19T04:15:03.793229+0000","last_fullsized":"2024-01-19T04:15:03.793229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793823+0000","last_change":"2024-01-19T04:15:02.679833+0000","last_active":"2024-01-19T04:15:03.793823+0000","last_peered":"2024-01-19T04:15:03.793823+0000","last_clean":"2024-01-19T04:15:03.793823+0000","last_became_active":"2024-01-19T04:15:02.679450+0000","last_became_peered":"2024-01-19T04:15:02.679450+0000","last_unstale":"2024-01-19T04:15:03.793823+0000","last_undegraded":"2024-01-19T04:15:03.793823+0000","last_fullsized":"2024-01-19T04:15:03.793823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.679751+0000","last_change":"2024-01-19T04:15:02.675672+0000","last_active":"2024-01-19T04:15:02.679751+0000","last_peered":"2024-01-19T04:15:02.679751+0000","last_clean":"2024-01-19T04:15:02.679751+0000","last_became_active":"2024-01-19T04:15:02.668805+0000","last_became_peered":"2024-01-19T04:15:02.668805+0000","last_unstale":"2024-01-19T04:15:02.679751+0000","last_undegraded":"2024-01-19T04:15:02.679751+0000","last_fullsized":"2024-01-19T04:15:02.679751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:44.185890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794204+0000","last_change":"2024-01-19T04:15:02.679845+0000","last_active":"2024-01-19T04:15:03.794204+0000","last_peered":"2024-01-19T04:15:03.794204+0000","last_clean":"2024-01-19T04:15:03.794204+0000","last_became_active":"2024-01-19T04:15:02.679512+0000","last_became_peered":"2024-01-19T04:15:02.679512+0000","last_unstale":"2024-01-19T04:15:03.794204+0000","last_undegraded":"2024-01-19T04:15:03.794204+0000","last_fullsized":"2024-01-19T04:15:03.794204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.670076+0000","last_change":"2024-01-19T04:15:02.668029+0000","last_active":"2024-01-19T04:15:02.670076+0000","last_peered":"2024-01-19T04:15:02.670076+0000","last_clean":"2024-01-19T04:15:02.670076+0000","last_became_active":"2024-01-19T04:15:02.667742+0000","last_became_peered":"2024-01-19T04:15:02.667742+0000","last_unstale":"2024-01-19T04:15:02.670076+0000","last_undegraded":"2024-01-19T04:15:02.670076+0000","last_fullsized":"2024-01-19T04:15:02.670076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:41:18.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793620+0000","last_change":"2024-01-19T04:15:02.684316+0000","last_active":"2024-01-19T04:15:03.793620+0000","last_peered":"2024-01-19T04:15:03.793620+0000","last_clean":"2024-01-19T04:15:03.793620+0000","last_became_active":"2024-01-19T04:15:02.681947+0000","last_became_peered":"2024-01-19T04:15:02.681947+0000","last_unstale":"2024-01-19T04:15:03.793620+0000","last_undegraded":"2024-01-19T04:15:03.793620+0000","last_fullsized":"2024-01-19T04:15:03.793620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793691+0000","last_change":"2024-01-19T04:15:02.672775+0000","last_active":"2024-01-19T04:15:03.793691+0000","last_peered":"2024-01-19T04:15:03.793691+0000","last_clean":"2024-01-19T04:15:03.793691+0000","last_became_active":"2024-01-19T04:15:02.672561+0000","last_became_peered":"2024-01-19T04:15:02.672561+0000","last_unstale":"2024-01-19T04:15:03.793691+0000","last_undegraded":"2024-01-19T04:15:03.793691+0000","last_fullsized":"2024-01-19T04:15:03.793691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.665140+0000","last_change":"2024-01-19T04:15:02.661526+0000","last_active":"2024-01-19T04:15:02.665140+0000","last_peered":"2024-01-19T04:15:02.665140+0000","last_clean":"2024-01-19T04:15:02.665140+0000","last_became_active":"2024-01-19T04:15:02.661278+0000","last_became_peered":"2024-01-19T04:15:02.661278+0000","last_unstale":"2024-01-19T04:15:02.665140+0000","last_undegraded":"2024-01-19T04:15:02.665140+0000","last_fullsized":"2024-01-19T04:15:02.665140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:44:12.189687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793056+0000","last_change":"2024-01-19T04:15:02.660175+0000","last_active":"2024-01-19T04:15:03.793056+0000","last_peered":"2024-01-19T04:15:03.793056+0000","last_clean":"2024-01-19T04:15:03.793056+0000","last_became_active":"2024-01-19T04:15:02.659887+0000","last_became_peered":"2024-01-19T04:15:02.659887+0000","last_unstale":"2024-01-19T04:15:03.793056+0000","last_undegraded":"2024-01-19T04:15:03.793056+0000","last_fullsized":"2024-01-19T04:15:03.793056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.796302+0000","last_change":"2024-01-19T04:15:02.680673+0000","last_active":"2024-01-19T04:15:03.796302+0000","last_peered":"2024-01-19T04:15:03.796302+0000","last_clean":"2024-01-19T04:15:03.796302+0000","last_became_active":"2024-01-19T04:15:02.679966+0000","last_became_peered":"2024-01-19T04:15:02.679966+0000","last_unstale":"2024-01-19T04:15:03.796302+0000","last_undegraded":"2024-01-19T04:15:03.796302+0000","last_fullsized":"2024-01-19T04:15:03.796302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661036+0000","last_change":"2024-01-19T04:15:02.684219+0000","last_active":"2024-01-19T04:15:03.661036+0000","last_peered":"2024-01-19T04:15:03.661036+0000","last_clean":"2024-01-19T04:15:03.661036+0000","last_became_active":"2024-01-19T04:15:02.683973+0000","last_became_peered":"2024-01-19T04:15:02.683973+0000","last_unstale":"2024-01-19T04:15:03.661036+0000","last_undegraded":"2024-01-19T04:15:03.661036+0000","last_fullsized":"2024-01-19T04:15:03.661036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793375+0000","last_change":"2024-01-19T04:15:02.682448+0000","last_active":"2024-01-19T04:15:03.793375+0000","last_peered":"2024-01-19T04:15:03.793375+0000","last_clean":"2024-01-19T04:15:03.793375+0000","last_became_active":"2024-01-19T04:15:02.673199+0000","last_became_peered":"2024-01-19T04:15:02.673199+0000","last_unstale":"2024-01-19T04:15:03.793375+0000","last_undegraded":"2024-01-19T04:15:03.793375+0000","last_fullsized":"2024-01-19T04:15:03.793375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.662776+0000","last_change":"2024-01-19T04:15:02.661774+0000","last_active":"2024-01-19T04:15:03.662776+0000","last_peered":"2024-01-19T04:15:03.662776+0000","last_clean":"2024-01-19T04:15:03.662776+0000","last_became_active":"2024-01-19T04:15:02.661479+0000","last_became_peered":"2024-01-19T04:15:02.661479+0000","last_unstale":"2024-01-19T04:15:03.662776+0000","last_undegraded":"2024-01-19T04:15:03.662776+0000","last_fullsized":"2024-01-19T04:15:03.662776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:45.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.693344+0000","last_change":"2024-01-19T04:15:01.664062+0000","last_active":"2024-01-19T04:15:02.693344+0000","last_peered":"2024-01-19T04:15:02.693344+0000","last_clean":"2024-01-19T04:15:02.693344+0000","last_became_active":"2024-01-19T04:15:01.663666+0000","last_became_peered":"2024-01-19T04:15:01.663666+0000","last_unstale":"2024-01-19T04:15:02.693344+0000","last_undegraded":"2024-01-19T04:15:02.693344+0000","last_fullsized":"2024-01-19T04:15:02.693344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:26.787644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793174+0000","last_change":"2024-01-19T04:15:02.664100+0000","last_active":"2024-01-19T04:15:03.793174+0000","last_peered":"2024-01-19T04:15:03.793174+0000","last_clean":"2024-01-19T04:15:03.793174+0000","last_became_active":"2024-01-19T04:15:02.663834+0000","last_became_peered":"2024-01-19T04:15:02.663834+0000","last_unstale":"2024-01-19T04:15:03.793174+0000","last_undegraded":"2024-01-19T04:15:03.793174+0000","last_fullsized":"2024-01-19T04:15:03.793174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793267+0000","last_change":"2024-01-19T04:15:01.663996+0000","last_active":"2024-01-19T04:15:03.793267+0000","last_peered":"2024-01-19T04:15:03.793267+0000","last_clean":"2024-01-19T04:15:03.793267+0000","last_became_active":"2024-01-19T04:15:01.663681+0000","last_became_peered":"2024-01-19T04:15:01.663681+0000","last_unstale":"2024-01-19T04:15:03.793267+0000","last_undegraded":"2024-01-19T04:15:03.793267+0000","last_fullsized":"2024-01-19T04:15:03.793267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.653659+0000","last_change":"2024-01-19T04:15:01.656029+0000","last_active":"2024-01-19T04:15:02.653659+0000","last_peered":"2024-01-19T04:15:02.653659+0000","last_clean":"2024-01-19T04:15:02.653659+0000","last_became_active":"2024-01-19T04:15:01.655545+0000","last_became_peered":"2024-01-19T04:15:01.655545+0000","last_unstale":"2024-01-19T04:15:02.653659+0000","last_undegraded":"2024-01-19T04:15:02.653659+0000","last_fullsized":"2024-01-19T04:15:02.653659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:14:53.257377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.665892+0000","last_change":"2024-01-19T04:15:02.662372+0000","last_active":"2024-01-19T04:15:02.665892+0000","last_peered":"2024-01-19T04:15:02.665892+0000","last_clean":"2024-01-19T04:15:02.665892+0000","last_became_active":"2024-01-19T04:15:02.662169+0000","last_became_peered":"2024-01-19T04:15:02.662169+0000","last_unstale":"2024-01-19T04:15:02.665892+0000","last_undegraded":"2024-01-19T04:15:02.665892+0000","last_fullsized":"2024-01-19T04:15:02.665892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:54:28.197250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794296+0000","last_change":"2024-01-19T04:15:01.654399+0000","last_active":"2024-01-19T04:15:03.794296+0000","last_peered":"2024-01-19T04:15:03.794296+0000","last_clean":"2024-01-19T04:15:03.794296+0000","last_became_active":"2024-01-19T04:15:01.652845+0000","last_became_peered":"2024-01-19T04:15:01.652845+0000","last_unstale":"2024-01-19T04:15:03.794296+0000","last_undegraded":"2024-01-19T04:15:03.794296+0000","last_fullsized":"2024-01-19T04:15:03.794296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793429+0000","last_change":"2024-01-19T04:15:02.655914+0000","last_active":"2024-01-19T04:15:03.793429+0000","last_peered":"2024-01-19T04:15:03.793429+0000","last_clean":"2024-01-19T04:15:03.793429+0000","last_became_active":"2024-01-19T04:15:02.655614+0000","last_became_peered":"2024-01-19T04:15:02.655614+0000","last_unstale":"2024-01-19T04:15:03.793429+0000","last_undegraded":"2024-01-19T04:15:03.793429+0000","last_fullsized":"2024-01-19T04:15:03.793429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793903+0000","last_change":"2024-01-19T04:15:01.659225+0000","last_active":"2024-01-19T04:15:03.793903+0000","last_peered":"2024-01-19T04:15:03.793903+0000","last_clean":"2024-01-19T04:15:03.793903+0000","last_became_active":"2024-01-19T04:15:01.658937+0000","last_became_peered":"2024-01-19T04:15:01.658937+0000","last_unstale":"2024-01-19T04:15:03.793903+0000","last_undegraded":"2024-01-19T04:15:03.793903+0000","last_fullsized":"2024-01-19T04:15:03.793903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793665+0000","last_change":"2024-01-19T04:15:02.679479+0000","last_active":"2024-01-19T04:15:03.793665+0000","last_peered":"2024-01-19T04:15:03.793665+0000","last_clean":"2024-01-19T04:15:03.793665+0000","last_became_active":"2024-01-19T04:15:02.678631+0000","last_became_peered":"2024-01-19T04:15:02.678631+0000","last_unstale":"2024-01-19T04:15:03.793665+0000","last_undegraded":"2024-01-19T04:15:03.793665+0000","last_fullsized":"2024-01-19T04:15:03.793665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793772+0000","last_change":"2024-01-19T04:15:01.657478+0000","last_active":"2024-01-19T04:15:03.793772+0000","last_peered":"2024-01-19T04:15:03.793772+0000","last_clean":"2024-01-19T04:15:03.793772+0000","last_became_active":"2024-01-19T04:15:01.654337+0000","last_became_peered":"2024-01-19T04:15:01.654337+0000","last_unstale":"2024-01-19T04:15:03.793772+0000","last_undegraded":"2024-01-19T04:15:03.793772+0000","last_fullsized":"2024-01-19T04:15:03.793772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793644+0000","last_change":"2024-01-19T04:15:02.684918+0000","last_active":"2024-01-19T04:15:03.793644+0000","last_peered":"2024-01-19T04:15:03.793644+0000","last_clean":"2024-01-19T04:15:03.793644+0000","last_became_active":"2024-01-19T04:15:02.684209+0000","last_became_peered":"2024-01-19T04:15:02.684209+0000","last_unstale":"2024-01-19T04:15:03.793644+0000","last_undegraded":"2024-01-19T04:15:03.793644+0000","last_fullsized":"2024-01-19T04:15:03.793644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793630+0000","last_change":"2024-01-19T04:15:01.649235+0000","last_active":"2024-01-19T04:15:03.793630+0000","last_peered":"2024-01-19T04:15:03.793630+0000","last_clean":"2024-01-19T04:15:03.793630+0000","last_became_active":"2024-01-19T04:15:01.648890+0000","last_became_peered":"2024-01-19T04:15:01.648890+0000","last_unstale":"2024-01-19T04:15:03.793630+0000","last_undegraded":"2024-01-19T04:15:03.793630+0000","last_fullsized":"2024-01-19T04:15:03.793630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663313+0000","last_change":"2024-01-19T04:15:02.666858+0000","last_active":"2024-01-19T04:15:03.663313+0000","last_peered":"2024-01-19T04:15:03.663313+0000","last_clean":"2024-01-19T04:15:03.663313+0000","last_became_active":"2024-01-19T04:15:02.666581+0000","last_became_peered":"2024-01-19T04:15:02.666581+0000","last_unstale":"2024-01-19T04:15:03.663313+0000","last_undegraded":"2024-01-19T04:15:03.663313+0000","last_fullsized":"2024-01-19T04:15:03.663313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794002+0000","last_change":"2024-01-19T04:15:01.652327+0000","last_active":"2024-01-19T04:15:03.794002+0000","last_peered":"2024-01-19T04:15:03.794002+0000","last_clean":"2024-01-19T04:15:03.794002+0000","last_became_active":"2024-01-19T04:15:01.651986+0000","last_became_peered":"2024-01-19T04:15:01.651986+0000","last_unstale":"2024-01-19T04:15:03.794002+0000","last_undegraded":"2024-01-19T04:15:03.794002+0000","last_fullsized":"2024-01-19T04:15:03.794002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:02.668704+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:02.668254+0000","last_became_peered":"2024-01-19T04:15:02.668254+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793263+0000","last_change":"2024-01-19T04:15:01.656572+0000","last_active":"2024-01-19T04:15:03.793263+0000","last_peered":"2024-01-19T04:15:03.793263+0000","last_clean":"2024-01-19T04:15:03.793263+0000","last_became_active":"2024-01-19T04:15:01.655927+0000","last_became_peered":"2024-01-19T04:15:01.655927+0000","last_unstale":"2024-01-19T04:15:03.793263+0000","last_undegraded":"2024-01-19T04:15:03.793263+0000","last_fullsized":"2024-01-19T04:15:03.793263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:10:35.666423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792925+0000","last_change":"2024-01-19T04:15:02.665136+0000","last_active":"2024-01-19T04:15:03.792925+0000","last_peered":"2024-01-19T04:15:03.792925+0000","last_clean":"2024-01-19T04:15:03.792925+0000","last_became_active":"2024-01-19T04:15:02.659894+0000","last_became_peered":"2024-01-19T04:15:02.659894+0000","last_unstale":"2024-01-19T04:15:03.792925+0000","last_undegraded":"2024-01-19T04:15:03.792925+0000","last_fullsized":"2024-01-19T04:15:03.792925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:15.849417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794290+0000","last_change":"2024-01-19T04:15:01.656361+0000","last_active":"2024-01-19T04:15:03.794290+0000","last_peered":"2024-01-19T04:15:03.794290+0000","last_clean":"2024-01-19T04:15:03.794290+0000","last_became_active":"2024-01-19T04:15:01.655933+0000","last_became_peered":"2024-01-19T04:15:01.655933+0000","last_unstale":"2024-01-19T04:15:03.794290+0000","last_undegraded":"2024-01-19T04:15:03.794290+0000","last_fullsized":"2024-01-19T04:15:03.794290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794647+0000","last_change":"2024-01-19T04:15:02.675994+0000","last_active":"2024-01-19T04:15:03.794647+0000","last_peered":"2024-01-19T04:15:03.794647+0000","last_clean":"2024-01-19T04:15:03.794647+0000","last_became_active":"2024-01-19T04:15:02.673959+0000","last_became_peered":"2024-01-19T04:15:02.673959+0000","last_unstale":"2024-01-19T04:15:03.794647+0000","last_undegraded":"2024-01-19T04:15:03.794647+0000","last_fullsized":"2024-01-19T04:15:03.794647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:22.472681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794344+0000","last_change":"2024-01-19T04:15:01.661165+0000","last_active":"2024-01-19T04:15:03.794344+0000","last_peered":"2024-01-19T04:15:03.794344+0000","last_clean":"2024-01-19T04:15:03.794344+0000","last_became_active":"2024-01-19T04:15:01.656873+0000","last_became_peered":"2024-01-19T04:15:01.656873+0000","last_unstale":"2024-01-19T04:15:03.794344+0000","last_undegraded":"2024-01-19T04:15:03.794344+0000","last_fullsized":"2024-01-19T04:15:03.794344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793545+0000","last_change":"2024-01-19T04:15:02.682133+0000","last_active":"2024-01-19T04:15:03.793545+0000","last_peered":"2024-01-19T04:15:03.793545+0000","last_clean":"2024-01-19T04:15:03.793545+0000","last_became_active":"2024-01-19T04:15:02.672918+0000","last_became_peered":"2024-01-19T04:15:02.672918+0000","last_unstale":"2024-01-19T04:15:03.793545+0000","last_undegraded":"2024-01-19T04:15:03.793545+0000","last_fullsized":"2024-01-19T04:15:03.793545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.660994+0000","last_change":"2024-01-19T04:15:01.660206+0000","last_active":"2024-01-19T04:15:03.660994+0000","last_peered":"2024-01-19T04:15:03.660994+0000","last_clean":"2024-01-19T04:15:03.660994+0000","last_became_active":"2024-01-19T04:15:01.659875+0000","last_became_peered":"2024-01-19T04:15:01.659875+0000","last_unstale":"2024-01-19T04:15:03.660994+0000","last_undegraded":"2024-01-19T04:15:03.660994+0000","last_fullsized":"2024-01-19T04:15:03.660994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793220+0000","last_change":"2024-01-19T04:15:02.668873+0000","last_active":"2024-01-19T04:15:03.793220+0000","last_peered":"2024-01-19T04:15:03.793220+0000","last_clean":"2024-01-19T04:15:03.793220+0000","last_became_active":"2024-01-19T04:15:02.668553+0000","last_became_peered":"2024-01-19T04:15:02.668553+0000","last_unstale":"2024-01-19T04:15:03.793220+0000","last_undegraded":"2024-01-19T04:15:03.793220+0000","last_fullsized":"2024-01-19T04:15:03.793220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663364+0000","last_change":"2024-01-19T04:15:01.661192+0000","last_active":"2024-01-19T04:15:03.663364+0000","last_peered":"2024-01-19T04:15:03.663364+0000","last_clean":"2024-01-19T04:15:03.663364+0000","last_became_active":"2024-01-19T04:15:01.660673+0000","last_became_peered":"2024-01-19T04:15:01.660673+0000","last_unstale":"2024-01-19T04:15:03.663364+0000","last_undegraded":"2024-01-19T04:15:03.663364+0000","last_fullsized":"2024-01-19T04:15:03.663364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:16.106132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794632+0000","last_change":"2024-01-19T04:15:02.670249+0000","last_active":"2024-01-19T04:15:03.794632+0000","last_peered":"2024-01-19T04:15:03.794632+0000","last_clean":"2024-01-19T04:15:03.794632+0000","last_became_active":"2024-01-19T04:15:02.669945+0000","last_became_peered":"2024-01-19T04:15:02.669945+0000","last_unstale":"2024-01-19T04:15:03.794632+0000","last_undegraded":"2024-01-19T04:15:03.794632+0000","last_fullsized":"2024-01-19T04:15:03.794632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661228+0000","last_change":"2024-01-19T04:15:01.651897+0000","last_active":"2024-01-19T04:15:03.661228+0000","last_peered":"2024-01-19T04:15:03.661228+0000","last_clean":"2024-01-19T04:15:03.661228+0000","last_became_active":"2024-01-19T04:15:01.651557+0000","last_became_peered":"2024-01-19T04:15:01.651557+0000","last_unstale":"2024-01-19T04:15:03.661228+0000","last_undegraded":"2024-01-19T04:15:03.661228+0000","last_fullsized":"2024-01-19T04:15:03.661228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794447+0000","last_change":"2024-01-19T04:15:02.676980+0000","last_active":"2024-01-19T04:15:03.794447+0000","last_peered":"2024-01-19T04:15:03.794447+0000","last_clean":"2024-01-19T04:15:03.794447+0000","last_became_active":"2024-01-19T04:15:02.676586+0000","last_became_peered":"2024-01-19T04:15:02.676586+0000","last_unstale":"2024-01-19T04:15:03.794447+0000","last_undegraded":"2024-01-19T04:15:03.794447+0000","last_fullsized":"2024-01-19T04:15:03.794447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793684+0000","last_change":"2024-01-19T04:15:01.660626+0000","last_active":"2024-01-19T04:15:03.793684+0000","last_peered":"2024-01-19T04:15:03.793684+0000","last_clean":"2024-01-19T04:15:03.793684+0000","last_became_active":"2024-01-19T04:15:01.660299+0000","last_became_peered":"2024-01-19T04:15:01.660299+0000","last_unstale":"2024-01-19T04:15:03.793684+0000","last_undegraded":"2024-01-19T04:15:03.793684+0000","last_fullsized":"2024-01-19T04:15:03.793684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794140+0000","last_change":"2024-01-19T04:15:02.689947+0000","last_active":"2024-01-19T04:15:03.794140+0000","last_peered":"2024-01-19T04:15:03.794140+0000","last_clean":"2024-01-19T04:15:03.794140+0000","last_became_active":"2024-01-19T04:15:02.689658+0000","last_became_peered":"2024-01-19T04:15:02.689658+0000","last_unstale":"2024-01-19T04:15:03.794140+0000","last_undegraded":"2024-01-19T04:15:03.794140+0000","last_fullsized":"2024-01-19T04:15:03.794140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661163+0000","last_change":"2024-01-19T04:15:01.659005+0000","last_active":"2024-01-19T04:15:03.661163+0000","last_peered":"2024-01-19T04:15:03.661163+0000","last_clean":"2024-01-19T04:15:03.661163+0000","last_became_active":"2024-01-19T04:15:01.658686+0000","last_became_peered":"2024-01-19T04:15:01.658686+0000","last_unstale":"2024-01-19T04:15:03.661163+0000","last_undegraded":"2024-01-19T04:15:03.661163+0000","last_fullsized":"2024-01-19T04:15:03.661163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793563+0000","last_change":"2024-01-19T04:15:02.682480+0000","last_active":"2024-01-19T04:15:03.793563+0000","last_peered":"2024-01-19T04:15:03.793563+0000","last_clean":"2024-01-19T04:15:03.793563+0000","last_became_active":"2024-01-19T04:15:02.681651+0000","last_became_peered":"2024-01-19T04:15:02.681651+0000","last_unstale":"2024-01-19T04:15:03.793563+0000","last_undegraded":"2024-01-19T04:15:03.793563+0000","last_fullsized":"2024-01-19T04:15:03.793563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.655130+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:02.655130+0000","last_peered":"2024-01-19T04:15:02.655130+0000","last_clean":"2024-01-19T04:15:02.655130+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:02.655130+0000","last_undegraded":"2024-01-19T04:15:02.655130+0000","last_fullsized":"2024-01-19T04:15:02.655130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793217+0000","last_change":"2024-01-19T04:15:01.653219+0000","last_active":"2024-01-19T04:15:03.793217+0000","last_peered":"2024-01-19T04:15:03.793217+0000","last_clean":"2024-01-19T04:15:03.793217+0000","last_became_active":"2024-01-19T04:15:01.651102+0000","last_became_peered":"2024-01-19T04:15:01.651102+0000","last_unstale":"2024-01-19T04:15:03.793217+0000","last_undegraded":"2024-01-19T04:15:03.793217+0000","last_fullsized":"2024-01-19T04:15:03.793217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.685553+0000","last_change":"2024-01-19T04:15:02.682206+0000","last_active":"2024-01-19T04:15:02.685553+0000","last_peered":"2024-01-19T04:15:02.685553+0000","last_clean":"2024-01-19T04:15:02.685553+0000","last_became_active":"2024-01-19T04:15:02.681769+0000","last_became_peered":"2024-01-19T04:15:02.681769+0000","last_unstale":"2024-01-19T04:15:02.685553+0000","last_undegraded":"2024-01-19T04:15:02.685553+0000","last_fullsized":"2024-01-19T04:15:02.685553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.437963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:01.662658+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:01.662354+0000","last_became_peered":"2024-01-19T04:15:01.662354+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792635+0000","last_change":"2024-01-19T04:15:02.663011+0000","last_active":"2024-01-19T04:15:03.792635+0000","last_peered":"2024-01-19T04:15:03.792635+0000","last_clean":"2024-01-19T04:15:03.792635+0000","last_became_active":"2024-01-19T04:15:02.661355+0000","last_became_peered":"2024-01-19T04:15:02.661355+0000","last_unstale":"2024-01-19T04:15:03.792635+0000","last_undegraded":"2024-01-19T04:15:03.792635+0000","last_fullsized":"2024-01-19T04:15:03.792635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:28:40.149191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661294+0000","last_change":"2024-01-19T04:15:01.656500+0000","last_active":"2024-01-19T04:15:03.661294+0000","last_peered":"2024-01-19T04:15:03.661294+0000","last_clean":"2024-01-19T04:15:03.661294+0000","last_became_active":"2024-01-19T04:15:01.654782+0000","last_became_peered":"2024-01-19T04:15:01.654782+0000","last_unstale":"2024-01-19T04:15:03.661294+0000","last_undegraded":"2024-01-19T04:15:03.661294+0000","last_fullsized":"2024-01-19T04:15:03.661294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793289+0000","last_change":"2024-01-19T04:15:02.663704+0000","last_active":"2024-01-19T04:15:03.793289+0000","last_peered":"2024-01-19T04:15:03.793289+0000","last_clean":"2024-01-19T04:15:03.793289+0000","last_became_active":"2024-01-19T04:15:02.663466+0000","last_became_peered":"2024-01-19T04:15:02.663466+0000","last_unstale":"2024-01-19T04:15:03.793289+0000","last_undegraded":"2024-01-19T04:15:03.793289+0000","last_fullsized":"2024-01-19T04:15:03.793289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:01.649482+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:01.649196+0000","last_became_peered":"2024-01-19T04:15:01.649196+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663035+0000","last_change":"2024-01-19T04:15:02.666162+0000","last_active":"2024-01-19T04:15:03.663035+0000","last_peered":"2024-01-19T04:15:03.663035+0000","last_clean":"2024-01-19T04:15:03.663035+0000","last_became_active":"2024-01-19T04:15:02.664211+0000","last_became_peered":"2024-01-19T04:15:02.664211+0000","last_unstale":"2024-01-19T04:15:03.663035+0000","last_undegraded":"2024-01-19T04:15:03.663035+0000","last_fullsized":"2024-01-19T04:15:03.663035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:20.226272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:01.661604+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:01.661344+0000","last_became_peered":"2024-01-19T04:15:01.661344+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:02.678390+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:02.678101+0000","last_became_peered":"2024-01-19T04:15:02.678101+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793948+0000","last_change":"2024-01-19T04:15:01.666935+0000","last_active":"2024-01-19T04:15:03.793948+0000","last_peered":"2024-01-19T04:15:03.793948+0000","last_clean":"2024-01-19T04:15:03.793948+0000","last_became_active":"2024-01-19T04:15:01.666614+0000","last_became_peered":"2024-01-19T04:15:01.666614+0000","last_unstale":"2024-01-19T04:15:03.793948+0000","last_undegraded":"2024-01-19T04:15:03.793948+0000","last_fullsized":"2024-01-19T04:15:03.793948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793500+0000","last_change":"2024-01-19T04:15:02.670747+0000","last_active":"2024-01-19T04:15:03.793500+0000","last_peered":"2024-01-19T04:15:03.793500+0000","last_clean":"2024-01-19T04:15:03.793500+0000","last_became_active":"2024-01-19T04:15:02.670497+0000","last_became_peered":"2024-01-19T04:15:02.670497+0000","last_unstale":"2024-01-19T04:15:03.793500+0000","last_undegraded":"2024-01-19T04:15:03.793500+0000","last_fullsized":"2024-01-19T04:15:03.793500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793865+0000","last_change":"2024-01-19T04:15:01.655738+0000","last_active":"2024-01-19T04:15:03.793865+0000","last_peered":"2024-01-19T04:15:03.793865+0000","last_clean":"2024-01-19T04:15:03.793865+0000","last_became_active":"2024-01-19T04:15:01.655435+0000","last_became_peered":"2024-01-19T04:15:01.655435+0000","last_unstale":"2024-01-19T04:15:03.793865+0000","last_undegraded":"2024-01-19T04:15:03.793865+0000","last_fullsized":"2024-01-19T04:15:03.793865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.683746+0000","last_change":"2024-01-19T04:15:02.676099+0000","last_active":"2024-01-19T04:15:02.683746+0000","last_peered":"2024-01-19T04:15:02.683746+0000","last_clean":"2024-01-19T04:15:02.683746+0000","last_became_active":"2024-01-19T04:15:02.675858+0000","last_became_peered":"2024-01-19T04:15:02.675858+0000","last_unstale":"2024-01-19T04:15:02.683746+0000","last_undegraded":"2024-01-19T04:15:02.683746+0000","last_fullsized":"2024-01-19T04:15:02.683746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:49.255283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794005+0000","last_change":"2024-01-19T04:15:01.664964+0000","last_active":"2024-01-19T04:15:03.794005+0000","last_peered":"2024-01-19T04:15:03.794005+0000","last_clean":"2024-01-19T04:15:03.794005+0000","last_became_active":"2024-01-19T04:15:01.664666+0000","last_became_peered":"2024-01-19T04:15:01.664666+0000","last_unstale":"2024-01-19T04:15:03.794005+0000","last_undegraded":"2024-01-19T04:15:03.794005+0000","last_fullsized":"2024-01-19T04:15:03.794005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:02.655983+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:02.655720+0000","last_became_peered":"2024-01-19T04:15:02.655720+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:01.663296+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:01.663010+0000","last_became_peered":"2024-01-19T04:15:01.663010+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663043+0000","last_change":"2024-01-19T04:15:02.662528+0000","last_active":"2024-01-19T04:15:03.663043+0000","last_peered":"2024-01-19T04:15:03.663043+0000","last_clean":"2024-01-19T04:15:03.663043+0000","last_became_active":"2024-01-19T04:15:02.661397+0000","last_became_peered":"2024-01-19T04:15:02.661397+0000","last_unstale":"2024-01-19T04:15:03.663043+0000","last_undegraded":"2024-01-19T04:15:03.663043+0000","last_fullsized":"2024-01-19T04:15:03.663043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:21.142628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793634+0000","last_change":"2024-01-19T04:15:01.664514+0000","last_active":"2024-01-19T04:15:03.793634+0000","last_peered":"2024-01-19T04:15:03.793634+0000","last_clean":"2024-01-19T04:15:03.793634+0000","last_became_active":"2024-01-19T04:15:01.662668+0000","last_became_peered":"2024-01-19T04:15:01.662668+0000","last_unstale":"2024-01-19T04:15:03.793634+0000","last_undegraded":"2024-01-19T04:15:03.793634+0000","last_fullsized":"2024-01-19T04:15:03.793634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.671419+0000","last_change":"2024-01-19T04:15:02.663292+0000","last_active":"2024-01-19T04:15:02.671419+0000","last_peered":"2024-01-19T04:15:02.671419+0000","last_clean":"2024-01-19T04:15:02.671419+0000","last_became_active":"2024-01-19T04:15:02.663012+0000","last_became_peered":"2024-01-19T04:15:02.663012+0000","last_unstale":"2024-01-19T04:15:02.671419+0000","last_undegraded":"2024-01-19T04:15:02.671419+0000","last_fullsized":"2024-01-19T04:15:02.671419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:09.478479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793469+0000","last_change":"2024-01-19T04:15:01.652378+0000","last_active":"2024-01-19T04:15:03.793469+0000","last_peered":"2024-01-19T04:15:03.793469+0000","last_clean":"2024-01-19T04:15:03.793469+0000","last_became_active":"2024-01-19T04:15:01.652057+0000","last_became_peered":"2024-01-19T04:15:01.652057+0000","last_unstale":"2024-01-19T04:15:03.793469+0000","last_undegraded":"2024-01-19T04:15:03.793469+0000","last_fullsized":"2024-01-19T04:15:03.793469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.675417+0000","last_change":"2024-01-19T04:15:02.669867+0000","last_active":"2024-01-19T04:15:02.675417+0000","last_peered":"2024-01-19T04:15:02.675417+0000","last_clean":"2024-01-19T04:15:02.675417+0000","last_became_active":"2024-01-19T04:15:02.669483+0000","last_became_peered":"2024-01-19T04:15:02.669483+0000","last_unstale":"2024-01-19T04:15:02.675417+0000","last_undegraded":"2024-01-19T04:15:02.675417+0000","last_fullsized":"2024-01-19T04:15:02.675417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:15:00.270142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794715+0000","last_change":"2024-01-19T04:15:01.664685+0000","last_active":"2024-01-19T04:15:03.794715+0000","last_peered":"2024-01-19T04:15:03.794715+0000","last_clean":"2024-01-19T04:15:03.794715+0000","last_became_active":"2024-01-19T04:15:01.664311+0000","last_became_peered":"2024-01-19T04:15:01.664311+0000","last_unstale":"2024-01-19T04:15:03.794715+0000","last_undegraded":"2024-01-19T04:15:03.794715+0000","last_fullsized":"2024-01-19T04:15:03.794715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:21:02.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793441+0000","last_change":"2024-01-19T04:15:02.668202+0000","last_active":"2024-01-19T04:15:03.793441+0000","last_peered":"2024-01-19T04:15:03.793441+0000","last_clean":"2024-01-19T04:15:03.793441+0000","last_became_active":"2024-01-19T04:15:02.667661+0000","last_became_peered":"2024-01-19T04:15:02.667661+0000","last_unstale":"2024-01-19T04:15:03.793441+0000","last_undegraded":"2024-01-19T04:15:03.793441+0000","last_fullsized":"2024-01-19T04:15:03.793441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794134+0000","last_change":"2024-01-19T04:15:02.679928+0000","last_active":"2024-01-19T04:15:03.794134+0000","last_peered":"2024-01-19T04:15:03.794134+0000","last_clean":"2024-01-19T04:15:03.794134+0000","last_became_active":"2024-01-19T04:15:02.679629+0000","last_became_peered":"2024-01-19T04:15:02.679629+0000","last_unstale":"2024-01-19T04:15:03.794134+0000","last_undegraded":"2024-01-19T04:15:03.794134+0000","last_fullsized":"2024-01-19T04:15:03.794134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793812+0000","last_change":"2024-01-19T04:15:01.665948+0000","last_active":"2024-01-19T04:15:03.793812+0000","last_peered":"2024-01-19T04:15:03.793812+0000","last_clean":"2024-01-19T04:15:03.793812+0000","last_became_active":"2024-01-19T04:15:01.665641+0000","last_became_peered":"2024-01-19T04:15:01.665641+0000","last_unstale":"2024-01-19T04:15:03.793812+0000","last_undegraded":"2024-01-19T04:15:03.793812+0000","last_fullsized":"2024-01-19T04:15:03.793812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:09.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794795+0000","last_change":"2024-01-19T04:15:02.681662+0000","last_active":"2024-01-19T04:15:03.794795+0000","last_peered":"2024-01-19T04:15:03.794795+0000","last_clean":"2024-01-19T04:15:03.794795+0000","last_became_active":"2024-01-19T04:15:02.681303+0000","last_became_peered":"2024-01-19T04:15:02.681303+0000","last_unstale":"2024-01-19T04:15:03.794795+0000","last_undegraded":"2024-01-19T04:15:03.794795+0000","last_fullsized":"2024-01-19T04:15:03.794795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793675+0000","last_change":"2024-01-19T04:15:01.671175+0000","last_active":"2024-01-19T04:15:03.793675+0000","last_peered":"2024-01-19T04:15:03.793675+0000","last_clean":"2024-01-19T04:15:03.793675+0000","last_became_active":"2024-01-19T04:15:01.670934+0000","last_became_peered":"2024-01-19T04:15:01.670934+0000","last_unstale":"2024-01-19T04:15:03.793675+0000","last_undegraded":"2024-01-19T04:15:03.793675+0000","last_fullsized":"2024-01-19T04:15:03.793675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:02.685102+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:02.684653+0000","last_became_peered":"2024-01-19T04:15:02.684653+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.689927+0000","last_change":"2024-01-19T04:15:01.657663+0000","last_active":"2024-01-19T04:15:02.689927+0000","last_peered":"2024-01-19T04:15:02.689927+0000","last_clean":"2024-01-19T04:15:02.689927+0000","last_became_active":"2024-01-19T04:15:01.657372+0000","last_became_peered":"2024-01-19T04:15:01.657372+0000","last_unstale":"2024-01-19T04:15:02.689927+0000","last_undegraded":"2024-01-19T04:15:02.689927+0000","last_fullsized":"2024-01-19T04:15:02.689927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:24:30.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.676302+0000","last_change":"2024-01-19T04:15:02.670659+0000","last_active":"2024-01-19T04:15:02.676302+0000","last_peered":"2024-01-19T04:15:02.676302+0000","last_clean":"2024-01-19T04:15:02.676302+0000","last_became_active":"2024-01-19T04:15:02.668710+0000","last_became_peered":"2024-01-19T04:15:02.668710+0000","last_unstale":"2024-01-19T04:15:02.676302+0000","last_undegraded":"2024-01-19T04:15:02.676302+0000","last_fullsized":"2024-01-19T04:15:02.676302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:34:19.305228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793688+0000","last_change":"2024-01-19T04:15:01.665080+0000","last_active":"2024-01-19T04:15:03.793688+0000","last_peered":"2024-01-19T04:15:03.793688+0000","last_clean":"2024-01-19T04:15:03.793688+0000","last_became_active":"2024-01-19T04:15:01.663889+0000","last_became_peered":"2024-01-19T04:15:01.663889+0000","last_unstale":"2024-01-19T04:15:03.793688+0000","last_undegraded":"2024-01-19T04:15:03.793688+0000","last_fullsized":"2024-01-19T04:15:03.793688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:03:13.418483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":670753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]}]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":73503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":73663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":670809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:07.155 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:15:07.155 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-19T04:15:07.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-19T04:15:07.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-19T04:15:07.156 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-19T04:15:07.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.328+0000 7f9dc1800640 1 Processor -- start 2024-01-19T04:15:07.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.328+0000 7f9dc1800640 1 -- start start 2024-01-19T04:15:07.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dc1800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9dbc0c54b0 0x7f9dbc06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dc1800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9dbc072310 0x7f9dbc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dc1800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc0c44f0 con 0x7f9dbc155320 2024-01-19T04:15:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dc1800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c4980 con 0x7f9dbc072310 2024-01-19T04:15:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dc1800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c3bc0 con 0x7f9dbc0c54b0 2024-01-19T04:15:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9dbc072310 0x7f9dbc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9dbc072310 0x7f9dbc06d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41042/0 (socket says 172.21.15.32:41042) 2024-01-19T04:15:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbaa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9dbc155320 0x7f9dbc0a4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35832/0 (socket says 172.21.15.32:35832) 2024-01-19T04:15:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbb400640 1 -- 172.21.15.32:0/2634909389 learned_addr learned my addr 172.21.15.32:0/2634909389 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dba000640 1 --2- 172.21.15.32:0/2634909389 >> v2:172.21.15.67:3300/0 conn(0x7f9dbc0c54b0 0x7f9dbc06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbb400640 1 -- 172.21.15.32:0/2634909389 >> v2:172.21.15.67:3300/0 conn(0x7f9dbc0c54b0 msgr2=0x7f9dbc06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:07.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbb400640 1 --2- 172.21.15.32:0/2634909389 >> v2:172.21.15.67:3300/0 conn(0x7f9dbc0c54b0 0x7f9dbc06cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbb400640 1 -- 172.21.15.32:0/2634909389 >> v1:172.21.15.32:6789/0 conn(0x7f9dbc155320 legacy=0x7f9dbc0a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9dbb400640 1 -- 172.21.15.32:0/2634909389 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc0c3ea0 con 0x7f9dbc072310 2024-01-19T04:15:07.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.332+0000 7f9db9600640 1 -- 172.21.15.32:0/2634909389 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753079772 0 0) 0x7f9dbc0c44f0 con 0x7f9dbc155320 2024-01-19T04:15:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dbb400640 1 --2- 172.21.15.32:0/2634909389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc072310 0x7f9dbc06d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc06e090 tx=0x7f9db401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fe5bf8829979de server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9db9600640 1 -- 172.21.15.32:0/2634909389 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40a5800 con 0x7f9dbc072310 2024-01-19T04:15:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9db9600640 1 -- 172.21.15.32:0/2634909389 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db40a5960 con 0x7f9dbc072310 2024-01-19T04:15:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9db9600640 1 -- 172.21.15.32:0/2634909389 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40a5cf0 con 0x7f9dbc072310 2024-01-19T04:15:07.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- 172.21.15.32:0/2634909389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc072310 msgr2=0x7f9dbc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2634909389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc072310 0x7f9dbc06d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc06e090 tx=0x7f9db401c9a0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- 172.21.15.32:0/2634909389 shutdown_connections 2024-01-19T04:15:07.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2634909389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc072310 0x7f9dbc06d1c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2634909389 >> v2:172.21.15.67:3300/0 conn(0x7f9dbc0c54b0 0x7f9dbc06cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- 172.21.15.32:0/2634909389 >> 172.21.15.32:0/2634909389 conn(0x7f9dbc0c5b20 msgr2=0x7f9dbc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:07.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- 172.21.15.32:0/2634909389 shutdown_connections 2024-01-19T04:15:07.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- 172.21.15.32:0/2634909389 wait complete. 2024-01-19T04:15:07.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 Processor -- start 2024-01-19T04:15:07.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- start start 2024-01-19T04:15:07.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9dbc072310 0x7f9dbc1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9dbc0c54b0 0x7f9dbc071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc155320 0x7f9dbc071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1523b0 con 0x7f9dbc155320 2024-01-19T04:15:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1ec9c0 con 0x7f9dbc072310 2024-01-19T04:15:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.336+0000 7f9dc1800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc071210 con 0x7f9dbc0c54b0 2024-01-19T04:15:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc155320 0x7f9dbc071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc155320 0x7f9dbc071d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41058/0 (socket says 172.21.15.32:41058) 2024-01-19T04:15:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 -- 172.21.15.32:0/2832214168 learned_addr learned my addr 172.21.15.32:0/2832214168 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dba000640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9dbc0c54b0 0x7f9dbc071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbaa00640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9dbc072310 0x7f9dbc1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 -- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9dbc0c54b0 msgr2=0x7f9dbc071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9dbc0c54b0 0x7f9dbc071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 -- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9dbc072310 msgr2=0x7f9dbc1531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9dbc072310 0x7f9dbc1531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 -- 172.21.15.32:0/2832214168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4009b30 con 0x7f9dbc155320 2024-01-19T04:15:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dbb400640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc155320 0x7f9dbc071d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9db40195b0 tx=0x7f9db4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9db2a00640 1 -- 172.21.15.32:0/2832214168 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40b8670 con 0x7f9dbc155320 2024-01-19T04:15:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9db2a00640 1 -- 172.21.15.32:0/2832214168 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db40b87f0 con 0x7f9dbc155320 2024-01-19T04:15:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9db2a00640 1 -- 172.21.15.32:0/2832214168 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40b8ba0 con 0x7f9dbc155320 2024-01-19T04:15:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc0a5630 con 0x7f9dbc155320 2024-01-19T04:15:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc151470 con 0x7f9dbc155320 2024-01-19T04:15:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc1ecb30 con 0x7f9dbc155320 2024-01-19T04:15:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.340+0000 7f9db2a00640 1 -- 172.21.15.32:0/2832214168 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9db40b8d00 con 0x7f9dbc155320 2024-01-19T04:15:07.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.344+0000 7f9db2a00640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9d94066500 0x7f9d940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.344+0000 7f9db2a00640 1 -- 172.21.15.32:0/2832214168 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9db411f2a0 con 0x7f9dbc155320 2024-01-19T04:15:07.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.344+0000 7f9dbaa00640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9d94066500 0x7f9d940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.344+0000 7f9dbaa00640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9d94066500 0x7f9d940689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000f70 tx=0x7f9dac007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:07.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.348+0000 7f9db2a00640 1 -- 172.21.15.32:0/2832214168 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9dbc1ecb30 con 0x7f9dbc155320 2024-01-19T04:15:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.544+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9dbc1ecb30 con 0x7f9dbc155320 2024-01-19T04:15:07.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.548+0000 7f9db2a00640 1 -- 172.21.15.32:0/2832214168 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164166 (secure 0 0 0) 0x7f9dbc1ecb30 con 0x7f9dbc155320 2024-01-19T04:15:07.554 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9d94066500 msgr2=0x7f9d940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9d94066500 0x7f9d940689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000f70 tx=0x7f9dac007df0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc155320 msgr2=0x7f9dbc071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc155320 0x7f9dbc071d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9db40195b0 tx=0x7f9db4019740 comp rx=0 tx=0).stop 2024-01-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 shutdown_connections 2024-01-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9d94066500 0x7f9d940689c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dbc155320 0x7f9dbc071d40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9dbc0c54b0 0x7f9dbc071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 --2- 172.21.15.32:0/2832214168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9dbc072310 0x7f9dbc1531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 >> 172.21.15.32:0/2832214168 conn(0x7f9dbc0c5b20 msgr2=0x7f9dbc153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 shutdown_connections 2024-01-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.552+0000 7f9dc1800640 1 -- 172.21.15.32:0/2832214168 wait complete. 2024-01-19T04:15:07.574 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":873967597},{"type":"v1","addr":"172.21.15.67:6833","nonce":873967597}]},"active_addr":"172.21.15.67:6833/873967597","active_change":"2024-01-19T04:14:42.013459+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3779766811}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":1293818662}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3054129651}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":4028161810}]}]} 2024-01-19T04:15:07.578 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-19T04:15:07.578 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-19T04:15:07.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f6885c00640 1 Processor -- start 2024-01-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f6885c00640 1 -- start start 2024-01-19T04:15:07.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f6885c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6880072310 0x7f688006d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f6885c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800c44f0 con 0x7f6880155320 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f6885c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800c4980 con 0x7f68800c54b0 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f6885c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800c3bc0 con 0x7f6880072310 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f687f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6880072310 0x7f688006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f687ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6880155320 0x7f68800a4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35836/0 (socket says 172.21.15.32:35836) 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f687f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6880072310 0x7f688006d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41062/0 (socket says 172.21.15.32:41062) 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f687ea00640 1 -- 172.21.15.32:0/540067909 learned_addr learned my addr 172.21.15.32:0/540067909 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:07.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f687f400640 1 -- 172.21.15.32:0/540067909 >> v1:172.21.15.67:6789/0 conn(0x7f68800c54b0 legacy=0x7f688006cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f687f400640 1 -- 172.21.15.32:0/540067909 >> v1:172.21.15.32:6789/0 conn(0x7f6880155320 legacy=0x7f68800a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.716+0000 7f687f400640 1 -- 172.21.15.32:0/540067909 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800c3ea0 con 0x7f6880072310 2024-01-19T04:15:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f687f400640 1 --2- 172.21.15.32:0/540067909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880072310 0x7f688006d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6878009d90 tx=0x7f687801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764f2c1fb678e2da server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f687d600640 1 -- 172.21.15.32:0/540067909 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780a5a00 con 0x7f6880072310 2024-01-19T04:15:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f687d600640 1 -- 172.21.15.32:0/540067909 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68780a5b60 con 0x7f6880072310 2024-01-19T04:15:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f687d600640 1 -- 172.21.15.32:0/540067909 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780ad440 con 0x7f6880072310 2024-01-19T04:15:07.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f6885c00640 1 -- 172.21.15.32:0/540067909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880072310 msgr2=0x7f688006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f6885c00640 1 --2- 172.21.15.32:0/540067909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880072310 0x7f688006d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6878009d90 tx=0x7f687801c920 comp rx=0 tx=0).stop 2024-01-19T04:15:07.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f6885c00640 1 -- 172.21.15.32:0/540067909 shutdown_connections 2024-01-19T04:15:07.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f6885c00640 1 --2- 172.21.15.32:0/540067909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880072310 0x7f688006d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f6885c00640 1 -- 172.21.15.32:0/540067909 >> 172.21.15.32:0/540067909 conn(0x7f68800c5b20 msgr2=0x7f68800c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f6885c00640 1 -- 172.21.15.32:0/540067909 shutdown_connections 2024-01-19T04:15:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.720+0000 7f6885c00640 1 -- 172.21.15.32:0/540067909 wait complete. 2024-01-19T04:15:07.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 Processor -- start 2024-01-19T04:15:07.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 -- start start 2024-01-19T04:15:07.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6880072310 0x7f68800a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68800c54b0 0x7f68800aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880155320 0x7f6880071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68800ab300 con 0x7f6880155320 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801f0ca0 con 0x7f6880072310 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68801f0970 con 0x7f68800c54b0 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880155320 0x7f6880071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880155320 0x7f6880071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41078/0 (socket says 172.21.15.32:41078) 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 -- 172.21.15.32:0/1308067248 learned_addr learned my addr 172.21.15.32:0/1308067248 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687ea00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6880072310 0x7f68800a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687e000640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68800c54b0 0x7f68800aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 -- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68800c54b0 msgr2=0x7f68800aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68800c54b0 0x7f68800aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 -- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6880072310 msgr2=0x7f68800a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6880072310 0x7f68800a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 -- 172.21.15.32:0/1308067248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878009a70 con 0x7f6880155320 2024-01-19T04:15:07.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f687f400640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880155320 0x7f6880071070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f687801a550 tx=0x7f68780196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:07.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6876a00640 1 -- 172.21.15.32:0/1308067248 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780add10 con 0x7f6880155320 2024-01-19T04:15:07.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6876a00640 1 -- 172.21.15.32:0/1308067248 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68780ade70 con 0x7f6880155320 2024-01-19T04:15:07.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6876a00640 1 -- 172.21.15.32:0/1308067248 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780b7610 con 0x7f6880155320 2024-01-19T04:15:07.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.724+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6880151730 con 0x7f6880155320 2024-01-19T04:15:07.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.728+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6880151cf0 con 0x7f6880155320 2024-01-19T04:15:07.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.728+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68801f0ab0 con 0x7f6880155320 2024-01-19T04:15:07.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.728+0000 7f6876a00640 1 -- 172.21.15.32:0/1308067248 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f68780b4050 con 0x7f6880155320 2024-01-19T04:15:07.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.728+0000 7f6876a00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6858066500 0x7f68580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:07.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.728+0000 7f6876a00640 1 -- 172.21.15.32:0/1308067248 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f687811f3c0 con 0x7f6880155320 2024-01-19T04:15:07.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.728+0000 7f687ea00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6858066500 0x7f68580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:07.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.728+0000 7f687ea00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6858066500 0x7f68580689c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6870005890 tx=0x7f6870009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:07.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.732+0000 7f6876a00640 1 -- 172.21.15.32:0/1308067248 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f68780ec820 con 0x7f6880155320 2024-01-19T04:15:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68801f0e10 con 0x7f6880155320 2024-01-19T04:15:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6876a00640 1 -- 172.21.15.32:0/1308067248 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f68780efe40 con 0x7f6880155320 2024-01-19T04:15:07.899 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:07.899 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6858066500 msgr2=0x7f68580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6858066500 0x7f68580689c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6870005890 tx=0x7f6870009040 comp rx=0 tx=0).stop 2024-01-19T04:15:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880155320 msgr2=0x7f6880071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880155320 0x7f6880071070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f687801a550 tx=0x7f68780196c0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 shutdown_connections 2024-01-19T04:15:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6858066500 0x7f68580689c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6880155320 0x7f6880071070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68800c54b0 0x7f68800aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 --2- 172.21.15.32:0/1308067248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6880072310 0x7f68800a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 >> 172.21.15.32:0/1308067248 conn(0x7f68800c5b20 msgr2=0x7f68800c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 shutdown_connections 2024-01-19T04:15:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:07.896+0000 7f6885c00640 1 -- 172.21.15.32:0/1308067248 wait complete. 2024-01-19T04:15:07.920 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-19T04:15:07.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:08.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d92a00640 1 Processor -- start 2024-01-19T04:15:08.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d92a00640 1 -- start start 2024-01-19T04:15:08.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d92a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d8c14fea0 0x7f1d8c0c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c0726c0 0x7f1d8c071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d92a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c156720 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d92a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0c1630 con 0x7f1d8c14fea0 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d92a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1569c0 con 0x7f1d8c0726c0 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d8be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d8c14fea0 0x7f1d8c0c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d8be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d8c14fea0 0x7f1d8c0c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34282/0 (socket says 172.21.15.32:34282) 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d8be00640 1 -- 172.21.15.32:0/3457575315 learned_addr learned my addr 172.21.15.32:0/3457575315 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d90a00640 1 --2- 172.21.15.32:0/3457575315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c0726c0 0x7f1d8c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d8be00640 1 -- 172.21.15.32:0/3457575315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c0726c0 msgr2=0x7f1d8c071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d8be00640 1 --2- 172.21.15.32:0/3457575315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c0726c0 0x7f1d8c071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d8be00640 1 -- 172.21.15.32:0/3457575315 >> v1:172.21.15.67:6789/0 conn(0x7f1d8c0a5f60 legacy=0x7f1d8c06a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.060+0000 7f1d8be00640 1 -- 172.21.15.32:0/3457575315 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0c18f0 con 0x7f1d8c14fea0 2024-01-19T04:15:08.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d8be00640 1 --2- 172.21.15.32:0/3457575315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c14fea0 0x7f1d8c0c2ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009870 tx=0x7f1d7c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a28e6d5ddf38e87 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d8aa00640 1 -- 172.21.15.32:0/3457575315 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c071d60 con 0x7f1d8c14fea0 2024-01-19T04:15:08.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d8aa00640 1 -- 172.21.15.32:0/3457575315 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0a7070 con 0x7f1d8c14fea0 2024-01-19T04:15:08.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d8aa00640 1 -- 172.21.15.32:0/3457575315 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0ab860 con 0x7f1d8c14fea0 2024-01-19T04:15:08.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 -- 172.21.15.32:0/3457575315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c14fea0 msgr2=0x7f1d8c0c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3457575315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c14fea0 0x7f1d8c0c2ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009870 tx=0x7f1d7c01c420 comp rx=0 tx=0).stop 2024-01-19T04:15:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 -- 172.21.15.32:0/3457575315 shutdown_connections 2024-01-19T04:15:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3457575315 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c0726c0 0x7f1d8c071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3457575315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c14fea0 0x7f1d8c0c2ff0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 -- 172.21.15.32:0/3457575315 >> 172.21.15.32:0/3457575315 conn(0x7f1d8c0c6b30 msgr2=0x7f1d8c0c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 -- 172.21.15.32:0/3457575315 shutdown_connections 2024-01-19T04:15:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.064+0000 7f1d92a00640 1 -- 172.21.15.32:0/3457575315 wait complete. 2024-01-19T04:15:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 Processor -- start 2024-01-19T04:15:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 -- start start 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d8c0726c0 0x7f1d8c156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c0a5f60 0x7f1d8c0c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c14fea0 0x7f1d8c0c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c157510 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1ef3a0 con 0x7f1d8c0726c0 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1ef0c0 con 0x7f1d8c14fea0 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c0a5f60 0x7f1d8c0c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c0a5f60 0x7f1d8c0c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34286/0 (socket says 172.21.15.32:34286) 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 -- 172.21.15.32:0/3516187801 learned_addr learned my addr 172.21.15.32:0/3516187801 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d90a00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c14fea0 0x7f1d8c0c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8be00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d8c0726c0 0x7f1d8c156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 -- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c14fea0 msgr2=0x7f1d8c0c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c14fea0 0x7f1d8c0c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 -- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d8c0726c0 msgr2=0x7f1d8c156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d8c0726c0 0x7f1d8c156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 -- 172.21.15.32:0/3516187801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0094d0 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d8b400640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c0a5f60 0x7f1d8c0c6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1d74007fd0 tx=0x7f1d7400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d83e00640 1 -- 172.21.15.32:0/3516187801 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740052d0 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d83e00640 1 -- 172.21.15.32:0/3516187801 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d74005430 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d83e00640 1 -- 172.21.15.32:0/3516187801 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74003840 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c0ac0b0 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c0ac670 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.068+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c0c2370 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.072+0000 7f1d83e00640 1 -- 172.21.15.32:0/3516187801 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1d740039a0 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.072+0000 7f1d83e00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d64066530 0x7f1d640689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.072+0000 7f1d83e00640 1 -- 172.21.15.32:0/3516187801 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d74083490 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.072+0000 7f1d8be00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d64066530 0x7f1d640689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.072+0000 7f1d8be00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d64066530 0x7f1d640689f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0af000 tx=0x7f1d7c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.076+0000 7f1d83e00640 1 -- 172.21.15.32:0/3516187801 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1d740506c0 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.236+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d8c0acbc0 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.236+0000 7f1d83e00640 1 -- 172.21.15.32:0/3516187801 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f1d74053ce0 con 0x7f1d8c0a5f60 2024-01-19T04:15:08.240 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:08.240 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d64066530 msgr2=0x7f1d640689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d64066530 0x7f1d640689f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0af000 tx=0x7f1d7c0b6040 comp rx=0 tx=0).stop 2024-01-19T04:15:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c0a5f60 msgr2=0x7f1d8c0c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c0a5f60 0x7f1d8c0c6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1d74007fd0 tx=0x7f1d7400c890 comp rx=0 tx=0).stop 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 shutdown_connections 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d64066530 0x7f1d640689f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d8c14fea0 0x7f1d8c0c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d8c0a5f60 0x7f1d8c0c6240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 --2- 172.21.15.32:0/3516187801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d8c0726c0 0x7f1d8c156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 >> 172.21.15.32:0/3516187801 conn(0x7f1d8c0c6b30 msgr2=0x7f1d8c0a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 shutdown_connections 2024-01-19T04:15:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.240+0000 7f1d92a00640 1 -- 172.21.15.32:0/3516187801 wait complete. 2024-01-19T04:15:08.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-19T04:15:08.263 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-19T04:15:08.263 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-19T04:15:08.263 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-19T04:15:08.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-19T04:15:08.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-19T04:15:08.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-19T04:15:08.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-19T04:15:08.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.504+0000 7f6ae9600640 1 Processor -- start 2024-01-19T04:15:08.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.504+0000 7f6ae9600640 1 -- start start 2024-01-19T04:15:08.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.504+0000 7f202b200640 1 Processor -- start 2024-01-19T04:15:08.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.504+0000 7f9712000640 1 Processor -- start 2024-01-19T04:15:08.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.504+0000 7f202b200640 1 -- start start 2024-01-19T04:15:08.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.504+0000 7f9712000640 1 -- start start 2024-01-19T04:15:08.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f6ae9600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4155540 0x7f6ae40a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f6ae9600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae41581f0 con 0x7f6ae40a5250 2024-01-19T04:15:08.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f6ae9600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae41584d0 con 0x7f6ae4157cf0 2024-01-19T04:15:08.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f6ae9600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae41587b0 con 0x7f6ae4155540 2024-01-19T04:15:08.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f202b200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f202c1513c0 0x7f202c0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f202b200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f202b200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c1517a0 con 0x7f202c0721a0 2024-01-19T04:15:08.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f202b200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0c1de0 con 0x7f202c1513c0 2024-01-19T04:15:08.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f202b200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c06c860 con 0x7f202c0c6470 2024-01-19T04:15:08.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f9712000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c072310 0x7f970c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f9712000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c0c44f0 con 0x7f970c0c54b0 2024-01-19T04:15:08.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f9712000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c0c4980 con 0x7f970c155320 2024-01-19T04:15:08.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f9712000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0c3bc0 con 0x7f970c072310 2024-01-19T04:15:08.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f970be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c072310 0x7f970c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f970be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c072310 0x7f970c06d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:38842/0 (socket says 172.21.15.32:38842) 2024-01-19T04:15:08.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f970be00640 1 -- 172.21.15.32:0/2684879744 learned_addr learned my addr 172.21.15.32:0/2684879744 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f6ae2000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6ae4157cf0 0x7f6ae406d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50362/0 (socket says 172.21.15.32:50362) 2024-01-19T04:15:08.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f6ae2000640 1 -- 172.21.15.32:0/2789225714 learned_addr learned my addr 172.21.15.32:0/2789225714 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f6ae2a00640 1 --2- 172.21.15.32:0/2789225714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4155540 0x7f6ae40a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264866044 0 0) 0x7f970c0c44f0 con 0x7f970c0c54b0 2024-01-19T04:15:08.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ec003530 con 0x7f970c0c54b0 2024-01-19T04:15:08.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f6ae1600640 1 -- 172.21.15.32:0/2789225714 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359759665 0 0) 0x7f6ae41584d0 con 0x7f6ae4157cf0 2024-01-19T04:15:08.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f6ae2a00640 1 -- 172.21.15.32:0/2789225714 >> v1:172.21.15.67:6789/0 conn(0x7f6ae4157cf0 legacy=0x7f6ae406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f6ae2a00640 1 -- 172.21.15.32:0/2789225714 >> v1:172.21.15.32:6789/0 conn(0x7f6ae40a5250 legacy=0x7f6ae406d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f6ae2a00640 1 -- 172.21.15.32:0/2789225714 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4158a90 con 0x7f6ae4155540 2024-01-19T04:15:08.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f2029400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f202c0721a0 0x7f202c070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50370/0 (socket says 172.21.15.32:50370) 2024-01-19T04:15:08.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.508+0000 7f2029400640 1 -- 172.21.15.32:0/1802849541 learned_addr learned my addr 172.21.15.32:0/1802849541 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f202a800640 1 --2- 172.21.15.32:0/1802849541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f2029e00640 1 --2- 172.21.15.32:0/1802849541 >> v2:172.21.15.67:3300/0 conn(0x7f202c1513c0 0x7f202c0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f2028a00640 1 -- 172.21.15.32:0/1802849541 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250069918 0 0) 0x7f202c1517a0 con 0x7f202c0721a0 2024-01-19T04:15:08.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f2028a00640 1 -- 172.21.15.32:0/1802849541 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f200c007940 con 0x7f202c0721a0 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039961905 0 0) 0x7f970c0c4980 con 0x7f970c155320 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ec003850 con 0x7f970c155320 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3299927730 0 0) 0x7f96ec003530 con 0x7f970c0c54b0 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c072310 msgr2=0x7f970c06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c072310 0x7f970c06d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 >> v1:172.21.15.67:6789/0 conn(0x7f970c155320 legacy=0x7f970c0a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0c3ea0 con 0x7f970c0c54b0 2024-01-19T04:15:08.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f96f4001660 con 0x7f970c0c54b0 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 >> v1:172.21.15.32:6789/0 conn(0x7f970c0c54b0 legacy=0x7f970c06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96ec003cf0 0x7f96ec004110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec0047d0 0x7f96ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec0051e0 0x7f96ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0c3bc0 con 0x7f96ec0047d0 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec00c110 con 0x7f96ec0051e0 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec00c2d0 con 0x7f96ec003cf0 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970b400640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96ec003cf0 0x7f96ec004110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970b400640 1 -- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec0051e0 msgr2=0x7f96ec00b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970b400640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec0051e0 0x7f96ec00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f202a800640 1 -- 172.21.15.32:0/1802849541 >> v2:172.21.15.67:3300/0 conn(0x7f202c1513c0 msgr2=0x7f202c0c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f202a800640 1 --2- 172.21.15.32:0/1802849541 >> v2:172.21.15.67:3300/0 conn(0x7f202c1513c0 0x7f202c0c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f202a800640 1 -- 172.21.15.32:0/1802849541 >> v1:172.21.15.67:6789/0 conn(0x7f202c0721a0 legacy=0x7f202c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f202a800640 1 -- 172.21.15.32:0/1802849541 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c06bfe0 con 0x7f202c0c6470 2024-01-19T04:15:08.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae2a00640 1 --2- 172.21.15.32:0/2789225714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4155540 0x7f6ae40a4d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0097f0 tx=0x7f6acc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f9fbd1ce225eb9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970b400640 1 -- 172.21.15.32:0/2684879744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec0047d0 msgr2=0x7f96ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970b400640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec0047d0 0x7f96ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.512+0000 7f970b400640 1 -- 172.21.15.32:0/2684879744 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0c3ea0 con 0x7f96ec003cf0 2024-01-19T04:15:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae1600640 1 -- 172.21.15.32:0/2789225714 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0ab670 con 0x7f6ae4155540 2024-01-19T04:15:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae1600640 1 -- 172.21.15.32:0/2789225714 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc0ab7d0 con 0x7f6ae4155540 2024-01-19T04:15:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae1600640 1 -- 172.21.15.32:0/2789225714 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0ab670 con 0x7f6ae4155540 2024-01-19T04:15:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae9600640 1 -- 172.21.15.32:0/2789225714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4155540 msgr2=0x7f6ae40a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae9600640 1 --2- 172.21.15.32:0/2789225714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4155540 0x7f6ae40a4d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0097f0 tx=0x7f6acc01c470 comp rx=0 tx=0).stop 2024-01-19T04:15:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7fae0c800640 1 Processor -- start 2024-01-19T04:15:08.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae9600640 1 -- 172.21.15.32:0/2789225714 shutdown_connections 2024-01-19T04:15:08.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae9600640 1 --2- 172.21.15.32:0/2789225714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4155540 0x7f6ae40a4d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f6ae9600640 1 -- 172.21.15.32:0/2789225714 >> 172.21.15.32:0/2789225714 conn(0x7f6ae40c5b20 msgr2=0x7f6ae40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f6ae9600640 1 -- 172.21.15.32:0/2789225714 shutdown_connections 2024-01-19T04:15:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f6ae9600640 1 -- 172.21.15.32:0/2789225714 wait complete. 2024-01-19T04:15:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.516+0000 7f2029e00640 1 --2- 172.21.15.32:0/1802849541 >> v2:172.21.15.67:3300/0 conn(0x7f202c1513c0 0x7f202c0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f970b400640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96ec003cf0 0x7f96ec004110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97040018e0 tx=0x7f970401ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1ac94ac0c300e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7fae0c800640 1 -- start start 2024-01-19T04:15:08.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040052d0 con 0x7f96ec003cf0 2024-01-19T04:15:08.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f970a000640 1 -- 172.21.15.32:0/2684879744 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9704005430 con 0x7f96ec003cf0 2024-01-19T04:15:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f202a800640 1 --2- 172.21.15.32:0/1802849541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c070780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f202400bd20 tx=0x7f202401c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=948865acbb774ee9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f2028a00640 1 -- 172.21.15.32:0/1802849541 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240a5810 con 0x7f202c0c6470 2024-01-19T04:15:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f2028a00640 1 -- 172.21.15.32:0/1802849541 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20240a9070 con 0x7f202c0c6470 2024-01-19T04:15:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f2028a00640 1 -- 172.21.15.32:0/1802849541 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240a5bf0 con 0x7f202c0c6470 2024-01-19T04:15:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f9712000640 1 -- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96ec003cf0 msgr2=0x7f96ec004110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f9712000640 1 --2- 172.21.15.32:0/2684879744 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96ec003cf0 0x7f96ec004110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97040018e0 tx=0x7f970401ec30 comp rx=0 tx=0).stop 2024-01-19T04:15:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f970be00640 1 -- 172.21.15.32:0/2684879744 reap_dead start 2024-01-19T04:15:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f6ae9600640 1 Processor -- start 2024-01-19T04:15:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f6ae9600640 1 -- start start 2024-01-19T04:15:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f202b200640 1 -- 172.21.15.32:0/1802849541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 msgr2=0x7f202c070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f202b200640 1 --2- 172.21.15.32:0/1802849541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c070780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f202400bd20 tx=0x7f202401c770 comp rx=0 tx=0).stop 2024-01-19T04:15:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f9712000640 1 -- 172.21.15.32:0/2684879744 shutdown_connections 2024-01-19T04:15:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f2dbde00640 1 Processor -- start 2024-01-19T04:15:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7f202b200640 1 -- 172.21.15.32:0/1802849541 shutdown_connections 2024-01-19T04:15:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7fae0c800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fae040727f0 0x7fae040a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7fae0c800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040c3f10 0x7fae040c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7fae0c800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0406e8a0 con 0x7fae0406e1e0 2024-01-19T04:15:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7fae0c800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae04154750 con 0x7fae040727f0 2024-01-19T04:15:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.520+0000 7fae0c800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040720a0 con 0x7fae040c3f10 2024-01-19T04:15:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f202b200640 1 --2- 172.21.15.32:0/1802849541 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c070780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae09e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fae0406e1e0 0x7fae0414db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47312/0 (socket says 172.21.15.32:47312) 2024-01-19T04:15:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae09e00640 1 -- 172.21.15.32:0/1586793651 learned_addr learned my addr 172.21.15.32:0/1586793651 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae09400640 1 --2- 172.21.15.32:0/1586793651 >> v2:172.21.15.67:3300/0 conn(0x7fae040727f0 0x7fae040a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f9712000640 1 -- 172.21.15.32:0/2684879744 >> 172.21.15.32:0/2684879744 conn(0x7f970c0c5b20 msgr2=0x7f970c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ae40a5250 0x7f6ae4158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f202b200640 1 --2- 172.21.15.32:0/1802849541 >> v2:172.21.15.67:3300/0 conn(0x7f202c1513c0 0x7f202c0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f202b200640 1 -- 172.21.15.32:0/1802849541 >> 172.21.15.32:0/1802849541 conn(0x7f202c0a7a20 msgr2=0x7f202c0a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae9600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ae4155540 0x7f6ae40a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae9600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4157cf0 0x7f6ae40ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae9600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40aad80 con 0x7f6ae4155540 2024-01-19T04:15:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae9600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40aa700 con 0x7f6ae40a5250 2024-01-19T04:15:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae9600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae41edcc0 con 0x7f6ae4157cf0 2024-01-19T04:15:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f2dbde00640 1 -- start start 2024-01-19T04:15:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae09400640 1 -- 172.21.15.32:0/1586793651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040c3f10 msgr2=0x7fae040c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae09400640 1 --2- 172.21.15.32:0/1586793651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040c3f10 0x7fae040c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae09400640 1 -- 172.21.15.32:0/1586793651 >> v1:172.21.15.32:6789/0 conn(0x7fae0406e1e0 legacy=0x7fae0414db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ae4155540 0x7f6ae40a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ae40a5250 0x7f6ae4158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae09400640 1 -- 172.21.15.32:0/1586793651 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae041506b0 con 0x7fae040727f0 2024-01-19T04:15:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7fae08a00640 1 -- 172.21.15.32:0/1586793651 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321743157 0 0) 0x7fae0406e8a0 con 0x7fae0406e1e0 2024-01-19T04:15:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4157cf0 0x7f6ae40ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ae40a5250 0x7f6ae4158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38766/0 (socket says 172.21.15.32:38766) 2024-01-19T04:15:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae2a00640 1 -- 172.21.15.32:0/2523844441 learned_addr learned my addr 172.21.15.32:0/2523844441 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f202b200640 1 -- 172.21.15.32:0/1802849541 shutdown_connections 2024-01-19T04:15:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f202b200640 1 -- 172.21.15.32:0/1802849541 wait complete. 2024-01-19T04:15:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7feeb7000640 1 Processor -- start 2024-01-19T04:15:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae3400640 1 -- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ae40a5250 msgr2=0x7f6ae4158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae3400640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ae40a5250 0x7f6ae4158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae3400640 1 -- 172.21.15.32:0/2523844441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ae4155540 msgr2=0x7f6ae40a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae3400640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ae4155540 0x7f6ae40a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f6ae3400640 1 -- 172.21.15.32:0/2523844441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc009420 con 0x7f6ae4157cf0 2024-01-19T04:15:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7feeb7000640 1 -- start start 2024-01-19T04:15:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f9712000640 1 -- 172.21.15.32:0/2684879744 shutdown_connections 2024-01-19T04:15:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.524+0000 7f9712000640 1 -- 172.21.15.32:0/2684879744 wait complete. 2024-01-19T04:15:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2dbde00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806f520 0x7f2db806f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f6ae3400640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4157cf0 0x7f6ae40ab1a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c7b0 tx=0x7f6ad400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2dbde00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2db806ecf0 0x7f2db8158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2dbde00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db8158fe0 con 0x7f2db806e8a0 2024-01-19T04:15:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2dbde00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80a8d80 con 0x7f2db806ecf0 2024-01-19T04:15:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2dbde00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80aa150 con 0x7f2db806f520 2024-01-19T04:15:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4003d90 con 0x7f6ae4157cf0 2024-01-19T04:15:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f6ae9600640 1 -- 172.21.15.32:0/2523844441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae40aa9a0 con 0x7f6ae4157cf0 2024-01-19T04:15:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400ce60 con 0x7f6ae4157cf0 2024-01-19T04:15:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40052b0 con 0x7f6ae4157cf0 2024-01-19T04:15:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f6ae9600640 1 -- 172.21.15.32:0/2523844441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae415a1e0 con 0x7f6ae4157cf0 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 Processor -- start 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 -- start start 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2db806ecf0 0x7f2db8158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2db806ecf0 0x7f2db8158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38768/0 (socket says 172.21.15.32:38768) 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db7e00640 1 -- 172.21.15.32:0/2093112055 learned_addr learned my addr 172.21.15.32:0/2093112055 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb7000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7feeb00c1860 0x7feeb00c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb7000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feeb0158e40 0x7feeb0159220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb7000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb0071c20 con 0x7feeb01561c0 2024-01-19T04:15:08.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb7000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb0071ec0 con 0x7feeb00c1860 2024-01-19T04:15:08.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb7000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00721a0 con 0x7feeb0158e40 2024-01-19T04:15:08.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb5000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feeb0158e40 0x7feeb0159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeaf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7feeb00c1860 0x7feeb00c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb5000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feeb0158e40 0x7feeb0159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38782/0 (socket says 172.21.15.32:38782) 2024-01-19T04:15:08.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7feeb5000640 1 -- 172.21.15.32:0/1283928070 learned_addr learned my addr 172.21.15.32:0/1283928070 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f205e000640 1 Processor -- start 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ae40749f0 con 0x7f6ae4157cf0 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6ad4005410 con 0x7f6ae4157cf0 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f6adaa00640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6abc066550 0x7f6abc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ad4083490 con 0x7f6ae4157cf0 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f6ae2a00640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6abc066550 0x7f6abc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f6adaa00640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7f6abc06e6f0 0x7f6abc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 --> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6abc0711c0 con 0x7f6abc06e6f0 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f6ae2000640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7f6abc06e6f0 0x7f6abc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0721a0 0x7f202c14b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c1f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f202c1513c0 0x7f202c1f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1f48d0 con 0x7f202c1513c0 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1f57e0 con 0x7f202c0721a0 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f202b200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0a2f20 con 0x7f202c0c6470 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f202a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f202c1513c0 0x7f202c1f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0721a0 0x7f202c14b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0721a0 0x7f202c14b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38784/0 (socket says 172.21.15.32:38784) 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 -- 172.21.15.32:0/3737522514 learned_addr learned my addr 172.21.15.32:0/3737522514 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029400640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c1f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f202a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f202c1513c0 0x7f202c1f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34314/0 (socket says 172.21.15.32:34314) 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 -- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 msgr2=0x7f202c1f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f202c0c6470 0x7f202c1f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 -- 172.21.15.32:0/3737522514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f202c1513c0 msgr2=0x7f202c1f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f202c1513c0 0x7f202c1f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 -- 172.21.15.32:0/3737522514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202400b980 con 0x7f202c0721a0 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2029e00640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0721a0 0x7f202c14b710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f201400e810 tx=0x7f201400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400c8d0 con 0x7f202c0721a0 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400ca30 con 0x7f202c0721a0 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400cdc0 con 0x7f202c0721a0 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c14fc10 con 0x7f202c0721a0 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c0a2540 con 0x7f202c0721a0 2024-01-19T04:15:08.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f9712000640 1 Processor -- start 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db6a00640 1 --2- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806f520 0x7f2db806f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db7e00640 1 -- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806f520 msgr2=0x7f2db806f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db7e00640 1 --2- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806f520 0x7f2db806f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db7e00640 1 -- 172.21.15.32:0/2093112055 >> v1:172.21.15.67:6789/0 conn(0x7f2db806e8a0 legacy=0x7f2db80a9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f2db7e00640 1 -- 172.21.15.32:0/2093112055 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80c3c50 con 0x7f2db806ecf0 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7fae09400640 1 --2- 172.21.15.32:0/1586793651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040727f0 0x7fae040a9c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadec0097c0 tx=0x7fadec01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf67c0e56c095d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7fae08a00640 1 -- 172.21.15.32:0/1586793651 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec0a8970 con 0x7fae040727f0 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7fae08a00640 1 -- 172.21.15.32:0/1586793651 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec0a8ad0 con 0x7fae040727f0 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7fae08a00640 1 -- 172.21.15.32:0/1586793651 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec0a8970 con 0x7fae040727f0 2024-01-19T04:15:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7fae0c800640 1 -- 172.21.15.32:0/1586793651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040727f0 msgr2=0x7fae040a9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7fae0c800640 1 --2- 172.21.15.32:0/1586793651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040727f0 0x7fae040a9c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadec0097c0 tx=0x7fadec01ec70 comp rx=0 tx=0).stop 2024-01-19T04:15:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7feeaf400640 1 -- 172.21.15.32:0/1283928070 >> v2:172.21.15.67:3300/0 conn(0x7feeb0158e40 msgr2=0x7feeb0159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7feeaf400640 1 --2- 172.21.15.32:0/1283928070 >> v2:172.21.15.67:3300/0 conn(0x7feeb0158e40 0x7feeb0159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7feeaf400640 1 -- 172.21.15.32:0/1283928070 >> v1:172.21.15.32:6789/0 conn(0x7feeb01561c0 legacy=0x7feeb006cd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:15:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7feeaf400640 1 -- 172.21.15.32:0/1283928070 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0072480 con 0x7feeb00c1860 2024-01-19T04:15:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7feeb5000640 1 --2- 172.21.15.32:0/1283928070 >> v2:172.21.15.67:3300/0 conn(0x7feeb0158e40 0x7feeb0159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.528+0000 7f205e000640 1 -- start start 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f205e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2058151480 0x7f20580c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f205e000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2058150ff0 con 0x7f20580718b0 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f205e000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20580ab9a0 con 0x7f20580aa600 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f205e000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580ab6c0 con 0x7f2058151480 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f20580718b0 0x7f2058153e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47318/0 (socket says 172.21.15.32:47318) 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056a00640 1 -- 172.21.15.32:0/3668858016 learned_addr learned my addr 172.21.15.32:0/3668858016 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2057400640 1 --1- 172.21.15.32:0/3668858016 >> v1:172.21.15.67:6789/0 conn(0x7f20580aa600 0x7f20580aae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50404/0 (socket says 172.21.15.32:50404) 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130737007 0 0) 0x7f2058150ff0 con 0x7f20580718b0 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2038003530 con 0x7f20580718b0 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2057e00640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2058151480 0x7f20580c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925777569 0 0) 0x7f20580ab9a0 con 0x7f20580aa600 2024-01-19T04:15:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2058150ff0 con 0x7f20580aa600 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3913094886 0 0) 0x7f2038003530 con 0x7f20580718b0 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2058151480 msgr2=0x7f20580c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2058151480 0x7f20580c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 >> v1:172.21.15.67:6789/0 conn(0x7f20580aa600 legacy=0x7f20580aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20581509a0 con 0x7f20580718b0 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f2040001680 con 0x7f20580718b0 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 >> v1:172.21.15.32:6789/0 conn(0x7f20580718b0 legacy=0x7f2058153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2038003b40 0x7f2038003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20380047d0 0x7f2038004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20380051e0 0x7f203800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580ab6c0 con 0x7f2038003b40 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203800c0c0 con 0x7f20380047d0 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203800c280 con 0x7f20380051e0 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2056a00640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20380047d0 0x7f2038004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2057400640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2038003b40 0x7f2038003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2057e00640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20380051e0 0x7f203800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f2057400640 1 -- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20380051e0 msgr2=0x7f203800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2057400640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20380051e0 0x7f203800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2057400640 1 -- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20380047d0 msgr2=0x7f2038004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2057400640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20380047d0 0x7f2038004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2057400640 1 -- 172.21.15.32:0/3668858016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038003530 con 0x7f2038003b40 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2057e00640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20380051e0 0x7f203800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2056a00640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20380047d0 0x7f2038004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f0639200640 1 Processor -- start 2024-01-19T04:15:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.532+0000 7f0639200640 1 -- start start 2024-01-19T04:15:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f6ae2a00640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6abc066550 0x7f6abc068a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6acc01ab20 tx=0x7f6acc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f202c15d720 con 0x7f202c0721a0 2024-01-19T04:15:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f9712000640 1 -- start start 2024-01-19T04:15:08.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2db7e00640 1 --2- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db806ecf0 0x7f2db8158aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009e50 tx=0x7f2db001c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fce070d1f2b5b46 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7fae0c800640 1 -- 172.21.15.32:0/1586793651 shutdown_connections 2024-01-19T04:15:08.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7fae0c800640 1 --2- 172.21.15.32:0/1586793651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae040c3f10 0x7fae040c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7fae0c800640 1 --2- 172.21.15.32:0/1586793651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040727f0 0x7fae040a9c70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7fae0c800640 1 -- 172.21.15.32:0/1586793651 >> 172.21.15.32:0/1586793651 conn(0x7fae0406d6c0 msgr2=0x7fae0406dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2db6000640 1 -- 172.21.15.32:0/2093112055 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db00a55b0 con 0x7f2db806ecf0 2024-01-19T04:15:08.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2db6000640 1 -- 172.21.15.32:0/2093112055 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db00a5710 con 0x7f2db806ecf0 2024-01-19T04:15:08.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2db6000640 1 -- 172.21.15.32:0/2093112055 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db00a5aa0 con 0x7f2db806ecf0 2024-01-19T04:15:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0639200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f063414dfb0 0x7f063406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0639200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f063406d470 0x7f06340c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0639200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0634070320 con 0x7f06340c1da0 2024-01-19T04:15:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0639200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063414e390 con 0x7f063406d470 2024-01-19T04:15:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0639200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0634071070 con 0x7f063414dfb0 2024-01-19T04:15:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0632800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f06340c1da0 0x7f0634150920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50412/0 (socket says 172.21.15.32:50412) 2024-01-19T04:15:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0632800640 1 -- 172.21.15.32:0/3653241199 learned_addr learned my addr 172.21.15.32:0/3653241199 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7fae0c800640 1 -- 172.21.15.32:0/1586793651 shutdown_connections 2024-01-19T04:15:08.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208440867 0 0) 0x7f0634070320 con 0x7f06340c1da0 2024-01-19T04:15:08.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0614003530 con 0x7f06340c1da0 2024-01-19T04:15:08.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad4001710 con 0x7f6ae4157cf0 2024-01-19T04:15:08.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f6ae2000640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7f6abc06e6f0 0x7f6abc070b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2014013410 con 0x7f202c0721a0 2024-01-19T04:15:08.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f9712000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec003cf0 0x7f970c1eb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f9712000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c0aa380 0x7f970c1eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f9712000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c1e9f80 0x7f970c1ea410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0631400640 1 --2- 172.21.15.32:0/3653241199 >> v2:172.21.15.32:3300/0 conn(0x7f063406d470 0x7f06340c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1017308414 0 0) 0x7f0614003530 con 0x7f06340c1da0 2024-01-19T04:15:08.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 >> v2:172.21.15.67:3300/0 conn(0x7f063414dfb0 msgr2=0x7f063406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 --2- 172.21.15.32:0/3653241199 >> v2:172.21.15.67:3300/0 conn(0x7f063414dfb0 0x7f063406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 >> v2:172.21.15.32:3300/0 conn(0x7f063406d470 msgr2=0x7f06340c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f970b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec003cf0 0x7f970c1eb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f2057400640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2038003b40 0x7f2038003f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2048001900 tx=0x7f204801c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d610cca47ae048 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f970b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec003cf0 0x7f970c1eb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38802/0 (socket says 172.21.15.32:38802) 2024-01-19T04:15:08.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f970b400640 1 -- 172.21.15.32:0/3861537882 learned_addr learned my addr 172.21.15.32:0/3861537882 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7fae0c800640 1 -- 172.21.15.32:0/1586793651 wait complete. 2024-01-19T04:15:08.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f9712000640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c156000 con 0x7f970c0aa380 2024-01-19T04:15:08.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f9712000640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c155a40 con 0x7f96ec003cf0 2024-01-19T04:15:08.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970be00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c1e9f80 0x7f970c1ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f9712000640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c155d20 con 0x7f970c1e9f80 2024-01-19T04:15:08.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048005820 con 0x7f2038003b40 2024-01-19T04:15:08.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048005980 con 0x7f2038003b40 2024-01-19T04:15:08.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2056000640 1 -- 172.21.15.32:0/3668858016 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048005d70 con 0x7f2038003b40 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 --2- 172.21.15.32:0/3653241199 >> v2:172.21.15.32:3300/0 conn(0x7f063406d470 0x7f06340c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063406e250 con 0x7f06340c1da0 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.536+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f062c001a00 con 0x7f06340c1da0 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 >> v1:172.21.15.67:6789/0 conn(0x7f06340c1da0 legacy=0x7f0634150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0630a00640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0614003980 0x7f0614003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0630a00640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06140047d0 0x7f0614004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0630a00640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0614007970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063414e390 con 0x7f0614005390 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634071070 con 0x7f06140047d0 2024-01-19T04:15:08.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06140082b0 con 0x7f0614003980 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== osd.0 v2:172.21.15.32:6816/4180731217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6abc0711c0 con 0x7f6abc06e6f0 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970aa00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c0aa380 0x7f970c1eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970be00640 1 -- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec003cf0 msgr2=0x7f970c1eb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970be00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96ec003cf0 0x7f970c1eb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970be00640 1 -- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c0aa380 msgr2=0x7f970c1eb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970be00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c0aa380 0x7f970c1eb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970be00640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0a5630 con 0x7f970c1e9f80 2024-01-19T04:15:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2dbde00640 1 -- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db806ecf0 msgr2=0x7f2db8158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2dbde00640 1 --2- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db806ecf0 0x7f2db8158aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009e50 tx=0x7f2db001c8f0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0632800640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0614007970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0631400640 1 --2- 172.21.15.32:0/3653241199 >> v2:172.21.15.32:3300/0 conn(0x7f063406d470 0x7f06340c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0631e00640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0614003980 0x7f0614003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2dbde00640 1 -- 172.21.15.32:0/2093112055 shutdown_connections 2024-01-19T04:15:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2dbde00640 1 --2- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db806ecf0 0x7f2db8158aa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2dbde00640 1 --2- 172.21.15.32:0/2093112055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806f520 0x7f2db806f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2dbde00640 1 -- 172.21.15.32:0/2093112055 >> 172.21.15.32:0/2093112055 conn(0x7f2db806d6c0 msgr2=0x7f2db806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7fae0c800640 1 Processor -- start 2024-01-19T04:15:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2022000640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2004066550 0x7f2004068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f205e000640 1 -- 172.21.15.32:0/3668858016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2038003b40 msgr2=0x7f2038003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f205e000640 1 --2- 172.21.15.32:0/3668858016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2038003b40 0x7f2038003f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2048001900 tx=0x7f204801c550 comp rx=0 tx=0).stop 2024-01-19T04:15:08.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f970be00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c1e9f80 0x7f970c1ea410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f970c073eb0 tx=0x7f96fc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7feeaf400640 1 --2- 172.21.15.32:0/1283928070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb00c1860 0x7feeb00c1cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feeb0159dd0 tx=0x7fee9801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432d7d3cb23d747e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0632800640 1 -- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0614003980 msgr2=0x7f0614003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0632800640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0614003980 0x7f0614003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0632800640 1 -- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06140047d0 msgr2=0x7f0614004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2057e00640 1 -- 172.21.15.32:0/3668858016 reap_dead start 2024-01-19T04:15:08.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f205e000640 1 -- 172.21.15.32:0/3668858016 shutdown_connections 2024-01-19T04:15:08.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f205e000640 1 -- 172.21.15.32:0/3668858016 >> 172.21.15.32:0/3668858016 conn(0x7f20580c2950 msgr2=0x7f20580c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0631400640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06140047d0 0x7f0614004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2dbde00640 1 -- 172.21.15.32:0/2093112055 shutdown_connections 2024-01-19T04:15:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2029400640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2004066550 0x7f2004068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00caf0 con 0x7f970c1e9f80 2024-01-19T04:15:08.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc00f040 con 0x7f970c1e9f80 2024-01-19T04:15:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00ce90 con 0x7f970c1e9f80 2024-01-19T04:15:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f205e000640 1 -- 172.21.15.32:0/3668858016 shutdown_connections 2024-01-19T04:15:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2014083f10 con 0x7f202c0721a0 2024-01-19T04:15:08.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f205e000640 1 -- 172.21.15.32:0/3668858016 wait complete. 2024-01-19T04:15:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7feeaea00640 1 -- 172.21.15.32:0/1283928070 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980ab600 con 0x7feeb00c1860 2024-01-19T04:15:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2022000640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f200406e770 0x7f2004070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2029400640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2004066550 0x7f2004068a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f202c1502a0 tx=0x7f201c006050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7feeaea00640 1 -- 172.21.15.32:0/1283928070 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee980a7050 con 0x7feeb00c1860 2024-01-19T04:15:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeaea00640 1 -- 172.21.15.32:0/1283928070 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980ab980 con 0x7feeb00c1860 2024-01-19T04:15:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0632800640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06140047d0 0x7f0614004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f0632800640 1 -- 172.21.15.32:0/3653241199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614003530 con 0x7f0614005390 2024-01-19T04:15:08.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f0631400640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06140047d0 0x7f0614004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.540+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 --> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2004071240 con 0x7f200406e770 2024-01-19T04:15:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2014086620 con 0x7f202c0721a0 2024-01-19T04:15:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f9712000640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c0a98a0 con 0x7f970c1e9f80 2024-01-19T04:15:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f9712000640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c0a9e60 con 0x7f970c1e9f80 2024-01-19T04:15:08.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f2dbde00640 1 -- 172.21.15.32:0/2093112055 wait complete. 2024-01-19T04:15:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7fae0c800640 1 -- start start 2024-01-19T04:15:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 -- 172.21.15.32:0/1283928070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb00c1860 msgr2=0x7feeb00c1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 --2- 172.21.15.32:0/1283928070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb00c1860 0x7feeb00c1cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feeb0159dd0 tx=0x7fee9801c300 comp rx=0 tx=0).stop 2024-01-19T04:15:08.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f205e000640 1 Processor -- start 2024-01-19T04:15:08.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 -- 172.21.15.32:0/1283928070 shutdown_connections 2024-01-19T04:15:08.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 --2- 172.21.15.32:0/1283928070 >> v2:172.21.15.67:3300/0 conn(0x7feeb0158e40 0x7feeb0159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 --2- 172.21.15.32:0/1283928070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb00c1860 0x7feeb00c1cf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f205e000640 1 -- start start 2024-01-19T04:15:08.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f970c0a54b0 con 0x7f970c1e9f80 2024-01-19T04:15:08.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 -- 172.21.15.32:0/1283928070 >> 172.21.15.32:0/1283928070 conn(0x7feeb00c2950 msgr2=0x7feeb00c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 -- 172.21.15.32:0/1283928070 shutdown_connections 2024-01-19T04:15:08.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7feeb7000640 1 -- 172.21.15.32:0/1283928070 wait complete. 2024-01-19T04:15:08.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f205e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2038003b40 0x7f205815de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f205e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20581ed060 0x7f205814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f205e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2058070370 0x7f20581f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f202a800640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f200406e770 0x7f2004070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f202a800640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f200406e770 0x7f2004070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7f2dbde00640 1 Processor -- start 2024-01-19T04:15:08.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2038003b40 0x7f205815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f205e000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205815e3d0 con 0x7f20581ed060 2024-01-19T04:15:08.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2038003b40 0x7f205815de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:38954/0 (socket says 172.21.15.32:38954) 2024-01-19T04:15:08.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 -- 172.21.15.32:0/2004526826 learned_addr learned my addr 172.21.15.32:0/2004526826 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f205e000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205814d650 con 0x7f2058070370 2024-01-19T04:15:08.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2058158950 con 0x7f2038003b40 2024-01-19T04:15:08.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7fae0c800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0406e1e0 0x7fae04143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7fae0c800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae040727f0 0x7fae04146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7fae0c800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040c3f10 0x7fae04142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7fae0c800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae041464d0 con 0x7fae040727f0 2024-01-19T04:15:08.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7fae0c800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04141760 con 0x7fae040c3f10 2024-01-19T04:15:08.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.544+0000 7fae0c800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae04150160 con 0x7fae0406e1e0 2024-01-19T04:15:08.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f0632800640 1 -- 172.21.15.32:0/3653241199 reap_dead start 2024-01-19T04:15:08.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057e00640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2058070370 0x7f20581f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f0632800640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0614007970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f062c008540 tx=0x7f062c01f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbb668033a0c85d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae09e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0406e1e0 0x7fae04143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 -- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2058070370 msgr2=0x7f20581f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2058070370 0x7f20581f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 -- 172.21.15.32:0/2004526826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20581ed060 msgr2=0x7f205814d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20581ed060 0x7f205814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 -- 172.21.15.32:0/2004526826 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058158c30 con 0x7f2038003b40 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae09e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0406e1e0 0x7fae04143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:38956/0 (socket says 172.21.15.32:38956) 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040c3f10 0x7fae04142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040c3f10 0x7fae04142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38824/0 (socket says 172.21.15.32:38824) 2024-01-19T04:15:08.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 -- 172.21.15.32:0/3503943540 learned_addr learned my addr 172.21.15.32:0/3503943540 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae09400640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae040727f0 0x7fae04146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2057400640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2038003b40 0x7f205815de90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f204801c380 tx=0x7f2038005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== osd.1 v2:172.21.15.32:6808/3082627308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2004071240 con 0x7f200406e770 2024-01-19T04:15:08.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 -- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0406e1e0 msgr2=0x7fae04143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae0406e1e0 0x7fae04143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 -- 172.21.15.32:0/3503943540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae040727f0 msgr2=0x7fae04146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae040727f0 0x7fae04146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 -- 172.21.15.32:0/3503943540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec009420 con 0x7fae040c3f10 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0b200640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040c3f10 0x7fae04142120 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b9a0 tx=0x7fadfc00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00cba0 con 0x7fae040c3f10 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc00cd20 con 0x7fae040c3f10 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc014680 con 0x7fae040c3f10 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c008270 con 0x7f0614005390 2024-01-19T04:15:08.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c0064f0 con 0x7f0614005390 2024-01-19T04:15:08.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f0630a00640 1 -- 172.21.15.32:0/3653241199 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0068a0 con 0x7f0614005390 2024-01-19T04:15:08.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20480b2070 con 0x7f2038003b40 2024-01-19T04:15:08.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048004930 con 0x7f2038003b40 2024-01-19T04:15:08.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2058158f10 con 0x7f2038003b40 2024-01-19T04:15:08.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f0639200640 1 -- 172.21.15.32:0/3653241199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 msgr2=0x7f0614007970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f0639200640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0614007970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f062c008540 tx=0x7f062c01f810 comp rx=0 tx=0).stop 2024-01-19T04:15:08.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048004ca0 con 0x7f2038003b40 2024-01-19T04:15:08.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0c800640 1 -- 172.21.15.32:0/3503943540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae04150440 con 0x7fae040c3f10 2024-01-19T04:15:08.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205814de70 con 0x7f2038003b40 2024-01-19T04:15:08.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96fc014480 con 0x7f970c1e9f80 2024-01-19T04:15:08.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7fae0c800640 1 -- 172.21.15.32:0/3503943540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae041460f0 con 0x7fae040c3f10 2024-01-19T04:15:08.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7feeb7000640 1 Processor -- start 2024-01-19T04:15:08.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7feeb7000640 1 -- start start 2024-01-19T04:15:08.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f9703400640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96e4066550 0x7f96e4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f0639200640 1 -- 172.21.15.32:0/3653241199 shutdown_connections 2024-01-19T04:15:08.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f0639200640 1 --2- 172.21.15.32:0/3653241199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0614007970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f0639200640 1 -- 172.21.15.32:0/3653241199 >> 172.21.15.32:0/3653241199 conn(0x7f06340c2950 msgr2=0x7f06340c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f0639200640 1 -- 172.21.15.32:0/3653241199 shutdown_connections 2024-01-19T04:15:08.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f0639200640 1 -- 172.21.15.32:0/3653241199 wait complete. 2024-01-19T04:15:08.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.548+0000 7f2dbde00640 1 -- start start 2024-01-19T04:15:08.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae040a8600 con 0x7fae040c3f10 2024-01-19T04:15:08.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f970b400640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96e4066550 0x7f96e4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96fc084350 con 0x7f970c1e9f80 2024-01-19T04:15:08.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dbde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db806e8a0 0x7f2db8159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dbde00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806ecf0 0x7f2db8072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dbde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2db806f520 0x7f2db8155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dbde00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81f49f0 con 0x7f2db806f520 2024-01-19T04:15:08.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dbde00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8154db0 con 0x7f2db806e8a0 2024-01-19T04:15:08.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dbde00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8154760 con 0x7f2db806ecf0 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806ecf0 0x7f2db8072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806ecf0 0x7f2db8072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:38960/0 (socket says 172.21.15.32:38960) 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 -- 172.21.15.32:0/2951723310 learned_addr learned my addr 172.21.15.32:0/2951723310 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2db7e00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2db806f520 0x7f2db8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 -- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db806e8a0 msgr2=0x7f2db8159e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2db806e8a0 0x7f2db8159e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 -- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2db806f520 msgr2=0x7f2db8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2db806f520 0x7f2db8155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fadfc01d3b0 con 0x7fae040c3f10 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb7000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feeb00c1860 0x7feeb0153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb7000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb01561c0 0x7feeb01449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb7000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feeb0158e40 0x7feeb0144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f9703400640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f96e406e770 0x7f96e4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96e4071240 con 0x7f96e406e770 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96fc086930 con 0x7f970c1e9f80 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f970b400640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96e4066550 0x7f96e4068a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f970401ec70 tx=0x7f97040b4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f970aa00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f96e406e770 0x7f96e4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2dade00640 1 -- 172.21.15.32:0/2951723310 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0009b30 con 0x7f2db806ecf0 2024-01-19T04:15:08.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f2db7e00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2db806f520 0x7f2db8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:08.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2dade00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806ecf0 0x7f2db8072320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2da000c390 tx=0x7f2da000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae02000640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faddc0665d0 0x7faddc068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadfc083d80 con 0x7fae040c3f10 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb7000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0151630 con 0x7feeb01561c0 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeafe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feeb00c1860 0x7feeb0153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb7000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0151880 con 0x7feeb0158e40 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb5000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feeb0158e40 0x7feeb0144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb7000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0151b60 con 0x7feeb00c1860 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb5000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feeb0158e40 0x7feeb0144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38836/0 (socket says 172.21.15.32:38836) 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeb5000640 1 -- 172.21.15.32:0/921533919 learned_addr learned my addr 172.21.15.32:0/921533919 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7feeaf400640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb01561c0 0x7feeb01449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feeb5000640 1 -- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feeb00c1860 msgr2=0x7feeb0153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feeb5000640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feeb00c1860 0x7feeb0153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2058150450 con 0x7f2038003b40 2024-01-19T04:15:08.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2048007090 con 0x7f2038003b40 2024-01-19T04:15:08.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.552+0000 7f0639200640 1 Processor -- start 2024-01-19T04:15:08.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 -- start start 2024-01-19T04:15:08.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00052d0 con 0x7f2db806ecf0 2024-01-19T04:15:08.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae02000640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7faddc06e7f0 0x7faddc070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 --> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faddc0712c0 con 0x7faddc06e7f0 2024-01-19T04:15:08.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadfc0863a0 con 0x7fae040c3f10 2024-01-19T04:15:08.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feeb5000640 1 -- 172.21.15.32:0/921533919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb01561c0 msgr2=0x7feeb01449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feeb5000640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb01561c0 0x7feeb01449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feeb5000640 1 -- 172.21.15.32:0/921533919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009b30 con 0x7feeb0158e40 2024-01-19T04:15:08.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0005430 con 0x7f2db806ecf0 2024-01-19T04:15:08.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0003820 con 0x7f2db806ecf0 2024-01-19T04:15:08.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae09e00640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faddc0665d0 0x7faddc068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae09400640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7faddc06e7f0 0x7faddc070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feeaf400640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeb01561c0 0x7feeb01449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:08.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feeb5000640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feeb0158e40 0x7feeb0144ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feea800efc0 tx=0x7feea800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f204f400640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f20300665d0 0x7f2030068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0634153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634146e50 0x7f06341e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634146920 0x7f063414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634150980 con 0x7f0614005390 2024-01-19T04:15:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634151d20 con 0x7f0634146e50 2024-01-19T04:15:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06341ea5f0 con 0x7f0634146920 2024-01-19T04:15:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f970aa00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f96e406e770 0x7f96e4070b90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2dbde00640 1 -- 172.21.15.32:0/2951723310 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db8154a40 con 0x7f2db806ecf0 2024-01-19T04:15:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2dbde00640 1 -- 172.21.15.32:0/2951723310 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db81f4c40 con 0x7f2db806ecf0 2024-01-19T04:15:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f204811d070 con 0x7f2038003b40 2024-01-19T04:15:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f204f400640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f203006e680 0x7f2030070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 --> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2030071150 con 0x7f203006e680 2024-01-19T04:15:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f204811f690 con 0x7f2038003b40 2024-01-19T04:15:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634146920 0x7f063414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0631400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634146e50 0x7f06341e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634146920 0x7f063414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:38974/0 (socket says 172.21.15.32:38974) 2024-01-19T04:15:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 -- 172.21.15.32:0/1916596239 learned_addr learned my addr 172.21.15.32:0/1916596239 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae09e00640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faddc0665d0 0x7faddc068a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadf4007fd0 tx=0x7fadf4007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7fae09400640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7faddc06e7f0 0x7faddc070c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2056a00640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f20300665d0 0x7f2030068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f2057e00640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f203006e680 0x7f2030070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0631e00640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0634153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 -- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634146e50 msgr2=0x7f06341e9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0634146e50 0x7f06341e9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 -- 172.21.15.32:0/1916596239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 msgr2=0x7f0634153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614005390 0x7f0634153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 -- 172.21.15.32:0/1916596239 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06341ea8d0 con 0x7f0634146920 2024-01-19T04:15:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0632800640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634146920 0x7f063414f250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f062c0200b0 tx=0x7f0614005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8018070 con 0x7feeb0158e40 2024-01-19T04:15:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0b6070 con 0x7f0634146920 2024-01-19T04:15:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c008070 con 0x7f0634146920 2024-01-19T04:15:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0634150bd0 con 0x7f0634146920 2024-01-19T04:15:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d80001040 con 0x7f2db806ecf0 2024-01-19T04:15:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== osd.4 v2:172.21.15.67:6800/73147838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faddc0712c0 con 0x7faddc06e7f0 2024-01-19T04:15:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800f040 con 0x7feeb0158e40 2024-01-19T04:15:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800ce00 con 0x7feeb0158e40 2024-01-19T04:15:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7feeb7000640 1 -- 172.21.15.32:0/921533919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee98009420 con 0x7feeb0158e40 2024-01-19T04:15:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0083e0 con 0x7f0634146920 2024-01-19T04:15:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.556+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06341492e0 con 0x7f0634146920 2024-01-19T04:15:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7feeb7000640 1 -- 172.21.15.32:0/921533919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb0152120 con 0x7feeb0158e40 2024-01-19T04:15:08.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feeb0165db0 con 0x7feeb0158e40 2024-01-19T04:15:08.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2da0003980 con 0x7f2db806ecf0 2024-01-19T04:15:08.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== osd.2 v2:172.21.15.32:6800/1746987778 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f96e4071240 con 0x7f96e406e770 2024-01-19T04:15:08.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f2057e00640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f203006e680 0x7f2030070aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f2056a00640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f20300665d0 0x7f2030068a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2040007ba0 tx=0x7f2040007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f062c006660 con 0x7f0634146920 2024-01-19T04:15:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0634072090 con 0x7f0634146920 2024-01-19T04:15:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f2dafe00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d90066580 0x7f2d90068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== osd.6 v2:172.21.15.67:6809/44142691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2030071150 con 0x7f203006e680 2024-01-19T04:15:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f062a000640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f060c066600 0x7f060c068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f062c120b70 con 0x7f0634146920 2024-01-19T04:15:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.560+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2da00830d0 con 0x7f2db806ecf0 2024-01-19T04:15:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f2dafe00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f2d9006e7a0 0x7f2d90070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 --> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d90071270 con 0x7f2d9006e7a0 2024-01-19T04:15:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2da0083490 con 0x7f2db806ecf0 2024-01-19T04:15:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7feea8014480 con 0x7feeb0158e40 2024-01-19T04:15:08.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f062a000640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f060c06e820 0x7f060c070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 --> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f060c0712f0 con 0x7f060c06e820 2024-01-19T04:15:08.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f062c125240 con 0x7f0634146920 2024-01-19T04:15:08.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f0631e00640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f060c066600 0x7f060c068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f2db6a00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d90066580 0x7f2d90068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f0631400640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f060c06e820 0x7f060c070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f0631400640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f060c06e820 0x7f060c070c40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f0631e00640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f060c066600 0x7f060c068ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f061c006fd0 tx=0x7f061c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== osd.7 v2:172.21.15.67:6824/472535671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f060c0712f0 con 0x7f060c06e820 2024-01-19T04:15:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7f2db6a00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d90066580 0x7f2d90068a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2db8154690 tx=0x7f2da8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7feea7e00640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee880665d0 0x7fee88068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feea8084160 con 0x7feeb0158e40 2024-01-19T04:15:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7feea7e00640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7fee8806e7f0 0x7fee88070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 --> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee880712c0 con 0x7fee8806e7f0 2024-01-19T04:15:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.564+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7feea8086780 con 0x7feeb0158e40 2024-01-19T04:15:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.568+0000 7feeaf400640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7fee8806e7f0 0x7fee88070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.568+0000 7feeafe00640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee880665d0 0x7fee88068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.568+0000 7f2db7e00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f2d9006e7a0 0x7f2d90070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.568+0000 7f2db7e00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f2d9006e7a0 0x7f2d90070bc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.568+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== osd.3 v2:172.21.15.32:6817/3668363434 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2d90071270 con 0x7f2d9006e7a0 2024-01-19T04:15:08.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.568+0000 7feeaf400640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7fee8806e7f0 0x7fee88070c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.576+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== osd.5 v2:172.21.15.67:6808/1136197459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fee880712c0 con 0x7fee8806e7f0 2024-01-19T04:15:08.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.576+0000 7feeafe00640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee880665d0 0x7fee88068a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feea000b7f0 tx=0x7feea0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 --> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20581f08b0 con 0x7f203006e680 2024-01-19T04:15:08.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 --> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f202c0c46c0 con 0x7f200406e770 2024-01-19T04:15:08.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 --> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ae40aaec0 con 0x7f6abc06e6f0 2024-01-19T04:15:08.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f2022000640 1 -- 172.21.15.32:0/3737522514 <== osd.1 v2:172.21.15.32:6808/3082627308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f202c0c46c0 con 0x7f200406e770 2024-01-19T04:15:08.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f204f400640 1 -- 172.21.15.32:0/2004526826 <== osd.6 v2:172.21.15.67:6809/44142691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20581f08b0 con 0x7f203006e680 2024-01-19T04:15:08.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f200406e770 msgr2=0x7f2004070b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f202b200640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f200406e770 0x7f2004070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f6adaa00640 1 -- 172.21.15.32:0/2523844441 <== osd.0 v2:172.21.15.32:6816/4180731217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ae40aaec0 con 0x7f6abc06e6f0 2024-01-19T04:15:08.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.580+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2004066550 msgr2=0x7f2004068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f203006e680 msgr2=0x7f2030070aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f203006e680 0x7f2030070aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202b200640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2004066550 0x7f2004068a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f202c1502a0 tx=0x7f201c006050 comp rx=0 tx=0).stop 2024-01-19T04:15:08.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0721a0 msgr2=0x7f202c14b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f20300665d0 msgr2=0x7f2030068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7f6abc06e6f0 msgr2=0x7f6abc070b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7f6abc06e6f0 0x7f6abc070b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f20300665d0 0x7f2030068a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2040007ba0 tx=0x7f2040007ad0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2038003b40 msgr2=0x7f205815de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 --2- 172.21.15.32:0/2004526826 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2038003b40 0x7f205815de90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f204801c380 tx=0x7f2038005800 comp rx=0 tx=0).stop 2024-01-19T04:15:08.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f2057e00640 1 -- 172.21.15.32:0/2004526826 reap_dead start 2024-01-19T04:15:08.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6abc066550 msgr2=0x7f6abc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6abc066550 0x7f6abc068a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6acc01ab20 tx=0x7f6acc008040 comp rx=0 tx=0).stop 2024-01-19T04:15:08.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4157cf0 msgr2=0x7f6ae40ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 --2- 172.21.15.32:0/2523844441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ae4157cf0 0x7f6ae40ab1a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c7b0 tx=0x7f6ad400cc70 comp rx=0 tx=0).stop 2024-01-19T04:15:08.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ae3400640 1 -- 172.21.15.32:0/2523844441 reap_dead start 2024-01-19T04:15:08.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202b200640 1 --2- 172.21.15.32:0/3737522514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f202c0721a0 0x7f202c14b710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f201400e810 tx=0x7f201400ecd0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202a800640 1 -- 172.21.15.32:0/3737522514 reap_dead start 2024-01-19T04:15:08.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 shutdown_connections 2024-01-19T04:15:08.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 >> 172.21.15.32:0/3737522514 conn(0x7f202c0a7a20 msgr2=0x7f202c0a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 shutdown_connections 2024-01-19T04:15:08.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 >> 172.21.15.32:0/2004526826 conn(0x7f20580c2950 msgr2=0x7f20580c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 shutdown_connections 2024-01-19T04:15:08.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 shutdown_connections 2024-01-19T04:15:08.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f205e000640 1 -- 172.21.15.32:0/2004526826 wait complete. 2024-01-19T04:15:08.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f202b200640 1 -- 172.21.15.32:0/3737522514 wait complete. 2024-01-19T04:15:08.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 shutdown_connections 2024-01-19T04:15:08.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.584+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 >> 172.21.15.32:0/2523844441 conn(0x7f6ae40c5b20 msgr2=0x7f6ae4153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.588+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 shutdown_connections 2024-01-19T04:15:08.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.588+0000 7f6ad3e00640 1 -- 172.21.15.32:0/2523844441 wait complete. 2024-01-19T04:15:08.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.588+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 --> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f970c155700 con 0x7f96e406e770 2024-01-19T04:15:08.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9703400640 1 -- 172.21.15.32:0/3861537882 <== osd.2 v2:172.21.15.32:6800/1746987778 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96f40050b0 con 0x7f96e406e770 2024-01-19T04:15:08.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 --> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae04072380 con 0x7faddc06e7f0 2024-01-19T04:15:08.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f96e406e770 msgr2=0x7f96e4070b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f96e406e770 0x7f96e4070b90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fae02000640 1 -- 172.21.15.32:0/3503943540 <== osd.4 v2:172.21.15.67:6800/73147838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fadec0a8890 con 0x7faddc06e7f0 2024-01-19T04:15:08.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7faddc06e7f0 msgr2=0x7faddc070c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7faddc06e7f0 0x7faddc070c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96e4066550 msgr2=0x7f96e4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96e4066550 0x7f96e4068a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f970401ec70 tx=0x7f97040b4040 comp rx=0 tx=0).stop 2024-01-19T04:15:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c1e9f80 msgr2=0x7f970c1ea410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 --2- 172.21.15.32:0/3861537882 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f970c1e9f80 0x7f970c1ea410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f970c073eb0 tx=0x7f96fc00c490 comp rx=0 tx=0).stop 2024-01-19T04:15:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f970be00640 1 -- 172.21.15.32:0/3861537882 reap_dead start 2024-01-19T04:15:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faddc0665d0 msgr2=0x7faddc068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faddc0665d0 0x7faddc068a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadf4007fd0 tx=0x7fadf4007d60 comp rx=0 tx=0).stop 2024-01-19T04:15:08.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040c3f10 msgr2=0x7fae04142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 --2- 172.21.15.32:0/3503943540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae040c3f10 0x7fae04142120 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00b9a0 tx=0x7fadfc00be60 comp rx=0 tx=0).stop 2024-01-19T04:15:08.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fae0b200640 1 -- 172.21.15.32:0/3503943540 reap_dead start 2024-01-19T04:15:08.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 shutdown_connections 2024-01-19T04:15:08.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 >> 172.21.15.32:0/3861537882 conn(0x7f970c0c5b20 msgr2=0x7f970c152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 shutdown_connections 2024-01-19T04:15:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 >> 172.21.15.32:0/3503943540 conn(0x7fae0406d6c0 msgr2=0x7fae041477c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 shutdown_connections 2024-01-19T04:15:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.592+0000 7fadfb400640 1 -- 172.21.15.32:0/3503943540 wait complete. 2024-01-19T04:15:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.596+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 shutdown_connections 2024-01-19T04:15:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.596+0000 7f9700c00640 1 -- 172.21.15.32:0/3861537882 wait complete. 2024-01-19T04:15:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.596+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 --> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f063414b7e0 con 0x7f060c06e820 2024-01-19T04:15:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.600+0000 7f062a000640 1 -- 172.21.15.32:0/1916596239 <== osd.7 v2:172.21.15.67:6824/472535671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f063414b7e0 con 0x7f060c06e820 2024-01-19T04:15:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.600+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 --> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d80002d40 con 0x7f2d9006e7a0 2024-01-19T04:15:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.600+0000 7f2dafe00640 1 -- 172.21.15.32:0/2951723310 <== osd.3 v2:172.21.15.32:6817/3668363434 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d80002d40 con 0x7f2d9006e7a0 2024-01-19T04:15:08.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.600+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f060c06e820 msgr2=0x7f060c070c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0639200640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f060c06e820 0x7f060c070c40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f060c066600 msgr2=0x7f060c068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0639200640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f060c066600 0x7f060c068ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f061c006fd0 tx=0x7f061c008040 comp rx=0 tx=0).stop 2024-01-19T04:15:08.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634146920 msgr2=0x7f063414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0639200640 1 --2- 172.21.15.32:0/1916596239 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0634146920 0x7f063414f250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f062c0200b0 tx=0x7f0614005800 comp rx=0 tx=0).stop 2024-01-19T04:15:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f2d9006e7a0 msgr2=0x7f2d90070bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f2d9006e7a0 0x7f2d90070bc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d90066580 msgr2=0x7f2d90068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d90066580 0x7f2d90068a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2db8154690 tx=0x7f2da8008040 comp rx=0 tx=0).stop 2024-01-19T04:15:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806ecf0 msgr2=0x7f2db8072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 --2- 172.21.15.32:0/2951723310 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2db806ecf0 0x7f2db8072320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2da000c390 tx=0x7f2da000c850 comp rx=0 tx=0).stop 2024-01-19T04:15:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2db7e00640 1 -- 172.21.15.32:0/2951723310 reap_dead start 2024-01-19T04:15:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0632800640 1 -- 172.21.15.32:0/1916596239 reap_dead start 2024-01-19T04:15:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 shutdown_connections 2024-01-19T04:15:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 >> 172.21.15.32:0/2951723310 conn(0x7f2db806d6c0 msgr2=0x7f2db8156910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 shutdown_connections 2024-01-19T04:15:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 >> 172.21.15.32:0/1916596239 conn(0x7f06340c2950 msgr2=0x7f06340c1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.604+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 shutdown_connections 2024-01-19T04:15:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.608+0000 7f2daca00640 1 -- 172.21.15.32:0/2951723310 wait complete. 2024-01-19T04:15:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.608+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 shutdown_connections 2024-01-19T04:15:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.608+0000 7f0639200640 1 -- 172.21.15.32:0/1916596239 wait complete. 2024-01-19T04:15:08.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.612+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 --> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feeb004e980 con 0x7fee8806e7f0 2024-01-19T04:15:08.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.612+0000 7feea7e00640 1 -- 172.21.15.32:0/921533919 <== osd.5 v2:172.21.15.67:6808/1136197459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feeb004e980 con 0x7fee8806e7f0 2024-01-19T04:15:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.612+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7fee8806e7f0 msgr2=0x7fee88070c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.612+0000 7feea5600640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7fee8806e7f0 0x7fee88070c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.616+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee880665d0 msgr2=0x7fee88068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.616+0000 7feea5600640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee880665d0 0x7fee88068a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feea000b7f0 tx=0x7feea0008040 comp rx=0 tx=0).stop 2024-01-19T04:15:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.616+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feeb0158e40 msgr2=0x7feeb0144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.616+0000 7feea5600640 1 --2- 172.21.15.32:0/921533919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feeb0158e40 0x7feeb0144ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feea800efc0 tx=0x7feea800c490 comp rx=0 tx=0).stop 2024-01-19T04:15:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.616+0000 7feeb5000640 1 -- 172.21.15.32:0/921533919 reap_dead start 2024-01-19T04:15:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.616+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 shutdown_connections 2024-01-19T04:15:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.616+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 >> 172.21.15.32:0/921533919 conn(0x7feeb00c2950 msgr2=0x7feeb006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.620+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 shutdown_connections 2024-01-19T04:15:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.620+0000 7feea5600640 1 -- 172.21.15.32:0/921533919 wait complete. 2024-01-19T04:15:08.626 INFO:teuthology.orchestra.run.smithi032.stdout:68719476742 2024-01-19T04:15:08.626 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-19T04:15:08.632 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-01-19T04:15:08.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-19T04:15:08.639 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-01-19T04:15:08.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-19T04:15:08.642 INFO:teuthology.orchestra.run.smithi032.stdout:68719476743 2024-01-19T04:15:08.642 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-19T04:15:08.645 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-01-19T04:15:08.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-19T04:15:08.652 INFO:teuthology.orchestra.run.smithi032.stdout:68719476742 2024-01-19T04:15:08.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-19T04:15:08.656 INFO:teuthology.orchestra.run.smithi032.stdout:60129542152 2024-01-19T04:15:08.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-19T04:15:08.661 INFO:teuthology.orchestra.run.smithi032.stdout:68719476741 2024-01-19T04:15:08.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-19T04:15:08.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.864+0000 7f75dc600640 1 Processor -- start 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.864+0000 7f75dc600640 1 -- start start 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.868+0000 7f75dc600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f75d40c20e0 0x7f75d40c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.868+0000 7f75d9c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f75d4151370 0x7f75d40c0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47328/0 (socket says 172.21.15.32:47328) 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.868+0000 7f75dc600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d406c6c0 con 0x7f75d4151370 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.868+0000 7f75d9200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f75d40c20e0 0x7f75d40c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.868+0000 7f75d9c00640 1 -- 172.21.15.32:0/1199159218 learned_addr learned my addr 172.21.15.32:0/1199159218 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.868+0000 7f75dc600640 1 -- 172.21.15.32:0/1199159218 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d406cfd0 con 0x7f75d4072300 2024-01-19T04:15:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.868+0000 7f75dc600640 1 -- 172.21.15.32:0/1199159218 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d406ccf0 con 0x7f75d40c20e0 2024-01-19T04:15:08.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.872+0000 7f75d9200640 1 -- 172.21.15.32:0/1199159218 >> v1:172.21.15.67:6789/0 conn(0x7f75d4072300 legacy=0x7f75d40c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.872+0000 7f75d3e00640 1 -- 172.21.15.32:0/1199159218 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533220336 0 0) 0x7f75d406cfd0 con 0x7f75d4072300 2024-01-19T04:15:08.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.872+0000 7f75d9200640 1 -- 172.21.15.32:0/1199159218 >> v1:172.21.15.32:6789/0 conn(0x7f75d4151370 legacy=0x7f75d40c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.872+0000 7f75d9200640 1 -- 172.21.15.32:0/1199159218 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d406beb0 con 0x7f75d40c20e0 2024-01-19T04:15:08.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.876+0000 7f75d9200640 1 --2- 172.21.15.32:0/1199159218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d40c20e0 0x7f75d40c44c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00c2e0 tx=0x7f75cc01dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e9876f2dd25ae4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.876+0000 7f75d3e00640 1 -- 172.21.15.32:0/1199159218 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0a6da0 con 0x7f75d40c20e0 2024-01-19T04:15:08.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.876+0000 7f75d3e00640 1 -- 172.21.15.32:0/1199159218 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00a0d0 con 0x7f75d40c20e0 2024-01-19T04:15:08.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.876+0000 7f75d3e00640 1 -- 172.21.15.32:0/1199159218 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00a460 con 0x7f75d40c20e0 2024-01-19T04:15:08.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.876+0000 7f75dc600640 1 -- 172.21.15.32:0/1199159218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d40c20e0 msgr2=0x7f75d40c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.876+0000 7f75dc600640 1 --2- 172.21.15.32:0/1199159218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d40c20e0 0x7f75d40c44c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00c2e0 tx=0x7f75cc01dce0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.880+0000 7f75dc600640 1 -- 172.21.15.32:0/1199159218 shutdown_connections 2024-01-19T04:15:08.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.880+0000 7f75dc600640 1 --2- 172.21.15.32:0/1199159218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d40c20e0 0x7f75d40c44c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.880+0000 7f75dc600640 1 -- 172.21.15.32:0/1199159218 >> 172.21.15.32:0/1199159218 conn(0x7f75d40c5b20 msgr2=0x7f75d40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.880+0000 7f75dc600640 1 -- 172.21.15.32:0/1199159218 shutdown_connections 2024-01-19T04:15:08.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.880+0000 7f75dc600640 1 -- 172.21.15.32:0/1199159218 wait complete. 2024-01-19T04:15:08.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.884+0000 7f75dc600640 1 Processor -- start 2024-01-19T04:15:08.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.884+0000 7f75dc600640 1 -- start start 2024-01-19T04:15:08.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75dc600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75d4072300 0x7f75d414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75dc600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75d40c20e0 0x7f75d41fa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75dc600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4151370 0x7f75d41fae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75dc600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40ab170 con 0x7f75d4151370 2024-01-19T04:15:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75dc600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40a8de0 con 0x7f75d4072300 2024-01-19T04:15:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75d9c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75d4072300 0x7f75d414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75dc600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40a8b00 con 0x7f75d40c20e0 2024-01-19T04:15:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75d9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75d40c20e0 0x7f75d41fa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75da600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4151370 0x7f75d41fae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75da600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4151370 0x7f75d41fae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34440/0 (socket says 172.21.15.32:34440) 2024-01-19T04:15:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f75da600640 1 -- 172.21.15.32:0/1506587727 learned_addr learned my addr 172.21.15.32:0/1506587727 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.888+0000 7f67abe00640 1 Processor -- start 2024-01-19T04:15:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67abe00640 1 -- start start 2024-01-19T04:15:08.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f75da600640 1 -- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75d40c20e0 msgr2=0x7f75d41fa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f75da600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75d40c20e0 0x7f75d41fa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f75da600640 1 -- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75d4072300 msgr2=0x7f75d414c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f75da600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75d4072300 0x7f75d414c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f75da600640 1 -- 172.21.15.32:0/1506587727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc00c050 con 0x7f75d4151370 2024-01-19T04:15:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f43da600640 1 Processor -- start 2024-01-19T04:15:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67abe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67ac0c0790 0x7f67ac070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67abe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67ac1513c0 0x7f67ac0c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67abe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ac0c1de0 con 0x7f67ac0721a0 2024-01-19T04:15:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67abe00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac151810 con 0x7f67ac1513c0 2024-01-19T04:15:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67abe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac06c860 con 0x7f67ac0c0790 2024-01-19T04:15:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f90b5c00640 1 Processor -- start 2024-01-19T04:15:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f43da600640 1 -- start start 2024-01-19T04:15:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f90b5c00640 1 -- start start 2024-01-19T04:15:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67aaa00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f67ac0721a0 0x7f67ac070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50432/0 (socket says 172.21.15.32:50432) 2024-01-19T04:15:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67aaa00640 1 -- 172.21.15.32:0/3146700254 learned_addr learned my addr 172.21.15.32:0/3146700254 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67ab400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67ac1513c0 0x7f67ac0c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67ab400640 1 -- 172.21.15.32:0/3146700254 >> v2:172.21.15.67:3300/0 conn(0x7f67ac0c0790 msgr2=0x7f67ac070780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-19T04:15:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67ab400640 1 --2- 172.21.15.32:0/3146700254 >> v2:172.21.15.67:3300/0 conn(0x7f67ac0c0790 0x7f67ac070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67ab400640 1 -- 172.21.15.32:0/3146700254 >> v1:172.21.15.67:6789/0 conn(0x7f67ac0721a0 legacy=0x7f67ac070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f67ab400640 1 -- 172.21.15.32:0/3146700254 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac06bfe0 con 0x7f67ac1513c0 2024-01-19T04:15:08.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.892+0000 7f75da600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4151370 0x7f75d41fae20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c450 tx=0x7f75c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f75d1600640 1 -- 172.21.15.32:0/1506587727 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40054e0 con 0x7f75d4151370 2024-01-19T04:15:08.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d41fdff0 con 0x7f75d4151370 2024-01-19T04:15:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7fede1200640 1 Processor -- start 2024-01-19T04:15:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90b5c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f90b00718b0 0x7f90b0151480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90b5c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90b00aa600 0x7f90b0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90b5c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b0150ff0 con 0x7f90b00c3470 2024-01-19T04:15:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90b5c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b00aaa50 con 0x7f90b00718b0 2024-01-19T04:15:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90b5c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b00ab9a0 con 0x7f90b00aa600 2024-01-19T04:15:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90af400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90b00aa600 0x7f90b0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90af400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90b00aa600 0x7f90b0153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38874/0 (socket says 172.21.15.32:38874) 2024-01-19T04:15:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90af400640 1 -- 172.21.15.32:0/1388917955 learned_addr learned my addr 172.21.15.32:0/1388917955 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90ae000640 1 --2- 172.21.15.32:0/1388917955 >> v2:172.21.15.32:3300/0 conn(0x7f90b00718b0 0x7f90b0151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d41fe5b0 con 0x7f75d4151370 2024-01-19T04:15:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f75d1600640 1 -- 172.21.15.32:0/1506587727 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4003600 con 0x7f75d4151370 2024-01-19T04:15:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f75d1600640 1 -- 172.21.15.32:0/1506587727 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4003990 con 0x7f75d4151370 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43da600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43d40c1860 0x7f43d40c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43da600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f43d4158e40 0x7f43d4159220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43da600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d4071c20 con 0x7f43d41561c0 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43da600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d4071ec0 con 0x7f43d40c1860 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43da600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40721a0 con 0x7f43d4158e40 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43d3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f43d4158e40 0x7f43d4159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43d3400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f43d41561c0 0x7f43d406cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50446/0 (socket says 172.21.15.32:50446) 2024-01-19T04:15:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43d3400640 1 -- 172.21.15.32:0/601429676 learned_addr learned my addr 172.21.15.32:0/601429676 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90af400640 1 -- 172.21.15.32:0/1388917955 >> v2:172.21.15.32:3300/0 conn(0x7f90b00718b0 msgr2=0x7f90b0151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90af400640 1 --2- 172.21.15.32:0/1388917955 >> v2:172.21.15.32:3300/0 conn(0x7f90b00718b0 0x7f90b0151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a40052a0 con 0x7f75d4151370 2024-01-19T04:15:08.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7fede1200640 1 -- start start 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fede1200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc1561c0 0x7feddc06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fede1200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feddc158e40 0x7feddc159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fede1200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc071c20 con 0x7feddc06d270 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fede1200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc071ec0 con 0x7feddc158e40 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fede1200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0721a0 con 0x7feddc1561c0 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43d3e00640 1 -- 172.21.15.32:0/601429676 >> v2:172.21.15.32:3300/0 conn(0x7f43d40c1860 msgr2=0x7f43d40c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43d3e00640 1 --2- 172.21.15.32:0/601429676 >> v2:172.21.15.32:3300/0 conn(0x7f43d40c1860 0x7f43d40c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43d3e00640 1 -- 172.21.15.32:0/601429676 >> v1:172.21.15.67:6789/0 conn(0x7f43d41561c0 legacy=0x7f43d406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f43d3e00640 1 -- 172.21.15.32:0/601429676 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4072480 con 0x7f43d4158e40 2024-01-19T04:15:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedd9400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7feddc06d270 0x7feddc0c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50462/0 (socket says 172.21.15.32:50462) 2024-01-19T04:15:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedd9400640 1 -- 172.21.15.32:0/1004313166 learned_addr learned my addr 172.21.15.32:0/1004313166 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedda800640 1 --2- 172.21.15.32:0/1004313166 >> v2:172.21.15.67:3300/0 conn(0x7feddc158e40 0x7feddc159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7f75d1600640 1 -- 172.21.15.32:0/1506587727 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f75c4003af0 con 0x7f75d4151370 2024-01-19T04:15:08.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedd9e00640 1 --2- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc1561c0 0x7feddc06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7f75d1600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75ac066500 0x7f75ac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedd8a00640 1 -- 172.21.15.32:0/1004313166 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406547443 0 0) 0x7feddc071c20 con 0x7feddc06d270 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedd8a00640 1 -- 172.21.15.32:0/1004313166 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedbc003530 con 0x7feddc06d270 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedda800640 1 -- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc1561c0 msgr2=0x7feddc06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedda800640 1 --2- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc1561c0 0x7feddc06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedda800640 1 -- 172.21.15.32:0/1004313166 >> v1:172.21.15.67:6789/0 conn(0x7feddc06d270 legacy=0x7feddc0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedda800640 1 -- 172.21.15.32:0/1004313166 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc072480 con 0x7feddc158e40 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fedd9e00640 1 --2- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc1561c0 0x7feddc06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7f75d9c00640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75ac066500 0x7f75ac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7f75d1600640 1 -- 172.21.15.32:0/1506587727 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75c4054440 con 0x7f75d4151370 2024-01-19T04:15:08.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7f67ab400640 1 --2- 172.21.15.32:0/3146700254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac1513c0 0x7f67ac0c5ae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f67ac154c50 tx=0x7f679c01c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf0909b0d8a724c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fe98ce00640 1 Processor -- start 2024-01-19T04:15:08.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90af400640 1 -- 172.21.15.32:0/1388917955 >> v1:172.21.15.67:6789/0 conn(0x7f90b00c3470 legacy=0x7f90b00aae70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-19T04:15:08.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.896+0000 7f90af400640 1 -- 172.21.15.32:0/1388917955 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00ab6c0 con 0x7f90b00aa600 2024-01-19T04:15:08.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.900+0000 7fe98ce00640 1 -- start start 2024-01-19T04:15:08.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f75d9c00640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75ac066500 0x7f75ac0689c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75bc005890 tx=0x7f75bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90af400640 1 --2- 172.21.15.32:0/1388917955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00aa600 0x7f90b0153e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90b006fc80 tx=0x7f909801eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47dc6a88903bf544 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90ad600640 1 -- 172.21.15.32:0/1388917955 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980a79c0 con 0x7f90b00aa600 2024-01-19T04:15:08.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f43d3e00640 1 --2- 172.21.15.32:0/601429676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 0x7f43d4159220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43d4159dd0 tx=0x7f43cc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b67385a4dacad909 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90ad600640 1 -- 172.21.15.32:0/1388917955 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90980a7b20 con 0x7f90b00aa600 2024-01-19T04:15:08.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90ad600640 1 -- 172.21.15.32:0/1388917955 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980af440 con 0x7f90b00aa600 2024-01-19T04:15:08.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe98ce00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe988151370 0x7fe9880c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe98ce00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9880c20e0 0x7fe9880c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe98ce00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f43d2000640 1 -- 172.21.15.32:0/601429676 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0a5740 con 0x7f43d4158e40 2024-01-19T04:15:08.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f43d2000640 1 -- 172.21.15.32:0/601429676 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc0a58a0 con 0x7f43d4158e40 2024-01-19T04:15:08.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f43d2000640 1 -- 172.21.15.32:0/601429676 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0a5c30 con 0x7f43d4158e40 2024-01-19T04:15:08.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 -- 172.21.15.32:0/1388917955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00aa600 msgr2=0x7f90b0153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 --2- 172.21.15.32:0/1388917955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00aa600 0x7f90b0153e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90b006fc80 tx=0x7f909801eaf0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 -- 172.21.15.32:0/1388917955 shutdown_connections 2024-01-19T04:15:08.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 --2- 172.21.15.32:0/1388917955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00aa600 0x7f90b0153e40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 --2- 172.21.15.32:0/1388917955 >> v2:172.21.15.32:3300/0 conn(0x7f90b00718b0 0x7f90b0151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 -- 172.21.15.32:0/1388917955 >> 172.21.15.32:0/1388917955 conn(0x7f90b00c2950 msgr2=0x7f90b00c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe98ce00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98806ccf0 con 0x7fe988151370 2024-01-19T04:15:08.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe985400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9880c20e0 0x7fe9880c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe985400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe9880c20e0 0x7fe9880c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38910/0 (socket says 172.21.15.32:38910) 2024-01-19T04:15:08.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe985400640 1 -- 172.21.15.32:0/1232241634 learned_addr learned my addr 172.21.15.32:0/1232241634 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe986800640 1 --2- 172.21.15.32:0/1232241634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f43da600640 1 -- 172.21.15.32:0/601429676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 msgr2=0x7f43d4159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f43da600640 1 --2- 172.21.15.32:0/601429676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 0x7f43d4159220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43d4159dd0 tx=0x7f43cc01c830 comp rx=0 tx=0).stop 2024-01-19T04:15:08.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe98ce00640 1 -- 172.21.15.32:0/1232241634 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98806c6c0 con 0x7fe9880c20e0 2024-01-19T04:15:08.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe98ce00640 1 -- 172.21.15.32:0/1232241634 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98806cfd0 con 0x7fe988072300 2024-01-19T04:15:08.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 -- 172.21.15.32:0/1388917955 shutdown_connections 2024-01-19T04:15:08.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7f90b5c00640 1 -- 172.21.15.32:0/1388917955 wait complete. 2024-01-19T04:15:08.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fedda800640 1 --2- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc158e40 0x7feddc159250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0097c0 tx=0x7fedcc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf2b7d8d2410553 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe985e00640 1 --2- 172.21.15.32:0/1232241634 >> v2:172.21.15.32:3300/0 conn(0x7fe988151370 0x7fe9880c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe986800640 1 -- 172.21.15.32:0/1232241634 >> v2:172.21.15.67:3300/0 conn(0x7fe9880c20e0 msgr2=0x7fe9880c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fedd8a00640 1 -- 172.21.15.32:0/1004313166 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0ab600 con 0x7feddc158e40 2024-01-19T04:15:08.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fedd8a00640 1 -- 172.21.15.32:0/1004313166 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc0a7050 con 0x7feddc158e40 2024-01-19T04:15:08.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fedd8a00640 1 -- 172.21.15.32:0/1004313166 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0ab600 con 0x7feddc158e40 2024-01-19T04:15:08.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe986800640 1 --2- 172.21.15.32:0/1232241634 >> v2:172.21.15.67:3300/0 conn(0x7fe9880c20e0 0x7fe9880c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe986800640 1 -- 172.21.15.32:0/1232241634 >> v2:172.21.15.32:3300/0 conn(0x7fe988151370 msgr2=0x7fe9880c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe986800640 1 --2- 172.21.15.32:0/1232241634 >> v2:172.21.15.32:3300/0 conn(0x7fe988151370 0x7fe9880c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.904+0000 7fe986800640 1 -- 172.21.15.32:0/1232241634 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98806beb0 con 0x7fe988072300 2024-01-19T04:15:08.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fe985e00640 1 --2- 172.21.15.32:0/1232241634 >> v2:172.21.15.32:3300/0 conn(0x7fe988151370 0x7fe9880c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:08.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fe985400640 1 --2- 172.21.15.32:0/1232241634 >> v2:172.21.15.67:3300/0 conn(0x7fe9880c20e0 0x7fe9880c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:08.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 -- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc158e40 msgr2=0x7feddc159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 --2- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc158e40 0x7feddc159250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0097c0 tx=0x7fedcc01c380 comp rx=0 tx=0).stop 2024-01-19T04:15:08.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f43da600640 1 -- 172.21.15.32:0/601429676 shutdown_connections 2024-01-19T04:15:08.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f43da600640 1 --2- 172.21.15.32:0/601429676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 0x7f43d4159220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f43da600640 1 --2- 172.21.15.32:0/601429676 >> v2:172.21.15.32:3300/0 conn(0x7f43d40c1860 0x7f43d40c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f43da600640 1 -- 172.21.15.32:0/601429676 >> 172.21.15.32:0/601429676 conn(0x7f43d40c2950 msgr2=0x7f43d40c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 -- 172.21.15.32:0/1004313166 shutdown_connections 2024-01-19T04:15:08.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 --2- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc158e40 0x7feddc159250 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 --2- 172.21.15.32:0/1004313166 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc1561c0 0x7feddc06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 -- 172.21.15.32:0/1004313166 >> 172.21.15.32:0/1004313166 conn(0x7feddc0c2950 msgr2=0x7feddc0c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f90b5c00640 1 Processor -- start 2024-01-19T04:15:08.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 -- 172.21.15.32:0/1004313166 shutdown_connections 2024-01-19T04:15:08.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7fede1200640 1 -- 172.21.15.32:0/1004313166 wait complete. 2024-01-19T04:15:08.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f43da600640 1 -- 172.21.15.32:0/601429676 shutdown_connections 2024-01-19T04:15:08.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f90b5c00640 1 -- start start 2024-01-19T04:15:08.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f75d1600640 1 -- 172.21.15.32:0/1506587727 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f75c4050780 con 0x7f75d4151370 2024-01-19T04:15:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67a9600640 1 -- 172.21.15.32:0/3146700254 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0ab600 con 0x7f67ac1513c0 2024-01-19T04:15:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67a9600640 1 -- 172.21.15.32:0/3146700254 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c0a7050 con 0x7f67ac1513c0 2024-01-19T04:15:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67a9600640 1 -- 172.21.15.32:0/3146700254 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0ab980 con 0x7f67ac1513c0 2024-01-19T04:15:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f517fa00640 1 Processor -- start 2024-01-19T04:15:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f43da600640 1 -- 172.21.15.32:0/601429676 wait complete. 2024-01-19T04:15:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67abe00640 1 -- 172.21.15.32:0/3146700254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac1513c0 msgr2=0x7f67ac0c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67abe00640 1 --2- 172.21.15.32:0/3146700254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac1513c0 0x7f67ac0c5ae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f67ac154c50 tx=0x7f679c01c2f0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f90b5c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00718b0 0x7f90b01f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f90b5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90b00aa600 0x7f90b01489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67abe00640 1 -- 172.21.15.32:0/3146700254 shutdown_connections 2024-01-19T04:15:08.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67abe00640 1 --2- 172.21.15.32:0/3146700254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac1513c0 0x7f67ac0c5ae0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67abe00640 1 --2- 172.21.15.32:0/3146700254 >> v2:172.21.15.67:3300/0 conn(0x7f67ac0c0790 0x7f67ac070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f67abe00640 1 -- 172.21.15.32:0/3146700254 >> 172.21.15.32:0/3146700254 conn(0x7f67ac0a7a20 msgr2=0x7f67ac0a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f517fa00640 1 -- start start 2024-01-19T04:15:08.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 Processor -- start 2024-01-19T04:15:08.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.908+0000 7f90ae000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90b00aa600 0x7f90b01489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90ae000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90b00aa600 0x7f90b01489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34494/0 (socket says 172.21.15.32:34494) 2024-01-19T04:15:08.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90aea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00718b0 0x7f90b01f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90aea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00718b0 0x7f90b01f1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38912/0 (socket says 172.21.15.32:38912) 2024-01-19T04:15:08.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 Processor -- start 2024-01-19T04:15:08.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 -- start start 2024-01-19T04:15:08.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90ae000640 1 -- 172.21.15.32:0/717664215 learned_addr learned my addr 172.21.15.32:0/717664215 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 -- start start 2024-01-19T04:15:08.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90b5c00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90b00c3470 0x7f90b014b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00c3d70 con 0x7f90b00aa600 2024-01-19T04:15:08.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b01f2280 con 0x7f90b00718b0 2024-01-19T04:15:08.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00c3a40 con 0x7f90b00c3470 2024-01-19T04:15:08.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517fa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f51780c1860 0x7f51780c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517fa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5178158e40 0x7f5178159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517fa00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5178071c20 con 0x7f51781561c0 2024-01-19T04:15:08.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517fa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5178071ec0 con 0x7f51780c1860 2024-01-19T04:15:08.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517fa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51780721a0 con 0x7f5178158e40 2024-01-19T04:15:08.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43d40c1860 0x7f43d40c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d41561c0 0x7f43d415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc06d270 0x7feddc150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc1561c0 0x7feddc1435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc158e40 0x7feddc15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc15a730 con 0x7feddc158e40 2024-01-19T04:15:08.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1509b0 con 0x7feddc1561c0 2024-01-19T04:15:08.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fede1200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc143ae0 con 0x7feddc06d270 2024-01-19T04:15:08.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43d3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43d40c1860 0x7f43d40c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fedd9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc06d270 0x7feddc150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fedd9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc06d270 0x7feddc150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39020/0 (socket says 172.21.15.32:39020) 2024-01-19T04:15:08.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fedd9e00640 1 -- 172.21.15.32:0/1341186371 learned_addr learned my addr 172.21.15.32:0/1341186371 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43d2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d41561c0 0x7f43d415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43d3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43d40c1860 0x7f43d40c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39010/0 (socket says 172.21.15.32:39010) 2024-01-19T04:15:08.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43d2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d41561c0 0x7f43d415c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34496/0 (socket says 172.21.15.32:34496) 2024-01-19T04:15:08.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90af400640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90b00c3470 0x7f90b014b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fedd9400640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc1561c0 0x7feddc1435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90aea00640 1 -- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90b00c3470 msgr2=0x7f90b014b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90aea00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90b00c3470 0x7f90b014b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90aea00640 1 -- 172.21.15.32:0/717664215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90b00aa600 msgr2=0x7f90b01489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90aea00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90b00aa600 0x7f90b01489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43d3400640 1 -- 172.21.15.32:0/1717935161 learned_addr learned my addr 172.21.15.32:0/1717935161 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 0x7f43d415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f90aea00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909800b770 con 0x7f90b00718b0 2024-01-19T04:15:08.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4144b40 con 0x7f43d41561c0 2024-01-19T04:15:08.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41f47f0 con 0x7f43d4158e40 2024-01-19T04:15:08.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f43da600640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41f4ad0 con 0x7f43d40c1860 2024-01-19T04:15:08.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f67abe00640 1 -- 172.21.15.32:0/3146700254 shutdown_connections 2024-01-19T04:15:08.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f67abe00640 1 -- 172.21.15.32:0/3146700254 wait complete. 2024-01-19T04:15:08.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7fedd9e00640 1 -- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc1561c0 msgr2=0x7feddc1435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd9e00640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc1561c0 0x7feddc1435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd9e00640 1 -- 172.21.15.32:0/1341186371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc158e40 msgr2=0x7feddc15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd9e00640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc158e40 0x7feddc15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517d000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f51781561c0 0x7f517806cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50472/0 (socket says 172.21.15.32:50472) 2024-01-19T04:15:08.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517d000640 1 -- 172.21.15.32:0/177826353 learned_addr learned my addr 172.21.15.32:0/177826353 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:08.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f5177e00640 1 --2- 172.21.15.32:0/177826353 >> v2:172.21.15.32:3300/0 conn(0x7f51780c1860 0x7f51780c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389706515 0 0) 0x7f5178071c20 con 0x7f51781561c0 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5158003530 con 0x7f51781561c0 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f517da00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5178158e40 0x7f5178159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 <== mon.1 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815749524 0 0) 0x7f5158003530 con 0x7f51781561c0 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.912+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5178158e40 msgr2=0x7f5178159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5178158e40 0x7f5178159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 >> v2:172.21.15.32:3300/0 conn(0x7f51780c1860 msgr2=0x7f51780c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f90aea00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00718b0 0x7f90b01f1d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90a800be20 tx=0x7f90a8009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 --2- 172.21.15.32:0/177826353 >> v2:172.21.15.32:3300/0 conn(0x7f51780c1860 0x7f51780c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178072480 con 0x7f51781561c0 2024-01-19T04:15:08.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43d3e00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 0x7f43d415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd9e00640 1 -- 172.21.15.32:0/1341186371 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4009a70 con 0x7feddc06d270 2024-01-19T04:15:08.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43d3400640 1 -- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 msgr2=0x7f43d415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43d3400640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 0x7f43d415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43d3400640 1 -- 172.21.15.32:0/1717935161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d41561c0 msgr2=0x7f43d415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43d3400640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d41561c0 0x7f43d415c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43d3400640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009a70 con 0x7f43d40c1860 2024-01-19T04:15:08.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fe986800640 1 --2- 172.21.15.32:0/1232241634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880c4a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe9880abe10 tx=0x7fe9780208c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07c0abefd5ea106 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43d3400640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43d40c1860 0x7f43d40c4e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c400 tx=0x7f43c400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 <== mon.1 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f5170001a00 con 0x7f51781561c0 2024-01-19T04:15:08.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 >> v1:172.21.15.67:6789/0 conn(0x7f51781561c0 legacy=0x7f517806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5158003980 0x7f5158003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51580047d0 0x7f5158004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5158005190 0x7f515800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5178071ec0 con 0x7f5158003980 2024-01-19T04:15:08.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51780721a0 con 0x7f5158005190 2024-01-19T04:15:08.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515800c0b0 con 0x7f51580047d0 2024-01-19T04:15:08.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f517da00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5178158e40 0x7f5178159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:08.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f517da00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5158005190 0x7f515800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177e00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51580047d0 0x7f5158004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 Processor -- start 2024-01-19T04:15:08.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd9e00640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc06d270 0x7feddc150470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fedd400efc0 tx=0x7fedd400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd2000640 1 -- 172.21.15.32:0/1341186371 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4014680 con 0x7feddc06d270 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd2000640 1 -- 172.21.15.32:0/1341186371 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd400f040 con 0x7feddc06d270 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fedd2000640 1 -- 172.21.15.32:0/1341186371 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40149e0 con 0x7feddc06d270 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc009420 con 0x7feddc06d270 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc0ab350 con 0x7feddc06d270 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f90a6a00640 1 -- 172.21.15.32:0/717664215 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8014440 con 0x7f90b00718b0 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f90a6a00640 1 -- 172.21.15.32:0/717664215 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a80145a0 con 0x7f90b00718b0 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f90a6a00640 1 -- 172.21.15.32:0/717664215 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8014990 con 0x7f90b00718b0 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b00c4ec0 con 0x7f90b00718b0 2024-01-19T04:15:08.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b00c5480 con 0x7f90b00718b0 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f517d000640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5158003980 0x7f5158003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177e00640 1 -- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5158005190 msgr2=0x7f515800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177e00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5158005190 0x7f515800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177e00640 1 -- 172.21.15.32:0/177826353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5158003980 msgr2=0x7f5158003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177e00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5158003980 0x7f5158003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f5177e00640 1 -- 172.21.15.32:0/177826353 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178072480 con 0x7f51580047d0 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fe984a00640 1 -- 172.21.15.32:0/1232241634 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780a9950 con 0x7fe988072300 2024-01-19T04:15:08.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fe984a00640 1 -- 172.21.15.32:0/1232241634 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9780a9ab0 con 0x7fe988072300 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7fe984a00640 1 -- 172.21.15.32:0/1232241634 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780a9e40 con 0x7fe988072300 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43cb400640 1 -- 172.21.15.32:0/1717935161 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4005cf0 con 0x7f43d40c1860 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43da600640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d41f4db0 con 0x7f43d40c1860 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43da600640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d41f5370 con 0x7f43d40c1860 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43cb400640 1 -- 172.21.15.32:0/1717935161 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4005e50 con 0x7f43d40c1860 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f43cb400640 1 -- 172.21.15.32:0/1717935161 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40072d0 con 0x7f43d40c1860 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f43da600640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a40052a0 con 0x7f43d40c1860 2024-01-19T04:15:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 -- start start 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac0721a0 0x7f67ac14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67ac0c0790 0x7f67ac0a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67ac1513c0 0x7f67ac1f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac1e63d0 con 0x7f67ac0721a0 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac150c20 con 0x7f67ac1513c0 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67abe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac1e7e40 con 0x7f67ac0c0790 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67ab400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67ac1513c0 0x7f67ac1f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67ab400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67ac1513c0 0x7f67ac1f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38956/0 (socket says 172.21.15.32:38956) 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.916+0000 7f67ab400640 1 -- 172.21.15.32:0/195738340 learned_addr learned my addr 172.21.15.32:0/195738340 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67aaa00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac0721a0 0x7f67ac14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67aa000640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67ac0c0790 0x7f67ac0a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f5177e00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51580047d0 0x7f5158004c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f516000ba30 tx=0x7f516001c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8655abf6abfa850 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67ab400640 1 -- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67ac0c0790 msgr2=0x7f67ac0a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67ab400640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67ac0c0790 0x7f67ac0a2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67ab400640 1 -- 172.21.15.32:0/195738340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac0721a0 msgr2=0x7f67ac14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67ab400640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac0721a0 0x7f67ac14d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67ab400640 1 -- 172.21.15.32:0/195738340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c009420 con 0x7f67ac1513c0 2024-01-19T04:15:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f43cb400640 1 -- 172.21.15.32:0/1717935161 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f43c4007430 con 0x7f43d40c1860 2024-01-19T04:15:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 -- 172.21.15.32:0/1232241634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 msgr2=0x7fe9880c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 --2- 172.21.15.32:0/1232241634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880c4a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe9880abe10 tx=0x7fe9780208c0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b00c5bf0 con 0x7f90b00718b0 2024-01-19T04:15:08.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 -- 172.21.15.32:0/1232241634 shutdown_connections 2024-01-19T04:15:08.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fedd2000640 1 -- 172.21.15.32:0/1341186371 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fedd4014b40 con 0x7feddc06d270 2024-01-19T04:15:08.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 --2- 172.21.15.32:0/1232241634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880c4a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f43cb400640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f43ac066500 0x7f43ac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f43cb400640 1 -- 172.21.15.32:0/1717935161 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c4083390 con 0x7f43d40c1860 2024-01-19T04:15:08.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc04e980 con 0x7feddc06d270 2024-01-19T04:15:08.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 --2- 172.21.15.32:0/1232241634 >> v2:172.21.15.67:3300/0 conn(0x7fe9880c20e0 0x7fe9880c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 --2- 172.21.15.32:0/1232241634 >> v2:172.21.15.32:3300/0 conn(0x7fe988151370 0x7fe9880c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f43d2a00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f43ac066500 0x7f43ac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 -- 172.21.15.32:0/1232241634 >> 172.21.15.32:0/1232241634 conn(0x7fe9880c5b20 msgr2=0x7fe9880c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f67ab400640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67ac1513c0 0x7f67ac1f4b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f679c018f00 tx=0x7f679c019090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600ac660 con 0x7f51580047d0 2024-01-19T04:15:08.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51600ac7c0 con 0x7f51580047d0 2024-01-19T04:15:08.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7f5177400640 1 -- 172.21.15.32:0/177826353 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600acb70 con 0x7f51580047d0 2024-01-19T04:15:08.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.920+0000 7fe98ce00640 1 -- 172.21.15.32:0/1232241634 shutdown_connections 2024-01-19T04:15:08.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f67a2a00640 1 -- 172.21.15.32:0/195738340 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0b4600 con 0x7f67ac1513c0 2024-01-19T04:15:08.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f67a2a00640 1 -- 172.21.15.32:0/195738340 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c0b4760 con 0x7f67ac1513c0 2024-01-19T04:15:08.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f67a2a00640 1 -- 172.21.15.32:0/195738340 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0b4b10 con 0x7f67ac1513c0 2024-01-19T04:15:08.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7fedd2000640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fedb4066550 0x7fedb4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7fedd2000640 1 -- 172.21.15.32:0/1341186371 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedd4084b50 con 0x7feddc06d270 2024-01-19T04:15:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7fedd9400640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fedb4066550 0x7fedb4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7fe98ce00640 1 -- 172.21.15.32:0/1232241634 wait complete. 2024-01-19T04:15:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f43d2a00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f43ac066500 0x7f43ac0689c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006fd0 tx=0x7f43bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f90a6a00640 1 -- 172.21.15.32:0/717664215 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f90a801d3b0 con 0x7f90b00718b0 2024-01-19T04:15:08.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac1e8120 con 0x7f67ac1513c0 2024-01-19T04:15:08.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517fa00640 1 -- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51580047d0 msgr2=0x7f5158004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517fa00640 1 --2- 172.21.15.32:0/177826353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51580047d0 0x7f5158004c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f516000ba30 tx=0x7f516001c6c0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517da00640 1 -- 172.21.15.32:0/177826353 reap_dead start 2024-01-19T04:15:08.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517fa00640 1 -- 172.21.15.32:0/177826353 shutdown_connections 2024-01-19T04:15:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517fa00640 1 -- 172.21.15.32:0/177826353 >> 172.21.15.32:0/177826353 conn(0x7f51780c2950 msgr2=0x7f51780c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac1e68c0 con 0x7f67ac1513c0 2024-01-19T04:15:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517fa00640 1 -- 172.21.15.32:0/177826353 shutdown_connections 2024-01-19T04:15:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7fedd9400640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fedb4066550 0x7fedb4068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feddc153600 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517fa00640 1 -- 172.21.15.32:0/177826353 wait complete. 2024-01-19T04:15:08.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f90a6a00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9088066600 0x7f9088068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f90a6a00640 1 -- 172.21.15.32:0/717664215 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90a8083ff0 con 0x7f90b00718b0 2024-01-19T04:15:08.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f90ae000640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9088066600 0x7f9088068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac071750 con 0x7f67ac1513c0 2024-01-19T04:15:08.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7fe98ce00640 1 Processor -- start 2024-01-19T04:15:08.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f90ae000640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9088066600 0x7f9088068ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90b01eeeb0 tx=0x7f90a0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7f517fa00640 1 Processor -- start 2024-01-19T04:15:08.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.924+0000 7fe98ce00640 1 -- start start 2024-01-19T04:15:08.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517fa00640 1 -- start start 2024-01-19T04:15:08.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f43cb400640 1 -- 172.21.15.32:0/1717935161 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f43c40540d0 con 0x7f43d40c1860 2024-01-19T04:15:08.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe98ce00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe98ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880c20e0 0x7fe988142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe98ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe988151370 0x7fe988143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe98ce00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881f5950 con 0x7fe9880c20e0 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe98ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881f4cd0 con 0x7fe988151370 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe98ce00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881f4fb0 con 0x7fe988072300 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe985e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe985e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39050/0 (socket says 172.21.15.32:39050) 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe985e00640 1 -- 172.21.15.32:0/649033352 learned_addr learned my addr 172.21.15.32:0/649033352 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe986800640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe988151370 0x7fe988143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517fa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51580047d0 0x7f5178070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517fa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51780ab490 0x7f517815c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517fa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51780aaf40 0x7f517815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517fa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517815d100 con 0x7f51580047d0 2024-01-19T04:15:08.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517fa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517815a040 con 0x7f51780aaf40 2024-01-19T04:15:08.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517fa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51781f4860 con 0x7f51780ab490 2024-01-19T04:15:08.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe985400640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880c20e0 0x7fe988142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51780ab490 0x7f517815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51580047d0 0x7f5178070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51780ab490 0x7f517815c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39064/0 (socket says 172.21.15.32:39064) 2024-01-19T04:15:08.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe986800640 1 -- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 msgr2=0x7fe9880a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe986800640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe986800640 1 -- 172.21.15.32:0/649033352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880c20e0 msgr2=0x7fe988142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe986800640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880c20e0 0x7fe988142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 -- 172.21.15.32:0/2571138143 learned_addr learned my addr 172.21.15.32:0/2571138143 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe986800640 1 -- 172.21.15.32:0/649033352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978010810 con 0x7fe988151370 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f517da00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51780aaf40 0x7f517815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 -- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51780aaf40 msgr2=0x7f517815cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51780aaf40 0x7f517815cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 -- 172.21.15.32:0/2571138143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51580047d0 msgr2=0x7f5178070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51580047d0 0x7f5178070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 -- 172.21.15.32:0/2571138143 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517815adc0 con 0x7f51780ab490 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe985e00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe986800640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe988151370 0x7fe988143140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9780b0000 tx=0x7fe97801d660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7f5177e00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51780ab490 0x7f517815c680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f516001cba0 tx=0x7f5158005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.928+0000 7fe97e000640 1 -- 172.21.15.32:0/649033352 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780b2df0 con 0x7fe988151370 2024-01-19T04:15:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7fe97e000640 1 -- 172.21.15.32:0/649033352 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe978010500 con 0x7fe988151370 2024-01-19T04:15:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f90a6a00640 1 -- 172.21.15.32:0/717664215 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f90a80b54d0 con 0x7f90b00718b0 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7fe97e000640 1 -- 172.21.15.32:0/649033352 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780bb640 con 0x7fe988151370 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9881f5290 con 0x7fe988151370 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9880a6e20 con 0x7fe988151370 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9880749f0 con 0x7fe988151370 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f5174c00640 1 -- 172.21.15.32:0/2571138143 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600acbf0 con 0x7f51780ab490 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f5174c00640 1 -- 172.21.15.32:0/2571138143 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51600b9070 con 0x7f51780ab490 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f5174c00640 1 -- 172.21.15.32:0/2571138143 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160004020 con 0x7f51780ab490 2024-01-19T04:15:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517815a250 con 0x7f51780ab490 2024-01-19T04:15:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51780708b0 con 0x7f51780ab490 2024-01-19T04:15:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f67a2a00640 1 -- 172.21.15.32:0/195738340 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f679c0b2040 con 0x7f67ac1513c0 2024-01-19T04:15:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7fedd2000640 1 -- 172.21.15.32:0/1341186371 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fedd4051e60 con 0x7feddc06d270 2024-01-19T04:15:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.932+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517804e980 con 0x7f51780ab490 2024-01-19T04:15:08.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.936+0000 7f67a2a00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6784066600 0x7f6784068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.936+0000 7f67a2a00640 1 -- 172.21.15.32:0/195738340 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f679c11e340 con 0x7f67ac1513c0 2024-01-19T04:15:08.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.936+0000 7f67aaa00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6784066600 0x7f6784068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.936+0000 7f67aaa00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6784066600 0x7f6784068ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6794006fd0 tx=0x7f6794008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.936+0000 7f67a2a00640 1 -- 172.21.15.32:0/195738340 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f679c0eb6e0 con 0x7f67ac1513c0 2024-01-19T04:15:08.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.940+0000 7f5174c00640 1 -- 172.21.15.32:0/2571138143 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5160004180 con 0x7f51780ab490 2024-01-19T04:15:08.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.940+0000 7fe97e000640 1 -- 172.21.15.32:0/649033352 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe9780bb7a0 con 0x7fe988151370 2024-01-19T04:15:08.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.940+0000 7f5174c00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5150066600 0x7f5150068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.940+0000 7f5174c00640 1 -- 172.21.15.32:0/2571138143 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f516011eb40 con 0x7f51780ab490 2024-01-19T04:15:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.940+0000 7f517d000640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5150066600 0x7f5150068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.940+0000 7f5174c00640 1 -- 172.21.15.32:0/2571138143 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f51600ebe90 con 0x7f51780ab490 2024-01-19T04:15:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.944+0000 7f517d000640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5150066600 0x7f5150068ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51700014b0 tx=0x7f5170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.944+0000 7fe97e000640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe960066500 0x7fe9600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.944+0000 7fe97e000640 1 -- 172.21.15.32:0/649033352 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9781203e0 con 0x7fe988151370 2024-01-19T04:15:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.944+0000 7fe97e000640 1 -- 172.21.15.32:0/649033352 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe978120950 con 0x7fe988151370 2024-01-19T04:15:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.944+0000 7fe985e00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe960066500 0x7fe9600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.948+0000 7fe985e00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe960066500 0x7fe9600689c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe98000d880 tx=0x7fe980007830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.972+0000 7f1613200640 1 Processor -- start 2024-01-19T04:15:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.972+0000 7f1613200640 1 -- start start 2024-01-19T04:15:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1613200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f160c14db00 0x7f160c0a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1613200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f160c0727f0 0x7f160c150b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1613200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c06e8a0 con 0x7f160c14dee0 2024-01-19T04:15:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1613200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c154750 con 0x7f160c14db00 2024-01-19T04:15:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1613200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0720a0 con 0x7f160c0727f0 2024-01-19T04:15:08.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1611c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f160c0727f0 0x7f160c150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1611c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f160c0727f0 0x7f160c150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38990/0 (socket says 172.21.15.32:38990) 2024-01-19T04:15:08.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1611c00640 1 -- 172.21.15.32:0/2306545265 learned_addr learned my addr 172.21.15.32:0/2306545265 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1611c00640 1 -- 172.21.15.32:0/2306545265 >> v2:172.21.15.32:3300/0 conn(0x7f160c14db00 msgr2=0x7f160c0a9c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T04:15:08.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1611c00640 1 --2- 172.21.15.32:0/2306545265 >> v2:172.21.15.32:3300/0 conn(0x7f160c14db00 0x7f160c0a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1611c00640 1 -- 172.21.15.32:0/2306545265 >> v1:172.21.15.32:6789/0 conn(0x7f160c14dee0 legacy=0x7f160c0c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:08.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.976+0000 7f1611c00640 1 -- 172.21.15.32:0/2306545265 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c1506b0 con 0x7f160c0727f0 2024-01-19T04:15:08.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f1611c00640 1 --2- 172.21.15.32:0/2306545265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c0727f0 0x7f160c150b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f160c0aa1e0 tx=0x7f15f401e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=309662b3fffb592b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:08.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f160aa00640 1 -- 172.21.15.32:0/2306545265 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40a7a30 con 0x7f160c0727f0 2024-01-19T04:15:08.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f160aa00640 1 -- 172.21.15.32:0/2306545265 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f40ab070 con 0x7f160c0727f0 2024-01-19T04:15:08.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f160aa00640 1 -- 172.21.15.32:0/2306545265 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40a7db0 con 0x7f160c0727f0 2024-01-19T04:15:08.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f1613200640 1 -- 172.21.15.32:0/2306545265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c0727f0 msgr2=0x7f160c150b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:08.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f1613200640 1 --2- 172.21.15.32:0/2306545265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c0727f0 0x7f160c150b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f160c0aa1e0 tx=0x7f15f401e940 comp rx=0 tx=0).stop 2024-01-19T04:15:08.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f1613200640 1 -- 172.21.15.32:0/2306545265 shutdown_connections 2024-01-19T04:15:08.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f1613200640 1 --2- 172.21.15.32:0/2306545265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c0727f0 0x7f160c150b20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.984+0000 7f1613200640 1 --2- 172.21.15.32:0/2306545265 >> v2:172.21.15.32:3300/0 conn(0x7f160c14db00 0x7f160c0a9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:08.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.988+0000 7f1613200640 1 -- 172.21.15.32:0/2306545265 >> 172.21.15.32:0/2306545265 conn(0x7f160c06d6c0 msgr2=0x7f160c06dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:08.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.988+0000 7f1613200640 1 -- 172.21.15.32:0/2306545265 shutdown_connections 2024-01-19T04:15:08.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.988+0000 7f1613200640 1 -- 172.21.15.32:0/2306545265 wait complete. 2024-01-19T04:15:08.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.988+0000 7f1613200640 1 Processor -- start 2024-01-19T04:15:08.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1613200640 1 -- start start 2024-01-19T04:15:08.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1613200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f160c0727f0 0x7f160c14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1613200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c14db00 0x7f160c14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1613200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160c14dee0 0x7f160c0c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:08.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f160b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c14db00 0x7f160c14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:08.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f160b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c14db00 0x7f160c14cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38998/0 (socket says 172.21.15.32:38998) 2024-01-19T04:15:08.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f160b400640 1 -- 172.21.15.32:0/3974857660 learned_addr learned my addr 172.21.15.32:0/3974857660 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:08.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c14af00 con 0x7f160c0727f0 2024-01-19T04:15:08.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c61f0 con 0x7f160c14db00 2024-01-19T04:15:08.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0c69b0 con 0x7f160c14dee0 2024-01-19T04:15:08.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.992+0000 7f1611c00640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160c14dee0 0x7f160c0c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1611c00640 1 -- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c14db00 msgr2=0x7f160c14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1611c00640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c14db00 0x7f160c14cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1611c00640 1 -- 172.21.15.32:0/3974857660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f160c0727f0 msgr2=0x7f160c14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1611c00640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f160c0727f0 0x7f160c14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1611c00640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4008550 con 0x7f160c14dee0 2024-01-19T04:15:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1611c00640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160c14dee0 0x7f160c0c5070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15f40af000 tx=0x7f15f401d180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1603e00640 1 -- 172.21.15.32:0/3974857660 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40a8c90 con 0x7f160c14dee0 2024-01-19T04:15:09.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1603e00640 1 -- 172.21.15.32:0/3974857660 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f40a8df0 con 0x7f160c14dee0 2024-01-19T04:15:09.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1603e00640 1 -- 172.21.15.32:0/3974857660 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400b370 con 0x7f160c14dee0 2024-01-19T04:15:09.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c144fa0 con 0x7f160c14dee0 2024-01-19T04:15:09.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:08.996+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c0c6c00 con 0x7f160c14dee0 2024-01-19T04:15:09.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.000+0000 7f1603e00640 1 -- 172.21.15.32:0/3974857660 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f15f400b4d0 con 0x7f160c14dee0 2024-01-19T04:15:09.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.000+0000 7f1603e00640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15e4066530 0x7f15e40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:09.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.004+0000 7f1603e00640 1 -- 172.21.15.32:0/3974857660 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15f411dfe0 con 0x7f160c14dee0 2024-01-19T04:15:09.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.004+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c04e980 con 0x7f160c14dee0 2024-01-19T04:15:09.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.004+0000 7f160be00640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15e4066530 0x7f15e40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:09.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.004+0000 7f160be00640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15e4066530 0x7f15e40689f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f160c06b5d0 tx=0x7f15fc006ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:09.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.008+0000 7f1603e00640 1 -- 172.21.15.32:0/3974857660 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f15f40eb3d0 con 0x7f160c14dee0 2024-01-19T04:15:09.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.248+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f75a4005550 con 0x7f75d4151370 2024-01-19T04:15:09.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.248+0000 7f75d1600640 1 -- 172.21.15.32:0/1506587727 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75c4017070 con 0x7f75d4151370 2024-01-19T04:15:09.253 INFO:teuthology.orchestra.run.smithi032.stdout:68719476741 2024-01-19T04:15:09.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75ac066500 msgr2=0x7f75ac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75ac066500 0x7f75ac0689c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75bc005890 tx=0x7f75bc009040 comp rx=0 tx=0).stop 2024-01-19T04:15:09.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4151370 msgr2=0x7f75d41fae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4151370 0x7f75d41fae20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c450 tx=0x7f75c400c910 comp rx=0 tx=0).stop 2024-01-19T04:15:09.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 shutdown_connections 2024-01-19T04:15:09.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75ac066500 0x7f75ac0689c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4151370 0x7f75d41fae20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75d40c20e0 0x7f75d41fa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 --2- 172.21.15.32:0/1506587727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75d4072300 0x7f75d414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.252+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 >> 172.21.15.32:0/1506587727 conn(0x7f75d40c5b20 msgr2=0x7f75d414e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.260+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 shutdown_connections 2024-01-19T04:15:09.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.260+0000 7f75dc600640 1 -- 172.21.15.32:0/1506587727 wait complete. 2024-01-19T04:15:09.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.260+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9880bfc10 con 0x7fe988151370 2024-01-19T04:15:09.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.260+0000 7fe97e000640 1 -- 172.21.15.32:0/649033352 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9780ed9c0 con 0x7fe988151370 2024-01-19T04:15:09.267 INFO:teuthology.orchestra.run.smithi032.stdout:64424509444 2024-01-19T04:15:09.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe960066500 msgr2=0x7fe9600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe960066500 0x7fe9600689c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe98000d880 tx=0x7fe980007830 comp rx=0 tx=0).stop 2024-01-19T04:15:09.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe988151370 msgr2=0x7fe988143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe988151370 0x7fe988143140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9780b0000 tx=0x7fe97801d660 comp rx=0 tx=0).stop 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 shutdown_connections 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe960066500 0x7fe9600689c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe988151370 0x7fe988143140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880c20e0 0x7fe988142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 --2- 172.21.15.32:0/649033352 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe988072300 0x7fe9880a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 >> 172.21.15.32:0/649033352 conn(0x7fe9880c5b20 msgr2=0x7fe988071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 shutdown_connections 2024-01-19T04:15:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.264+0000 7fe98ce00640 1 -- 172.21.15.32:0/649033352 wait complete. 2024-01-19T04:15:09.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.268+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feddc14ca80 con 0x7feddc06d270 2024-01-19T04:15:09.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.268+0000 7f43da600640 1 -- 172.21.15.32:0/1717935161 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43a4005550 con 0x7f43d40c1860 2024-01-19T04:15:09.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.268+0000 7fedd2000640 1 -- 172.21.15.32:0/1341186371 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedd4084070 con 0x7feddc06d270 2024-01-19T04:15:09.273 INFO:teuthology.orchestra.run.smithi032.stdout:64424509444 2024-01-19T04:15:09.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.268+0000 7f43cb400640 1 -- 172.21.15.32:0/1717935161 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43c4001150 con 0x7f43d40c1860 2024-01-19T04:15:09.277 INFO:teuthology.orchestra.run.smithi032.stdout:60129542150 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.272+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fedb4066550 msgr2=0x7fedb4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.272+0000 7fede1200640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fedb4066550 0x7fedb4068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feddc153600 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.272+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc06d270 msgr2=0x7feddc150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.272+0000 7fede1200640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc06d270 0x7feddc150470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fedd400efc0 tx=0x7fedd400c490 comp rx=0 tx=0).stop 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 -- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f43ac066500 msgr2=0x7f43ac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f43ac066500 0x7f43ac0689c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006fd0 tx=0x7f43bc008040 comp rx=0 tx=0).stop 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 -- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43d40c1860 msgr2=0x7f43d40c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43d40c1860 0x7f43d40c4e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c400 tx=0x7f43c400c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 shutdown_connections 2024-01-19T04:15:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 -- 172.21.15.32:0/1717935161 shutdown_connections 2024-01-19T04:15:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f43ac066500 0x7f43ac0689c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d4158e40 0x7f43d415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43d41561c0 0x7f43d415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 --2- 172.21.15.32:0/1717935161 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f43d40c1860 0x7f43d40c4e20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 -- 172.21.15.32:0/1717935161 >> 172.21.15.32:0/1717935161 conn(0x7f43d40c2950 msgr2=0x7f43d406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fedb4066550 0x7fedb4068a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feddc158e40 0x7feddc15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feddc1561c0 0x7feddc1435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 --2- 172.21.15.32:0/1341186371 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feddc06d270 0x7feddc150470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 >> 172.21.15.32:0/1341186371 conn(0x7feddc0c2950 msgr2=0x7feddc0c10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 -- 172.21.15.32:0/1717935161 shutdown_connections 2024-01-19T04:15:09.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f43c8c00640 1 -- 172.21.15.32:0/1717935161 wait complete. 2024-01-19T04:15:09.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 shutdown_connections 2024-01-19T04:15:09.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f90b004e980 con 0x7f90b00718b0 2024-01-19T04:15:09.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7fede1200640 1 -- 172.21.15.32:0/1341186371 wait complete. 2024-01-19T04:15:09.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.276+0000 7f90a6a00640 1 -- 172.21.15.32:0/717664215 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90a8019020 con 0x7f90b00718b0 2024-01-19T04:15:09.285 INFO:teuthology.orchestra.run.smithi032.stdout:68719476742 2024-01-19T04:15:09.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.280+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9088066600 msgr2=0x7f9088068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.280+0000 7f90b5c00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9088066600 0x7f9088068ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90b01eeeb0 tx=0x7f90a0009190 comp rx=0 tx=0).stop 2024-01-19T04:15:09.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.280+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00718b0 msgr2=0x7f90b01f1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.280+0000 7f90b5c00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00718b0 0x7f90b01f1d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90a800be20 tx=0x7f90a8009f70 comp rx=0 tx=0).stop 2024-01-19T04:15:09.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 shutdown_connections 2024-01-19T04:15:09.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9088066600 0x7f9088068ac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f90b00c3470 0x7f90b014b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90b00aa600 0x7f90b01489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 --2- 172.21.15.32:0/717664215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90b00718b0 0x7f90b01f1d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 >> 172.21.15.32:0/717664215 conn(0x7f90b00c2950 msgr2=0x7f90b006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f51781488e0 con 0x7f51780ab490 2024-01-19T04:15:09.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 shutdown_connections 2024-01-19T04:15:09.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f90b5c00640 1 -- 172.21.15.32:0/717664215 wait complete. 2024-01-19T04:15:09.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.284+0000 7f5174c00640 1 -- 172.21.15.32:0/2571138143 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51600bb090 con 0x7f51780ab490 2024-01-19T04:15:09.289 INFO:teuthology.orchestra.run.smithi032.stdout:68719476741 2024-01-19T04:15:09.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67ac071750 con 0x7f67ac1513c0 2024-01-19T04:15:09.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f67a2a00640 1 -- 172.21.15.32:0/195738340 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67ac071750 con 0x7f67ac1513c0 2024-01-19T04:15:09.291 INFO:teuthology.orchestra.run.smithi032.stdout:64424509444 2024-01-19T04:15:09.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5150066600 msgr2=0x7f5150068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5150066600 0x7f5150068ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51700014b0 tx=0x7f5170009040 comp rx=0 tx=0).stop 2024-01-19T04:15:09.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51780ab490 msgr2=0x7f517815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51780ab490 0x7f517815c680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f516001cba0 tx=0x7f5158005800 comp rx=0 tx=0).stop 2024-01-19T04:15:09.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 shutdown_connections 2024-01-19T04:15:09.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5150066600 0x7f5150068ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51780aaf40 0x7f517815cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f51780ab490 0x7f517815c680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 --2- 172.21.15.32:0/2571138143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f51580047d0 0x7f5178070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.288+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 >> 172.21.15.32:0/2571138143 conn(0x7f51780c2950 msgr2=0x7f51781538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 shutdown_connections 2024-01-19T04:15:09.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f517fa00640 1 -- 172.21.15.32:0/2571138143 wait complete. 2024-01-19T04:15:09.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6784066600 msgr2=0x7f6784068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6784066600 0x7f6784068ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6794006fd0 tx=0x7f6794008040 comp rx=0 tx=0).stop 2024-01-19T04:15:09.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67ac1513c0 msgr2=0x7f67ac1f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67ac1513c0 0x7f67ac1f4b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f679c018f00 tx=0x7f679c019090 comp rx=0 tx=0).stop 2024-01-19T04:15:09.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 shutdown_connections 2024-01-19T04:15:09.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6784066600 0x7f6784068ac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67ac1513c0 0x7f67ac1f4b70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67ac0c0790 0x7f67ac0a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 --2- 172.21.15.32:0/195738340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67ac0721a0 0x7f67ac14d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 >> 172.21.15.32:0/195738340 conn(0x7f67ac0a7a20 msgr2=0x7f67ac0a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.6 2024-01-19T04:15:09.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.292+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 shutdown_connections 2024-01-19T04:15:09.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.296+0000 7f67abe00640 1 -- 172.21.15.32:0/195738340 wait complete. 2024-01-19T04:15:09.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.2 2024-01-19T04:15:09.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.0 2024-01-19T04:15:09.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.3 2024-01-19T04:15:09.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2024-01-19T04:15:09.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.4 2024-01-19T04:15:09.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.7 2024-01-19T04:15:09.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.328+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f160c071de0 con 0x7f160c14dee0 2024-01-19T04:15:09.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1603e00640 1 -- 172.21.15.32:0/3974857660 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15f40ad090 con 0x7f160c14dee0 2024-01-19T04:15:09.334 INFO:teuthology.orchestra.run.smithi032.stdout:68719476740 2024-01-19T04:15:09.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15e4066530 msgr2=0x7f15e40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15e4066530 0x7f15e40689f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f160c06b5d0 tx=0x7f15fc006ca0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160c14dee0 msgr2=0x7f160c0c5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160c14dee0 0x7f160c0c5070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15f40af000 tx=0x7f15f401d180 comp rx=0 tx=0).stop 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 shutdown_connections 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f15e4066530 0x7f15e40689f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f160c14dee0 0x7f160c0c5070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c14db00 0x7f160c14cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 --2- 172.21.15.32:0/3974857660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f160c0727f0 0x7f160c14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 >> 172.21.15.32:0/3974857660 conn(0x7f160c06d6c0 msgr2=0x7f160c06daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 shutdown_connections 2024-01-19T04:15:09.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:09.332+0000 7f1613200640 1 -- 172.21.15.32:0/3974857660 wait complete. 2024-01-19T04:15:09.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476740 for osd.5 2024-01-19T04:15:10.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-19T04:15:10.314 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-19T04:15:10.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-19T04:15:10.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-19T04:15:10.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-19T04:15:10.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-19T04:15:10.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-19T04:15:10.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-19T04:15:10.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.520+0000 7f014e000640 1 Processor -- start 2024-01-19T04:15:10.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.520+0000 7f014e000640 1 -- start start 2024-01-19T04:15:10.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f014e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01480c20e0 0x7f01480c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f014e000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014806c6c0 con 0x7f0148151370 2024-01-19T04:15:10.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f014e000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014806cfd0 con 0x7f0148072300 2024-01-19T04:15:10.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f014e000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014806ccf0 con 0x7f01480c20e0 2024-01-19T04:15:10.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f0147e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0148072300 0x7f01480c4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50476/0 (socket says 172.21.15.32:50476) 2024-01-19T04:15:10.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f0147e00640 1 -- 172.21.15.32:0/2093878403 learned_addr learned my addr 172.21.15.32:0/2093878403 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:10.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f0146a00640 1 --2- 172.21.15.32:0/2093878403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01480c20e0 0x7f01480c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f0146000640 1 -- 172.21.15.32:0/2093878403 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656885115 0 0) 0x7f014806cfd0 con 0x7f0148072300 2024-01-19T04:15:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f0146000640 1 -- 172.21.15.32:0/2093878403 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0128003530 con 0x7f0148072300 2024-01-19T04:15:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f0146a00640 1 -- 172.21.15.32:0/2093878403 >> v1:172.21.15.67:6789/0 conn(0x7f0148072300 legacy=0x7f01480c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.524+0000 7f0146a00640 1 -- 172.21.15.32:0/2093878403 >> v1:172.21.15.32:6789/0 conn(0x7f0148151370 legacy=0x7f01480c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:10.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.528+0000 7f0146a00640 1 -- 172.21.15.32:0/2093878403 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014806beb0 con 0x7f01480c20e0 2024-01-19T04:15:10.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f0146a00640 1 --2- 172.21.15.32:0/2093878403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01480c20e0 0x7f01480c44c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0140009dc0 tx=0x7f014001c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d2c082ef6ebd0c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f0146000640 1 -- 172.21.15.32:0/2093878403 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a58a0 con 0x7f01480c20e0 2024-01-19T04:15:10.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f0146000640 1 -- 172.21.15.32:0/2093878403 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01400a5a00 con 0x7f01480c20e0 2024-01-19T04:15:10.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f0146000640 1 -- 172.21.15.32:0/2093878403 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a5d90 con 0x7f01480c20e0 2024-01-19T04:15:10.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f014e000640 1 -- 172.21.15.32:0/2093878403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01480c20e0 msgr2=0x7f01480c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f014e000640 1 --2- 172.21.15.32:0/2093878403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01480c20e0 0x7f01480c44c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0140009dc0 tx=0x7f014001c7e0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f014e000640 1 -- 172.21.15.32:0/2093878403 shutdown_connections 2024-01-19T04:15:10.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f014e000640 1 --2- 172.21.15.32:0/2093878403 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01480c20e0 0x7f01480c44c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.532+0000 7f014e000640 1 -- 172.21.15.32:0/2093878403 >> 172.21.15.32:0/2093878403 conn(0x7f01480c5b20 msgr2=0x7f01480c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.536+0000 7f014e000640 1 -- 172.21.15.32:0/2093878403 shutdown_connections 2024-01-19T04:15:10.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.536+0000 7f014e000640 1 -- 172.21.15.32:0/2093878403 wait complete. 2024-01-19T04:15:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.536+0000 7f014e000640 1 Processor -- start 2024-01-19T04:15:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.536+0000 7f014e000640 1 -- start start 2024-01-19T04:15:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f014e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0148072300 0x7f01480a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f014e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01480c20e0 0x7f01480bd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f014e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0148151370 0x7f01480bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0146a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01480c20e0 0x7f01480bd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f014e000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014814fd40 con 0x7f0148151370 2024-01-19T04:15:10.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f014e000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014820bee0 con 0x7f01480c20e0 2024-01-19T04:15:10.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0147400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0148072300 0x7f01480a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0146a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01480c20e0 0x7f01480bd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:39010/0 (socket says 172.21.15.32:39010) 2024-01-19T04:15:10.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0146a00640 1 -- 172.21.15.32:0/4202199 learned_addr learned my addr 172.21.15.32:0/4202199 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f014e000640 1 -- 172.21.15.32:0/4202199 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480bbc60 con 0x7f0148072300 2024-01-19T04:15:10.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0146a00640 1 -- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0148072300 msgr2=0x7f01480a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0146a00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0148072300 0x7f01480a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0146a00640 1 -- 172.21.15.32:0/4202199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0148151370 msgr2=0x7f01480bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.540+0000 7f0146a00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0148151370 0x7f01480bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f0146a00640 1 -- 172.21.15.32:0/4202199 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140009a70 con 0x7f01480c20e0 2024-01-19T04:15:10.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f0147400640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0148072300 0x7f01480a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:10.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f0146a00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01480c20e0 0x7f01480bd970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01400b0040 tx=0x7f0140019580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f013f400640 1 -- 172.21.15.32:0/4202199 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a58a0 con 0x7f01480c20e0 2024-01-19T04:15:10.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f014e000640 1 -- 172.21.15.32:0/4202199 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01480bb3c0 con 0x7f01480c20e0 2024-01-19T04:15:10.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f014e000640 1 -- 172.21.15.32:0/4202199 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01480bb980 con 0x7f01480c20e0 2024-01-19T04:15:10.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f013f400640 1 -- 172.21.15.32:0/4202199 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01400ad850 con 0x7f01480c20e0 2024-01-19T04:15:10.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f013f400640 1 -- 172.21.15.32:0/4202199 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a58a0 con 0x7f01480c20e0 2024-01-19T04:15:10.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.544+0000 7f014e000640 1 -- 172.21.15.32:0/4202199 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01180052a0 con 0x7f01480c20e0 2024-01-19T04:15:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.552+0000 7f013f400640 1 -- 172.21.15.32:0/4202199 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f01400b4050 con 0x7f01480c20e0 2024-01-19T04:15:10.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.556+0000 7f013f400640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01200665c0 0x7f0120068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.556+0000 7f013f400640 1 -- 172.21.15.32:0/4202199 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f014011ec90 con 0x7f01480c20e0 2024-01-19T04:15:10.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.556+0000 7f013f400640 1 -- 172.21.15.32:0/4202199 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f014011f0d0 con 0x7f01480c20e0 2024-01-19T04:15:10.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.556+0000 7f0147400640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01200665c0 0x7f0120068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.564+0000 7f0147400640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01200665c0 0x7f0120068a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0138009cb0 tx=0x7f0138009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.588+0000 7fdcf6000640 1 Processor -- start 2024-01-19T04:15:10.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.588+0000 7ff4b5e00640 1 Processor -- start 2024-01-19T04:15:10.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.588+0000 7fdcf6000640 1 -- start start 2024-01-19T04:15:10.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.588+0000 7ff4b5e00640 1 -- start start 2024-01-19T04:15:10.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf00c0790 0x7fdcf0070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b5e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b00c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b5e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4b0153780 0x7ff4b00c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf6000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf01517a0 con 0x7fdcf01513c0 2024-01-19T04:15:10.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf6000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf00c1de0 con 0x7fdcf00721a0 2024-01-19T04:15:10.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf6000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf006c860 con 0x7fdcf00c0790 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b4a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b00c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4afe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff4b00c39a0 0x7ff4b0153e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50496/0 (socket says 172.21.15.32:50496) 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b5e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b0072820 con 0x7ff4b00c39a0 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b5e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b0154570 con 0x7ff4b0153780 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b5e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00c5390 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4afe00640 1 -- 172.21.15.32:0/521502544 learned_addr learned my addr 172.21.15.32:0/521502544 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b4a00640 1 -- 172.21.15.32:0/521502544 >> v2:172.21.15.32:3300/0 conn(0x7ff4b0153780 msgr2=0x7ff4b00c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:10.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcefe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdcf00721a0 0x7fdcf0070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50490/0 (socket says 172.21.15.32:50490) 2024-01-19T04:15:10.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcefe00640 1 -- 172.21.15.32:0/3096575862 learned_addr learned my addr 172.21.15.32:0/3096575862 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:10.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf4c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdcf01513c0 0x7fdcf00c5f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47362/0 (socket says 172.21.15.32:47362) 2024-01-19T04:15:10.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf5600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf00c0790 0x7fdcf0070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b5400640 1 --2- 172.21.15.32:0/521502544 >> v2:172.21.15.32:3300/0 conn(0x7ff4b0153780 0x7ff4b00c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4af400640 1 -- 172.21.15.32:0/521502544 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927866306 0 0) 0x7ff4b0072820 con 0x7ff4b00c39a0 2024-01-19T04:15:10.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcef400640 1 -- 172.21.15.32:0/3096575862 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143912889 0 0) 0x7fdcf00c1de0 con 0x7fdcf00721a0 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcef400640 1 -- 172.21.15.32:0/3096575862 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd0003530 con 0x7fdcf00721a0 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf5600640 1 -- 172.21.15.32:0/3096575862 >> v1:172.21.15.67:6789/0 conn(0x7fdcf00721a0 legacy=0x7fdcf0070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf5600640 1 -- 172.21.15.32:0/3096575862 >> v1:172.21.15.32:6789/0 conn(0x7fdcf01513c0 legacy=0x7fdcf00c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7fdcf5600640 1 -- 172.21.15.32:0/3096575862 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf006bfe0 con 0x7fdcf00c0790 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b4a00640 1 --2- 172.21.15.32:0/521502544 >> v2:172.21.15.32:3300/0 conn(0x7ff4b0153780 0x7ff4b00c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b4a00640 1 -- 172.21.15.32:0/521502544 >> v1:172.21.15.67:6789/0 conn(0x7ff4b00c39a0 legacy=0x7ff4b0153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b4a00640 1 -- 172.21.15.32:0/521502544 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00c1360 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.592+0000 7ff4b5400640 1 --2- 172.21.15.32:0/521502544 >> v2:172.21.15.32:3300/0 conn(0x7ff4b0153780 0x7ff4b00c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:10.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4b4a00640 1 --2- 172.21.15.32:0/521502544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b00c4380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009b10 tx=0x7ff4a801edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ee0ac692540d91 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f3974000640 1 Processor -- start 2024-01-19T04:15:10.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4af400640 1 -- 172.21.15.32:0/521502544 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80af440 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fe120200640 1 Processor -- start 2024-01-19T04:15:10.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fdcf5600640 1 --2- 172.21.15.32:0/3096575862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf00c0790 0x7fdcf0070780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009dc0 tx=0x7fdce801c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8592e586c81795e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4af400640 1 -- 172.21.15.32:0/521502544 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80af5a0 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4af400640 1 -- 172.21.15.32:0/521502544 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80af930 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f6452a00640 1 Processor -- start 2024-01-19T04:15:10.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f6452a00640 1 -- start start 2024-01-19T04:15:10.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fe120200640 1 -- start start 2024-01-19T04:15:10.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f3974000640 1 -- start start 2024-01-19T04:15:10.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4b5e00640 1 -- 172.21.15.32:0/521502544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 msgr2=0x7ff4b00c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/521502544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b00c4380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009b10 tx=0x7ff4a801edf0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fdcef400640 1 -- 172.21.15.32:0/3096575862 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80a5880 con 0x7fdcf00c0790 2024-01-19T04:15:10.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fdcef400640 1 -- 172.21.15.32:0/3096575862 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce80a59e0 con 0x7fdcf00c0790 2024-01-19T04:15:10.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fdcef400640 1 -- 172.21.15.32:0/3096575862 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80a5d70 con 0x7fdcf00c0790 2024-01-19T04:15:10.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4b5e00640 1 -- 172.21.15.32:0/521502544 shutdown_connections 2024-01-19T04:15:10.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/521502544 >> v2:172.21.15.32:3300/0 conn(0x7ff4b0153780 0x7ff4b00c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/521502544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b00c4380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7ff4b5e00640 1 -- 172.21.15.32:0/521502544 >> 172.21.15.32:0/521502544 conn(0x7ff4b00a7850 msgr2=0x7ff4b00a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f29b7400640 1 Processor -- start 2024-01-19T04:15:10.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f6452a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f644c1513c0 0x7f644c0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f6452a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f644c0c6470 0x7f644c070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f6452a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c1517a0 con 0x7f644c0721a0 2024-01-19T04:15:10.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f6452a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c0c1de0 con 0x7f644c0c6470 2024-01-19T04:15:10.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f6452a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c06c860 con 0x7f644c1513c0 2024-01-19T04:15:10.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7f29b7400640 1 -- start start 2024-01-19T04:15:10.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fe120200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe1181561c0 0x7fe11806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fe120200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe118158e40 0x7fe118159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fe120200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118071c20 con 0x7fe11806d270 2024-01-19T04:15:10.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fe120200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe118071ec0 con 0x7fe1181561c0 2024-01-19T04:15:10.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.600+0000 7fe120200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1180721a0 con 0x7fe118158e40 2024-01-19T04:15:10.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6450c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f644c0721a0 0x7f644c070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50500/0 (socket says 172.21.15.32:50500) 2024-01-19T04:15:10.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6450c00640 1 -- 172.21.15.32:0/210312113 learned_addr learned my addr 172.21.15.32:0/210312113 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:10.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6452000640 1 --2- 172.21.15.32:0/210312113 >> v2:172.21.15.32:3300/0 conn(0x7f644c0c6470 0x7f644c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6451600640 1 --2- 172.21.15.32:0/210312113 >> v2:172.21.15.67:3300/0 conn(0x7f644c1513c0 0x7f644c0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7ff4b5e00640 1 -- 172.21.15.32:0/521502544 shutdown_connections 2024-01-19T04:15:10.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11e200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe118158e40 0x7fe118159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11e200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe118158e40 0x7fe118159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:39022/0 (socket says 172.21.15.32:39022) 2024-01-19T04:15:10.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11e200640 1 -- 172.21.15.32:0/1040479759 learned_addr learned my addr 172.21.15.32:0/1040479759 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3974000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f396c0c5740 0x7f396c0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3974000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c0c0c90 con 0x7f396c0c1120 2024-01-19T04:15:10.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3974000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c150cb0 con 0x7f396c0c42b0 2024-01-19T04:15:10.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3974000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c150f90 con 0x7f396c0c5740 2024-01-19T04:15:10.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11d800640 1 --2- 172.21.15.32:0/1040479759 >> v2:172.21.15.32:3300/0 conn(0x7fe1181561c0 0x7fe11806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f644be00640 1 -- 172.21.15.32:0/210312113 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273648760 0 0) 0x7f644c1517a0 con 0x7f644c0721a0 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6451600640 1 -- 172.21.15.32:0/210312113 >> v2:172.21.15.32:3300/0 conn(0x7f644c0c6470 msgr2=0x7f644c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6451600640 1 --2- 172.21.15.32:0/210312113 >> v2:172.21.15.32:3300/0 conn(0x7f644c0c6470 0x7f644c070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6451600640 1 -- 172.21.15.32:0/210312113 >> v1:172.21.15.67:6789/0 conn(0x7f644c0721a0 legacy=0x7f644c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f6451600640 1 -- 172.21.15.32:0/210312113 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c06bfe0 con 0x7f644c1513c0 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11e200640 1 -- 172.21.15.32:0/1040479759 >> v2:172.21.15.32:3300/0 conn(0x7fe1181561c0 msgr2=0x7fe11806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11e200640 1 --2- 172.21.15.32:0/1040479759 >> v2:172.21.15.32:3300/0 conn(0x7fe1181561c0 0x7fe11806cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11e200640 1 -- 172.21.15.32:0/1040479759 >> v1:172.21.15.32:6789/0 conn(0x7fe11806d270 legacy=0x7fe1180c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:10.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7fe11e200640 1 -- 172.21.15.32:0/1040479759 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe118072480 con 0x7fe118158e40 2024-01-19T04:15:10.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7ff4b5e00640 1 -- 172.21.15.32:0/521502544 wait complete. 2024-01-19T04:15:10.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7ff4b5e00640 1 Processor -- start 2024-01-19T04:15:10.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5e00640 1 -- start start 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f29b7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29b00c21c0 0x7f29b0158b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f29b7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29b00c04a0 0x7f29b00c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f29b7400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00c1120 con 0x7f29b0152d20 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f29b7400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b006cd10 con 0x7f29b00c21c0 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f29b7400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00c1400 con 0x7f29b00c04a0 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f29afe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29b00c21c0 0x7f29b0158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f29afe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29b00c21c0 0x7f29b0158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34648/0 (socket says 172.21.15.32:34648) 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f29afe00640 1 -- 172.21.15.32:0/1889118781 learned_addr learned my addr 172.21.15.32:0/1889118781 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f29afe00640 1 -- 172.21.15.32:0/1889118781 >> v2:172.21.15.67:3300/0 conn(0x7f29b00c04a0 msgr2=0x7f29b00c3a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f29afe00640 1 --2- 172.21.15.32:0/1889118781 >> v2:172.21.15.67:3300/0 conn(0x7f29b00c04a0 0x7f29b00c3a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f29afe00640 1 -- 172.21.15.32:0/1889118781 >> v1:172.21.15.67:6789/0 conn(0x7f29b0152d20 legacy=0x7f29b006beb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f29afe00640 1 -- 172.21.15.32:0/1889118781 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00c16e0 con 0x7f29b00c21c0 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7fdcf6000640 1 -- 172.21.15.32:0/3096575862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf00c0790 msgr2=0x7fdcf0070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3096575862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf00c0790 0x7fdcf0070780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009dc0 tx=0x7fdce801c7e0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3970c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f396c0c5740 0x7f396c0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3970c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f396c0c5740 0x7f396c0c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:39030/0 (socket says 172.21.15.32:39030) 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3970c00640 1 -- 172.21.15.32:0/2415277759 learned_addr learned my addr 172.21.15.32:0/2415277759 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3970c00640 1 -- 172.21.15.32:0/2415277759 >> v1:172.21.15.67:6789/0 conn(0x7f396c0c42b0 legacy=0x7f396c06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3970c00640 1 -- 172.21.15.32:0/2415277759 >> v1:172.21.15.32:6789/0 conn(0x7f396c0c1120 legacy=0x7f396c15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.604+0000 7f3970c00640 1 -- 172.21.15.32:0/2415277759 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0c0640 con 0x7f396c0c5740 2024-01-19T04:15:10.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7fdcf6000640 1 -- 172.21.15.32:0/3096575862 shutdown_connections 2024-01-19T04:15:10.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3096575862 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf00c0790 0x7fdcf0070780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7fdcf6000640 1 -- 172.21.15.32:0/3096575862 >> 172.21.15.32:0/3096575862 conn(0x7fdcf00a7a20 msgr2=0x7fdcf00a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4b00c39a0 0x7ff4b0148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f6451600640 1 --2- 172.21.15.32:0/210312113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c1513c0 0x7f644c0c5f30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f644c0c6a20 tx=0x7f643401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9157d7bef6cd7ad7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b01f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f644be00640 1 -- 172.21.15.32:0/210312113 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340ab600 con 0x7f644c1513c0 2024-01-19T04:15:10.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4b0153780 0x7ff4b01f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f644be00640 1 -- 172.21.15.32:0/210312113 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340a7050 con 0x7f644c1513c0 2024-01-19T04:15:10.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7f644be00640 1 -- 172.21.15.32:0/210312113 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340ab600 con 0x7f644c1513c0 2024-01-19T04:15:10.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7fdcf6000640 1 -- 172.21.15.32:0/3096575862 shutdown_connections 2024-01-19T04:15:10.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4b00c39a0 0x7ff4b0148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4b00c39a0 0x7ff4b0148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:39038/0 (socket says 172.21.15.32:39038) 2024-01-19T04:15:10.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4b0153780 0x7ff4b01f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4afe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b01f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4b0153780 0x7ff4b01f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34664/0 (socket says 172.21.15.32:34664) 2024-01-19T04:15:10.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4afe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b01f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39112/0 (socket says 172.21.15.32:39112) 2024-01-19T04:15:10.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b4a00640 1 -- 172.21.15.32:0/2590241058 learned_addr learned my addr 172.21.15.32:0/2590241058 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b01f6fa0 con 0x7ff4b0153780 2024-01-19T04:15:10.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.608+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b014b670 con 0x7ff4b00c39a0 2024-01-19T04:15:10.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b014aa60 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fdcf6000640 1 -- 172.21.15.32:0/3096575862 wait complete. 2024-01-19T04:15:10.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe11e200640 1 --2- 172.21.15.32:0/1040479759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe118158e40 0x7fe118159250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe118159e00 tx=0x7fe11001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e3821b755b194f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4afe00640 1 -- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4b00c39a0 msgr2=0x7ff4b0148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 -- 172.21.15.32:0/210312113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c1513c0 msgr2=0x7f644c0c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 --2- 172.21.15.32:0/210312113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c1513c0 0x7f644c0c5f30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f644c0c6a20 tx=0x7f643401c310 comp rx=0 tx=0).stop 2024-01-19T04:15:10.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f3970c00640 1 --2- 172.21.15.32:0/2415277759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c5740 0x7f396c0c4690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3954006fd0 tx=0x7f39540257d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d398503c1b29352 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe117e00640 1 -- 172.21.15.32:0/1040479759 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a55c0 con 0x7fe118158e40 2024-01-19T04:15:10.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe117e00640 1 -- 172.21.15.32:0/1040479759 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100a5720 con 0x7fe118158e40 2024-01-19T04:15:10.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe117e00640 1 -- 172.21.15.32:0/1040479759 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a5ab0 con 0x7fe118158e40 2024-01-19T04:15:10.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4afe00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4b00c39a0 0x7ff4b0148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4afe00640 1 -- 172.21.15.32:0/2590241058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4b0153780 msgr2=0x7ff4b01f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 -- 172.21.15.32:0/210312113 shutdown_connections 2024-01-19T04:15:10.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f396be00640 1 -- 172.21.15.32:0/2415277759 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540adde0 con 0x7f396c0c5740 2024-01-19T04:15:10.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4afe00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4b0153780 0x7ff4b01f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f396be00640 1 -- 172.21.15.32:0/2415277759 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540b1070 con 0x7f396c0c5740 2024-01-19T04:15:10.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4afe00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009770 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4b4a00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4b00c39a0 0x7ff4b0148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:10.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4b5400640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4b0153780 0x7ff4b01f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:10.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 --2- 172.21.15.32:0/210312113 >> v2:172.21.15.32:3300/0 conn(0x7f644c0c6470 0x7f644c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f396be00640 1 -- 172.21.15.32:0/2415277759 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540adde0 con 0x7f396c0c5740 2024-01-19T04:15:10.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 --2- 172.21.15.32:0/210312113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c1513c0 0x7f644c0c5f30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 -- 172.21.15.32:0/210312113 >> 172.21.15.32:0/210312113 conn(0x7f644c0a7a20 msgr2=0x7f644c0a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe120200640 1 -- 172.21.15.32:0/1040479759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe118158e40 msgr2=0x7fe118159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe120200640 1 --2- 172.21.15.32:0/1040479759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe118158e40 0x7fe118159250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe118159e00 tx=0x7fe11001c890 comp rx=0 tx=0).stop 2024-01-19T04:15:10.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fdcf6000640 1 Processor -- start 2024-01-19T04:15:10.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4afe00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b01f6520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c410 tx=0x7ff49800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 -- 172.21.15.32:0/210312113 shutdown_connections 2024-01-19T04:15:10.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe120200640 1 -- 172.21.15.32:0/1040479759 shutdown_connections 2024-01-19T04:15:10.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe120200640 1 --2- 172.21.15.32:0/1040479759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe118158e40 0x7fe118159250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe120200640 1 --2- 172.21.15.32:0/1040479759 >> v2:172.21.15.32:3300/0 conn(0x7fe1181561c0 0x7fe11806cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fe120200640 1 -- 172.21.15.32:0/1040479759 >> 172.21.15.32:0/1040479759 conn(0x7fe1180c2950 msgr2=0x7fe1180c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7fdcf6000640 1 -- start start 2024-01-19T04:15:10.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4acc00640 1 -- 172.21.15.32:0/2590241058 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980074e0 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4acc00640 1 -- 172.21.15.32:0/2590241058 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498007640 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4acc00640 1 -- 172.21.15.32:0/2590241058 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498004a30 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b014ad40 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f6452a00640 1 -- 172.21.15.32:0/210312113 wait complete. 2024-01-19T04:15:10.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f3974000640 1 -- 172.21.15.32:0/2415277759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c5740 msgr2=0x7f396c0c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f3974000640 1 --2- 172.21.15.32:0/2415277759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c5740 0x7f396c0c4690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3954006fd0 tx=0x7f39540257d0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f3974000640 1 -- 172.21.15.32:0/2415277759 shutdown_connections 2024-01-19T04:15:10.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f3974000640 1 --2- 172.21.15.32:0/2415277759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c5740 0x7f396c0c4690 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7f3974000640 1 -- 172.21.15.32:0/2415277759 >> 172.21.15.32:0/2415277759 conn(0x7f396c0c5b20 msgr2=0x7f396c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.612+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b014b300 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fe120200640 1 -- 172.21.15.32:0/1040479759 shutdown_connections 2024-01-19T04:15:10.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f3974000640 1 -- 172.21.15.32:0/2415277759 shutdown_connections 2024-01-19T04:15:10.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f3974000640 1 -- 172.21.15.32:0/2415277759 wait complete. 2024-01-19T04:15:10.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b00a8b50 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f29afe00640 1 --2- 172.21.15.32:0/1889118781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b0158b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f29b00a5770 tx=0x7f299801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7aac21378b4406 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fe120200640 1 -- 172.21.15.32:0/1040479759 wait complete. 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcf00721a0 0x7fdcf00bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf00c0790 0x7fdcf0148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf01513c0 0x7fdcf0149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf6000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01ecf70 con 0x7fdcf00721a0 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf6000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00a91f0 con 0x7fdcf00c0790 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf6000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00aa5e0 con 0x7fdcf01513c0 2024-01-19T04:15:10.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcf00721a0 0x7fdcf00bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcefe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf00c0790 0x7fdcf0148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcf00721a0 0x7fdcf00bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34668/0 (socket says 172.21.15.32:34668) 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 -- 172.21.15.32:0/3099759491 learned_addr learned my addr 172.21.15.32:0/3099759491 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf5600640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf01513c0 0x7fdcf0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 -- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf01513c0 msgr2=0x7fdcf0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf01513c0 0x7fdcf0149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 -- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf00c0790 msgr2=0x7fdcf0148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf00c0790 0x7fdcf0148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 -- 172.21.15.32:0/3099759491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8009a70 con 0x7fdcf00721a0 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcefe00640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf00c0790 0x7fdcf0148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:10.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7ff4acc00640 1 -- 172.21.15.32:0/2590241058 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff498004b90 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f3974000640 1 Processor -- start 2024-01-19T04:15:10.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fdcf4c00640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcf00721a0 0x7fdcf00bf130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdce001d410 tx=0x7fdce001d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7fe120200640 1 Processor -- start 2024-01-19T04:15:10.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f29af400640 1 -- 172.21.15.32:0/1889118781 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980ab600 con 0x7f29b00c21c0 2024-01-19T04:15:10.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f29af400640 1 -- 172.21.15.32:0/1889118781 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29980a7050 con 0x7f29b00c21c0 2024-01-19T04:15:10.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f29af400640 1 -- 172.21.15.32:0/1889118781 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980ab980 con 0x7f29b00c21c0 2024-01-19T04:15:10.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe120200640 1 -- start start 2024-01-19T04:15:10.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7ff4acc00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff488066600 0x7ff488068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7ff4acc00640 1 -- 172.21.15.32:0/2590241058 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff498083a10 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f29b7400640 1 -- 172.21.15.32:0/1889118781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 msgr2=0x7f29b0158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f29b7400640 1 --2- 172.21.15.32:0/1889118781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b0158b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f29b00a5770 tx=0x7f299801c450 comp rx=0 tx=0).stop 2024-01-19T04:15:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fdcecc00640 1 -- 172.21.15.32:0/3099759491 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0005900 con 0x7fdcf00721a0 2024-01-19T04:15:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.616+0000 7f3974000640 1 -- start start 2024-01-19T04:15:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3974000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f396c0c1120 0x7f396c14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7ff4b4a00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff488066600 0x7ff488068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe120200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe11806d270 0x7fe1180ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fdcecc00640 1 -- 172.21.15.32:0/3099759491 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce0005a60 con 0x7fdcf00721a0 2024-01-19T04:15:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fdcecc00640 1 -- 172.21.15.32:0/3099759491 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0005e30 con 0x7fdcf00721a0 2024-01-19T04:15:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f29b7400640 1 -- 172.21.15.32:0/1889118781 shutdown_connections 2024-01-19T04:15:10.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f29b7400640 1 --2- 172.21.15.32:0/1889118781 >> v2:172.21.15.67:3300/0 conn(0x7f29b00c04a0 0x7f29b00c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f29b7400640 1 --2- 172.21.15.32:0/1889118781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b0158b00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f29b7400640 1 -- 172.21.15.32:0/1889118781 >> 172.21.15.32:0/1889118781 conn(0x7f29b00c5b20 msgr2=0x7f29b00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3974000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c42b0 0x7f396c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe120200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1181561c0 0x7fe1181492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe120200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe118158e40 0x7fe1180c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe120200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180aab20 con 0x7fe11806d270 2024-01-19T04:15:10.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe120200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181497f0 con 0x7fe1181561c0 2024-01-19T04:15:10.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe120200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181f5510 con 0x7fe118158e40 2024-01-19T04:15:10.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f396c0c1120 0x7f396c14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe118158e40 0x7fe1180c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f29b7400640 1 -- 172.21.15.32:0/1889118781 shutdown_connections 2024-01-19T04:15:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3974000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f396c0c5740 0x7f396c1ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3974000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0aaf10 con 0x7f396c0c5740 2024-01-19T04:15:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3974000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c14db60 con 0x7f396c0c42b0 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3974000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c14de40 con 0x7f396c0c1120 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3970c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c42b0 0x7f396c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3970c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c42b0 0x7f396c14fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:39074/0 (socket says 172.21.15.32:39074) 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe118158e40 0x7fe1180c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39132/0 (socket says 172.21.15.32:39132) 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 -- 172.21.15.32:0/3728370108 learned_addr learned my addr 172.21.15.32:0/3728370108 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11d800640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe11806d270 0x7fe1180ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11ce00640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1181561c0 0x7fe1181492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf01548e0 con 0x7fdcf00721a0 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf00aab20 con 0x7fdcf00721a0 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f396c0c1120 0x7f396c14ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39128/0 (socket says 172.21.15.32:39128) 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 -- 172.21.15.32:0/3653338492 learned_addr learned my addr 172.21.15.32:0/3653338492 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 -- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1181561c0 msgr2=0x7fe1181492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1181561c0 0x7fe1181492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 -- 172.21.15.32:0/3728370108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe11806d270 msgr2=0x7fe1180ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe11806d270 0x7fe1180ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 -- 172.21.15.32:0/3728370108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009b30 con 0x7fe118158e40 2024-01-19T04:15:10.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11ce00640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1181561c0 0x7fe1181492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:10.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f6452a00640 1 Processor -- start 2024-01-19T04:15:10.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3972000640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f396c0c5740 0x7f396c1ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7ff4b4a00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff488066600 0x7ff488068ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009b10 tx=0x7ff4a80a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 -- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c42b0 msgr2=0x7f396c14fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c42b0 0x7f396c14fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 -- 172.21.15.32:0/3653338492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f396c0c5740 msgr2=0x7f396c1ec3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f396c0c5740 0x7f396c1ec3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f3971600640 1 -- 172.21.15.32:0/3653338492 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540108d0 con 0x7f396c0c1120 2024-01-19T04:15:10.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7fe11e200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe118158e40 0x7fe1180c0f10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe11001af40 tx=0x7fe110019630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f3971600640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f396c0c1120 0x7f396c14ec00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c750 tx=0x7f395c00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.620+0000 7f6452a00640 1 -- start start 2024-01-19T04:15:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf00749f0 con 0x7fdcf00721a0 2024-01-19T04:15:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7fe115600640 1 -- 172.21.15.32:0/3728370108 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a55c0 con 0x7fe118158e40 2024-01-19T04:15:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7fe115600640 1 -- 172.21.15.32:0/3728370108 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100b8670 con 0x7fe118158e40 2024-01-19T04:15:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7fe115600640 1 -- 172.21.15.32:0/3728370108 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100b8a00 con 0x7fe118158e40 2024-01-19T04:15:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f3969600640 1 -- 172.21.15.32:0/3653338492 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c005280 con 0x7f396c0c1120 2024-01-19T04:15:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c14e120 con 0x7f396c0c1120 2024-01-19T04:15:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7ff4acc00640 1 -- 172.21.15.32:0/2590241058 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff4b00a8b50 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f6452a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f644c0721a0 0x7f644c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f6452a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c0c6470 0x7f644c0a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f6452a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f644c1513c0 0x7f644c0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f6452a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c14ea40 con 0x7f644c1513c0 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f6452a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c14d300 con 0x7f644c0c6470 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f6452a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c14d880 con 0x7f644c0721a0 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c14e6e0 con 0x7f396c0c1120 2024-01-19T04:15:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f3969600640 1 -- 172.21.15.32:0/3653338492 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c0053e0 con 0x7f396c0c1120 2024-01-19T04:15:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f3969600640 1 -- 172.21.15.32:0/3653338492 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c00a880 con 0x7f396c0c1120 2024-01-19T04:15:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c0c1de0 con 0x7f396c0c1120 2024-01-19T04:15:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7fdcecc00640 1 -- 172.21.15.32:0/3099759491 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdce0007090 con 0x7fdcf00721a0 2024-01-19T04:15:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1181f57f0 con 0x7fe118158e40 2024-01-19T04:15:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.624+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1180718a0 con 0x7fe118158e40 2024-01-19T04:15:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1180aa610 con 0x7fe118158e40 2024-01-19T04:15:10.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6451600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f644c0721a0 0x7f644c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6451600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f644c0721a0 0x7f644c0a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39140/0 (socket says 172.21.15.32:39140) 2024-01-19T04:15:10.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6451600640 1 -- 172.21.15.32:0/3469573326 learned_addr learned my addr 172.21.15.32:0/3469573326 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6452000640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f644c1513c0 0x7f644c0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7fe115600640 1 -- 172.21.15.32:0/3728370108 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe1100b8b60 con 0x7fe118158e40 2024-01-19T04:15:10.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f29b7400640 1 -- 172.21.15.32:0/1889118781 wait complete. 2024-01-19T04:15:10.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f29b7400640 1 Processor -- start 2024-01-19T04:15:10.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6452000640 1 -- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f644c0721a0 msgr2=0x7f644c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6452000640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f644c0721a0 0x7f644c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6452000640 1 -- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c0c6470 msgr2=0x7f644c0a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6452000640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c0c6470 0x7f644c0a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6452000640 1 -- 172.21.15.32:0/3469573326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434009420 con 0x7f644c1513c0 2024-01-19T04:15:10.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7fdcecc00640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdcc80665d0 0x7fdcc8068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7fdcecc00640 1 -- 172.21.15.32:0/3099759491 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdce00943f0 con 0x7fdcf00721a0 2024-01-19T04:15:10.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f29b7400640 1 -- start start 2024-01-19T04:15:10.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f3969600640 1 -- 172.21.15.32:0/3653338492 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f395c00a9e0 con 0x7f396c0c1120 2024-01-19T04:15:10.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f6452000640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f644c1513c0 0x7f644c0aa740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f644400f900 tx=0x7f644400fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7fe115600640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0f0066580 0x7fe0f0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7fdcefe00640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdcc80665d0 0x7fdcc8068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7fe115600640 1 -- 172.21.15.32:0/3728370108 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe11011ed60 con 0x7fe118158e40 2024-01-19T04:15:10.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.628+0000 7f3969600640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3944066500 0x7f39440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7fe11d800640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0f0066580 0x7fe0f0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f3969600640 1 -- 172.21.15.32:0/3653338492 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f395c0834c0 con 0x7f396c0c1120 2024-01-19T04:15:10.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f3970c00640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3944066500 0x7f39440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b00c04a0 0x7f29b01f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7fe11d800640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0f0066580 0x7fe0f0068a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe108007a60 tx=0x7fe108008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7fdcefe00640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdcc80665d0 0x7fdcc8068a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009320 tx=0x7fdcd80092b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f3970c00640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3944066500 0x7f39440689c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39540b7000 tx=0x7f3954004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b00c04a0 0x7f29b01f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b00c04a0 0x7f29b01f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:39102/0 (socket says 172.21.15.32:39102) 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b4a00640 1 -- 172.21.15.32:0/1965758110 learned_addr learned my addr 172.21.15.32:0/1965758110 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29afe00640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b7400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b0152d20 0x7f29b014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b5400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b0152d20 0x7f29b014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b014abb0 con 0x7f29b00c21c0 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b01f5c00 con 0x7f29b00c04a0 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b014c250 con 0x7f29b0152d20 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29afe00640 1 -- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b0152d20 msgr2=0x7f29b014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29afe00640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b0152d20 0x7f29b014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f29afe00640 1 -- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b00c04a0 msgr2=0x7f29b01f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.632+0000 7f6449600640 1 -- 172.21.15.32:0/3469573326 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644400c070 con 0x7f644c1513c0 2024-01-19T04:15:10.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29afe00640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b00c04a0 0x7f29b01f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c0a9b60 con 0x7f644c1513c0 2024-01-19T04:15:10.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29afe00640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980094d0 con 0x7f29b00c21c0 2024-01-19T04:15:10.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c14d5a0 con 0x7f644c1513c0 2024-01-19T04:15:10.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29b5400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b0152d20 0x7f29b014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:10.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7fe115600640 1 -- 172.21.15.32:0/3728370108 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe1180aa610 con 0x7fe118158e40 2024-01-19T04:15:10.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7fdcecc00640 1 -- 172.21.15.32:0/3099759491 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdce0061720 con 0x7fdcf00721a0 2024-01-19T04:15:10.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29afe00640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b014a130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29980ab000 tx=0x7f29980191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f6449600640 1 -- 172.21.15.32:0/3469573326 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440094c0 con 0x7f644c1513c0 2024-01-19T04:15:10.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f6449600640 1 -- 172.21.15.32:0/3469573326 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644400de50 con 0x7f644c1513c0 2024-01-19T04:15:10.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29acc00640 1 -- 172.21.15.32:0/1965758110 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980b5640 con 0x7f29b00c21c0 2024-01-19T04:15:10.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c0052a0 con 0x7f644c1513c0 2024-01-19T04:15:10.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29acc00640 1 -- 172.21.15.32:0/1965758110 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29980abe90 con 0x7f29b00c21c0 2024-01-19T04:15:10.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b014c4c0 con 0x7f29b00c21c0 2024-01-19T04:15:10.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b014ff70 con 0x7f29b00c21c0 2024-01-19T04:15:10.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.636+0000 7f6449600640 1 -- 172.21.15.32:0/3469573326 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6444004020 con 0x7f644c1513c0 2024-01-19T04:15:10.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.640+0000 7f6449600640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6424066500 0x7f64240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.640+0000 7f6449600640 1 -- 172.21.15.32:0/3469573326 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6444083b40 con 0x7f644c1513c0 2024-01-19T04:15:10.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.640+0000 7f3969600640 1 -- 172.21.15.32:0/3653338492 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f395c0508a0 con 0x7f396c0c1120 2024-01-19T04:15:10.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.640+0000 7f6451600640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6424066500 0x7f64240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.640+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b00749f0 con 0x7f29b00c21c0 2024-01-19T04:15:10.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.640+0000 7f29acc00640 1 -- 172.21.15.32:0/1965758110 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980b59a0 con 0x7f29b00c21c0 2024-01-19T04:15:10.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.640+0000 7f6451600640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6424066500 0x7f64240689c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f644c0719b0 tx=0x7f64340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.648+0000 7f6449600640 1 -- 172.21.15.32:0/3469573326 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6444050e60 con 0x7f644c1513c0 2024-01-19T04:15:10.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.660+0000 7f29acc00640 1 -- 172.21.15.32:0/1965758110 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f29980b5b00 con 0x7f29b00c21c0 2024-01-19T04:15:10.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.660+0000 7f29acc00640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29880665d0 0x7f2988068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.660+0000 7f29acc00640 1 -- 172.21.15.32:0/1965758110 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f299811e670 con 0x7f29b00c21c0 2024-01-19T04:15:10.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.660+0000 7f29acc00640 1 -- 172.21.15.32:0/1965758110 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f299811ea50 con 0x7f29b00c21c0 2024-01-19T04:15:10.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.660+0000 7ff455200640 1 Processor -- start 2024-01-19T04:15:10.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.660+0000 7f29b4a00640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29880665d0 0x7f2988068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7f29b4a00640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29880665d0 0x7f2988068a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009f90 tx=0x7f29a00095b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.660+0000 7ff455200640 1 -- start start 2024-01-19T04:15:10.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff455200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4501513c0 0x7ff4500c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff455200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4500721a0 0x7ff450070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff455200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4501517a0 con 0x7ff4500c6470 2024-01-19T04:15:10.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff455200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4500c1de0 con 0x7ff4500721a0 2024-01-19T04:15:10.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff455200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45006c860 con 0x7ff4501513c0 2024-01-19T04:15:10.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff44fe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff4500c6470 0x7ff4500705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50518/0 (socket says 172.21.15.32:50518) 2024-01-19T04:15:10.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff44fe00640 1 -- 172.21.15.32:0/4187059955 learned_addr learned my addr 172.21.15.32:0/4187059955 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:10.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff44f400640 1 --2- 172.21.15.32:0/4187059955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4501513c0 0x7ff4500c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.664+0000 7ff44ea00640 1 --2- 172.21.15.32:0/4187059955 >> v2:172.21.15.32:3300/0 conn(0x7ff4500721a0 0x7ff450070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.668+0000 7ff44e000640 1 -- 172.21.15.32:0/4187059955 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429302839 0 0) 0x7ff4501517a0 con 0x7ff4500c6470 2024-01-19T04:15:10.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.668+0000 7ff44f400640 1 -- 172.21.15.32:0/4187059955 >> v2:172.21.15.32:3300/0 conn(0x7ff4500721a0 msgr2=0x7ff450070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:10.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.668+0000 7ff44f400640 1 --2- 172.21.15.32:0/4187059955 >> v2:172.21.15.32:3300/0 conn(0x7ff4500721a0 0x7ff450070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.668+0000 7ff44f400640 1 -- 172.21.15.32:0/4187059955 >> v1:172.21.15.67:6789/0 conn(0x7ff4500c6470 legacy=0x7ff4500705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.668+0000 7ff44ea00640 1 --2- 172.21.15.32:0/4187059955 >> v2:172.21.15.32:3300/0 conn(0x7ff4500721a0 0x7ff450070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:10.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.668+0000 7ff44f400640 1 -- 172.21.15.32:0/4187059955 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45006bfe0 con 0x7ff4501513c0 2024-01-19T04:15:10.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.672+0000 7ff44f400640 1 --2- 172.21.15.32:0/4187059955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4501513c0 0x7ff4500c5f30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff438009fd0 tx=0x7ff43801d560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0609911ca42e541 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.672+0000 7ff44e000640 1 -- 172.21.15.32:0/4187059955 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380a7620 con 0x7ff4501513c0 2024-01-19T04:15:10.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.672+0000 7ff44e000640 1 -- 172.21.15.32:0/4187059955 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4380a7780 con 0x7ff4501513c0 2024-01-19T04:15:10.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.672+0000 7ff44e000640 1 -- 172.21.15.32:0/4187059955 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380a7620 con 0x7ff4501513c0 2024-01-19T04:15:10.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.672+0000 7ff455200640 1 -- 172.21.15.32:0/4187059955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4501513c0 msgr2=0x7ff4500c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.672+0000 7ff455200640 1 --2- 172.21.15.32:0/4187059955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4501513c0 0x7ff4500c5f30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff438009fd0 tx=0x7ff43801d560 comp rx=0 tx=0).stop 2024-01-19T04:15:10.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.675+0000 7ff455200640 1 -- 172.21.15.32:0/4187059955 shutdown_connections 2024-01-19T04:15:10.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.675+0000 7ff455200640 1 --2- 172.21.15.32:0/4187059955 >> v2:172.21.15.32:3300/0 conn(0x7ff4500721a0 0x7ff450070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.675+0000 7ff455200640 1 --2- 172.21.15.32:0/4187059955 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4501513c0 0x7ff4500c5f30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.675+0000 7ff455200640 1 -- 172.21.15.32:0/4187059955 >> 172.21.15.32:0/4187059955 conn(0x7ff4500a7a20 msgr2=0x7ff4500a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.675+0000 7ff455200640 1 -- 172.21.15.32:0/4187059955 shutdown_connections 2024-01-19T04:15:10.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.675+0000 7ff455200640 1 -- 172.21.15.32:0/4187059955 wait complete. 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 Processor -- start 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 -- start start 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4500721a0 0x7ff4501538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4500c6470 0x7ff450147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4501513c0 0x7ff4501480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450148600 con 0x7ff4501513c0 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4501546d0 con 0x7ff4500c6470 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff455200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450071440 con 0x7ff4500721a0 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4500721a0 0x7ff4501538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4500721a0 0x7ff4501538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:39158/0 (socket says 172.21.15.32:39158) 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 -- 172.21.15.32:0/1700040626 learned_addr learned my addr 172.21.15.32:0/1700040626 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44ea00640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4500c6470 0x7ff450147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 -- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4500c6470 msgr2=0x7ff450147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4500c6470 0x7ff450147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 -- 172.21.15.32:0/1700040626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4501513c0 msgr2=0x7ff4501480c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-19T04:15:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44fe00640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4501513c0 0x7ff4501480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4501513c0 0x7ff4501480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44f400640 1 -- 172.21.15.32:0/1700040626 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009cb0 con 0x7ff4500721a0 2024-01-19T04:15:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.679+0000 7ff44ea00640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4500c6470 0x7ff450147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.683+0000 7ff44f400640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4500721a0 0x7ff4501538e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff43801b190 tx=0x7ff43801a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.683+0000 7ff447400640 1 -- 172.21.15.32:0/1700040626 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380b7070 con 0x7ff4500721a0 2024-01-19T04:15:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.683+0000 7ff447400640 1 -- 172.21.15.32:0/1700040626 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4380a7c40 con 0x7ff4500721a0 2024-01-19T04:15:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.683+0000 7ff447400640 1 -- 172.21.15.32:0/1700040626 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438003620 con 0x7ff4500721a0 2024-01-19T04:15:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.683+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff450071720 con 0x7ff4500721a0 2024-01-19T04:15:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.687+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4500ab290 con 0x7ff4500721a0 2024-01-19T04:15:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.687+0000 7ff447400640 1 -- 172.21.15.32:0/1700040626 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff438003780 con 0x7ff4500721a0 2024-01-19T04:15:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.691+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4500712a0 con 0x7ff4500721a0 2024-01-19T04:15:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.691+0000 7ff447400640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff42806a920 0x7ff42806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.691+0000 7ff447400640 1 -- 172.21.15.32:0/1700040626 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4380efb00 con 0x7ff4500721a0 2024-01-19T04:15:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.691+0000 7ff44ea00640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff42806a920 0x7ff42806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.695+0000 7ff44ea00640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff42806a920 0x7ff42806cde0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff450152e10 tx=0x7ff440008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.695+0000 7ff447400640 1 -- 172.21.15.32:0/1700040626 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff4380ebed0 con 0x7ff4500721a0 2024-01-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.907+0000 7f014e000640 1 -- 172.21.15.32:0/4202199 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0118005820 con 0x7f01480c20e0 2024-01-19T04:15:10.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.911+0000 7f013f400640 1 -- 172.21.15.32:0/4202199 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01400c7020 con 0x7f01480c20e0 2024-01-19T04:15:10.914 INFO:teuthology.orchestra.run.smithi032.stdout:68719476742 2024-01-19T04:15:10.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.911+0000 7f013cc00640 1 -- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01200665c0 msgr2=0x7f0120068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.911+0000 7f013cc00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01200665c0 0x7f0120068a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0138009cb0 tx=0x7f0138009060 comp rx=0 tx=0).stop 2024-01-19T04:15:10.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.911+0000 7f013cc00640 1 -- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01480c20e0 msgr2=0x7f01480bd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.911+0000 7f013cc00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01480c20e0 0x7f01480bd970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01400b0040 tx=0x7f0140019580 comp rx=0 tx=0).stop 2024-01-19T04:15:10.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 -- 172.21.15.32:0/4202199 shutdown_connections 2024-01-19T04:15:10.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01200665c0 0x7f0120068a80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0148151370 0x7f01480bdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01480c20e0 0x7f01480bd970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 --2- 172.21.15.32:0/4202199 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0148072300 0x7f01480a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 -- 172.21.15.32:0/4202199 >> 172.21.15.32:0/4202199 conn(0x7f01480c5b20 msgr2=0x7f0148150400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 -- 172.21.15.32:0/4202199 shutdown_connections 2024-01-19T04:15:10.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.915+0000 7f013cc00640 1 -- 172.21.15.32:0/4202199 wait complete. 2024-01-19T04:15:10.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.951+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4b00a8b50 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.951+0000 7ff4acc00640 1 -- 172.21.15.32:0/2590241058 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4b00a8b50 con 0x7ff4b00c3fa0 2024-01-19T04:15:10.956 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-01-19T04:15:10.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.6 2024-01-19T04:15:10.957 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:10.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff488066600 msgr2=0x7ff488068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff488066600 0x7ff488068ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009b10 tx=0x7ff4a80a9070 comp rx=0 tx=0).stop 2024-01-19T04:15:10.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 msgr2=0x7ff4b01f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b01f6520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c410 tx=0x7ff49800c8d0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 shutdown_connections 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff488066600 0x7ff488068ac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4b0153780 0x7ff4b01f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4b00c3fa0 0x7ff4b01f6520 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 --2- 172.21.15.32:0/2590241058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4b00c39a0 0x7ff4b0148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 >> 172.21.15.32:0/2590241058 conn(0x7ff4b00a7850 msgr2=0x7ff4b00c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 shutdown_connections 2024-01-19T04:15:10.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.955+0000 7ff4b5e00640 1 -- 172.21.15.32:0/2590241058 wait complete. 2024-01-19T04:15:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.979+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f396c14e8d0 con 0x7f396c0c1120 2024-01-19T04:15:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.979+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdcf00c0570 con 0x7fdcf00721a0 2024-01-19T04:15:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.979+0000 7f3969600640 1 -- 172.21.15.32:0/3653338492 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f395c001360 con 0x7f396c0c1120 2024-01-19T04:15:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.979+0000 7fdcecc00640 1 -- 172.21.15.32:0/3099759491 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdce0028020 con 0x7fdcf00721a0 2024-01-19T04:15:10.985 INFO:teuthology.orchestra.run.smithi032.stdout:68719476743 2024-01-19T04:15:10.986 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-01-19T04:15:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3944066500 msgr2=0x7f39440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f641c005820 con 0x7f644c1513c0 2024-01-19T04:15:10.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3944066500 0x7f39440689c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39540b7000 tx=0x7f3954004740 comp rx=0 tx=0).stop 2024-01-19T04:15:10.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f396c0c1120 msgr2=0x7f396c14ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f396c0c1120 0x7f396c14ec00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c750 tx=0x7f395c00cc10 comp rx=0 tx=0).stop 2024-01-19T04:15:10.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 shutdown_connections 2024-01-19T04:15:10.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3944066500 0x7f39440689c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f396c0c5740 0x7f396c1ec3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f396c0c42b0 0x7f396c14fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 --2- 172.21.15.32:0/3653338492 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f396c0c1120 0x7f396c14ec00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 >> 172.21.15.32:0/3653338492 conn(0x7f396c0c5b20 msgr2=0x7f396c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.0 2024-01-19T04:15:10.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdcc80665d0 msgr2=0x7fdcc8068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdcc80665d0 0x7fdcc8068a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009320 tx=0x7fdcd80092b0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcf00721a0 msgr2=0x7fdcf00bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.983+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcf00721a0 0x7fdcf00bf130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdce001d410 tx=0x7fdce001d8d0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 shutdown_connections 2024-01-19T04:15:10.992 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:10.992 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-01-19T04:15:10.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6449600640 1 -- 172.21.15.32:0/3469573326 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6444021020 con 0x7f644c1513c0 2024-01-19T04:15:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 shutdown_connections 2024-01-19T04:15:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdcc80665d0 0x7fdcc8068a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdcf01513c0 0x7fdcf0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf00c0790 0x7fdcf0148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 --2- 172.21.15.32:0/3099759491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcf00721a0 0x7fdcf00bf130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 >> 172.21.15.32:0/3099759491 conn(0x7fdcf00a7a20 msgr2=0x7fdcf015b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f3974000640 1 -- 172.21.15.32:0/3653338492 wait complete. 2024-01-19T04:15:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 shutdown_connections 2024-01-19T04:15:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fdcf6000640 1 -- 172.21.15.32:0/3099759491 wait complete. 2024-01-19T04:15:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe1180aa610 con 0x7fe118158e40 2024-01-19T04:15:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7fe115600640 1 -- 172.21.15.32:0/3728370108 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1180aa610 con 0x7fe118158e40 2024-01-19T04:15:10.995 INFO:teuthology.orchestra.run.smithi032.stdout:68719476742 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6424066500 msgr2=0x7f64240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6424066500 0x7f64240689c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f644c0719b0 tx=0x7f64340a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f644c1513c0 msgr2=0x7f644c0aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f644c1513c0 0x7f644c0aa740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f644400f900 tx=0x7f644400fdc0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 shutdown_connections 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6424066500 0x7f64240689c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f644c1513c0 0x7f644c0aa740 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f644c0c6470 0x7f644c0a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 --2- 172.21.15.32:0/3469573326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f644c0721a0 0x7f644c0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.987+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 >> 172.21.15.32:0/3469573326 conn(0x7f644c0a7a20 msgr2=0x7f644c1505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 shutdown_connections 2024-01-19T04:15:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7f6452a00640 1 -- 172.21.15.32:0/3469573326 wait complete. 2024-01-19T04:15:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0f0066580 msgr2=0x7fe0f0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0f0066580 0x7fe0f0068a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe108007a60 tx=0x7fe108008040 comp rx=0 tx=0).stop 2024-01-19T04:15:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe118158e40 msgr2=0x7fe1180c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe118158e40 0x7fe1180c0f10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe11001af40 tx=0x7fe110019630 comp rx=0 tx=0).stop 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 shutdown_connections 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0f0066580 0x7fe0f0068a40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe118158e40 0x7fe1180c0f10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1181561c0 0x7fe1181492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 --2- 172.21.15.32:0/3728370108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe11806d270 0x7fe1180ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 >> 172.21.15.32:0/3728370108 conn(0x7fe1180c2950 msgr2=0x7fe118158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 shutdown_connections 2024-01-19T04:15:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:10.991+0000 7fe120200640 1 -- 172.21.15.32:0/3728370108 wait complete. 2024-01-19T04:15:11.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.2 2024-01-19T04:15:11.022 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:11.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.7 2024-01-19T04:15:11.023 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:11.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.019+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29b00c56e0 con 0x7f29b00c21c0 2024-01-19T04:15:11.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29acc00640 1 -- 172.21.15.32:0/1965758110 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29980eb8f0 con 0x7f29b00c21c0 2024-01-19T04:15:11.026 INFO:teuthology.orchestra.run.smithi032.stdout:60129542152 2024-01-19T04:15:11.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29880665d0 msgr2=0x7f2988068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29880665d0 0x7f2988068a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009f90 tx=0x7f29a00095b0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 msgr2=0x7f29b014a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b014a130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29980ab000 tx=0x7f29980191f0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.4 2024-01-19T04:15:11.030 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:11.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 shutdown_connections 2024-01-19T04:15:11.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29880665d0 0x7f2988068a90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29b0152d20 0x7f29b014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29b00c21c0 0x7f29b014a130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 --2- 172.21.15.32:0/1965758110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29b00c04a0 0x7f29b01f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.023+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 >> 172.21.15.32:0/1965758110 conn(0x7f29b00c5b20 msgr2=0x7f29b00c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:11.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.027+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 shutdown_connections 2024-01-19T04:15:11.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.027+0000 7f29b7400640 1 -- 172.21.15.32:0/1965758110 wait complete. 2024-01-19T04:15:11.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2024-01-19T04:15:11.032 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.031+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff450071bd0 con 0x7ff4500721a0 2024-01-19T04:15:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.031+0000 7ff447400640 1 -- 172.21.15.32:0/1700040626 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4380ad030 con 0x7ff4500721a0 2024-01-19T04:15:11.037 INFO:teuthology.orchestra.run.smithi032.stdout:68719476741 2024-01-19T04:15:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff42806a920 msgr2=0x7ff42806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff42806a920 0x7ff42806cde0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff450152e10 tx=0x7ff440008040 comp rx=0 tx=0).stop 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4500721a0 msgr2=0x7ff4501538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4500721a0 0x7ff4501538e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff43801b190 tx=0x7ff43801a300 comp rx=0 tx=0).stop 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 shutdown_connections 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff42806a920 0x7ff42806cde0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4501513c0 0x7ff4501480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4500c6470 0x7ff450147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 --2- 172.21.15.32:0/1700040626 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff4500721a0 0x7ff4501538e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 >> 172.21.15.32:0/1700040626 conn(0x7ff4500a7a20 msgr2=0x7ff45014b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 shutdown_connections 2024-01-19T04:15:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.035+0000 7ff455200640 1 -- 172.21.15.32:0/1700040626 wait complete. 2024-01-19T04:15:11.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.3 2024-01-19T04:15:11.053 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:11.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476741 for osd.5 2024-01-19T04:15:11.060 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:11.060 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-19T04:15:11.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.239+0000 7fed2de00640 1 Processor -- start 2024-01-19T04:15:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.239+0000 7fed2de00640 1 -- start start 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed2de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fed280c06f0 0x7fed280c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed2de00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed28066580 0x7fed280c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed2de00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280c10a0 con 0x7fed28151b00 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed2de00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed280c1380 con 0x7fed280c06f0 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed2de00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280c2290 con 0x7fed28066580 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed26000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fed280c06f0 0x7fed280c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed26a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fed28151b00 0x7fed280bf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47394/0 (socket says 172.21.15.32:47394) 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed26a00640 1 -- 172.21.15.32:0/330927215 learned_addr learned my addr 172.21.15.32:0/330927215 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:11.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed27400640 1 --2- 172.21.15.32:0/330927215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed28066580 0x7fed280c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed25600640 1 -- 172.21.15.32:0/330927215 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360713578 0 0) 0x7fed280c10a0 con 0x7fed28151b00 2024-01-19T04:15:11.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed25600640 1 -- 172.21.15.32:0/330927215 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed08003530 con 0x7fed28151b00 2024-01-19T04:15:11.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed26000640 1 -- 172.21.15.32:0/330927215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed28066580 msgr2=0x7fed280c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:11.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed26000640 1 --2- 172.21.15.32:0/330927215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed28066580 0x7fed280c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed26000640 1 -- 172.21.15.32:0/330927215 >> v1:172.21.15.32:6789/0 conn(0x7fed28151b00 legacy=0x7fed280bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.243+0000 7fed26000640 1 -- 172.21.15.32:0/330927215 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed28066a40 con 0x7fed280c06f0 2024-01-19T04:15:11.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed26000640 1 --2- 172.21.15.32:0/330927215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed280c06f0 0x7fed280c1810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed100097c0 tx=0x7fed1001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2480d2f6796e8e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:11.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed25600640 1 -- 172.21.15.32:0/330927215 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100ab600 con 0x7fed280c06f0 2024-01-19T04:15:11.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed25600640 1 -- 172.21.15.32:0/330927215 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed100a7050 con 0x7fed280c06f0 2024-01-19T04:15:11.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed25600640 1 -- 172.21.15.32:0/330927215 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100ab980 con 0x7fed280c06f0 2024-01-19T04:15:11.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 -- 172.21.15.32:0/330927215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed280c06f0 msgr2=0x7fed280c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 --2- 172.21.15.32:0/330927215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed280c06f0 0x7fed280c1810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed100097c0 tx=0x7fed1001c330 comp rx=0 tx=0).stop 2024-01-19T04:15:11.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 -- 172.21.15.32:0/330927215 shutdown_connections 2024-01-19T04:15:11.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 --2- 172.21.15.32:0/330927215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed28066580 0x7fed280c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 --2- 172.21.15.32:0/330927215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed280c06f0 0x7fed280c1810 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 -- 172.21.15.32:0/330927215 >> 172.21.15.32:0/330927215 conn(0x7fed280c2f00 msgr2=0x7fed280c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:11.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 -- 172.21.15.32:0/330927215 shutdown_connections 2024-01-19T04:15:11.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 -- 172.21.15.32:0/330927215 wait complete. 2024-01-19T04:15:11.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.247+0000 7fed2de00640 1 Processor -- start 2024-01-19T04:15:11.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 -- start start 2024-01-19T04:15:11.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed28066580 0x7fed28144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c06f0 0x7fed28145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed28151b00 0x7fed281f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2806b850 con 0x7fed28151b00 2024-01-19T04:15:11.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed280c4cb0 con 0x7fed28066580 2024-01-19T04:15:11.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280c5210 con 0x7fed280c06f0 2024-01-19T04:15:11.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed28151b00 0x7fed281f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed28151b00 0x7fed281f05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34734/0 (socket says 172.21.15.32:34734) 2024-01-19T04:15:11.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 -- 172.21.15.32:0/3010706339 learned_addr learned my addr 172.21.15.32:0/3010706339 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:11.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed26000640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c06f0 0x7fed28145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed26a00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed28066580 0x7fed28144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 -- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c06f0 msgr2=0x7fed28145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c06f0 0x7fed28145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 -- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed28066580 msgr2=0x7fed28144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed28066580 0x7fed28144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 -- 172.21.15.32:0/3010706339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009420 con 0x7fed28151b00 2024-01-19T04:15:11.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed27400640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed28151b00 0x7fed281f05f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed20009cb0 tx=0x7fed2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:11.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed1f400640 1 -- 172.21.15.32:0/3010706339 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20009b20 con 0x7fed28151b00 2024-01-19T04:15:11.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed1f400640 1 -- 172.21.15.32:0/3010706339 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000f040 con 0x7fed28151b00 2024-01-19T04:15:11.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed1f400640 1 -- 172.21.15.32:0/3010706339 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200146c0 con 0x7fed28151b00 2024-01-19T04:15:11.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed280c4ee0 con 0x7fed28151b00 2024-01-19T04:15:11.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2806b570 con 0x7fed28151b00 2024-01-19T04:15:11.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.251+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed280749f0 con 0x7fed28151b00 2024-01-19T04:15:11.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.255+0000 7fed1f400640 1 -- 172.21.15.32:0/3010706339 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fed20014820 con 0x7fed28151b00 2024-01-19T04:15:11.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.255+0000 7fed1f400640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed00066530 0x7fed000689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.255+0000 7fed1f400640 1 -- 172.21.15.32:0/3010706339 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed20084bf0 con 0x7fed28151b00 2024-01-19T04:15:11.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.255+0000 7fed26a00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed00066530 0x7fed000689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.255+0000 7fed26a00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed00066530 0x7fed000689f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed18001370 tx=0x7fed18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:11.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.259+0000 7fed1f400640 1 -- 172.21.15.32:0/3010706339 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fed20051df0 con 0x7fed28151b00 2024-01-19T04:15:11.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.423+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed28151ee0 con 0x7fed00066530 2024-01-19T04:15:11.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.431+0000 7fed1f400640 1 -- 172.21.15.32:0/3010706339 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264560 (secure 0 0 0) 0x7fed18001c70 con 0x7fed00066530 2024-01-19T04:15:11.438 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:11.440 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed00066530 msgr2=0x7fed000689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed00066530 0x7fed000689f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed18001370 tx=0x7fed18009040 comp rx=0 tx=0).stop 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed28151b00 msgr2=0x7fed281f05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed28151b00 0x7fed281f05f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed20009cb0 tx=0x7fed2000c490 comp rx=0 tx=0).stop 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 shutdown_connections 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed00066530 0x7fed000689f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed28151b00 0x7fed281f05f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed280c06f0 0x7fed28145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 --2- 172.21.15.32:0/3010706339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed28066580 0x7fed28144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 >> 172.21.15.32:0/3010706339 conn(0x7fed280c2f00 msgr2=0x7fed280c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 shutdown_connections 2024-01-19T04:15:11.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.435+0000 7fed2de00640 1 -- 172.21.15.32:0/3010706339 wait complete. 2024-01-19T04:15:11.459 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-01-19T04:15:10.030094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235852,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738868,"statfs":{"total":773094113280,"available":772852600832,"internally_reserved":0,"allocated":3088384,"data_stored":1823980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001929"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793727+0000","last_change":"2024-01-19T04:15:02.673206+0000","last_active":"2024-01-19T04:15:03.793727+0000","last_peered":"2024-01-19T04:15:03.793727+0000","last_clean":"2024-01-19T04:15:03.793727+0000","last_became_active":"2024-01-19T04:15:02.672837+0000","last_became_peered":"2024-01-19T04:15:02.672837+0000","last_unstale":"2024-01-19T04:15:03.793727+0000","last_undegraded":"2024-01-19T04:15:03.793727+0000","last_fullsized":"2024-01-19T04:15:03.793727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793881+0000","last_change":"2024-01-19T04:15:02.660330+0000","last_active":"2024-01-19T04:15:03.793881+0000","last_peered":"2024-01-19T04:15:03.793881+0000","last_clean":"2024-01-19T04:15:03.793881+0000","last_became_active":"2024-01-19T04:15:02.660069+0000","last_became_peered":"2024-01-19T04:15:02.660069+0000","last_unstale":"2024-01-19T04:15:03.793881+0000","last_undegraded":"2024-01-19T04:15:03.793881+0000","last_fullsized":"2024-01-19T04:15:03.793881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793227+0000","last_change":"2024-01-19T04:15:02.671714+0000","last_active":"2024-01-19T04:15:03.793227+0000","last_peered":"2024-01-19T04:15:03.793227+0000","last_clean":"2024-01-19T04:15:03.793227+0000","last_became_active":"2024-01-19T04:15:02.667718+0000","last_became_peered":"2024-01-19T04:15:02.667718+0000","last_unstale":"2024-01-19T04:15:03.793227+0000","last_undegraded":"2024-01-19T04:15:03.793227+0000","last_fullsized":"2024-01-19T04:15:03.793227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793901+0000","last_change":"2024-01-19T04:15:02.683062+0000","last_active":"2024-01-19T04:15:03.793901+0000","last_peered":"2024-01-19T04:15:03.793901+0000","last_clean":"2024-01-19T04:15:03.793901+0000","last_became_active":"2024-01-19T04:15:02.682769+0000","last_became_peered":"2024-01-19T04:15:02.682769+0000","last_unstale":"2024-01-19T04:15:03.793901+0000","last_undegraded":"2024-01-19T04:15:03.793901+0000","last_fullsized":"2024-01-19T04:15:03.793901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794606+0000","last_change":"2024-01-19T04:15:02.675817+0000","last_active":"2024-01-19T04:15:03.794606+0000","last_peered":"2024-01-19T04:15:03.794606+0000","last_clean":"2024-01-19T04:15:03.794606+0000","last_became_active":"2024-01-19T04:15:02.673948+0000","last_became_peered":"2024-01-19T04:15:02.673948+0000","last_unstale":"2024-01-19T04:15:03.794606+0000","last_undegraded":"2024-01-19T04:15:03.794606+0000","last_fullsized":"2024-01-19T04:15:03.794606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793668+0000","last_change":"2024-01-19T04:15:02.680536+0000","last_active":"2024-01-19T04:15:03.793668+0000","last_peered":"2024-01-19T04:15:03.793668+0000","last_clean":"2024-01-19T04:15:03.793668+0000","last_became_active":"2024-01-19T04:15:02.680182+0000","last_became_peered":"2024-01-19T04:15:02.680182+0000","last_unstale":"2024-01-19T04:15:03.793668+0000","last_undegraded":"2024-01-19T04:15:03.793668+0000","last_fullsized":"2024-01-19T04:15:03.793668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:13:26.044664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793083+0000","last_change":"2024-01-19T04:15:02.667084+0000","last_active":"2024-01-19T04:15:03.793083+0000","last_peered":"2024-01-19T04:15:03.793083+0000","last_clean":"2024-01-19T04:15:03.793083+0000","last_became_active":"2024-01-19T04:15:02.666773+0000","last_became_peered":"2024-01-19T04:15:02.666773+0000","last_unstale":"2024-01-19T04:15:03.793083+0000","last_undegraded":"2024-01-19T04:15:03.793083+0000","last_fullsized":"2024-01-19T04:15:03.793083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.791850+0000","last_change":"2024-01-19T04:15:02.681046+0000","last_active":"2024-01-19T04:15:03.791850+0000","last_peered":"2024-01-19T04:15:03.791850+0000","last_clean":"2024-01-19T04:15:03.791850+0000","last_became_active":"2024-01-19T04:15:02.680748+0000","last_became_peered":"2024-01-19T04:15:02.680748+0000","last_unstale":"2024-01-19T04:15:03.791850+0000","last_undegraded":"2024-01-19T04:15:03.791850+0000","last_fullsized":"2024-01-19T04:15:03.791850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:35.522445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793875+0000","last_change":"2024-01-19T04:15:02.686021+0000","last_active":"2024-01-19T04:15:03.793875+0000","last_peered":"2024-01-19T04:15:03.793875+0000","last_clean":"2024-01-19T04:15:03.793875+0000","last_became_active":"2024-01-19T04:15:02.685239+0000","last_became_peered":"2024-01-19T04:15:02.685239+0000","last_unstale":"2024-01-19T04:15:03.793875+0000","last_undegraded":"2024-01-19T04:15:03.793875+0000","last_fullsized":"2024-01-19T04:15:03.793875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793470+0000","last_change":"2024-01-19T04:15:02.685444+0000","last_active":"2024-01-19T04:15:03.793470+0000","last_peered":"2024-01-19T04:15:03.793470+0000","last_clean":"2024-01-19T04:15:03.793470+0000","last_became_active":"2024-01-19T04:15:02.685184+0000","last_became_peered":"2024-01-19T04:15:02.685184+0000","last_unstale":"2024-01-19T04:15:03.793470+0000","last_undegraded":"2024-01-19T04:15:03.793470+0000","last_fullsized":"2024-01-19T04:15:03.793470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794527+0000","last_change":"2024-01-19T04:15:02.686028+0000","last_active":"2024-01-19T04:15:03.794527+0000","last_peered":"2024-01-19T04:15:03.794527+0000","last_clean":"2024-01-19T04:15:03.794527+0000","last_became_active":"2024-01-19T04:15:02.685561+0000","last_became_peered":"2024-01-19T04:15:02.685561+0000","last_unstale":"2024-01-19T04:15:03.794527+0000","last_undegraded":"2024-01-19T04:15:03.794527+0000","last_fullsized":"2024-01-19T04:15:03.794527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663222+0000","last_change":"2024-01-19T04:15:02.671711+0000","last_active":"2024-01-19T04:15:03.663222+0000","last_peered":"2024-01-19T04:15:03.663222+0000","last_clean":"2024-01-19T04:15:03.663222+0000","last_became_active":"2024-01-19T04:15:02.671331+0000","last_became_peered":"2024-01-19T04:15:02.671331+0000","last_unstale":"2024-01-19T04:15:03.663222+0000","last_undegraded":"2024-01-19T04:15:03.663222+0000","last_fullsized":"2024-01-19T04:15:03.663222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:48.803204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792305+0000","last_change":"2024-01-19T04:15:02.672095+0000","last_active":"2024-01-19T04:15:03.792305+0000","last_peered":"2024-01-19T04:15:03.792305+0000","last_clean":"2024-01-19T04:15:03.792305+0000","last_became_active":"2024-01-19T04:15:02.671811+0000","last_became_peered":"2024-01-19T04:15:02.671811+0000","last_unstale":"2024-01-19T04:15:03.792305+0000","last_undegraded":"2024-01-19T04:15:03.792305+0000","last_fullsized":"2024-01-19T04:15:03.792305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:33.488079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792698+0000","last_change":"2024-01-19T04:15:02.659658+0000","last_active":"2024-01-19T04:15:03.792698+0000","last_peered":"2024-01-19T04:15:03.792698+0000","last_clean":"2024-01-19T04:15:03.792698+0000","last_became_active":"2024-01-19T04:15:02.659343+0000","last_became_peered":"2024-01-19T04:15:02.659343+0000","last_unstale":"2024-01-19T04:15:03.792698+0000","last_undegraded":"2024-01-19T04:15:03.792698+0000","last_fullsized":"2024-01-19T04:15:03.792698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:37.529811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793549+0000","last_change":"2024-01-19T04:15:02.661052+0000","last_active":"2024-01-19T04:15:03.793549+0000","last_peered":"2024-01-19T04:15:03.793549+0000","last_clean":"2024-01-19T04:15:03.793549+0000","last_became_active":"2024-01-19T04:15:02.660725+0000","last_became_peered":"2024-01-19T04:15:02.660725+0000","last_unstale":"2024-01-19T04:15:03.793549+0000","last_undegraded":"2024-01-19T04:15:03.793549+0000","last_fullsized":"2024-01-19T04:15:03.793549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794007+0000","last_change":"2024-01-19T04:15:02.674681+0000","last_active":"2024-01-19T04:15:03.794007+0000","last_peered":"2024-01-19T04:15:03.794007+0000","last_clean":"2024-01-19T04:15:03.794007+0000","last_became_active":"2024-01-19T04:15:02.674302+0000","last_became_peered":"2024-01-19T04:15:02.674302+0000","last_unstale":"2024-01-19T04:15:03.794007+0000","last_undegraded":"2024-01-19T04:15:03.794007+0000","last_fullsized":"2024-01-19T04:15:03.794007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794556+0000","last_change":"2024-01-19T04:15:02.680651+0000","last_active":"2024-01-19T04:15:03.794556+0000","last_peered":"2024-01-19T04:15:03.794556+0000","last_clean":"2024-01-19T04:15:03.794556+0000","last_became_active":"2024-01-19T04:15:02.680263+0000","last_became_peered":"2024-01-19T04:15:02.680263+0000","last_unstale":"2024-01-19T04:15:03.794556+0000","last_undegraded":"2024-01-19T04:15:03.794556+0000","last_fullsized":"2024-01-19T04:15:03.794556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661205+0000","last_change":"2024-01-19T04:15:02.669777+0000","last_active":"2024-01-19T04:15:03.661205+0000","last_peered":"2024-01-19T04:15:03.661205+0000","last_clean":"2024-01-19T04:15:03.661205+0000","last_became_active":"2024-01-19T04:15:02.669488+0000","last_became_peered":"2024-01-19T04:15:02.669488+0000","last_unstale":"2024-01-19T04:15:03.661205+0000","last_undegraded":"2024-01-19T04:15:03.661205+0000","last_fullsized":"2024-01-19T04:15:03.661205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:10.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793826+0000","last_change":"2024-01-19T04:15:02.666101+0000","last_active":"2024-01-19T04:15:03.793826+0000","last_peered":"2024-01-19T04:15:03.793826+0000","last_clean":"2024-01-19T04:15:03.793826+0000","last_became_active":"2024-01-19T04:15:02.665664+0000","last_became_peered":"2024-01-19T04:15:02.665664+0000","last_unstale":"2024-01-19T04:15:03.793826+0000","last_undegraded":"2024-01-19T04:15:03.793826+0000","last_fullsized":"2024-01-19T04:15:03.793826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793385+0000","last_change":"2024-01-19T04:15:02.682696+0000","last_active":"2024-01-19T04:15:03.793385+0000","last_peered":"2024-01-19T04:15:03.793385+0000","last_clean":"2024-01-19T04:15:03.793385+0000","last_became_active":"2024-01-19T04:15:02.682337+0000","last_became_peered":"2024-01-19T04:15:02.682337+0000","last_unstale":"2024-01-19T04:15:03.793385+0000","last_undegraded":"2024-01-19T04:15:03.793385+0000","last_fullsized":"2024-01-19T04:15:03.793385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793229+0000","last_change":"2024-01-19T04:15:02.675046+0000","last_active":"2024-01-19T04:15:03.793229+0000","last_peered":"2024-01-19T04:15:03.793229+0000","last_clean":"2024-01-19T04:15:03.793229+0000","last_became_active":"2024-01-19T04:15:02.674569+0000","last_became_peered":"2024-01-19T04:15:02.674569+0000","last_unstale":"2024-01-19T04:15:03.793229+0000","last_undegraded":"2024-01-19T04:15:03.793229+0000","last_fullsized":"2024-01-19T04:15:03.793229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793823+0000","last_change":"2024-01-19T04:15:02.679833+0000","last_active":"2024-01-19T04:15:03.793823+0000","last_peered":"2024-01-19T04:15:03.793823+0000","last_clean":"2024-01-19T04:15:03.793823+0000","last_became_active":"2024-01-19T04:15:02.679450+0000","last_became_peered":"2024-01-19T04:15:02.679450+0000","last_unstale":"2024-01-19T04:15:03.793823+0000","last_undegraded":"2024-01-19T04:15:03.793823+0000","last_fullsized":"2024-01-19T04:15:03.793823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792111+0000","last_change":"2024-01-19T04:15:02.675672+0000","last_active":"2024-01-19T04:15:03.792111+0000","last_peered":"2024-01-19T04:15:03.792111+0000","last_clean":"2024-01-19T04:15:03.792111+0000","last_became_active":"2024-01-19T04:15:02.668805+0000","last_became_peered":"2024-01-19T04:15:02.668805+0000","last_unstale":"2024-01-19T04:15:03.792111+0000","last_undegraded":"2024-01-19T04:15:03.792111+0000","last_fullsized":"2024-01-19T04:15:03.792111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:49.221178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794204+0000","last_change":"2024-01-19T04:15:02.679845+0000","last_active":"2024-01-19T04:15:03.794204+0000","last_peered":"2024-01-19T04:15:03.794204+0000","last_clean":"2024-01-19T04:15:03.794204+0000","last_became_active":"2024-01-19T04:15:02.679512+0000","last_became_peered":"2024-01-19T04:15:02.679512+0000","last_unstale":"2024-01-19T04:15:03.794204+0000","last_undegraded":"2024-01-19T04:15:03.794204+0000","last_fullsized":"2024-01-19T04:15:03.794204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792559+0000","last_change":"2024-01-19T04:15:02.668029+0000","last_active":"2024-01-19T04:15:03.792559+0000","last_peered":"2024-01-19T04:15:03.792559+0000","last_clean":"2024-01-19T04:15:03.792559+0000","last_became_active":"2024-01-19T04:15:02.667742+0000","last_became_peered":"2024-01-19T04:15:02.667742+0000","last_unstale":"2024-01-19T04:15:03.792559+0000","last_undegraded":"2024-01-19T04:15:03.792559+0000","last_fullsized":"2024-01-19T04:15:03.792559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.431141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793620+0000","last_change":"2024-01-19T04:15:02.684316+0000","last_active":"2024-01-19T04:15:03.793620+0000","last_peered":"2024-01-19T04:15:03.793620+0000","last_clean":"2024-01-19T04:15:03.793620+0000","last_became_active":"2024-01-19T04:15:02.681947+0000","last_became_peered":"2024-01-19T04:15:02.681947+0000","last_unstale":"2024-01-19T04:15:03.793620+0000","last_undegraded":"2024-01-19T04:15:03.793620+0000","last_fullsized":"2024-01-19T04:15:03.793620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793691+0000","last_change":"2024-01-19T04:15:02.672775+0000","last_active":"2024-01-19T04:15:03.793691+0000","last_peered":"2024-01-19T04:15:03.793691+0000","last_clean":"2024-01-19T04:15:03.793691+0000","last_became_active":"2024-01-19T04:15:02.672561+0000","last_became_peered":"2024-01-19T04:15:02.672561+0000","last_unstale":"2024-01-19T04:15:03.793691+0000","last_undegraded":"2024-01-19T04:15:03.793691+0000","last_fullsized":"2024-01-19T04:15:03.793691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792576+0000","last_change":"2024-01-19T04:15:02.661526+0000","last_active":"2024-01-19T04:15:03.792576+0000","last_peered":"2024-01-19T04:15:03.792576+0000","last_clean":"2024-01-19T04:15:03.792576+0000","last_became_active":"2024-01-19T04:15:02.661278+0000","last_became_peered":"2024-01-19T04:15:02.661278+0000","last_unstale":"2024-01-19T04:15:03.792576+0000","last_undegraded":"2024-01-19T04:15:03.792576+0000","last_fullsized":"2024-01-19T04:15:03.792576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:52:08.790222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793056+0000","last_change":"2024-01-19T04:15:02.660175+0000","last_active":"2024-01-19T04:15:03.793056+0000","last_peered":"2024-01-19T04:15:03.793056+0000","last_clean":"2024-01-19T04:15:03.793056+0000","last_became_active":"2024-01-19T04:15:02.659887+0000","last_became_peered":"2024-01-19T04:15:02.659887+0000","last_unstale":"2024-01-19T04:15:03.793056+0000","last_undegraded":"2024-01-19T04:15:03.793056+0000","last_fullsized":"2024-01-19T04:15:03.793056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.796302+0000","last_change":"2024-01-19T04:15:02.680673+0000","last_active":"2024-01-19T04:15:03.796302+0000","last_peered":"2024-01-19T04:15:03.796302+0000","last_clean":"2024-01-19T04:15:03.796302+0000","last_became_active":"2024-01-19T04:15:02.679966+0000","last_became_peered":"2024-01-19T04:15:02.679966+0000","last_unstale":"2024-01-19T04:15:03.796302+0000","last_undegraded":"2024-01-19T04:15:03.796302+0000","last_fullsized":"2024-01-19T04:15:03.796302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661036+0000","last_change":"2024-01-19T04:15:02.684219+0000","last_active":"2024-01-19T04:15:03.661036+0000","last_peered":"2024-01-19T04:15:03.661036+0000","last_clean":"2024-01-19T04:15:03.661036+0000","last_became_active":"2024-01-19T04:15:02.683973+0000","last_became_peered":"2024-01-19T04:15:02.683973+0000","last_unstale":"2024-01-19T04:15:03.661036+0000","last_undegraded":"2024-01-19T04:15:03.661036+0000","last_fullsized":"2024-01-19T04:15:03.661036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793375+0000","last_change":"2024-01-19T04:15:02.682448+0000","last_active":"2024-01-19T04:15:03.793375+0000","last_peered":"2024-01-19T04:15:03.793375+0000","last_clean":"2024-01-19T04:15:03.793375+0000","last_became_active":"2024-01-19T04:15:02.673199+0000","last_became_peered":"2024-01-19T04:15:02.673199+0000","last_unstale":"2024-01-19T04:15:03.793375+0000","last_undegraded":"2024-01-19T04:15:03.793375+0000","last_fullsized":"2024-01-19T04:15:03.793375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.662776+0000","last_change":"2024-01-19T04:15:02.661774+0000","last_active":"2024-01-19T04:15:03.662776+0000","last_peered":"2024-01-19T04:15:03.662776+0000","last_clean":"2024-01-19T04:15:03.662776+0000","last_became_active":"2024-01-19T04:15:02.661479+0000","last_became_peered":"2024-01-19T04:15:02.661479+0000","last_unstale":"2024-01-19T04:15:03.662776+0000","last_undegraded":"2024-01-19T04:15:03.662776+0000","last_fullsized":"2024-01-19T04:15:03.662776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:45.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.045252+0000","last_change":"2024-01-19T04:15:01.664062+0000","last_active":"2024-01-19T04:15:03.045252+0000","last_peered":"2024-01-19T04:15:03.045252+0000","last_clean":"2024-01-19T04:15:03.045252+0000","last_became_active":"2024-01-19T04:15:01.663666+0000","last_became_peered":"2024-01-19T04:15:01.663666+0000","last_unstale":"2024-01-19T04:15:03.045252+0000","last_undegraded":"2024-01-19T04:15:03.045252+0000","last_fullsized":"2024-01-19T04:15:03.045252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:26.787644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793174+0000","last_change":"2024-01-19T04:15:02.664100+0000","last_active":"2024-01-19T04:15:03.793174+0000","last_peered":"2024-01-19T04:15:03.793174+0000","last_clean":"2024-01-19T04:15:03.793174+0000","last_became_active":"2024-01-19T04:15:02.663834+0000","last_became_peered":"2024-01-19T04:15:02.663834+0000","last_unstale":"2024-01-19T04:15:03.793174+0000","last_undegraded":"2024-01-19T04:15:03.793174+0000","last_fullsized":"2024-01-19T04:15:03.793174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793267+0000","last_change":"2024-01-19T04:15:01.663996+0000","last_active":"2024-01-19T04:15:03.793267+0000","last_peered":"2024-01-19T04:15:03.793267+0000","last_clean":"2024-01-19T04:15:03.793267+0000","last_became_active":"2024-01-19T04:15:01.663681+0000","last_became_peered":"2024-01-19T04:15:01.663681+0000","last_unstale":"2024-01-19T04:15:03.793267+0000","last_undegraded":"2024-01-19T04:15:03.793267+0000","last_fullsized":"2024-01-19T04:15:03.793267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.045223+0000","last_change":"2024-01-19T04:15:01.656029+0000","last_active":"2024-01-19T04:15:03.045223+0000","last_peered":"2024-01-19T04:15:03.045223+0000","last_clean":"2024-01-19T04:15:03.045223+0000","last_became_active":"2024-01-19T04:15:01.655545+0000","last_became_peered":"2024-01-19T04:15:01.655545+0000","last_unstale":"2024-01-19T04:15:03.045223+0000","last_undegraded":"2024-01-19T04:15:03.045223+0000","last_fullsized":"2024-01-19T04:15:03.045223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:14:53.257377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.791961+0000","last_change":"2024-01-19T04:15:02.662372+0000","last_active":"2024-01-19T04:15:03.791961+0000","last_peered":"2024-01-19T04:15:03.791961+0000","last_clean":"2024-01-19T04:15:03.791961+0000","last_became_active":"2024-01-19T04:15:02.662169+0000","last_became_peered":"2024-01-19T04:15:02.662169+0000","last_unstale":"2024-01-19T04:15:03.791961+0000","last_undegraded":"2024-01-19T04:15:03.791961+0000","last_fullsized":"2024-01-19T04:15:03.791961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:56.446803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794296+0000","last_change":"2024-01-19T04:15:01.654399+0000","last_active":"2024-01-19T04:15:03.794296+0000","last_peered":"2024-01-19T04:15:03.794296+0000","last_clean":"2024-01-19T04:15:03.794296+0000","last_became_active":"2024-01-19T04:15:01.652845+0000","last_became_peered":"2024-01-19T04:15:01.652845+0000","last_unstale":"2024-01-19T04:15:03.794296+0000","last_undegraded":"2024-01-19T04:15:03.794296+0000","last_fullsized":"2024-01-19T04:15:03.794296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793429+0000","last_change":"2024-01-19T04:15:02.655914+0000","last_active":"2024-01-19T04:15:03.793429+0000","last_peered":"2024-01-19T04:15:03.793429+0000","last_clean":"2024-01-19T04:15:03.793429+0000","last_became_active":"2024-01-19T04:15:02.655614+0000","last_became_peered":"2024-01-19T04:15:02.655614+0000","last_unstale":"2024-01-19T04:15:03.793429+0000","last_undegraded":"2024-01-19T04:15:03.793429+0000","last_fullsized":"2024-01-19T04:15:03.793429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793903+0000","last_change":"2024-01-19T04:15:01.659225+0000","last_active":"2024-01-19T04:15:03.793903+0000","last_peered":"2024-01-19T04:15:03.793903+0000","last_clean":"2024-01-19T04:15:03.793903+0000","last_became_active":"2024-01-19T04:15:01.658937+0000","last_became_peered":"2024-01-19T04:15:01.658937+0000","last_unstale":"2024-01-19T04:15:03.793903+0000","last_undegraded":"2024-01-19T04:15:03.793903+0000","last_fullsized":"2024-01-19T04:15:03.793903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793665+0000","last_change":"2024-01-19T04:15:02.679479+0000","last_active":"2024-01-19T04:15:03.793665+0000","last_peered":"2024-01-19T04:15:03.793665+0000","last_clean":"2024-01-19T04:15:03.793665+0000","last_became_active":"2024-01-19T04:15:02.678631+0000","last_became_peered":"2024-01-19T04:15:02.678631+0000","last_unstale":"2024-01-19T04:15:03.793665+0000","last_undegraded":"2024-01-19T04:15:03.793665+0000","last_fullsized":"2024-01-19T04:15:03.793665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793772+0000","last_change":"2024-01-19T04:15:01.657478+0000","last_active":"2024-01-19T04:15:03.793772+0000","last_peered":"2024-01-19T04:15:03.793772+0000","last_clean":"2024-01-19T04:15:03.793772+0000","last_became_active":"2024-01-19T04:15:01.654337+0000","last_became_peered":"2024-01-19T04:15:01.654337+0000","last_unstale":"2024-01-19T04:15:03.793772+0000","last_undegraded":"2024-01-19T04:15:03.793772+0000","last_fullsized":"2024-01-19T04:15:03.793772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793644+0000","last_change":"2024-01-19T04:15:02.684918+0000","last_active":"2024-01-19T04:15:03.793644+0000","last_peered":"2024-01-19T04:15:03.793644+0000","last_clean":"2024-01-19T04:15:03.793644+0000","last_became_active":"2024-01-19T04:15:02.684209+0000","last_became_peered":"2024-01-19T04:15:02.684209+0000","last_unstale":"2024-01-19T04:15:03.793644+0000","last_undegraded":"2024-01-19T04:15:03.793644+0000","last_fullsized":"2024-01-19T04:15:03.793644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793630+0000","last_change":"2024-01-19T04:15:01.649235+0000","last_active":"2024-01-19T04:15:03.793630+0000","last_peered":"2024-01-19T04:15:03.793630+0000","last_clean":"2024-01-19T04:15:03.793630+0000","last_became_active":"2024-01-19T04:15:01.648890+0000","last_became_peered":"2024-01-19T04:15:01.648890+0000","last_unstale":"2024-01-19T04:15:03.793630+0000","last_undegraded":"2024-01-19T04:15:03.793630+0000","last_fullsized":"2024-01-19T04:15:03.793630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663313+0000","last_change":"2024-01-19T04:15:02.666858+0000","last_active":"2024-01-19T04:15:03.663313+0000","last_peered":"2024-01-19T04:15:03.663313+0000","last_clean":"2024-01-19T04:15:03.663313+0000","last_became_active":"2024-01-19T04:15:02.666581+0000","last_became_peered":"2024-01-19T04:15:02.666581+0000","last_unstale":"2024-01-19T04:15:03.663313+0000","last_undegraded":"2024-01-19T04:15:03.663313+0000","last_fullsized":"2024-01-19T04:15:03.663313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794002+0000","last_change":"2024-01-19T04:15:01.652327+0000","last_active":"2024-01-19T04:15:03.794002+0000","last_peered":"2024-01-19T04:15:03.794002+0000","last_clean":"2024-01-19T04:15:03.794002+0000","last_became_active":"2024-01-19T04:15:01.651986+0000","last_became_peered":"2024-01-19T04:15:01.651986+0000","last_unstale":"2024-01-19T04:15:03.794002+0000","last_undegraded":"2024-01-19T04:15:03.794002+0000","last_fullsized":"2024-01-19T04:15:03.794002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:02.668704+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:02.668254+0000","last_became_peered":"2024-01-19T04:15:02.668254+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793263+0000","last_change":"2024-01-19T04:15:01.656572+0000","last_active":"2024-01-19T04:15:03.793263+0000","last_peered":"2024-01-19T04:15:03.793263+0000","last_clean":"2024-01-19T04:15:03.793263+0000","last_became_active":"2024-01-19T04:15:01.655927+0000","last_became_peered":"2024-01-19T04:15:01.655927+0000","last_unstale":"2024-01-19T04:15:03.793263+0000","last_undegraded":"2024-01-19T04:15:03.793263+0000","last_fullsized":"2024-01-19T04:15:03.793263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:10:35.666423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792925+0000","last_change":"2024-01-19T04:15:02.665136+0000","last_active":"2024-01-19T04:15:03.792925+0000","last_peered":"2024-01-19T04:15:03.792925+0000","last_clean":"2024-01-19T04:15:03.792925+0000","last_became_active":"2024-01-19T04:15:02.659894+0000","last_became_peered":"2024-01-19T04:15:02.659894+0000","last_unstale":"2024-01-19T04:15:03.792925+0000","last_undegraded":"2024-01-19T04:15:03.792925+0000","last_fullsized":"2024-01-19T04:15:03.792925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:15.849417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794290+0000","last_change":"2024-01-19T04:15:01.656361+0000","last_active":"2024-01-19T04:15:03.794290+0000","last_peered":"2024-01-19T04:15:03.794290+0000","last_clean":"2024-01-19T04:15:03.794290+0000","last_became_active":"2024-01-19T04:15:01.655933+0000","last_became_peered":"2024-01-19T04:15:01.655933+0000","last_unstale":"2024-01-19T04:15:03.794290+0000","last_undegraded":"2024-01-19T04:15:03.794290+0000","last_fullsized":"2024-01-19T04:15:03.794290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794647+0000","last_change":"2024-01-19T04:15:02.675994+0000","last_active":"2024-01-19T04:15:03.794647+0000","last_peered":"2024-01-19T04:15:03.794647+0000","last_clean":"2024-01-19T04:15:03.794647+0000","last_became_active":"2024-01-19T04:15:02.673959+0000","last_became_peered":"2024-01-19T04:15:02.673959+0000","last_unstale":"2024-01-19T04:15:03.794647+0000","last_undegraded":"2024-01-19T04:15:03.794647+0000","last_fullsized":"2024-01-19T04:15:03.794647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:22.472681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794344+0000","last_change":"2024-01-19T04:15:01.661165+0000","last_active":"2024-01-19T04:15:03.794344+0000","last_peered":"2024-01-19T04:15:03.794344+0000","last_clean":"2024-01-19T04:15:03.794344+0000","last_became_active":"2024-01-19T04:15:01.656873+0000","last_became_peered":"2024-01-19T04:15:01.656873+0000","last_unstale":"2024-01-19T04:15:03.794344+0000","last_undegraded":"2024-01-19T04:15:03.794344+0000","last_fullsized":"2024-01-19T04:15:03.794344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793545+0000","last_change":"2024-01-19T04:15:02.682133+0000","last_active":"2024-01-19T04:15:03.793545+0000","last_peered":"2024-01-19T04:15:03.793545+0000","last_clean":"2024-01-19T04:15:03.793545+0000","last_became_active":"2024-01-19T04:15:02.672918+0000","last_became_peered":"2024-01-19T04:15:02.672918+0000","last_unstale":"2024-01-19T04:15:03.793545+0000","last_undegraded":"2024-01-19T04:15:03.793545+0000","last_fullsized":"2024-01-19T04:15:03.793545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.660994+0000","last_change":"2024-01-19T04:15:01.660206+0000","last_active":"2024-01-19T04:15:03.660994+0000","last_peered":"2024-01-19T04:15:03.660994+0000","last_clean":"2024-01-19T04:15:03.660994+0000","last_became_active":"2024-01-19T04:15:01.659875+0000","last_became_peered":"2024-01-19T04:15:01.659875+0000","last_unstale":"2024-01-19T04:15:03.660994+0000","last_undegraded":"2024-01-19T04:15:03.660994+0000","last_fullsized":"2024-01-19T04:15:03.660994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793220+0000","last_change":"2024-01-19T04:15:02.668873+0000","last_active":"2024-01-19T04:15:03.793220+0000","last_peered":"2024-01-19T04:15:03.793220+0000","last_clean":"2024-01-19T04:15:03.793220+0000","last_became_active":"2024-01-19T04:15:02.668553+0000","last_became_peered":"2024-01-19T04:15:02.668553+0000","last_unstale":"2024-01-19T04:15:03.793220+0000","last_undegraded":"2024-01-19T04:15:03.793220+0000","last_fullsized":"2024-01-19T04:15:03.793220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663364+0000","last_change":"2024-01-19T04:15:01.661192+0000","last_active":"2024-01-19T04:15:03.663364+0000","last_peered":"2024-01-19T04:15:03.663364+0000","last_clean":"2024-01-19T04:15:03.663364+0000","last_became_active":"2024-01-19T04:15:01.660673+0000","last_became_peered":"2024-01-19T04:15:01.660673+0000","last_unstale":"2024-01-19T04:15:03.663364+0000","last_undegraded":"2024-01-19T04:15:03.663364+0000","last_fullsized":"2024-01-19T04:15:03.663364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:16.106132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794632+0000","last_change":"2024-01-19T04:15:02.670249+0000","last_active":"2024-01-19T04:15:03.794632+0000","last_peered":"2024-01-19T04:15:03.794632+0000","last_clean":"2024-01-19T04:15:03.794632+0000","last_became_active":"2024-01-19T04:15:02.669945+0000","last_became_peered":"2024-01-19T04:15:02.669945+0000","last_unstale":"2024-01-19T04:15:03.794632+0000","last_undegraded":"2024-01-19T04:15:03.794632+0000","last_fullsized":"2024-01-19T04:15:03.794632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661228+0000","last_change":"2024-01-19T04:15:01.651897+0000","last_active":"2024-01-19T04:15:03.661228+0000","last_peered":"2024-01-19T04:15:03.661228+0000","last_clean":"2024-01-19T04:15:03.661228+0000","last_became_active":"2024-01-19T04:15:01.651557+0000","last_became_peered":"2024-01-19T04:15:01.651557+0000","last_unstale":"2024-01-19T04:15:03.661228+0000","last_undegraded":"2024-01-19T04:15:03.661228+0000","last_fullsized":"2024-01-19T04:15:03.661228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794447+0000","last_change":"2024-01-19T04:15:02.676980+0000","last_active":"2024-01-19T04:15:03.794447+0000","last_peered":"2024-01-19T04:15:03.794447+0000","last_clean":"2024-01-19T04:15:03.794447+0000","last_became_active":"2024-01-19T04:15:02.676586+0000","last_became_peered":"2024-01-19T04:15:02.676586+0000","last_unstale":"2024-01-19T04:15:03.794447+0000","last_undegraded":"2024-01-19T04:15:03.794447+0000","last_fullsized":"2024-01-19T04:15:03.794447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793684+0000","last_change":"2024-01-19T04:15:01.660626+0000","last_active":"2024-01-19T04:15:03.793684+0000","last_peered":"2024-01-19T04:15:03.793684+0000","last_clean":"2024-01-19T04:15:03.793684+0000","last_became_active":"2024-01-19T04:15:01.660299+0000","last_became_peered":"2024-01-19T04:15:01.660299+0000","last_unstale":"2024-01-19T04:15:03.793684+0000","last_undegraded":"2024-01-19T04:15:03.793684+0000","last_fullsized":"2024-01-19T04:15:03.793684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794140+0000","last_change":"2024-01-19T04:15:02.689947+0000","last_active":"2024-01-19T04:15:03.794140+0000","last_peered":"2024-01-19T04:15:03.794140+0000","last_clean":"2024-01-19T04:15:03.794140+0000","last_became_active":"2024-01-19T04:15:02.689658+0000","last_became_peered":"2024-01-19T04:15:02.689658+0000","last_unstale":"2024-01-19T04:15:03.794140+0000","last_undegraded":"2024-01-19T04:15:03.794140+0000","last_fullsized":"2024-01-19T04:15:03.794140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661163+0000","last_change":"2024-01-19T04:15:01.659005+0000","last_active":"2024-01-19T04:15:03.661163+0000","last_peered":"2024-01-19T04:15:03.661163+0000","last_clean":"2024-01-19T04:15:03.661163+0000","last_became_active":"2024-01-19T04:15:01.658686+0000","last_became_peered":"2024-01-19T04:15:01.658686+0000","last_unstale":"2024-01-19T04:15:03.661163+0000","last_undegraded":"2024-01-19T04:15:03.661163+0000","last_fullsized":"2024-01-19T04:15:03.661163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793563+0000","last_change":"2024-01-19T04:15:02.682480+0000","last_active":"2024-01-19T04:15:03.793563+0000","last_peered":"2024-01-19T04:15:03.793563+0000","last_clean":"2024-01-19T04:15:03.793563+0000","last_became_active":"2024-01-19T04:15:02.681651+0000","last_became_peered":"2024-01-19T04:15:02.681651+0000","last_unstale":"2024-01-19T04:15:03.793563+0000","last_undegraded":"2024-01-19T04:15:03.793563+0000","last_fullsized":"2024-01-19T04:15:03.793563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.655130+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:02.655130+0000","last_peered":"2024-01-19T04:15:02.655130+0000","last_clean":"2024-01-19T04:15:02.655130+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:02.655130+0000","last_undegraded":"2024-01-19T04:15:02.655130+0000","last_fullsized":"2024-01-19T04:15:02.655130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793217+0000","last_change":"2024-01-19T04:15:01.653219+0000","last_active":"2024-01-19T04:15:03.793217+0000","last_peered":"2024-01-19T04:15:03.793217+0000","last_clean":"2024-01-19T04:15:03.793217+0000","last_became_active":"2024-01-19T04:15:01.651102+0000","last_became_peered":"2024-01-19T04:15:01.651102+0000","last_unstale":"2024-01-19T04:15:03.793217+0000","last_undegraded":"2024-01-19T04:15:03.793217+0000","last_fullsized":"2024-01-19T04:15:03.793217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792251+0000","last_change":"2024-01-19T04:15:02.682206+0000","last_active":"2024-01-19T04:15:03.792251+0000","last_peered":"2024-01-19T04:15:03.792251+0000","last_clean":"2024-01-19T04:15:03.792251+0000","last_became_active":"2024-01-19T04:15:02.681769+0000","last_became_peered":"2024-01-19T04:15:02.681769+0000","last_unstale":"2024-01-19T04:15:03.792251+0000","last_undegraded":"2024-01-19T04:15:03.792251+0000","last_fullsized":"2024-01-19T04:15:03.792251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:41:27.610593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:01.662658+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:01.662354+0000","last_became_peered":"2024-01-19T04:15:01.662354+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792635+0000","last_change":"2024-01-19T04:15:02.663011+0000","last_active":"2024-01-19T04:15:03.792635+0000","last_peered":"2024-01-19T04:15:03.792635+0000","last_clean":"2024-01-19T04:15:03.792635+0000","last_became_active":"2024-01-19T04:15:02.661355+0000","last_became_peered":"2024-01-19T04:15:02.661355+0000","last_unstale":"2024-01-19T04:15:03.792635+0000","last_undegraded":"2024-01-19T04:15:03.792635+0000","last_fullsized":"2024-01-19T04:15:03.792635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:28:40.149191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661294+0000","last_change":"2024-01-19T04:15:01.656500+0000","last_active":"2024-01-19T04:15:03.661294+0000","last_peered":"2024-01-19T04:15:03.661294+0000","last_clean":"2024-01-19T04:15:03.661294+0000","last_became_active":"2024-01-19T04:15:01.654782+0000","last_became_peered":"2024-01-19T04:15:01.654782+0000","last_unstale":"2024-01-19T04:15:03.661294+0000","last_undegraded":"2024-01-19T04:15:03.661294+0000","last_fullsized":"2024-01-19T04:15:03.661294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793289+0000","last_change":"2024-01-19T04:15:02.663704+0000","last_active":"2024-01-19T04:15:03.793289+0000","last_peered":"2024-01-19T04:15:03.793289+0000","last_clean":"2024-01-19T04:15:03.793289+0000","last_became_active":"2024-01-19T04:15:02.663466+0000","last_became_peered":"2024-01-19T04:15:02.663466+0000","last_unstale":"2024-01-19T04:15:03.793289+0000","last_undegraded":"2024-01-19T04:15:03.793289+0000","last_fullsized":"2024-01-19T04:15:03.793289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:01.649482+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:01.649196+0000","last_became_peered":"2024-01-19T04:15:01.649196+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663035+0000","last_change":"2024-01-19T04:15:02.666162+0000","last_active":"2024-01-19T04:15:03.663035+0000","last_peered":"2024-01-19T04:15:03.663035+0000","last_clean":"2024-01-19T04:15:03.663035+0000","last_became_active":"2024-01-19T04:15:02.664211+0000","last_became_peered":"2024-01-19T04:15:02.664211+0000","last_unstale":"2024-01-19T04:15:03.663035+0000","last_undegraded":"2024-01-19T04:15:03.663035+0000","last_fullsized":"2024-01-19T04:15:03.663035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:20.226272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:01.661604+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:01.661344+0000","last_became_peered":"2024-01-19T04:15:01.661344+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:02.678390+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:02.678101+0000","last_became_peered":"2024-01-19T04:15:02.678101+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793948+0000","last_change":"2024-01-19T04:15:01.666935+0000","last_active":"2024-01-19T04:15:03.793948+0000","last_peered":"2024-01-19T04:15:03.793948+0000","last_clean":"2024-01-19T04:15:03.793948+0000","last_became_active":"2024-01-19T04:15:01.666614+0000","last_became_peered":"2024-01-19T04:15:01.666614+0000","last_unstale":"2024-01-19T04:15:03.793948+0000","last_undegraded":"2024-01-19T04:15:03.793948+0000","last_fullsized":"2024-01-19T04:15:03.793948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793500+0000","last_change":"2024-01-19T04:15:02.670747+0000","last_active":"2024-01-19T04:15:03.793500+0000","last_peered":"2024-01-19T04:15:03.793500+0000","last_clean":"2024-01-19T04:15:03.793500+0000","last_became_active":"2024-01-19T04:15:02.670497+0000","last_became_peered":"2024-01-19T04:15:02.670497+0000","last_unstale":"2024-01-19T04:15:03.793500+0000","last_undegraded":"2024-01-19T04:15:03.793500+0000","last_fullsized":"2024-01-19T04:15:03.793500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:04.050424+0000","last_change":"2024-01-19T04:15:01.655738+0000","last_active":"2024-01-19T04:15:04.050424+0000","last_peered":"2024-01-19T04:15:04.050424+0000","last_clean":"2024-01-19T04:15:04.050424+0000","last_became_active":"2024-01-19T04:15:01.655435+0000","last_became_peered":"2024-01-19T04:15:01.655435+0000","last_unstale":"2024-01-19T04:15:04.050424+0000","last_undegraded":"2024-01-19T04:15:04.050424+0000","last_fullsized":"2024-01-19T04:15:04.050424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792702+0000","last_change":"2024-01-19T04:15:02.676099+0000","last_active":"2024-01-19T04:15:03.792702+0000","last_peered":"2024-01-19T04:15:03.792702+0000","last_clean":"2024-01-19T04:15:03.792702+0000","last_became_active":"2024-01-19T04:15:02.675858+0000","last_became_peered":"2024-01-19T04:15:02.675858+0000","last_unstale":"2024-01-19T04:15:03.792702+0000","last_undegraded":"2024-01-19T04:15:03.792702+0000","last_fullsized":"2024-01-19T04:15:03.792702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:27:02.894234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794005+0000","last_change":"2024-01-19T04:15:01.664964+0000","last_active":"2024-01-19T04:15:03.794005+0000","last_peered":"2024-01-19T04:15:03.794005+0000","last_clean":"2024-01-19T04:15:03.794005+0000","last_became_active":"2024-01-19T04:15:01.664666+0000","last_became_peered":"2024-01-19T04:15:01.664666+0000","last_unstale":"2024-01-19T04:15:03.794005+0000","last_undegraded":"2024-01-19T04:15:03.794005+0000","last_fullsized":"2024-01-19T04:15:03.794005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:02.655983+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:02.655720+0000","last_became_peered":"2024-01-19T04:15:02.655720+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:01.663296+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:01.663010+0000","last_became_peered":"2024-01-19T04:15:01.663010+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663043+0000","last_change":"2024-01-19T04:15:02.662528+0000","last_active":"2024-01-19T04:15:03.663043+0000","last_peered":"2024-01-19T04:15:03.663043+0000","last_clean":"2024-01-19T04:15:03.663043+0000","last_became_active":"2024-01-19T04:15:02.661397+0000","last_became_peered":"2024-01-19T04:15:02.661397+0000","last_unstale":"2024-01-19T04:15:03.663043+0000","last_undegraded":"2024-01-19T04:15:03.663043+0000","last_fullsized":"2024-01-19T04:15:03.663043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:21.142628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793634+0000","last_change":"2024-01-19T04:15:01.664514+0000","last_active":"2024-01-19T04:15:03.793634+0000","last_peered":"2024-01-19T04:15:03.793634+0000","last_clean":"2024-01-19T04:15:03.793634+0000","last_became_active":"2024-01-19T04:15:01.662668+0000","last_became_peered":"2024-01-19T04:15:01.662668+0000","last_unstale":"2024-01-19T04:15:03.793634+0000","last_undegraded":"2024-01-19T04:15:03.793634+0000","last_fullsized":"2024-01-19T04:15:03.793634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.791985+0000","last_change":"2024-01-19T04:15:02.663292+0000","last_active":"2024-01-19T04:15:03.791985+0000","last_peered":"2024-01-19T04:15:03.791985+0000","last_clean":"2024-01-19T04:15:03.791985+0000","last_became_active":"2024-01-19T04:15:02.663012+0000","last_became_peered":"2024-01-19T04:15:02.663012+0000","last_unstale":"2024-01-19T04:15:03.791985+0000","last_undegraded":"2024-01-19T04:15:03.791985+0000","last_fullsized":"2024-01-19T04:15:03.791985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:04.998464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793469+0000","last_change":"2024-01-19T04:15:01.652378+0000","last_active":"2024-01-19T04:15:03.793469+0000","last_peered":"2024-01-19T04:15:03.793469+0000","last_clean":"2024-01-19T04:15:03.793469+0000","last_became_active":"2024-01-19T04:15:01.652057+0000","last_became_peered":"2024-01-19T04:15:01.652057+0000","last_unstale":"2024-01-19T04:15:03.793469+0000","last_undegraded":"2024-01-19T04:15:03.793469+0000","last_fullsized":"2024-01-19T04:15:03.793469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792381+0000","last_change":"2024-01-19T04:15:02.669867+0000","last_active":"2024-01-19T04:15:03.792381+0000","last_peered":"2024-01-19T04:15:03.792381+0000","last_clean":"2024-01-19T04:15:03.792381+0000","last_became_active":"2024-01-19T04:15:02.669483+0000","last_became_peered":"2024-01-19T04:15:02.669483+0000","last_unstale":"2024-01-19T04:15:03.792381+0000","last_undegraded":"2024-01-19T04:15:03.792381+0000","last_fullsized":"2024-01-19T04:15:03.792381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:23:07.891592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794715+0000","last_change":"2024-01-19T04:15:01.664685+0000","last_active":"2024-01-19T04:15:03.794715+0000","last_peered":"2024-01-19T04:15:03.794715+0000","last_clean":"2024-01-19T04:15:03.794715+0000","last_became_active":"2024-01-19T04:15:01.664311+0000","last_became_peered":"2024-01-19T04:15:01.664311+0000","last_unstale":"2024-01-19T04:15:03.794715+0000","last_undegraded":"2024-01-19T04:15:03.794715+0000","last_fullsized":"2024-01-19T04:15:03.794715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:21:02.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793441+0000","last_change":"2024-01-19T04:15:02.668202+0000","last_active":"2024-01-19T04:15:03.793441+0000","last_peered":"2024-01-19T04:15:03.793441+0000","last_clean":"2024-01-19T04:15:03.793441+0000","last_became_active":"2024-01-19T04:15:02.667661+0000","last_became_peered":"2024-01-19T04:15:02.667661+0000","last_unstale":"2024-01-19T04:15:03.793441+0000","last_undegraded":"2024-01-19T04:15:03.793441+0000","last_fullsized":"2024-01-19T04:15:03.793441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794134+0000","last_change":"2024-01-19T04:15:02.679928+0000","last_active":"2024-01-19T04:15:03.794134+0000","last_peered":"2024-01-19T04:15:03.794134+0000","last_clean":"2024-01-19T04:15:03.794134+0000","last_became_active":"2024-01-19T04:15:02.679629+0000","last_became_peered":"2024-01-19T04:15:02.679629+0000","last_unstale":"2024-01-19T04:15:03.794134+0000","last_undegraded":"2024-01-19T04:15:03.794134+0000","last_fullsized":"2024-01-19T04:15:03.794134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793812+0000","last_change":"2024-01-19T04:15:01.665948+0000","last_active":"2024-01-19T04:15:03.793812+0000","last_peered":"2024-01-19T04:15:03.793812+0000","last_clean":"2024-01-19T04:15:03.793812+0000","last_became_active":"2024-01-19T04:15:01.665641+0000","last_became_peered":"2024-01-19T04:15:01.665641+0000","last_unstale":"2024-01-19T04:15:03.793812+0000","last_undegraded":"2024-01-19T04:15:03.793812+0000","last_fullsized":"2024-01-19T04:15:03.793812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:09.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794795+0000","last_change":"2024-01-19T04:15:02.681662+0000","last_active":"2024-01-19T04:15:03.794795+0000","last_peered":"2024-01-19T04:15:03.794795+0000","last_clean":"2024-01-19T04:15:03.794795+0000","last_became_active":"2024-01-19T04:15:02.681303+0000","last_became_peered":"2024-01-19T04:15:02.681303+0000","last_unstale":"2024-01-19T04:15:03.794795+0000","last_undegraded":"2024-01-19T04:15:03.794795+0000","last_fullsized":"2024-01-19T04:15:03.794795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793675+0000","last_change":"2024-01-19T04:15:01.671175+0000","last_active":"2024-01-19T04:15:03.793675+0000","last_peered":"2024-01-19T04:15:03.793675+0000","last_clean":"2024-01-19T04:15:03.793675+0000","last_became_active":"2024-01-19T04:15:01.670934+0000","last_became_peered":"2024-01-19T04:15:01.670934+0000","last_unstale":"2024-01-19T04:15:03.793675+0000","last_undegraded":"2024-01-19T04:15:03.793675+0000","last_fullsized":"2024-01-19T04:15:03.793675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:02.685102+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:02.684653+0000","last_became_peered":"2024-01-19T04:15:02.684653+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.045276+0000","last_change":"2024-01-19T04:15:01.657663+0000","last_active":"2024-01-19T04:15:03.045276+0000","last_peered":"2024-01-19T04:15:03.045276+0000","last_clean":"2024-01-19T04:15:03.045276+0000","last_became_active":"2024-01-19T04:15:01.657372+0000","last_became_peered":"2024-01-19T04:15:01.657372+0000","last_unstale":"2024-01-19T04:15:03.045276+0000","last_undegraded":"2024-01-19T04:15:03.045276+0000","last_fullsized":"2024-01-19T04:15:03.045276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:24:30.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792578+0000","last_change":"2024-01-19T04:15:02.670659+0000","last_active":"2024-01-19T04:15:03.792578+0000","last_peered":"2024-01-19T04:15:03.792578+0000","last_clean":"2024-01-19T04:15:03.792578+0000","last_became_active":"2024-01-19T04:15:02.668710+0000","last_became_peered":"2024-01-19T04:15:02.668710+0000","last_unstale":"2024-01-19T04:15:03.792578+0000","last_undegraded":"2024-01-19T04:15:03.792578+0000","last_fullsized":"2024-01-19T04:15:03.792578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:23:52.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793688+0000","last_change":"2024-01-19T04:15:01.665080+0000","last_active":"2024-01-19T04:15:03.793688+0000","last_peered":"2024-01-19T04:15:03.793688+0000","last_clean":"2024-01-19T04:15:03.793688+0000","last_became_active":"2024-01-19T04:15:01.663889+0000","last_became_peered":"2024-01-19T04:15:01.663889+0000","last_unstale":"2024-01-19T04:15:03.793688+0000","last_undegraded":"2024-01-19T04:15:03.793688+0000","last_fullsized":"2024-01-19T04:15:03.793688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:03:13.418483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":670753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":4,"up_from":16,"seq":68719476743,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":79803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":79963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.343}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2639999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0990000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":670809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4460000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.633}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5939999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5629999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6470000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0510000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":81415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3239999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5469999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.319}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6230000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2539999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.423}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:11.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:11.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f042da00640 1 Processor -- start 2024-01-19T04:15:11.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f042da00640 1 -- start start 2024-01-19T04:15:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f042da00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04280c04a0 0x7f04280c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f042da00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0428071e80 con 0x7f042814fb50 2024-01-19T04:15:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f042da00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280726c0 con 0x7f04280a4ec0 2024-01-19T04:15:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f042da00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04281535c0 con 0x7f04280c04a0 2024-01-19T04:15:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f0426000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04280c04a0 0x7f04280c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f0426a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f042814fb50 0x7f042806fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47398/0 (socket says 172.21.15.32:47398) 2024-01-19T04:15:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f0426a00640 1 -- 172.21.15.32:0/1661333726 learned_addr learned my addr 172.21.15.32:0/1661333726 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f0426000640 1 -- 172.21.15.32:0/1661333726 >> v1:172.21.15.67:6789/0 conn(0x7f04280a4ec0 legacy=0x7f042815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f0426000640 1 -- 172.21.15.32:0/1661333726 >> v1:172.21.15.32:6789/0 conn(0x7f042814fb50 legacy=0x7f042806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.639+0000 7f0426000640 1 -- 172.21.15.32:0/1661333726 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280c0a20 con 0x7f04280c04a0 2024-01-19T04:15:11.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f0426000640 1 --2- 172.21.15.32:0/1661333726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04280c1230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04100097c0 tx=0x7f041001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef9db886f910271 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:11.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f0425600640 1 -- 172.21.15.32:0/1661333726 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100ab600 con 0x7f04280c04a0 2024-01-19T04:15:11.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f0425600640 1 -- 172.21.15.32:0/1661333726 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04100a7050 con 0x7f04280c04a0 2024-01-19T04:15:11.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f0425600640 1 -- 172.21.15.32:0/1661333726 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100ab980 con 0x7f04280c04a0 2024-01-19T04:15:11.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f042da00640 1 -- 172.21.15.32:0/1661333726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 msgr2=0x7f04280c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f042da00640 1 --2- 172.21.15.32:0/1661333726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04280c1230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04100097c0 tx=0x7f041001c3f0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f042da00640 1 -- 172.21.15.32:0/1661333726 shutdown_connections 2024-01-19T04:15:11.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f042da00640 1 --2- 172.21.15.32:0/1661333726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04280c1230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f042da00640 1 -- 172.21.15.32:0/1661333726 >> 172.21.15.32:0/1661333726 conn(0x7f04280c5b20 msgr2=0x7f04280c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:11.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f042da00640 1 -- 172.21.15.32:0/1661333726 shutdown_connections 2024-01-19T04:15:11.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.643+0000 7f042da00640 1 -- 172.21.15.32:0/1661333726 wait complete. 2024-01-19T04:15:11.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 Processor -- start 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 -- start start 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04280a4ec0 0x7f04281eefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04281ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f042814fb50 0x7f04281458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04281545c0 con 0x7f04280c04a0 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042814c320 con 0x7f04280a4ec0 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0428153d20 con 0x7f042814fb50 2024-01-19T04:15:11.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04281ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04281ef4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34756/0 (socket says 172.21.15.32:34756) 2024-01-19T04:15:11.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 -- 172.21.15.32:0/3713494317 learned_addr learned my addr 172.21.15.32:0/3713494317 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:11.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0427400640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f042814fb50 0x7f04281458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426a00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04280a4ec0 0x7f04281eefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 -- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f042814fb50 msgr2=0x7f04281458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f042814fb50 0x7f04281458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 -- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04280a4ec0 msgr2=0x7f04281eefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04280a4ec0 0x7f04281eefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 -- 172.21.15.32:0/3713494317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410009420 con 0x7f04280c04a0 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0427400640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f042814fb50 0x7f04281458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426a00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04280a4ec0 0x7f04281eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f0426000640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04281ef4f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0410019000 tx=0x7f0410019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f041ea00640 1 -- 172.21.15.32:0/3713494317 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100b4610 con 0x7f04280c04a0 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f041ea00640 1 -- 172.21.15.32:0/3713494317 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04100abe90 con 0x7f04280c04a0 2024-01-19T04:15:11.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f041ea00640 1 -- 172.21.15.32:0/3713494317 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100b49d0 con 0x7f04280c04a0 2024-01-19T04:15:11.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0428154000 con 0x7f04280c04a0 2024-01-19T04:15:11.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04281526a0 con 0x7f04280c04a0 2024-01-19T04:15:11.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.647+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04280749f0 con 0x7f04280c04a0 2024-01-19T04:15:11.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.651+0000 7f041ea00640 1 -- 172.21.15.32:0/3713494317 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f04100b2040 con 0x7f04280c04a0 2024-01-19T04:15:11.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.651+0000 7f041ea00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0400066500 0x7f04000689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:11.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.651+0000 7f041ea00640 1 -- 172.21.15.32:0/3713494317 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f041011e0c0 con 0x7f04280c04a0 2024-01-19T04:15:11.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.651+0000 7f0426a00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0400066500 0x7f04000689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:11.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.651+0000 7f0426a00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0400066500 0x7f04000689c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0418005890 tx=0x7f0418009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:11.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.655+0000 7f041ea00640 1 -- 172.21.15.32:0/3713494317 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f04100eb370 con 0x7f04280c04a0 2024-01-19T04:15:11.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.811+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0428153e90 con 0x7f0400066500 2024-01-19T04:15:11.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.819+0000 7f041ea00640 1 -- 172.21.15.32:0/3713494317 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264560 (secure 0 0 0) 0x7f0428153e90 con 0x7f0400066500 2024-01-19T04:15:11.827 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:11.828 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0400066500 msgr2=0x7f04000689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0400066500 0x7f04000689c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0418005890 tx=0x7f0418009040 comp rx=0 tx=0).stop 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 msgr2=0x7f04281ef4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04281ef4f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0410019000 tx=0x7f0410019190 comp rx=0 tx=0).stop 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 shutdown_connections 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0400066500 0x7f04000689c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f042814fb50 0x7f04281458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04280c04a0 0x7f04281ef4f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 --2- 172.21.15.32:0/3713494317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04280a4ec0 0x7f04281eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 >> 172.21.15.32:0/3713494317 conn(0x7f04280c5b20 msgr2=0x7f0428150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 shutdown_connections 2024-01-19T04:15:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:11.823+0000 7f042da00640 1 -- 172.21.15.32:0/3713494317 wait complete. 2024-01-19T04:15:11.847 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-01-19T04:15:10.030094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235852,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738868,"statfs":{"total":773094113280,"available":772852600832,"internally_reserved":0,"allocated":3088384,"data_stored":1823980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001929"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793727+0000","last_change":"2024-01-19T04:15:02.673206+0000","last_active":"2024-01-19T04:15:03.793727+0000","last_peered":"2024-01-19T04:15:03.793727+0000","last_clean":"2024-01-19T04:15:03.793727+0000","last_became_active":"2024-01-19T04:15:02.672837+0000","last_became_peered":"2024-01-19T04:15:02.672837+0000","last_unstale":"2024-01-19T04:15:03.793727+0000","last_undegraded":"2024-01-19T04:15:03.793727+0000","last_fullsized":"2024-01-19T04:15:03.793727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793881+0000","last_change":"2024-01-19T04:15:02.660330+0000","last_active":"2024-01-19T04:15:03.793881+0000","last_peered":"2024-01-19T04:15:03.793881+0000","last_clean":"2024-01-19T04:15:03.793881+0000","last_became_active":"2024-01-19T04:15:02.660069+0000","last_became_peered":"2024-01-19T04:15:02.660069+0000","last_unstale":"2024-01-19T04:15:03.793881+0000","last_undegraded":"2024-01-19T04:15:03.793881+0000","last_fullsized":"2024-01-19T04:15:03.793881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793227+0000","last_change":"2024-01-19T04:15:02.671714+0000","last_active":"2024-01-19T04:15:03.793227+0000","last_peered":"2024-01-19T04:15:03.793227+0000","last_clean":"2024-01-19T04:15:03.793227+0000","last_became_active":"2024-01-19T04:15:02.667718+0000","last_became_peered":"2024-01-19T04:15:02.667718+0000","last_unstale":"2024-01-19T04:15:03.793227+0000","last_undegraded":"2024-01-19T04:15:03.793227+0000","last_fullsized":"2024-01-19T04:15:03.793227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793901+0000","last_change":"2024-01-19T04:15:02.683062+0000","last_active":"2024-01-19T04:15:03.793901+0000","last_peered":"2024-01-19T04:15:03.793901+0000","last_clean":"2024-01-19T04:15:03.793901+0000","last_became_active":"2024-01-19T04:15:02.682769+0000","last_became_peered":"2024-01-19T04:15:02.682769+0000","last_unstale":"2024-01-19T04:15:03.793901+0000","last_undegraded":"2024-01-19T04:15:03.793901+0000","last_fullsized":"2024-01-19T04:15:03.793901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794606+0000","last_change":"2024-01-19T04:15:02.675817+0000","last_active":"2024-01-19T04:15:03.794606+0000","last_peered":"2024-01-19T04:15:03.794606+0000","last_clean":"2024-01-19T04:15:03.794606+0000","last_became_active":"2024-01-19T04:15:02.673948+0000","last_became_peered":"2024-01-19T04:15:02.673948+0000","last_unstale":"2024-01-19T04:15:03.794606+0000","last_undegraded":"2024-01-19T04:15:03.794606+0000","last_fullsized":"2024-01-19T04:15:03.794606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793668+0000","last_change":"2024-01-19T04:15:02.680536+0000","last_active":"2024-01-19T04:15:03.793668+0000","last_peered":"2024-01-19T04:15:03.793668+0000","last_clean":"2024-01-19T04:15:03.793668+0000","last_became_active":"2024-01-19T04:15:02.680182+0000","last_became_peered":"2024-01-19T04:15:02.680182+0000","last_unstale":"2024-01-19T04:15:03.793668+0000","last_undegraded":"2024-01-19T04:15:03.793668+0000","last_fullsized":"2024-01-19T04:15:03.793668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:13:26.044664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793083+0000","last_change":"2024-01-19T04:15:02.667084+0000","last_active":"2024-01-19T04:15:03.793083+0000","last_peered":"2024-01-19T04:15:03.793083+0000","last_clean":"2024-01-19T04:15:03.793083+0000","last_became_active":"2024-01-19T04:15:02.666773+0000","last_became_peered":"2024-01-19T04:15:02.666773+0000","last_unstale":"2024-01-19T04:15:03.793083+0000","last_undegraded":"2024-01-19T04:15:03.793083+0000","last_fullsized":"2024-01-19T04:15:03.793083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.791850+0000","last_change":"2024-01-19T04:15:02.681046+0000","last_active":"2024-01-19T04:15:03.791850+0000","last_peered":"2024-01-19T04:15:03.791850+0000","last_clean":"2024-01-19T04:15:03.791850+0000","last_became_active":"2024-01-19T04:15:02.680748+0000","last_became_peered":"2024-01-19T04:15:02.680748+0000","last_unstale":"2024-01-19T04:15:03.791850+0000","last_undegraded":"2024-01-19T04:15:03.791850+0000","last_fullsized":"2024-01-19T04:15:03.791850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:35.522445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793875+0000","last_change":"2024-01-19T04:15:02.686021+0000","last_active":"2024-01-19T04:15:03.793875+0000","last_peered":"2024-01-19T04:15:03.793875+0000","last_clean":"2024-01-19T04:15:03.793875+0000","last_became_active":"2024-01-19T04:15:02.685239+0000","last_became_peered":"2024-01-19T04:15:02.685239+0000","last_unstale":"2024-01-19T04:15:03.793875+0000","last_undegraded":"2024-01-19T04:15:03.793875+0000","last_fullsized":"2024-01-19T04:15:03.793875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793470+0000","last_change":"2024-01-19T04:15:02.685444+0000","last_active":"2024-01-19T04:15:03.793470+0000","last_peered":"2024-01-19T04:15:03.793470+0000","last_clean":"2024-01-19T04:15:03.793470+0000","last_became_active":"2024-01-19T04:15:02.685184+0000","last_became_peered":"2024-01-19T04:15:02.685184+0000","last_unstale":"2024-01-19T04:15:03.793470+0000","last_undegraded":"2024-01-19T04:15:03.793470+0000","last_fullsized":"2024-01-19T04:15:03.793470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794527+0000","last_change":"2024-01-19T04:15:02.686028+0000","last_active":"2024-01-19T04:15:03.794527+0000","last_peered":"2024-01-19T04:15:03.794527+0000","last_clean":"2024-01-19T04:15:03.794527+0000","last_became_active":"2024-01-19T04:15:02.685561+0000","last_became_peered":"2024-01-19T04:15:02.685561+0000","last_unstale":"2024-01-19T04:15:03.794527+0000","last_undegraded":"2024-01-19T04:15:03.794527+0000","last_fullsized":"2024-01-19T04:15:03.794527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663222+0000","last_change":"2024-01-19T04:15:02.671711+0000","last_active":"2024-01-19T04:15:03.663222+0000","last_peered":"2024-01-19T04:15:03.663222+0000","last_clean":"2024-01-19T04:15:03.663222+0000","last_became_active":"2024-01-19T04:15:02.671331+0000","last_became_peered":"2024-01-19T04:15:02.671331+0000","last_unstale":"2024-01-19T04:15:03.663222+0000","last_undegraded":"2024-01-19T04:15:03.663222+0000","last_fullsized":"2024-01-19T04:15:03.663222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:48.803204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792305+0000","last_change":"2024-01-19T04:15:02.672095+0000","last_active":"2024-01-19T04:15:03.792305+0000","last_peered":"2024-01-19T04:15:03.792305+0000","last_clean":"2024-01-19T04:15:03.792305+0000","last_became_active":"2024-01-19T04:15:02.671811+0000","last_became_peered":"2024-01-19T04:15:02.671811+0000","last_unstale":"2024-01-19T04:15:03.792305+0000","last_undegraded":"2024-01-19T04:15:03.792305+0000","last_fullsized":"2024-01-19T04:15:03.792305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:33.488079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792698+0000","last_change":"2024-01-19T04:15:02.659658+0000","last_active":"2024-01-19T04:15:03.792698+0000","last_peered":"2024-01-19T04:15:03.792698+0000","last_clean":"2024-01-19T04:15:03.792698+0000","last_became_active":"2024-01-19T04:15:02.659343+0000","last_became_peered":"2024-01-19T04:15:02.659343+0000","last_unstale":"2024-01-19T04:15:03.792698+0000","last_undegraded":"2024-01-19T04:15:03.792698+0000","last_fullsized":"2024-01-19T04:15:03.792698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:31:37.529811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793549+0000","last_change":"2024-01-19T04:15:02.661052+0000","last_active":"2024-01-19T04:15:03.793549+0000","last_peered":"2024-01-19T04:15:03.793549+0000","last_clean":"2024-01-19T04:15:03.793549+0000","last_became_active":"2024-01-19T04:15:02.660725+0000","last_became_peered":"2024-01-19T04:15:02.660725+0000","last_unstale":"2024-01-19T04:15:03.793549+0000","last_undegraded":"2024-01-19T04:15:03.793549+0000","last_fullsized":"2024-01-19T04:15:03.793549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794007+0000","last_change":"2024-01-19T04:15:02.674681+0000","last_active":"2024-01-19T04:15:03.794007+0000","last_peered":"2024-01-19T04:15:03.794007+0000","last_clean":"2024-01-19T04:15:03.794007+0000","last_became_active":"2024-01-19T04:15:02.674302+0000","last_became_peered":"2024-01-19T04:15:02.674302+0000","last_unstale":"2024-01-19T04:15:03.794007+0000","last_undegraded":"2024-01-19T04:15:03.794007+0000","last_fullsized":"2024-01-19T04:15:03.794007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794556+0000","last_change":"2024-01-19T04:15:02.680651+0000","last_active":"2024-01-19T04:15:03.794556+0000","last_peered":"2024-01-19T04:15:03.794556+0000","last_clean":"2024-01-19T04:15:03.794556+0000","last_became_active":"2024-01-19T04:15:02.680263+0000","last_became_peered":"2024-01-19T04:15:02.680263+0000","last_unstale":"2024-01-19T04:15:03.794556+0000","last_undegraded":"2024-01-19T04:15:03.794556+0000","last_fullsized":"2024-01-19T04:15:03.794556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:20:09.706523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661205+0000","last_change":"2024-01-19T04:15:02.669777+0000","last_active":"2024-01-19T04:15:03.661205+0000","last_peered":"2024-01-19T04:15:03.661205+0000","last_clean":"2024-01-19T04:15:03.661205+0000","last_became_active":"2024-01-19T04:15:02.669488+0000","last_became_peered":"2024-01-19T04:15:02.669488+0000","last_unstale":"2024-01-19T04:15:03.661205+0000","last_undegraded":"2024-01-19T04:15:03.661205+0000","last_fullsized":"2024-01-19T04:15:03.661205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:10.384183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793826+0000","last_change":"2024-01-19T04:15:02.666101+0000","last_active":"2024-01-19T04:15:03.793826+0000","last_peered":"2024-01-19T04:15:03.793826+0000","last_clean":"2024-01-19T04:15:03.793826+0000","last_became_active":"2024-01-19T04:15:02.665664+0000","last_became_peered":"2024-01-19T04:15:02.665664+0000","last_unstale":"2024-01-19T04:15:03.793826+0000","last_undegraded":"2024-01-19T04:15:03.793826+0000","last_fullsized":"2024-01-19T04:15:03.793826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793385+0000","last_change":"2024-01-19T04:15:02.682696+0000","last_active":"2024-01-19T04:15:03.793385+0000","last_peered":"2024-01-19T04:15:03.793385+0000","last_clean":"2024-01-19T04:15:03.793385+0000","last_became_active":"2024-01-19T04:15:02.682337+0000","last_became_peered":"2024-01-19T04:15:02.682337+0000","last_unstale":"2024-01-19T04:15:03.793385+0000","last_undegraded":"2024-01-19T04:15:03.793385+0000","last_fullsized":"2024-01-19T04:15:03.793385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793229+0000","last_change":"2024-01-19T04:15:02.675046+0000","last_active":"2024-01-19T04:15:03.793229+0000","last_peered":"2024-01-19T04:15:03.793229+0000","last_clean":"2024-01-19T04:15:03.793229+0000","last_became_active":"2024-01-19T04:15:02.674569+0000","last_became_peered":"2024-01-19T04:15:02.674569+0000","last_unstale":"2024-01-19T04:15:03.793229+0000","last_undegraded":"2024-01-19T04:15:03.793229+0000","last_fullsized":"2024-01-19T04:15:03.793229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793823+0000","last_change":"2024-01-19T04:15:02.679833+0000","last_active":"2024-01-19T04:15:03.793823+0000","last_peered":"2024-01-19T04:15:03.793823+0000","last_clean":"2024-01-19T04:15:03.793823+0000","last_became_active":"2024-01-19T04:15:02.679450+0000","last_became_peered":"2024-01-19T04:15:02.679450+0000","last_unstale":"2024-01-19T04:15:03.793823+0000","last_undegraded":"2024-01-19T04:15:03.793823+0000","last_fullsized":"2024-01-19T04:15:03.793823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:47.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792111+0000","last_change":"2024-01-19T04:15:02.675672+0000","last_active":"2024-01-19T04:15:03.792111+0000","last_peered":"2024-01-19T04:15:03.792111+0000","last_clean":"2024-01-19T04:15:03.792111+0000","last_became_active":"2024-01-19T04:15:02.668805+0000","last_became_peered":"2024-01-19T04:15:02.668805+0000","last_unstale":"2024-01-19T04:15:03.792111+0000","last_undegraded":"2024-01-19T04:15:03.792111+0000","last_fullsized":"2024-01-19T04:15:03.792111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:49.221178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794204+0000","last_change":"2024-01-19T04:15:02.679845+0000","last_active":"2024-01-19T04:15:03.794204+0000","last_peered":"2024-01-19T04:15:03.794204+0000","last_clean":"2024-01-19T04:15:03.794204+0000","last_became_active":"2024-01-19T04:15:02.679512+0000","last_became_peered":"2024-01-19T04:15:02.679512+0000","last_unstale":"2024-01-19T04:15:03.794204+0000","last_undegraded":"2024-01-19T04:15:03.794204+0000","last_fullsized":"2024-01-19T04:15:03.794204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:39.261552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792559+0000","last_change":"2024-01-19T04:15:02.668029+0000","last_active":"2024-01-19T04:15:03.792559+0000","last_peered":"2024-01-19T04:15:03.792559+0000","last_clean":"2024-01-19T04:15:03.792559+0000","last_became_active":"2024-01-19T04:15:02.667742+0000","last_became_peered":"2024-01-19T04:15:02.667742+0000","last_unstale":"2024-01-19T04:15:03.792559+0000","last_undegraded":"2024-01-19T04:15:03.792559+0000","last_fullsized":"2024-01-19T04:15:03.792559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.431141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793620+0000","last_change":"2024-01-19T04:15:02.684316+0000","last_active":"2024-01-19T04:15:03.793620+0000","last_peered":"2024-01-19T04:15:03.793620+0000","last_clean":"2024-01-19T04:15:03.793620+0000","last_became_active":"2024-01-19T04:15:02.681947+0000","last_became_peered":"2024-01-19T04:15:02.681947+0000","last_unstale":"2024-01-19T04:15:03.793620+0000","last_undegraded":"2024-01-19T04:15:03.793620+0000","last_fullsized":"2024-01-19T04:15:03.793620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793691+0000","last_change":"2024-01-19T04:15:02.672775+0000","last_active":"2024-01-19T04:15:03.793691+0000","last_peered":"2024-01-19T04:15:03.793691+0000","last_clean":"2024-01-19T04:15:03.793691+0000","last_became_active":"2024-01-19T04:15:02.672561+0000","last_became_peered":"2024-01-19T04:15:02.672561+0000","last_unstale":"2024-01-19T04:15:03.793691+0000","last_undegraded":"2024-01-19T04:15:03.793691+0000","last_fullsized":"2024-01-19T04:15:03.793691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792576+0000","last_change":"2024-01-19T04:15:02.661526+0000","last_active":"2024-01-19T04:15:03.792576+0000","last_peered":"2024-01-19T04:15:03.792576+0000","last_clean":"2024-01-19T04:15:03.792576+0000","last_became_active":"2024-01-19T04:15:02.661278+0000","last_became_peered":"2024-01-19T04:15:02.661278+0000","last_unstale":"2024-01-19T04:15:03.792576+0000","last_undegraded":"2024-01-19T04:15:03.792576+0000","last_fullsized":"2024-01-19T04:15:03.792576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:52:08.790222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793056+0000","last_change":"2024-01-19T04:15:02.660175+0000","last_active":"2024-01-19T04:15:03.793056+0000","last_peered":"2024-01-19T04:15:03.793056+0000","last_clean":"2024-01-19T04:15:03.793056+0000","last_became_active":"2024-01-19T04:15:02.659887+0000","last_became_peered":"2024-01-19T04:15:02.659887+0000","last_unstale":"2024-01-19T04:15:03.793056+0000","last_undegraded":"2024-01-19T04:15:03.793056+0000","last_fullsized":"2024-01-19T04:15:03.793056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.796302+0000","last_change":"2024-01-19T04:15:02.680673+0000","last_active":"2024-01-19T04:15:03.796302+0000","last_peered":"2024-01-19T04:15:03.796302+0000","last_clean":"2024-01-19T04:15:03.796302+0000","last_became_active":"2024-01-19T04:15:02.679966+0000","last_became_peered":"2024-01-19T04:15:02.679966+0000","last_unstale":"2024-01-19T04:15:03.796302+0000","last_undegraded":"2024-01-19T04:15:03.796302+0000","last_fullsized":"2024-01-19T04:15:03.796302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661036+0000","last_change":"2024-01-19T04:15:02.684219+0000","last_active":"2024-01-19T04:15:03.661036+0000","last_peered":"2024-01-19T04:15:03.661036+0000","last_clean":"2024-01-19T04:15:03.661036+0000","last_became_active":"2024-01-19T04:15:02.683973+0000","last_became_peered":"2024-01-19T04:15:02.683973+0000","last_unstale":"2024-01-19T04:15:03.661036+0000","last_undegraded":"2024-01-19T04:15:03.661036+0000","last_fullsized":"2024-01-19T04:15:03.661036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793375+0000","last_change":"2024-01-19T04:15:02.682448+0000","last_active":"2024-01-19T04:15:03.793375+0000","last_peered":"2024-01-19T04:15:03.793375+0000","last_clean":"2024-01-19T04:15:03.793375+0000","last_became_active":"2024-01-19T04:15:02.673199+0000","last_became_peered":"2024-01-19T04:15:02.673199+0000","last_unstale":"2024-01-19T04:15:03.793375+0000","last_undegraded":"2024-01-19T04:15:03.793375+0000","last_fullsized":"2024-01-19T04:15:03.793375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:19.781222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.662776+0000","last_change":"2024-01-19T04:15:02.661774+0000","last_active":"2024-01-19T04:15:03.662776+0000","last_peered":"2024-01-19T04:15:03.662776+0000","last_clean":"2024-01-19T04:15:03.662776+0000","last_became_active":"2024-01-19T04:15:02.661479+0000","last_became_peered":"2024-01-19T04:15:02.661479+0000","last_unstale":"2024-01-19T04:15:03.662776+0000","last_undegraded":"2024-01-19T04:15:03.662776+0000","last_fullsized":"2024-01-19T04:15:03.662776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:45.069158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.045252+0000","last_change":"2024-01-19T04:15:01.664062+0000","last_active":"2024-01-19T04:15:03.045252+0000","last_peered":"2024-01-19T04:15:03.045252+0000","last_clean":"2024-01-19T04:15:03.045252+0000","last_became_active":"2024-01-19T04:15:01.663666+0000","last_became_peered":"2024-01-19T04:15:01.663666+0000","last_unstale":"2024-01-19T04:15:03.045252+0000","last_undegraded":"2024-01-19T04:15:03.045252+0000","last_fullsized":"2024-01-19T04:15:03.045252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:20:26.787644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793174+0000","last_change":"2024-01-19T04:15:02.664100+0000","last_active":"2024-01-19T04:15:03.793174+0000","last_peered":"2024-01-19T04:15:03.793174+0000","last_clean":"2024-01-19T04:15:03.793174+0000","last_became_active":"2024-01-19T04:15:02.663834+0000","last_became_peered":"2024-01-19T04:15:02.663834+0000","last_unstale":"2024-01-19T04:15:03.793174+0000","last_undegraded":"2024-01-19T04:15:03.793174+0000","last_fullsized":"2024-01-19T04:15:03.793174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793267+0000","last_change":"2024-01-19T04:15:01.663996+0000","last_active":"2024-01-19T04:15:03.793267+0000","last_peered":"2024-01-19T04:15:03.793267+0000","last_clean":"2024-01-19T04:15:03.793267+0000","last_became_active":"2024-01-19T04:15:01.663681+0000","last_became_peered":"2024-01-19T04:15:01.663681+0000","last_unstale":"2024-01-19T04:15:03.793267+0000","last_undegraded":"2024-01-19T04:15:03.793267+0000","last_fullsized":"2024-01-19T04:15:03.793267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.045223+0000","last_change":"2024-01-19T04:15:01.656029+0000","last_active":"2024-01-19T04:15:03.045223+0000","last_peered":"2024-01-19T04:15:03.045223+0000","last_clean":"2024-01-19T04:15:03.045223+0000","last_became_active":"2024-01-19T04:15:01.655545+0000","last_became_peered":"2024-01-19T04:15:01.655545+0000","last_unstale":"2024-01-19T04:15:03.045223+0000","last_undegraded":"2024-01-19T04:15:03.045223+0000","last_fullsized":"2024-01-19T04:15:03.045223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:14:53.257377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.791961+0000","last_change":"2024-01-19T04:15:02.662372+0000","last_active":"2024-01-19T04:15:03.791961+0000","last_peered":"2024-01-19T04:15:03.791961+0000","last_clean":"2024-01-19T04:15:03.791961+0000","last_became_active":"2024-01-19T04:15:02.662169+0000","last_became_peered":"2024-01-19T04:15:02.662169+0000","last_unstale":"2024-01-19T04:15:03.791961+0000","last_undegraded":"2024-01-19T04:15:03.791961+0000","last_fullsized":"2024-01-19T04:15:03.791961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:56.446803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794296+0000","last_change":"2024-01-19T04:15:01.654399+0000","last_active":"2024-01-19T04:15:03.794296+0000","last_peered":"2024-01-19T04:15:03.794296+0000","last_clean":"2024-01-19T04:15:03.794296+0000","last_became_active":"2024-01-19T04:15:01.652845+0000","last_became_peered":"2024-01-19T04:15:01.652845+0000","last_unstale":"2024-01-19T04:15:03.794296+0000","last_undegraded":"2024-01-19T04:15:03.794296+0000","last_fullsized":"2024-01-19T04:15:03.794296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793429+0000","last_change":"2024-01-19T04:15:02.655914+0000","last_active":"2024-01-19T04:15:03.793429+0000","last_peered":"2024-01-19T04:15:03.793429+0000","last_clean":"2024-01-19T04:15:03.793429+0000","last_became_active":"2024-01-19T04:15:02.655614+0000","last_became_peered":"2024-01-19T04:15:02.655614+0000","last_unstale":"2024-01-19T04:15:03.793429+0000","last_undegraded":"2024-01-19T04:15:03.793429+0000","last_fullsized":"2024-01-19T04:15:03.793429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793903+0000","last_change":"2024-01-19T04:15:01.659225+0000","last_active":"2024-01-19T04:15:03.793903+0000","last_peered":"2024-01-19T04:15:03.793903+0000","last_clean":"2024-01-19T04:15:03.793903+0000","last_became_active":"2024-01-19T04:15:01.658937+0000","last_became_peered":"2024-01-19T04:15:01.658937+0000","last_unstale":"2024-01-19T04:15:03.793903+0000","last_undegraded":"2024-01-19T04:15:03.793903+0000","last_fullsized":"2024-01-19T04:15:03.793903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793665+0000","last_change":"2024-01-19T04:15:02.679479+0000","last_active":"2024-01-19T04:15:03.793665+0000","last_peered":"2024-01-19T04:15:03.793665+0000","last_clean":"2024-01-19T04:15:03.793665+0000","last_became_active":"2024-01-19T04:15:02.678631+0000","last_became_peered":"2024-01-19T04:15:02.678631+0000","last_unstale":"2024-01-19T04:15:03.793665+0000","last_undegraded":"2024-01-19T04:15:03.793665+0000","last_fullsized":"2024-01-19T04:15:03.793665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793772+0000","last_change":"2024-01-19T04:15:01.657478+0000","last_active":"2024-01-19T04:15:03.793772+0000","last_peered":"2024-01-19T04:15:03.793772+0000","last_clean":"2024-01-19T04:15:03.793772+0000","last_became_active":"2024-01-19T04:15:01.654337+0000","last_became_peered":"2024-01-19T04:15:01.654337+0000","last_unstale":"2024-01-19T04:15:03.793772+0000","last_undegraded":"2024-01-19T04:15:03.793772+0000","last_fullsized":"2024-01-19T04:15:03.793772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793644+0000","last_change":"2024-01-19T04:15:02.684918+0000","last_active":"2024-01-19T04:15:03.793644+0000","last_peered":"2024-01-19T04:15:03.793644+0000","last_clean":"2024-01-19T04:15:03.793644+0000","last_became_active":"2024-01-19T04:15:02.684209+0000","last_became_peered":"2024-01-19T04:15:02.684209+0000","last_unstale":"2024-01-19T04:15:03.793644+0000","last_undegraded":"2024-01-19T04:15:03.793644+0000","last_fullsized":"2024-01-19T04:15:03.793644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:53.203708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793630+0000","last_change":"2024-01-19T04:15:01.649235+0000","last_active":"2024-01-19T04:15:03.793630+0000","last_peered":"2024-01-19T04:15:03.793630+0000","last_clean":"2024-01-19T04:15:03.793630+0000","last_became_active":"2024-01-19T04:15:01.648890+0000","last_became_peered":"2024-01-19T04:15:01.648890+0000","last_unstale":"2024-01-19T04:15:03.793630+0000","last_undegraded":"2024-01-19T04:15:03.793630+0000","last_fullsized":"2024-01-19T04:15:03.793630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663313+0000","last_change":"2024-01-19T04:15:02.666858+0000","last_active":"2024-01-19T04:15:03.663313+0000","last_peered":"2024-01-19T04:15:03.663313+0000","last_clean":"2024-01-19T04:15:03.663313+0000","last_became_active":"2024-01-19T04:15:02.666581+0000","last_became_peered":"2024-01-19T04:15:02.666581+0000","last_unstale":"2024-01-19T04:15:03.663313+0000","last_undegraded":"2024-01-19T04:15:03.663313+0000","last_fullsized":"2024-01-19T04:15:03.663313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:55.154791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794002+0000","last_change":"2024-01-19T04:15:01.652327+0000","last_active":"2024-01-19T04:15:03.794002+0000","last_peered":"2024-01-19T04:15:03.794002+0000","last_clean":"2024-01-19T04:15:03.794002+0000","last_became_active":"2024-01-19T04:15:01.651986+0000","last_became_peered":"2024-01-19T04:15:01.651986+0000","last_unstale":"2024-01-19T04:15:03.794002+0000","last_undegraded":"2024-01-19T04:15:03.794002+0000","last_fullsized":"2024-01-19T04:15:03.794002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:02.668704+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:02.668254+0000","last_became_peered":"2024-01-19T04:15:02.668254+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:21:16.362265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793263+0000","last_change":"2024-01-19T04:15:01.656572+0000","last_active":"2024-01-19T04:15:03.793263+0000","last_peered":"2024-01-19T04:15:03.793263+0000","last_clean":"2024-01-19T04:15:03.793263+0000","last_became_active":"2024-01-19T04:15:01.655927+0000","last_became_peered":"2024-01-19T04:15:01.655927+0000","last_unstale":"2024-01-19T04:15:03.793263+0000","last_undegraded":"2024-01-19T04:15:03.793263+0000","last_fullsized":"2024-01-19T04:15:03.793263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:10:35.666423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792925+0000","last_change":"2024-01-19T04:15:02.665136+0000","last_active":"2024-01-19T04:15:03.792925+0000","last_peered":"2024-01-19T04:15:03.792925+0000","last_clean":"2024-01-19T04:15:03.792925+0000","last_became_active":"2024-01-19T04:15:02.659894+0000","last_became_peered":"2024-01-19T04:15:02.659894+0000","last_unstale":"2024-01-19T04:15:03.792925+0000","last_undegraded":"2024-01-19T04:15:03.792925+0000","last_fullsized":"2024-01-19T04:15:03.792925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:15.849417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794290+0000","last_change":"2024-01-19T04:15:01.656361+0000","last_active":"2024-01-19T04:15:03.794290+0000","last_peered":"2024-01-19T04:15:03.794290+0000","last_clean":"2024-01-19T04:15:03.794290+0000","last_became_active":"2024-01-19T04:15:01.655933+0000","last_became_peered":"2024-01-19T04:15:01.655933+0000","last_unstale":"2024-01-19T04:15:03.794290+0000","last_undegraded":"2024-01-19T04:15:03.794290+0000","last_fullsized":"2024-01-19T04:15:03.794290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794647+0000","last_change":"2024-01-19T04:15:02.675994+0000","last_active":"2024-01-19T04:15:03.794647+0000","last_peered":"2024-01-19T04:15:03.794647+0000","last_clean":"2024-01-19T04:15:03.794647+0000","last_became_active":"2024-01-19T04:15:02.673959+0000","last_became_peered":"2024-01-19T04:15:02.673959+0000","last_unstale":"2024-01-19T04:15:03.794647+0000","last_undegraded":"2024-01-19T04:15:03.794647+0000","last_fullsized":"2024-01-19T04:15:03.794647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:22.472681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794344+0000","last_change":"2024-01-19T04:15:01.661165+0000","last_active":"2024-01-19T04:15:03.794344+0000","last_peered":"2024-01-19T04:15:03.794344+0000","last_clean":"2024-01-19T04:15:03.794344+0000","last_became_active":"2024-01-19T04:15:01.656873+0000","last_became_peered":"2024-01-19T04:15:01.656873+0000","last_unstale":"2024-01-19T04:15:03.794344+0000","last_undegraded":"2024-01-19T04:15:03.794344+0000","last_fullsized":"2024-01-19T04:15:03.794344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793545+0000","last_change":"2024-01-19T04:15:02.682133+0000","last_active":"2024-01-19T04:15:03.793545+0000","last_peered":"2024-01-19T04:15:03.793545+0000","last_clean":"2024-01-19T04:15:03.793545+0000","last_became_active":"2024-01-19T04:15:02.672918+0000","last_became_peered":"2024-01-19T04:15:02.672918+0000","last_unstale":"2024-01-19T04:15:03.793545+0000","last_undegraded":"2024-01-19T04:15:03.793545+0000","last_fullsized":"2024-01-19T04:15:03.793545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.660994+0000","last_change":"2024-01-19T04:15:01.660206+0000","last_active":"2024-01-19T04:15:03.660994+0000","last_peered":"2024-01-19T04:15:03.660994+0000","last_clean":"2024-01-19T04:15:03.660994+0000","last_became_active":"2024-01-19T04:15:01.659875+0000","last_became_peered":"2024-01-19T04:15:01.659875+0000","last_unstale":"2024-01-19T04:15:03.660994+0000","last_undegraded":"2024-01-19T04:15:03.660994+0000","last_fullsized":"2024-01-19T04:15:03.660994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793220+0000","last_change":"2024-01-19T04:15:02.668873+0000","last_active":"2024-01-19T04:15:03.793220+0000","last_peered":"2024-01-19T04:15:03.793220+0000","last_clean":"2024-01-19T04:15:03.793220+0000","last_became_active":"2024-01-19T04:15:02.668553+0000","last_became_peered":"2024-01-19T04:15:02.668553+0000","last_unstale":"2024-01-19T04:15:03.793220+0000","last_undegraded":"2024-01-19T04:15:03.793220+0000","last_fullsized":"2024-01-19T04:15:03.793220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:53.532449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663364+0000","last_change":"2024-01-19T04:15:01.661192+0000","last_active":"2024-01-19T04:15:03.663364+0000","last_peered":"2024-01-19T04:15:03.663364+0000","last_clean":"2024-01-19T04:15:03.663364+0000","last_became_active":"2024-01-19T04:15:01.660673+0000","last_became_peered":"2024-01-19T04:15:01.660673+0000","last_unstale":"2024-01-19T04:15:03.663364+0000","last_undegraded":"2024-01-19T04:15:03.663364+0000","last_fullsized":"2024-01-19T04:15:03.663364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:16.106132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794632+0000","last_change":"2024-01-19T04:15:02.670249+0000","last_active":"2024-01-19T04:15:03.794632+0000","last_peered":"2024-01-19T04:15:03.794632+0000","last_clean":"2024-01-19T04:15:03.794632+0000","last_became_active":"2024-01-19T04:15:02.669945+0000","last_became_peered":"2024-01-19T04:15:02.669945+0000","last_unstale":"2024-01-19T04:15:03.794632+0000","last_undegraded":"2024-01-19T04:15:03.794632+0000","last_fullsized":"2024-01-19T04:15:03.794632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:22.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661228+0000","last_change":"2024-01-19T04:15:01.651897+0000","last_active":"2024-01-19T04:15:03.661228+0000","last_peered":"2024-01-19T04:15:03.661228+0000","last_clean":"2024-01-19T04:15:03.661228+0000","last_became_active":"2024-01-19T04:15:01.651557+0000","last_became_peered":"2024-01-19T04:15:01.651557+0000","last_unstale":"2024-01-19T04:15:03.661228+0000","last_undegraded":"2024-01-19T04:15:03.661228+0000","last_fullsized":"2024-01-19T04:15:03.661228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794447+0000","last_change":"2024-01-19T04:15:02.676980+0000","last_active":"2024-01-19T04:15:03.794447+0000","last_peered":"2024-01-19T04:15:03.794447+0000","last_clean":"2024-01-19T04:15:03.794447+0000","last_became_active":"2024-01-19T04:15:02.676586+0000","last_became_peered":"2024-01-19T04:15:02.676586+0000","last_unstale":"2024-01-19T04:15:03.794447+0000","last_undegraded":"2024-01-19T04:15:03.794447+0000","last_fullsized":"2024-01-19T04:15:03.794447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793684+0000","last_change":"2024-01-19T04:15:01.660626+0000","last_active":"2024-01-19T04:15:03.793684+0000","last_peered":"2024-01-19T04:15:03.793684+0000","last_clean":"2024-01-19T04:15:03.793684+0000","last_became_active":"2024-01-19T04:15:01.660299+0000","last_became_peered":"2024-01-19T04:15:01.660299+0000","last_unstale":"2024-01-19T04:15:03.793684+0000","last_undegraded":"2024-01-19T04:15:03.793684+0000","last_fullsized":"2024-01-19T04:15:03.793684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794140+0000","last_change":"2024-01-19T04:15:02.689947+0000","last_active":"2024-01-19T04:15:03.794140+0000","last_peered":"2024-01-19T04:15:03.794140+0000","last_clean":"2024-01-19T04:15:03.794140+0000","last_became_active":"2024-01-19T04:15:02.689658+0000","last_became_peered":"2024-01-19T04:15:02.689658+0000","last_unstale":"2024-01-19T04:15:03.794140+0000","last_undegraded":"2024-01-19T04:15:03.794140+0000","last_fullsized":"2024-01-19T04:15:03.794140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:51.870489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661163+0000","last_change":"2024-01-19T04:15:01.659005+0000","last_active":"2024-01-19T04:15:03.661163+0000","last_peered":"2024-01-19T04:15:03.661163+0000","last_clean":"2024-01-19T04:15:03.661163+0000","last_became_active":"2024-01-19T04:15:01.658686+0000","last_became_peered":"2024-01-19T04:15:01.658686+0000","last_unstale":"2024-01-19T04:15:03.661163+0000","last_undegraded":"2024-01-19T04:15:03.661163+0000","last_fullsized":"2024-01-19T04:15:03.661163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793563+0000","last_change":"2024-01-19T04:15:02.682480+0000","last_active":"2024-01-19T04:15:03.793563+0000","last_peered":"2024-01-19T04:15:03.793563+0000","last_clean":"2024-01-19T04:15:03.793563+0000","last_became_active":"2024-01-19T04:15:02.681651+0000","last_became_peered":"2024-01-19T04:15:02.681651+0000","last_unstale":"2024-01-19T04:15:03.793563+0000","last_undegraded":"2024-01-19T04:15:03.793563+0000","last_fullsized":"2024-01-19T04:15:03.793563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:02.655130+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:02.655130+0000","last_peered":"2024-01-19T04:15:02.655130+0000","last_clean":"2024-01-19T04:15:02.655130+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:02.655130+0000","last_undegraded":"2024-01-19T04:15:02.655130+0000","last_fullsized":"2024-01-19T04:15:02.655130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793217+0000","last_change":"2024-01-19T04:15:01.653219+0000","last_active":"2024-01-19T04:15:03.793217+0000","last_peered":"2024-01-19T04:15:03.793217+0000","last_clean":"2024-01-19T04:15:03.793217+0000","last_became_active":"2024-01-19T04:15:01.651102+0000","last_became_peered":"2024-01-19T04:15:01.651102+0000","last_unstale":"2024-01-19T04:15:03.793217+0000","last_undegraded":"2024-01-19T04:15:03.793217+0000","last_fullsized":"2024-01-19T04:15:03.793217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792251+0000","last_change":"2024-01-19T04:15:02.682206+0000","last_active":"2024-01-19T04:15:03.792251+0000","last_peered":"2024-01-19T04:15:03.792251+0000","last_clean":"2024-01-19T04:15:03.792251+0000","last_became_active":"2024-01-19T04:15:02.681769+0000","last_became_peered":"2024-01-19T04:15:02.681769+0000","last_unstale":"2024-01-19T04:15:03.792251+0000","last_undegraded":"2024-01-19T04:15:03.792251+0000","last_fullsized":"2024-01-19T04:15:03.792251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:41:27.610593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:01.662658+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:01.662354+0000","last_became_peered":"2024-01-19T04:15:01.662354+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792635+0000","last_change":"2024-01-19T04:15:02.663011+0000","last_active":"2024-01-19T04:15:03.792635+0000","last_peered":"2024-01-19T04:15:03.792635+0000","last_clean":"2024-01-19T04:15:03.792635+0000","last_became_active":"2024-01-19T04:15:02.661355+0000","last_became_peered":"2024-01-19T04:15:02.661355+0000","last_unstale":"2024-01-19T04:15:03.792635+0000","last_undegraded":"2024-01-19T04:15:03.792635+0000","last_fullsized":"2024-01-19T04:15:03.792635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:28:40.149191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.661294+0000","last_change":"2024-01-19T04:15:01.656500+0000","last_active":"2024-01-19T04:15:03.661294+0000","last_peered":"2024-01-19T04:15:03.661294+0000","last_clean":"2024-01-19T04:15:03.661294+0000","last_became_active":"2024-01-19T04:15:01.654782+0000","last_became_peered":"2024-01-19T04:15:01.654782+0000","last_unstale":"2024-01-19T04:15:03.661294+0000","last_undegraded":"2024-01-19T04:15:03.661294+0000","last_fullsized":"2024-01-19T04:15:03.661294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:29:40.817251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793289+0000","last_change":"2024-01-19T04:15:02.663704+0000","last_active":"2024-01-19T04:15:03.793289+0000","last_peered":"2024-01-19T04:15:03.793289+0000","last_clean":"2024-01-19T04:15:03.793289+0000","last_became_active":"2024-01-19T04:15:02.663466+0000","last_became_peered":"2024-01-19T04:15:02.663466+0000","last_unstale":"2024-01-19T04:15:03.793289+0000","last_undegraded":"2024-01-19T04:15:03.793289+0000","last_fullsized":"2024-01-19T04:15:03.793289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:30:27.509844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:01.649482+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:01.649196+0000","last_became_peered":"2024-01-19T04:15:01.649196+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663035+0000","last_change":"2024-01-19T04:15:02.666162+0000","last_active":"2024-01-19T04:15:03.663035+0000","last_peered":"2024-01-19T04:15:03.663035+0000","last_clean":"2024-01-19T04:15:03.663035+0000","last_became_active":"2024-01-19T04:15:02.664211+0000","last_became_peered":"2024-01-19T04:15:02.664211+0000","last_unstale":"2024-01-19T04:15:03.663035+0000","last_undegraded":"2024-01-19T04:15:03.663035+0000","last_fullsized":"2024-01-19T04:15:03.663035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:20.226272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:01.661604+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:01.661344+0000","last_became_peered":"2024-01-19T04:15:01.661344+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794660+0000","last_change":"2024-01-19T04:15:02.678390+0000","last_active":"2024-01-19T04:15:03.794660+0000","last_peered":"2024-01-19T04:15:03.794660+0000","last_clean":"2024-01-19T04:15:03.794660+0000","last_became_active":"2024-01-19T04:15:02.678101+0000","last_became_peered":"2024-01-19T04:15:02.678101+0000","last_unstale":"2024-01-19T04:15:03.794660+0000","last_undegraded":"2024-01-19T04:15:03.794660+0000","last_fullsized":"2024-01-19T04:15:03.794660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:08:07.352480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793948+0000","last_change":"2024-01-19T04:15:01.666935+0000","last_active":"2024-01-19T04:15:03.793948+0000","last_peered":"2024-01-19T04:15:03.793948+0000","last_clean":"2024-01-19T04:15:03.793948+0000","last_became_active":"2024-01-19T04:15:01.666614+0000","last_became_peered":"2024-01-19T04:15:01.666614+0000","last_unstale":"2024-01-19T04:15:03.793948+0000","last_undegraded":"2024-01-19T04:15:03.793948+0000","last_fullsized":"2024-01-19T04:15:03.793948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:31:54.149630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793500+0000","last_change":"2024-01-19T04:15:02.670747+0000","last_active":"2024-01-19T04:15:03.793500+0000","last_peered":"2024-01-19T04:15:03.793500+0000","last_clean":"2024-01-19T04:15:03.793500+0000","last_became_active":"2024-01-19T04:15:02.670497+0000","last_became_peered":"2024-01-19T04:15:02.670497+0000","last_unstale":"2024-01-19T04:15:03.793500+0000","last_undegraded":"2024-01-19T04:15:03.793500+0000","last_fullsized":"2024-01-19T04:15:03.793500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:49:03.710915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:04.050424+0000","last_change":"2024-01-19T04:15:01.655738+0000","last_active":"2024-01-19T04:15:04.050424+0000","last_peered":"2024-01-19T04:15:04.050424+0000","last_clean":"2024-01-19T04:15:04.050424+0000","last_became_active":"2024-01-19T04:15:01.655435+0000","last_became_peered":"2024-01-19T04:15:01.655435+0000","last_unstale":"2024-01-19T04:15:04.050424+0000","last_undegraded":"2024-01-19T04:15:04.050424+0000","last_fullsized":"2024-01-19T04:15:04.050424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792702+0000","last_change":"2024-01-19T04:15:02.676099+0000","last_active":"2024-01-19T04:15:03.792702+0000","last_peered":"2024-01-19T04:15:03.792702+0000","last_clean":"2024-01-19T04:15:03.792702+0000","last_became_active":"2024-01-19T04:15:02.675858+0000","last_became_peered":"2024-01-19T04:15:02.675858+0000","last_unstale":"2024-01-19T04:15:03.792702+0000","last_undegraded":"2024-01-19T04:15:03.792702+0000","last_fullsized":"2024-01-19T04:15:03.792702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:27:02.894234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794005+0000","last_change":"2024-01-19T04:15:01.664964+0000","last_active":"2024-01-19T04:15:03.794005+0000","last_peered":"2024-01-19T04:15:03.794005+0000","last_clean":"2024-01-19T04:15:03.794005+0000","last_became_active":"2024-01-19T04:15:01.664666+0000","last_became_peered":"2024-01-19T04:15:01.664666+0000","last_unstale":"2024-01-19T04:15:03.794005+0000","last_undegraded":"2024-01-19T04:15:03.794005+0000","last_fullsized":"2024-01-19T04:15:03.794005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:20.137468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793496+0000","last_change":"2024-01-19T04:15:02.655983+0000","last_active":"2024-01-19T04:15:03.793496+0000","last_peered":"2024-01-19T04:15:03.793496+0000","last_clean":"2024-01-19T04:15:03.793496+0000","last_became_active":"2024-01-19T04:15:02.655720+0000","last_became_peered":"2024-01-19T04:15:02.655720+0000","last_unstale":"2024-01-19T04:15:03.793496+0000","last_undegraded":"2024-01-19T04:15:03.793496+0000","last_fullsized":"2024-01-19T04:15:03.793496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:27.219041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793403+0000","last_change":"2024-01-19T04:15:01.663296+0000","last_active":"2024-01-19T04:15:03.793403+0000","last_peered":"2024-01-19T04:15:03.793403+0000","last_clean":"2024-01-19T04:15:03.793403+0000","last_became_active":"2024-01-19T04:15:01.663010+0000","last_became_peered":"2024-01-19T04:15:01.663010+0000","last_unstale":"2024-01-19T04:15:03.793403+0000","last_undegraded":"2024-01-19T04:15:03.793403+0000","last_fullsized":"2024-01-19T04:15:03.793403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:37:19.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.663043+0000","last_change":"2024-01-19T04:15:02.662528+0000","last_active":"2024-01-19T04:15:03.663043+0000","last_peered":"2024-01-19T04:15:03.663043+0000","last_clean":"2024-01-19T04:15:03.663043+0000","last_became_active":"2024-01-19T04:15:02.661397+0000","last_became_peered":"2024-01-19T04:15:02.661397+0000","last_unstale":"2024-01-19T04:15:03.663043+0000","last_undegraded":"2024-01-19T04:15:03.663043+0000","last_fullsized":"2024-01-19T04:15:03.663043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:21.142628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793634+0000","last_change":"2024-01-19T04:15:01.664514+0000","last_active":"2024-01-19T04:15:03.793634+0000","last_peered":"2024-01-19T04:15:03.793634+0000","last_clean":"2024-01-19T04:15:03.793634+0000","last_became_active":"2024-01-19T04:15:01.662668+0000","last_became_peered":"2024-01-19T04:15:01.662668+0000","last_unstale":"2024-01-19T04:15:03.793634+0000","last_undegraded":"2024-01-19T04:15:03.793634+0000","last_fullsized":"2024-01-19T04:15:03.793634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:49:44.063998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.791985+0000","last_change":"2024-01-19T04:15:02.663292+0000","last_active":"2024-01-19T04:15:03.791985+0000","last_peered":"2024-01-19T04:15:03.791985+0000","last_clean":"2024-01-19T04:15:03.791985+0000","last_became_active":"2024-01-19T04:15:02.663012+0000","last_became_peered":"2024-01-19T04:15:02.663012+0000","last_unstale":"2024-01-19T04:15:03.791985+0000","last_undegraded":"2024-01-19T04:15:03.791985+0000","last_fullsized":"2024-01-19T04:15:03.791985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:04.998464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793469+0000","last_change":"2024-01-19T04:15:01.652378+0000","last_active":"2024-01-19T04:15:03.793469+0000","last_peered":"2024-01-19T04:15:03.793469+0000","last_clean":"2024-01-19T04:15:03.793469+0000","last_became_active":"2024-01-19T04:15:01.652057+0000","last_became_peered":"2024-01-19T04:15:01.652057+0000","last_unstale":"2024-01-19T04:15:03.793469+0000","last_undegraded":"2024-01-19T04:15:03.793469+0000","last_fullsized":"2024-01-19T04:15:03.793469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:41.776727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792381+0000","last_change":"2024-01-19T04:15:02.669867+0000","last_active":"2024-01-19T04:15:03.792381+0000","last_peered":"2024-01-19T04:15:03.792381+0000","last_clean":"2024-01-19T04:15:03.792381+0000","last_became_active":"2024-01-19T04:15:02.669483+0000","last_became_peered":"2024-01-19T04:15:02.669483+0000","last_unstale":"2024-01-19T04:15:03.792381+0000","last_undegraded":"2024-01-19T04:15:03.792381+0000","last_fullsized":"2024-01-19T04:15:03.792381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:23:07.891592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794715+0000","last_change":"2024-01-19T04:15:01.664685+0000","last_active":"2024-01-19T04:15:03.794715+0000","last_peered":"2024-01-19T04:15:03.794715+0000","last_clean":"2024-01-19T04:15:03.794715+0000","last_became_active":"2024-01-19T04:15:01.664311+0000","last_became_peered":"2024-01-19T04:15:01.664311+0000","last_unstale":"2024-01-19T04:15:03.794715+0000","last_undegraded":"2024-01-19T04:15:03.794715+0000","last_fullsized":"2024-01-19T04:15:03.794715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:21:02.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793441+0000","last_change":"2024-01-19T04:15:02.668202+0000","last_active":"2024-01-19T04:15:03.793441+0000","last_peered":"2024-01-19T04:15:03.793441+0000","last_clean":"2024-01-19T04:15:03.793441+0000","last_became_active":"2024-01-19T04:15:02.667661+0000","last_became_peered":"2024-01-19T04:15:02.667661+0000","last_unstale":"2024-01-19T04:15:03.793441+0000","last_undegraded":"2024-01-19T04:15:03.793441+0000","last_fullsized":"2024-01-19T04:15:03.793441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:02:31.951459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794134+0000","last_change":"2024-01-19T04:15:02.679928+0000","last_active":"2024-01-19T04:15:03.794134+0000","last_peered":"2024-01-19T04:15:03.794134+0000","last_clean":"2024-01-19T04:15:03.794134+0000","last_became_active":"2024-01-19T04:15:02.679629+0000","last_became_peered":"2024-01-19T04:15:02.679629+0000","last_unstale":"2024-01-19T04:15:03.794134+0000","last_undegraded":"2024-01-19T04:15:03.794134+0000","last_fullsized":"2024-01-19T04:15:03.794134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:03:19.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793812+0000","last_change":"2024-01-19T04:15:01.665948+0000","last_active":"2024-01-19T04:15:03.793812+0000","last_peered":"2024-01-19T04:15:03.793812+0000","last_clean":"2024-01-19T04:15:03.793812+0000","last_became_active":"2024-01-19T04:15:01.665641+0000","last_became_peered":"2024-01-19T04:15:01.665641+0000","last_unstale":"2024-01-19T04:15:03.793812+0000","last_undegraded":"2024-01-19T04:15:03.793812+0000","last_fullsized":"2024-01-19T04:15:03.793812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:11:09.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.794795+0000","last_change":"2024-01-19T04:15:02.681662+0000","last_active":"2024-01-19T04:15:03.794795+0000","last_peered":"2024-01-19T04:15:03.794795+0000","last_clean":"2024-01-19T04:15:03.794795+0000","last_became_active":"2024-01-19T04:15:02.681303+0000","last_became_peered":"2024-01-19T04:15:02.681303+0000","last_unstale":"2024-01-19T04:15:03.794795+0000","last_undegraded":"2024-01-19T04:15:03.794795+0000","last_fullsized":"2024-01-19T04:15:03.794795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:14.303835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793675+0000","last_change":"2024-01-19T04:15:01.671175+0000","last_active":"2024-01-19T04:15:03.793675+0000","last_peered":"2024-01-19T04:15:03.793675+0000","last_clean":"2024-01-19T04:15:03.793675+0000","last_became_active":"2024-01-19T04:15:01.670934+0000","last_became_peered":"2024-01-19T04:15:01.670934+0000","last_unstale":"2024-01-19T04:15:03.793675+0000","last_undegraded":"2024-01-19T04:15:03.793675+0000","last_fullsized":"2024-01-19T04:15:03.793675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:47.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793581+0000","last_change":"2024-01-19T04:15:02.685102+0000","last_active":"2024-01-19T04:15:03.793581+0000","last_peered":"2024-01-19T04:15:03.793581+0000","last_clean":"2024-01-19T04:15:03.793581+0000","last_became_active":"2024-01-19T04:15:02.684653+0000","last_became_peered":"2024-01-19T04:15:02.684653+0000","last_unstale":"2024-01-19T04:15:03.793581+0000","last_undegraded":"2024-01-19T04:15:03.793581+0000","last_fullsized":"2024-01-19T04:15:03.793581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:31.736245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.045276+0000","last_change":"2024-01-19T04:15:01.657663+0000","last_active":"2024-01-19T04:15:03.045276+0000","last_peered":"2024-01-19T04:15:03.045276+0000","last_clean":"2024-01-19T04:15:03.045276+0000","last_became_active":"2024-01-19T04:15:01.657372+0000","last_became_peered":"2024-01-19T04:15:01.657372+0000","last_unstale":"2024-01-19T04:15:03.045276+0000","last_undegraded":"2024-01-19T04:15:03.045276+0000","last_fullsized":"2024-01-19T04:15:03.045276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:24:30.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.792578+0000","last_change":"2024-01-19T04:15:02.670659+0000","last_active":"2024-01-19T04:15:03.792578+0000","last_peered":"2024-01-19T04:15:03.792578+0000","last_clean":"2024-01-19T04:15:03.792578+0000","last_became_active":"2024-01-19T04:15:02.668710+0000","last_became_peered":"2024-01-19T04:15:02.668710+0000","last_unstale":"2024-01-19T04:15:03.792578+0000","last_undegraded":"2024-01-19T04:15:03.792578+0000","last_fullsized":"2024-01-19T04:15:03.792578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:01.629301+0000","last_clean_scrub_stamp":"2024-01-19T04:15:01.629301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:23:52.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-01-19T04:15:03.793688+0000","last_change":"2024-01-19T04:15:01.665080+0000","last_active":"2024-01-19T04:15:03.793688+0000","last_peered":"2024-01-19T04:15:03.793688+0000","last_clean":"2024-01-19T04:15:03.793688+0000","last_became_active":"2024-01-19T04:15:01.663889+0000","last_became_peered":"2024-01-19T04:15:01.663889+0000","last_unstale":"2024-01-19T04:15:03.793688+0000","last_undegraded":"2024-01-19T04:15:03.793688+0000","last_fullsized":"2024-01-19T04:15:03.793688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:00.624141+0000","last_clean_scrub_stamp":"2024-01-19T04:15:00.624141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:03:13.418483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":670753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":4,"up_from":16,"seq":68719476743,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":79929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":79803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":79963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.343}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2639999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0990000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":670809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4460000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.633}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5939999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5629999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6470000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0510000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":81415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3239999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5469999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.319}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6230000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2539999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.423}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:11.851 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-19T04:15:11.851 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-19T04:15:11.851 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-19T04:15:11.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-19T04:15:12.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.023+0000 7fa428600640 1 Processor -- start 2024-01-19T04:15:12.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.023+0000 7fa428600640 1 -- start start 2024-01-19T04:15:12.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa428600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa420151e80 0x7fa4200c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa428600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa42006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa428600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42006fb10 con 0x7fa4200c1540 2024-01-19T04:15:12.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa428600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa420155650 con 0x7fa420151e80 2024-01-19T04:15:12.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa428600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42006fd60 con 0x7fa4200a7390 2024-01-19T04:15:12.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa425200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa4200c1540 0x7fa42006e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47412/0 (socket says 172.21.15.32:47412) 2024-01-19T04:15:12.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa425200640 1 -- 172.21.15.32:0/2594276675 learned_addr learned my addr 172.21.15.32:0/2594276675 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa425c00640 1 --2- 172.21.15.32:0/2594276675 >> v2:172.21.15.67:3300/0 conn(0x7fa420151e80 0x7fa4200c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa426600640 1 --2- 172.21.15.32:0/2594276675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa42006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa41fe00640 1 -- 172.21.15.32:0/2594276675 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214979991 0 0) 0x7fa42006fb10 con 0x7fa4200c1540 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa41fe00640 1 -- 172.21.15.32:0/2594276675 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa400003530 con 0x7fa4200c1540 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa426600640 1 -- 172.21.15.32:0/2594276675 >> v2:172.21.15.67:3300/0 conn(0x7fa420151e80 msgr2=0x7fa4200c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa426600640 1 --2- 172.21.15.32:0/2594276675 >> v2:172.21.15.67:3300/0 conn(0x7fa420151e80 0x7fa4200c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa426600640 1 -- 172.21.15.32:0/2594276675 >> v1:172.21.15.32:6789/0 conn(0x7fa4200c1540 legacy=0x7fa42006e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa426600640 1 -- 172.21.15.32:0/2594276675 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420070040 con 0x7fa4200a7390 2024-01-19T04:15:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.027+0000 7fa425c00640 1 --2- 172.21.15.32:0/2594276675 >> v2:172.21.15.67:3300/0 conn(0x7fa420151e80 0x7fa4200c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:12.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa426600640 1 --2- 172.21.15.32:0/2594276675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa42006ee00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa418009d90 tx=0x7fa41801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c89bce55b7bc26b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa41fe00640 1 -- 172.21.15.32:0/2594276675 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180a5780 con 0x7fa4200a7390 2024-01-19T04:15:12.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa41fe00640 1 -- 172.21.15.32:0/2594276675 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4180a58e0 con 0x7fa4200a7390 2024-01-19T04:15:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa41fe00640 1 -- 172.21.15.32:0/2594276675 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180a5c70 con 0x7fa4200a7390 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 -- 172.21.15.32:0/2594276675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 msgr2=0x7fa42006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 --2- 172.21.15.32:0/2594276675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa42006ee00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa418009d90 tx=0x7fa41801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 -- 172.21.15.32:0/2594276675 shutdown_connections 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 --2- 172.21.15.32:0/2594276675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa42006ee00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 --2- 172.21.15.32:0/2594276675 >> v2:172.21.15.67:3300/0 conn(0x7fa420151e80 0x7fa4200c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 -- 172.21.15.32:0/2594276675 >> 172.21.15.32:0/2594276675 conn(0x7fa4200726d0 msgr2=0x7fa4200663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 -- 172.21.15.32:0/2594276675 shutdown_connections 2024-01-19T04:15:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.031+0000 7fa428600640 1 -- 172.21.15.32:0/2594276675 wait complete. 2024-01-19T04:15:12.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 Processor -- start 2024-01-19T04:15:12.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 -- start start 2024-01-19T04:15:12.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa420156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4200c1540 0x7fa420157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420151e80 0x7fa42014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa420159800 con 0x7fa420151e80 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200a99e0 con 0x7fa4200c1540 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201f1600 con 0x7fa4200a7390 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420151e80 0x7fa42014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420151e80 0x7fa42014ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34770/0 (socket says 172.21.15.32:34770) 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 -- 172.21.15.32:0/3206638278 learned_addr learned my addr 172.21.15.32:0/3206638278 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa425c00640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa420156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa425200640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4200c1540 0x7fa420157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 -- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 msgr2=0x7fa420156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa420156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 -- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4200c1540 msgr2=0x7fa420157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4200c1540 0x7fa420157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 -- 172.21.15.32:0/3206638278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410009420 con 0x7fa420151e80 2024-01-19T04:15:12.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa426600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420151e80 0x7fa42014ebf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa41801a4f0 tx=0x7fa418019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa41d600640 1 -- 172.21.15.32:0/3206638278 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180ad640 con 0x7fa420151e80 2024-01-19T04:15:12.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa41d600640 1 -- 172.21.15.32:0/3206638278 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4180ad7a0 con 0x7fa420151e80 2024-01-19T04:15:12.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa41d600640 1 -- 172.21.15.32:0/3206638278 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180adb30 con 0x7fa420151e80 2024-01-19T04:15:12.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa418009a70 con 0x7fa420151e80 2024-01-19T04:15:12.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4200a9670 con 0x7fa420151e80 2024-01-19T04:15:12.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.035+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4200a9b90 con 0x7fa420151e80 2024-01-19T04:15:12.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.039+0000 7fa41d600640 1 -- 172.21.15.32:0/3206638278 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa4180b4070 con 0x7fa420151e80 2024-01-19T04:15:12.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.039+0000 7fa41d600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.039+0000 7fa41d600640 1 -- 172.21.15.32:0/3206638278 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa41811ecd0 con 0x7fa420151e80 2024-01-19T04:15:12.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.039+0000 7fa425c00640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.039+0000 7fa425c00640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4200c6f00 tx=0x7fa410008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.043+0000 7fa41d600640 1 -- 172.21.15.32:0/3206638278 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa4200a9b90 con 0x7fa420151e80 2024-01-19T04:15:12.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa4200a9b90 con 0x7fa420151e80 2024-01-19T04:15:12.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa41d600640 1 -- 172.21.15.32:0/3206638278 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa4180b2040 con 0x7fa420151e80 2024-01-19T04:15:12.242 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:12.242 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-19T04:15:12.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 msgr2=0x7fa3f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4200c6f00 tx=0x7fa410008040 comp rx=0 tx=0).stop 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420151e80 msgr2=0x7fa42014ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420151e80 0x7fa42014ebf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa41801a4f0 tx=0x7fa418019660 comp rx=0 tx=0).stop 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 shutdown_connections 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420151e80 0x7fa42014ebf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4200c1540 0x7fa420157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 --2- 172.21.15.32:0/3206638278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4200a7390 0x7fa420156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 >> 172.21.15.32:0/3206638278 conn(0x7fa4200726d0 msgr2=0x7fa4200663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 shutdown_connections 2024-01-19T04:15:12.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.239+0000 7fa428600640 1 -- 172.21.15.32:0/3206638278 wait complete. 2024-01-19T04:15:12.264 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-19T04:15:12.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:12.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.399+0000 7f6043c00640 1 Processor -- start 2024-01-19T04:15:12.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.399+0000 7f6043c00640 1 -- start start 2024-01-19T04:15:12.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f6043c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c0c04a0 0x7f603c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f6043c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c071e80 con 0x7f603c0a4ec0 2024-01-19T04:15:12.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f6043c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0726c0 con 0x7f603c14fb50 2024-01-19T04:15:12.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f6043c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1535c0 con 0x7f603c0c04a0 2024-01-19T04:15:12.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f6041c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f603c0a4ec0 0x7f603c15cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47418/0 (socket says 172.21.15.32:47418) 2024-01-19T04:15:12.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f6041c00640 1 -- 172.21.15.32:0/2952660954 learned_addr learned my addr 172.21.15.32:0/2952660954 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:12.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603be00640 1 --2- 172.21.15.32:0/2952660954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c0c04a0 0x7f603c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603b400640 1 -- 172.21.15.32:0/2952660954 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303621377 0 0) 0x7f603c071e80 con 0x7f603c0a4ec0 2024-01-19T04:15:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603b400640 1 -- 172.21.15.32:0/2952660954 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c003530 con 0x7f603c0a4ec0 2024-01-19T04:15:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603b400640 1 -- 172.21.15.32:0/2952660954 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053994717 0 0) 0x7f603c0726c0 con 0x7f603c14fb50 2024-01-19T04:15:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603b400640 1 -- 172.21.15.32:0/2952660954 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603c071e80 con 0x7f603c14fb50 2024-01-19T04:15:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603be00640 1 -- 172.21.15.32:0/2952660954 >> v1:172.21.15.67:6789/0 conn(0x7f603c14fb50 legacy=0x7f603c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603be00640 1 -- 172.21.15.32:0/2952660954 >> v1:172.21.15.32:6789/0 conn(0x7f603c0a4ec0 legacy=0x7f603c15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.403+0000 7f603be00640 1 -- 172.21.15.32:0/2952660954 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0c0a20 con 0x7f603c0c04a0 2024-01-19T04:15:12.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f603be00640 1 --2- 172.21.15.32:0/2952660954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c0c04a0 0x7f603c0c1230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6024009820 tx=0x7f602401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4634549a926cd2c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f603b400640 1 -- 172.21.15.32:0/2952660954 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240a4ea0 con 0x7f603c0c04a0 2024-01-19T04:15:12.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f603b400640 1 -- 172.21.15.32:0/2952660954 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60240a7050 con 0x7f603c0c04a0 2024-01-19T04:15:12.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f603b400640 1 -- 172.21.15.32:0/2952660954 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240ab820 con 0x7f603c0c04a0 2024-01-19T04:15:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 -- 172.21.15.32:0/2952660954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c0c04a0 msgr2=0x7f603c0c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 --2- 172.21.15.32:0/2952660954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c0c04a0 0x7f603c0c1230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6024009820 tx=0x7f602401c410 comp rx=0 tx=0).stop 2024-01-19T04:15:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 -- 172.21.15.32:0/2952660954 shutdown_connections 2024-01-19T04:15:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 --2- 172.21.15.32:0/2952660954 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c0c04a0 0x7f603c0c1230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 -- 172.21.15.32:0/2952660954 >> 172.21.15.32:0/2952660954 conn(0x7f603c0c5b20 msgr2=0x7f603c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 -- 172.21.15.32:0/2952660954 shutdown_connections 2024-01-19T04:15:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 -- 172.21.15.32:0/2952660954 wait complete. 2024-01-19T04:15:12.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 Processor -- start 2024-01-19T04:15:12.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.407+0000 7f6043c00640 1 -- start start 2024-01-19T04:15:12.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f603c0a4ec0 0x7f603c148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f603c0c04a0 0x7f603c1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c14fb50 0x7f603c149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c14a080 con 0x7f603c0c04a0 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c147910 con 0x7f603c0a4ec0 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c14ab70 con 0x7f603c14fb50 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f603c0c04a0 0x7f603c1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f603c0c04a0 0x7f603c1473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34786/0 (socket says 172.21.15.32:34786) 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 -- 172.21.15.32:0/1935719590 learned_addr learned my addr 172.21.15.32:0/1935719590 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6041200640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f603c0a4ec0 0x7f603c148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6041c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c14fb50 0x7f603c149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 -- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c14fb50 msgr2=0x7f603c149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c14fb50 0x7f603c149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 -- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f603c0a4ec0 msgr2=0x7f603c148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f603c0a4ec0 0x7f603c148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 -- 172.21.15.32:0/1935719590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009420 con 0x7f603c0c04a0 2024-01-19T04:15:12.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6041c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c14fb50 0x7f603c149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:12.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f603be00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f603c0c04a0 0x7f603c1473d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6024009820 tx=0x7f602401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6038c00640 1 -- 172.21.15.32:0/1935719590 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240a4ea0 con 0x7f603c0c04a0 2024-01-19T04:15:12.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6038c00640 1 -- 172.21.15.32:0/1935719590 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60240b7450 con 0x7f603c0c04a0 2024-01-19T04:15:12.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6038c00640 1 -- 172.21.15.32:0/1935719590 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240b7800 con 0x7f603c0c04a0 2024-01-19T04:15:12.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c149150 con 0x7f603c0c04a0 2024-01-19T04:15:12.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c14a520 con 0x7f603c0c04a0 2024-01-19T04:15:12.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c0749f0 con 0x7f603c0c04a0 2024-01-19T04:15:12.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.411+0000 7f6038c00640 1 -- 172.21.15.32:0/1935719590 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f60240b7960 con 0x7f603c0c04a0 2024-01-19T04:15:12.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.415+0000 7f6038c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6014066500 0x7f60140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.415+0000 7f6038c00640 1 -- 172.21.15.32:0/1935719590 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f602411e500 con 0x7f603c0c04a0 2024-01-19T04:15:12.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.415+0000 7f6041200640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6014066500 0x7f60140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.415+0000 7f6041200640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6014066500 0x7f60140689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f602c001720 tx=0x7f602c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.419+0000 7f6038c00640 1 -- 172.21.15.32:0/1935719590 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f60240eb790 con 0x7f603c0c04a0 2024-01-19T04:15:12.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.579+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f603c15e400 con 0x7f603c0c04a0 2024-01-19T04:15:12.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6038c00640 1 -- 172.21.15.32:0/1935719590 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f60240eedb0 con 0x7f603c0c04a0 2024-01-19T04:15:12.587 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:12.587 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6014066500 msgr2=0x7f60140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6014066500 0x7f60140689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f602c001720 tx=0x7f602c009040 comp rx=0 tx=0).stop 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f603c0c04a0 msgr2=0x7f603c1473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f603c0c04a0 0x7f603c1473d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6024009820 tx=0x7f602401ac50 comp rx=0 tx=0).stop 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 shutdown_connections 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6014066500 0x7f60140689c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f603c14fb50 0x7f603c149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f603c0c04a0 0x7f603c1473d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 --2- 172.21.15.32:0/1935719590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f603c0a4ec0 0x7f603c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 >> 172.21.15.32:0/1935719590 conn(0x7f603c0c5b20 msgr2=0x7f603c151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 shutdown_connections 2024-01-19T04:15:12.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.583+0000 7f6043c00640 1 -- 172.21.15.32:0/1935719590 wait complete. 2024-01-19T04:15:12.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:12.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73f000640 1 Processor -- start 2024-01-19T04:15:12.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73f000640 1 -- start start 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73f000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7380720b0 0x7fa73815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73f000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738072730 con 0x7fa73814eb90 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73f000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738155580 con 0x7fa7381550e0 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73f000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa738072a10 con 0x7fa7380720b0 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa737e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa73814eb90 0x7fa7381549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47422/0 (socket says 172.21.15.32:47422) 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa737e00640 1 -- 172.21.15.32:0/2469009581 learned_addr learned my addr 172.21.15.32:0/2469009581 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73d000640 1 --2- 172.21.15.32:0/2469009581 >> v2:172.21.15.67:3300/0 conn(0x7fa7380720b0 0x7fa73815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa736a00640 1 -- 172.21.15.32:0/2469009581 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020179151 0 0) 0x7fa738072730 con 0x7fa73814eb90 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa736a00640 1 -- 172.21.15.32:0/2469009581 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa718003530 con 0x7fa73814eb90 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa736a00640 1 -- 172.21.15.32:0/2469009581 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843676458 0 0) 0x7fa738155580 con 0x7fa7381550e0 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa736a00640 1 -- 172.21.15.32:0/2469009581 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa738072730 con 0x7fa7381550e0 2024-01-19T04:15:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73d000640 1 -- 172.21.15.32:0/2469009581 >> v1:172.21.15.67:6789/0 conn(0x7fa7381550e0 legacy=0x7fa7380719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73d000640 1 -- 172.21.15.32:0/2469009581 >> v1:172.21.15.32:6789/0 conn(0x7fa73814eb90 legacy=0x7fa7381549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.751+0000 7fa73d000640 1 -- 172.21.15.32:0/2469009581 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738155860 con 0x7fa7380720b0 2024-01-19T04:15:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73d000640 1 --2- 172.21.15.32:0/2469009581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7380720b0 0x7fa73815cd10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa730009d90 tx=0x7fa73001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c12a5f480504b971 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa736a00640 1 -- 172.21.15.32:0/2469009581 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300a5780 con 0x7fa7380720b0 2024-01-19T04:15:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa736a00640 1 -- 172.21.15.32:0/2469009581 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300a58e0 con 0x7fa7380720b0 2024-01-19T04:15:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa736a00640 1 -- 172.21.15.32:0/2469009581 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300a5c70 con 0x7fa7380720b0 2024-01-19T04:15:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73f000640 1 -- 172.21.15.32:0/2469009581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7380720b0 msgr2=0x7fa73815cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73f000640 1 --2- 172.21.15.32:0/2469009581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7380720b0 0x7fa73815cd10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa730009d90 tx=0x7fa73001c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73f000640 1 -- 172.21.15.32:0/2469009581 shutdown_connections 2024-01-19T04:15:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73f000640 1 --2- 172.21.15.32:0/2469009581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7380720b0 0x7fa73815cd10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73f000640 1 -- 172.21.15.32:0/2469009581 >> 172.21.15.32:0/2469009581 conn(0x7fa7380c25a0 msgr2=0x7fa7380c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73f000640 1 -- 172.21.15.32:0/2469009581 shutdown_connections 2024-01-19T04:15:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.755+0000 7fa73f000640 1 -- 172.21.15.32:0/2469009581 wait complete. 2024-01-19T04:15:12.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 Processor -- start 2024-01-19T04:15:12.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 -- start start 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7380720b0 0x7fa738151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa73814eb90 0x7fa738152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7381550e0 0x7fa7381f0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814fc20 con 0x7fa7381550e0 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381f14f0 con 0x7fa73814eb90 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381517b0 con 0x7fa7380720b0 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7381550e0 0x7fa7381f0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7381550e0 0x7fa7381f0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34798/0 (socket says 172.21.15.32:34798) 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 -- 172.21.15.32:0/4052012001 learned_addr learned my addr 172.21.15.32:0/4052012001 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa737400640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa73814eb90 0x7fa738152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa737e00640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7380720b0 0x7fa738151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 -- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7380720b0 msgr2=0x7fa738151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7380720b0 0x7fa738151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 -- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa73814eb90 msgr2=0x7fa738152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa73814eb90 0x7fa738152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 -- 172.21.15.32:0/4052012001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009a70 con 0x7fa7381550e0 2024-01-19T04:15:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73d000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7381550e0 0x7fa7381f0840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7300b0040 tx=0x7fa730019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa72fe00640 1 -- 172.21.15.32:0/4052012001 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300b9650 con 0x7fa7381550e0 2024-01-19T04:15:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa72fe00640 1 -- 172.21.15.32:0/4052012001 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300b97b0 con 0x7fa7381550e0 2024-01-19T04:15:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa72fe00640 1 -- 172.21.15.32:0/4052012001 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300b9b20 con 0x7fa7381550e0 2024-01-19T04:15:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa738143210 con 0x7fa7381550e0 2024-01-19T04:15:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.759+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa738151a00 con 0x7fa7381550e0 2024-01-19T04:15:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.763+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7380749f0 con 0x7fa7381550e0 2024-01-19T04:15:12.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.763+0000 7fa72fe00640 1 -- 172.21.15.32:0/4052012001 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa7300b9c80 con 0x7fa7381550e0 2024-01-19T04:15:12.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.763+0000 7fa72fe00640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa710066500 0x7fa7100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:12.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.763+0000 7fa72fe00640 1 -- 172.21.15.32:0/4052012001 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73011f070 con 0x7fa7381550e0 2024-01-19T04:15:12.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.763+0000 7fa737e00640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa710066500 0x7fa7100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:12.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.763+0000 7fa737e00640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa710066500 0x7fa7100689c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa728000f70 tx=0x7fa728009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:12.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.767+0000 7fa72fe00640 1 -- 172.21.15.32:0/4052012001 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa7301504d0 con 0x7fa7381550e0 2024-01-19T04:15:12.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7380a4b90 con 0x7fa7381550e0 2024-01-19T04:15:12.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa72fe00640 1 -- 172.21.15.32:0/4052012001 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7300ec280 con 0x7fa7381550e0 2024-01-19T04:15:12.934 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa710066500 msgr2=0x7fa7100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa710066500 0x7fa7100689c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa728000f70 tx=0x7fa728009040 comp rx=0 tx=0).stop 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7381550e0 msgr2=0x7fa7381f0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7381550e0 0x7fa7381f0840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7300b0040 tx=0x7fa730019660 comp rx=0 tx=0).stop 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 shutdown_connections 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa710066500 0x7fa7100689c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7381550e0 0x7fa7381f0840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa73814eb90 0x7fa738152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 --2- 172.21.15.32:0/4052012001 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7380720b0 0x7fa738151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 >> 172.21.15.32:0/4052012001 conn(0x7fa7380c25a0 msgr2=0x7fa7380c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 shutdown_connections 2024-01-19T04:15:12.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:12.931+0000 7fa73f000640 1 -- 172.21.15.32:0/4052012001 wait complete. 2024-01-19T04:15:12.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:13.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e4d800640 1 Processor -- start 2024-01-19T04:15:13.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e4d800640 1 -- start start 2024-01-19T04:15:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e4d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8e4806d440 0x7f8e480c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e4d800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e480a4ea0 con 0x7f8e480c2080 2024-01-19T04:15:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e4d800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e48152a20 con 0x7f8e480723b0 2024-01-19T04:15:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e4d800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e481524a0 con 0x7f8e4806d440 2024-01-19T04:15:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e47400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8e4806d440 0x7f8e480c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e46000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8e480c2080 0x7f8e48155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47432/0 (socket says 172.21.15.32:47432) 2024-01-19T04:15:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e46000640 1 -- 172.21.15.32:0/3818166552 learned_addr learned my addr 172.21.15.32:0/3818166552 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:13.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e47400640 1 -- 172.21.15.32:0/3818166552 >> v1:172.21.15.67:6789/0 conn(0x7f8e480723b0 legacy=0x7f8e48152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:13.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e47400640 1 -- 172.21.15.32:0/3818166552 >> v1:172.21.15.32:6789/0 conn(0x7f8e480c2080 legacy=0x7f8e48155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e47400640 1 -- 172.21.15.32:0/3818166552 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480c3430 con 0x7f8e4806d440 2024-01-19T04:15:13.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.099+0000 7f8e45600640 1 -- 172.21.15.32:0/3818166552 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639316058 0 0) 0x7f8e480a4ea0 con 0x7f8e480c2080 2024-01-19T04:15:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e47400640 1 --2- 172.21.15.32:0/3818166552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480c4e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009d90 tx=0x7f8e4001c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65046ae575fc06b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e45600640 1 -- 172.21.15.32:0/3818166552 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400a5790 con 0x7f8e4806d440 2024-01-19T04:15:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e45600640 1 -- 172.21.15.32:0/3818166552 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400a58f0 con 0x7f8e4806d440 2024-01-19T04:15:13.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e45600640 1 -- 172.21.15.32:0/3818166552 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400a5c80 con 0x7f8e4806d440 2024-01-19T04:15:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e4d800640 1 -- 172.21.15.32:0/3818166552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 msgr2=0x7f8e480c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e4d800640 1 --2- 172.21.15.32:0/3818166552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480c4e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009d90 tx=0x7f8e4001c7c0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e4d800640 1 -- 172.21.15.32:0/3818166552 shutdown_connections 2024-01-19T04:15:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e4d800640 1 --2- 172.21.15.32:0/3818166552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480c4e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e4d800640 1 -- 172.21.15.32:0/3818166552 >> 172.21.15.32:0/3818166552 conn(0x7f8e480c25a0 msgr2=0x7f8e480c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e4d800640 1 -- 172.21.15.32:0/3818166552 shutdown_connections 2024-01-19T04:15:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.103+0000 7f8e4d800640 1 -- 172.21.15.32:0/3818166552 wait complete. 2024-01-19T04:15:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 Processor -- start 2024-01-19T04:15:13.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 -- start start 2024-01-19T04:15:13.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e480723b0 0x7f8e4814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480c2080 0x7f8e4814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48153660 con 0x7f8e4806d440 2024-01-19T04:15:13.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48155aa0 con 0x7f8e480c2080 2024-01-19T04:15:13.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48153900 con 0x7f8e480723b0 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34814/0 (socket says 172.21.15.32:34814) 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 -- 172.21.15.32:0/921317385 learned_addr learned my addr 172.21.15.32:0/921317385 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46000640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e480723b0 0x7f8e4814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e47400640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480c2080 0x7f8e4814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 -- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e480723b0 msgr2=0x7f8e4814eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e480723b0 0x7f8e4814eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 -- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480c2080 msgr2=0x7f8e4814f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480c2080 0x7f8e4814f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 -- 172.21.15.32:0/921317385 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009a70 con 0x7f8e4806d440 2024-01-19T04:15:13.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e46a00640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480701a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800b410 tx=0x7f8e3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e3ea00640 1 -- 172.21.15.32:0/921317385 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38011830 con 0x7f8e4806d440 2024-01-19T04:15:13.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e3ea00640 1 -- 172.21.15.32:0/921317385 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e380119b0 con 0x7f8e4806d440 2024-01-19T04:15:13.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e3ea00640 1 -- 172.21.15.32:0/921317385 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38011d60 con 0x7f8e4806d440 2024-01-19T04:15:13.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e48070d70 con 0x7f8e4806d440 2024-01-19T04:15:13.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.107+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e48153d90 con 0x7f8e4806d440 2024-01-19T04:15:13.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.111+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e48070bd0 con 0x7f8e4806d440 2024-01-19T04:15:13.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.111+0000 7f8e3ea00640 1 -- 172.21.15.32:0/921317385 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8e3801a400 con 0x7f8e4806d440 2024-01-19T04:15:13.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.111+0000 7f8e3ea00640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8e20066500 0x7f8e200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.111+0000 7f8e3ea00640 1 -- 172.21.15.32:0/921317385 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e38083ec0 con 0x7f8e4806d440 2024-01-19T04:15:13.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.111+0000 7f8e46000640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8e20066500 0x7f8e200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.111+0000 7f8e46000640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8e20066500 0x7f8e200689c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e480c5030 tx=0x7f8e30007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.115+0000 7f8e3ea00640 1 -- 172.21.15.32:0/921317385 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8e48070bd0 con 0x7f8e4806d440 2024-01-19T04:15:13.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.271+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e48070bd0 con 0x7f8e4806d440 2024-01-19T04:15:13.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e3ea00640 1 -- 172.21.15.32:0/921317385 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e38015020 con 0x7f8e4806d440 2024-01-19T04:15:13.278 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8e20066500 msgr2=0x7f8e200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8e20066500 0x7f8e200689c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e480c5030 tx=0x7f8e30007d60 comp rx=0 tx=0).stop 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 msgr2=0x7f8e480701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480701a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800b410 tx=0x7f8e3800b8d0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 shutdown_connections 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8e20066500 0x7f8e200689c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480c2080 0x7f8e4814f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8e480723b0 0x7f8e4814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 --2- 172.21.15.32:0/921317385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e4806d440 0x7f8e480701a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 >> 172.21.15.32:0/921317385 conn(0x7f8e480c25a0 msgr2=0x7f8e480a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:13.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 shutdown_connections 2024-01-19T04:15:13.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.275+0000 7f8e4d800640 1 -- 172.21.15.32:0/921317385 wait complete. 2024-01-19T04:15:13.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:13.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f4474c00640 1 Processor -- start 2024-01-19T04:15:13.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f4474c00640 1 -- start start 2024-01-19T04:15:13.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f4474c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f447006d440 0x7f44700c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f4474c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700a4ea0 con 0x7f44700723b0 2024-01-19T04:15:13.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f4474c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4470152a20 con 0x7f44700c2080 2024-01-19T04:15:13.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f4474c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44701524a0 con 0x7f447006d440 2024-01-19T04:15:13.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f446e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f447006d440 0x7f44700c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f446de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f44700723b0 0x7f4470152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47434/0 (socket says 172.21.15.32:47434) 2024-01-19T04:15:13.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f446de00640 1 -- 172.21.15.32:0/3640513294 learned_addr learned my addr 172.21.15.32:0/3640513294 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:13.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f446e800640 1 --2- 172.21.15.32:0/3640513294 >> v2:172.21.15.32:3300/0 conn(0x7f447006d440 0x7f44700c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34818/0 (socket says 172.21.15.32:34818) 2024-01-19T04:15:13.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f446e800640 1 -- 172.21.15.32:0/3640513294 >> v1:172.21.15.67:6789/0 conn(0x7f44700c2080 legacy=0x7f4470155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f446e800640 1 -- 172.21.15.32:0/3640513294 >> v1:172.21.15.32:6789/0 conn(0x7f44700723b0 legacy=0x7f4470152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.439+0000 7f446e800640 1 -- 172.21.15.32:0/3640513294 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700c3430 con 0x7f447006d440 2024-01-19T04:15:13.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f446e800640 1 --2- 172.21.15.32:0/3640513294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447006d440 0x7f44700c4e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4468009d90 tx=0x7f446801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e25fc548759105 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f446ca00640 1 -- 172.21.15.32:0/3640513294 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680a57d0 con 0x7f447006d440 2024-01-19T04:15:13.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f446ca00640 1 -- 172.21.15.32:0/3640513294 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680a5930 con 0x7f447006d440 2024-01-19T04:15:13.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f446ca00640 1 -- 172.21.15.32:0/3640513294 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680a5cc0 con 0x7f447006d440 2024-01-19T04:15:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f4474c00640 1 -- 172.21.15.32:0/3640513294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447006d440 msgr2=0x7f44700c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f4474c00640 1 --2- 172.21.15.32:0/3640513294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447006d440 0x7f44700c4e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4468009d90 tx=0x7f446801c800 comp rx=0 tx=0).stop 2024-01-19T04:15:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f4474c00640 1 -- 172.21.15.32:0/3640513294 shutdown_connections 2024-01-19T04:15:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f4474c00640 1 --2- 172.21.15.32:0/3640513294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447006d440 0x7f44700c4e50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f4474c00640 1 -- 172.21.15.32:0/3640513294 >> 172.21.15.32:0/3640513294 conn(0x7f44700c25a0 msgr2=0x7f44700c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f4474c00640 1 -- 172.21.15.32:0/3640513294 shutdown_connections 2024-01-19T04:15:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.443+0000 7f4474c00640 1 -- 172.21.15.32:0/3640513294 wait complete. 2024-01-19T04:15:13.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 Processor -- start 2024-01-19T04:15:13.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 -- start start 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f447006d440 0x7f447014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44700723b0 0x7f44700aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44700c2080 0x7f44700aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447014def0 con 0x7f44700c2080 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447014e380 con 0x7f44700723b0 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447014d5c0 con 0x7f447006d440 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44700c2080 0x7f44700aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44700c2080 0x7f44700aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34828/0 (socket says 172.21.15.32:34828) 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 -- 172.21.15.32:0/432408198 learned_addr learned my addr 172.21.15.32:0/432408198 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446d400640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44700723b0 0x7f44700aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446de00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f447006d440 0x7f447014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 -- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f447006d440 msgr2=0x7f447014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f447006d440 0x7f447014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 -- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44700723b0 msgr2=0x7f44700aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44700723b0 0x7f44700aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 -- 172.21.15.32:0/432408198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4468009a70 con 0x7f44700c2080 2024-01-19T04:15:13.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446d400640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44700723b0 0x7f44700aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:13.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446de00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f447006d440 0x7f447014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:13.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f446e800640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44700c2080 0x7f44700aac60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44680b0040 tx=0x7f44680195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4466000640 1 -- 172.21.15.32:0/432408198 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680b9860 con 0x7f44700c2080 2024-01-19T04:15:13.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4466000640 1 -- 172.21.15.32:0/432408198 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680b99c0 con 0x7f44700c2080 2024-01-19T04:15:13.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4466000640 1 -- 172.21.15.32:0/432408198 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680b9d50 con 0x7f44700c2080 2024-01-19T04:15:13.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447014d8a0 con 0x7f44700c2080 2024-01-19T04:15:13.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447014d270 con 0x7f44700c2080 2024-01-19T04:15:13.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.447+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44700c4c00 con 0x7f44700c2080 2024-01-19T04:15:13.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.451+0000 7f4466000640 1 -- 172.21.15.32:0/432408198 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f44680ad440 con 0x7f44700c2080 2024-01-19T04:15:13.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.451+0000 7f4466000640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4448066530 0x7f44480689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.451+0000 7f4466000640 1 -- 172.21.15.32:0/432408198 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f446811f190 con 0x7f44700c2080 2024-01-19T04:15:13.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.451+0000 7f446de00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4448066530 0x7f44480689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.451+0000 7f446de00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4448066530 0x7f44480689f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4460005890 tx=0x7f4460009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.455+0000 7f4466000640 1 -- 172.21.15.32:0/432408198 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f44680efeb0 con 0x7f44700c2080 2024-01-19T04:15:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.611+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44700749f0 con 0x7f44700c2080 2024-01-19T04:15:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.611+0000 7f4466000640 1 -- 172.21.15.32:0/432408198 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44680a5790 con 0x7f44700c2080 2024-01-19T04:15:13.617 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4448066530 msgr2=0x7f44480689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4448066530 0x7f44480689f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4460005890 tx=0x7f4460009040 comp rx=0 tx=0).stop 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44700c2080 msgr2=0x7f44700aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44700c2080 0x7f44700aac60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44680b0040 tx=0x7f44680195a0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 shutdown_connections 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4448066530 0x7f44480689f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44700c2080 0x7f44700aac60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44700723b0 0x7f44700aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 --2- 172.21.15.32:0/432408198 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f447006d440 0x7f447014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 >> 172.21.15.32:0/432408198 conn(0x7f44700c25a0 msgr2=0x7f44700c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 shutdown_connections 2024-01-19T04:15:13.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.615+0000 7f4474c00640 1 -- 172.21.15.32:0/432408198 wait complete. 2024-01-19T04:15:13.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:13.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.775+0000 7f0d3fe00640 1 Processor -- start 2024-01-19T04:15:13.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.775+0000 7f0d3fe00640 1 -- start start 2024-01-19T04:15:13.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0d380c55e0 0x7f0d38151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3fe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380c1d40 con 0x7f0d380c18b0 2024-01-19T04:15:13.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3fe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380c0810 con 0x7f0d38147f90 2024-01-19T04:15:13.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3fe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3806c5c0 con 0x7f0d380c55e0 2024-01-19T04:15:13.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0d380c18b0 0x7f0d380a4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47436/0 (socket says 172.21.15.32:47436) 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3de00640 1 -- 172.21.15.32:0/2082799888 learned_addr learned my addr 172.21.15.32:0/2082799888 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3ca00640 1 --2- 172.21.15.32:0/2082799888 >> v2:172.21.15.67:3300/0 conn(0x7f0d380c55e0 0x7f0d38151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d37e00640 1 -- 172.21.15.32:0/2082799888 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329197714 0 0) 0x7f0d380c1d40 con 0x7f0d380c18b0 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d37e00640 1 -- 172.21.15.32:0/2082799888 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d18003530 con 0x7f0d380c18b0 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d37e00640 1 -- 172.21.15.32:0/2082799888 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392620381 0 0) 0x7f0d380c0810 con 0x7f0d38147f90 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d37e00640 1 -- 172.21.15.32:0/2082799888 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d380c1d40 con 0x7f0d38147f90 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3ca00640 1 -- 172.21.15.32:0/2082799888 >> v1:172.21.15.67:6789/0 conn(0x7f0d38147f90 legacy=0x7f0d3806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3ca00640 1 -- 172.21.15.32:0/2082799888 >> v1:172.21.15.32:6789/0 conn(0x7f0d380c18b0 legacy=0x7f0d380a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.779+0000 7f0d3ca00640 1 -- 172.21.15.32:0/2082799888 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380c0af0 con 0x7f0d380c55e0 2024-01-19T04:15:13.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3ca00640 1 --2- 172.21.15.32:0/2082799888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c55e0 0x7f0d38151350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d200097c0 tx=0x7f0d2001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f0dc1f7843c5b32 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d37e00640 1 -- 172.21.15.32:0/2082799888 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200ac620 con 0x7f0d380c55e0 2024-01-19T04:15:13.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d37e00640 1 -- 172.21.15.32:0/2082799888 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d200ac780 con 0x7f0d380c55e0 2024-01-19T04:15:13.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d37e00640 1 -- 172.21.15.32:0/2082799888 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200acb10 con 0x7f0d380c55e0 2024-01-19T04:15:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2082799888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c55e0 msgr2=0x7f0d38151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2082799888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c55e0 0x7f0d38151350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d200097c0 tx=0x7f0d2001c3c0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2082799888 shutdown_connections 2024-01-19T04:15:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2082799888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c55e0 0x7f0d38151350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2082799888 >> 172.21.15.32:0/2082799888 conn(0x7f0d380c5b20 msgr2=0x7f0d380c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2082799888 shutdown_connections 2024-01-19T04:15:13.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2082799888 wait complete. 2024-01-19T04:15:13.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 Processor -- start 2024-01-19T04:15:13.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.783+0000 7f0d3fe00640 1 -- start start 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c18b0 0x7f0d381550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d380c55e0 0x7f0d3814d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d38147f90 0x7f0d3814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380ab7a0 con 0x7f0d380c55e0 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3814ea80 con 0x7f0d380c18b0 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380aa800 con 0x7f0d38147f90 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d380c55e0 0x7f0d3814d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d380c55e0 0x7f0d3814d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34838/0 (socket says 172.21.15.32:34838) 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 -- 172.21.15.32:0/2328866759 learned_addr learned my addr 172.21.15.32:0/2328866759 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3de00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d38147f90 0x7f0d3814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3d400640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c18b0 0x7f0d381550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 -- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d38147f90 msgr2=0x7f0d3814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d38147f90 0x7f0d3814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 -- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c18b0 msgr2=0x7f0d381550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c18b0 0x7f0d381550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 -- 172.21.15.32:0/2328866759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009420 con 0x7f0d380c55e0 2024-01-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3d400640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c18b0 0x7f0d381550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3ca00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d380c55e0 0x7f0d3814d8b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0d200af040 tx=0x7f0d2001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d35600640 1 -- 172.21.15.32:0/2328866759 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200ac620 con 0x7f0d380c55e0 2024-01-19T04:15:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d35600640 1 -- 172.21.15.32:0/2328866759 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d200b8450 con 0x7f0d380c55e0 2024-01-19T04:15:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d380aaae0 con 0x7f0d380c55e0 2024-01-19T04:15:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d35600640 1 -- 172.21.15.32:0/2328866759 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200b8820 con 0x7f0d380c55e0 2024-01-19T04:15:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d38155610 con 0x7f0d380c55e0 2024-01-19T04:15:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d380ab910 con 0x7f0d380c55e0 2024-01-19T04:15:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.787+0000 7f0d35600640 1 -- 172.21.15.32:0/2328866759 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0d200aa070 con 0x7f0d380c55e0 2024-01-19T04:15:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.791+0000 7f0d35600640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0d10066500 0x7f0d100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.791+0000 7f0d35600640 1 -- 172.21.15.32:0/2328866759 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d2011e370 con 0x7f0d380c55e0 2024-01-19T04:15:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.791+0000 7f0d3d400640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0d10066500 0x7f0d100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.791+0000 7f0d3d400640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0d10066500 0x7f0d100689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d28001740 tx=0x7f0d28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:13.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.795+0000 7f0d35600640 1 -- 172.21.15.32:0/2328866759 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0d200eb720 con 0x7f0d380c55e0 2024-01-19T04:15:13.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d380749f0 con 0x7f0d380c55e0 2024-01-19T04:15:13.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d35600640 1 -- 172.21.15.32:0/2328866759 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f0d200eed40 con 0x7f0d380c55e0 2024-01-19T04:15:13.995 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:13.995 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:13.995 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0d10066500 msgr2=0x7f0d100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0d10066500 0x7f0d100689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d28001740 tx=0x7f0d28009040 comp rx=0 tx=0).stop 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d380c55e0 msgr2=0x7f0d3814d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d380c55e0 0x7f0d3814d8b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0d200af040 tx=0x7f0d2001ac00 comp rx=0 tx=0).stop 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 shutdown_connections 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0d10066500 0x7f0d100689c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0d38147f90 0x7f0d3814ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d380c55e0 0x7f0d3814d8b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 --2- 172.21.15.32:0/2328866759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d380c18b0 0x7f0d381550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 >> 172.21.15.32:0/2328866759 conn(0x7f0d380c5b20 msgr2=0x7f0d380c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 shutdown_connections 2024-01-19T04:15:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:13.991+0000 7f0d3fe00640 1 -- 172.21.15.32:0/2328866759 wait complete. 2024-01-19T04:15:14.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:14.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.151+0000 7f697ea00640 1 Processor -- start 2024-01-19T04:15:14.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ea00640 1 -- start start 2024-01-19T04:15:14.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6978155060 0x7f69780c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 0x7f69780c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ea00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69780c6570 con 0x7f69780c78d0 2024-01-19T04:15:14.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ea00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6978155560 con 0x7f6978155060 2024-01-19T04:15:14.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ea00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780c5c40 con 0x7f697806fa50 2024-01-19T04:15:14.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f69780c78d0 0x7f69780c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47452/0 (socket says 172.21.15.32:47452) 2024-01-19T04:15:14.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977e00640 1 -- 172.21.15.32:0/1515160313 learned_addr learned my addr 172.21.15.32:0/1515160313 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 --2- 172.21.15.32:0/1515160313 >> v2:172.21.15.67:3300/0 conn(0x7f6978155060 0x7f69780c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ca00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 0x7f69780c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404612832 0 0) 0x7f69780c6570 con 0x7f69780c78d0 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6958003530 con 0x7f69780c78d0 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 72071921 0 0) 0x7f6958003530 con 0x7f69780c78d0 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 msgr2=0x7f69780c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 0x7f69780c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 >> v2:172.21.15.67:3300/0 conn(0x7f6978155060 msgr2=0x7f69780c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 --2- 172.21.15.32:0/1515160313 >> v2:172.21.15.67:3300/0 conn(0x7f6978155060 0x7f69780c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780c5f20 con 0x7f69780c78d0 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f6968001680 con 0x7f69780c78d0 2024-01-19T04:15:14.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 --2- 172.21.15.32:0/1515160313 >> v2:172.21.15.67:3300/0 conn(0x7f6978155060 0x7f69780c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 >> v1:172.21.15.32:6789/0 conn(0x7f69780c78d0 legacy=0x7f69780c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6958003980 0x7f6958003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6958004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 0x7f6958005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978155560 con 0x7f69580047d0 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780c5c40 con 0x7f6958003980 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695800b990 con 0x7f697806fa50 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6958004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977e00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6958003980 0x7f6958003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f697ca00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 0x7f6958005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 -- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 msgr2=0x7f6958005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697806fa50 0x7f6958005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 -- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6958003980 msgr2=0x7f6958003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6958003980 0x7f6958003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.155+0000 7f6977400640 1 -- 172.21.15.32:0/1515160313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958003530 con 0x7f69580047d0 2024-01-19T04:15:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f6977400640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6958004c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6960009cb0 tx=0x7f696001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7acd8a00ad44e70 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780c7750 con 0x7f69580047d0 2024-01-19T04:15:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69600a57e0 con 0x7f69580047d0 2024-01-19T04:15:14.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f6976a00640 1 -- 172.21.15.32:0/1515160313 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69600a5b90 con 0x7f69580047d0 2024-01-19T04:15:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f697ea00640 1 -- 172.21.15.32:0/1515160313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 msgr2=0x7f6958004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f697ea00640 1 --2- 172.21.15.32:0/1515160313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6958004c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6960009cb0 tx=0x7f696001cc00 comp rx=0 tx=0).stop 2024-01-19T04:15:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f697ca00640 1 -- 172.21.15.32:0/1515160313 reap_dead start 2024-01-19T04:15:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f697ea00640 1 -- 172.21.15.32:0/1515160313 shutdown_connections 2024-01-19T04:15:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f697ea00640 1 -- 172.21.15.32:0/1515160313 >> 172.21.15.32:0/1515160313 conn(0x7f697806ddb0 msgr2=0x7f697806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:14.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f697ea00640 1 -- 172.21.15.32:0/1515160313 shutdown_connections 2024-01-19T04:15:14.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.159+0000 7f697ea00640 1 -- 172.21.15.32:0/1515160313 wait complete. 2024-01-19T04:15:14.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 Processor -- start 2024-01-19T04:15:14.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 -- start start 2024-01-19T04:15:14.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6978151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69781510c0 0x7f69780c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697814d790 0x7f697814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697814fc70 con 0x7f69580047d0 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697814eff0 con 0x7f697814d790 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697814f2d0 con 0x7f69781510c0 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6978151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6978151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34850/0 (socket says 172.21.15.32:34850) 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 -- 172.21.15.32:0/1987365489 learned_addr learned my addr 172.21.15.32:0/1987365489 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ca00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697814d790 0x7f697814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977400640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69781510c0 0x7f69780c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 -- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69781510c0 msgr2=0x7f69780c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69781510c0 0x7f69780c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 -- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697814d790 msgr2=0x7f697814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697814d790 0x7f697814dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 -- 172.21.15.32:0/1987365489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697814f5b0 con 0x7f69580047d0 2024-01-19T04:15:14.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f6977e00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6978151d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f696800e820 tx=0x7f696800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f696fe00640 1 -- 172.21.15.32:0/1987365489 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696800c8d0 con 0x7f69580047d0 2024-01-19T04:15:14.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f696fe00640 1 -- 172.21.15.32:0/1987365489 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696800ca50 con 0x7f69580047d0 2024-01-19T04:15:14.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f696fe00640 1 -- 172.21.15.32:0/1987365489 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696800ce00 con 0x7f69580047d0 2024-01-19T04:15:14.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697814f890 con 0x7f69580047d0 2024-01-19T04:15:14.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.163+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697814eca0 con 0x7f69580047d0 2024-01-19T04:15:14.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.167+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697814fee0 con 0x7f69580047d0 2024-01-19T04:15:14.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.167+0000 7f696fe00640 1 -- 172.21.15.32:0/1987365489 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f696801d460 con 0x7f69580047d0 2024-01-19T04:15:14.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.167+0000 7f696fe00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6950066500 0x7f69500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.167+0000 7f696fe00640 1 -- 172.21.15.32:0/1987365489 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6968083da0 con 0x7f69580047d0 2024-01-19T04:15:14.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.167+0000 7f6977400640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6950066500 0x7f69500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.167+0000 7f6977400640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6950066500 0x7f69500689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f69600af000 tx=0x7f69600046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.171+0000 7f696fe00640 1 -- 172.21.15.32:0/1987365489 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f69680510e0 con 0x7f69580047d0 2024-01-19T04:15:14.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.331+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697814fee0 con 0x7f69580047d0 2024-01-19T04:15:14.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f696fe00640 1 -- 172.21.15.32:0/1987365489 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f696807be60 con 0x7f69580047d0 2024-01-19T04:15:14.338 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:14.338 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:14.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6950066500 msgr2=0x7f69500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6950066500 0x7f69500689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f69600af000 tx=0x7f69600046d0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 msgr2=0x7f6978151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6978151d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f696800e820 tx=0x7f696800ece0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 shutdown_connections 2024-01-19T04:15:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6950066500 0x7f69500689c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f697814d790 0x7f697814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69781510c0 0x7f69780c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 --2- 172.21.15.32:0/1987365489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69580047d0 0x7f6978151d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 >> 172.21.15.32:0/1987365489 conn(0x7f697806ddb0 msgr2=0x7f6978153780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 shutdown_connections 2024-01-19T04:15:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.335+0000 7f697ea00640 1 -- 172.21.15.32:0/1987365489 wait complete. 2024-01-19T04:15:14.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:14.360 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:14.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e8c00640 1 Processor -- start 2024-01-19T04:15:14.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e8c00640 1 -- start start 2024-01-19T04:15:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e8c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e40723b0 0x7fe1e4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e8c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1e40c2080 0x7fe1e4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e8c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40a4ea0 con 0x7fe1e406d440 2024-01-19T04:15:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e8c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e41524a0 con 0x7fe1e40c2080 2024-01-19T04:15:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e8c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4152a20 con 0x7fe1e40723b0 2024-01-19T04:15:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e2800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe1e406d440 0x7fe1e40c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47460/0 (socket says 172.21.15.32:47460) 2024-01-19T04:15:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e2800640 1 -- 172.21.15.32:0/414045210 learned_addr learned my addr 172.21.15.32:0/414045210 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074472640 0 0) 0x7fe1e40a4ea0 con 0x7fe1e406d440 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c4003530 con 0x7fe1e406d440 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e1400640 1 --2- 172.21.15.32:0/414045210 >> v2:172.21.15.67:3300/0 conn(0x7fe1e40c2080 0x7fe1e4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.499+0000 7fe1e1e00640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e40723b0 0x7fe1e4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2632658385 0 0) 0x7fe1c4003530 con 0x7fe1e406d440 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e40723b0 msgr2=0x7fe1e4152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e40723b0 0x7fe1e4152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 >> v2:172.21.15.67:3300/0 conn(0x7fe1e40c2080 msgr2=0x7fe1e4155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 --2- 172.21.15.32:0/414045210 >> v2:172.21.15.67:3300/0 conn(0x7fe1e40c2080 0x7fe1e4155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e41533f0 con 0x7fe1e406d440 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fe1dc001a00 con 0x7fe1e406d440 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 >> v1:172.21.15.32:6789/0 conn(0x7fe1e406d440 legacy=0x7fe1e40c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1c4003980 0x7fe1c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c40047d0 0x7fe1c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e41524a0 con 0x7fe1c4005190 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4152a20 con 0x7fe1c40047d0 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c400bfb0 con 0x7fe1c4003980 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e2800640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e1e00640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1c4003980 0x7fe1c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e1400640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c40047d0 0x7fe1c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e2800640 1 -- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1c4003980 msgr2=0x7fe1c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e2800640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1c4003980 0x7fe1c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e2800640 1 -- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c40047d0 msgr2=0x7fe1c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e2800640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c40047d0 0x7fe1c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.503+0000 7fe1e2800640 1 -- 172.21.15.32:0/414045210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4003530 con 0x7fe1c4005190 2024-01-19T04:15:14.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e2800640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1c400b990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406d8f0 tx=0x7fe1dc01d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49fa75be8ce41a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0ad630 con 0x7fe1c4005190 2024-01-19T04:15:14.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc0a8070 con 0x7fe1c4005190 2024-01-19T04:15:14.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e0a00640 1 -- 172.21.15.32:0/414045210 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0ada30 con 0x7fe1c4005190 2024-01-19T04:15:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 -- 172.21.15.32:0/414045210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 msgr2=0x7fe1c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 --2- 172.21.15.32:0/414045210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1c400b990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406d8f0 tx=0x7fe1dc01d320 comp rx=0 tx=0).stop 2024-01-19T04:15:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e2800640 1 -- 172.21.15.32:0/414045210 reap_dead start 2024-01-19T04:15:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 -- 172.21.15.32:0/414045210 shutdown_connections 2024-01-19T04:15:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 -- 172.21.15.32:0/414045210 >> 172.21.15.32:0/414045210 conn(0x7fe1e40c25a0 msgr2=0x7fe1e40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 -- 172.21.15.32:0/414045210 shutdown_connections 2024-01-19T04:15:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 -- 172.21.15.32:0/414045210 wait complete. 2024-01-19T04:15:14.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 Processor -- start 2024-01-19T04:15:14.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.507+0000 7fe1e8c00640 1 -- start start 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1e4159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e41ebc20 0x7fe1e415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e415c710 0x7fe1e4153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415a260 con 0x7fe1c4005190 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4159390 con 0x7fe1e415c710 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4149a70 con 0x7fe1e41ebc20 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1e4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1e4159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34870/0 (socket says 172.21.15.32:34870) 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 -- 172.21.15.32:0/3183625201 learned_addr learned my addr 172.21.15.32:0/3183625201 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e2800640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e415c710 0x7fe1e4153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1400640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e41ebc20 0x7fe1e415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 -- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e41ebc20 msgr2=0x7fe1e415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e41ebc20 0x7fe1e415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 -- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e415c710 msgr2=0x7fe1e4153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e415c710 0x7fe1e4153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 -- 172.21.15.32:0/3183625201 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e41ec080 con 0x7fe1c4005190 2024-01-19T04:15:14.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e2800640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e415c710 0x7fe1e4153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:14.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e1e00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1e4159810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4011890 tx=0x7fe1d4011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1da000640 1 -- 172.21.15.32:0/3183625201 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4004240 con 0x7fe1c4005190 2024-01-19T04:15:14.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1da000640 1 -- 172.21.15.32:0/3183625201 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d40043a0 con 0x7fe1c4005190 2024-01-19T04:15:14.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e414bdd0 con 0x7fe1c4005190 2024-01-19T04:15:14.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1da000640 1 -- 172.21.15.32:0/3183625201 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400fa00 con 0x7fe1c4005190 2024-01-19T04:15:14.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e4155220 con 0x7fe1c4005190 2024-01-19T04:15:14.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e4155080 con 0x7fe1c4005190 2024-01-19T04:15:14.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.511+0000 7fe1da000640 1 -- 172.21.15.32:0/3183625201 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe1d400fb60 con 0x7fe1c4005190 2024-01-19T04:15:14.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.515+0000 7fe1da000640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe1bc066530 0x7fe1bc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.515+0000 7fe1da000640 1 -- 172.21.15.32:0/3183625201 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1d4084380 con 0x7fe1c4005190 2024-01-19T04:15:14.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.515+0000 7fe1e1400640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe1bc066530 0x7fe1bc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.515+0000 7fe1e1400640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe1bc066530 0x7fe1bc0689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4149e10 tx=0x7fe1cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.519+0000 7fe1da000640 1 -- 172.21.15.32:0/3183625201 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe1e4155080 con 0x7fe1c4005190 2024-01-19T04:15:14.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.675+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1e4155080 con 0x7fe1c4005190 2024-01-19T04:15:14.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.675+0000 7fe1da000640 1 -- 172.21.15.32:0/3183625201 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1e4155080 con 0x7fe1c4005190 2024-01-19T04:15:14.682 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe1bc066530 msgr2=0x7fe1bc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe1bc066530 0x7fe1bc0689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4149e10 tx=0x7fe1cc008040 comp rx=0 tx=0).stop 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 msgr2=0x7fe1e4159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1e4159810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4011890 tx=0x7fe1d4011d50 comp rx=0 tx=0).stop 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 shutdown_connections 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe1bc066530 0x7fe1bc0689f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e415c710 0x7fe1e4153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1e41ebc20 0x7fe1e415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 --2- 172.21.15.32:0/3183625201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c4005190 0x7fe1e4159810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 >> 172.21.15.32:0/3183625201 conn(0x7fe1e40c25a0 msgr2=0x7fe1e414f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 shutdown_connections 2024-01-19T04:15:14.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.679+0000 7fe1e8c00640 1 -- 172.21.15.32:0/3183625201 wait complete. 2024-01-19T04:15:14.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.843+0000 7f5b02400640 1 Processor -- start 2024-01-19T04:15:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.843+0000 7f5b02400640 1 -- start start 2024-01-19T04:15:14.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.843+0000 7f5b02400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.843+0000 7f5b02400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc0c0eb0 con 0x7f5afc06cab0 2024-01-19T04:15:14.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.843+0000 7f5b02400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc0a5330 con 0x7f5afc0705b0 2024-01-19T04:15:14.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5b02400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc06e5c0 con 0x7f5afc0c55d0 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afb400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5afc06cab0 0x7f5afc0c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47466/0 (socket says 172.21.15.32:47466) 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afb400640 1 -- 172.21.15.32:0/3432219635 learned_addr learned my addr 172.21.15.32:0/3432219635 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afaa00640 1 --2- 172.21.15.32:0/3432219635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afa000640 1 -- 172.21.15.32:0/3432219635 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625488827 0 0) 0x7f5afc0c0eb0 con 0x7f5afc06cab0 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afa000640 1 -- 172.21.15.32:0/3432219635 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5adc003530 con 0x7f5afc06cab0 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afa000640 1 -- 172.21.15.32:0/3432219635 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811848264 0 0) 0x7f5afc0a5330 con 0x7f5afc0705b0 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afaa00640 1 -- 172.21.15.32:0/3432219635 >> v1:172.21.15.67:6789/0 conn(0x7f5afc0705b0 legacy=0x7f5afc15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afaa00640 1 -- 172.21.15.32:0/3432219635 >> v1:172.21.15.32:6789/0 conn(0x7f5afc06cab0 legacy=0x7f5afc0c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afaa00640 1 -- 172.21.15.32:0/3432219635 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc1516f0 con 0x7f5afc0c55d0 2024-01-19T04:15:14.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.847+0000 7f5afaa00640 1 --2- 172.21.15.32:0/3432219635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc06ce90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400a990 tx=0x7f5ae401d860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22265c2a80410a1d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5afa000640 1 -- 172.21.15.32:0/3432219635 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40a6910 con 0x7f5afc0c55d0 2024-01-19T04:15:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5afa000640 1 -- 172.21.15.32:0/3432219635 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae40a6a70 con 0x7f5afc0c55d0 2024-01-19T04:15:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5afa000640 1 -- 172.21.15.32:0/3432219635 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40a6e00 con 0x7f5afc0c55d0 2024-01-19T04:15:14.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- 172.21.15.32:0/3432219635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 msgr2=0x7f5afc06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 --2- 172.21.15.32:0/3432219635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc06ce90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400a990 tx=0x7f5ae401d860 comp rx=0 tx=0).stop 2024-01-19T04:15:14.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- 172.21.15.32:0/3432219635 shutdown_connections 2024-01-19T04:15:14.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 --2- 172.21.15.32:0/3432219635 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc06ce90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- 172.21.15.32:0/3432219635 >> 172.21.15.32:0/3432219635 conn(0x7f5afc0c25a0 msgr2=0x7f5afc0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:14.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- 172.21.15.32:0/3432219635 shutdown_connections 2024-01-19T04:15:14.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- 172.21.15.32:0/3432219635 wait complete. 2024-01-19T04:15:14.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 Processor -- start 2024-01-19T04:15:14.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- start start 2024-01-19T04:15:14.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc06cab0 0x7f5afc1f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc0705b0 0x7f5afc0bf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc1ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1543f0 con 0x7f5afc0705b0 2024-01-19T04:15:14.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc155a20 con 0x7f5afc06cab0 2024-01-19T04:15:14.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5b02400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1ed1e0 con 0x7f5afc0c55d0 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.851+0000 7f5afaa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc0705b0 0x7f5afc0bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc0705b0 0x7f5afc0bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34872/0 (socket says 172.21.15.32:34872) 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 -- 172.21.15.32:0/3515610481 learned_addr learned my addr 172.21.15.32:0/3515610481 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afb400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc06cab0 0x7f5afc1f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afbe00640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc1ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 -- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 msgr2=0x7f5afc1ee650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc1ee650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 -- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc06cab0 msgr2=0x7f5afc1f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc06cab0 0x7f5afc1f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 -- 172.21.15.32:0/3515610481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae400a5c0 con 0x7f5afc0705b0 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afb400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc06cab0 0x7f5afc1f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:14.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afbe00640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc1ee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:14.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5afaa00640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc0705b0 0x7f5afc0bf230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40b1040 tx=0x7f5ae401a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5af3400640 1 -- 172.21.15.32:0/3515610481 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4004220 con 0x7f5afc0705b0 2024-01-19T04:15:14.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5af3400640 1 -- 172.21.15.32:0/3515610481 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4004380 con 0x7f5afc0705b0 2024-01-19T04:15:14.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5af3400640 1 -- 172.21.15.32:0/3515610481 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40ae890 con 0x7f5afc0705b0 2024-01-19T04:15:14.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc1f1640 con 0x7f5afc0705b0 2024-01-19T04:15:14.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc1ed3f0 con 0x7f5afc0705b0 2024-01-19T04:15:14.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc0749f0 con 0x7f5afc0705b0 2024-01-19T04:15:14.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.855+0000 7f5af3400640 1 -- 172.21.15.32:0/3515610481 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5ae40b5040 con 0x7f5afc0705b0 2024-01-19T04:15:14.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.859+0000 7f5af3400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ad4066500 0x7f5ad40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:14.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.859+0000 7f5af3400640 1 -- 172.21.15.32:0/3515610481 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ae411da20 con 0x7f5afc0705b0 2024-01-19T04:15:14.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.859+0000 7f5afb400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ad4066500 0x7f5ad40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:14.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.859+0000 7f5afb400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ad4066500 0x7f5ad40689c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5aec005890 tx=0x7f5aec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:14.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:14.863+0000 7f5af3400640 1 -- 172.21.15.32:0/3515610481 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5ae40eac20 con 0x7f5afc0705b0 2024-01-19T04:15:15.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.023+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5afc06d590 con 0x7f5afc0705b0 2024-01-19T04:15:15.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.023+0000 7f5af3400640 1 -- 172.21.15.32:0/3515610481 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ae40044f0 con 0x7f5afc0705b0 2024-01-19T04:15:15.028 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:15.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ad4066500 msgr2=0x7f5ad40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ad4066500 0x7f5ad40689c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5aec005890 tx=0x7f5aec009040 comp rx=0 tx=0).stop 2024-01-19T04:15:15.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc0705b0 msgr2=0x7f5afc0bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc0705b0 0x7f5afc0bf230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40b1040 tx=0x7f5ae401a600 comp rx=0 tx=0).stop 2024-01-19T04:15:15.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 shutdown_connections 2024-01-19T04:15:15.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ad4066500 0x7f5ad40689c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5afc0c55d0 0x7f5afc1ee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc0705b0 0x7f5afc0bf230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 --2- 172.21.15.32:0/3515610481 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5afc06cab0 0x7f5afc1f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 >> 172.21.15.32:0/3515610481 conn(0x7f5afc0c25a0 msgr2=0x7f5afc150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:15.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 shutdown_connections 2024-01-19T04:15:15.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.027+0000 7f5b02400640 1 -- 172.21.15.32:0/3515610481 wait complete. 2024-01-19T04:15:15.050 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:15.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bb6400640 1 Processor -- start 2024-01-19T04:15:15.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bb6400640 1 -- start start 2024-01-19T04:15:15.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bb6400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5bb01550e0 0x7f5bb00719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bb6400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5bb006c670 0x7f5bb0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bb6400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0072730 con 0x7f5bb014eb90 2024-01-19T04:15:15.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bb6400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb0072a10 con 0x7f5bb006c670 2024-01-19T04:15:15.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bb6400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb014ef70 con 0x7f5bb01550e0 2024-01-19T04:15:15.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bafe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5bb006c670 0x7f5bb0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5baf400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5bb014eb90 0x7f5bb01549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47470/0 (socket says 172.21.15.32:47470) 2024-01-19T04:15:15.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5baf400640 1 -- 172.21.15.32:0/2629493014 learned_addr learned my addr 172.21.15.32:0/2629493014 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:15.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5baea00640 1 --2- 172.21.15.32:0/2629493014 >> v2:172.21.15.67:3300/0 conn(0x7f5bb01550e0 0x7f5bb00719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bafe00640 1 -- 172.21.15.32:0/2629493014 >> v2:172.21.15.67:3300/0 conn(0x7f5bb01550e0 msgr2=0x7f5bb00719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:15.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bafe00640 1 --2- 172.21.15.32:0/2629493014 >> v2:172.21.15.67:3300/0 conn(0x7f5bb01550e0 0x7f5bb00719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bafe00640 1 -- 172.21.15.32:0/2629493014 >> v1:172.21.15.32:6789/0 conn(0x7f5bb014eb90 legacy=0x7f5bb01549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bafe00640 1 -- 172.21.15.32:0/2629493014 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0155580 con 0x7f5bb006c670 2024-01-19T04:15:15.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.191+0000 7f5bae000640 1 -- 172.21.15.32:0/2629493014 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719128581 0 0) 0x7f5bb0072730 con 0x7f5bb014eb90 2024-01-19T04:15:15.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bafe00640 1 --2- 172.21.15.32:0/2629493014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0066fd0 tx=0x7f5ba801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5803643a2d46494a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bae000640 1 -- 172.21.15.32:0/2629493014 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80a5850 con 0x7f5bb006c670 2024-01-19T04:15:15.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bae000640 1 -- 172.21.15.32:0/2629493014 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba80a59b0 con 0x7f5bb006c670 2024-01-19T04:15:15.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bae000640 1 -- 172.21.15.32:0/2629493014 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80a5d40 con 0x7f5bb006c670 2024-01-19T04:15:15.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 -- 172.21.15.32:0/2629493014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 msgr2=0x7f5bb0071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 --2- 172.21.15.32:0/2629493014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0066fd0 tx=0x7f5ba801c880 comp rx=0 tx=0).stop 2024-01-19T04:15:15.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 -- 172.21.15.32:0/2629493014 shutdown_connections 2024-01-19T04:15:15.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 --2- 172.21.15.32:0/2629493014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071ee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 --2- 172.21.15.32:0/2629493014 >> v2:172.21.15.67:3300/0 conn(0x7f5bb01550e0 0x7f5bb00719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 -- 172.21.15.32:0/2629493014 >> 172.21.15.32:0/2629493014 conn(0x7f5bb00c25a0 msgr2=0x7f5bb00c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:15.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 -- 172.21.15.32:0/2629493014 shutdown_connections 2024-01-19T04:15:15.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.195+0000 7f5bb6400640 1 -- 172.21.15.32:0/2629493014 wait complete. 2024-01-19T04:15:15.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 Processor -- start 2024-01-19T04:15:15.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 -- start start 2024-01-19T04:15:15.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bb014eb90 0x7f5bb01e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bb01550e0 0x7f5bb00ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01ee2a0 con 0x7f5bb006c670 2024-01-19T04:15:15.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01ebac0 con 0x7f5bb01550e0 2024-01-19T04:15:15.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01ee4b0 con 0x7f5bb014eb90 2024-01-19T04:15:15.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34896/0 (socket says 172.21.15.32:34896) 2024-01-19T04:15:15.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 -- 172.21.15.32:0/1019162472 learned_addr learned my addr 172.21.15.32:0/1019162472 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:15.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bafe00640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bb01550e0 0x7f5bb00ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baea00640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bb014eb90 0x7f5bb01e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 -- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bb014eb90 msgr2=0x7f5bb01e8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bb014eb90 0x7f5bb01e8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 -- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bb01550e0 msgr2=0x7f5bb00ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bb01550e0 0x7f5bb00ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 -- 172.21.15.32:0/1019162472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8009a70 con 0x7f5bb006c670 2024-01-19T04:15:15.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bafe00640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bb01550e0 0x7f5bb00ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:15.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baea00640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bb014eb90 0x7f5bb01e8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:15.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5baf400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00011f0 tx=0x7f5ba000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5ba7400640 1 -- 172.21.15.32:0/1019162472 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00074e0 con 0x7f5bb006c670 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5ba7400640 1 -- 172.21.15.32:0/1019162472 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0007640 con 0x7f5bb006c670 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb01ee790 con 0x7f5bb006c670 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5ba7400640 1 -- 172.21.15.32:0/1019162472 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0004a10 con 0x7f5bb006c670 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb00c18e0 con 0x7f5bb006c670 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.199+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb01eecb0 con 0x7f5bb006c670 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.203+0000 7f5ba7400640 1 -- 172.21.15.32:0/1019162472 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5ba0004b70 con 0x7f5bb006c670 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.203+0000 7f5ba7400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b88066500 0x7f5b880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.203+0000 7f5ba7400640 1 -- 172.21.15.32:0/1019162472 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ba00833f0 con 0x7f5bb006c670 2024-01-19T04:15:15.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.203+0000 7f5baea00640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b88066500 0x7f5b880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.203+0000 7f5baea00640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b88066500 0x7f5b880689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0154760 tx=0x7f5b98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.207+0000 7f5ba7400640 1 -- 172.21.15.32:0/1019162472 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5bb01eecb0 con 0x7f5bb006c670 2024-01-19T04:15:15.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.367+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bb01eecb0 con 0x7f5bb006c670 2024-01-19T04:15:15.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.367+0000 7f5ba7400640 1 -- 172.21.15.32:0/1019162472 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ba0018020 con 0x7f5bb006c670 2024-01-19T04:15:15.372 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.367+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b88066500 msgr2=0x7f5b880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.367+0000 7f5bb6400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b88066500 0x7f5b880689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0154760 tx=0x7f5b98008040 comp rx=0 tx=0).stop 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 msgr2=0x7f5bb0071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00011f0 tx=0x7f5ba000c9b0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 shutdown_connections 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b88066500 0x7f5b880689c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bb01550e0 0x7f5bb00ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bb014eb90 0x7f5bb01e8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 --2- 172.21.15.32:0/1019162472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bb006c670 0x7f5bb0071240 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 >> 172.21.15.32:0/1019162472 conn(0x7f5bb00c25a0 msgr2=0x7f5bb0153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:15.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 shutdown_connections 2024-01-19T04:15:15.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.371+0000 7f5bb6400640 1 -- 172.21.15.32:0/1019162472 wait complete. 2024-01-19T04:15:15.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:15.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c3800640 1 Processor -- start 2024-01-19T04:15:15.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c3800640 1 -- start start 2024-01-19T04:15:15.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c3800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66bc151f30 0x7f66bc0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c3800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66bc06eb70 0x7f66bc06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c3800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc0c5b40 con 0x7f66bc06fda0 2024-01-19T04:15:15.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c3800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc1551e0 con 0x7f66bc151f30 2024-01-19T04:15:15.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c3800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc155710 con 0x7f66bc06eb70 2024-01-19T04:15:15.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c0e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66bc151f30 0x7f66bc0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66bbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f66bc06fda0 0x7f66bc0c4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47484/0 (socket says 172.21.15.32:47484) 2024-01-19T04:15:15.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66bbe00640 1 -- 172.21.15.32:0/2924968721 learned_addr learned my addr 172.21.15.32:0/2924968721 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:15.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c1800640 1 --2- 172.21.15.32:0/2924968721 >> v2:172.21.15.67:3300/0 conn(0x7f66bc06eb70 0x7f66bc06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66bb400640 1 -- 172.21.15.32:0/2924968721 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451768753 0 0) 0x7f66bc0c5b40 con 0x7f66bc06fda0 2024-01-19T04:15:15.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c0e00640 1 -- 172.21.15.32:0/2924968721 >> v2:172.21.15.67:3300/0 conn(0x7f66bc06eb70 msgr2=0x7f66bc06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:15.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c0e00640 1 --2- 172.21.15.32:0/2924968721 >> v2:172.21.15.67:3300/0 conn(0x7f66bc06eb70 0x7f66bc06efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c0e00640 1 -- 172.21.15.32:0/2924968721 >> v1:172.21.15.32:6789/0 conn(0x7f66bc06fda0 legacy=0x7f66bc0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.531+0000 7f66c0e00640 1 -- 172.21.15.32:0/2924968721 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc0c3fa0 con 0x7f66bc151f30 2024-01-19T04:15:15.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c0e00640 1 --2- 172.21.15.32:0/2924968721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc151f30 0x7f66bc0c4430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0a7790 tx=0x7f66ac01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce40262272187ac server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66bb400640 1 -- 172.21.15.32:0/2924968721 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac0ab600 con 0x7f66bc151f30 2024-01-19T04:15:15.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66bb400640 1 -- 172.21.15.32:0/2924968721 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac0a7050 con 0x7f66bc151f30 2024-01-19T04:15:15.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66bb400640 1 -- 172.21.15.32:0/2924968721 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac0ab980 con 0x7f66bc151f30 2024-01-19T04:15:15.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 -- 172.21.15.32:0/2924968721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc151f30 msgr2=0x7f66bc0c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 --2- 172.21.15.32:0/2924968721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc151f30 0x7f66bc0c4430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66bc0a7790 tx=0x7f66ac01c3d0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 -- 172.21.15.32:0/2924968721 shutdown_connections 2024-01-19T04:15:15.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 --2- 172.21.15.32:0/2924968721 >> v2:172.21.15.67:3300/0 conn(0x7f66bc06eb70 0x7f66bc06efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 --2- 172.21.15.32:0/2924968721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc151f30 0x7f66bc0c4430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 -- 172.21.15.32:0/2924968721 >> 172.21.15.32:0/2924968721 conn(0x7f66bc0a9870 msgr2=0x7f66bc0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:15.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 -- 172.21.15.32:0/2924968721 shutdown_connections 2024-01-19T04:15:15.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.535+0000 7f66c3800640 1 -- 172.21.15.32:0/2924968721 wait complete. 2024-01-19T04:15:15.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 Processor -- start 2024-01-19T04:15:15.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 -- start start 2024-01-19T04:15:15.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc06eb70 0x7f66bc1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc06fda0 0x7f66bc06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66bc151f30 0x7f66bc153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc14f330 con 0x7f66bc06fda0 2024-01-19T04:15:15.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc1511a0 con 0x7f66bc06eb70 2024-01-19T04:15:15.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc147010 con 0x7f66bc151f30 2024-01-19T04:15:15.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc06fda0 0x7f66bc06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc06fda0 0x7f66bc06b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34922/0 (socket says 172.21.15.32:34922) 2024-01-19T04:15:15.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 -- 172.21.15.32:0/3237373310 learned_addr learned my addr 172.21.15.32:0/3237373310 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:15.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c0e00640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc06eb70 0x7f66bc1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c1800640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66bc151f30 0x7f66bc153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 -- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66bc151f30 msgr2=0x7f66bc153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66bc151f30 0x7f66bc153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 -- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc06eb70 msgr2=0x7f66bc1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc06eb70 0x7f66bc1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 -- 172.21.15.32:0/3237373310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009420 con 0x7f66bc06fda0 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66bbe00640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc06fda0 0x7f66bc06b7b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66a400c4b0 tx=0x7f66a400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66b8c00640 1 -- 172.21.15.32:0/3237373310 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40074e0 con 0x7f66bc06fda0 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66b8c00640 1 -- 172.21.15.32:0/3237373310 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a4007660 con 0x7f66bc06fda0 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc151b30 con 0x7f66bc06fda0 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66b8c00640 1 -- 172.21.15.32:0/3237373310 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4004a30 con 0x7f66bc06fda0 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc14ed20 con 0x7f66bc06fda0 2024-01-19T04:15:15.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.539+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc0a71a0 con 0x7f66bc06fda0 2024-01-19T04:15:15.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.543+0000 7f66b8c00640 1 -- 172.21.15.32:0/3237373310 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f66a4004b90 con 0x7f66bc06fda0 2024-01-19T04:15:15.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.543+0000 7f66b8c00640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066500 0x7f66940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.543+0000 7f66b8c00640 1 -- 172.21.15.32:0/3237373310 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66a40830f0 con 0x7f66bc06fda0 2024-01-19T04:15:15.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.543+0000 7f66c0e00640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066500 0x7f66940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.543+0000 7f66c0e00640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066500 0x7f66940689c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0ad000 tx=0x7f66ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.547+0000 7f66b8c00640 1 -- 172.21.15.32:0/3237373310 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f66a40504f0 con 0x7f66bc06fda0 2024-01-19T04:15:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.739+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66bc151b30 con 0x7f66bc06fda0 2024-01-19T04:15:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.739+0000 7f66b8c00640 1 -- 172.21.15.32:0/3237373310 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f66bc151b30 con 0x7f66bc06fda0 2024-01-19T04:15:15.744 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:15.744 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066500 msgr2=0x7f66940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066500 0x7f66940689c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0ad000 tx=0x7f66ac008040 comp rx=0 tx=0).stop 2024-01-19T04:15:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc06fda0 msgr2=0x7f66bc06b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc06fda0 0x7f66bc06b7b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66a400c4b0 tx=0x7f66a400c970 comp rx=0 tx=0).stop 2024-01-19T04:15:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 shutdown_connections 2024-01-19T04:15:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066500 0x7f66940689c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f66bc151f30 0x7f66bc153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc06fda0 0x7f66bc06b7b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 --2- 172.21.15.32:0/3237373310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc06eb70 0x7f66bc1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 >> 172.21.15.32:0/3237373310 conn(0x7f66bc0a9870 msgr2=0x7f66bc0bda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 shutdown_connections 2024-01-19T04:15:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.743+0000 7f66c3800640 1 -- 172.21.15.32:0/3237373310 wait complete. 2024-01-19T04:15:15.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:15.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f6912800640 1 Processor -- start 2024-01-19T04:15:15.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f6912800640 1 -- start start 2024-01-19T04:15:15.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f6912800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c0c54b0 0x7f690c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f6912800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0c44f0 con 0x7f690c072310 2024-01-19T04:15:15.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f6912800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0c4980 con 0x7f690c155320 2024-01-19T04:15:15.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f6912800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0c3bc0 con 0x7f690c0c54b0 2024-01-19T04:15:15.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f690be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f690c072310 0x7f690c06d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47496/0 (socket says 172.21.15.32:47496) 2024-01-19T04:15:15.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.903+0000 7f690be00640 1 -- 172.21.15.32:0/1127827988 learned_addr learned my addr 172.21.15.32:0/1127827988 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:15.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690aa00640 1 --2- 172.21.15.32:0/1127827988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c0c54b0 0x7f690c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690a000640 1 -- 172.21.15.32:0/1127827988 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640080567 0 0) 0x7f690c0c44f0 con 0x7f690c072310 2024-01-19T04:15:15.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690a000640 1 -- 172.21.15.32:0/1127827988 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68ec003530 con 0x7f690c072310 2024-01-19T04:15:15.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690a000640 1 -- 172.21.15.32:0/1127827988 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407062134 0 0) 0x7f690c0c4980 con 0x7f690c155320 2024-01-19T04:15:15.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690aa00640 1 -- 172.21.15.32:0/1127827988 >> v1:172.21.15.67:6789/0 conn(0x7f690c155320 legacy=0x7f690c0a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690aa00640 1 -- 172.21.15.32:0/1127827988 >> v1:172.21.15.32:6789/0 conn(0x7f690c072310 legacy=0x7f690c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690aa00640 1 -- 172.21.15.32:0/1127827988 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0c3ea0 con 0x7f690c0c54b0 2024-01-19T04:15:15.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690aa00640 1 --2- 172.21.15.32:0/1127827988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c0c54b0 0x7f690c06cc80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097f0 tx=0x7f68f401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8153b0e735b9a7f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690a000640 1 -- 172.21.15.32:0/1127827988 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40ab620 con 0x7f690c0c54b0 2024-01-19T04:15:15.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690a000640 1 -- 172.21.15.32:0/1127827988 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f40ab780 con 0x7f690c0c54b0 2024-01-19T04:15:15.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.907+0000 7f690a000640 1 -- 172.21.15.32:0/1127827988 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40abaf0 con 0x7f690c0c54b0 2024-01-19T04:15:15.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- 172.21.15.32:0/1127827988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c0c54b0 msgr2=0x7f690c06cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 --2- 172.21.15.32:0/1127827988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c0c54b0 0x7f690c06cc80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097f0 tx=0x7f68f401c400 comp rx=0 tx=0).stop 2024-01-19T04:15:15.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- 172.21.15.32:0/1127827988 shutdown_connections 2024-01-19T04:15:15.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 --2- 172.21.15.32:0/1127827988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c0c54b0 0x7f690c06cc80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- 172.21.15.32:0/1127827988 >> 172.21.15.32:0/1127827988 conn(0x7f690c0c5b20 msgr2=0x7f690c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:15.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- 172.21.15.32:0/1127827988 shutdown_connections 2024-01-19T04:15:15.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- 172.21.15.32:0/1127827988 wait complete. 2024-01-19T04:15:15.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 Processor -- start 2024-01-19T04:15:15.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- start start 2024-01-19T04:15:15.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c072310 0x7f690c158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f690c0c54b0 0x7f690c1ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f690c155320 0x7f690c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1ecd00 con 0x7f690c0c54b0 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1ecf10 con 0x7f690c155320 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f6912800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c150c20 con 0x7f690c072310 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f690aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f690c0c54b0 0x7f690c1ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f690aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f690c0c54b0 0x7f690c1ed3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34938/0 (socket says 172.21.15.32:34938) 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f690aa00640 1 -- 172.21.15.32:0/972526987 learned_addr learned my addr 172.21.15.32:0/972526987 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f690b400640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c072310 0x7f690c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.911+0000 7f690be00640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f690c155320 0x7f690c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f690aa00640 1 -- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c072310 msgr2=0x7f690c158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f690aa00640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c072310 0x7f690c158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f690aa00640 1 -- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f690c155320 msgr2=0x7f690c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f690aa00640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f690c155320 0x7f690c14ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f690aa00640 1 -- 172.21.15.32:0/972526987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009420 con 0x7f690c0c54b0 2024-01-19T04:15:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f690be00640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f690c155320 0x7f690c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f690aa00640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f690c0c54b0 0x7f690c1ed3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68f40ad040 tx=0x7f68f40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6903400640 1 -- 172.21.15.32:0/972526987 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4004450 con 0x7f690c0c54b0 2024-01-19T04:15:15.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6903400640 1 -- 172.21.15.32:0/972526987 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f40ab8f0 con 0x7f690c0c54b0 2024-01-19T04:15:15.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6903400640 1 -- 172.21.15.32:0/972526987 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40abc80 con 0x7f690c0c54b0 2024-01-19T04:15:15.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c150660 con 0x7f690c0c54b0 2024-01-19T04:15:15.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c158560 con 0x7f690c0c54b0 2024-01-19T04:15:15.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c0749f0 con 0x7f690c0c54b0 2024-01-19T04:15:15.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6903400640 1 -- 172.21.15.32:0/972526987 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f68f4003620 con 0x7f690c0c54b0 2024-01-19T04:15:15.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6903400640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f68e4066500 0x7f68e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:15.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.915+0000 7f6903400640 1 -- 172.21.15.32:0/972526987 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68f411e3a0 con 0x7f690c0c54b0 2024-01-19T04:15:15.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.919+0000 7f690b400640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f68e4066500 0x7f68e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:15.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.919+0000 7f690b400640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f68e4066500 0x7f68e40689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007fd0 tx=0x7f68fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:15.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:15.919+0000 7f6903400640 1 -- 172.21.15.32:0/972526987 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f68f40eb5a0 con 0x7f690c0c54b0 2024-01-19T04:15:16.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.079+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f690c0bfb80 con 0x7f690c0c54b0 2024-01-19T04:15:16.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6903400640 1 -- 172.21.15.32:0/972526987 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f68f40eebc0 con 0x7f690c0c54b0 2024-01-19T04:15:16.086 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:16.086 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f68e4066500 msgr2=0x7f68e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f68e4066500 0x7f68e40689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007fd0 tx=0x7f68fc009040 comp rx=0 tx=0).stop 2024-01-19T04:15:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f690c0c54b0 msgr2=0x7f690c1ed3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f690c0c54b0 0x7f690c1ed3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68f40ad040 tx=0x7f68f40191a0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 shutdown_connections 2024-01-19T04:15:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f68e4066500 0x7f68e40689c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f690c155320 0x7f690c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f690c0c54b0 0x7f690c1ed3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 --2- 172.21.15.32:0/972526987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f690c072310 0x7f690c158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 >> 172.21.15.32:0/972526987 conn(0x7f690c0c5b20 msgr2=0x7f690c1531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 shutdown_connections 2024-01-19T04:15:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.083+0000 7f6912800640 1 -- 172.21.15.32:0/972526987 wait complete. 2024-01-19T04:15:16.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:16.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f3560800640 1 Processor -- start 2024-01-19T04:15:16.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f3560800640 1 -- start start 2024-01-19T04:15:16.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f3560800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35580c04a0 0x7f35580c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:16.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f3560800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35580a4ec0 0x7f35580c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f3560800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558071e80 con 0x7f355814fb50 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f3560800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35581535c0 con 0x7f35580a4ec0 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f3560800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580726c0 con 0x7f35580c04a0 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35580a4ec0 0x7f35580c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35580a4ec0 0x7f35580c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34950/0 (socket says 172.21.15.32:34950) 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355e800640 1 -- 172.21.15.32:0/2821360902 learned_addr learned my addr 172.21.15.32:0/2821360902 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355d400640 1 --2- 172.21.15.32:0/2821360902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35580c04a0 0x7f35580c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355e800640 1 -- 172.21.15.32:0/2821360902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35580c04a0 msgr2=0x7f35580c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:16.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355e800640 1 --2- 172.21.15.32:0/2821360902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35580c04a0 0x7f35580c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355e800640 1 -- 172.21.15.32:0/2821360902 >> v1:172.21.15.67:6789/0 conn(0x7f355814fb50 legacy=0x7f355806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:16.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.247+0000 7f355e800640 1 -- 172.21.15.32:0/2821360902 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580c1cb0 con 0x7f35580a4ec0 2024-01-19T04:15:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f355e800640 1 --2- 172.21.15.32:0/2821360902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580a4ec0 0x7f35580c1770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3550009e80 tx=0x7f355001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135ffad9371c24e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f355ca00640 1 -- 172.21.15.32:0/2821360902 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500a5620 con 0x7f35580a4ec0 2024-01-19T04:15:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f355ca00640 1 -- 172.21.15.32:0/2821360902 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35500a5780 con 0x7f35580a4ec0 2024-01-19T04:15:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f355ca00640 1 -- 172.21.15.32:0/2821360902 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500a5b10 con 0x7f35580a4ec0 2024-01-19T04:15:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 -- 172.21.15.32:0/2821360902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580a4ec0 msgr2=0x7f35580c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 --2- 172.21.15.32:0/2821360902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580a4ec0 0x7f35580c1770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3550009e80 tx=0x7f355001c960 comp rx=0 tx=0).stop 2024-01-19T04:15:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 -- 172.21.15.32:0/2821360902 shutdown_connections 2024-01-19T04:15:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 --2- 172.21.15.32:0/2821360902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580a4ec0 0x7f35580c1770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 --2- 172.21.15.32:0/2821360902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f35580c04a0 0x7f35580c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 -- 172.21.15.32:0/2821360902 >> 172.21.15.32:0/2821360902 conn(0x7f35580c5b20 msgr2=0x7f35580c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:16.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 -- 172.21.15.32:0/2821360902 shutdown_connections 2024-01-19T04:15:16.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.251+0000 7f3560800640 1 -- 172.21.15.32:0/2821360902 wait complete. 2024-01-19T04:15:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 Processor -- start 2024-01-19T04:15:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 -- start start 2024-01-19T04:15:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35580a4ec0 0x7f35581ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580c04a0 0x7f35580bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f355814fb50 0x7f3558149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355806beb0 con 0x7f35580c04a0 2024-01-19T04:15:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355815c130 con 0x7f35580a4ec0 2024-01-19T04:15:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355815c3f0 con 0x7f355814fb50 2024-01-19T04:15:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580c04a0 0x7f35580bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580c04a0 0x7f35580bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34956/0 (socket says 172.21.15.32:34956) 2024-01-19T04:15:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 -- 172.21.15.32:0/787482782 learned_addr learned my addr 172.21.15.32:0/787482782 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355de00640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35580a4ec0 0x7f35581ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355e800640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f355814fb50 0x7f3558149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 -- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f355814fb50 msgr2=0x7f3558149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f355814fb50 0x7f3558149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 -- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35580a4ec0 msgr2=0x7f35581ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35580a4ec0 0x7f35581ed8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 -- 172.21.15.32:0/787482782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009b30 con 0x7f35580c04a0 2024-01-19T04:15:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355de00640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35580a4ec0 0x7f35581ed8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f355d400640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580c04a0 0x7f35580bf130 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f354000d800 tx=0x7f354000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3556000640 1 -- 172.21.15.32:0/787482782 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000b6c0 con 0x7f35580c04a0 2024-01-19T04:15:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3556000640 1 -- 172.21.15.32:0/787482782 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354000b860 con 0x7f35580c04a0 2024-01-19T04:15:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3556000640 1 -- 172.21.15.32:0/787482782 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000bc10 con 0x7f35580c04a0 2024-01-19T04:15:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355815c6d0 con 0x7f35580c04a0 2024-01-19T04:15:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35580c2720 con 0x7f35580c04a0 2024-01-19T04:15:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.255+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355815c8c0 con 0x7f35580c04a0 2024-01-19T04:15:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.259+0000 7f3556000640 1 -- 172.21.15.32:0/787482782 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f354001e460 con 0x7f35580c04a0 2024-01-19T04:15:16.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.259+0000 7f3556000640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3530066500 0x7f35300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:16.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.259+0000 7f3556000640 1 -- 172.21.15.32:0/787482782 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3540084480 con 0x7f35580c04a0 2024-01-19T04:15:16.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.259+0000 7f355de00640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3530066500 0x7f35300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:16.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.259+0000 7f355de00640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3530066500 0x7f35300689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3548001710 tx=0x7f3548009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:16.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.263+0000 7f3556000640 1 -- 172.21.15.32:0/787482782 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3540051680 con 0x7f35580c04a0 2024-01-19T04:15:16.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.455+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35580749f0 con 0x7f35580c04a0 2024-01-19T04:15:16.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.455+0000 7f3556000640 1 -- 172.21.15.32:0/787482782 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f3540054ca0 con 0x7f35580c04a0 2024-01-19T04:15:16.460 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:16.460 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:16.460 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.455+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3530066500 msgr2=0x7f35300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.455+0000 7f3560800640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3530066500 0x7f35300689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3548001710 tx=0x7f3548009040 comp rx=0 tx=0).stop 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.455+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580c04a0 msgr2=0x7f35580bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.455+0000 7f3560800640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580c04a0 0x7f35580bf130 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f354000d800 tx=0x7f354000dcc0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 shutdown_connections 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3530066500 0x7f35300689c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f355814fb50 0x7f3558149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35580c04a0 0x7f35580bf130 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 --2- 172.21.15.32:0/787482782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35580a4ec0 0x7f35581ed8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:16.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 >> 172.21.15.32:0/787482782 conn(0x7f35580c5b20 msgr2=0x7f3558150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:16.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 shutdown_connections 2024-01-19T04:15:16.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:16.459+0000 7f3560800640 1 -- 172.21.15.32:0/787482782 wait complete. 2024-01-19T04:15:16.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T04:15:02.043532+0000', 'modified': '2024-01-19T04:15:05.050467+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.32:6834/3007887666', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6832', 'nonce': 3007887666}, {'type': 'v1', 'addr': '172.21.15.32:6834', 'nonce': 3007887666}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-19T04:15:16.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-19T04:15:16.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-19T04:15:17.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb64600640 1 Processor -- start 2024-01-19T04:15:17.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb64600640 1 -- start start 2024-01-19T04:15:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb64600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdb5c14fcd0 0x7fdb5c1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb64600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb5c0c4130 0x7fdb5c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb64600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5c1530e0 con 0x7fdb5c14f8f0 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb64600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5c0c3130 con 0x7fdb5c14fcd0 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb64600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5c1527b0 con 0x7fdb5c0c4130 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb61200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdb5c14fcd0 0x7fdb5c1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb61200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdb5c14fcd0 0x7fdb5c1560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34970/0 (socket says 172.21.15.32:34970) 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb61200640 1 -- 172.21.15.32:0/844958310 learned_addr learned my addr 172.21.15.32:0/844958310 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb62600640 1 --2- 172.21.15.32:0/844958310 >> v2:172.21.15.67:3300/0 conn(0x7fdb5c0c4130 0x7fdb5c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb61200640 1 -- 172.21.15.32:0/844958310 >> v2:172.21.15.67:3300/0 conn(0x7fdb5c0c4130 msgr2=0x7fdb5c0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb61200640 1 --2- 172.21.15.32:0/844958310 >> v2:172.21.15.67:3300/0 conn(0x7fdb5c0c4130 0x7fdb5c0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb61200640 1 -- 172.21.15.32:0/844958310 >> v1:172.21.15.67:6789/0 conn(0x7fdb5c14f8f0 legacy=0x7fdb5c1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.023+0000 7fdb61200640 1 -- 172.21.15.32:0/844958310 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c152a90 con 0x7fdb5c14fcd0 2024-01-19T04:15:17.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb61200640 1 --2- 172.21.15.32:0/844958310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c14fcd0 0x7fdb5c1560b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0bb240 tx=0x7fdb4401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eda0e1f2042a551 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb5be00640 1 -- 172.21.15.32:0/844958310 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440ab620 con 0x7fdb5c14fcd0 2024-01-19T04:15:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb5be00640 1 -- 172.21.15.32:0/844958310 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb440ab780 con 0x7fdb5c14fcd0 2024-01-19T04:15:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb5be00640 1 -- 172.21.15.32:0/844958310 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440abb10 con 0x7fdb5c14fcd0 2024-01-19T04:15:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 -- 172.21.15.32:0/844958310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c14fcd0 msgr2=0x7fdb5c1560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 --2- 172.21.15.32:0/844958310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c14fcd0 0x7fdb5c1560b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0bb240 tx=0x7fdb4401c400 comp rx=0 tx=0).stop 2024-01-19T04:15:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 -- 172.21.15.32:0/844958310 shutdown_connections 2024-01-19T04:15:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 --2- 172.21.15.32:0/844958310 >> v2:172.21.15.67:3300/0 conn(0x7fdb5c0c4130 0x7fdb5c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 --2- 172.21.15.32:0/844958310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c14fcd0 0x7fdb5c1560b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 -- 172.21.15.32:0/844958310 >> 172.21.15.32:0/844958310 conn(0x7fdb5c06ddb0 msgr2=0x7fdb5c06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 -- 172.21.15.32:0/844958310 shutdown_connections 2024-01-19T04:15:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.027+0000 7fdb64600640 1 -- 172.21.15.32:0/844958310 wait complete. 2024-01-19T04:15:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 Processor -- start 2024-01-19T04:15:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 -- start start 2024-01-19T04:15:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c0c4130 0x7fdb5c14ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb5c14f8f0 0x7fdb5c06bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5c14d290 0x7fdb5c06c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c06cc10 con 0x7fdb5c0c4130 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c06cef0 con 0x7fdb5c14d290 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c06b850 con 0x7fdb5c14f8f0 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c0c4130 0x7fdb5c14ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c0c4130 0x7fdb5c14ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34978/0 (socket says 172.21.15.32:34978) 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 -- 172.21.15.32:0/4167717373 learned_addr learned my addr 172.21.15.32:0/4167717373 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb62600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5c14d290 0x7fdb5c06c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61200640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb5c14f8f0 0x7fdb5c06bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 -- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb5c14f8f0 msgr2=0x7fdb5c06bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb5c14f8f0 0x7fdb5c06bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 -- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5c14d290 msgr2=0x7fdb5c06c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5c14d290 0x7fdb5c06c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 -- 172.21.15.32:0/4167717373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440094d0 con 0x7fdb5c0c4130 2024-01-19T04:15:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb61c00640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c0c4130 0x7fdb5c14ec20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00c450 tx=0x7fdb4c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb59600640 1 -- 172.21.15.32:0/4167717373 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c012830 con 0x7fdb5c0c4130 2024-01-19T04:15:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb59600640 1 -- 172.21.15.32:0/4167717373 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c0129b0 con 0x7fdb5c0c4130 2024-01-19T04:15:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb59600640 1 -- 172.21.15.32:0/4167717373 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c012d60 con 0x7fdb5c0c4130 2024-01-19T04:15:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c14f160 con 0x7fdb5c0c4130 2024-01-19T04:15:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.031+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c14c360 con 0x7fdb5c0c4130 2024-01-19T04:15:17.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb59600640 1 -- 172.21.15.32:0/4167717373 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdb4c01c460 con 0x7fdb5c0c4130 2024-01-19T04:15:17.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb59600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdb34066500 0x7fdb340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb59600640 1 -- 172.21.15.32:0/4167717373 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb4c083d10 con 0x7fdb5c0c4130 2024-01-19T04:15:17.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb61200640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdb34066500 0x7fdb340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 Processor -- start 2024-01-19T04:15:17.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 -- start start 2024-01-19T04:15:17.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb61200640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdb34066500 0x7fdb340689c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb440af000 tx=0x7fdb440b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059db4e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db4ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4f2c0 0x56059db98810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059d9acd70 con 0x56059db4e080 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059d9a8ba0 con 0x56059db4f2c0 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.035+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56059d9a60d0 con 0x56059db4e9a0 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059db4e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059db4e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34986/0 (socket says 172.21.15.32:34986) 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 -- 172.21.15.32:0/2554776265 learned_addr learned my addr 172.21.15.32:0/2554776265 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61200640 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db4ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb62600640 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4f2c0 0x56059db98810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 -- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 msgr2=0x56059db4ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db4ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 -- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4f2c0 msgr2=0x56059db98810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4f2c0 0x56059db98810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 -- 172.21.15.32:0/2554776265 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56059d698890 con 0x56059db4e080 2024-01-19T04:15:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb61c00640 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059db4e460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c054b90 tx=0x7fdb4c054d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a375b896fd7f5582 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb52000640 1 -- 172.21.15.32:0/2554776265 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c06c170 con 0x56059db4e080 2024-01-19T04:15:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb52000640 1 -- 172.21.15.32:0/2554776265 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c06c2f0 con 0x56059db4e080 2024-01-19T04:15:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb52000640 1 -- 172.21.15.32:0/2554776265 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c05c9c0 con 0x56059db4e080 2024-01-19T04:15:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 -- 172.21.15.32:0/2554776265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 msgr2=0x56059db4e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059db4e460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c054b90 tx=0x7fdb4c054d80 comp rx=0 tx=0).stop 2024-01-19T04:15:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 -- 172.21.15.32:0/2554776265 shutdown_connections 2024-01-19T04:15:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4f2c0 0x56059db98810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db4ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2554776265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059db4e460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 -- 172.21.15.32:0/2554776265 >> 172.21.15.32:0/2554776265 conn(0x56059db56d20 msgr2=0x56059db8e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 -- 172.21.15.32:0/2554776265 shutdown_connections 2024-01-19T04:15:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 -- 172.21.15.32:0/2554776265 wait complete. 2024-01-19T04:15:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 -- start start 2024-01-19T04:15:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.039+0000 7fdb67a46000 1 Processor -- start 2024-01-19T04:15:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059db538e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db53e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4f2c0 0x56059db54360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059d9a19c0 con 0x56059db4f2c0 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059d959040 con 0x56059db4e080 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56059d95eee0 con 0x56059db4e9a0 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 10 client.0 _ll_register_callbacks cb 0x56059d95c1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4f2c0 0x56059db54360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb61c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059db538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4f2c0 0x56059db54360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34996/0 (socket says 172.21.15.32:34996) 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 -- 172.21.15.32:0/2830204475 learned_addr learned my addr 172.21.15.32:0/2830204475 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb61200640 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db53e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 -- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 msgr2=0x56059db53e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db53e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 -- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 msgr2=0x56059db538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059db538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 -- 172.21.15.32:0/2830204475 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c14c360 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb61c00640 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059db538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb62600640 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4f2c0 0x56059db54360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdb54004660 tx=0x7fdb54007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435f36b4b2857961 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 1 -- 172.21.15.32:0/2830204475 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54004750 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 1 -- 172.21.15.32:0/2830204475 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb54017470 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56059d927e30 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 1 -- 172.21.15.32:0/2830204475 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb540048b0 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 10 client.4665 fetch_fsmap learned FSMap version 8 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56059d9615e0 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 1 -- 172.21.15.32:0/2830204475 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56059d927e30 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 1 -- 172.21.15.32:0/2830204475 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb54017630 con 0x56059db4f2c0 2024-01-19T04:15:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 10 client.4665 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 20 client.4665 populate_metadata read hostname 'smithi032' 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059dba1040 0x56059dba3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 4 client.4665 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 --> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56059d95e870 con 0x56059dba1040 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb61c00640 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059dba1040 0x56059dba3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb61c00640 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059dba1040 0x56059dba3430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e98b861fe7fd35d server_cookie=f2c2833eb566f85c in_seq=0 out_seq=0 2024-01-19T04:15:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 10 client.4665 ms_handle_connect on v2:172.21.15.32:6832/3007887666 2024-01-19T04:15:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 1 -- 172.21.15.32:0/2830204475 <== mds.0 v2:172.21.15.32:6832/3007887666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56059d95e870 con 0x56059dba1040 2024-01-19T04:15:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb4aa00640 10 client.4665 handle_command_reply: tid=0 2024-01-19T04:15:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.043+0000 7fdb67a46000 1 client.4665 shutdown 2024-01-19T04:15:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4f2c0 msgr2=0x56059db54360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4f2c0 0x56059db54360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdb54004660 tx=0x7fdb54007700 comp rx=0 tx=0).stop 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 shutdown_connections 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059dba1040 0x56059dba3430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4f2c0 0x56059db54360 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059db53e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb4aa00640 0 client.4665 ms_handle_reset on v2:172.21.15.32:6832/3007887666 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 --2- 172.21.15.32:0/2830204475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059db538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 >> 172.21.15.32:0/2830204475 conn(0x56059db56d20 msgr2=0x56059db4d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 shutdown_connections 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 1 -- 172.21.15.32:0/2830204475 wait complete. 2024-01-19T04:15:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.047+0000 7fdb67a46000 20 client.4665 trim_cache size 0 max 16384 2024-01-19T04:15:17.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 Processor -- start 2024-01-19T04:15:17.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- start start 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db56d20 0x56059dba3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059dba3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059dba3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059d659940 con 0x56059db4e080 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059d96ae30 con 0x56059db56d20 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56059d9a0850 con 0x56059db4e9a0 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059dba3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059dba3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35006/0 (socket says 172.21.15.32:35006) 2024-01-19T04:15:17.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 -- 172.21.15.32:0/1977752141 learned_addr learned my addr 172.21.15.32:0/1977752141 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 -- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 msgr2=0x56059dba3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059dba3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61c00640 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db56d20 0x56059dba3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 -- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db56d20 msgr2=0x56059dba3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db56d20 0x56059dba3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 -- 172.21.15.32:0/1977752141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56059d9478e0 con 0x56059db4e080 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61c00640 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db56d20 0x56059dba3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb61200640 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059dba3970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb440090b0 tx=0x7fdb44009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea21b165eb883bc8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb51600640 1 -- 172.21.15.32:0/1977752141 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440c5070 con 0x56059db4e080 2024-01-19T04:15:17.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb51600640 1 -- 172.21.15.32:0/1977752141 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb440c6040 con 0x56059db4e080 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb51600640 1 -- 172.21.15.32:0/1977752141 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440bfcf0 con 0x56059db4e080 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- 172.21.15.32:0/1977752141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 msgr2=0x56059dba3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059dba3970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb440090b0 tx=0x7fdb44009040 comp rx=0 tx=0).stop 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- 172.21.15.32:0/1977752141 shutdown_connections 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db4e9a0 0x56059dba3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e080 0x56059dba3970 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 --2- 172.21.15.32:0/1977752141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db56d20 0x56059dba3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- 172.21.15.32:0/1977752141 >> 172.21.15.32:0/1977752141 conn(0x56059db9de00 msgr2=0x56059db4c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- 172.21.15.32:0/1977752141 shutdown_connections 2024-01-19T04:15:17.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.063+0000 7fdb67a46000 1 -- 172.21.15.32:0/1977752141 wait complete. 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 -- start start 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 Processor -- start 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059dbf01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e9a0 0x56059dbf0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db56d20 0x56059dbf1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059d99d330 con 0x56059db4e9a0 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059db535b0 con 0x56059db4e080 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x56059d94da00 con 0x56059db56d20 2024-01-19T04:15:17.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 10 client.0 _ll_register_callbacks cb 0x56059d9620a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e9a0 0x56059dbf0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e9a0 0x56059dbf0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35010/0 (socket says 172.21.15.32:35010) 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 -- 172.21.15.32:0/977976557 learned_addr learned my addr 172.21.15.32:0/977976557 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb62600640 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db56d20 0x56059dbf1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61c00640 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059dbf01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 -- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db56d20 msgr2=0x56059dbf1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db56d20 0x56059dbf1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 -- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 msgr2=0x56059dbf01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059dbf01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 -- 172.21.15.32:0/977976557 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c152a90 con 0x56059db4e9a0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61200640 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e9a0 0x56059dbf0e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb44006db0 tx=0x7fdb440046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc5e5eb7fdcaad3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb4aa00640 1 -- 172.21.15.32:0/977976557 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440c5030 con 0x56059db4e9a0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56059d9534f0 con 0x56059db4e9a0 2024-01-19T04:15:17.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb4aa00640 1 -- 172.21.15.32:0/977976557 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb440d3460 con 0x56059db4e9a0 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb4aa00640 1 -- 172.21.15.32:0/977976557 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb440d3660 con 0x56059db4e9a0 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 10 client.4671 fetch_fsmap learned FSMap version 8 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56059d698cc0 con 0x56059db4e9a0 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb4aa00640 1 -- 172.21.15.32:0/977976557 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb440e0020 con 0x56059db4e9a0 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb4aa00640 1 -- 172.21.15.32:0/977976557 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb5c0c8100 con 0x56059db4e9a0 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 10 client.4671 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 20 client.4671 populate_metadata read hostname 'smithi032' 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059db4f2c0 0x56059dbf1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 4 client.4671 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:15:17.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 --> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56059d9a0310 con 0x56059db4f2c0 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.067+0000 7fdb61c00640 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059db4f2c0 0x56059dbf1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb4aa00640 10 client.4671 ms_handle_connect on v2:172.21.15.32:6832/3007887666 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb61c00640 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059db4f2c0 0x56059dbf1880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e443b422a419eb server_cookie=6fb0e972509acd69 in_seq=0 out_seq=0 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb4aa00640 1 -- 172.21.15.32:0/977976557 <== mds.0 v2:172.21.15.32:6832/3007887666 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x56059d9a0310 con 0x56059db4f2c0 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb4aa00640 10 client.4671 handle_command_reply: tid=0 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 client.4671 shutdown 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e9a0 msgr2=0x56059dbf0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e9a0 0x56059dbf0e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb44006db0 tx=0x7fdb440046d0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 shutdown_connections 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:6832/3007887666,v1:172.21.15.32:6834/3007887666] conn(0x56059db4f2c0 0x56059dbf1880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x56059db56d20 0x56059dbf1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56059db4e9a0 0x56059dbf0e00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb4aa00640 0 client.4671 ms_handle_reset on v2:172.21.15.32:6832/3007887666 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 --2- 172.21.15.32:0/977976557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56059db4e080 0x56059dbf01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 >> 172.21.15.32:0/977976557 conn(0x56059db9de00 msgr2=0x56059db4c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 shutdown_connections 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 1 -- 172.21.15.32:0/977976557 wait complete. 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb67a46000 20 client.4671 trim_cache size 0 max 16384 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "d7445317-ddd8-4205-bf5b-c51cd46cffd9", 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4272, 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-01-19T04:15:17.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 14.418672033, 2024-01-19T04:15:17.079 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 8, 2024-01-19T04:15:17.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 23, 2024-01-19T04:15:17.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 23, 2024-01-19T04:15:17.079 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 21.857081811 2024-01-19T04:15:17.079 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdb34066500 msgr2=0x7fdb340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdb34066500 0x7fdb340689c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb440af000 tx=0x7fdb440b6040 comp rx=0 tx=0).stop 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c0c4130 msgr2=0x7fdb5c14ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c0c4130 0x7fdb5c14ec20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00c450 tx=0x7fdb4c00c910 comp rx=0 tx=0).stop 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 shutdown_connections 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdb34066500 0x7fdb340689c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5c14d290 0x7fdb5c06c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdb5c14f8f0 0x7fdb5c06bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 --2- 172.21.15.32:0/4167717373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb5c0c4130 0x7fdb5c14ec20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 >> 172.21.15.32:0/4167717373 conn(0x7fdb5c06ddb0 msgr2=0x7fdb5c0c3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 shutdown_connections 2024-01-19T04:15:17.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.071+0000 7fdb64600640 1 -- 172.21.15.32:0/4167717373 wait complete. 2024-01-19T04:15:17.096 INFO:teuthology.run_tasks:Running task kclient... 2024-01-19T04:15:17.119 INFO:tasks.kclient:Mounting kernel clients... 2024-01-19T04:15:17.119 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-01-19T04:15:17.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.119 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:15:17.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-01-19T04:15:17.196 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2024-01-19T04:15:17.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:15:17.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.198 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:15:17.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.209 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-01-19T04:15:17.280 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-01-19T04:15:17.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:15:17.282 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-01-19T04:15:17.282 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-19T04:15:17.283 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:15:17.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:15:17.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4488e00640 1 Processor -- start 2024-01-19T04:15:17.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4488e00640 1 -- start start 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4488e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f448414fb50 0x7f448406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4488e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44840c04a0 0x7f44840c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4488e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484071e80 con 0x7f44840a4ec0 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4488e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44841535c0 con 0x7f44840c04a0 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4488e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44840726c0 con 0x7f448414fb50 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4481400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44840c04a0 0x7f44840c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4482800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f44840a4ec0 0x7f4484155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47512/0 (socket says 172.21.15.32:47512) 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4482800640 1 -- 172.21.15.32:0/3296209663 learned_addr learned my addr 172.21.15.32:0/3296209663 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4481400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44840c04a0 0x7f44840c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35022/0 (socket says 172.21.15.32:35022) 2024-01-19T04:15:17.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4481e00640 1 --2- 172.21.15.32:0/3296209663 >> v2:172.21.15.67:3300/0 conn(0x7f448414fb50 0x7f448406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4481400640 1 -- 172.21.15.32:0/3296209663 >> v2:172.21.15.67:3300/0 conn(0x7f448414fb50 msgr2=0x7f448406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:17.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4481400640 1 --2- 172.21.15.32:0/3296209663 >> v2:172.21.15.67:3300/0 conn(0x7f448414fb50 0x7f448406fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4481400640 1 -- 172.21.15.32:0/3296209663 >> v1:172.21.15.32:6789/0 conn(0x7f44840a4ec0 legacy=0x7f4484155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.419+0000 7f4481400640 1 -- 172.21.15.32:0/3296209663 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840c0a20 con 0x7f44840c04a0 2024-01-19T04:15:17.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4481400640 1 --2- 172.21.15.32:0/3296209663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840c04a0 0x7f44840c1230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f448406f5f0 tx=0x7f446c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e150b45b6da26c8e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4480a00640 1 -- 172.21.15.32:0/3296209663 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c0ab600 con 0x7f44840c04a0 2024-01-19T04:15:17.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4480a00640 1 -- 172.21.15.32:0/3296209663 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c0a7050 con 0x7f44840c04a0 2024-01-19T04:15:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4480a00640 1 -- 172.21.15.32:0/3296209663 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c0ab980 con 0x7f44840c04a0 2024-01-19T04:15:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4488e00640 1 -- 172.21.15.32:0/3296209663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840c04a0 msgr2=0x7f44840c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4488e00640 1 --2- 172.21.15.32:0/3296209663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840c04a0 0x7f44840c1230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f448406f5f0 tx=0x7f446c01c3d0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4488e00640 1 -- 172.21.15.32:0/3296209663 shutdown_connections 2024-01-19T04:15:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4488e00640 1 --2- 172.21.15.32:0/3296209663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840c04a0 0x7f44840c1230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4488e00640 1 --2- 172.21.15.32:0/3296209663 >> v2:172.21.15.67:3300/0 conn(0x7f448414fb50 0x7f448406fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.423+0000 7f4488e00640 1 -- 172.21.15.32:0/3296209663 >> 172.21.15.32:0/3296209663 conn(0x7f44840c5b20 msgr2=0x7f44840c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 -- 172.21.15.32:0/3296209663 shutdown_connections 2024-01-19T04:15:17.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 -- 172.21.15.32:0/3296209663 wait complete. 2024-01-19T04:15:17.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 Processor -- start 2024-01-19T04:15:17.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 -- start start 2024-01-19T04:15:17.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44840a4ec0 0x7f448414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44840c04a0 0x7f448414a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f448414fb50 0x7f44841edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4484153c80 con 0x7f448414fb50 2024-01-19T04:15:17.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44841ee240 con 0x7f44840c04a0 2024-01-19T04:15:17.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4488e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448414aea0 con 0x7f44840a4ec0 2024-01-19T04:15:17.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f448414fb50 0x7f44841edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f448414fb50 0x7f44841edd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35026/0 (socket says 172.21.15.32:35026) 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 -- 172.21.15.32:0/4061329401 learned_addr learned my addr 172.21.15.32:0/4061329401 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4481400640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44840c04a0 0x7f448414a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4481e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44840a4ec0 0x7f448414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 -- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44840a4ec0 msgr2=0x7f448414a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44840a4ec0 0x7f448414a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 -- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44840c04a0 msgr2=0x7f448414a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44840c04a0 0x7f448414a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 -- 172.21.15.32:0/4061329401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c009420 con 0x7f448414fb50 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4481e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44840a4ec0 0x7f448414a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.427+0000 7f4482800640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f448414fb50 0x7f44841edd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f447c00ca70 tx=0x7f447c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f447a000640 1 -- 172.21.15.32:0/4061329401 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00ab70 con 0x7f448414fb50 2024-01-19T04:15:17.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f447a000640 1 -- 172.21.15.32:0/4061329401 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00acd0 con 0x7f448414fb50 2024-01-19T04:15:17.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f447a000640 1 -- 172.21.15.32:0/4061329401 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c012600 con 0x7f448414fb50 2024-01-19T04:15:17.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448414b180 con 0x7f448414fb50 2024-01-19T04:15:17.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4484149810 con 0x7f448414fb50 2024-01-19T04:15:17.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44840749f0 con 0x7f448414fb50 2024-01-19T04:15:17.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f447a000640 1 -- 172.21.15.32:0/4061329401 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f447c007070 con 0x7f448414fb50 2024-01-19T04:15:17.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f447a000640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f445c066500 0x7f445c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:17.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f447a000640 1 -- 172.21.15.32:0/4061329401 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f447c083bf0 con 0x7f448414fb50 2024-01-19T04:15:17.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.431+0000 7f4481e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f445c066500 0x7f445c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:17.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.435+0000 7f4481e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f445c066500 0x7f445c0689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4474009b10 tx=0x7f4474008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:17.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.435+0000 7f447a000640 1 -- 172.21.15.32:0/4061329401 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f447c050f20 con 0x7f448414fb50 2024-01-19T04:15:17.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.631+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44840c56e0 con 0x7f448414fb50 2024-01-19T04:15:17.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.631+0000 7f447a000640 1 -- 172.21.15.32:0/4061329401 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f447c017020 con 0x7f448414fb50 2024-01-19T04:15:17.636 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:15:17.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f445c066500 msgr2=0x7f445c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f445c066500 0x7f445c0689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4474009b10 tx=0x7f4474008040 comp rx=0 tx=0).stop 2024-01-19T04:15:17.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f448414fb50 msgr2=0x7f44841edd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:17.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f448414fb50 0x7f44841edd00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f447c00ca70 tx=0x7f447c00cf30 comp rx=0 tx=0).stop 2024-01-19T04:15:17.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 shutdown_connections 2024-01-19T04:15:17.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f445c066500 0x7f445c0689c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f448414fb50 0x7f44841edd00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44840c04a0 0x7f448414a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 --2- 172.21.15.32:0/4061329401 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f44840a4ec0 0x7f448414a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:17.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 >> 172.21.15.32:0/4061329401 conn(0x7f44840c5b20 msgr2=0x7f44840a6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:17.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 shutdown_connections 2024-01-19T04:15:17.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:17.635+0000 7f4488e00640 1 -- 172.21.15.32:0/4061329401 wait complete. 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:15:17.658 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:15:17.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.659 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-01-19T04:15:17.667 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:15:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42425sec preferred_lft 42425sec 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:1f:1a:e5:73 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:15:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:17.670 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-19T04:15:17.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.670 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:15:17.671 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:15:17.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2024-01-19T04:15:17.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2024-01-19T04:15:17.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2024-01-19T04:15:17.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-19T04:15:17.671 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:15:17.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.783 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:15:17.802 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-01-19T04:15:17.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.804 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-01-19T04:15:17.868 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-01-19T04:15:17.868 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:15:17.869 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-19T04:15:17.869 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:15:17.869 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-19T04:15:17.869 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:15:17.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.869 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:15:17.870 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:15:17.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-19T04:15:17.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-19T04:15:17.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-19T04:15:17.870 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:15:17.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.959 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:15:17.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:17.968 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-01-19T04:15:18.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:18.024 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:15:18.024 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:15:18.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:15:18.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-19T04:15:18.024 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:15:18.104 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-19T04:15:18.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:18.104 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:15:18.104 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:15:18.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-19T04:15:18.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-19T04:15:18.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-19T04:15:18.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-19T04:15:18.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-19T04:15:18.105 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:15:18.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:18.278 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:15:18.278 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:15:18.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-01-19T04:15:18.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2024-01-19T04:15:18.278 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:15:18.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:15:18.318 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:15:18.370 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:15:18.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:15:18.370 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:15:18.421 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-19T04:15:18.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:18.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:15:18.529 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:15:18.529 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:15:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:15:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:15:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:15:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:15:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:15:19.085 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:15:19.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:15:19.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.140 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:15:19.182 INFO:teuthology.orchestra.run.smithi032.stdout:client4520 2024-01-19T04:15:19.183 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:15:19.183 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:19.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.234 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:15:19.295 INFO:teuthology.orchestra.run.smithi032.stdout:client4520 2024-01-19T04:15:19.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.295 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:15:19.354 INFO:teuthology.orchestra.run.smithi032.stdout:client4520 2024-01-19T04:15:19.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.355 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d7445317-ddd8-4205-bf5b-c51cd46cffd9.client4520/status') 2024-01-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4520 (3)172.21.15.32:0/2478741017 2024-01-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2024-01-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2024-01-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2024-01-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi032.stderr:70 bytes copied, 5.2439e-05 s, 1.3 MB/s 2024-01-19T04:15:19.424 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-01-19T04:15:19.424 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-19T04:15:19.424 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:15:19.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:15:19.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23f800640 1 Processor -- start 2024-01-19T04:15:19.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23f800640 1 -- start start 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23f800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb238151de0 0x7fb2380c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23f800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb238154c70 0x7fb2381550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23f800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2381547e0 con 0x7fb2380a7200 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23f800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2381521c0 con 0x7fb238151de0 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23f800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238155600 con 0x7fb238154c70 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23ce00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb238151de0 0x7fb2380c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23ce00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb238151de0 0x7fb2380c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46996/0 (socket says 172.21.15.32:46996) 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23ce00640 1 -- 172.21.15.32:0/1112278472 learned_addr learned my addr 172.21.15.32:0/1112278472 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23d800640 1 --2- 172.21.15.32:0/1112278472 >> v2:172.21.15.67:3300/0 conn(0x7fb238154c70 0x7fb2381550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23ce00640 1 -- 172.21.15.32:0/1112278472 >> v2:172.21.15.67:3300/0 conn(0x7fb238154c70 msgr2=0x7fb2381550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23ce00640 1 --2- 172.21.15.32:0/1112278472 >> v2:172.21.15.67:3300/0 conn(0x7fb238154c70 0x7fb2381550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23ce00640 1 -- 172.21.15.32:0/1112278472 >> v1:172.21.15.67:6789/0 conn(0x7fb2380a7200 legacy=0x7fb2380c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:19.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.603+0000 7fb23ce00640 1 -- 172.21.15.32:0/1112278472 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380c1db0 con 0x7fb238151de0 2024-01-19T04:15:19.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23ce00640 1 --2- 172.21.15.32:0/1112278472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238151de0 0x7fb2380c1870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2380c1360 tx=0x7fb22801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac9a620ee4e4c43 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:19.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb237400640 1 -- 172.21.15.32:0/1112278472 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228004230 con 0x7fb238151de0 2024-01-19T04:15:19.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb237400640 1 -- 172.21.15.32:0/1112278472 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2280a7050 con 0x7fb238151de0 2024-01-19T04:15:19.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb237400640 1 -- 172.21.15.32:0/1112278472 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228003620 con 0x7fb238151de0 2024-01-19T04:15:19.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 -- 172.21.15.32:0/1112278472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238151de0 msgr2=0x7fb2380c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:19.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 --2- 172.21.15.32:0/1112278472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238151de0 0x7fb2380c1870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2380c1360 tx=0x7fb22801c440 comp rx=0 tx=0).stop 2024-01-19T04:15:19.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 -- 172.21.15.32:0/1112278472 shutdown_connections 2024-01-19T04:15:19.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 --2- 172.21.15.32:0/1112278472 >> v2:172.21.15.67:3300/0 conn(0x7fb238154c70 0x7fb2381550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 --2- 172.21.15.32:0/1112278472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238151de0 0x7fb2380c1870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 -- 172.21.15.32:0/1112278472 >> 172.21.15.32:0/1112278472 conn(0x7fb2380726d0 msgr2=0x7fb2380663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:19.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 -- 172.21.15.32:0/1112278472 shutdown_connections 2024-01-19T04:15:19.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.607+0000 7fb23f800640 1 -- 172.21.15.32:0/1112278472 wait complete. 2024-01-19T04:15:19.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 Processor -- start 2024-01-19T04:15:19.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 -- start start 2024-01-19T04:15:19.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2380a7200 0x7fb238155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:19.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb238151de0 0x7fb23814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:19.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238154c70 0x7fb23814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:19.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23814e980 con 0x7fb238154c70 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb238158ae0 con 0x7fb2380a7200 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381ecda0 con 0x7fb238151de0 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238154c70 0x7fb23814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238154c70 0x7fb23814e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47008/0 (socket says 172.21.15.32:47008) 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 -- 172.21.15.32:0/4164707978 learned_addr learned my addr 172.21.15.32:0/4164707978 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23ce00640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2380a7200 0x7fb238155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb237e00640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb238151de0 0x7fb23814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 -- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb238151de0 msgr2=0x7fb23814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb238151de0 0x7fb23814df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 -- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2380a7200 msgr2=0x7fb238155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2380a7200 0x7fb238155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 -- 172.21.15.32:0/4164707978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094d0 con 0x7fb238154c70 2024-01-19T04:15:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23d800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238154c70 0x7fb23814e440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb23000efc0 tx=0x7fb23000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb234c00640 1 -- 172.21.15.32:0/4164707978 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230009b10 con 0x7fb238154c70 2024-01-19T04:15:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb234c00640 1 -- 172.21.15.32:0/4164707978 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23000f040 con 0x7fb238154c70 2024-01-19T04:15:19.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb238157600 con 0x7fb238154c70 2024-01-19T04:15:19.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb234c00640 1 -- 172.21.15.32:0/4164707978 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300146c0 con 0x7fb238154c70 2024-01-19T04:15:19.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb238157bc0 con 0x7fb238154c70 2024-01-19T04:15:19.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.611+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2381ecfc0 con 0x7fb238154c70 2024-01-19T04:15:19.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.615+0000 7fb234c00640 1 -- 172.21.15.32:0/4164707978 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb230014820 con 0x7fb238154c70 2024-01-19T04:15:19.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.615+0000 7fb234c00640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb210066500 0x7fb2100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:19.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.615+0000 7fb234c00640 1 -- 172.21.15.32:0/4164707978 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb230084b30 con 0x7fb238154c70 2024-01-19T04:15:19.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.615+0000 7fb23ce00640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb210066500 0x7fb2100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:19.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.615+0000 7fb23ce00640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb210066500 0x7fb2100689c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ad000 tx=0x7fb2280a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:19.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.619+0000 7fb234c00640 1 -- 172.21.15.32:0/4164707978 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb2381ecfc0 con 0x7fb238154c70 2024-01-19T04:15:19.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.815+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb2381ecf60 con 0x7fb238154c70 2024-01-19T04:15:19.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.815+0000 7fb234c00640 1 -- 172.21.15.32:0/4164707978 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb230018060 con 0x7fb238154c70 2024-01-19T04:15:19.821 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:15:19.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb210066500 msgr2=0x7fb2100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb210066500 0x7fb2100689c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ad000 tx=0x7fb2280a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238154c70 msgr2=0x7fb23814e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238154c70 0x7fb23814e440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb23000efc0 tx=0x7fb23000c490 comp rx=0 tx=0).stop 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 shutdown_connections 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb210066500 0x7fb2100689c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb238154c70 0x7fb23814e440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb238151de0 0x7fb23814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 --2- 172.21.15.32:0/4164707978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2380a7200 0x7fb238155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 >> 172.21.15.32:0/4164707978 conn(0x7fb2380726d0 msgr2=0x7fb238066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 shutdown_connections 2024-01-19T04:15:19.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:19.819+0000 7fb23f800640 1 -- 172.21.15.32:0/4164707978 wait complete. 2024-01-19T04:15:19.843 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-19T04:15:19.843 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:15:19.843 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:15:19.843 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-19T04:15:19.844 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:15:19.844 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-19T04:15:19.844 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-19T04:15:19.844 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:15:19.844 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:15:19.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.844 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:15:19.854 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42446sec preferred_lft 42446sec 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:15:19.855 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:15:19.856 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-19T04:15:19.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.857 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:15:19.857 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:15:19.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-01-19T04:15:19.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-01-19T04:15:19.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-01-19T04:15:19.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-19T04:15:19.857 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:15:19.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.976 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:15:19.996 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:15:19.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:19.999 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:15:20.069 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:15:20.069 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:15:20.069 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:15:20.069 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:15:20.069 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:15:20.069 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:15:20.069 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:15:20.070 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:15:20.070 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:15:20.070 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:15:20.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:20.070 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:15:20.070 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:15:20.070 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:15:20.070 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:15:20.070 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:15:20.070 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:15:20.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:20.164 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:15:20.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:20.173 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-01-19T04:15:20.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:20.225 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:15:20.225 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:15:20.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:15:20.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-19T04:15:20.225 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:15:20.308 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-19T04:15:20.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-19T04:15:20.309 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:15:20.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:20.468 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:15:20.468 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:15:20.468 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:15:20.468 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-01-19T04:15:20.468 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:15:20.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:15:20.508 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:15:20.560 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:15:20.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:15:20.560 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:15:20.612 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-19T04:15:20.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:20.612 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:15:20.713 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:15:20.714 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:15:21.258 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:15:21.259 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:15:21.259 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:15:21.259 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:15:21.259 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:15:21.263 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:15:21.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:21.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:15:21.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:21.283 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:15:21.345 INFO:teuthology.orchestra.run.smithi067.stdout:client4651 2024-01-19T04:15:21.345 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:15:21.345 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:21.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:21.396 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:15:21.451 INFO:teuthology.orchestra.run.smithi067.stdout:client4651 2024-01-19T04:15:21.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:21.452 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:15:21.503 INFO:teuthology.orchestra.run.smithi067.stdout:client4651 2024-01-19T04:15:21.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:21.504 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d7445317-ddd8-4205-bf5b-c51cd46cffd9.client4651/status') 2024-01-19T04:15:21.564 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4651 (3)192.168.0.1:0/2013106846 2024-01-19T04:15:21.564 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2024-01-19T04:15:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2024-01-19T04:15:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2024-01-19T04:15:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:69 bytes copied, 5.2995e-05 s, 1.3 MB/s 2024-01-19T04:15:21.566 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-19T04:15:21.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9664000640 1 Processor -- start 2024-01-19T04:15:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9664000640 1 -- start start 2024-01-19T04:15:21.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9664000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f965c14fb50 0x7f965c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:21.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9664000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c071e80 con 0x7f965c0a4ec0 2024-01-19T04:15:21.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9664000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c0726c0 con 0x7f965c0c04a0 2024-01-19T04:15:21.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9664000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c1535c0 con 0x7f965c14fb50 2024-01-19T04:15:21.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9662000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f965c0a4ec0 0x7f965c15cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54876/0 (socket says 172.21.15.32:54876) 2024-01-19T04:15:21.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9662000640 1 -- 172.21.15.32:0/4030703408 learned_addr learned my addr 172.21.15.32:0/4030703408 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:21.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9661600640 1 --2- 172.21.15.32:0/4030703408 >> v2:172.21.15.67:3300/0 conn(0x7f965c14fb50 0x7f965c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f965be00640 1 -- 172.21.15.32:0/4030703408 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836030815 0 0) 0x7f965c071e80 con 0x7f965c0a4ec0 2024-01-19T04:15:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f965be00640 1 -- 172.21.15.32:0/4030703408 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f963c003530 con 0x7f965c0a4ec0 2024-01-19T04:15:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9661600640 1 -- 172.21.15.32:0/4030703408 >> v1:172.21.15.67:6789/0 conn(0x7f965c0c04a0 legacy=0x7f965c0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9661600640 1 -- 172.21.15.32:0/4030703408 >> v1:172.21.15.32:6789/0 conn(0x7f965c0a4ec0 legacy=0x7f965c15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.731+0000 7f9661600640 1 -- 172.21.15.32:0/4030703408 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c0c0a20 con 0x7f965c14fb50 2024-01-19T04:15:21.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.735+0000 7f9661600640 1 --2- 172.21.15.32:0/4030703408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c06fec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f964c0097c0 tx=0x7f964c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baf372f21e341e8e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:21.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f965be00640 1 -- 172.21.15.32:0/4030703408 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0ab600 con 0x7f965c14fb50 2024-01-19T04:15:21.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f965be00640 1 -- 172.21.15.32:0/4030703408 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c0a7050 con 0x7f965c14fb50 2024-01-19T04:15:21.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f965be00640 1 -- 172.21.15.32:0/4030703408 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0ab980 con 0x7f965c14fb50 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f9664000640 1 -- 172.21.15.32:0/4030703408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 msgr2=0x7f965c06fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f9664000640 1 --2- 172.21.15.32:0/4030703408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c06fec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f964c0097c0 tx=0x7f964c01c3f0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f9664000640 1 -- 172.21.15.32:0/4030703408 shutdown_connections 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f9664000640 1 --2- 172.21.15.32:0/4030703408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c06fec0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f9664000640 1 -- 172.21.15.32:0/4030703408 >> 172.21.15.32:0/4030703408 conn(0x7f965c0c5b20 msgr2=0x7f965c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f9664000640 1 -- 172.21.15.32:0/4030703408 shutdown_connections 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.739+0000 7f9664000640 1 -- 172.21.15.32:0/4030703408 wait complete. 2024-01-19T04:15:21.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 Processor -- start 2024-01-19T04:15:21.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 -- start start 2024-01-19T04:15:21.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f965c0a4ec0 0x7f965c1ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:21.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f965c0c04a0 0x7f965c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:21.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c14b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:21.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c1ee5c0 con 0x7f965c0a4ec0 2024-01-19T04:15:21.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c14c880 con 0x7f965c14fb50 2024-01-19T04:15:21.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0ab1c0 con 0x7f965c0c04a0 2024-01-19T04:15:21.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f965c0a4ec0 0x7f965c1ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:21.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f965c0a4ec0 0x7f965c1ee080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47024/0 (socket says 172.21.15.32:47024) 2024-01-19T04:15:21.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 -- 172.21.15.32:0/1109104487 learned_addr learned my addr 172.21.15.32:0/1109104487 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:21.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9660c00640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f965c0c04a0 0x7f965c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:21.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9662000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c14b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:21.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 -- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f965c0c04a0 msgr2=0x7f965c15da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:21.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f965c0c04a0 0x7f965c15da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 -- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 msgr2=0x7f965c14b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:21.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c14b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 -- 172.21.15.32:0/1109104487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c009420 con 0x7f965c0a4ec0 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9660c00640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f965c0c04a0 0x7f965c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9662000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c14b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9661600640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f965c0a4ec0 0x7f965c1ee080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f964c0ae040 tx=0x7f964c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9659600640 1 -- 172.21.15.32:0/1109104487 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b7450 con 0x7f965c0a4ec0 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9659600640 1 -- 172.21.15.32:0/1109104487 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c0b75b0 con 0x7f965c0a4ec0 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9659600640 1 -- 172.21.15.32:0/1109104487 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b7960 con 0x7f965c0a4ec0 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c0ab4a0 con 0x7f965c0a4ec0 2024-01-19T04:15:21.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.743+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c14c510 con 0x7f965c0a4ec0 2024-01-19T04:15:21.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.747+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c0749f0 con 0x7f965c0a4ec0 2024-01-19T04:15:21.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.747+0000 7f9659600640 1 -- 172.21.15.32:0/1109104487 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f964c0b7ac0 con 0x7f965c0a4ec0 2024-01-19T04:15:21.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.747+0000 7f9659600640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9634066500 0x7f96340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:21.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.747+0000 7f9659600640 1 -- 172.21.15.32:0/1109104487 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f964c11e7a0 con 0x7f965c0a4ec0 2024-01-19T04:15:21.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.747+0000 7f9660c00640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9634066500 0x7f96340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:21.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.747+0000 7f9660c00640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9634066500 0x7f96340689c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f965c153bd0 tx=0x7f9644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:21.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.751+0000 7f9659600640 1 -- 172.21.15.32:0/1109104487 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f964c0ebb50 con 0x7f965c0a4ec0 2024-01-19T04:15:21.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.911+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f965c0c0190 con 0x7f965c0a4ec0 2024-01-19T04:15:21.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9659600640 1 -- 172.21.15.32:0/1109104487 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f964c0bb090 con 0x7f965c0a4ec0 2024-01-19T04:15:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:21.918 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:21.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9634066500 msgr2=0x7f96340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:21.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9634066500 0x7f96340689c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f965c153bd0 tx=0x7f9644009040 comp rx=0 tx=0).stop 2024-01-19T04:15:21.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f965c0a4ec0 msgr2=0x7f965c1ee080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:21.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f965c0a4ec0 0x7f965c1ee080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f964c0ae040 tx=0x7f964c01ac30 comp rx=0 tx=0).stop 2024-01-19T04:15:21.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 shutdown_connections 2024-01-19T04:15:21.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9634066500 0x7f96340689c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f965c14fb50 0x7f965c14b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f965c0c04a0 0x7f965c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 --2- 172.21.15.32:0/1109104487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f965c0a4ec0 0x7f965c1ee080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 >> 172.21.15.32:0/1109104487 conn(0x7f965c0c5b20 msgr2=0x7f965c06d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 shutdown_connections 2024-01-19T04:15:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:21.915+0000 7f9664000640 1 -- 172.21.15.32:0/1109104487 wait complete. 2024-01-19T04:15:21.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:21.941 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:22.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.079+0000 7fed14c00640 1 Processor -- start 2024-01-19T04:15:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.079+0000 7fed14c00640 1 -- start start 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed14c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed100c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed14c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fed101546e0 0x7fed10154b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed14c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed10157c50 con 0x7fed100c3c20 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed14c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed10155080 con 0x7fed101546e0 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed14c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed100c44c0 con 0x7fed10151e80 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fed101546e0 0x7fed10154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fed101546e0 0x7fed10154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47026/0 (socket says 172.21.15.32:47026) 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0e800640 1 -- 172.21.15.32:0/857660594 learned_addr learned my addr 172.21.15.32:0/857660594 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0de00640 1 --2- 172.21.15.32:0/857660594 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed100c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0e800640 1 -- 172.21.15.32:0/857660594 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 msgr2=0x7fed100c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0e800640 1 --2- 172.21.15.32:0/857660594 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed100c1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0e800640 1 -- 172.21.15.32:0/857660594 >> v1:172.21.15.67:6789/0 conn(0x7fed100c3c20 legacy=0x7fed1006f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0e800640 1 -- 172.21.15.32:0/857660594 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10157ea0 con 0x7fed101546e0 2024-01-19T04:15:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.083+0000 7fed0de00640 1 --2- 172.21.15.32:0/857660594 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed100c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed0e800640 1 --2- 172.21.15.32:0/857660594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed10154b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed08009e50 tx=0x7fed0801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6955a15b46c3d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed0ca00640 1 -- 172.21.15.32:0/857660594 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080a5730 con 0x7fed101546e0 2024-01-19T04:15:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed0ca00640 1 -- 172.21.15.32:0/857660594 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080a5890 con 0x7fed101546e0 2024-01-19T04:15:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed0ca00640 1 -- 172.21.15.32:0/857660594 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080a5c20 con 0x7fed101546e0 2024-01-19T04:15:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 -- 172.21.15.32:0/857660594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 msgr2=0x7fed10154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 --2- 172.21.15.32:0/857660594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed10154b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed08009e50 tx=0x7fed0801c980 comp rx=0 tx=0).stop 2024-01-19T04:15:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 -- 172.21.15.32:0/857660594 shutdown_connections 2024-01-19T04:15:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 --2- 172.21.15.32:0/857660594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed10154b40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 --2- 172.21.15.32:0/857660594 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed100c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 -- 172.21.15.32:0/857660594 >> 172.21.15.32:0/857660594 conn(0x7fed100726d0 msgr2=0x7fed100663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 -- 172.21.15.32:0/857660594 shutdown_connections 2024-01-19T04:15:22.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 -- 172.21.15.32:0/857660594 wait complete. 2024-01-19T04:15:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 Processor -- start 2024-01-19T04:15:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.087+0000 7fed14c00640 1 -- start start 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed100c3c20 0x7fed1015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed1015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed1015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015d000 con 0x7fed101546e0 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015bf40 con 0x7fed100c3c20 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed101ed730 con 0x7fed10151e80 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed1015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed1015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47040/0 (socket says 172.21.15.32:47040) 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 -- 172.21.15.32:0/1375429774 learned_addr learned my addr 172.21.15.32:0/1375429774 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0d400640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed1015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0de00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed100c3c20 0x7fed1015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 -- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 msgr2=0x7fed1015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed1015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 -- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed100c3c20 msgr2=0x7fed1015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed100c3c20 0x7fed1015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 -- 172.21.15.32:0/1375429774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08009b30 con 0x7fed101546e0 2024-01-19T04:15:22.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed0e800640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed1015ba00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed0801a5b0 tx=0x7fed08019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed06000640 1 -- 172.21.15.32:0/1375429774 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080b8640 con 0x7fed101546e0 2024-01-19T04:15:22.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed06000640 1 -- 172.21.15.32:0/1375429774 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080b87c0 con 0x7fed101546e0 2024-01-19T04:15:22.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed06000640 1 -- 172.21.15.32:0/1375429774 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080b8b70 con 0x7fed101546e0 2024-01-19T04:15:22.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed10158b00 con 0x7fed101546e0 2024-01-19T04:15:22.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed10158ff0 con 0x7fed101546e0 2024-01-19T04:15:22.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed100749f0 con 0x7fed101546e0 2024-01-19T04:15:22.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.091+0000 7fed06000640 1 -- 172.21.15.32:0/1375429774 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fed080b8cd0 con 0x7fed101546e0 2024-01-19T04:15:22.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.095+0000 7fed06000640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fece8066500 0x7fece80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.095+0000 7fed06000640 1 -- 172.21.15.32:0/1375429774 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed0811f4e0 con 0x7fed101546e0 2024-01-19T04:15:22.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.095+0000 7fed0de00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fece8066500 0x7fece80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.095+0000 7fed0de00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fece8066500 0x7fece80689c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed10151b80 tx=0x7fed00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.099+0000 7fed06000640 1 -- 172.21.15.32:0/1375429774 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fed080ec940 con 0x7fed101546e0 2024-01-19T04:15:22.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:15:22.215 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:15:22.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.263+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed100c16f0 con 0x7fed101546e0 2024-01-19T04:15:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.263+0000 7fed06000640 1 -- 172.21.15.32:0/1375429774 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed080eff60 con 0x7fed101546e0 2024-01-19T04:15:22.269 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:22.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fece8066500 msgr2=0x7fece80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fece8066500 0x7fece80689c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed10151b80 tx=0x7fed00008040 comp rx=0 tx=0).stop 2024-01-19T04:15:22.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 msgr2=0x7fed1015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed1015ba00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed0801a5b0 tx=0x7fed08019720 comp rx=0 tx=0).stop 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 shutdown_connections 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fece8066500 0x7fece80689c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed101546e0 0x7fed1015ba00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed10151e80 0x7fed1015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 --2- 172.21.15.32:0/1375429774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed100c3c20 0x7fed1015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 >> 172.21.15.32:0/1375429774 conn(0x7fed100726d0 msgr2=0x7fed100663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 shutdown_connections 2024-01-19T04:15:22.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.267+0000 7fed14c00640 1 -- 172.21.15.32:0/1375429774 wait complete. 2024-01-19T04:15:22.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.475+0000 7f8ac2a00640 1 Processor -- start 2024-01-19T04:15:22.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.475+0000 7f8ac2a00640 1 -- start start 2024-01-19T04:15:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.475+0000 7f8ac2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8abc1550e0 0x7f8abc0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.475+0000 7f8ac2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc06c670 0x7f8abc071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.475+0000 7f8ac2a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc072730 con 0x7f8abc14eb90 2024-01-19T04:15:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.475+0000 7f8ac2a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc072a10 con 0x7f8abc1550e0 2024-01-19T04:15:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.475+0000 7f8ac2a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc14ef70 con 0x7f8abc06c670 2024-01-19T04:15:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8abc1550e0 0x7f8abc0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8abc14eb90 0x7f8abc1549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54888/0 (socket says 172.21.15.32:54888) 2024-01-19T04:15:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abbe00640 1 -- 172.21.15.32:0/2420182651 learned_addr learned my addr 172.21.15.32:0/2420182651 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8ac0a00640 1 --2- 172.21.15.32:0/2420182651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc06c670 0x7f8abc071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abb400640 1 -- 172.21.15.32:0/2420182651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc06c670 msgr2=0x7f8abc071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abb400640 1 --2- 172.21.15.32:0/2420182651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc06c670 0x7f8abc071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abb400640 1 -- 172.21.15.32:0/2420182651 >> v1:172.21.15.32:6789/0 conn(0x7f8abc14eb90 legacy=0x7f8abc1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abb400640 1 -- 172.21.15.32:0/2420182651 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc155580 con 0x7f8abc1550e0 2024-01-19T04:15:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abaa00640 1 -- 172.21.15.32:0/2420182651 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035135594 0 0) 0x7f8abc072730 con 0x7f8abc14eb90 2024-01-19T04:15:22.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abb400640 1 --2- 172.21.15.32:0/2420182651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc1550e0 0x7f8abc0719a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400ba60 tx=0x7f8aa401eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f810e0a057d6e07c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abaa00640 1 -- 172.21.15.32:0/2420182651 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40a7aa0 con 0x7f8abc1550e0 2024-01-19T04:15:22.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abaa00640 1 -- 172.21.15.32:0/2420182651 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa40a7c00 con 0x7f8abc1550e0 2024-01-19T04:15:22.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.479+0000 7f8abaa00640 1 -- 172.21.15.32:0/2420182651 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40af440 con 0x7f8abc1550e0 2024-01-19T04:15:22.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- 172.21.15.32:0/2420182651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc1550e0 msgr2=0x7f8abc0719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/2420182651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc1550e0 0x7f8abc0719a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400ba60 tx=0x7f8aa401eac0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- 172.21.15.32:0/2420182651 shutdown_connections 2024-01-19T04:15:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/2420182651 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc06c670 0x7f8abc071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/2420182651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc1550e0 0x7f8abc0719a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- 172.21.15.32:0/2420182651 >> 172.21.15.32:0/2420182651 conn(0x7f8abc0c25a0 msgr2=0x7f8abc0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- 172.21.15.32:0/2420182651 shutdown_connections 2024-01-19T04:15:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- 172.21.15.32:0/2420182651 wait complete. 2024-01-19T04:15:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 Processor -- start 2024-01-19T04:15:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- start start 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc06c670 0x7f8abc148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8abc14eb90 0x7f8abc153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc1550e0 0x7f8abc1494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1487e0 con 0x7f8abc06c670 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1e9e60 con 0x7f8abc14eb90 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac2a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc147eb0 con 0x7f8abc1550e0 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8abbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc06c670 0x7f8abc148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8abbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc06c670 0x7f8abc148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47068/0 (socket says 172.21.15.32:47068) 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8abbe00640 1 -- 172.21.15.32:0/594336344 learned_addr learned my addr 172.21.15.32:0/594336344 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8ac0a00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc1550e0 0x7f8abc1494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.483+0000 7f8abb400640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8abc14eb90 0x7f8abc153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8abbe00640 1 -- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc1550e0 msgr2=0x7f8abc1494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8abbe00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc1550e0 0x7f8abc1494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8abbe00640 1 -- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8abc14eb90 msgr2=0x7f8abc153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8abbe00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8abc14eb90 0x7f8abc153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8abbe00640 1 -- 172.21.15.32:0/594336344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa400b6c0 con 0x7f8abc06c670 2024-01-19T04:15:22.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8abbe00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc06c670 0x7f8abc148c70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c550 tx=0x7f8aac00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ab3e00640 1 -- 172.21.15.32:0/594336344 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac005cf0 con 0x7f8abc06c670 2024-01-19T04:15:22.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ab3e00640 1 -- 172.21.15.32:0/594336344 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac005e70 con 0x7f8abc06c670 2024-01-19T04:15:22.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc148190 con 0x7f8abc06c670 2024-01-19T04:15:22.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ab3e00640 1 -- 172.21.15.32:0/594336344 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac007310 con 0x7f8abc06c670 2024-01-19T04:15:22.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc154130 con 0x7f8abc06c670 2024-01-19T04:15:22.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc0749f0 con 0x7f8abc06c670 2024-01-19T04:15:22.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ab3e00640 1 -- 172.21.15.32:0/594336344 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8aac007470 con 0x7f8abc06c670 2024-01-19T04:15:22.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ab3e00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8a94066530 0x7f8a940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.487+0000 7f8ab3e00640 1 -- 172.21.15.32:0/594336344 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8aac083470 con 0x7f8abc06c670 2024-01-19T04:15:22.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.491+0000 7f8abb400640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8a94066530 0x7f8a940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.491+0000 7f8abb400640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8a94066530 0x7f8a940689f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40b1000 tx=0x7f8aa40a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.491+0000 7f8ab3e00640 1 -- 172.21.15.32:0/594336344 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8aac0507b0 con 0x7f8abc06c670 2024-01-19T04:15:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.655+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8abc154ec0 con 0x7f8abc06c670 2024-01-19T04:15:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.655+0000 7f8ab3e00640 1 -- 172.21.15.32:0/594336344 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8aac053dd0 con 0x7f8abc06c670 2024-01-19T04:15:22.661 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8a94066530 msgr2=0x7f8a940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8a94066530 0x7f8a940689f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40b1000 tx=0x7f8aa40a9070 comp rx=0 tx=0).stop 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc06c670 msgr2=0x7f8abc148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc06c670 0x7f8abc148c70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c550 tx=0x7f8aac00ca10 comp rx=0 tx=0).stop 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 shutdown_connections 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8a94066530 0x7f8a940689f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8abc1550e0 0x7f8abc1494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8abc14eb90 0x7f8abc153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 --2- 172.21.15.32:0/594336344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8abc06c670 0x7f8abc148c70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 >> 172.21.15.32:0/594336344 conn(0x7f8abc0c25a0 msgr2=0x7f8abc071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 shutdown_connections 2024-01-19T04:15:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.659+0000 7f8ac2a00640 1 -- 172.21.15.32:0/594336344 wait complete. 2024-01-19T04:15:22.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:22.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa616e00640 1 Processor -- start 2024-01-19T04:15:22.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa616e00640 1 -- start start 2024-01-19T04:15:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa616e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 0x7fa610157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa616e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa6100c6360 0x7fa6100c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa616e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6100c2d30 con 0x7fa610151b80 2024-01-19T04:15:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa616e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6100c34a0 con 0x7fa6100c6360 2024-01-19T04:15:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa616e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa610155730 con 0x7fa610155150 2024-01-19T04:15:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa60fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa610151b80 0x7fa6100c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54902/0 (socket says 172.21.15.32:54902) 2024-01-19T04:15:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa60fe00640 1 -- 172.21.15.32:0/447316695 learned_addr learned my addr 172.21.15.32:0/447316695 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa614e00640 1 --2- 172.21.15.32:0/447316695 >> v2:172.21.15.67:3300/0 conn(0x7fa6100c6360 0x7fa6100c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa60f400640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 0x7fa610157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425305289 0 0) 0x7fa6100c2d30 con 0x7fa610151b80 2024-01-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.823+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f0003530 con 0x7fa610151b80 2024-01-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2516528398 0 0) 0x7fa5f0003530 con 0x7fa610151b80 2024-01-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 msgr2=0x7fa610157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 0x7fa610157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 >> v2:172.21.15.67:3300/0 conn(0x7fa6100c6360 msgr2=0x7fa6100c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 --2- 172.21.15.32:0/447316695 >> v2:172.21.15.67:3300/0 conn(0x7fa6100c6360 0x7fa6100c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6100c3010 con 0x7fa610151b80 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fa600001680 con 0x7fa610151b80 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 >> v1:172.21.15.32:6789/0 conn(0x7fa610151b80 legacy=0x7fa6100c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f00047d0 0x7fa5f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 0x7fa5f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100c34a0 con 0x7fa5f0003980 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa610155730 con 0x7fa5f00047d0 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f000b990 con 0x7fa610155150 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60fe00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60f400640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f00047d0 0x7fa5f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa614e00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 0x7fa5f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60fe00640 1 -- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 msgr2=0x7fa5f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60fe00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610155150 0x7fa5f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60fe00640 1 -- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f00047d0 msgr2=0x7fa5f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60fe00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f00047d0 0x7fa5f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60fe00640 1 -- 172.21.15.32:0/447316695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0003530 con 0x7fa5f0003980 2024-01-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.827+0000 7fa60fe00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa60000c1c0 tx=0x7fa60001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3c3d61bcd4ac02 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000058e0 con 0x7fa5f0003980 2024-01-19T04:15:22.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600005a60 con 0x7fa5f0003980 2024-01-19T04:15:22.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa60ea00640 1 -- 172.21.15.32:0/447316695 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600005e10 con 0x7fa5f0003980 2024-01-19T04:15:22.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- 172.21.15.32:0/447316695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5f0003980 msgr2=0x7fa5f0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 --2- 172.21.15.32:0/447316695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa60000c1c0 tx=0x7fa60001cc10 comp rx=0 tx=0).stop 2024-01-19T04:15:22.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa614e00640 1 -- 172.21.15.32:0/447316695 reap_dead start 2024-01-19T04:15:22.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- 172.21.15.32:0/447316695 shutdown_connections 2024-01-19T04:15:22.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- 172.21.15.32:0/447316695 >> 172.21.15.32:0/447316695 conn(0x7fa6100c7d40 msgr2=0x7fa6100c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:22.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- 172.21.15.32:0/447316695 shutdown_connections 2024-01-19T04:15:22.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- 172.21.15.32:0/447316695 wait complete. 2024-01-19T04:15:22.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 Processor -- start 2024-01-19T04:15:22.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- start start 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f0003980 0x7fa6101ed310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610154970 0x7fa6100a7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa610150da0 0x7fa610151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100a6520 con 0x7fa610150da0 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100a6800 con 0x7fa5f0003980 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.831+0000 7fa616e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6101ecb10 con 0x7fa610154970 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa610150da0 0x7fa610151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa610150da0 0x7fa610151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47092/0 (socket says 172.21.15.32:47092) 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 -- 172.21.15.32:0/2533291335 learned_addr learned my addr 172.21.15.32:0/2533291335 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa60f400640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610154970 0x7fa6100a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa60fe00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f0003980 0x7fa6101ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 -- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610154970 msgr2=0x7fa6100a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610154970 0x7fa6100a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 -- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f0003980 msgr2=0x7fa6101ed310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f0003980 0x7fa6101ed310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 -- 172.21.15.32:0/2533291335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6101ecdf0 con 0x7fa610150da0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa614e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa610150da0 0x7fa610151220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa610158de0 tx=0x7fa60800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa607e00640 1 -- 172.21.15.32:0/2533291335 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800e040 con 0x7fa610150da0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa607e00640 1 -- 172.21.15.32:0/2533291335 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800f040 con 0x7fa610150da0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa607e00640 1 -- 172.21.15.32:0/2533291335 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608015670 con 0x7fa610150da0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6101ec800 con 0x7fa610150da0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6100ad070 con 0x7fa610150da0 2024-01-19T04:15:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6100749f0 con 0x7fa610150da0 2024-01-19T04:15:22.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.835+0000 7fa607e00640 1 -- 172.21.15.32:0/2533291335 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa6080157d0 con 0x7fa610150da0 2024-01-19T04:15:22.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.839+0000 7fa607e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa5e8066530 0x7fa5e80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:22.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.839+0000 7fa607e00640 1 -- 172.21.15.32:0/2533291335 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa608084750 con 0x7fa610150da0 2024-01-19T04:15:22.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.839+0000 7fa60fe00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa5e8066530 0x7fa5e80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.839+0000 7fa60fe00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa5e8066530 0x7fa5e80689f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6000aa000 tx=0x7fa61006e450 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:22.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.843+0000 7fa607e00640 1 -- 172.21.15.32:0/2533291335 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa6080519e0 con 0x7fa610150da0 2024-01-19T04:15:23.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.999+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6100c5c40 con 0x7fa610150da0 2024-01-19T04:15:23.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:22.999+0000 7fa607e00640 1 -- 172.21.15.32:0/2533291335 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa608055000 con 0x7fa610150da0 2024-01-19T04:15:23.005 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa5e8066530 msgr2=0x7fa5e80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa5e8066530 0x7fa5e80689f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6000aa000 tx=0x7fa61006e450 comp rx=0 tx=0).stop 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa610150da0 msgr2=0x7fa610151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa610150da0 0x7fa610151220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa610158de0 tx=0x7fa60800f580 comp rx=0 tx=0).stop 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 shutdown_connections 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa5e8066530 0x7fa5e80689f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa610150da0 0x7fa610151220 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa610154970 0x7fa6100a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 --2- 172.21.15.32:0/2533291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f0003980 0x7fa6101ed310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 >> 172.21.15.32:0/2533291335 conn(0x7fa6100c7d40 msgr2=0x7fa6100c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 shutdown_connections 2024-01-19T04:15:23.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.003+0000 7fa616e00640 1 -- 172.21.15.32:0/2533291335 wait complete. 2024-01-19T04:15:23.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.163+0000 7fd7c4400640 1 Processor -- start 2024-01-19T04:15:23.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.163+0000 7fd7c4400640 1 -- start start 2024-01-19T04:15:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c4400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7bc072310 0x7fd7bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c4400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc0c44f0 con 0x7fd7bc0c54b0 2024-01-19T04:15:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c4400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc0c4980 con 0x7fd7bc155320 2024-01-19T04:15:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c4400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c3bc0 con 0x7fd7bc072310 2024-01-19T04:15:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c2400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7bc072310 0x7fd7bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c1000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd7bc0c54b0 0x7fd7bc06cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54908/0 (socket says 172.21.15.32:54908) 2024-01-19T04:15:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c1000640 1 -- 172.21.15.32:0/441533229 learned_addr learned my addr 172.21.15.32:0/441533229 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c2400640 1 -- 172.21.15.32:0/441533229 >> v1:172.21.15.67:6789/0 conn(0x7fd7bc155320 legacy=0x7fd7bc0a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c2400640 1 -- 172.21.15.32:0/441533229 >> v1:172.21.15.32:6789/0 conn(0x7fd7bc0c54b0 legacy=0x7fd7bc06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c2400640 1 -- 172.21.15.32:0/441533229 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0c3ea0 con 0x7fd7bc072310 2024-01-19T04:15:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7c2400640 1 --2- 172.21.15.32:0/441533229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc06d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009d90 tx=0x7fd7b401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b94d604828c8585 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7bbe00640 1 -- 172.21.15.32:0/441533229 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40a5a00 con 0x7fd7bc072310 2024-01-19T04:15:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.167+0000 7fd7bbe00640 1 -- 172.21.15.32:0/441533229 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b40a5b60 con 0x7fd7bc072310 2024-01-19T04:15:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7bbe00640 1 -- 172.21.15.32:0/441533229 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40ad440 con 0x7fd7bc072310 2024-01-19T04:15:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 -- 172.21.15.32:0/441533229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 msgr2=0x7fd7bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 --2- 172.21.15.32:0/441533229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc06d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009d90 tx=0x7fd7b401c920 comp rx=0 tx=0).stop 2024-01-19T04:15:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 -- 172.21.15.32:0/441533229 shutdown_connections 2024-01-19T04:15:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 --2- 172.21.15.32:0/441533229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc06d390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 -- 172.21.15.32:0/441533229 >> 172.21.15.32:0/441533229 conn(0x7fd7bc0c5b20 msgr2=0x7fd7bc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 -- 172.21.15.32:0/441533229 shutdown_connections 2024-01-19T04:15:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 -- 172.21.15.32:0/441533229 wait complete. 2024-01-19T04:15:23.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 Processor -- start 2024-01-19T04:15:23.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 -- start start 2024-01-19T04:15:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc14bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.171+0000 7fd7c4400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7bc0c54b0 0x7fd7bc071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c4400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7bc155320 0x7fd7bc071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c4400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc071400 con 0x7fd7bc072310 2024-01-19T04:15:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c4400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc14e7a0 con 0x7fd7bc0c54b0 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c4400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc14e310 con 0x7fd7bc155320 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc14bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc14bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47110/0 (socket says 172.21.15.32:47110) 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 -- 172.21.15.32:0/2153395827 learned_addr learned my addr 172.21.15.32:0/2153395827 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c2400640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7bc155320 0x7fd7bc071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1000640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7bc0c54b0 0x7fd7bc071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 -- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7bc155320 msgr2=0x7fd7bc071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7bc155320 0x7fd7bc071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 -- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7bc0c54b0 msgr2=0x7fd7bc071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7bc0c54b0 0x7fd7bc071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 -- 172.21.15.32:0/2153395827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009a70 con 0x7fd7bc072310 2024-01-19T04:15:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1000640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7bc0c54b0 0x7fd7bc071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c1a00640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc14bcc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c370 tx=0x7fd7ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7b9600640 1 -- 172.21.15.32:0/2153395827 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0052d0 con 0x7fd7bc072310 2024-01-19T04:15:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7b9600640 1 -- 172.21.15.32:0/2153395827 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac005430 con 0x7fd7bc072310 2024-01-19T04:15:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc071120 con 0x7fd7bc072310 2024-01-19T04:15:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7b9600640 1 -- 172.21.15.32:0/2153395827 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac007260 con 0x7fd7bc072310 2024-01-19T04:15:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc14cb50 con 0x7fd7bc072310 2024-01-19T04:15:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc0749f0 con 0x7fd7bc072310 2024-01-19T04:15:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.175+0000 7fd7b9600640 1 -- 172.21.15.32:0/2153395827 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd7ac0073c0 con 0x7fd7bc072310 2024-01-19T04:15:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.179+0000 7fd7b9600640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd794066530 0x7fd7940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.179+0000 7fd7b9600640 1 -- 172.21.15.32:0/2153395827 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7ac0830a0 con 0x7fd7bc072310 2024-01-19T04:15:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.179+0000 7fd7c1000640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd794066530 0x7fd7940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.179+0000 7fd7c1000640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd794066530 0x7fd7940689f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0c12a0 tx=0x7fd7a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.183+0000 7fd7b9600640 1 -- 172.21.15.32:0/2153395827 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd7ac050480 con 0x7fd7bc072310 2024-01-19T04:15:23.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.343+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7bc0bfb80 con 0x7fd7bc072310 2024-01-19T04:15:23.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.343+0000 7fd7b9600640 1 -- 172.21.15.32:0/2153395827 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7fd7ac053aa0 con 0x7fd7bc072310 2024-01-19T04:15:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:23.348 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:23.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd794066530 msgr2=0x7fd7940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd794066530 0x7fd7940689f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0c12a0 tx=0x7fd7a4009040 comp rx=0 tx=0).stop 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 msgr2=0x7fd7bc14bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc14bcc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c370 tx=0x7fd7ac00c830 comp rx=0 tx=0).stop 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 shutdown_connections 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd794066530 0x7fd7940689f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7bc155320 0x7fd7bc071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7bc0c54b0 0x7fd7bc071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 --2- 172.21.15.32:0/2153395827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7bc072310 0x7fd7bc14bcc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 >> 172.21.15.32:0/2153395827 conn(0x7fd7bc0c5b20 msgr2=0x7fd7bc0c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 shutdown_connections 2024-01-19T04:15:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.347+0000 7fd7c4400640 1 -- 172.21.15.32:0/2153395827 wait complete. 2024-01-19T04:15:23.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:23.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:23.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f14a3800640 1 Processor -- start 2024-01-19T04:15:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f14a3800640 1 -- start start 2024-01-19T04:15:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f14a3800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f14a3800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c0a4ea0 con 0x7f149c0c2080 2024-01-19T04:15:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f14a3800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c152a20 con 0x7f149c06d440 2024-01-19T04:15:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f14a3800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c1524a0 con 0x7f149c0723b0 2024-01-19T04:15:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f149be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f149c0c2080 0x7f149c155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54912/0 (socket says 172.21.15.32:54912) 2024-01-19T04:15:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f149be00640 1 -- 172.21.15.32:0/1898980540 learned_addr learned my addr 172.21.15.32:0/1898980540 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.511+0000 7f14a0e00640 1 --2- 172.21.15.32:0/1898980540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f149b400640 1 -- 172.21.15.32:0/1898980540 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84575573 0 0) 0x7f149c0a4ea0 con 0x7f149c0c2080 2024-01-19T04:15:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f149b400640 1 -- 172.21.15.32:0/1898980540 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f147c003530 con 0x7f149c0c2080 2024-01-19T04:15:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f149b400640 1 -- 172.21.15.32:0/1898980540 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611087891 0 0) 0x7f149c152a20 con 0x7f149c06d440 2024-01-19T04:15:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f149b400640 1 -- 172.21.15.32:0/1898980540 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c0a4ea0 con 0x7f149c06d440 2024-01-19T04:15:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f14a0e00640 1 -- 172.21.15.32:0/1898980540 >> v1:172.21.15.67:6789/0 conn(0x7f149c06d440 legacy=0x7f149c0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f14a0e00640 1 -- 172.21.15.32:0/1898980540 >> v1:172.21.15.32:6789/0 conn(0x7f149c0c2080 legacy=0x7f149c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f14a0e00640 1 -- 172.21.15.32:0/1898980540 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c1533f0 con 0x7f149c0723b0 2024-01-19T04:15:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f14a0e00640 1 --2- 172.21.15.32:0/1898980540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c152eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f148c0097f0 tx=0x7f148c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75be219a5429872e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f149b400640 1 -- 172.21.15.32:0/1898980540 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0ac600 con 0x7f149c0723b0 2024-01-19T04:15:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f149b400640 1 -- 172.21.15.32:0/1898980540 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0a8050 con 0x7f149c0723b0 2024-01-19T04:15:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.515+0000 7f149b400640 1 -- 172.21.15.32:0/1898980540 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0ac980 con 0x7f149c0723b0 2024-01-19T04:15:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- 172.21.15.32:0/1898980540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 msgr2=0x7f149c152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 --2- 172.21.15.32:0/1898980540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c152eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f148c0097f0 tx=0x7f148c01c3a0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- 172.21.15.32:0/1898980540 shutdown_connections 2024-01-19T04:15:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 --2- 172.21.15.32:0/1898980540 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c152eb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- 172.21.15.32:0/1898980540 >> 172.21.15.32:0/1898980540 conn(0x7f149c0c25a0 msgr2=0x7f149c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- 172.21.15.32:0/1898980540 shutdown_connections 2024-01-19T04:15:23.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- 172.21.15.32:0/1898980540 wait complete. 2024-01-19T04:15:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 Processor -- start 2024-01-19T04:15:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- start start 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06d440 0x7f149c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c0c2080 0x7f149c14a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c150ee0 con 0x7f149c06d440 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c1ed640 con 0x7f149c0c2080 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a3800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c1ecd70 con 0x7f149c0723b0 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06d440 0x7f149c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06d440 0x7f149c150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47118/0 (socket says 172.21.15.32:47118) 2024-01-19T04:15:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 -- 172.21.15.32:0/1077998616 learned_addr learned my addr 172.21.15.32:0/1077998616 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f149be00640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a1800640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c0c2080 0x7f149c14a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 -- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 msgr2=0x7f149c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 -- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c0c2080 msgr2=0x7f149c14a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c0c2080 0x7f149c14a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.519+0000 7f14a0e00640 1 -- 172.21.15.32:0/1077998616 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009420 con 0x7f149c06d440 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f14a0e00640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06d440 0x7f149c150570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f148c018fb0 tx=0x7f148c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f1498c00640 1 -- 172.21.15.32:0/1077998616 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0b7420 con 0x7f149c06d440 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f1498c00640 1 -- 172.21.15.32:0/1077998616 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0b75a0 con 0x7f149c06d440 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f1498c00640 1 -- 172.21.15.32:0/1077998616 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0b7950 con 0x7f149c06d440 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c1555f0 con 0x7f149c06d440 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c1ecf80 con 0x7f149c06d440 2024-01-19T04:15:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c0749f0 con 0x7f149c06d440 2024-01-19T04:15:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f1498c00640 1 -- 172.21.15.32:0/1077998616 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f148c0b3040 con 0x7f149c06d440 2024-01-19T04:15:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f1498c00640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f1498c00640 1 -- 172.21.15.32:0/1077998616 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f148c11de90 con 0x7f149c06d440 2024-01-19T04:15:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.523+0000 7f149be00640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.527+0000 7f149be00640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f149c1f13a0 tx=0x7f1484007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.527+0000 7f1498c00640 1 -- 172.21.15.32:0/1077998616 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f148c0eb2f0 con 0x7f149c06d440 2024-01-19T04:15:23.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.687+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f149c151df0 con 0x7f149c06d440 2024-01-19T04:15:23.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.687+0000 7f1498c00640 1 -- 172.21.15.32:0/1077998616 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f148c0ee910 con 0x7f149c06d440 2024-01-19T04:15:23.692 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.687+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 msgr2=0x7f14740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.687+0000 7f14a3800640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f149c1f13a0 tx=0x7f1484007d80 comp rx=0 tx=0).stop 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.687+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06d440 msgr2=0x7f149c150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.687+0000 7f14a3800640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06d440 0x7f149c150570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f148c018fb0 tx=0x7f148c01abe0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.687+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 shutdown_connections 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.691+0000 7f14a3800640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.691+0000 7f14a3800640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c0c2080 0x7f149c14a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.691+0000 7f14a3800640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c0723b0 0x7f149c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.691+0000 7f14a3800640 1 --2- 172.21.15.32:0/1077998616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06d440 0x7f149c150570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.691+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 >> 172.21.15.32:0/1077998616 conn(0x7f149c0c25a0 msgr2=0x7f149c0bf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.691+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 shutdown_connections 2024-01-19T04:15:23.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.691+0000 7f14a3800640 1 -- 172.21.15.32:0/1077998616 wait complete. 2024-01-19T04:15:23.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:23.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.851+0000 7fcdd8a00640 1 Processor -- start 2024-01-19T04:15:23.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.851+0000 7fcdd8a00640 1 -- start start 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd8a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcdd0151e60 0x7fcdd00c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcdd00c4fc0 0x7fcdd0155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd8a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00c36c0 con 0x7fcdd00c1f60 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd8a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd00c30e0 con 0x7fcdd0151e60 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd8a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd00c2b70 con 0x7fcdd00c4fc0 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcdd0151e60 0x7fcdd00c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd5600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcdd00c1f60 0x7fcdd00c48b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54924/0 (socket says 172.21.15.32:54924) 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd5600640 1 -- 172.21.15.32:0/398721107 learned_addr learned my addr 172.21.15.32:0/398721107 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd6a00640 1 --2- 172.21.15.32:0/398721107 >> v2:172.21.15.67:3300/0 conn(0x7fcdd00c4fc0 0x7fcdd0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd6000640 1 -- 172.21.15.32:0/398721107 >> v2:172.21.15.67:3300/0 conn(0x7fcdd00c4fc0 msgr2=0x7fcdd0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd6000640 1 --2- 172.21.15.32:0/398721107 >> v2:172.21.15.67:3300/0 conn(0x7fcdd00c4fc0 0x7fcdd0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd6000640 1 -- 172.21.15.32:0/398721107 >> v1:172.21.15.32:6789/0 conn(0x7fcdd00c1f60 legacy=0x7fcdd00c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.855+0000 7fcdd6000640 1 -- 172.21.15.32:0/398721107 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00c55a0 con 0x7fcdd0151e60 2024-01-19T04:15:23.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd6000640 1 --2- 172.21.15.32:0/398721107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd0151e60 0x7fcdd00c4240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0071f70 tx=0x7fcdc001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca108fe9627175c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd4c00640 1 -- 172.21.15.32:0/398721107 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00ab600 con 0x7fcdd0151e60 2024-01-19T04:15:23.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd4c00640 1 -- 172.21.15.32:0/398721107 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc00a7050 con 0x7fcdd0151e60 2024-01-19T04:15:23.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd4c00640 1 -- 172.21.15.32:0/398721107 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00ab980 con 0x7fcdd0151e60 2024-01-19T04:15:23.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 -- 172.21.15.32:0/398721107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd0151e60 msgr2=0x7fcdd00c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/398721107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd0151e60 0x7fcdd00c4240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0071f70 tx=0x7fcdc001c370 comp rx=0 tx=0).stop 2024-01-19T04:15:23.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 -- 172.21.15.32:0/398721107 shutdown_connections 2024-01-19T04:15:23.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/398721107 >> v2:172.21.15.67:3300/0 conn(0x7fcdd00c4fc0 0x7fcdd0155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/398721107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd0151e60 0x7fcdd00c4240 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 -- 172.21.15.32:0/398721107 >> 172.21.15.32:0/398721107 conn(0x7fcdd00663f0 msgr2=0x7fcdd0066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:23.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 -- 172.21.15.32:0/398721107 shutdown_connections 2024-01-19T04:15:23.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 -- 172.21.15.32:0/398721107 wait complete. 2024-01-19T04:15:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 Processor -- start 2024-01-19T04:15:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.859+0000 7fcdd8a00640 1 -- start start 2024-01-19T04:15:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd00c1f60 0x7fcdd00aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd00c4fc0 0x7fcdd00c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdd0151e60 0x7fcdd006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd006ded0 con 0x7fcdd00c1f60 2024-01-19T04:15:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00c6fc0 con 0x7fcdd00c4fc0 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd006f0a0 con 0x7fcdd0151e60 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd00c1f60 0x7fcdd00aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd00c1f60 0x7fcdd00aa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47138/0 (socket says 172.21.15.32:47138) 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 -- 172.21.15.32:0/1498570203 learned_addr learned my addr 172.21.15.32:0/1498570203 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd5600640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd00c4fc0 0x7fcdd00c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdd0151e60 0x7fcdd006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 -- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdd0151e60 msgr2=0x7fcdd006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdd0151e60 0x7fcdd006e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 -- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd00c4fc0 msgr2=0x7fcdd00c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd00c4fc0 0x7fcdd00c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 -- 172.21.15.32:0/1498570203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0009420 con 0x7fcdd00c1f60 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd5600640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd00c4fc0 0x7fcdd00c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdd0151e60 0x7fcdd006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd6000640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd00c1f60 0x7fcdd00aa170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ae040 tx=0x7fcdc001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdce000640 1 -- 172.21.15.32:0/1498570203 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00b7650 con 0x7fcdd00c1f60 2024-01-19T04:15:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdce000640 1 -- 172.21.15.32:0/1498570203 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc00b77b0 con 0x7fcdd00c1f60 2024-01-19T04:15:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd006f380 con 0x7fcdd00c1f60 2024-01-19T04:15:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdce000640 1 -- 172.21.15.32:0/1498570203 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00b7b60 con 0x7fcdd00c1f60 2024-01-19T04:15:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd00c83b0 con 0x7fcdd00c1f60 2024-01-19T04:15:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd00749f0 con 0x7fcdd00c1f60 2024-01-19T04:15:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.863+0000 7fcdce000640 1 -- 172.21.15.32:0/1498570203 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcdc00b7cc0 con 0x7fcdd00c1f60 2024-01-19T04:15:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.867+0000 7fcdce000640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcda8066500 0x7fcda80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.867+0000 7fcdce000640 1 -- 172.21.15.32:0/1498570203 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdc011e760 con 0x7fcdd00c1f60 2024-01-19T04:15:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.867+0000 7fcdd5600640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcda8066500 0x7fcda80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:23.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.867+0000 7fcdd5600640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcda8066500 0x7fcda80689c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0143dd0 tx=0x7fcdb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:23.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:23.871+0000 7fcdce000640 1 -- 172.21.15.32:0/1498570203 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcdc00ebb10 con 0x7fcdd00c1f60 2024-01-19T04:15:24.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.031+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdd00c1d40 con 0x7fcdd00c1f60 2024-01-19T04:15:24.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.031+0000 7fcdce000640 1 -- 172.21.15.32:0/1498570203 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdc00bb020 con 0x7fcdd00c1f60 2024-01-19T04:15:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:24.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcda8066500 msgr2=0x7fcda80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcda8066500 0x7fcda80689c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0143dd0 tx=0x7fcdb8009040 comp rx=0 tx=0).stop 2024-01-19T04:15:24.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd00c1f60 msgr2=0x7fcdd00aa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd00c1f60 0x7fcdd00aa170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ae040 tx=0x7fcdc001abb0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 shutdown_connections 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcda8066500 0x7fcda80689c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdd0151e60 0x7fcdd006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd00c4fc0 0x7fcdd00c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 --2- 172.21.15.32:0/1498570203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdd00c1f60 0x7fcdd00aa170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 >> 172.21.15.32:0/1498570203 conn(0x7fcdd00663f0 msgr2=0x7fcdd00c1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 shutdown_connections 2024-01-19T04:15:24.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.035+0000 7fcdd8a00640 1 -- 172.21.15.32:0/1498570203 wait complete. 2024-01-19T04:15:24.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:24.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5913400640 1 Processor -- start 2024-01-19T04:15:24.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5913400640 1 -- start start 2024-01-19T04:15:24.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5913400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f590c0c8290 0x7f590c0a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5913400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c0c1bc0 0x7f590c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5913400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c157d60 con 0x7f590c06fe50 2024-01-19T04:15:24.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5913400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c158040 con 0x7f590c0c8290 2024-01-19T04:15:24.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5913400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c158320 con 0x7f590c0c1bc0 2024-01-19T04:15:24.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5910a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f590c0c8290 0x7f590c0a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5910a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f590c0c8290 0x7f590c0a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47146/0 (socket says 172.21.15.32:47146) 2024-01-19T04:15:24.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5910a00640 1 -- 172.21.15.32:0/3202382426 learned_addr learned my addr 172.21.15.32:0/3202382426 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:24.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f590be00640 1 --2- 172.21.15.32:0/3202382426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c0c1bc0 0x7f590c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5910a00640 1 -- 172.21.15.32:0/3202382426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c0c1bc0 msgr2=0x7f590c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:24.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5910a00640 1 --2- 172.21.15.32:0/3202382426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c0c1bc0 0x7f590c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5910a00640 1 -- 172.21.15.32:0/3202382426 >> v1:172.21.15.67:6789/0 conn(0x7f590c06fe50 legacy=0x7f590c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.199+0000 7f5910a00640 1 -- 172.21.15.32:0/3202382426 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c158600 con 0x7f590c0c8290 2024-01-19T04:15:24.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5910a00640 1 --2- 172.21.15.32:0/3202382426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c8290 0x7f590c0a7190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009870 tx=0x7f58fc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1283cfca4d6f04ae server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f590b400640 1 -- 172.21.15.32:0/3202382426 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0ab600 con 0x7f590c0c8290 2024-01-19T04:15:24.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f590b400640 1 -- 172.21.15.32:0/3202382426 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc0a7050 con 0x7f590c0c8290 2024-01-19T04:15:24.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f590b400640 1 -- 172.21.15.32:0/3202382426 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0ab980 con 0x7f590c0c8290 2024-01-19T04:15:24.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 -- 172.21.15.32:0/3202382426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c8290 msgr2=0x7f590c0a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 --2- 172.21.15.32:0/3202382426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c8290 0x7f590c0a7190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009870 tx=0x7f58fc01c4b0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 -- 172.21.15.32:0/3202382426 shutdown_connections 2024-01-19T04:15:24.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 --2- 172.21.15.32:0/3202382426 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c0c1bc0 0x7f590c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 --2- 172.21.15.32:0/3202382426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c8290 0x7f590c0a7190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 -- 172.21.15.32:0/3202382426 >> 172.21.15.32:0/3202382426 conn(0x7f590c0726d0 msgr2=0x7f590c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:24.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 -- 172.21.15.32:0/3202382426 shutdown_connections 2024-01-19T04:15:24.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.203+0000 7f5913400640 1 -- 172.21.15.32:0/3202382426 wait complete. 2024-01-19T04:15:24.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 Processor -- start 2024-01-19T04:15:24.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 -- start start 2024-01-19T04:15:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c06fe50 0x7f590c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c1bc0 0x7f590c0ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f590c0c8290 0x7f590c140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c1ed880 con 0x7f590c0c1bc0 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c158f50 con 0x7f590c0c8290 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c1edca0 con 0x7f590c06fe50 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c1bc0 0x7f590c0ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c1bc0 0x7f590c0ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47156/0 (socket says 172.21.15.32:47156) 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 -- 172.21.15.32:0/3746499070 learned_addr learned my addr 172.21.15.32:0/3746499070 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5910a00640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c06fe50 0x7f590c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5911400640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f590c0c8290 0x7f590c140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 -- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c06fe50 msgr2=0x7f590c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c06fe50 0x7f590c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 -- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f590c0c8290 msgr2=0x7f590c140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f590c0c8290 0x7f590c140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 -- 172.21.15.32:0/3746499070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0094d0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f590be00640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c1bc0 0x7f590c0ac4b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f58f400e870 tx=0x7f58f400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5908c00640 1 -- 172.21.15.32:0/3746499070 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4009510 con 0x7f590c0c1bc0 2024-01-19T04:15:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5908c00640 1 -- 172.21.15.32:0/3746499070 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f400eec0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c1ecee0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5908c00640 1 -- 172.21.15.32:0/3746499070 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400cb40 con 0x7f590c0c1bc0 2024-01-19T04:15:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.207+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c1ed4a0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.211+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c1ed9c0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.211+0000 7f5908c00640 1 -- 172.21.15.32:0/3746499070 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f58f400cca0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.211+0000 7f5908c00640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58e4066500 0x7f58e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.211+0000 7f5908c00640 1 -- 172.21.15.32:0/3746499070 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58f4083e90 con 0x7f590c0c1bc0 2024-01-19T04:15:24.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.211+0000 7f5910a00640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58e4066500 0x7f58e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.211+0000 7f5910a00640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58e4066500 0x7f58e40689c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0ad000 tx=0x7f58fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.215+0000 7f5908c00640 1 -- 172.21.15.32:0/3746499070 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f590c1ed9c0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.379+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f590c1ed9c0 con 0x7f590c0c1bc0 2024-01-19T04:15:24.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.379+0000 7f5908c00640 1 -- 172.21.15.32:0/3746499070 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58f4017020 con 0x7f590c0c1bc0 2024-01-19T04:15:24.385 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:24.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58e4066500 msgr2=0x7f58e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58e4066500 0x7f58e40689c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0ad000 tx=0x7f58fc0a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:24.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c1bc0 msgr2=0x7f590c0ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c1bc0 0x7f590c0ac4b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f58f400e870 tx=0x7f58f400ec70 comp rx=0 tx=0).stop 2024-01-19T04:15:24.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 shutdown_connections 2024-01-19T04:15:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58e4066500 0x7f58e40689c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f590c0c8290 0x7f590c140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f590c0c1bc0 0x7f590c0ac4b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 --2- 172.21.15.32:0/3746499070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f590c06fe50 0x7f590c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 >> 172.21.15.32:0/3746499070 conn(0x7f590c0726d0 msgr2=0x7f590c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 shutdown_connections 2024-01-19T04:15:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.383+0000 7f5913400640 1 -- 172.21.15.32:0/3746499070 wait complete. 2024-01-19T04:15:24.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.543+0000 7fc1b7200640 1 Processor -- start 2024-01-19T04:15:24.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.543+0000 7fc1b7200640 1 -- start start 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b7200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b7200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1b006fa50 0x7fc1b00c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b7200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00c6570 con 0x7fc1b0155060 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b7200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b00c81f0 con 0x7fc1b006fa50 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b7200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0155560 con 0x7fc1b00c78d0 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1b006fa50 0x7fc1b00c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1b006fa50 0x7fc1b00c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47164/0 (socket says 172.21.15.32:47164) 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 -- 172.21.15.32:0/1588348264 learned_addr learned my addr 172.21.15.32:0/1588348264 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1afe00640 1 --2- 172.21.15.32:0/1588348264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 -- 172.21.15.32:0/1588348264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 msgr2=0x7fc1b00c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 --2- 172.21.15.32:0/1588348264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b00c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 -- 172.21.15.32:0/1588348264 >> v1:172.21.15.67:6789/0 conn(0x7fc1b0155060 legacy=0x7fc1b00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:24.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 -- 172.21.15.32:0/1588348264 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00c5c40 con 0x7fc1b006fa50 2024-01-19T04:15:24.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1b5200640 1 --2- 172.21.15.32:0/1588348264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b006fa50 0x7fc1b00c7110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009e50 tx=0x7fc1a801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb87e32bde8a8ffb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.547+0000 7fc1aea00640 1 -- 172.21.15.32:0/1588348264 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80a5790 con 0x7fc1b006fa50 2024-01-19T04:15:24.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1aea00640 1 -- 172.21.15.32:0/1588348264 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80a58f0 con 0x7fc1b006fa50 2024-01-19T04:15:24.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1aea00640 1 -- 172.21.15.32:0/1588348264 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80a5c80 con 0x7fc1b006fa50 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- 172.21.15.32:0/1588348264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b006fa50 msgr2=0x7fc1b00c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 --2- 172.21.15.32:0/1588348264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b006fa50 0x7fc1b00c7110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009e50 tx=0x7fc1a801c910 comp rx=0 tx=0).stop 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- 172.21.15.32:0/1588348264 shutdown_connections 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 --2- 172.21.15.32:0/1588348264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b006fa50 0x7fc1b00c7110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 --2- 172.21.15.32:0/1588348264 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b00c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- 172.21.15.32:0/1588348264 >> 172.21.15.32:0/1588348264 conn(0x7fc1b006ddb0 msgr2=0x7fc1b006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- 172.21.15.32:0/1588348264 shutdown_connections 2024-01-19T04:15:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- 172.21.15.32:0/1588348264 wait complete. 2024-01-19T04:15:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 Processor -- start 2024-01-19T04:15:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- start start 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1b006fa50 0x7fc1b00a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b0150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b0155060 0x7fc1b01503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00a9970 con 0x7fc1b0155060 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01f0570 con 0x7fc1b006fa50 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b7200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0151210 con 0x7fc1b00c78d0 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.551+0000 7fc1b5200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b0155060 0x7fc1b01503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b0155060 0x7fc1b01503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47176/0 (socket says 172.21.15.32:47176) 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 -- 172.21.15.32:0/572156340 learned_addr learned my addr 172.21.15.32:0/572156340 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:24.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1af400640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b0150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1afe00640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1b006fa50 0x7fc1b00a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 -- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 msgr2=0x7fc1b0150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b0150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 -- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1b006fa50 msgr2=0x7fc1b00a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1b006fa50 0x7fc1b00a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 -- 172.21.15.32:0/572156340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009b30 con 0x7fc1b0155060 2024-01-19T04:15:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b5200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b0155060 0x7fc1b01503b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1a801afc0 tx=0x7fc1a80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1a7e00640 1 -- 172.21.15.32:0/572156340 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80b8670 con 0x7fc1b0155060 2024-01-19T04:15:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1a7e00640 1 -- 172.21.15.32:0/572156340 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80b87f0 con 0x7fc1b0155060 2024-01-19T04:15:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b01f07c0 con 0x7fc1b0155060 2024-01-19T04:15:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1a7e00640 1 -- 172.21.15.32:0/572156340 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80b8ba0 con 0x7fc1b0155060 2024-01-19T04:15:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b01f0d80 con 0x7fc1b0155060 2024-01-19T04:15:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b00749f0 con 0x7fc1b0155060 2024-01-19T04:15:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1a7e00640 1 -- 172.21.15.32:0/572156340 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc1a80b8d00 con 0x7fc1b0155060 2024-01-19T04:15:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1a7e00640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc188066500 0x7fc1880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.555+0000 7fc1a7e00640 1 -- 172.21.15.32:0/572156340 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a811f450 con 0x7fc1b0155060 2024-01-19T04:15:24.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.559+0000 7fc1afe00640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc188066500 0x7fc1880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.559+0000 7fc1afe00640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc188066500 0x7fc1880689c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0006aa0 tx=0x7fc1a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.559+0000 7fc1a7e00640 1 -- 172.21.15.32:0/572156340 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc1a80ec8b0 con 0x7fc1b0155060 2024-01-19T04:15:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.723+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b015fd50 con 0x7fc1b0155060 2024-01-19T04:15:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.723+0000 7fc1a7e00640 1 -- 172.21.15.32:0/572156340 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7fc1a80efed0 con 0x7fc1b0155060 2024-01-19T04:15:24.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:24.729 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc188066500 msgr2=0x7fc1880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc188066500 0x7fc1880689c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0006aa0 tx=0x7fc1a0008040 comp rx=0 tx=0).stop 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b0155060 msgr2=0x7fc1b01503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b0155060 0x7fc1b01503b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1a801afc0 tx=0x7fc1a80196b0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 shutdown_connections 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc188066500 0x7fc1880689c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1b0155060 0x7fc1b01503b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1b00c78d0 0x7fc1b0150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 --2- 172.21.15.32:0/572156340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1b006fa50 0x7fc1b00a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 >> 172.21.15.32:0/572156340 conn(0x7fc1b006ddb0 msgr2=0x7fc1b0152450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:24.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 shutdown_connections 2024-01-19T04:15:24.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.727+0000 7fc1b7200640 1 -- 172.21.15.32:0/572156340 wait complete. 2024-01-19T04:15:24.751 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:24.752 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.891+0000 7fd7b1e00640 1 Processor -- start 2024-01-19T04:15:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.891+0000 7fd7b1e00640 1 -- start start 2024-01-19T04:15:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.891+0000 7fd7b1e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7ac0c4360 0x7fd7ac06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.891+0000 7fd7b1e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd7ac070630 0x7fd7ac06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.891+0000 7fd7b1e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac06c6a0 con 0x7fd7ac151dc0 2024-01-19T04:15:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.891+0000 7fd7b1e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac1521a0 con 0x7fd7ac0c4360 2024-01-19T04:15:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.891+0000 7fd7b1e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac154cf0 con 0x7fd7ac070630 2024-01-19T04:15:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aa000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7ac0c4360 0x7fd7ac06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aaa00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd7ac151dc0 0x7fd7ac0c1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:40992/0 (socket says 172.21.15.32:40992) 2024-01-19T04:15:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aa000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7ac0c4360 0x7fd7ac06cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47188/0 (socket says 172.21.15.32:47188) 2024-01-19T04:15:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aaa00640 1 -- 172.21.15.32:0/331340387 learned_addr learned my addr 172.21.15.32:0/331340387 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7ab400640 1 --2- 172.21.15.32:0/331340387 >> v2:172.21.15.67:3300/0 conn(0x7fd7ac070630 0x7fd7ac06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aa000640 1 -- 172.21.15.32:0/331340387 >> v2:172.21.15.67:3300/0 conn(0x7fd7ac070630 msgr2=0x7fd7ac06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aa000640 1 --2- 172.21.15.32:0/331340387 >> v2:172.21.15.67:3300/0 conn(0x7fd7ac070630 0x7fd7ac06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aa000640 1 -- 172.21.15.32:0/331340387 >> v1:172.21.15.67:6789/0 conn(0x7fd7ac151dc0 legacy=0x7fd7ac0c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aa000640 1 -- 172.21.15.32:0/331340387 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac154fd0 con 0x7fd7ac0c4360 2024-01-19T04:15:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7aa000640 1 --2- 172.21.15.32:0/331340387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac0c4360 0x7fd7ac06cb30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac074610 tx=0x7fd79401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649dc135cf79e96a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7a9600640 1 -- 172.21.15.32:0/331340387 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940a7070 con 0x7fd7ac0c4360 2024-01-19T04:15:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7a9600640 1 -- 172.21.15.32:0/331340387 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7940ab430 con 0x7fd7ac0c4360 2024-01-19T04:15:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.895+0000 7fd7a9600640 1 -- 172.21.15.32:0/331340387 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940ab7c0 con 0x7fd7ac0c4360 2024-01-19T04:15:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- 172.21.15.32:0/331340387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac0c4360 msgr2=0x7fd7ac06cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/331340387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac0c4360 0x7fd7ac06cb30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac074610 tx=0x7fd79401c430 comp rx=0 tx=0).stop 2024-01-19T04:15:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- 172.21.15.32:0/331340387 shutdown_connections 2024-01-19T04:15:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/331340387 >> v2:172.21.15.67:3300/0 conn(0x7fd7ac070630 0x7fd7ac06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/331340387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac0c4360 0x7fd7ac06cb30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- 172.21.15.32:0/331340387 >> 172.21.15.32:0/331340387 conn(0x7fd7ac0c7d00 msgr2=0x7fd7ac0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- 172.21.15.32:0/331340387 shutdown_connections 2024-01-19T04:15:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- 172.21.15.32:0/331340387 wait complete. 2024-01-19T04:15:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 Processor -- start 2024-01-19T04:15:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- start start 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac070630 0x7fd7ac155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7ac0c4360 0x7fd7ac06f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac151dc0 0x7fd7ac1edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac156720 con 0x7fd7ac151dc0 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1ee160 con 0x7fd7ac070630 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7b1e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac06eeb0 con 0x7fd7ac0c4360 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac151dc0 0x7fd7ac1edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7aa000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7ac0c4360 0x7fd7ac06f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7aaa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac070630 0x7fd7ac155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac151dc0 0x7fd7ac1edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47196/0 (socket says 172.21.15.32:47196) 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7aa000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7ac0c4360 0x7fd7ac06f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:45628/0 (socket says 172.21.15.32:45628) 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.899+0000 7fd7ab400640 1 -- 172.21.15.32:0/160876805 learned_addr learned my addr 172.21.15.32:0/160876805 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7aa000640 1 -- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac070630 msgr2=0x7fd7ac155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7aa000640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac070630 0x7fd7ac155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7aa000640 1 -- 172.21.15.32:0/160876805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac151dc0 msgr2=0x7fd7ac1edc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7aa000640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac151dc0 0x7fd7ac1edc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7aa000640 1 -- 172.21.15.32:0/160876805 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794009420 con 0x7fd7ac0c4360 2024-01-19T04:15:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7aa000640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7ac0c4360 0x7fd7ac06f930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7940ac000 tx=0x7fd79401ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7a3400640 1 -- 172.21.15.32:0/160876805 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940abea0 con 0x7fd7ac0c4360 2024-01-19T04:15:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7a3400640 1 -- 172.21.15.32:0/160876805 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7940b5810 con 0x7fd7ac0c4360 2024-01-19T04:15:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac156440 con 0x7fd7ac0c4360 2024-01-19T04:15:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7a3400640 1 -- 172.21.15.32:0/160876805 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940b5bc0 con 0x7fd7ac0c4360 2024-01-19T04:15:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac06f430 con 0x7fd7ac0c4360 2024-01-19T04:15:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac06b900 con 0x7fd7ac0c4360 2024-01-19T04:15:24.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.903+0000 7fd7a3400640 1 -- 172.21.15.32:0/160876805 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd7940b5d20 con 0x7fd7ac0c4360 2024-01-19T04:15:24.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.907+0000 7fd7a3400640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd784066500 0x7fd7840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:24.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.907+0000 7fd7a3400640 1 -- 172.21.15.32:0/160876805 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd79411e9e0 con 0x7fd7ac0c4360 2024-01-19T04:15:24.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.907+0000 7fd7aaa00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd784066500 0x7fd7840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:24.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.907+0000 7fd7aaa00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd784066500 0x7fd7840689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000f70 tx=0x7fd79c007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:24.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:24.907+0000 7fd7a3400640 1 -- 172.21.15.32:0/160876805 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd7940ebec0 con 0x7fd7ac0c4360 2024-01-19T04:15:25.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.067+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7ac0749f0 con 0x7fd7ac0c4360 2024-01-19T04:15:25.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.067+0000 7fd7a3400640 1 -- 172.21.15.32:0/160876805 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7940ef4e0 con 0x7fd7ac0c4360 2024-01-19T04:15:25.072 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd784066500 msgr2=0x7fd7840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd784066500 0x7fd7840689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000f70 tx=0x7fd79c007e90 comp rx=0 tx=0).stop 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7ac0c4360 msgr2=0x7fd7ac06f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7ac0c4360 0x7fd7ac06f930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7940ac000 tx=0x7fd79401ac70 comp rx=0 tx=0).stop 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 shutdown_connections 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd784066500 0x7fd7840689c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7ac151dc0 0x7fd7ac1edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7ac0c4360 0x7fd7ac06f930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 --2- 172.21.15.32:0/160876805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7ac070630 0x7fd7ac155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 >> 172.21.15.32:0/160876805 conn(0x7fd7ac0c7d00 msgr2=0x7fd7ac151320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:25.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 shutdown_connections 2024-01-19T04:15:25.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.071+0000 7fd7b1e00640 1 -- 172.21.15.32:0/160876805 wait complete. 2024-01-19T04:15:25.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:25.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f66600640 1 Processor -- start 2024-01-19T04:15:25.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f66600640 1 -- start start 2024-01-19T04:15:25.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f66600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f600723b0 0x7f4f60152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f66600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f600c2080 0x7f4f60155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f66600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600a4ea0 con 0x7f4f6006d440 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f66600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f601524a0 con 0x7f4f600c2080 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f66600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60152a20 con 0x7f4f600723b0 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f600c2080 0x7f4f60155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f600c2080 0x7f4f60155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47198/0 (socket says 172.21.15.32:47198) 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5ea00640 1 -- 172.21.15.32:0/3469068018 learned_addr learned my addr 172.21.15.32:0/3469068018 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5f400640 1 --2- 172.21.15.32:0/3469068018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f600723b0 0x7f4f60152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5ea00640 1 -- 172.21.15.32:0/3469068018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f600723b0 msgr2=0x7f4f60152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5ea00640 1 --2- 172.21.15.32:0/3469068018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f600723b0 0x7f4f60152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5ea00640 1 -- 172.21.15.32:0/3469068018 >> v1:172.21.15.67:6789/0 conn(0x7f4f6006d440 legacy=0x7f4f600c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:25.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.235+0000 7f4f5ea00640 1 -- 172.21.15.32:0/3469068018 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f601533f0 con 0x7f4f600c2080 2024-01-19T04:15:25.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f5ea00640 1 --2- 172.21.15.32:0/3469068018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600c2080 0x7f4f60155a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009870 tx=0x7f4f4801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f4d8ec6bcb7bfb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f5e000640 1 -- 172.21.15.32:0/3469068018 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480ab620 con 0x7f4f600c2080 2024-01-19T04:15:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f5e000640 1 -- 172.21.15.32:0/3469068018 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f480ab780 con 0x7f4f600c2080 2024-01-19T04:15:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f5e000640 1 -- 172.21.15.32:0/3469068018 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480abb10 con 0x7f4f600c2080 2024-01-19T04:15:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 -- 172.21.15.32:0/3469068018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600c2080 msgr2=0x7f4f60155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 --2- 172.21.15.32:0/3469068018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600c2080 0x7f4f60155a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009870 tx=0x7f4f4801c420 comp rx=0 tx=0).stop 2024-01-19T04:15:25.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 -- 172.21.15.32:0/3469068018 shutdown_connections 2024-01-19T04:15:25.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 --2- 172.21.15.32:0/3469068018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600c2080 0x7f4f60155a90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 --2- 172.21.15.32:0/3469068018 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f600723b0 0x7f4f60152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 -- 172.21.15.32:0/3469068018 >> 172.21.15.32:0/3469068018 conn(0x7f4f600c25a0 msgr2=0x7f4f600c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:25.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 -- 172.21.15.32:0/3469068018 shutdown_connections 2024-01-19T04:15:25.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.239+0000 7f4f66600640 1 -- 172.21.15.32:0/3469068018 wait complete. 2024-01-19T04:15:25.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 Processor -- start 2024-01-19T04:15:25.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 -- start start 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f6006d440 0x7f4f600beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600723b0 0x7f4f60154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f600c2080 0x7f4f601ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60143ea0 con 0x7f4f600723b0 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6014fa60 con 0x7f4f600c2080 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600700e0 con 0x7f4f6006d440 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600723b0 0x7f4f60154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600723b0 0x7f4f60154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47200/0 (socket says 172.21.15.32:47200) 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 -- 172.21.15.32:0/1040090158 learned_addr learned my addr 172.21.15.32:0/1040090158 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5f400640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f6006d440 0x7f4f600beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5fe00640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f600c2080 0x7f4f601ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 -- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f6006d440 msgr2=0x7f4f600beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f6006d440 0x7f4f600beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 -- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f600c2080 msgr2=0x7f4f601ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f600c2080 0x7f4f601ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 -- 172.21.15.32:0/1040090158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480094d0 con 0x7f4f600723b0 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5f400640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f6006d440 0x7f4f600beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f5ea00640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600723b0 0x7f4f60154df0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f480ad040 tx=0x7f4f4801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f57400640 1 -- 172.21.15.32:0/1040090158 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480be3f0 con 0x7f4f600723b0 2024-01-19T04:15:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f57400640 1 -- 172.21.15.32:0/1040090158 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f480be570 con 0x7f4f600723b0 2024-01-19T04:15:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f57400640 1 -- 172.21.15.32:0/1040090158 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480be920 con 0x7f4f600723b0 2024-01-19T04:15:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f600703c0 con 0x7f4f600723b0 2024-01-19T04:15:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.243+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f60070980 con 0x7f4f600723b0 2024-01-19T04:15:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.247+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f60152670 con 0x7f4f600723b0 2024-01-19T04:15:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.247+0000 7f4f57400640 1 -- 172.21.15.32:0/1040090158 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4f480c7440 con 0x7f4f600723b0 2024-01-19T04:15:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.247+0000 7f4f57400640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4f38066500 0x7f4f380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.247+0000 7f4f57400640 1 -- 172.21.15.32:0/1040090158 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f4811e7d0 con 0x7f4f600723b0 2024-01-19T04:15:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.247+0000 7f4f5f400640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4f38066500 0x7f4f380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.247+0000 7f4f5f400640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4f38066500 0x7f4f380689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b9f0 tx=0x7f4f50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.251+0000 7f4f57400640 1 -- 172.21.15.32:0/1040090158 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4f480eba60 con 0x7f4f600723b0 2024-01-19T04:15:25.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.407+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f600749f0 con 0x7f4f600723b0 2024-01-19T04:15:25.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f57400640 1 -- 172.21.15.32:0/1040090158 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f480ef080 con 0x7f4f600723b0 2024-01-19T04:15:25.414 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4f38066500 msgr2=0x7f4f380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4f38066500 0x7f4f380689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b9f0 tx=0x7f4f50008040 comp rx=0 tx=0).stop 2024-01-19T04:15:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600723b0 msgr2=0x7f4f60154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600723b0 0x7f4f60154df0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f480ad040 tx=0x7f4f4801ac60 comp rx=0 tx=0).stop 2024-01-19T04:15:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 shutdown_connections 2024-01-19T04:15:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4f38066500 0x7f4f380689c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4f600c2080 0x7f4f601ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f600723b0 0x7f4f60154df0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 --2- 172.21.15.32:0/1040090158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4f6006d440 0x7f4f600beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 >> 172.21.15.32:0/1040090158 conn(0x7f4f600c25a0 msgr2=0x7f4f600c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 shutdown_connections 2024-01-19T04:15:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.411+0000 7f4f66600640 1 -- 172.21.15.32:0/1040090158 wait complete. 2024-01-19T04:15:25.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:25.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc19800640 1 Processor -- start 2024-01-19T04:15:25.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc19800640 1 -- start start 2024-01-19T04:15:25.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc19800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc14151b30 0x7fcc140c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc19800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc1406e8d0 0x7fcc140c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc19800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc140c86a0 con 0x7fcc1406fa50 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc19800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc141555e0 con 0x7fcc1406e8d0 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc19800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc14155020 con 0x7fcc14151b30 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc1406e8d0 0x7fcc140c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc1406e8d0 0x7fcc140c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47214/0 (socket says 172.21.15.32:47214) 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12000640 1 -- 172.21.15.32:0/1742441879 learned_addr learned my addr 172.21.15.32:0/1742441879 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12a00640 1 --2- 172.21.15.32:0/1742441879 >> v2:172.21.15.67:3300/0 conn(0x7fcc14151b30 0x7fcc140c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12000640 1 -- 172.21.15.32:0/1742441879 >> v2:172.21.15.67:3300/0 conn(0x7fcc14151b30 msgr2=0x7fcc140c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:25.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12000640 1 --2- 172.21.15.32:0/1742441879 >> v2:172.21.15.67:3300/0 conn(0x7fcc14151b30 0x7fcc140c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12000640 1 -- 172.21.15.32:0/1742441879 >> v1:172.21.15.67:6789/0 conn(0x7fcc1406fa50 legacy=0x7fcc140c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:25.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.575+0000 7fcc12000640 1 -- 172.21.15.32:0/1742441879 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14155300 con 0x7fcc1406e8d0 2024-01-19T04:15:25.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc12000640 1 --2- 172.21.15.32:0/1742441879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406e8d0 0x7fcc140c7e40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc140673a0 tx=0x7fcbfc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7d5e2a396f733c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc11600640 1 -- 172.21.15.32:0/1742441879 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0ab640 con 0x7fcc1406e8d0 2024-01-19T04:15:25.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc11600640 1 -- 172.21.15.32:0/1742441879 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0a7070 con 0x7fcc1406e8d0 2024-01-19T04:15:25.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc11600640 1 -- 172.21.15.32:0/1742441879 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0ab9c0 con 0x7fcc1406e8d0 2024-01-19T04:15:25.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 -- 172.21.15.32:0/1742441879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406e8d0 msgr2=0x7fcc140c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 --2- 172.21.15.32:0/1742441879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406e8d0 0x7fcc140c7e40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc140673a0 tx=0x7fcbfc01c440 comp rx=0 tx=0).stop 2024-01-19T04:15:25.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 -- 172.21.15.32:0/1742441879 shutdown_connections 2024-01-19T04:15:25.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 --2- 172.21.15.32:0/1742441879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406e8d0 0x7fcc140c7e40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 --2- 172.21.15.32:0/1742441879 >> v2:172.21.15.67:3300/0 conn(0x7fcc14151b30 0x7fcc140c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 -- 172.21.15.32:0/1742441879 >> 172.21.15.32:0/1742441879 conn(0x7fcc1406ddb0 msgr2=0x7fcc1406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:25.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 -- 172.21.15.32:0/1742441879 shutdown_connections 2024-01-19T04:15:25.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.579+0000 7fcc19800640 1 -- 172.21.15.32:0/1742441879 wait complete. 2024-01-19T04:15:25.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 Processor -- start 2024-01-19T04:15:25.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 -- start start 2024-01-19T04:15:25.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc1406e8d0 0x7fcc14150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406fa50 0x7fcc141ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc14151b30 0x7fcc141ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140bf310 con 0x7fcc1406fa50 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140ad910 con 0x7fcc1406e8d0 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14158040 con 0x7fcc14151b30 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406fa50 0x7fcc141ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406fa50 0x7fcc141ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47228/0 (socket says 172.21.15.32:47228) 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc1406e8d0 0x7fcc14150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 -- 172.21.15.32:0/925982283 learned_addr learned my addr 172.21.15.32:0/925982283 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc13400640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc14151b30 0x7fcc141ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 -- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc14151b30 msgr2=0x7fcc141ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc14151b30 0x7fcc141ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 -- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc1406e8d0 msgr2=0x7fcc14150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc1406e8d0 0x7fcc14150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 -- 172.21.15.32:0/925982283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0094d0 con 0x7fcc1406fa50 2024-01-19T04:15:25.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc12000640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406fa50 0x7fcc141ed030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc01c920 tx=0x7fcbfc01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc0aa00640 1 -- 172.21.15.32:0/925982283 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0be3f0 con 0x7fcc1406fa50 2024-01-19T04:15:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc0aa00640 1 -- 172.21.15.32:0/925982283 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0be570 con 0x7fcc1406fa50 2024-01-19T04:15:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc0aa00640 1 -- 172.21.15.32:0/925982283 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0be920 con 0x7fcc1406fa50 2024-01-19T04:15:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.583+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc140c2110 con 0x7fcc1406fa50 2024-01-19T04:15:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.587+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc140ad3f0 con 0x7fcc1406fa50 2024-01-19T04:15:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.587+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc140ad5e0 con 0x7fcc1406fa50 2024-01-19T04:15:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.587+0000 7fcc0aa00640 1 -- 172.21.15.32:0/925982283 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcbfc0c7440 con 0x7fcc1406fa50 2024-01-19T04:15:25.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.587+0000 7fcc0aa00640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcbec066500 0x7fcbec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.587+0000 7fcc0aa00640 1 -- 172.21.15.32:0/925982283 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbfc11e7a0 con 0x7fcc1406fa50 2024-01-19T04:15:25.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.587+0000 7fcc12a00640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcbec066500 0x7fcbec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.587+0000 7fcc12a00640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcbec066500 0x7fcbec0689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc040079c0 tx=0x7fcc04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.591+0000 7fcc0aa00640 1 -- 172.21.15.32:0/925982283 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcbfc0ebae0 con 0x7fcc1406fa50 2024-01-19T04:15:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.755+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc140749f0 con 0x7fcc1406fa50 2024-01-19T04:15:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.755+0000 7fcc0aa00640 1 -- 172.21.15.32:0/925982283 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbfc0ef100 con 0x7fcc1406fa50 2024-01-19T04:15:25.761 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcbec066500 msgr2=0x7fcbec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcbec066500 0x7fcbec0689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc040079c0 tx=0x7fcc04008040 comp rx=0 tx=0).stop 2024-01-19T04:15:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406fa50 msgr2=0x7fcc141ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406fa50 0x7fcc141ed030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc01c920 tx=0x7fcbfc01ac80 comp rx=0 tx=0).stop 2024-01-19T04:15:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 shutdown_connections 2024-01-19T04:15:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcbec066500 0x7fcbec0689c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcc14151b30 0x7fcc141ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc1406fa50 0x7fcc141ed030 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 --2- 172.21.15.32:0/925982283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc1406e8d0 0x7fcc14150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 >> 172.21.15.32:0/925982283 conn(0x7fcc1406ddb0 msgr2=0x7fcc1406e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:25.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 shutdown_connections 2024-01-19T04:15:25.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.759+0000 7fcc19800640 1 -- 172.21.15.32:0/925982283 wait complete. 2024-01-19T04:15:25.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:25.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9151400640 1 Processor -- start 2024-01-19T04:15:25.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9151400640 1 -- start start 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9151400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f914c0c4b10 0x7f914c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9151400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f914c070ef0 0x7f914c156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9151400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c0724c0 con 0x7f914c155520 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9151400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c155900 con 0x7f914c070ef0 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9151400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0c5630 con 0x7f914c0c4b10 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f914a800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f914c155520 0x7f914c06a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54936/0 (socket says 172.21.15.32:54936) 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f914a800640 1 -- 172.21.15.32:0/2675931306 learned_addr learned my addr 172.21.15.32:0/2675931306 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f914b200640 1 --2- 172.21.15.32:0/2675931306 >> v2:172.21.15.32:3300/0 conn(0x7f914c070ef0 0x7f914c156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9149e00640 1 --2- 172.21.15.32:0/2675931306 >> v2:172.21.15.67:3300/0 conn(0x7f914c0c4b10 0x7f914c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9149400640 1 -- 172.21.15.32:0/2675931306 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602495612 0 0) 0x7f914c0724c0 con 0x7f914c155520 2024-01-19T04:15:25.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f914b200640 1 -- 172.21.15.32:0/2675931306 >> v2:172.21.15.67:3300/0 conn(0x7f914c0c4b10 msgr2=0x7f914c155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:25.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f914b200640 1 --2- 172.21.15.32:0/2675931306 >> v2:172.21.15.67:3300/0 conn(0x7f914c0c4b10 0x7f914c155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f914b200640 1 -- 172.21.15.32:0/2675931306 >> v1:172.21.15.32:6789/0 conn(0x7f914c155520 legacy=0x7f914c06a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f914b200640 1 -- 172.21.15.32:0/2675931306 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0c5910 con 0x7f914c070ef0 2024-01-19T04:15:25.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.919+0000 7f9149e00640 1 --2- 172.21.15.32:0/2675931306 >> v2:172.21.15.67:3300/0 conn(0x7f914c0c4b10 0x7f914c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:25.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f914b200640 1 --2- 172.21.15.32:0/2675931306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c156170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f914c06c6c0 tx=0x7f914401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945c4d189e24364e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9149400640 1 -- 172.21.15.32:0/2675931306 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440a5830 con 0x7f914c070ef0 2024-01-19T04:15:25.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9149400640 1 -- 172.21.15.32:0/2675931306 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91440a5990 con 0x7f914c070ef0 2024-01-19T04:15:25.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9149400640 1 -- 172.21.15.32:0/2675931306 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440a5d20 con 0x7f914c070ef0 2024-01-19T04:15:25.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 -- 172.21.15.32:0/2675931306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 msgr2=0x7f914c156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 --2- 172.21.15.32:0/2675931306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c156170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f914c06c6c0 tx=0x7f914401c880 comp rx=0 tx=0).stop 2024-01-19T04:15:25.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 -- 172.21.15.32:0/2675931306 shutdown_connections 2024-01-19T04:15:25.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 --2- 172.21.15.32:0/2675931306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c156170 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 --2- 172.21.15.32:0/2675931306 >> v2:172.21.15.67:3300/0 conn(0x7f914c0c4b10 0x7f914c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 -- 172.21.15.32:0/2675931306 >> 172.21.15.32:0/2675931306 conn(0x7f914c06bdb0 msgr2=0x7f914c0a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 -- 172.21.15.32:0/2675931306 shutdown_connections 2024-01-19T04:15:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.923+0000 7f9151400640 1 -- 172.21.15.32:0/2675931306 wait complete. 2024-01-19T04:15:25.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 Processor -- start 2024-01-19T04:15:25.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 -- start start 2024-01-19T04:15:25.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f914c0c4b10 0x7f914c14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c155520 0x7f914c0a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0a7750 con 0x7f914c070ef0 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0a6900 con 0x7f914c155520 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0a8410 con 0x7f914c0c4b10 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47242/0 (socket says 172.21.15.32:47242) 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 -- 172.21.15.32:0/184367558 learned_addr learned my addr 172.21.15.32:0/184367558 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9149e00640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f914c0c4b10 0x7f914c14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914b200640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c155520 0x7f914c0a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 -- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f914c0c4b10 msgr2=0x7f914c14a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f914c0c4b10 0x7f914c14a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 -- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c155520 msgr2=0x7f914c0a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c155520 0x7f914c0a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 -- 172.21.15.32:0/184367558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144009a70 con 0x7f914c070ef0 2024-01-19T04:15:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9149e00640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f914c0c4b10 0x7f914c14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f914a800640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c14dce0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c4b0 tx=0x7f913c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9142a00640 1 -- 172.21.15.32:0/184367558 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0074e0 con 0x7f914c070ef0 2024-01-19T04:15:25.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9142a00640 1 -- 172.21.15.32:0/184367558 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c007660 con 0x7f914c070ef0 2024-01-19T04:15:25.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9142a00640 1 -- 172.21.15.32:0/184367558 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c004a30 con 0x7f914c070ef0 2024-01-19T04:15:25.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c153e70 con 0x7f914c070ef0 2024-01-19T04:15:25.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.927+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c14c8b0 con 0x7f914c070ef0 2024-01-19T04:15:25.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.931+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c0749f0 con 0x7f914c070ef0 2024-01-19T04:15:25.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.931+0000 7f9142a00640 1 -- 172.21.15.32:0/184367558 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f913c004b90 con 0x7f914c070ef0 2024-01-19T04:15:25.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.931+0000 7f9142a00640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9124066530 0x7f91240689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:25.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.931+0000 7f9142a00640 1 -- 172.21.15.32:0/184367558 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f913c082ed0 con 0x7f914c070ef0 2024-01-19T04:15:25.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.931+0000 7f9149e00640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9124066530 0x7f91240689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:25.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.931+0000 7f9149e00640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9124066530 0x7f91240689f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f914c14f680 tx=0x7f9134008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:25.935+0000 7f9142a00640 1 -- 172.21.15.32:0/184367558 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f913c050210 con 0x7f914c070ef0 2024-01-19T04:15:26.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.095+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f914c0c79e0 con 0x7f914c070ef0 2024-01-19T04:15:26.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.095+0000 7f9142a00640 1 -- 172.21.15.32:0/184367558 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f913c018090 con 0x7f914c070ef0 2024-01-19T04:15:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:26.101 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9124066530 msgr2=0x7f91240689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9124066530 0x7f91240689f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f914c14f680 tx=0x7f9134008040 comp rx=0 tx=0).stop 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 msgr2=0x7f914c14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c14dce0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c4b0 tx=0x7f913c00c970 comp rx=0 tx=0).stop 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 shutdown_connections 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9124066530 0x7f91240689f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f914c155520 0x7f914c0a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f914c0c4b10 0x7f914c14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 --2- 172.21.15.32:0/184367558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914c070ef0 0x7f914c14dce0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 >> 172.21.15.32:0/184367558 conn(0x7f914c06bdb0 msgr2=0x7f914c153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:26.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 shutdown_connections 2024-01-19T04:15:26.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.099+0000 7f9151400640 1 -- 172.21.15.32:0/184367558 wait complete. 2024-01-19T04:15:26.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:26.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:26.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 Processor -- start 2024-01-19T04:15:26.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 -- start start 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7feae806f810 0x7feae80a7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feae80a7000 0x7feae806fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae8158580 0x7feae81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80c1970 con 0x7feae806f810 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae8151fe0 con 0x7feae80a7000 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaefe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8157b30 con 0x7feae8158580 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7feae806f810 0x7feae80a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7feae806f810 0x7feae80a7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47256/0 (socket says 172.21.15.32:47256) 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 -- 172.21.15.32:0/1554836531 learned_addr learned my addr 172.21.15.32:0/1554836531 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:26.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaeca00640 1 --2- 172.21.15.32:0/1554836531 >> v2:172.21.15.67:3300/0 conn(0x7feae80a7000 0x7feae806fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaede00640 1 --2- 172.21.15.32:0/1554836531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae8158580 0x7feae81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 -- 172.21.15.32:0/1554836531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae8158580 msgr2=0x7feae81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 --2- 172.21.15.32:0/1554836531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae8158580 0x7feae81545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 -- 172.21.15.32:0/1554836531 >> v2:172.21.15.67:3300/0 conn(0x7feae80a7000 msgr2=0x7feae806fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 --2- 172.21.15.32:0/1554836531 >> v2:172.21.15.67:3300/0 conn(0x7feae80a7000 0x7feae806fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.263+0000 7feaed400640 1 -- 172.21.15.32:0/1554836531 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae81580f0 con 0x7feae806f810 2024-01-19T04:15:26.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaed400640 1 --2- 172.21.15.32:0/1554836531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae806f810 0x7feae80a7550 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feae8070420 tx=0x7fead801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce98f4e3fd9ac09 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feae7e00640 1 -- 172.21.15.32:0/1554836531 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80ab600 con 0x7feae806f810 2024-01-19T04:15:26.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feae7e00640 1 -- 172.21.15.32:0/1554836531 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead80a7050 con 0x7feae806f810 2024-01-19T04:15:26.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feae7e00640 1 -- 172.21.15.32:0/1554836531 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80ab980 con 0x7feae806f810 2024-01-19T04:15:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 -- 172.21.15.32:0/1554836531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae806f810 msgr2=0x7feae80a7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 --2- 172.21.15.32:0/1554836531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae806f810 0x7feae80a7550 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feae8070420 tx=0x7fead801c470 comp rx=0 tx=0).stop 2024-01-19T04:15:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 -- 172.21.15.32:0/1554836531 shutdown_connections 2024-01-19T04:15:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 --2- 172.21.15.32:0/1554836531 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae8158580 0x7feae81545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 --2- 172.21.15.32:0/1554836531 >> v2:172.21.15.67:3300/0 conn(0x7feae80a7000 0x7feae806fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 --2- 172.21.15.32:0/1554836531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae806f810 0x7feae80a7550 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 -- 172.21.15.32:0/1554836531 >> 172.21.15.32:0/1554836531 conn(0x7feae80726d0 msgr2=0x7feae80663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 -- 172.21.15.32:0/1554836531 shutdown_connections 2024-01-19T04:15:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.267+0000 7feaefe00640 1 -- 172.21.15.32:0/1554836531 wait complete. 2024-01-19T04:15:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 Processor -- start 2024-01-19T04:15:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 -- start start 2024-01-19T04:15:26.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feae806f810 0x7feae814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae80a7000 0x7feae81f0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae8158580 0x7feae81f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8156450 con 0x7feae8158580 2024-01-19T04:15:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81571a0 con 0x7feae806f810 2024-01-19T04:15:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8156b50 con 0x7feae80a7000 2024-01-19T04:15:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae8158580 0x7feae81f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaed400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feae806f810 0x7feae814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae8158580 0x7feae81f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47264/0 (socket says 172.21.15.32:47264) 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaeca00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae80a7000 0x7feae81f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 -- 172.21.15.32:0/405522574 learned_addr learned my addr 172.21.15.32:0/405522574 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 -- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae80a7000 msgr2=0x7feae81f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae80a7000 0x7feae81f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 -- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feae806f810 msgr2=0x7feae814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feae806f810 0x7feae814b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 -- 172.21.15.32:0/405522574 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80094d0 con 0x7feae8158580 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaede00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae8158580 0x7feae81f0760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feae0007e90 tx=0x7feae000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feae5600640 1 -- 172.21.15.32:0/405522574 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0014420 con 0x7feae8158580 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feae5600640 1 -- 172.21.15.32:0/405522574 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae0014580 con 0x7feae8158580 2024-01-19T04:15:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feae5600640 1 -- 172.21.15.32:0/405522574 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0014930 con 0x7feae8158580 2024-01-19T04:15:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae8156e30 con 0x7feae8158580 2024-01-19T04:15:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.271+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae814a330 con 0x7feae8158580 2024-01-19T04:15:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.275+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae804e980 con 0x7feae8158580 2024-01-19T04:15:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.275+0000 7feae5600640 1 -- 172.21.15.32:0/405522574 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7feae0014a90 con 0x7feae8158580 2024-01-19T04:15:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.275+0000 7feae5600640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feac0066500 0x7feac00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.275+0000 7feae5600640 1 -- 172.21.15.32:0/405522574 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feae0084630 con 0x7feae8158580 2024-01-19T04:15:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.275+0000 7feaed400640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feac0066500 0x7feac00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.275+0000 7feaed400640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feac0066500 0x7feac00689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fead80ad000 tx=0x7fead80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.279+0000 7feae5600640 1 -- 172.21.15.32:0/405522574 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7feae0051970 con 0x7feae8158580 2024-01-19T04:15:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.439+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feae8151ac0 con 0x7feae8158580 2024-01-19T04:15:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feae5600640 1 -- 172.21.15.32:0/405522574 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7feae0054f90 con 0x7feae8158580 2024-01-19T04:15:26.446 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:26.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feac0066500 msgr2=0x7feac00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feac0066500 0x7feac00689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fead80ad000 tx=0x7fead80a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:26.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae8158580 msgr2=0x7feae81f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae8158580 0x7feae81f0760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feae0007e90 tx=0x7feae000e4b0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 shutdown_connections 2024-01-19T04:15:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7feac0066500 0x7feac00689c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae8158580 0x7feae81f0760 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feae80a7000 0x7feae81f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 --2- 172.21.15.32:0/405522574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feae806f810 0x7feae814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 >> 172.21.15.32:0/405522574 conn(0x7feae80726d0 msgr2=0x7feae80663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 shutdown_connections 2024-01-19T04:15:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.443+0000 7feaefe00640 1 -- 172.21.15.32:0/405522574 wait complete. 2024-01-19T04:15:26.468 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:26.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2bc800640 1 Processor -- start 2024-01-19T04:15:26.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2bc800640 1 -- start start 2024-01-19T04:15:26.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2bc800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2b40723b0 0x7fc2b4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2bc800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b40c2080 0x7fc2b4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2bc800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b40a4ea0 con 0x7fc2b406d440 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2bc800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b41524a0 con 0x7fc2b40723b0 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2bc800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4152a20 con 0x7fc2b40c2080 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2b9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2b40723b0 0x7fc2b4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2b9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2b40723b0 0x7fc2b4152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47268/0 (socket says 172.21.15.32:47268) 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.607+0000 7fc2b9e00640 1 -- 172.21.15.32:0/1763766216 learned_addr learned my addr 172.21.15.32:0/1763766216 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b9400640 1 --2- 172.21.15.32:0/1763766216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b40c2080 0x7fc2b4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b9e00640 1 -- 172.21.15.32:0/1763766216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b40c2080 msgr2=0x7fc2b4155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b9e00640 1 --2- 172.21.15.32:0/1763766216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b40c2080 0x7fc2b4155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b9e00640 1 -- 172.21.15.32:0/1763766216 >> v1:172.21.15.67:6789/0 conn(0x7fc2b406d440 legacy=0x7fc2b40c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b9e00640 1 -- 172.21.15.32:0/1763766216 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b41533f0 con 0x7fc2b40723b0 2024-01-19T04:15:26.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b9400640 1 --2- 172.21.15.32:0/1763766216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b40c2080 0x7fc2b4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:26.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b9e00640 1 --2- 172.21.15.32:0/1763766216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4152eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009870 tx=0x7fc2a401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb06828a44e8bc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b8a00640 1 -- 172.21.15.32:0/1763766216 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40ac600 con 0x7fc2b40723b0 2024-01-19T04:15:26.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b8a00640 1 -- 172.21.15.32:0/1763766216 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a40a8050 con 0x7fc2b40723b0 2024-01-19T04:15:26.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.611+0000 7fc2b8a00640 1 -- 172.21.15.32:0/1763766216 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40ac980 con 0x7fc2b40723b0 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- 172.21.15.32:0/1763766216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 msgr2=0x7fc2b4152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 --2- 172.21.15.32:0/1763766216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4152eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009870 tx=0x7fc2a401c3e0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- 172.21.15.32:0/1763766216 shutdown_connections 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 --2- 172.21.15.32:0/1763766216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b40c2080 0x7fc2b4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 --2- 172.21.15.32:0/1763766216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4152eb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- 172.21.15.32:0/1763766216 >> 172.21.15.32:0/1763766216 conn(0x7fc2b40c25a0 msgr2=0x7fc2b40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- 172.21.15.32:0/1763766216 shutdown_connections 2024-01-19T04:15:26.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- 172.21.15.32:0/1763766216 wait complete. 2024-01-19T04:15:26.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 Processor -- start 2024-01-19T04:15:26.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- start start 2024-01-19T04:15:26.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b406d440 0x7fc2b41f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2b40c2080 0x7fc2b4145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b41545c0 con 0x7fc2b40723b0 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4146fd0 con 0x7fc2b40c2080 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2bc800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4154000 con 0x7fc2b406d440 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2b9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2b9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47276/0 (socket says 172.21.15.32:47276) 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.615+0000 7fc2b9400640 1 -- 172.21.15.32:0/2971607634 learned_addr learned my addr 172.21.15.32:0/2971607634 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b9e00640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b406d440 0x7fc2b41f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2ba800640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2b40c2080 0x7fc2b4145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b9400640 1 -- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b406d440 msgr2=0x7fc2b41f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b9400640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b406d440 0x7fc2b41f0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b9400640 1 -- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2b40c2080 msgr2=0x7fc2b4145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b9400640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2b40c2080 0x7fc2b4145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b9400640 1 -- 172.21.15.32:0/2971607634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40094d0 con 0x7fc2b40723b0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b9400640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4151c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00c7f0 tx=0x7fc29c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b2000640 1 -- 172.21.15.32:0/2971607634 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c007820 con 0x7fc2b40723b0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b2000640 1 -- 172.21.15.32:0/2971607634 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c007980 con 0x7fc2b40723b0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b2000640 1 -- 172.21.15.32:0/2971607634 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c007cf0 con 0x7fc2b40723b0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b41542e0 con 0x7fc2b40723b0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b414b2c0 con 0x7fc2b40723b0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b4146d30 con 0x7fc2b40723b0 2024-01-19T04:15:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b2000640 1 -- 172.21.15.32:0/2971607634 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc29c0113f0 con 0x7fc2b40723b0 2024-01-19T04:15:26.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b2000640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc28c066530 0x7fc28c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.619+0000 7fc2b2000640 1 -- 172.21.15.32:0/2971607634 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc29c0840d0 con 0x7fc2b40723b0 2024-01-19T04:15:26.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.623+0000 7fc2b9e00640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc28c066530 0x7fc28c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.623+0000 7fc2b9e00640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc28c066530 0x7fc28c0689f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40ae000 tx=0x7fc2a40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.623+0000 7fc2b2000640 1 -- 172.21.15.32:0/2971607634 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc2b4146d30 con 0x7fc2b40723b0 2024-01-19T04:15:26.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.787+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2b4146d30 con 0x7fc2b40723b0 2024-01-19T04:15:26.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.787+0000 7fc2b2000640 1 -- 172.21.15.32:0/2971607634 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2b4146d30 con 0x7fc2b40723b0 2024-01-19T04:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:26.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc28c066530 msgr2=0x7fc28c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc28c066530 0x7fc28c0689f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40ae000 tx=0x7fc2a40a7000 comp rx=0 tx=0).stop 2024-01-19T04:15:26.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 msgr2=0x7fc2b4151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4151c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00c7f0 tx=0x7fc29c00ccb0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 shutdown_connections 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc28c066530 0x7fc28c0689f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2b40c2080 0x7fc2b4145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2b40723b0 0x7fc2b4151c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 --2- 172.21.15.32:0/2971607634 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2b406d440 0x7fc2b41f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 >> 172.21.15.32:0/2971607634 conn(0x7fc2b40c25a0 msgr2=0x7fc2b4150310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 shutdown_connections 2024-01-19T04:15:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.791+0000 7fc2bc800640 1 -- 172.21.15.32:0/2971607634 wait complete. 2024-01-19T04:15:26.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:26.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73cac00640 1 Processor -- start 2024-01-19T04:15:26.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73cac00640 1 -- start start 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73cac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 0x7f73c406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73cac00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c406c6a0 con 0x7f73c4151dc0 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73cac00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c41521a0 con 0x7f73c40c4360 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73cac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c4154cf0 con 0x7f73c4070630 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f73c4151dc0 0x7f73c40c1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54940/0 (socket says 172.21.15.32:54940) 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c3e00640 1 -- 172.21.15.32:0/2224063973 learned_addr learned my addr 172.21.15.32:0/2224063973 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c8c00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 0x7f73c406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163389896 0 0) 0x7f73c406c6a0 con 0x7f73c4151dc0 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a4003530 con 0x7f73c4151dc0 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787971038 0 0) 0x7f73a4003530 con 0x7f73c4151dc0 2024-01-19T04:15:26.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 msgr2=0x7f73c406d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 0x7f73c406d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 >> v1:172.21.15.67:6789/0 conn(0x7f73c40c4360 legacy=0x7f73c406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4154fd0 con 0x7f73c4151dc0 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f73b4001680 con 0x7f73c4151dc0 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 >> v1:172.21.15.32:6789/0 conn(0x7f73c4151dc0 legacy=0x7f73c40c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73a40039b0 0x7f73a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 0x7f73a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c4154cf0 con 0x7f73a4004d10 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a400b990 con 0x7f73a40039b0 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a400bb50 con 0x7f73c4070630 2024-01-19T04:15:26.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c8c00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c3e00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73a40039b0 0x7f73a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.955+0000 7f73c3400640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 0x7f73a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c8c00640 1 -- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 msgr2=0x7f73a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:26.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c8c00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4070630 0x7f73a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c8c00640 1 -- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73a40039b0 msgr2=0x7f73a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:26.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c8c00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73a40039b0 0x7f73a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c8c00640 1 -- 172.21.15.32:0/2224063973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4003530 con 0x7f73a4004d10 2024-01-19T04:15:26.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c8c00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73a4005190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009fc0 tx=0x7f73bc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f39529a7bea9df server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4007ea0 con 0x7f73a4004d10 2024-01-19T04:15:26.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc00f040 con 0x7f73a4004d10 2024-01-19T04:15:26.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c2a00640 1 -- 172.21.15.32:0/2224063973 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0ad440 con 0x7f73a4004d10 2024-01-19T04:15:26.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73cac00640 1 -- 172.21.15.32:0/2224063973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 msgr2=0x7f73a4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73cac00640 1 --2- 172.21.15.32:0/2224063973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73a4005190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009fc0 tx=0x7f73bc01cc60 comp rx=0 tx=0).stop 2024-01-19T04:15:26.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.959+0000 7f73c8c00640 1 -- 172.21.15.32:0/2224063973 reap_dead start 2024-01-19T04:15:26.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- 172.21.15.32:0/2224063973 shutdown_connections 2024-01-19T04:15:26.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- 172.21.15.32:0/2224063973 >> 172.21.15.32:0/2224063973 conn(0x7f73c40c7d00 msgr2=0x7f73c40c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:26.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- 172.21.15.32:0/2224063973 shutdown_connections 2024-01-19T04:15:26.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- 172.21.15.32:0/2224063973 wait complete. 2024-01-19T04:15:26.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 Processor -- start 2024-01-19T04:15:26.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- start start 2024-01-19T04:15:26.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73c41ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c406f2c0 0x7f73c41eb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4155c70 0x7f73c414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c4158c60 con 0x7f73a4004d10 2024-01-19T04:15:26.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c406ee30 con 0x7f73c406f2c0 2024-01-19T04:15:26.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73cac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c41ede90 con 0x7f73c4155c70 2024-01-19T04:15:26.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73c41ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73c41ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47302/0 (socket says 172.21.15.32:47302) 2024-01-19T04:15:26.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 -- 172.21.15.32:0/3461300029 learned_addr learned my addr 172.21.15.32:0/3461300029 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c8c00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4155c70 0x7f73c414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3400640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c406f2c0 0x7f73c41eb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 -- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4155c70 msgr2=0x7f73c414cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4155c70 0x7f73c414cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 -- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c406f2c0 msgr2=0x7f73c41eb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c406f2c0 0x7f73c41eb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.963+0000 7f73c3e00640 1 -- 172.21.15.32:0/3461300029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c406e7e0 con 0x7f73a4004d10 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73c3e00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73c41ed560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73b4012490 tx=0x7f73b4012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73bbe00640 1 -- 172.21.15.32:0/3461300029 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4014750 con 0x7f73a4004d10 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73bbe00640 1 -- 172.21.15.32:0/3461300029 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b40148b0 con 0x7f73a4004d10 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73bbe00640 1 -- 172.21.15.32:0/3461300029 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4014c60 con 0x7f73a4004d10 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c406eac0 con 0x7f73a4004d10 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c41ee170 con 0x7f73a4004d10 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c406ec50 con 0x7f73a4004d10 2024-01-19T04:15:26.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73bbe00640 1 -- 172.21.15.32:0/3461300029 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f73b40153e0 con 0x7f73a4004d10 2024-01-19T04:15:26.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73bbe00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f739c066500 0x7f739c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:26.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73bbe00640 1 -- 172.21.15.32:0/3461300029 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73b4086680 con 0x7f73a4004d10 2024-01-19T04:15:26.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.967+0000 7f73c3400640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f739c066500 0x7f739c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:26.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.971+0000 7f73c3400640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f739c066500 0x7f739c0689c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73c41e7bd0 tx=0x7f73ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:26.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:26.971+0000 7f73bbe00640 1 -- 172.21.15.32:0/3461300029 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f73b40539c0 con 0x7f73a4004d10 2024-01-19T04:15:27.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.131+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73c40749f0 con 0x7f73a4004d10 2024-01-19T04:15:27.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.131+0000 7f73bbe00640 1 -- 172.21.15.32:0/3461300029 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73b4056fe0 con 0x7f73a4004d10 2024-01-19T04:15:27.136 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f739c066500 msgr2=0x7f739c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f739c066500 0x7f739c0689c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73c41e7bd0 tx=0x7f73ac009040 comp rx=0 tx=0).stop 2024-01-19T04:15:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 msgr2=0x7f73c41ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73c41ed560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73b4012490 tx=0x7f73b4012950 comp rx=0 tx=0).stop 2024-01-19T04:15:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 shutdown_connections 2024-01-19T04:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f739c066500 0x7f739c0689c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73c4155c70 0x7f73c414cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73c406f2c0 0x7f73c41eb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 --2- 172.21.15.32:0/3461300029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a4004d10 0x7f73c41ed560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 >> 172.21.15.32:0/3461300029 conn(0x7f73c40c7d00 msgr2=0x7f73c40c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 shutdown_connections 2024-01-19T04:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.135+0000 7f73cac00640 1 -- 172.21.15.32:0/3461300029 wait complete. 2024-01-19T04:15:27.198 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-19T04:15:27.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:27.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.335+0000 7ff8e3400640 1 Processor -- start 2024-01-19T04:15:27.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.335+0000 7ff8e3400640 1 -- start start 2024-01-19T04:15:27.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.335+0000 7ff8e3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.335+0000 7ff8e3400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc1547e0 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.335+0000 7ff8e3400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc06f820 con 0x7ff8dc151de0 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.335+0000 7ff8e3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1521c0 con 0x7ff8dc0a7200 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8e1400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff8dc0c41f0 0x7ff8dc154c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54942/0 (socket says 172.21.15.32:54942) 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8e1400640 1 -- 172.21.15.32:0/280815514 learned_addr learned my addr 172.21.15.32:0/280815514 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8dbe00640 1 --2- 172.21.15.32:0/280815514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8db400640 1 -- 172.21.15.32:0/280815514 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757216326 0 0) 0x7ff8dc1547e0 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8db400640 1 -- 172.21.15.32:0/280815514 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8bc003530 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8db400640 1 -- 172.21.15.32:0/280815514 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282351535 0 0) 0x7ff8dc06f820 con 0x7ff8dc151de0 2024-01-19T04:15:27.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8dbe00640 1 -- 172.21.15.32:0/280815514 >> v1:172.21.15.67:6789/0 conn(0x7ff8dc151de0 legacy=0x7ff8dc0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8dbe00640 1 -- 172.21.15.32:0/280815514 >> v1:172.21.15.32:6789/0 conn(0x7ff8dc0c41f0 legacy=0x7ff8dc154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8dbe00640 1 -- 172.21.15.32:0/280815514 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc06fb00 con 0x7ff8dc0a7200 2024-01-19T04:15:27.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8dbe00640 1 --2- 172.21.15.32:0/280815514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc0c3cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40097f0 tx=0x7ff8c401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1329b057e2ceb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:27.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.339+0000 7ff8db400640 1 -- 172.21.15.32:0/280815514 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40ab620 con 0x7ff8dc0a7200 2024-01-19T04:15:27.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8db400640 1 -- 172.21.15.32:0/280815514 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c40ab780 con 0x7ff8dc0a7200 2024-01-19T04:15:27.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8db400640 1 -- 172.21.15.32:0/280815514 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40abb10 con 0x7ff8dc0a7200 2024-01-19T04:15:27.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- 172.21.15.32:0/280815514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 msgr2=0x7ff8dc0c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 --2- 172.21.15.32:0/280815514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc0c3cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40097f0 tx=0x7ff8c401c400 comp rx=0 tx=0).stop 2024-01-19T04:15:27.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- 172.21.15.32:0/280815514 shutdown_connections 2024-01-19T04:15:27.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 --2- 172.21.15.32:0/280815514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc0c3cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- 172.21.15.32:0/280815514 >> 172.21.15.32:0/280815514 conn(0x7ff8dc0726d0 msgr2=0x7ff8dc0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:27.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- 172.21.15.32:0/280815514 shutdown_connections 2024-01-19T04:15:27.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- 172.21.15.32:0/280815514 wait complete. 2024-01-19T04:15:27.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 Processor -- start 2024-01-19T04:15:27.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- start start 2024-01-19T04:15:27.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc1f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8dc0c41f0 0x7ff8dc15e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8dc151de0 0x7ff8dc15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0c7080 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1f0d50 con 0x7ff8dc151de0 2024-01-19T04:15:27.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8e3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0c7320 con 0x7ff8dc0a7200 2024-01-19T04:15:27.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.343+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8dc0c41f0 0x7ff8dc15e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8dc0c41f0 0x7ff8dc15e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47314/0 (socket says 172.21.15.32:47314) 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 -- 172.21.15.32:0/3053986361 learned_addr learned my addr 172.21.15.32:0/3053986361 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8e0a00640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc1f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8e1400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8dc151de0 0x7ff8dc15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 -- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 msgr2=0x7ff8dc1f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc1f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 -- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8dc151de0 msgr2=0x7ff8dc15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8dc151de0 0x7ff8dc15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 -- 172.21.15.32:0/3053986361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009420 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8e1400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8dc151de0 0x7ff8dc15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8dbe00640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8dc0c41f0 0x7ff8dc15e370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40ad040 tx=0x7ff8c401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8d8c00640 1 -- 172.21.15.32:0/3053986361 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40abdc0 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8d8c00640 1 -- 172.21.15.32:0/3053986361 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c40bf410 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8d8c00640 1 -- 172.21.15.32:0/3053986361 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40bf7c0 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc15edf0 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc154130 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0c74e0 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8d8c00640 1 -- 172.21.15.32:0/3053986361 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff8c40bf920 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8d8c00640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8b4066500 0x7ff8b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.347+0000 7ff8d8c00640 1 -- 172.21.15.32:0/3053986361 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8c411e500 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.351+0000 7ff8e0a00640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8b4066500 0x7ff8b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.351+0000 7ff8e0a00640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8b4066500 0x7ff8b40689c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc1533a0 tx=0x7ff8cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:27.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.351+0000 7ff8d8c00640 1 -- 172.21.15.32:0/3053986361 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff8c40eb960 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.511+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8dc0749f0 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8d8c00640 1 -- 172.21.15.32:0/3053986361 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7ff8c40eef80 con 0x7ff8dc0c41f0 2024-01-19T04:15:27.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:27.519 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8b4066500 msgr2=0x7ff8b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8b4066500 0x7ff8b40689c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc1533a0 tx=0x7ff8cc009040 comp rx=0 tx=0).stop 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8dc0c41f0 msgr2=0x7ff8dc15e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8dc0c41f0 0x7ff8dc15e370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40ad040 tx=0x7ff8c401ac40 comp rx=0 tx=0).stop 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 shutdown_connections 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8b4066500 0x7ff8b40689c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8dc151de0 0x7ff8dc15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8dc0c41f0 0x7ff8dc15e370 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3053986361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8dc0a7200 0x7ff8dc1f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 >> 172.21.15.32:0/3053986361 conn(0x7ff8dc0726d0 msgr2=0x7ff8dc15f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:27.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 shutdown_connections 2024-01-19T04:15:27.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.515+0000 7ff8e3400640 1 -- 172.21.15.32:0/3053986361 wait complete. 2024-01-19T04:15:27.541 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:27.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:27.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.679+0000 7f995c200640 1 Processor -- start 2024-01-19T04:15:27.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.679+0000 7f995c200640 1 -- start start 2024-01-19T04:15:27.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f995c200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9954155520 0x7f995406c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f995c200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540beed0 con 0x7f9954072490 2024-01-19T04:15:27.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f995c200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540c3a80 con 0x7f99540bf360 2024-01-19T04:15:27.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f995c200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995406e0c0 con 0x7f9954155520 2024-01-19T04:15:27.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9958e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9954072490 0x7f995406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54948/0 (socket says 172.21.15.32:54948) 2024-01-19T04:15:27.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9958e00640 1 -- 172.21.15.32:0/1431476357 learned_addr learned my addr 172.21.15.32:0/1431476357 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 --2- 172.21.15.32:0/1431476357 >> v2:172.21.15.67:3300/0 conn(0x7f9954155520 0x7f995406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498132625 0 0) 0x7f99540beed0 con 0x7f9954072490 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9934003530 con 0x7f9954072490 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4294103139 0 0) 0x7f9934003530 con 0x7f9954072490 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 >> v2:172.21.15.67:3300/0 conn(0x7f9954155520 msgr2=0x7f995406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 --2- 172.21.15.32:0/1431476357 >> v2:172.21.15.67:3300/0 conn(0x7f9954155520 0x7f995406c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 >> v1:172.21.15.67:6789/0 conn(0x7f99540bf360 legacy=0x7f99540a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540c3d60 con 0x7f9954072490 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f993c001680 con 0x7f9954072490 2024-01-19T04:15:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 >> v1:172.21.15.32:6789/0 conn(0x7f9954072490 legacy=0x7f995406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934003980 0x7f9934003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9934004380 0x7f9934004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99340050f0 0x7f993400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993400c000 con 0x7f9934003980 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993400c170 con 0x7f9934004380 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993400c330 con 0x7f99340050f0 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 --2- 172.21.15.32:0/1431476357 >> v2:172.21.15.67:3300/0 conn(0x7f9954155520 0x7f995406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934003980 0x7f9934003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9958e00640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9934004380 0x7f9934004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f995a200640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99340050f0 0x7f993400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 -- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99340050f0 msgr2=0x7f993400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f99340050f0 0x7f993400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 -- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9934004380 msgr2=0x7f9934004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9934004380 0x7f9934004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f9959800640 1 -- 172.21.15.32:0/1431476357 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934003530 con 0x7f9934003980 2024-01-19T04:15:27.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.683+0000 7f995a200640 1 -- 172.21.15.32:0/1431476357 reap_dead start 2024-01-19T04:15:27.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f9959800640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934003980 0x7f9934003d60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9944009c90 tx=0x7f994401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d28f612c40280d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:27.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944004020 con 0x7f9934003980 2024-01-19T04:15:27.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944004180 con 0x7f9934003980 2024-01-19T04:15:27.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f9953e00640 1 -- 172.21.15.32:0/1431476357 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440a5760 con 0x7f9934003980 2024-01-19T04:15:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f995c200640 1 -- 172.21.15.32:0/1431476357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934003980 msgr2=0x7f9934003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f995c200640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934003980 0x7f9934003d60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9944009c90 tx=0x7f994401cbd0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f995c200640 1 -- 172.21.15.32:0/1431476357 shutdown_connections 2024-01-19T04:15:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f995c200640 1 --2- 172.21.15.32:0/1431476357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934003980 0x7f9934003d60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f995c200640 1 -- 172.21.15.32:0/1431476357 >> 172.21.15.32:0/1431476357 conn(0x7f99540c25a0 msgr2=0x7f99540c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f995c200640 1 -- 172.21.15.32:0/1431476357 shutdown_connections 2024-01-19T04:15:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.687+0000 7f995c200640 1 -- 172.21.15.32:0/1431476357 wait complete. 2024-01-19T04:15:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 Processor -- start 2024-01-19T04:15:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 -- start start 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9934003980 0x7f99540a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9954155c90 0x7f995414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99541f1570 0x7f995414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540ab5c0 con 0x7f9954155c90 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541f1a30 con 0x7f99541f1570 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954071d20 con 0x7f9934003980 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9954155c90 0x7f995414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9954155c90 0x7f995414c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47330/0 (socket says 172.21.15.32:47330) 2024-01-19T04:15:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 -- 172.21.15.32:0/2306808970 learned_addr learned my addr 172.21.15.32:0/2306808970 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995a200640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99541f1570 0x7f995414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9959800640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9934003980 0x7f99540a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 -- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9934003980 msgr2=0x7f99540a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9934003980 0x7f99540a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 -- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99541f1570 msgr2=0x7f995414c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99541f1570 0x7f995414c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 -- 172.21.15.32:0/2306808970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954072000 con 0x7f9954155c90 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9958e00640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9954155c90 0x7f995414c080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f993c007290 tx=0x7f993c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9951600640 1 -- 172.21.15.32:0/2306808970 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c001660 con 0x7f9954155c90 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9951600640 1 -- 172.21.15.32:0/2306808970 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00f8c0 con 0x7f9954155c90 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f9951600640 1 -- 172.21.15.32:0/2306808970 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00fc50 con 0x7f9954155c90 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540ab810 con 0x7f9954155c90 2024-01-19T04:15:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995414cc10 con 0x7f9954155c90 2024-01-19T04:15:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.691+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99540749f0 con 0x7f9954155c90 2024-01-19T04:15:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.695+0000 7f9951600640 1 -- 172.21.15.32:0/2306808970 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f993c01d460 con 0x7f9954155c90 2024-01-19T04:15:27.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.695+0000 7f9951600640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f992c066500 0x7f992c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:27.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.695+0000 7f9951600640 1 -- 172.21.15.32:0/2306808970 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f993c083de0 con 0x7f9954155c90 2024-01-19T04:15:27.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.695+0000 7f9959800640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f992c066500 0x7f992c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:27.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.695+0000 7f9959800640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f992c066500 0x7f992c0689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99440ae000 tx=0x7f99440046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:27.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.699+0000 7f9951600640 1 -- 172.21.15.32:0/2306808970 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f993c051120 con 0x7f9954155c90 2024-01-19T04:15:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.859+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9954153310 con 0x7f9954155c90 2024-01-19T04:15:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.859+0000 7f9951600640 1 -- 172.21.15.32:0/2306808970 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f993c054740 con 0x7f9954155c90 2024-01-19T04:15:27.864 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f992c066500 msgr2=0x7f992c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f992c066500 0x7f992c0689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99440ae000 tx=0x7f99440046d0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9954155c90 msgr2=0x7f995414c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9954155c90 0x7f995414c080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f993c007290 tx=0x7f993c007750 comp rx=0 tx=0).stop 2024-01-19T04:15:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 shutdown_connections 2024-01-19T04:15:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f992c066500 0x7f992c0689c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99541f1570 0x7f995414c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9954155c90 0x7f995414c080 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 --2- 172.21.15.32:0/2306808970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9934003980 0x7f99540a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 >> 172.21.15.32:0/2306808970 conn(0x7f99540c25a0 msgr2=0x7f99541544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 shutdown_connections 2024-01-19T04:15:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:27.863+0000 7f995c200640 1 -- 172.21.15.32:0/2306808970 wait complete. 2024-01-19T04:15:27.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc22be00640 1 Processor -- start 2024-01-19T04:15:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc22be00640 1 -- start start 2024-01-19T04:15:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc22be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc224152bf0 0x7fc2240c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc22be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2240c3830 0x7fc22415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc22be00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2240c6cc0 con 0x7fc2240c6f80 2024-01-19T04:15:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc22be00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc224155a50 con 0x7fc2240c3830 2024-01-19T04:15:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc22be00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2240c40b0 con 0x7fc224152bf0 2024-01-19T04:15:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc229e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2240c3830 0x7fc22415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc229e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2240c3830 0x7fc22415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35686/0 (socket says 172.21.15.32:35686) 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc229e00640 1 -- 172.21.15.32:0/3105370012 learned_addr learned my addr 172.21.15.32:0/3105370012 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc228a00640 1 --2- 172.21.15.32:0/3105370012 >> v2:172.21.15.67:3300/0 conn(0x7fc224152bf0 0x7fc2240c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc229e00640 1 -- 172.21.15.32:0/3105370012 >> v2:172.21.15.67:3300/0 conn(0x7fc224152bf0 msgr2=0x7fc2240c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc229e00640 1 --2- 172.21.15.32:0/3105370012 >> v2:172.21.15.67:3300/0 conn(0x7fc224152bf0 0x7fc2240c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc229e00640 1 -- 172.21.15.32:0/3105370012 >> v1:172.21.15.67:6789/0 conn(0x7fc2240c6f80 legacy=0x7fc2241524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc229e00640 1 -- 172.21.15.32:0/3105370012 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc224155d10 con 0x7fc2240c3830 2024-01-19T04:15:28.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.027+0000 7fc228a00640 1 --2- 172.21.15.32:0/3105370012 >> v2:172.21.15.67:3300/0 conn(0x7fc224152bf0 0x7fc2240c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:28.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc229e00640 1 --2- 172.21.15.32:0/3105370012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2240c3830 0x7fc22415cd80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc2241559b0 tx=0x7fc21c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84132c2ffd29a8e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc223e00640 1 -- 172.21.15.32:0/3105370012 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0a5860 con 0x7fc2240c3830 2024-01-19T04:15:28.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc223e00640 1 -- 172.21.15.32:0/3105370012 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0a59c0 con 0x7fc2240c3830 2024-01-19T04:15:28.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc223e00640 1 -- 172.21.15.32:0/3105370012 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0a5d50 con 0x7fc2240c3830 2024-01-19T04:15:28.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 -- 172.21.15.32:0/3105370012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2240c3830 msgr2=0x7fc22415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 --2- 172.21.15.32:0/3105370012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2240c3830 0x7fc22415cd80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc2241559b0 tx=0x7fc21c01c9a0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 -- 172.21.15.32:0/3105370012 shutdown_connections 2024-01-19T04:15:28.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 --2- 172.21.15.32:0/3105370012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2240c3830 0x7fc22415cd80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 --2- 172.21.15.32:0/3105370012 >> v2:172.21.15.67:3300/0 conn(0x7fc224152bf0 0x7fc2240c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 -- 172.21.15.32:0/3105370012 >> 172.21.15.32:0/3105370012 conn(0x7fc2240663f0 msgr2=0x7fc224066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:28.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 -- 172.21.15.32:0/3105370012 shutdown_connections 2024-01-19T04:15:28.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.031+0000 7fc22be00640 1 -- 172.21.15.32:0/3105370012 wait complete. 2024-01-19T04:15:28.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 Processor -- start 2024-01-19T04:15:28.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 -- start start 2024-01-19T04:15:28.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2240c3830 0x7fc224154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2240c6f80 0x7fc224148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc224152bf0 0x7fc22406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241412a0 con 0x7fc224152bf0 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc224152460 con 0x7fc2240c6f80 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc224140dd0 con 0x7fc2240c3830 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc224152bf0 0x7fc22406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc224152bf0 0x7fc22406b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35694/0 (socket says 172.21.15.32:35694) 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 -- 172.21.15.32:0/1924147449 learned_addr learned my addr 172.21.15.32:0/1924147449 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc228a00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2240c6f80 0x7fc224148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229400640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2240c3830 0x7fc224154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 -- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2240c3830 msgr2=0x7fc224154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2240c3830 0x7fc224154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 -- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2240c6f80 msgr2=0x7fc224148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2240c6f80 0x7fc224148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 -- 172.21.15.32:0/1924147449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009b30 con 0x7fc224152bf0 2024-01-19T04:15:28.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc229e00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc224152bf0 0x7fc22406b7b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0af040 tx=0x7fc21c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc221600640 1 -- 172.21.15.32:0/1924147449 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0b8670 con 0x7fc224152bf0 2024-01-19T04:15:28.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc221600640 1 -- 172.21.15.32:0/1924147449 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0b87d0 con 0x7fc224152bf0 2024-01-19T04:15:28.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc221600640 1 -- 172.21.15.32:0/1924147449 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0b8b80 con 0x7fc224152bf0 2024-01-19T04:15:28.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc224155060 con 0x7fc224152bf0 2024-01-19T04:15:28.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.035+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc224154c50 con 0x7fc224152bf0 2024-01-19T04:15:28.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.039+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2240749f0 con 0x7fc224152bf0 2024-01-19T04:15:28.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.039+0000 7fc221600640 1 -- 172.21.15.32:0/1924147449 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc21c0b8ce0 con 0x7fc224152bf0 2024-01-19T04:15:28.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.039+0000 7fc221600640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1fc066530 0x7fc1fc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.039+0000 7fc221600640 1 -- 172.21.15.32:0/1924147449 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc21c11f4a0 con 0x7fc224152bf0 2024-01-19T04:15:28.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.039+0000 7fc229400640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1fc066530 0x7fc1fc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.039+0000 7fc229400640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1fc066530 0x7fc1fc0689f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc2240c20a0 tx=0x7fc214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.043+0000 7fc221600640 1 -- 172.21.15.32:0/1924147449 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc21c0ec880 con 0x7fc224152bf0 2024-01-19T04:15:28.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.203+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2240aae80 con 0x7fc224152bf0 2024-01-19T04:15:28.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.203+0000 7fc221600640 1 -- 172.21.15.32:0/1924147449 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc21c0efea0 con 0x7fc224152bf0 2024-01-19T04:15:28.210 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:28.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1fc066530 msgr2=0x7fc1fc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1fc066530 0x7fc1fc0689f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc2240c20a0 tx=0x7fc214009040 comp rx=0 tx=0).stop 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc224152bf0 msgr2=0x7fc22406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc224152bf0 0x7fc22406b7b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0af040 tx=0x7fc21c019740 comp rx=0 tx=0).stop 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 shutdown_connections 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1fc066530 0x7fc1fc0689f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc224152bf0 0x7fc22406b7b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2240c6f80 0x7fc224148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 --2- 172.21.15.32:0/1924147449 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2240c3830 0x7fc224154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 >> 172.21.15.32:0/1924147449 conn(0x7fc2240663f0 msgr2=0x7fc2240667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:28.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 shutdown_connections 2024-01-19T04:15:28.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.207+0000 7fc22be00640 1 -- 172.21.15.32:0/1924147449 wait complete. 2024-01-19T04:15:28.232 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:28.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d82000640 1 Processor -- start 2024-01-19T04:15:28.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d82000640 1 -- start start 2024-01-19T04:15:28.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d82000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d7c0c3230 0x7f1d7c0c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d82000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0c6470 con 0x7f1d7c1565d0 2024-01-19T04:15:28.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d82000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0c6ff0 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d82000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0c88a0 con 0x7f1d7c0c3230 2024-01-19T04:15:28.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d7aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d7c0c3230 0x7f1d7c0c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d7b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1d7c1565d0 0x7f1d7c0c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36772/0 (socket says 172.21.15.32:36772) 2024-01-19T04:15:28.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d7b400640 1 -- 172.21.15.32:0/2359116832 learned_addr learned my addr 172.21.15.32:0/2359116832 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:28.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d7aa00640 1 -- 172.21.15.32:0/2359116832 >> v1:172.21.15.67:6789/0 conn(0x7f1d7c06eeb0 legacy=0x7f1d7c06f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:28.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d7a000640 1 -- 172.21.15.32:0/2359116832 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788293914 0 0) 0x7f1d7c0c6470 con 0x7f1d7c1565d0 2024-01-19T04:15:28.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d7aa00640 1 -- 172.21.15.32:0/2359116832 >> v1:172.21.15.32:6789/0 conn(0x7f1d7c1565d0 legacy=0x7f1d7c0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.371+0000 7f1d7aa00640 1 -- 172.21.15.32:0/2359116832 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0c66c0 con 0x7f1d7c0c3230 2024-01-19T04:15:28.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d7aa00640 1 --2- 172.21.15.32:0/2359116832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c0c3230 0x7f1d7c0c3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d640097c0 tx=0x7f1d6401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eadeaaefd5e16c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d7a000640 1 -- 172.21.15.32:0/2359116832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640ab600 con 0x7f1d7c0c3230 2024-01-19T04:15:28.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d7a000640 1 -- 172.21.15.32:0/2359116832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d640a7050 con 0x7f1d7c0c3230 2024-01-19T04:15:28.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d7a000640 1 -- 172.21.15.32:0/2359116832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640ab980 con 0x7f1d7c0c3230 2024-01-19T04:15:28.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d82000640 1 -- 172.21.15.32:0/2359116832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c0c3230 msgr2=0x7f1d7c0c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d82000640 1 --2- 172.21.15.32:0/2359116832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c0c3230 0x7f1d7c0c3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d640097c0 tx=0x7f1d6401c3b0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d82000640 1 -- 172.21.15.32:0/2359116832 shutdown_connections 2024-01-19T04:15:28.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d82000640 1 --2- 172.21.15.32:0/2359116832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c0c3230 0x7f1d7c0c3690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d82000640 1 -- 172.21.15.32:0/2359116832 >> 172.21.15.32:0/2359116832 conn(0x7f1d7c0726d0 msgr2=0x7f1d7c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:28.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d82000640 1 -- 172.21.15.32:0/2359116832 shutdown_connections 2024-01-19T04:15:28.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.375+0000 7f1d82000640 1 -- 172.21.15.32:0/2359116832 wait complete. 2024-01-19T04:15:28.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 Processor -- start 2024-01-19T04:15:28.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 -- start start 2024-01-19T04:15:28.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c06eeb0 0x7f1d7c14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d7c0c3230 0x7f1d7c0bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d7c1565d0 0x7f1d7c0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0c23b0 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0bf6c0 con 0x7f1d7c0c3230 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c153c90 con 0x7f1d7c1565d0 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c06eeb0 0x7f1d7c14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c06eeb0 0x7f1d7c14cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35716/0 (socket says 172.21.15.32:35716) 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 -- 172.21.15.32:0/822556786 learned_addr learned my addr 172.21.15.32:0/822556786 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7aa00640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d7c0c3230 0x7f1d7c0bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7be00640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d7c1565d0 0x7f1d7c0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 -- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d7c1565d0 msgr2=0x7f1d7c0ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d7c1565d0 0x7f1d7c0ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 -- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d7c0c3230 msgr2=0x7f1d7c0bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d7c0c3230 0x7f1d7c0bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 -- 172.21.15.32:0/822556786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64009420 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7be00640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d7c1565d0 0x7f1d7c0ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d7b400640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c06eeb0 0x7f1d7c14cf90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c4b0 tx=0x7f1d6c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d73400640 1 -- 172.21.15.32:0/822556786 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0074e0 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d73400640 1 -- 172.21.15.32:0/822556786 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c007660 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d73400640 1 -- 172.21.15.32:0/822556786 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c004a30 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c153f70 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.379+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c0c20d0 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.383+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c0c2590 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.383+0000 7f1d73400640 1 -- 172.21.15.32:0/822556786 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1d6c004b90 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.383+0000 7f1d73400640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d54066500 0x7f1d540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.383+0000 7f1d73400640 1 -- 172.21.15.32:0/822556786 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d6c082f80 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.383+0000 7f1d7aa00640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d54066500 0x7f1d540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.383+0000 7f1d7aa00640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d54066500 0x7f1d540689c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ad000 tx=0x7f1d640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.387+0000 7f1d73400640 1 -- 172.21.15.32:0/822556786 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1d6c053d50 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d7c0c1c50 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d73400640 1 -- 172.21.15.32:0/822556786 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d7c0c1c50 con 0x7f1d7c06eeb0 2024-01-19T04:15:28.551 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d54066500 msgr2=0x7f1d540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d54066500 0x7f1d540689c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ad000 tx=0x7f1d640a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c06eeb0 msgr2=0x7f1d7c14cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c06eeb0 0x7f1d7c14cf90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c4b0 tx=0x7f1d6c00c970 comp rx=0 tx=0).stop 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 shutdown_connections 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d54066500 0x7f1d540689c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d7c1565d0 0x7f1d7c0ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d7c0c3230 0x7f1d7c0bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 --2- 172.21.15.32:0/822556786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d7c06eeb0 0x7f1d7c14cf90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 >> 172.21.15.32:0/822556786 conn(0x7f1d7c0726d0 msgr2=0x7f1d7c0c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:28.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 shutdown_connections 2024-01-19T04:15:28.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.547+0000 7f1d82000640 1 -- 172.21.15.32:0/822556786 wait complete. 2024-01-19T04:15:28.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-19T04:15:28.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0643800640 1 Processor -- start 2024-01-19T04:15:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0643800640 1 -- start start 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0643800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f063c0c2be0 0x7f063c06aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0643800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c151490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0643800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c1585c0 con 0x7f063c06a6a0 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0643800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c1547f0 con 0x7f063c0c2be0 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0643800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0c16b0 con 0x7f063c072ad0 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0640e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f063c06a6a0 0x7f063c0c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36788/0 (socket says 172.21.15.32:36788) 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0640e00640 1 -- 172.21.15.32:0/1515258137 learned_addr learned my addr 172.21.15.32:0/1515258137 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0641800640 1 --2- 172.21.15.32:0/1515258137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f063be00640 1 --2- 172.21.15.32:0/1515258137 >> v2:172.21.15.67:3300/0 conn(0x7f063c0c2be0 0x7f063c06aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f063b400640 1 -- 172.21.15.32:0/1515258137 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431823484 0 0) 0x7f063c1585c0 con 0x7f063c06a6a0 2024-01-19T04:15:28.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f063b400640 1 -- 172.21.15.32:0/1515258137 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f061c003530 con 0x7f063c06a6a0 2024-01-19T04:15:28.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0641800640 1 -- 172.21.15.32:0/1515258137 >> v2:172.21.15.67:3300/0 conn(0x7f063c0c2be0 msgr2=0x7f063c06aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:28.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0641800640 1 --2- 172.21.15.32:0/1515258137 >> v2:172.21.15.67:3300/0 conn(0x7f063c0c2be0 0x7f063c06aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0641800640 1 -- 172.21.15.32:0/1515258137 >> v1:172.21.15.32:6789/0 conn(0x7f063c06a6a0 legacy=0x7f063c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f0641800640 1 -- 172.21.15.32:0/1515258137 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c1549e0 con 0x7f063c072ad0 2024-01-19T04:15:28.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.711+0000 7f063be00640 1 --2- 172.21.15.32:0/1515258137 >> v2:172.21.15.67:3300/0 conn(0x7f063c0c2be0 0x7f063c06aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:28.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0641800640 1 --2- 172.21.15.32:0/1515258137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c151490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0634009d90 tx=0x7f063401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb68a1d8971455b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f063b400640 1 -- 172.21.15.32:0/1515258137 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340a5900 con 0x7f063c072ad0 2024-01-19T04:15:28.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f063b400640 1 -- 172.21.15.32:0/1515258137 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06340a5a60 con 0x7f063c072ad0 2024-01-19T04:15:28.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f063b400640 1 -- 172.21.15.32:0/1515258137 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340a5df0 con 0x7f063c072ad0 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 -- 172.21.15.32:0/1515258137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 msgr2=0x7f063c151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 --2- 172.21.15.32:0/1515258137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c151490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0634009d90 tx=0x7f063401c950 comp rx=0 tx=0).stop 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 -- 172.21.15.32:0/1515258137 shutdown_connections 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 --2- 172.21.15.32:0/1515258137 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c151490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 --2- 172.21.15.32:0/1515258137 >> v2:172.21.15.67:3300/0 conn(0x7f063c0c2be0 0x7f063c06aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 -- 172.21.15.32:0/1515258137 >> 172.21.15.32:0/1515258137 conn(0x7f063c0c6ca0 msgr2=0x7f063c0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 -- 172.21.15.32:0/1515258137 shutdown_connections 2024-01-19T04:15:28.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.715+0000 7f0643800640 1 -- 172.21.15.32:0/1515258137 wait complete. 2024-01-19T04:15:28.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 Processor -- start 2024-01-19T04:15:28.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 -- start start 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06a6a0 0x7f063c06dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063c14d0c0 0x7f063c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c14cc30 con 0x7f063c14d0c0 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0a8560 con 0x7f063c06a6a0 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c06e2a0 con 0x7f063c072ad0 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063c14d0c0 0x7f063c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063c14d0c0 0x7f063c14d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35732/0 (socket says 172.21.15.32:35732) 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 -- 172.21.15.32:0/2766233517 learned_addr learned my addr 172.21.15.32:0/2766233517 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:28.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0640e00640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06a6a0 0x7f063c06dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f063be00640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 -- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 msgr2=0x7f063c14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 -- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06a6a0 msgr2=0x7f063c06dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06a6a0 0x7f063c06dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 -- 172.21.15.32:0/2766233517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624009420 con 0x7f063c14d0c0 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0641800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063c14d0c0 0x7f063c14d570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f063401b000 tx=0x7f06340196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0638c00640 1 -- 172.21.15.32:0/2766233517 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340b9650 con 0x7f063c14d0c0 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0638c00640 1 -- 172.21.15.32:0/2766233517 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06340b97b0 con 0x7f063c14d0c0 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0638c00640 1 -- 172.21.15.32:0/2766233517 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340b9b20 con 0x7f063c14d0c0 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0634009a70 con 0x7f063c14d0c0 2024-01-19T04:15:28.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.719+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0a7180 con 0x7f063c14d0c0 2024-01-19T04:15:28.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.723+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c0749f0 con 0x7f063c14d0c0 2024-01-19T04:15:28.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.723+0000 7f0638c00640 1 -- 172.21.15.32:0/2766233517 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f06340b9c80 con 0x7f063c14d0c0 2024-01-19T04:15:28.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.723+0000 7f0638c00640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0614066500 0x7f06140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:28.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.723+0000 7f0638c00640 1 -- 172.21.15.32:0/2766233517 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f063411eff0 con 0x7f063c14d0c0 2024-01-19T04:15:28.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.723+0000 7f0640e00640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0614066500 0x7f06140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:28.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.723+0000 7f0640e00640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0614066500 0x7f06140689c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f062c007fd0 tx=0x7f062c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:28.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.727+0000 7f0638c00640 1 -- 172.21.15.32:0/2766233517 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f06340ec3d0 con 0x7f063c14d0c0 2024-01-19T04:15:28.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:28.943+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f063c14cd70 con 0x7f063c14d0c0 2024-01-19T04:15:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.759+0000 7f0638c00640 1 -- 172.21.15.32:0/2766233517 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v50) v1 ==== 162+0+0 (secure 0 0 0) 0x7f06340ef9f0 con 0x7f063c14d0c0 2024-01-19T04:15:29.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0614066500 msgr2=0x7f06140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:29.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0614066500 0x7f06140689c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f062c007fd0 tx=0x7f062c009040 comp rx=0 tx=0).stop 2024-01-19T04:15:29.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063c14d0c0 msgr2=0x7f063c14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:29.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063c14d0c0 0x7f063c14d570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f063401b000 tx=0x7f06340196f0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 shutdown_connections 2024-01-19T04:15:29.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0614066500 0x7f06140689c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063c14d0c0 0x7f063c14d570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f063c072ad0 0x7f063c14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 --2- 172.21.15.32:0/2766233517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f063c06a6a0 0x7f063c06dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 >> 172.21.15.32:0/2766233517 conn(0x7f063c0c6ca0 msgr2=0x7f063c1534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:29.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 shutdown_connections 2024-01-19T04:15:29.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.763+0000 7f0643800640 1 -- 172.21.15.32:0/2766233517 wait complete. 2024-01-19T04:15:29.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-19T04:15:29.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b3000640 1 Processor -- start 2024-01-19T04:15:29.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b3000640 1 -- start start 2024-01-19T04:15:29.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b3000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 0x7f16ac0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b3000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac152bc0 con 0x7f16ac152620 2024-01-19T04:15:29.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b3000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac152ea0 con 0x7f16ac0c4e50 2024-01-19T04:15:29.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b3000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac06ea00 con 0x7f16ac0c6830 2024-01-19T04:15:29.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f16ac152620 0x7f16ac0c6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36800/0 (socket says 172.21.15.32:36800) 2024-01-19T04:15:29.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 -- 172.21.15.32:0/1169046511 learned_addr learned my addr 172.21.15.32:0/1169046511 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599999883 0 0) 0x7f16ac152bc0 con 0x7f16ac152620 2024-01-19T04:15:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b1000640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 0x7f16ac0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f168c003530 con 0x7f16ac152620 2024-01-19T04:15:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816567595 0 0) 0x7f168c003530 con 0x7f16ac152620 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 msgr2=0x7f16ac0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 0x7f16ac0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 >> v1:172.21.15.67:6789/0 conn(0x7f16ac0c4e50 legacy=0x7f16ac06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac153180 con 0x7f16ac152620 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f1694001680 con 0x7f16ac152620 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 >> v1:172.21.15.32:6789/0 conn(0x7f16ac152620 legacy=0x7f16ac0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 0x7f168c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c003ef0 0x7f168c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c004d10 0x7f168c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c00b9c0 con 0x7f168c003ef0 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c00bb30 con 0x7f168c004d10 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c00bcf0 con 0x7f16ac0c6830 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c003ef0 0x7f168c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16abe00640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 0x7f168c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b1000640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c004d10 0x7f168c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 -- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 msgr2=0x7f168c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c6830 0x7f168c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 -- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c004d10 msgr2=0x7f168c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c004d10 0x7f168c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16ab400640 1 -- 172.21.15.32:0/1169046511 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c003530 con 0x7f168c003ef0 2024-01-19T04:15:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.939+0000 7f16b1000640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c004d10 0x7f168c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:29.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16ab400640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c003ef0 0x7f168c0047d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f169400c1c0 tx=0x7f169401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded51d7777b3ebb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:29.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694005ae0 con 0x7f168c003ef0 2024-01-19T04:15:29.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694005c40 con 0x7f168c003ef0 2024-01-19T04:15:29.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16aaa00640 1 -- 172.21.15.32:0/1169046511 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694007070 con 0x7f168c003ef0 2024-01-19T04:15:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16b3000640 1 -- 172.21.15.32:0/1169046511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c003ef0 msgr2=0x7f168c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16b3000640 1 --2- 172.21.15.32:0/1169046511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c003ef0 0x7f168c0047d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f169400c1c0 tx=0x7f169401cb30 comp rx=0 tx=0).stop 2024-01-19T04:15:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16b1000640 1 -- 172.21.15.32:0/1169046511 reap_dead start 2024-01-19T04:15:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16b3000640 1 -- 172.21.15.32:0/1169046511 shutdown_connections 2024-01-19T04:15:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16b3000640 1 -- 172.21.15.32:0/1169046511 >> 172.21.15.32:0/1169046511 conn(0x7f16ac0c7d40 msgr2=0x7f16ac0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16b3000640 1 -- 172.21.15.32:0/1169046511 shutdown_connections 2024-01-19T04:15:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.943+0000 7f16b3000640 1 -- 172.21.15.32:0/1169046511 wait complete. 2024-01-19T04:15:29.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 Processor -- start 2024-01-19T04:15:29.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 -- start start 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c003ef0 0x7f16ac14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16ac14a2f0 0x7f16ac14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c2640 0x7f16ac148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14d0a0 con 0x7f16ac14a2f0 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14cdc0 con 0x7f168c003ef0 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0c3d00 con 0x7f16ac0c2640 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16ac14a2f0 0x7f16ac14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16ac14a2f0 0x7f16ac14ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35746/0 (socket says 172.21.15.32:35746) 2024-01-19T04:15:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 -- 172.21.15.32:0/2874017072 learned_addr learned my addr 172.21.15.32:0/2874017072 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:29.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16abe00640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c003ef0 0x7f16ac14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b1000640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c2640 0x7f16ac148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 -- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c2640 msgr2=0x7f16ac148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c2640 0x7f16ac148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 -- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c003ef0 msgr2=0x7f16ac14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c003ef0 0x7f16ac14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 -- 172.21.15.32:0/2874017072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0c4700 con 0x7f16ac14a2f0 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16ab400640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16ac14a2f0 0x7f16ac14ec50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f169401c960 tx=0x7f168c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16a3e00640 1 -- 172.21.15.32:0/2874017072 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940b4070 con 0x7f16ac14a2f0 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16a3e00640 1 -- 172.21.15.32:0/2874017072 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694005e70 con 0x7f16ac14a2f0 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16a3e00640 1 -- 172.21.15.32:0/2874017072 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694001640 con 0x7f16ac14a2f0 2024-01-19T04:15:29.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac156460 con 0x7f16ac14a2f0 2024-01-19T04:15:29.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.947+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac150960 con 0x7f16ac14a2f0 2024-01-19T04:15:29.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.951+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac0749f0 con 0x7f16ac14a2f0 2024-01-19T04:15:29.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.951+0000 7f16a3e00640 1 -- 172.21.15.32:0/2874017072 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1694007040 con 0x7f16ac14a2f0 2024-01-19T04:15:29.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.951+0000 7f16a3e00640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1684066500 0x7f16840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:29.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.951+0000 7f16a3e00640 1 -- 172.21.15.32:0/2874017072 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f169411d6c0 con 0x7f16ac14a2f0 2024-01-19T04:15:29.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.951+0000 7f16abe00640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1684066500 0x7f16840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:29.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.951+0000 7f16abe00640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1684066500 0x7f16840689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f169c0017b0 tx=0x7f169c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:29.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:29.955+0000 7f16a3e00640 1 -- 172.21.15.32:0/2874017072 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f16940ee490 con 0x7f16ac14a2f0 2024-01-19T04:15:30.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.115+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f16ac0c6d90 con 0x7f16ac14a2f0 2024-01-19T04:15:30.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16a3e00640 1 -- 172.21.15.32:0/2874017072 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16940ee020 con 0x7f16ac14a2f0 2024-01-19T04:15:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1684066500 msgr2=0x7f16840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1684066500 0x7f16840689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f169c0017b0 tx=0x7f169c009040 comp rx=0 tx=0).stop 2024-01-19T04:15:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16ac14a2f0 msgr2=0x7f16ac14ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16ac14a2f0 0x7f16ac14ec50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f169401c960 tx=0x7f168c005800 comp rx=0 tx=0).stop 2024-01-19T04:15:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 shutdown_connections 2024-01-19T04:15:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1684066500 0x7f16840689c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16ac0c2640 0x7f16ac148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16ac14a2f0 0x7f16ac14ec50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 --2- 172.21.15.32:0/2874017072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f168c003ef0 0x7f16ac14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 >> 172.21.15.32:0/2874017072 conn(0x7f16ac0c7d40 msgr2=0x7f16ac0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:30.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 shutdown_connections 2024-01-19T04:15:30.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.119+0000 7f16b3000640 1 -- 172.21.15.32:0/2874017072 wait complete. 2024-01-19T04:15:30.146 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T04:15:30.146 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:15:30.213 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:15:30.307 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T04:15:30.307 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:15:30.307 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:30.316 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:15:30.317 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:30.365 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:15:30.365 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:30.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:30.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235c000640 1 Processor -- start 2024-01-19T04:15:30.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235c000640 1 -- start start 2024-01-19T04:15:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235c000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2354151f30 0x7f23540c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235c000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f235406fda0 0x7f23540c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235c000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23540c5b40 con 0x7f235406eb70 2024-01-19T04:15:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235c000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23541551e0 con 0x7f235406fda0 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235c000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2354155710 con 0x7f2354151f30 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f2358c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f235406fda0 0x7f23540c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235a000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f235406eb70 0x7f235406f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36814/0 (socket says 172.21.15.32:36814) 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f235a000640 1 -- 172.21.15.32:0/2191149193 learned_addr learned my addr 172.21.15.32:0/2191149193 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f2359600640 1 --2- 172.21.15.32:0/2191149193 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2354151f30 0x7f23540c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f2358c00640 1 -- 172.21.15.32:0/2191149193 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2354151f30 msgr2=0x7f23540c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f2358c00640 1 --2- 172.21.15.32:0/2191149193 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2354151f30 0x7f23540c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f2358c00640 1 -- 172.21.15.32:0/2191149193 >> v1:172.21.15.32:6789/0 conn(0x7f235406eb70 legacy=0x7f235406f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.599+0000 7f2358c00640 1 -- 172.21.15.32:0/2191149193 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540c3fa0 con 0x7f235406fda0 2024-01-19T04:15:30.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f2358c00640 1 --2- 172.21.15.32:0/2191149193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f23540c4970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f233c0097c0 tx=0x7f233c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2669dffd4839e0d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:30.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f2353e00640 1 -- 172.21.15.32:0/2191149193 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0ab600 con 0x7f235406fda0 2024-01-19T04:15:30.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f2353e00640 1 -- 172.21.15.32:0/2191149193 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c0a7050 con 0x7f235406fda0 2024-01-19T04:15:30.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f2353e00640 1 -- 172.21.15.32:0/2191149193 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0ab980 con 0x7f235406fda0 2024-01-19T04:15:30.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 -- 172.21.15.32:0/2191149193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 msgr2=0x7f23540c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 --2- 172.21.15.32:0/2191149193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f23540c4970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f233c0097c0 tx=0x7f233c01c3f0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 -- 172.21.15.32:0/2191149193 shutdown_connections 2024-01-19T04:15:30.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 --2- 172.21.15.32:0/2191149193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f23540c4970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 --2- 172.21.15.32:0/2191149193 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2354151f30 0x7f23540c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 -- 172.21.15.32:0/2191149193 >> 172.21.15.32:0/2191149193 conn(0x7f23540a9870 msgr2=0x7f23540a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:30.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 -- 172.21.15.32:0/2191149193 shutdown_connections 2024-01-19T04:15:30.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.603+0000 7f235c000640 1 -- 172.21.15.32:0/2191149193 wait complete. 2024-01-19T04:15:30.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 Processor -- start 2024-01-19T04:15:30.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 -- start start 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f235406eb70 0x7f2354154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f235414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2354151f30 0x7f235414c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23541f0a20 con 0x7f235406fda0 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23540c6e80 con 0x7f2354151f30 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235406d380 con 0x7f235406eb70 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f235414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f235414bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35758/0 (socket says 172.21.15.32:35758) 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 -- 172.21.15.32:0/3098693070 learned_addr learned my addr 172.21.15.32:0/3098693070 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2359600640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f235406eb70 0x7f2354154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235a000640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2354151f30 0x7f235414c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 -- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f235406eb70 msgr2=0x7f2354154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f235406eb70 0x7f2354154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 -- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2354151f30 msgr2=0x7f235414c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2354151f30 0x7f235414c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 -- 172.21.15.32:0/3098693070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009420 con 0x7f235406fda0 2024-01-19T04:15:30.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2358c00640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f235414bf20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f233c01a020 tx=0x7f233c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:30.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2351600640 1 -- 172.21.15.32:0/3098693070 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0b4610 con 0x7f235406fda0 2024-01-19T04:15:30.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2351600640 1 -- 172.21.15.32:0/3098693070 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c0abe90 con 0x7f235406fda0 2024-01-19T04:15:30.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f2351600640 1 -- 172.21.15.32:0/3098693070 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0b49d0 con 0x7f235406fda0 2024-01-19T04:15:30.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235406d660 con 0x7f235406fda0 2024-01-19T04:15:30.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23540bf090 con 0x7f235406fda0 2024-01-19T04:15:30.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.607+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23540bf280 con 0x7f235406fda0 2024-01-19T04:15:30.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.611+0000 7f2351600640 1 -- 172.21.15.32:0/3098693070 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f233c0b2040 con 0x7f235406fda0 2024-01-19T04:15:30.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.611+0000 7f2351600640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f232c066500 0x7f232c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.611+0000 7f2351600640 1 -- 172.21.15.32:0/3098693070 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f233c11dea0 con 0x7f235406fda0 2024-01-19T04:15:30.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.611+0000 7f2359600640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f232c066500 0x7f232c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.611+0000 7f2359600640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f232c066500 0x7f232c0689c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f234400b9d0 tx=0x7f2344008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:30.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.615+0000 7f2351600640 1 -- 172.21.15.32:0/3098693070 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f233c0eb130 con 0x7f235406fda0 2024-01-19T04:15:30.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.779+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23540749f0 con 0x7f235406fda0 2024-01-19T04:15:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.779+0000 7f2351600640 1 -- 172.21.15.32:0/3098693070 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f233c0ee750 con 0x7f235406fda0 2024-01-19T04:15:30.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:30.784 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:30.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f232c066500 msgr2=0x7f232c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f232c066500 0x7f232c0689c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f234400b9d0 tx=0x7f2344008040 comp rx=0 tx=0).stop 2024-01-19T04:15:30.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 msgr2=0x7f235414bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f235414bf20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f233c01a020 tx=0x7f233c019190 comp rx=0 tx=0).stop 2024-01-19T04:15:30.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 shutdown_connections 2024-01-19T04:15:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f232c066500 0x7f232c0689c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2354151f30 0x7f235414c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235406fda0 0x7f235414bf20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 --2- 172.21.15.32:0/3098693070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f235406eb70 0x7f2354154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 >> 172.21.15.32:0/3098693070 conn(0x7f23540a9870 msgr2=0x7f235415e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 shutdown_connections 2024-01-19T04:15:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.783+0000 7f235c000640 1 -- 172.21.15.32:0/3098693070 wait complete. 2024-01-19T04:15:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:30.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:30.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.943+0000 7f9218a00640 1 Processor -- start 2024-01-19T04:15:30.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9218a00640 1 -- start start 2024-01-19T04:15:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9218a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f921006d440 0x7f92100c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9218a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92100a4ea0 con 0x7f92100723b0 2024-01-19T04:15:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9218a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9210152a20 con 0x7f92100c2080 2024-01-19T04:15:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9218a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92101524a0 con 0x7f921006d440 2024-01-19T04:15:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9216000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f92100723b0 0x7f9210152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36824/0 (socket says 172.21.15.32:36824) 2024-01-19T04:15:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9216000640 1 -- 172.21.15.32:0/2780432050 learned_addr learned my addr 172.21.15.32:0/2780432050 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9216a00640 1 --2- 172.21.15.32:0/2780432050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f921006d440 0x7f92100c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9214c00640 1 -- 172.21.15.32:0/2780432050 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656974556 0 0) 0x7f92100a4ea0 con 0x7f92100723b0 2024-01-19T04:15:30.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9214c00640 1 -- 172.21.15.32:0/2780432050 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f0003530 con 0x7f92100723b0 2024-01-19T04:15:30.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9216a00640 1 -- 172.21.15.32:0/2780432050 >> v1:172.21.15.67:6789/0 conn(0x7f92100c2080 legacy=0x7f9210155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9214c00640 1 -- 172.21.15.32:0/2780432050 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 193421492 0 0) 0x7f91f0003530 con 0x7f92100723b0 2024-01-19T04:15:30.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9216a00640 1 -- 172.21.15.32:0/2780432050 >> v1:172.21.15.32:6789/0 conn(0x7f92100723b0 legacy=0x7f9210152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.947+0000 7f9216a00640 1 -- 172.21.15.32:0/2780432050 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100c3430 con 0x7f921006d440 2024-01-19T04:15:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9216a00640 1 --2- 172.21.15.32:0/2780432050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f921006d440 0x7f92100c4e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9208009dc0 tx=0x7f920801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12de9e3ddf53ccee server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9214c00640 1 -- 172.21.15.32:0/2780432050 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200001680 con 0x7f921006d440 2024-01-19T04:15:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9214c00640 1 -- 172.21.15.32:0/2780432050 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92080a48e0 con 0x7f921006d440 2024-01-19T04:15:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9214c00640 1 -- 172.21.15.32:0/2780432050 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080a4c70 con 0x7f921006d440 2024-01-19T04:15:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9218a00640 1 -- 172.21.15.32:0/2780432050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f921006d440 msgr2=0x7f92100c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9218a00640 1 --2- 172.21.15.32:0/2780432050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f921006d440 0x7f92100c4e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9208009dc0 tx=0x7f920801c360 comp rx=0 tx=0).stop 2024-01-19T04:15:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9218a00640 1 -- 172.21.15.32:0/2780432050 shutdown_connections 2024-01-19T04:15:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9218a00640 1 --2- 172.21.15.32:0/2780432050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f921006d440 0x7f92100c4e50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9218a00640 1 -- 172.21.15.32:0/2780432050 >> 172.21.15.32:0/2780432050 conn(0x7f92100c25a0 msgr2=0x7f92100c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:30.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9218a00640 1 -- 172.21.15.32:0/2780432050 shutdown_connections 2024-01-19T04:15:30.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.951+0000 7f9218a00640 1 -- 172.21.15.32:0/2780432050 wait complete. 2024-01-19T04:15:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 Processor -- start 2024-01-19T04:15:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 -- start start 2024-01-19T04:15:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f921006d440 0x7f9210154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92100723b0 0x7f9210147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92100c2080 0x7f9210148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9210149cb0 con 0x7f92100723b0 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9210155430 con 0x7f921006d440 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92100a8bf0 con 0x7f92100c2080 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92100723b0 0x7f9210147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92100723b0 0x7f9210147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35766/0 (socket says 172.21.15.32:35766) 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 -- 172.21.15.32:0/1535087392 learned_addr learned my addr 172.21.15.32:0/1535087392 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9216a00640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92100c2080 0x7f9210148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9216000640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f921006d440 0x7f9210154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 -- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92100c2080 msgr2=0x7f9210148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92100c2080 0x7f9210148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 -- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f921006d440 msgr2=0x7f9210154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f921006d440 0x7f9210154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 -- 172.21.15.32:0/1535087392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208009a70 con 0x7f92100723b0 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9215600640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92100723b0 0x7f9210147bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c750 tx=0x7f91f800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f920e000640 1 -- 172.21.15.32:0/1535087392 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8005270 con 0x7f92100723b0 2024-01-19T04:15:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f920e000640 1 -- 172.21.15.32:0/1535087392 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f80053f0 con 0x7f92100723b0 2024-01-19T04:15:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f920e000640 1 -- 172.21.15.32:0/1535087392 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f800a880 con 0x7f92100723b0 2024-01-19T04:15:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92100a8ed0 con 0x7f92100723b0 2024-01-19T04:15:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.955+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9210148670 con 0x7f92100723b0 2024-01-19T04:15:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.959+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92100a93f0 con 0x7f92100723b0 2024-01-19T04:15:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.959+0000 7f920e000640 1 -- 172.21.15.32:0/1535087392 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f91f800a9e0 con 0x7f92100723b0 2024-01-19T04:15:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.959+0000 7f920e000640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91e8066530 0x7f91e80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.959+0000 7f920e000640 1 -- 172.21.15.32:0/1535087392 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91f80833e0 con 0x7f92100723b0 2024-01-19T04:15:30.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.959+0000 7f9216000640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91e8066530 0x7f91e80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:30.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.959+0000 7f9216000640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91e8066530 0x7f91e80689f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92000011f0 tx=0x7f9200000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:30.963+0000 7f920e000640 1 -- 172.21.15.32:0/1535087392 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f91f80507c0 con 0x7f92100723b0 2024-01-19T04:15:31.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.123+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92100749f0 con 0x7f92100723b0 2024-01-19T04:15:31.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.123+0000 7f920e000640 1 -- 172.21.15.32:0/1535087392 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91f80170a0 con 0x7f92100723b0 2024-01-19T04:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:31.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91e8066530 msgr2=0x7f91e80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91e8066530 0x7f91e80689f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92000011f0 tx=0x7f9200000ee0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92100723b0 msgr2=0x7f9210147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92100723b0 0x7f9210147bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c750 tx=0x7f91f800cc10 comp rx=0 tx=0).stop 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 shutdown_connections 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91e8066530 0x7f91e80689f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92100c2080 0x7f9210148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92100723b0 0x7f9210147bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 --2- 172.21.15.32:0/1535087392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f921006d440 0x7f9210154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 >> 172.21.15.32:0/1535087392 conn(0x7f92100c25a0 msgr2=0x7f921014c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 shutdown_connections 2024-01-19T04:15:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.127+0000 7f9218a00640 1 -- 172.21.15.32:0/1535087392 wait complete. 2024-01-19T04:15:31.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:31.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.291+0000 7f6b66c00640 1 Processor -- start 2024-01-19T04:15:31.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.291+0000 7f6b66c00640 1 -- start start 2024-01-19T04:15:31.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b66c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b6006c220 0x7f6b600a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b66c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b600beed0 con 0x7f6b60155520 2024-01-19T04:15:31.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b66c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6006c630 con 0x7f6b60072490 2024-01-19T04:15:31.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b66c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6006e0c0 con 0x7f6b6006c220 2024-01-19T04:15:31.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b5fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6b60155520 0x7f6b6006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36830/0 (socket says 172.21.15.32:36830) 2024-01-19T04:15:31.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b5fe00640 1 -- 172.21.15.32:0/424933536 learned_addr learned my addr 172.21.15.32:0/424933536 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:31.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b64c00640 1 --2- 172.21.15.32:0/424933536 >> v2:172.21.15.67:3300/0 conn(0x7f6b6006c220 0x7f6b600a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b5ea00640 1 -- 172.21.15.32:0/424933536 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672395704 0 0) 0x7f6b600beed0 con 0x7f6b60155520 2024-01-19T04:15:31.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b5ea00640 1 -- 172.21.15.32:0/424933536 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b40003530 con 0x7f6b60155520 2024-01-19T04:15:31.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b64c00640 1 -- 172.21.15.32:0/424933536 >> v1:172.21.15.67:6789/0 conn(0x7f6b60072490 legacy=0x7f6b600bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b64c00640 1 -- 172.21.15.32:0/424933536 >> v1:172.21.15.32:6789/0 conn(0x7f6b60155520 legacy=0x7f6b6006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.295+0000 7f6b64c00640 1 -- 172.21.15.32:0/424933536 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600c3a80 con 0x7f6b6006c220 2024-01-19T04:15:31.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b64c00640 1 --2- 172.21.15.32:0/424933536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b6006c220 0x7f6b600a4d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009d90 tx=0x7f6b5801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa4746df31e15550 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b5ea00640 1 -- 172.21.15.32:0/424933536 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580a5780 con 0x7f6b6006c220 2024-01-19T04:15:31.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b5ea00640 1 -- 172.21.15.32:0/424933536 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b580a58e0 con 0x7f6b6006c220 2024-01-19T04:15:31.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b5ea00640 1 -- 172.21.15.32:0/424933536 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580a5c70 con 0x7f6b6006c220 2024-01-19T04:15:31.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b66c00640 1 -- 172.21.15.32:0/424933536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b6006c220 msgr2=0x7f6b600a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b66c00640 1 --2- 172.21.15.32:0/424933536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b6006c220 0x7f6b600a4d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009d90 tx=0x7f6b5801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b66c00640 1 -- 172.21.15.32:0/424933536 shutdown_connections 2024-01-19T04:15:31.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b66c00640 1 --2- 172.21.15.32:0/424933536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b6006c220 0x7f6b600a4d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b66c00640 1 -- 172.21.15.32:0/424933536 >> 172.21.15.32:0/424933536 conn(0x7f6b600c25a0 msgr2=0x7f6b600c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:31.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b66c00640 1 -- 172.21.15.32:0/424933536 shutdown_connections 2024-01-19T04:15:31.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.299+0000 7f6b66c00640 1 -- 172.21.15.32:0/424933536 wait complete. 2024-01-19T04:15:31.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 Processor -- start 2024-01-19T04:15:31.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 -- start start 2024-01-19T04:15:31.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b6006c220 0x7f6b600a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b60072490 0x7f6b60070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b60155520 0x7f6b600709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60071490 con 0x7f6b6006c220 2024-01-19T04:15:31.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60070000 con 0x7f6b60072490 2024-01-19T04:15:31.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60071ca0 con 0x7f6b60155520 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b6006c220 0x7f6b600a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b6006c220 0x7f6b600a69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35770/0 (socket says 172.21.15.32:35770) 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 -- 172.21.15.32:0/1342498177 learned_addr learned my addr 172.21.15.32:0/1342498177 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b64c00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b60155520 0x7f6b600709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5f400640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b60072490 0x7f6b60070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 -- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b60155520 msgr2=0x7f6b600709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b60155520 0x7f6b600709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 -- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b60072490 msgr2=0x7f6b60070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b60072490 0x7f6b60070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 -- 172.21.15.32:0/1342498177 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58009a70 con 0x7f6b6006c220 2024-01-19T04:15:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b5fe00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b6006c220 0x7f6b600a69a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c500 tx=0x7f6b5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b57e00640 1 -- 172.21.15.32:0/1342498177 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50005cf0 con 0x7f6b6006c220 2024-01-19T04:15:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b57e00640 1 -- 172.21.15.32:0/1342498177 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50005e50 con 0x7f6b6006c220 2024-01-19T04:15:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b600a72f0 con 0x7f6b6006c220 2024-01-19T04:15:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b57e00640 1 -- 172.21.15.32:0/1342498177 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500072f0 con 0x7f6b6006c220 2024-01-19T04:15:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b600719c0 con 0x7f6b6006c220 2024-01-19T04:15:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.303+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b60153a00 con 0x7f6b6006c220 2024-01-19T04:15:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.307+0000 7f6b57e00640 1 -- 172.21.15.32:0/1342498177 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6b50007450 con 0x7f6b6006c220 2024-01-19T04:15:31.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.307+0000 7f6b57e00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b38066500 0x7f6b380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.307+0000 7f6b57e00640 1 -- 172.21.15.32:0/1342498177 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b50083430 con 0x7f6b6006c220 2024-01-19T04:15:31.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.307+0000 7f6b5f400640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b38066500 0x7f6b380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.307+0000 7f6b5f400640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b38066500 0x7f6b380689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b6014d410 tx=0x7f6b48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.311+0000 7f6b57e00640 1 -- 172.21.15.32:0/1342498177 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6b50050770 con 0x7f6b6006c220 2024-01-19T04:15:31.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.467+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b600749f0 con 0x7f6b6006c220 2024-01-19T04:15:31.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.467+0000 7f6b57e00640 1 -- 172.21.15.32:0/1342498177 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b50053d90 con 0x7f6b6006c220 2024-01-19T04:15:31.473 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:31.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b38066500 msgr2=0x7f6b380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b38066500 0x7f6b380689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b6014d410 tx=0x7f6b48009040 comp rx=0 tx=0).stop 2024-01-19T04:15:31.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b6006c220 msgr2=0x7f6b600a69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b6006c220 0x7f6b600a69a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c500 tx=0x7f6b5000c9c0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 shutdown_connections 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b38066500 0x7f6b380689c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b60155520 0x7f6b600709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b60072490 0x7f6b60070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 --2- 172.21.15.32:0/1342498177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b6006c220 0x7f6b600a69a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 >> 172.21.15.32:0/1342498177 conn(0x7f6b600c25a0 msgr2=0x7f6b600bf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 shutdown_connections 2024-01-19T04:15:31.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.471+0000 7f6b66c00640 1 -- 172.21.15.32:0/1342498177 wait complete. 2024-01-19T04:15:31.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:31.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24bb400640 1 Processor -- start 2024-01-19T04:15:31.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24bb400640 1 -- start start 2024-01-19T04:15:31.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24bb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f24b40c1750 0x7f24b414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24bb400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b40c4e40 con 0x7f24b40726c0 2024-01-19T04:15:31.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24bb400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b4158dc0 con 0x7f24b414e970 2024-01-19T04:15:31.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24bb400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b406f540 con 0x7f24b40c1750 2024-01-19T04:15:31.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b9400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f24b40726c0 0x7f24b406a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36836/0 (socket says 172.21.15.32:36836) 2024-01-19T04:15:31.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b9400640 1 -- 172.21.15.32:0/2573775513 learned_addr learned my addr 172.21.15.32:0/2573775513 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:31.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b3e00640 1 --2- 172.21.15.32:0/2573775513 >> v2:172.21.15.67:3300/0 conn(0x7f24b40c1750 0x7f24b414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b3400640 1 -- 172.21.15.32:0/2573775513 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383228797 0 0) 0x7f24b40c4e40 con 0x7f24b40726c0 2024-01-19T04:15:31.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b3400640 1 -- 172.21.15.32:0/2573775513 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2494003530 con 0x7f24b40726c0 2024-01-19T04:15:31.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b3e00640 1 -- 172.21.15.32:0/2573775513 >> v1:172.21.15.67:6789/0 conn(0x7f24b414e970 legacy=0x7f24b4070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b3e00640 1 -- 172.21.15.32:0/2573775513 >> v1:172.21.15.32:6789/0 conn(0x7f24b40726c0 legacy=0x7f24b406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.635+0000 7f24b3e00640 1 -- 172.21.15.32:0/2573775513 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40c4b60 con 0x7f24b40c1750 2024-01-19T04:15:31.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24b3e00640 1 --2- 172.21.15.32:0/2573775513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 0x7f24b414ed50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097c0 tx=0x7f249c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5826613d1f0d738 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24b3400640 1 -- 172.21.15.32:0/2573775513 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0ab600 con 0x7f24b40c1750 2024-01-19T04:15:31.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24b3400640 1 -- 172.21.15.32:0/2573775513 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0a7050 con 0x7f24b40c1750 2024-01-19T04:15:31.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24b3400640 1 -- 172.21.15.32:0/2573775513 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0ab980 con 0x7f24b40c1750 2024-01-19T04:15:31.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24bb400640 1 -- 172.21.15.32:0/2573775513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 msgr2=0x7f24b414ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24bb400640 1 --2- 172.21.15.32:0/2573775513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 0x7f24b414ed50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097c0 tx=0x7f249c01c3f0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24bb400640 1 -- 172.21.15.32:0/2573775513 shutdown_connections 2024-01-19T04:15:31.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24bb400640 1 --2- 172.21.15.32:0/2573775513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 0x7f24b414ed50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.639+0000 7f24bb400640 1 -- 172.21.15.32:0/2573775513 >> 172.21.15.32:0/2573775513 conn(0x7f24b40c6b30 msgr2=0x7f24b40c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:31.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 -- 172.21.15.32:0/2573775513 shutdown_connections 2024-01-19T04:15:31.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 -- 172.21.15.32:0/2573775513 wait complete. 2024-01-19T04:15:31.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 Processor -- start 2024-01-19T04:15:31.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 -- start start 2024-01-19T04:15:31.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24b40726c0 0x7f24b414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 0x7f24b41516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b414e970 0x7f24b4151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4152ff0 con 0x7f24b414e970 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b406ed10 con 0x7f24b40c1750 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4152260 con 0x7f24b40726c0 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b414e970 0x7f24b4151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b414e970 0x7f24b4151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35784/0 (socket says 172.21.15.32:35784) 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 -- 172.21.15.32:0/958622502 learned_addr learned my addr 172.21.15.32:0/958622502 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b3e00640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 0x7f24b41516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b8a00640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24b40726c0 0x7f24b414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 -- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24b40726c0 msgr2=0x7f24b414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24b40726c0 0x7f24b414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 -- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 msgr2=0x7f24b41516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 0x7f24b41516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 -- 172.21.15.32:0/958622502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c009420 con 0x7f24b414e970 2024-01-19T04:15:31.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b9400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b414e970 0x7f24b4151c10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00cad0 tx=0x7f24ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b0c00640 1 -- 172.21.15.32:0/958622502 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00ac30 con 0x7f24b414e970 2024-01-19T04:15:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b0c00640 1 -- 172.21.15.32:0/958622502 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac00ad90 con 0x7f24b414e970 2024-01-19T04:15:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24b0c00640 1 -- 172.21.15.32:0/958622502 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac012620 con 0x7f24b414e970 2024-01-19T04:15:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.643+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b40a6220 con 0x7f24b414e970 2024-01-19T04:15:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.647+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b41f1600 con 0x7f24b414e970 2024-01-19T04:15:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.647+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b406eec0 con 0x7f24b414e970 2024-01-19T04:15:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.647+0000 7f24b0c00640 1 -- 172.21.15.32:0/958622502 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f24ac007070 con 0x7f24b414e970 2024-01-19T04:15:31.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.647+0000 7f24b0c00640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f248c066530 0x7f248c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.647+0000 7f24b0c00640 1 -- 172.21.15.32:0/958622502 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24ac083e90 con 0x7f24b414e970 2024-01-19T04:15:31.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.647+0000 7f24b8a00640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f248c066530 0x7f248c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.651+0000 7f24b8a00640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f248c066530 0x7f248c0689f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24a4000f70 tx=0x7f24a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.651+0000 7f24b0c00640 1 -- 172.21.15.32:0/958622502 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f24b406eec0 con 0x7f24b414e970 2024-01-19T04:15:31.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.811+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24b406eec0 con 0x7f24b414e970 2024-01-19T04:15:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.811+0000 7f24b0c00640 1 -- 172.21.15.32:0/958622502 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24b406eec0 con 0x7f24b414e970 2024-01-19T04:15:31.817 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f248c066530 msgr2=0x7f248c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f248c066530 0x7f248c0689f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24a4000f70 tx=0x7f24a4009040 comp rx=0 tx=0).stop 2024-01-19T04:15:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b414e970 msgr2=0x7f24b4151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b414e970 0x7f24b4151c10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00cad0 tx=0x7f24ac00cf90 comp rx=0 tx=0).stop 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 shutdown_connections 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f248c066530 0x7f248c0689f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b414e970 0x7f24b4151c10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b40c1750 0x7f24b41516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 --2- 172.21.15.32:0/958622502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f24b40726c0 0x7f24b414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 >> 172.21.15.32:0/958622502 conn(0x7f24b40c6b30 msgr2=0x7f24b4071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 shutdown_connections 2024-01-19T04:15:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.815+0000 7f24bb400640 1 -- 172.21.15.32:0/958622502 wait complete. 2024-01-19T04:15:31.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:15:31.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.975+0000 7f66c4000640 1 Processor -- start 2024-01-19T04:15:31.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.975+0000 7f66c4000640 1 -- start start 2024-01-19T04:15:31.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c4000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66bc155320 0x7f66bc0a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c4000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc0c44f0 con 0x7f66bc0c54b0 2024-01-19T04:15:31.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c4000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc0c4980 con 0x7f66bc0a52e0 2024-01-19T04:15:31.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c4000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc0c3bc0 con 0x7f66bc155320 2024-01-19T04:15:31.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c0c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f66bc0c54b0 0x7f66bc06cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36838/0 (socket says 172.21.15.32:36838) 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c0c00640 1 -- 172.21.15.32:0/3250518788 learned_addr learned my addr 172.21.15.32:0/3250518788 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c1600640 1 --2- 172.21.15.32:0/3250518788 >> v2:172.21.15.67:3300/0 conn(0x7f66bc155320 0x7f66bc0a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249684731 0 0) 0x7f66bc0c44f0 con 0x7f66bc0c54b0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f669c003530 con 0x7f66bc0c54b0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286990538 0 0) 0x7f66bc0c4980 con 0x7f66bc0a52e0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66bc0c44f0 con 0x7f66bc0a52e0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593313656 0 0) 0x7f669c003530 con 0x7f66bc0c54b0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 >> v2:172.21.15.67:3300/0 conn(0x7f66bc155320 msgr2=0x7f66bc0a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 --2- 172.21.15.32:0/3250518788 >> v2:172.21.15.67:3300/0 conn(0x7f66bc155320 0x7f66bc0a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 >> v1:172.21.15.67:6789/0 conn(0x7f66bc0a52e0 legacy=0x7f66bc15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc0c3ea0 con 0x7f66bc0c54b0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f66a4001680 con 0x7f66bc0c54b0 2024-01-19T04:15:31.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 >> v1:172.21.15.32:6789/0 conn(0x7f66bc0c54b0 legacy=0x7f66bc06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c003b10 0x7f669c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c0047d0 0x7f669c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f669c005190 0x7f669c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0c3bc0 con 0x7f669c005190 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c00c010 con 0x7f669c0047d0 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c00c1d0 con 0x7f669c003b10 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c2000640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f669c005190 0x7f669c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c1600640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c003b10 0x7f669c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c0c00640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c0047d0 0x7f669c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c2000640 1 -- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c003b10 msgr2=0x7f669c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c2000640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c003b10 0x7f669c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c2000640 1 -- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c0047d0 msgr2=0x7f669c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:31.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c2000640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c0047d0 0x7f669c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.979+0000 7f66c2000640 1 -- 172.21.15.32:0/3250518788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c003530 con 0x7f669c005190 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c2000640 1 -- 172.21.15.32:0/3250518788 reap_dead start 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c2000640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f669c005190 0x7f669c00b990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66b4001fd0 tx=0x7f66b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad439497aa9dafa server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4007ea0 con 0x7f669c005190 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4003ba0 con 0x7f669c005190 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66bbe00640 1 -- 172.21.15.32:0/3250518788 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40050d0 con 0x7f669c005190 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 -- 172.21.15.32:0/3250518788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f669c005190 msgr2=0x7f669c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f669c005190 0x7f669c00b990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66b4001fd0 tx=0x7f66b401c8e0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 -- 172.21.15.32:0/3250518788 shutdown_connections 2024-01-19T04:15:31.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 --2- 172.21.15.32:0/3250518788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f669c005190 0x7f669c00b990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 -- 172.21.15.32:0/3250518788 >> 172.21.15.32:0/3250518788 conn(0x7f66bc0c5b20 msgr2=0x7f66bc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:31.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 -- 172.21.15.32:0/3250518788 shutdown_connections 2024-01-19T04:15:31.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 -- 172.21.15.32:0/3250518788 wait complete. 2024-01-19T04:15:31.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.983+0000 7f66c4000640 1 Processor -- start 2024-01-19T04:15:31.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 -- start start 2024-01-19T04:15:31.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c005190 0x7f66bc14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc1e7960 0x7f66bc0a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc0a73a0 0x7f66bc147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc1df5e0 con 0x7f66bc0a73a0 2024-01-19T04:15:31.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc1dfba0 con 0x7f66bc1e7960 2024-01-19T04:15:31.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc1edf50 con 0x7f669c005190 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc0a73a0 0x7f66bc147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc0a73a0 0x7f66bc147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35812/0 (socket says 172.21.15.32:35812) 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 -- 172.21.15.32:0/1232906820 learned_addr learned my addr 172.21.15.32:0/1232906820 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c1600640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c005190 0x7f66bc14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c0c00640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc1e7960 0x7f66bc0a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 -- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c005190 msgr2=0x7f66bc14e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c005190 0x7f66bc14e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 -- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc1e7960 msgr2=0x7f66bc0a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc1e7960 0x7f66bc0a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 -- 172.21.15.32:0/1232906820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc1ee230 con 0x7f66bc0a73a0 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c1600640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c005190 0x7f66bc14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:31.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c0c00640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc1e7960 0x7f66bc0a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:31.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c2000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc0a73a0 0x7f66bc147c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f66b401d180 tx=0x7f669c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66b9600640 1 -- 172.21.15.32:0/1232906820 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40b4070 con 0x7f66bc0a73a0 2024-01-19T04:15:31.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66b9600640 1 -- 172.21.15.32:0/1232906820 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4005710 con 0x7f66bc0a73a0 2024-01-19T04:15:31.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc1df830 con 0x7f66bc0a73a0 2024-01-19T04:15:31.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66b9600640 1 -- 172.21.15.32:0/1232906820 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4005880 con 0x7f66bc0a73a0 2024-01-19T04:15:31.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc0a4da0 con 0x7f66bc0a73a0 2024-01-19T04:15:31.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.987+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc14ec80 con 0x7f66bc0a73a0 2024-01-19T04:15:31.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.991+0000 7f66b9600640 1 -- 172.21.15.32:0/1232906820 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f66b40a66e0 con 0x7f66bc0a73a0 2024-01-19T04:15:31.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.991+0000 7f66b9600640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066530 0x7f66940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:31.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.991+0000 7f66b9600640 1 -- 172.21.15.32:0/1232906820 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66b40aa070 con 0x7f66bc0a73a0 2024-01-19T04:15:31.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.991+0000 7f66c1600640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066530 0x7f66940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:31.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.991+0000 7f66c1600640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066530 0x7f66940689f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009b60 tx=0x7f66ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:31.995+0000 7f66b9600640 1 -- 172.21.15.32:0/1232906820 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f66b40eac60 con 0x7f66bc0a73a0 2024-01-19T04:15:32.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.167+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f66bc1ee090 con 0x7f66bc0a73a0 2024-01-19T04:15:32.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66b9600640 1 -- 172.21.15.32:0/1232906820 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f66bc1ee090 con 0x7f66bc0a73a0 2024-01-19T04:15:32.174 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066530 msgr2=0x7f66940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066530 0x7f66940689f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009b60 tx=0x7f66ac008040 comp rx=0 tx=0).stop 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc0a73a0 msgr2=0x7f66bc147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc0a73a0 0x7f66bc147c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f66b401d180 tx=0x7f669c005800 comp rx=0 tx=0).stop 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 shutdown_connections 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6694066530 0x7f66940689f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66bc0a73a0 0x7f66bc147c30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66bc1e7960 0x7f66bc0a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 --2- 172.21.15.32:0/1232906820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f669c005190 0x7f66bc14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 >> 172.21.15.32:0/1232906820 conn(0x7f66bc0c5b20 msgr2=0x7f66bc0c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 shutdown_connections 2024-01-19T04:15:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.171+0000 7f66c4000640 1 -- 172.21.15.32:0/1232906820 wait complete. 2024-01-19T04:15:32.196 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-19T04:15:32.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:32.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-19T04:15:32.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:15:32.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:32.230 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T04:15:32.289 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:15:32.289 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:32.299 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:15:32.299 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:32.349 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:15:32.349 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:15:32.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:32.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.535+0000 7f666ee00640 1 Processor -- start 2024-01-19T04:15:32.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.535+0000 7f666ee00640 1 -- start start 2024-01-19T04:15:32.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ee00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f666806f550 0x7f66681588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ee00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66681546b0 0x7f6668154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ee00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6668072d40 con 0x7f6668151f10 2024-01-19T04:15:32.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ee00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66680c3450 con 0x7f66681546b0 2024-01-19T04:15:32.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ee00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6668072800 con 0x7f666806f550 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ce00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66681546b0 0x7f6668154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f6667e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6668151f10 0x7f66680720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36854/0 (socket says 172.21.15.32:36854) 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f6667e00640 1 -- 172.21.15.32:0/2628706782 learned_addr learned my addr 172.21.15.32:0/2628706782 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f6667400640 1 --2- 172.21.15.32:0/2628706782 >> v2:172.21.15.67:3300/0 conn(0x7f666806f550 0x7f66681588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ce00640 1 -- 172.21.15.32:0/2628706782 >> v2:172.21.15.67:3300/0 conn(0x7f666806f550 msgr2=0x7f66681588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ce00640 1 --2- 172.21.15.32:0/2628706782 >> v2:172.21.15.67:3300/0 conn(0x7f666806f550 0x7f66681588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ce00640 1 -- 172.21.15.32:0/2628706782 >> v1:172.21.15.32:6789/0 conn(0x7f6668151f10 legacy=0x7f66680720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f666ce00640 1 -- 172.21.15.32:0/2628706782 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668072a60 con 0x7f66681546b0 2024-01-19T04:15:32.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.539+0000 7f6666a00640 1 -- 172.21.15.32:0/2628706782 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096015719 0 0) 0x7f6668072d40 con 0x7f6668151f10 2024-01-19T04:15:32.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ce00640 1 --2- 172.21.15.32:0/2628706782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f6668154ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6668070f40 tx=0x7f666001c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9b9671f8f9344b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:32.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f6666a00640 1 -- 172.21.15.32:0/2628706782 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600a5680 con 0x7f66681546b0 2024-01-19T04:15:32.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f6666a00640 1 -- 172.21.15.32:0/2628706782 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66600a57e0 con 0x7f66681546b0 2024-01-19T04:15:32.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f6666a00640 1 -- 172.21.15.32:0/2628706782 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600a5b70 con 0x7f66681546b0 2024-01-19T04:15:32.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 -- 172.21.15.32:0/2628706782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 msgr2=0x7f6668154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 --2- 172.21.15.32:0/2628706782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f6668154ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6668070f40 tx=0x7f666001c7c0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 -- 172.21.15.32:0/2628706782 shutdown_connections 2024-01-19T04:15:32.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 --2- 172.21.15.32:0/2628706782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f6668154ac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 --2- 172.21.15.32:0/2628706782 >> v2:172.21.15.67:3300/0 conn(0x7f666806f550 0x7f66681588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 -- 172.21.15.32:0/2628706782 >> 172.21.15.32:0/2628706782 conn(0x7f66680c7040 msgr2=0x7f66680c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:32.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 -- 172.21.15.32:0/2628706782 shutdown_connections 2024-01-19T04:15:32.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 -- 172.21.15.32:0/2628706782 wait complete. 2024-01-19T04:15:32.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 Processor -- start 2024-01-19T04:15:32.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.543+0000 7f666ee00640 1 -- start start 2024-01-19T04:15:32.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f666806f550 0x7f66680be620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6668151f10 0x7f66680bf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f666806ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668155430 con 0x7f66681546b0 2024-01-19T04:15:32.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668155090 con 0x7f6668151f10 2024-01-19T04:15:32.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6668156430 con 0x7f666806f550 2024-01-19T04:15:32.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f666806ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f666806ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35838/0 (socket says 172.21.15.32:35838) 2024-01-19T04:15:32.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 -- 172.21.15.32:0/1364294521 learned_addr learned my addr 172.21.15.32:0/1364294521 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:32.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f6667e00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f666806f550 0x7f66680be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f6667400640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6668151f10 0x7f66680bf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 -- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f666806f550 msgr2=0x7f66680be620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f666806f550 0x7f66680be620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 -- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6668151f10 msgr2=0x7f66680bf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6668151f10 0x7f66680bf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 -- 172.21.15.32:0/1364294521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6660009a70 con 0x7f66681546b0 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ce00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f666806ce00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66600b0040 tx=0x7f6660019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f665fe00640 1 -- 172.21.15.32:0/1364294521 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600ad850 con 0x7f66681546b0 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f665fe00640 1 -- 172.21.15.32:0/1364294521 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66600ad9b0 con 0x7f66681546b0 2024-01-19T04:15:32.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f665fe00640 1 -- 172.21.15.32:0/1364294521 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600adda0 con 0x7f66681546b0 2024-01-19T04:15:32.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6668156710 con 0x7f66681546b0 2024-01-19T04:15:32.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6668156cd0 con 0x7f66681546b0 2024-01-19T04:15:32.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6668067340 con 0x7f66681546b0 2024-01-19T04:15:32.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.547+0000 7f665fe00640 1 -- 172.21.15.32:0/1364294521 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f66600b4050 con 0x7f66681546b0 2024-01-19T04:15:32.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.551+0000 7f665fe00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6640066500 0x7f66400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.551+0000 7f665fe00640 1 -- 172.21.15.32:0/1364294521 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f666011f210 con 0x7f66681546b0 2024-01-19T04:15:32.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.551+0000 7f6667e00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6640066500 0x7f66400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.551+0000 7f6667e00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6640066500 0x7f66400689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6658007fd0 tx=0x7f6658007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:32.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.555+0000 7f665fe00640 1 -- 172.21.15.32:0/1364294521 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f66600ec5e0 con 0x7f66681546b0 2024-01-19T04:15:32.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.715+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66680bf610 con 0x7f66681546b0 2024-01-19T04:15:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f665fe00640 1 -- 172.21.15.32:0/1364294521 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f66600efc00 con 0x7f66681546b0 2024-01-19T04:15:32.723 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:32.723 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6640066500 msgr2=0x7f66400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6640066500 0x7f66400689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6658007fd0 tx=0x7f6658007d60 comp rx=0 tx=0).stop 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 msgr2=0x7f666806ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f666806ce00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66600b0040 tx=0x7f6660019560 comp rx=0 tx=0).stop 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 shutdown_connections 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6640066500 0x7f66400689c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66681546b0 0x7f666806ce00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6668151f10 0x7f66680bf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 --2- 172.21.15.32:0/1364294521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f666806f550 0x7f66680be620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 >> 172.21.15.32:0/1364294521 conn(0x7f66680c7040 msgr2=0x7f66680bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 shutdown_connections 2024-01-19T04:15:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.719+0000 7f666ee00640 1 -- 172.21.15.32:0/1364294521 wait complete. 2024-01-19T04:15:32.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:32.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:32.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.883+0000 7f070b600640 1 Processor -- start 2024-01-19T04:15:32.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.883+0000 7f070b600640 1 -- start start 2024-01-19T04:15:32.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f070b600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0704155150 0x7f0704157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f070b600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07040c6360 0x7f07040c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f070b600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040c2d30 con 0x7f0704151b80 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f070b600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040c34a0 con 0x7f0704155150 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f070b600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0704155730 con 0x7f07040c6360 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0703e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0704155150 0x7f0704157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0703e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0704155150 0x7f0704157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35842/0 (socket says 172.21.15.32:35842) 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0708c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0704151b80 0x7f07040c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36856/0 (socket says 172.21.15.32:36856) 2024-01-19T04:15:32.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0703e00640 1 -- 172.21.15.32:0/1921554043 learned_addr learned my addr 172.21.15.32:0/1921554043 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:32.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0709600640 1 --2- 172.21.15.32:0/1921554043 >> v2:172.21.15.67:3300/0 conn(0x7f07040c6360 0x7f07040c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0703e00640 1 -- 172.21.15.32:0/1921554043 >> v2:172.21.15.67:3300/0 conn(0x7f07040c6360 msgr2=0x7f07040c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:32.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0703e00640 1 --2- 172.21.15.32:0/1921554043 >> v2:172.21.15.67:3300/0 conn(0x7f07040c6360 0x7f07040c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0703e00640 1 -- 172.21.15.32:0/1921554043 >> v1:172.21.15.32:6789/0 conn(0x7f0704151b80 legacy=0x7f07040c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0703e00640 1 -- 172.21.15.32:0/1921554043 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040c3010 con 0x7f0704155150 2024-01-19T04:15:32.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.887+0000 7f0709600640 1 --2- 172.21.15.32:0/1921554043 >> v2:172.21.15.67:3300/0 conn(0x7f07040c6360 0x7f07040c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:32.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f0703e00640 1 --2- 172.21.15.32:0/1921554043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f0704157cc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f07040c6120 tx=0x7f06ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf249d637d223a84 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:32.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f0703400640 1 -- 172.21.15.32:0/1921554043 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0aa430 con 0x7f0704155150 2024-01-19T04:15:32.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f0703400640 1 -- 172.21.15.32:0/1921554043 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0aa590 con 0x7f0704155150 2024-01-19T04:15:32.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f0703400640 1 -- 172.21.15.32:0/1921554043 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0aa920 con 0x7f0704155150 2024-01-19T04:15:32.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 -- 172.21.15.32:0/1921554043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 msgr2=0x7f0704157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 --2- 172.21.15.32:0/1921554043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f0704157cc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f07040c6120 tx=0x7f06ec01c4d0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 -- 172.21.15.32:0/1921554043 shutdown_connections 2024-01-19T04:15:32.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 --2- 172.21.15.32:0/1921554043 >> v2:172.21.15.67:3300/0 conn(0x7f07040c6360 0x7f07040c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 --2- 172.21.15.32:0/1921554043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f0704157cc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 -- 172.21.15.32:0/1921554043 >> 172.21.15.32:0/1921554043 conn(0x7f07040c7d40 msgr2=0x7f07040c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:32.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 -- 172.21.15.32:0/1921554043 shutdown_connections 2024-01-19T04:15:32.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 -- 172.21.15.32:0/1921554043 wait complete. 2024-01-19T04:15:32.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 Processor -- start 2024-01-19T04:15:32.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.891+0000 7f070b600640 1 -- start start 2024-01-19T04:15:32.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07040c6360 0x7f070406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0704151b80 0x7f07041f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f07041f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0704156b90 con 0x7f0704155150 2024-01-19T04:15:32.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07041f0660 con 0x7f0704151b80 2024-01-19T04:15:32.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07041f1570 con 0x7f07040c6360 2024-01-19T04:15:32.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f07041f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f07041f1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35848/0 (socket says 172.21.15.32:35848) 2024-01-19T04:15:32.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 -- 172.21.15.32:0/1045709606 learned_addr learned my addr 172.21.15.32:0/1045709606 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0703e00640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0704151b80 0x7f07041f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0708c00640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07040c6360 0x7f070406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 -- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07040c6360 msgr2=0x7f070406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07040c6360 0x7f070406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 -- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0704151b80 msgr2=0x7f07041f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0704151b80 0x7f07041f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 -- 172.21.15.32:0/1045709606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0094d0 con 0x7f0704155150 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0708c00640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07040c6360 0x7f070406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0709600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f07041f1030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00cd50 tx=0x7f06fc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:32.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0700c00640 1 -- 172.21.15.32:0/1045709606 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00f680 con 0x7f0704155150 2024-01-19T04:15:32.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0700c00640 1 -- 172.21.15.32:0/1045709606 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00f800 con 0x7f0704155150 2024-01-19T04:15:32.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0704156760 con 0x7f0704155150 2024-01-19T04:15:32.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0700c00640 1 -- 172.21.15.32:0/1045709606 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00fbb0 con 0x7f0704155150 2024-01-19T04:15:32.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0704149490 con 0x7f0704155150 2024-01-19T04:15:32.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07041f0810 con 0x7f0704155150 2024-01-19T04:15:32.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.895+0000 7f0700c00640 1 -- 172.21.15.32:0/1045709606 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f06fc00b040 con 0x7f0704155150 2024-01-19T04:15:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.899+0000 7f0700c00640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f06dc066530 0x7f06dc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.899+0000 7f0700c00640 1 -- 172.21.15.32:0/1045709606 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06fc084880 con 0x7f0704155150 2024-01-19T04:15:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.899+0000 7f0708c00640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f06dc066530 0x7f06dc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.899+0000 7f0708c00640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f06dc066530 0x7f06dc0689f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f06f4007fd0 tx=0x7f06f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:32.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:32.903+0000 7f0700c00640 1 -- 172.21.15.32:0/1045709606 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f07041f0810 con 0x7f0704155150 2024-01-19T04:15:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07041f0810 con 0x7f0704155150 2024-01-19T04:15:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f0700c00640 1 -- 172.21.15.32:0/1045709606 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07041f0810 con 0x7f0704155150 2024-01-19T04:15:33.067 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f06dc066530 msgr2=0x7f06dc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f06dc066530 0x7f06dc0689f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f06f4007fd0 tx=0x7f06f4009040 comp rx=0 tx=0).stop 2024-01-19T04:15:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 msgr2=0x7f07041f1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f07041f1030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00cd50 tx=0x7f06fc00a650 comp rx=0 tx=0).stop 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 shutdown_connections 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f06dc066530 0x7f06dc0689f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0704155150 0x7f07041f1030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0704151b80 0x7f07041f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 --2- 172.21.15.32:0/1045709606 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f07040c6360 0x7f070406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 >> 172.21.15.32:0/1045709606 conn(0x7f07040c7d40 msgr2=0x7f07040c3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 shutdown_connections 2024-01-19T04:15:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.063+0000 7f070b600640 1 -- 172.21.15.32:0/1045709606 wait complete. 2024-01-19T04:15:33.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:33.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 Processor -- start 2024-01-19T04:15:33.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 -- start start 2024-01-19T04:15:33.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91c4151dc0 0x7f91c40c1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91c40c15b0 0x7f91c406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c406c6a0 con 0x7f91c4151dc0 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c41521a0 con 0x7f91c40c15b0 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91cac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4154cf0 con 0x7f91c40c4360 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91c4151dc0 0x7f91c40c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91c4151dc0 0x7f91c40c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35864/0 (socket says 172.21.15.32:35864) 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 -- 172.21.15.32:0/2257194876 learned_addr learned my addr 172.21.15.32:0/2257194876 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c8c00640 1 --2- 172.21.15.32:0/2257194876 >> v2:172.21.15.67:3300/0 conn(0x7f91c40c15b0 0x7f91c406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 -- 172.21.15.32:0/2257194876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 msgr2=0x7f91c406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:33.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 --2- 172.21.15.32:0/2257194876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 -- 172.21.15.32:0/2257194876 >> v2:172.21.15.67:3300/0 conn(0x7f91c40c15b0 msgr2=0x7f91c406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:33.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 --2- 172.21.15.32:0/2257194876 >> v2:172.21.15.67:3300/0 conn(0x7f91c40c15b0 0x7f91c406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.231+0000 7f91c3e00640 1 -- 172.21.15.32:0/2257194876 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4154fd0 con 0x7f91c4151dc0 2024-01-19T04:15:33.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91c3e00640 1 --2- 172.21.15.32:0/2257194876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c4151dc0 0x7f91c40c1070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91c4070ba0 tx=0x7f91b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86c0cdbb9d36805 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91c2a00640 1 -- 172.21.15.32:0/2257194876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40aa5f0 con 0x7f91c4151dc0 2024-01-19T04:15:33.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91c2a00640 1 -- 172.21.15.32:0/2257194876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b40aa750 con 0x7f91c4151dc0 2024-01-19T04:15:33.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91c2a00640 1 -- 172.21.15.32:0/2257194876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40aaae0 con 0x7f91c4151dc0 2024-01-19T04:15:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 -- 172.21.15.32:0/2257194876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c4151dc0 msgr2=0x7f91c40c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 --2- 172.21.15.32:0/2257194876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c4151dc0 0x7f91c40c1070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91c4070ba0 tx=0x7f91b401c4d0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 -- 172.21.15.32:0/2257194876 shutdown_connections 2024-01-19T04:15:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 --2- 172.21.15.32:0/2257194876 >> v2:172.21.15.67:3300/0 conn(0x7f91c40c15b0 0x7f91c406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 --2- 172.21.15.32:0/2257194876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 --2- 172.21.15.32:0/2257194876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c4151dc0 0x7f91c40c1070 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 -- 172.21.15.32:0/2257194876 >> 172.21.15.32:0/2257194876 conn(0x7f91c40c7d00 msgr2=0x7f91c40c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:33.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 -- 172.21.15.32:0/2257194876 shutdown_connections 2024-01-19T04:15:33.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.235+0000 7f91cac00640 1 -- 172.21.15.32:0/2257194876 wait complete. 2024-01-19T04:15:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 Processor -- start 2024-01-19T04:15:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 -- start start 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c40c15b0 0x7f91c406ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c41f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91c4151dc0 0x7f91c41f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c41f1380 con 0x7f91c40c15b0 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c41f1590 con 0x7f91c4151dc0 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40ab0b0 con 0x7f91c40c4360 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c40c15b0 0x7f91c406ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c40c15b0 0x7f91c406ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35878/0 (socket says 172.21.15.32:35878) 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3e00640 1 -- 172.21.15.32:0/1413158494 learned_addr learned my addr 172.21.15.32:0/1413158494 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3400640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c41f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c8c00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91c4151dc0 0x7f91c41f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3400640 1 -- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91c4151dc0 msgr2=0x7f91c41f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3400640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91c4151dc0 0x7f91c41f0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3400640 1 -- 172.21.15.32:0/1413158494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c40c15b0 msgr2=0x7f91c406ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3400640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c40c15b0 0x7f91c406ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3400640 1 -- 172.21.15.32:0/1413158494 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40094d0 con 0x7f91c40c4360 2024-01-19T04:15:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3e00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c40c15b0 0x7f91c406ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91c3400640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c41f0900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e850 tx=0x7f91ac00ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91bbe00640 1 -- 172.21.15.32:0/1413158494 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0095b0 con 0x7f91c40c4360 2024-01-19T04:15:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91bbe00640 1 -- 172.21.15.32:0/1413158494 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00c940 con 0x7f91c40c4360 2024-01-19T04:15:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91bbe00640 1 -- 172.21.15.32:0/1413158494 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00ccd0 con 0x7f91c40c4360 2024-01-19T04:15:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4154ac0 con 0x7f91c40c4360 2024-01-19T04:15:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c406e900 con 0x7f91c40c4360 2024-01-19T04:15:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.239+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c406b900 con 0x7f91c40c4360 2024-01-19T04:15:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.243+0000 7f91bbe00640 1 -- 172.21.15.32:0/1413158494 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f91ac0059a0 con 0x7f91c40c4360 2024-01-19T04:15:33.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.243+0000 7f91bbe00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f919c066500 0x7f919c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.243+0000 7f91bbe00640 1 -- 172.21.15.32:0/1413158494 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91ac0845d0 con 0x7f91c40c4360 2024-01-19T04:15:33.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.243+0000 7f91c3e00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f919c066500 0x7f919c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.243+0000 7f91c3e00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f919c066500 0x7f919c0689c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91b401c510 tx=0x7f91b40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.247+0000 7f91bbe00640 1 -- 172.21.15.32:0/1413158494 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f91ac051990 con 0x7f91c40c4360 2024-01-19T04:15:33.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91c406ea90 con 0x7f91c40c4360 2024-01-19T04:15:33.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91bbe00640 1 -- 172.21.15.32:0/1413158494 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91ac054fb0 con 0x7f91c40c4360 2024-01-19T04:15:33.411 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f919c066500 msgr2=0x7f919c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f919c066500 0x7f919c0689c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91b401c510 tx=0x7f91b40b5040 comp rx=0 tx=0).stop 2024-01-19T04:15:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 msgr2=0x7f91c41f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c41f0900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e850 tx=0x7f91ac00ed10 comp rx=0 tx=0).stop 2024-01-19T04:15:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 shutdown_connections 2024-01-19T04:15:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f919c066500 0x7f919c0689c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91c4151dc0 0x7f91c41f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91c40c4360 0x7f91c41f0900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 --2- 172.21.15.32:0/1413158494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91c40c15b0 0x7f91c406ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 >> 172.21.15.32:0/1413158494 conn(0x7f91c40c7d00 msgr2=0x7f91c40c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 shutdown_connections 2024-01-19T04:15:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.407+0000 7f91cac00640 1 -- 172.21.15.32:0/1413158494 wait complete. 2024-01-19T04:15:33.432 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:33.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.571+0000 7fd353800640 1 Processor -- start 2024-01-19T04:15:33.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.571+0000 7fd353800640 1 -- start start 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd353800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd34c14eb90 0x7fd34c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd353800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd34c0720b0 0x7fd34c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd353800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c072730 con 0x7fd34c06c670 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd353800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c072a10 con 0x7fd34c14eb90 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd353800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c14ef70 con 0x7fd34c0720b0 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd34c14eb90 0x7fd34c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd34c14eb90 0x7fd34c1549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35890/0 (socket says 172.21.15.32:35890) 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 -- 172.21.15.32:0/2514715834 learned_addr learned my addr 172.21.15.32:0/2514715834 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd34be00640 1 --1- 172.21.15.32:0/2514715834 >> v1:172.21.15.32:6789/0 conn(0x7fd34c06c670 0x7fd34c0719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36868/0 (socket says 172.21.15.32:36868) 2024-01-19T04:15:33.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd351800640 1 --2- 172.21.15.32:0/2514715834 >> v2:172.21.15.67:3300/0 conn(0x7fd34c0720b0 0x7fd34c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 -- 172.21.15.32:0/2514715834 >> v2:172.21.15.67:3300/0 conn(0x7fd34c0720b0 msgr2=0x7fd34c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:33.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 --2- 172.21.15.32:0/2514715834 >> v2:172.21.15.67:3300/0 conn(0x7fd34c0720b0 0x7fd34c154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 -- 172.21.15.32:0/2514715834 >> v1:172.21.15.32:6789/0 conn(0x7fd34c06c670 legacy=0x7fd34c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 -- 172.21.15.32:0/2514715834 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c155580 con 0x7fd34c14eb90 2024-01-19T04:15:33.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd34b400640 1 -- 172.21.15.32:0/2514715834 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708685258 0 0) 0x7fd34c072730 con 0x7fd34c06c670 2024-01-19T04:15:33.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.575+0000 7fd350e00640 1 --2- 172.21.15.32:0/2514715834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c1549d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0c3430 tx=0x7fd33c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbb08834d6f3471 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd34b400640 1 -- 172.21.15.32:0/2514715834 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0ab600 con 0x7fd34c14eb90 2024-01-19T04:15:33.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd34b400640 1 -- 172.21.15.32:0/2514715834 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c0a7050 con 0x7fd34c14eb90 2024-01-19T04:15:33.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd34b400640 1 -- 172.21.15.32:0/2514715834 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0ab980 con 0x7fd34c14eb90 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- 172.21.15.32:0/2514715834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 msgr2=0x7fd34c1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 --2- 172.21.15.32:0/2514715834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c1549d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0c3430 tx=0x7fd33c01c3e0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- 172.21.15.32:0/2514715834 shutdown_connections 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 --2- 172.21.15.32:0/2514715834 >> v2:172.21.15.67:3300/0 conn(0x7fd34c0720b0 0x7fd34c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 --2- 172.21.15.32:0/2514715834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c1549d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- 172.21.15.32:0/2514715834 >> 172.21.15.32:0/2514715834 conn(0x7fd34c0c25a0 msgr2=0x7fd34c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- 172.21.15.32:0/2514715834 shutdown_connections 2024-01-19T04:15:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- 172.21.15.32:0/2514715834 wait complete. 2024-01-19T04:15:33.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 Processor -- start 2024-01-19T04:15:33.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- start start 2024-01-19T04:15:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd34c06c670 0x7fd34c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd34c0720b0 0x7fd34c15b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c150920 con 0x7fd34c14eb90 2024-01-19T04:15:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c151280 con 0x7fd34c0720b0 2024-01-19T04:15:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.579+0000 7fd353800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c152240 con 0x7fd34c06c670 2024-01-19T04:15:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c14a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35902/0 (socket says 172.21.15.32:35902) 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 -- 172.21.15.32:0/3006578439 learned_addr learned my addr 172.21.15.32:0/3006578439 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd34be00640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd34c0720b0 0x7fd34c15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd350e00640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd34c06c670 0x7fd34c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 -- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd34c06c670 msgr2=0x7fd34c150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd34c06c670 0x7fd34c150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 -- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd34c0720b0 msgr2=0x7fd34c15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd34c0720b0 0x7fd34c15b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 -- 172.21.15.32:0/3006578439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0094d0 con 0x7fd34c14eb90 2024-01-19T04:15:33.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd351800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c14a060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd344007d40 tx=0x7fd34400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd348c00640 1 -- 172.21.15.32:0/3006578439 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344014420 con 0x7fd34c14eb90 2024-01-19T04:15:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd348c00640 1 -- 172.21.15.32:0/3006578439 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3440145a0 con 0x7fd34c14eb90 2024-01-19T04:15:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd348c00640 1 -- 172.21.15.32:0/3006578439 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344014950 con 0x7fd34c14eb90 2024-01-19T04:15:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c1edca0 con 0x7fd34c14eb90 2024-01-19T04:15:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c150580 con 0x7fd34c14eb90 2024-01-19T04:15:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c150a60 con 0x7fd34c14eb90 2024-01-19T04:15:33.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.583+0000 7fd348c00640 1 -- 172.21.15.32:0/3006578439 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd344014ab0 con 0x7fd34c14eb90 2024-01-19T04:15:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.587+0000 7fd348c00640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd324066500 0x7fd3240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.587+0000 7fd348c00640 1 -- 172.21.15.32:0/3006578439 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3440847c0 con 0x7fd34c14eb90 2024-01-19T04:15:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.587+0000 7fd350e00640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd324066500 0x7fd3240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.587+0000 7fd350e00640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd324066500 0x7fd3240689c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ad000 tx=0x7fd33c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.587+0000 7fd348c00640 1 -- 172.21.15.32:0/3006578439 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd344051a50 con 0x7fd34c14eb90 2024-01-19T04:15:33.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd34c0749f0 con 0x7fd34c14eb90 2024-01-19T04:15:33.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd348c00640 1 -- 172.21.15.32:0/3006578439 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd344055070 con 0x7fd34c14eb90 2024-01-19T04:15:33.755 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd324066500 msgr2=0x7fd3240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd324066500 0x7fd3240689c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ad000 tx=0x7fd33c008040 comp rx=0 tx=0).stop 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 msgr2=0x7fd34c14a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c14a060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd344007d40 tx=0x7fd34400e4b0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 shutdown_connections 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd324066500 0x7fd3240689c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd34c14eb90 0x7fd34c14a060 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd34c0720b0 0x7fd34c15b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 --2- 172.21.15.32:0/3006578439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd34c06c670 0x7fd34c150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 >> 172.21.15.32:0/3006578439 conn(0x7fd34c0c25a0 msgr2=0x7fd34c0a6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:33.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 shutdown_connections 2024-01-19T04:15:33.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.751+0000 7fd353800640 1 -- 172.21.15.32:0/3006578439 wait complete. 2024-01-19T04:15:33.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:15:33.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4ac800640 1 Processor -- start 2024-01-19T04:15:33.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4ac800640 1 -- start start 2024-01-19T04:15:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4ac800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a414fb50 0x7fb4a406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4ac800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a4071e80 con 0x7fb4a40a4ec0 2024-01-19T04:15:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4ac800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a40726c0 con 0x7fb4a40c04a0 2024-01-19T04:15:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4ac800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a41535c0 con 0x7fb4a414fb50 2024-01-19T04:15:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4aa800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb4a40a4ec0 0x7fb4a415cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36874/0 (socket says 172.21.15.32:36874) 2024-01-19T04:15:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4aa800640 1 -- 172.21.15.32:0/3326519907 learned_addr learned my addr 172.21.15.32:0/3326519907 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:33.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4a9e00640 1 --2- 172.21.15.32:0/3326519907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a414fb50 0x7fb4a406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4a8a00640 1 -- 172.21.15.32:0/3326519907 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569789094 0 0) 0x7fb4a4071e80 con 0x7fb4a40a4ec0 2024-01-19T04:15:33.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4a8a00640 1 -- 172.21.15.32:0/3326519907 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb484003530 con 0x7fb4a40a4ec0 2024-01-19T04:15:33.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4a9e00640 1 -- 172.21.15.32:0/3326519907 >> v1:172.21.15.67:6789/0 conn(0x7fb4a40c04a0 legacy=0x7fb4a40c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.915+0000 7fb4a8a00640 1 -- 172.21.15.32:0/3326519907 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092219776 0 0) 0x7fb4a40726c0 con 0x7fb4a40c04a0 2024-01-19T04:15:33.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4a9e00640 1 -- 172.21.15.32:0/3326519907 >> v1:172.21.15.32:6789/0 conn(0x7fb4a40a4ec0 legacy=0x7fb4a415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4a9e00640 1 -- 172.21.15.32:0/3326519907 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a40c0a20 con 0x7fb4a414fb50 2024-01-19T04:15:33.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4a9e00640 1 --2- 172.21.15.32:0/3326519907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a414fb50 0x7fb4a406fec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb494009820 tx=0x7fb49401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408dc428345c7460 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4a8a00640 1 -- 172.21.15.32:0/3326519907 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940a4ea0 con 0x7fb4a414fb50 2024-01-19T04:15:33.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4a8a00640 1 -- 172.21.15.32:0/3326519907 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4940a7050 con 0x7fb4a414fb50 2024-01-19T04:15:33.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4a8a00640 1 -- 172.21.15.32:0/3326519907 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940ab820 con 0x7fb4a414fb50 2024-01-19T04:15:33.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4ac800640 1 -- 172.21.15.32:0/3326519907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a414fb50 msgr2=0x7fb4a406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.919+0000 7fb4ac800640 1 --2- 172.21.15.32:0/3326519907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a414fb50 0x7fb4a406fec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb494009820 tx=0x7fb49401c410 comp rx=0 tx=0).stop 2024-01-19T04:15:33.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- 172.21.15.32:0/3326519907 shutdown_connections 2024-01-19T04:15:33.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 --2- 172.21.15.32:0/3326519907 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a414fb50 0x7fb4a406fec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- 172.21.15.32:0/3326519907 >> 172.21.15.32:0/3326519907 conn(0x7fb4a40c5b20 msgr2=0x7fb4a40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:33.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- 172.21.15.32:0/3326519907 shutdown_connections 2024-01-19T04:15:33.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- 172.21.15.32:0/3326519907 wait complete. 2024-01-19T04:15:33.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 Processor -- start 2024-01-19T04:15:33.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- start start 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a40a4ec0 0x7fb4a40bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a40c04a0 0x7fb4a41effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a414fb50 0x7fb4a41f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a41f0a50 con 0x7fb4a40c04a0 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4154890 con 0x7fb4a414fb50 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4ac800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4155660 con 0x7fb4a40a4ec0 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a40c04a0 0x7fb4a41effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a40a4ec0 0x7fb4a40bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a40c04a0 0x7fb4a41effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35916/0 (socket says 172.21.15.32:35916) 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 -- 172.21.15.32:0/2350433052 learned_addr learned my addr 172.21.15.32:0/2350433052 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4aa800640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a414fb50 0x7fb4a41f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 -- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a40a4ec0 msgr2=0x7fb4a40bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a40a4ec0 0x7fb4a40bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 -- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a414fb50 msgr2=0x7fb4a41f0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a414fb50 0x7fb4a41f0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.923+0000 7fb4a9400640 1 -- 172.21.15.32:0/2350433052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494009420 con 0x7fb4a40c04a0 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4a9400640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a40c04a0 0x7fb4a41effd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c480 tx=0x7fb48c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4a2000640 1 -- 172.21.15.32:0/2350433052 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c005480 con 0x7fb4a40c04a0 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4a2000640 1 -- 172.21.15.32:0/2350433052 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c003600 con 0x7fb4a40c04a0 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4a2000640 1 -- 172.21.15.32:0/2350433052 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0039b0 con 0x7fb4a40c04a0 2024-01-19T04:15:33.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a4154ae0 con 0x7fb4a40c04a0 2024-01-19T04:15:33.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a41550a0 con 0x7fb4a40c04a0 2024-01-19T04:15:33.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a4072b30 con 0x7fb4a40c04a0 2024-01-19T04:15:33.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4a2000640 1 -- 172.21.15.32:0/2350433052 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb48c003b10 con 0x7fb4a40c04a0 2024-01-19T04:15:33.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4a2000640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb47c066500 0x7fb47c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:33.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.927+0000 7fb4a2000640 1 -- 172.21.15.32:0/2350433052 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb48c083910 con 0x7fb4a40c04a0 2024-01-19T04:15:33.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.931+0000 7fb4a9e00640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb47c066500 0x7fb47c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.931+0000 7fb4a9e00640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb47c066500 0x7fb47c0689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb4940ad000 tx=0x7fb4940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:33.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:33.931+0000 7fb4a2000640 1 -- 172.21.15.32:0/2350433052 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb4a4072b30 con 0x7fb4a40c04a0 2024-01-19T04:15:34.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4a4072b30 con 0x7fb4a40c04a0 2024-01-19T04:15:34.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4a2000640 1 -- 172.21.15.32:0/2350433052 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb4a4072b30 con 0x7fb4a40c04a0 2024-01-19T04:15:34.110 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:15:34.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb47c066500 msgr2=0x7fb47c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb47c066500 0x7fb47c0689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb4940ad000 tx=0x7fb4940a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:34.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a40c04a0 msgr2=0x7fb4a41effd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a40c04a0 0x7fb4a41effd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c480 tx=0x7fb48c00c940 comp rx=0 tx=0).stop 2024-01-19T04:15:34.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 shutdown_connections 2024-01-19T04:15:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb47c066500 0x7fb47c0689c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4a414fb50 0x7fb4a41f0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4a40c04a0 0x7fb4a41effd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 --2- 172.21.15.32:0/2350433052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb4a40a4ec0 0x7fb4a40bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 >> 172.21.15.32:0/2350433052 conn(0x7fb4a40c5b20 msgr2=0x7fb4a4151d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 shutdown_connections 2024-01-19T04:15:34.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.107+0000 7fb4ac800640 1 -- 172.21.15.32:0/2350433052 wait complete. 2024-01-19T04:15:34.132 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-19T04:15:34.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:34.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-19T04:15:34.172 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:15:34.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:15:34.172 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:15:34.232 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-19T04:15:34.232 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7628800640 1 Processor -- start 2024-01-19T04:15:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7628800640 1 -- start start 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7628800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76200c6e20 0x7f76200c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7628800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76200a6d30 0x7f76200c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7628800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76201533a0 con 0x7f762006fda0 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7628800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7620156380 con 0x7f76200c6e20 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7628800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762014fe40 con 0x7f76200a6d30 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76200c6e20 0x7f76200c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76200c6e20 0x7f76200c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35918/0 (socket says 172.21.15.32:35918) 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625e00640 1 -- 172.21.15.32:0/2167741855 learned_addr learned my addr 172.21.15.32:0/2167741855 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7626800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f762006fda0 0x7f7620152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36880/0 (socket says 172.21.15.32:36880) 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625400640 1 --2- 172.21.15.32:0/2167741855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76200a6d30 0x7f76200c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625e00640 1 -- 172.21.15.32:0/2167741855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76200a6d30 msgr2=0x7f76200c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625e00640 1 --2- 172.21.15.32:0/2167741855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76200a6d30 0x7f76200c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625e00640 1 -- 172.21.15.32:0/2167741855 >> v1:172.21.15.32:6789/0 conn(0x7f762006fda0 legacy=0x7f7620152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7625e00640 1 -- 172.21.15.32:0/2167741855 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620152800 con 0x7f76200c6e20 2024-01-19T04:15:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.371+0000 7f7624a00640 1 -- 172.21.15.32:0/2167741855 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135734298 0 0) 0x7f76180014a0 con 0x7f762006fda0 2024-01-19T04:15:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7625e00640 1 --2- 172.21.15.32:0/2167741855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200c6e20 0x7f76200c7200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7610009870 tx=0x7f761001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792812dc873e0dc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7624a00640 1 -- 172.21.15.32:0/2167741855 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100ab620 con 0x7f76200c6e20 2024-01-19T04:15:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7624a00640 1 -- 172.21.15.32:0/2167741855 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76100ab780 con 0x7f76200c6e20 2024-01-19T04:15:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7624a00640 1 -- 172.21.15.32:0/2167741855 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100abb10 con 0x7f76200c6e20 2024-01-19T04:15:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 -- 172.21.15.32:0/2167741855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200c6e20 msgr2=0x7f76200c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 --2- 172.21.15.32:0/2167741855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200c6e20 0x7f76200c7200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7610009870 tx=0x7f761001c420 comp rx=0 tx=0).stop 2024-01-19T04:15:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 -- 172.21.15.32:0/2167741855 shutdown_connections 2024-01-19T04:15:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 --2- 172.21.15.32:0/2167741855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76200a6d30 0x7f76200c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 --2- 172.21.15.32:0/2167741855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200c6e20 0x7f76200c7200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 -- 172.21.15.32:0/2167741855 >> 172.21.15.32:0/2167741855 conn(0x7f76200a9870 msgr2=0x7f76200a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 -- 172.21.15.32:0/2167741855 shutdown_connections 2024-01-19T04:15:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.375+0000 7f7628800640 1 -- 172.21.15.32:0/2167741855 wait complete. 2024-01-19T04:15:34.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 Processor -- start 2024-01-19T04:15:34.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 -- start start 2024-01-19T04:15:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f762006fda0 0x7f762006b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200a6d30 0x7f7620154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76200c6e20 0x7f76201ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620153920 con 0x7f76200a6d30 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200bea90 con 0x7f76200c6e20 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7620154f50 con 0x7f762006fda0 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200a6d30 0x7f7620154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200a6d30 0x7f7620154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35922/0 (socket says 172.21.15.32:35922) 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 -- 172.21.15.32:0/583521472 learned_addr learned my addr 172.21.15.32:0/583521472 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625e00640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f762006fda0 0x7f762006b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7626800640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76200c6e20 0x7f76201ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 -- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f762006fda0 msgr2=0x7f762006b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f762006fda0 0x7f762006b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 -- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76200c6e20 msgr2=0x7f76201ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76200c6e20 0x7f76201ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 -- 172.21.15.32:0/583521472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100094d0 con 0x7f76200a6d30 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7625400640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200a6d30 0x7f7620154a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f760800d7d0 tx=0x7f760800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f761e000640 1 -- 172.21.15.32:0/583521472 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800b6c0 con 0x7f76200a6d30 2024-01-19T04:15:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f761e000640 1 -- 172.21.15.32:0/583521472 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800b820 con 0x7f76200a6d30 2024-01-19T04:15:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f761e000640 1 -- 172.21.15.32:0/583521472 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760800bbd0 con 0x7f76200a6d30 2024-01-19T04:15:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.379+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7620155760 con 0x7f76200a6d30 2024-01-19T04:15:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.383+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7620155480 con 0x7f76200a6d30 2024-01-19T04:15:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.383+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76200749f0 con 0x7f76200a6d30 2024-01-19T04:15:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.383+0000 7f761e000640 1 -- 172.21.15.32:0/583521472 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f760800bd30 con 0x7f76200a6d30 2024-01-19T04:15:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.383+0000 7f761e000640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75f8066530 0x7f75f80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.383+0000 7f761e000640 1 -- 172.21.15.32:0/583521472 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7608084270 con 0x7f76200a6d30 2024-01-19T04:15:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.383+0000 7f7625e00640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75f8066530 0x7f75f80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.383+0000 7f7625e00640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75f8066530 0x7f75f80689f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76100af000 tx=0x7f76100b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.387+0000 7f761e000640 1 -- 172.21.15.32:0/583521472 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f76080515b0 con 0x7f76200a6d30 2024-01-19T04:15:34.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.579+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7620067bb0 con 0x7f76200a6d30 2024-01-19T04:15:34.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.579+0000 7f761e000640 1 -- 172.21.15.32:0/583521472 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f7608054bd0 con 0x7f76200a6d30 2024-01-19T04:15:34.585 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:34.586 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:34.586 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:34.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75f8066530 msgr2=0x7f75f80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75f8066530 0x7f75f80689f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76100af000 tx=0x7f76100b6040 comp rx=0 tx=0).stop 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200a6d30 msgr2=0x7f7620154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200a6d30 0x7f7620154a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f760800d7d0 tx=0x7f760800dc90 comp rx=0 tx=0).stop 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 shutdown_connections 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75f8066530 0x7f75f80689f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76200c6e20 0x7f76201ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76200a6d30 0x7f7620154a10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 --2- 172.21.15.32:0/583521472 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f762006fda0 0x7f762006b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 >> 172.21.15.32:0/583521472 conn(0x7f76200a9870 msgr2=0x7f762015b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 shutdown_connections 2024-01-19T04:15:34.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.583+0000 7f7628800640 1 -- 172.21.15.32:0/583521472 wait complete. 2024-01-19T04:15:34.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:34.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd4d600640 1 Processor -- start 2024-01-19T04:15:34.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd4d600640 1 -- start start 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd4d600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd48151f30 0x7fdd480c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd4d600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd4806fda0 0x7fdd480c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd4d600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd480c5b40 con 0x7fdd4806eb70 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd4d600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd481551e0 con 0x7fdd48151f30 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd4d600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd48155710 con 0x7fdd4806fda0 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd48151f30 0x7fdd480c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd48151f30 0x7fdd480c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35932/0 (socket says 172.21.15.32:35932) 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46a00640 1 -- 172.21.15.32:0/179896383 learned_addr learned my addr 172.21.15.32:0/179896383 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46000640 1 --2- 172.21.15.32:0/179896383 >> v2:172.21.15.67:3300/0 conn(0x7fdd4806fda0 0x7fdd480c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46a00640 1 -- 172.21.15.32:0/179896383 >> v2:172.21.15.67:3300/0 conn(0x7fdd4806fda0 msgr2=0x7fdd480c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46a00640 1 --2- 172.21.15.32:0/179896383 >> v2:172.21.15.67:3300/0 conn(0x7fdd4806fda0 0x7fdd480c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46a00640 1 -- 172.21.15.32:0/179896383 >> v1:172.21.15.67:6789/0 conn(0x7fdd4806eb70 legacy=0x7fdd4806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:34.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.747+0000 7fdd46a00640 1 -- 172.21.15.32:0/179896383 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480c3fa0 con 0x7fdd48151f30 2024-01-19T04:15:34.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd46a00640 1 --2- 172.21.15.32:0/179896383 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd48151f30 0x7fdd480c4430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdd4806da70 tx=0x7fdd3801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927d765f8bd977e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd45600640 1 -- 172.21.15.32:0/179896383 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd380ab600 con 0x7fdd48151f30 2024-01-19T04:15:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd45600640 1 -- 172.21.15.32:0/179896383 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd380a7050 con 0x7fdd48151f30 2024-01-19T04:15:34.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd45600640 1 -- 172.21.15.32:0/179896383 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd380ab980 con 0x7fdd48151f30 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 -- 172.21.15.32:0/179896383 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd48151f30 msgr2=0x7fdd480c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 --2- 172.21.15.32:0/179896383 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd48151f30 0x7fdd480c4430 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdd4806da70 tx=0x7fdd3801c430 comp rx=0 tx=0).stop 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 -- 172.21.15.32:0/179896383 shutdown_connections 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 --2- 172.21.15.32:0/179896383 >> v2:172.21.15.67:3300/0 conn(0x7fdd4806fda0 0x7fdd480c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 --2- 172.21.15.32:0/179896383 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd48151f30 0x7fdd480c4430 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 -- 172.21.15.32:0/179896383 >> 172.21.15.32:0/179896383 conn(0x7fdd480a9870 msgr2=0x7fdd480a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 -- 172.21.15.32:0/179896383 shutdown_connections 2024-01-19T04:15:34.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.751+0000 7fdd4d600640 1 -- 172.21.15.32:0/179896383 wait complete. 2024-01-19T04:15:34.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 Processor -- start 2024-01-19T04:15:34.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 -- start start 2024-01-19T04:15:34.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4806eb70 0x7fdd481f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd4806fda0 0x7fdd481f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48151f30 0x7fdd48156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481f1100 con 0x7fdd4806eb70 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480a74e0 con 0x7fdd48151f30 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48153180 con 0x7fdd4806fda0 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4806eb70 0x7fdd481f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4806eb70 0x7fdd481f0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35942/0 (socket says 172.21.15.32:35942) 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 -- 172.21.15.32:0/1894902799 learned_addr learned my addr 172.21.15.32:0/1894902799 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46000640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd4806fda0 0x7fdd481f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd47400640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48151f30 0x7fdd48156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 -- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd4806fda0 msgr2=0x7fdd481f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd4806fda0 0x7fdd481f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 -- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48151f30 msgr2=0x7fdd48156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48151f30 0x7fdd48156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 -- 172.21.15.32:0/1894902799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380094d0 con 0x7fdd4806eb70 2024-01-19T04:15:34.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd46a00640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4806eb70 0x7fdd481f0590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdd38019040 tx=0x7fdd3801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:34.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd3ea00640 1 -- 172.21.15.32:0/1894902799 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd380b6620 con 0x7fdd4806eb70 2024-01-19T04:15:34.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd3ea00640 1 -- 172.21.15.32:0/1894902799 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd380b6780 con 0x7fdd4806eb70 2024-01-19T04:15:34.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48153460 con 0x7fdd4806eb70 2024-01-19T04:15:34.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd3ea00640 1 -- 172.21.15.32:0/1894902799 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd380b6b30 con 0x7fdd4806eb70 2024-01-19T04:15:34.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.755+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd48153a20 con 0x7fdd4806eb70 2024-01-19T04:15:34.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.759+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd48153c10 con 0x7fdd4806eb70 2024-01-19T04:15:34.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.759+0000 7fdd3ea00640 1 -- 172.21.15.32:0/1894902799 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdd380b2040 con 0x7fdd4806eb70 2024-01-19T04:15:34.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.759+0000 7fdd3ea00640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd20066500 0x7fdd200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:34.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.759+0000 7fdd3ea00640 1 -- 172.21.15.32:0/1894902799 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd3811e300 con 0x7fdd4806eb70 2024-01-19T04:15:34.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.759+0000 7fdd46000640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd20066500 0x7fdd200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:34.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.759+0000 7fdd46000640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd20066500 0x7fdd200689c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd480be080 tx=0x7fdd30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:34.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.763+0000 7fdd3ea00640 1 -- 172.21.15.32:0/1894902799 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdd380eb5b0 con 0x7fdd4806eb70 2024-01-19T04:15:34.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd480749f0 con 0x7fdd4806eb70 2024-01-19T04:15:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd3ea00640 1 -- 172.21.15.32:0/1894902799 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7fdd380eebd0 con 0x7fdd4806eb70 2024-01-19T04:15:34.931 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:34.932 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:34.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd20066500 msgr2=0x7fdd200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd20066500 0x7fdd200689c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd480be080 tx=0x7fdd30008040 comp rx=0 tx=0).stop 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4806eb70 msgr2=0x7fdd481f0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4806eb70 0x7fdd481f0590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdd38019040 tx=0x7fdd3801ac70 comp rx=0 tx=0).stop 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 shutdown_connections 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd20066500 0x7fdd200689c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48151f30 0x7fdd48156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd4806fda0 0x7fdd481f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 --2- 172.21.15.32:0/1894902799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4806eb70 0x7fdd481f0590 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.927+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 >> 172.21.15.32:0/1894902799 conn(0x7fdd480a9870 msgr2=0x7fdd48151380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.931+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 shutdown_connections 2024-01-19T04:15:34.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:34.931+0000 7fdd4d600640 1 -- 172.21.15.32:0/1894902799 wait complete. 2024-01-19T04:15:34.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:14:59.970975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:01.037334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:34.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.091+0000 7fd8f8e00640 1 Processor -- start 2024-01-19T04:15:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.091+0000 7fd8f8e00640 1 -- start start 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f8e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8f40af8c0 0x7fd8f40c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f8e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8f40c7e30 0x7fd8f40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f8e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40c7870 con 0x7fd8f40c4df0 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f8e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40ca330 con 0x7fd8f40c7e30 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f8e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40cab60 con 0x7fd8f40af8c0 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8f40c7e30 0x7fd8f40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8f40c7e30 0x7fd8f40c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35952/0 (socket says 172.21.15.32:35952) 2024-01-19T04:15:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1400640 1 -- 172.21.15.32:0/218327855 learned_addr learned my addr 172.21.15.32:0/218327855 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f2800640 1 --1- 172.21.15.32:0/218327855 >> v1:172.21.15.32:6789/0 conn(0x7fd8f40c4df0 0x7fd8f40c7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36884/0 (socket says 172.21.15.32:36884) 2024-01-19T04:15:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1e00640 1 --2- 172.21.15.32:0/218327855 >> v2:172.21.15.67:3300/0 conn(0x7fd8f40af8c0 0x7fd8f40c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1400640 1 -- 172.21.15.32:0/218327855 >> v2:172.21.15.67:3300/0 conn(0x7fd8f40af8c0 msgr2=0x7fd8f40c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1400640 1 --2- 172.21.15.32:0/218327855 >> v2:172.21.15.67:3300/0 conn(0x7fd8f40af8c0 0x7fd8f40c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1400640 1 -- 172.21.15.32:0/218327855 >> v1:172.21.15.32:6789/0 conn(0x7fd8f40c4df0 legacy=0x7fd8f40c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.095+0000 7fd8f1400640 1 -- 172.21.15.32:0/218327855 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40ca5a0 con 0x7fd8f40c7e30 2024-01-19T04:15:35.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f1400640 1 --2- 172.21.15.32:0/218327855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f40c6c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40acb60 tx=0x7fd8dc01cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900cd6ab3591edbb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f0a00640 1 -- 172.21.15.32:0/218327855 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0aa650 con 0x7fd8f40c7e30 2024-01-19T04:15:35.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f0a00640 1 -- 172.21.15.32:0/218327855 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0aa7b0 con 0x7fd8f40c7e30 2024-01-19T04:15:35.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f0a00640 1 -- 172.21.15.32:0/218327855 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0aab40 con 0x7fd8f40c7e30 2024-01-19T04:15:35.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 -- 172.21.15.32:0/218327855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 msgr2=0x7fd8f40c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/218327855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f40c6c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40acb60 tx=0x7fd8dc01cf30 comp rx=0 tx=0).stop 2024-01-19T04:15:35.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 -- 172.21.15.32:0/218327855 shutdown_connections 2024-01-19T04:15:35.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/218327855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f40c6c20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/218327855 >> v2:172.21.15.67:3300/0 conn(0x7fd8f40af8c0 0x7fd8f40c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 -- 172.21.15.32:0/218327855 >> 172.21.15.32:0/218327855 conn(0x7fd8f4071fa0 msgr2=0x7fd8f40723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:35.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 -- 172.21.15.32:0/218327855 shutdown_connections 2024-01-19T04:15:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 -- 172.21.15.32:0/218327855 wait complete. 2024-01-19T04:15:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 Processor -- start 2024-01-19T04:15:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.099+0000 7fd8f8e00640 1 -- start start 2024-01-19T04:15:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8f40af8c0 0x7fd8f4155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40c4df0 0x7fd8f4151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f4156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41ed2d0 con 0x7fd8f40c7e30 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4158480 con 0x7fd8f40c4df0 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4151bd0 con 0x7fd8f40af8c0 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f4156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f4156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35962/0 (socket says 172.21.15.32:35962) 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 -- 172.21.15.32:0/1502665904 learned_addr learned my addr 172.21.15.32:0/1502665904 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f1400640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40c4df0 0x7fd8f4151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f1e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8f40af8c0 0x7fd8f4155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 -- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8f40af8c0 msgr2=0x7fd8f4155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8f40af8c0 0x7fd8f4155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 -- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40c4df0 msgr2=0x7fd8f4151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40c4df0 0x7fd8f4151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 -- 172.21.15.32:0/1502665904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0094d0 con 0x7fd8f40c7e30 2024-01-19T04:15:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f2800640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f4156570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c7a0 tx=0x7fd8ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8ea000640 1 -- 172.21.15.32:0/1502665904 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00a640 con 0x7fd8f40c7e30 2024-01-19T04:15:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8ea000640 1 -- 172.21.15.32:0/1502665904 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00a7a0 con 0x7fd8f40c7e30 2024-01-19T04:15:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f4156080 con 0x7fd8f40c7e30 2024-01-19T04:15:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8ea000640 1 -- 172.21.15.32:0/1502665904 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00ab10 con 0x7fd8f40c7e30 2024-01-19T04:15:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f40c0860 con 0x7fd8f40c7e30 2024-01-19T04:15:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4158640 con 0x7fd8f40c7e30 2024-01-19T04:15:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.103+0000 7fd8ea000640 1 -- 172.21.15.32:0/1502665904 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd8ec00ac70 con 0x7fd8f40c7e30 2024-01-19T04:15:35.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.107+0000 7fd8ea000640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd8cc066500 0x7fd8cc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.107+0000 7fd8ea000640 1 -- 172.21.15.32:0/1502665904 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8ec083440 con 0x7fd8f40c7e30 2024-01-19T04:15:35.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.107+0000 7fd8f1e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd8cc066500 0x7fd8cc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.107+0000 7fd8f1e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd8cc066500 0x7fd8cc0689c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40079c0 tx=0x7fd8e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.111+0000 7fd8ea000640 1 -- 172.21.15.32:0/1502665904 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd8ec050790 con 0x7fd8f40c7e30 2024-01-19T04:15:35.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.271+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8f40c7870 con 0x7fd8f40c7e30 2024-01-19T04:15:35.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.271+0000 7fd8ea000640 1 -- 172.21.15.32:0/1502665904 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8ec017020 con 0x7fd8f40c7e30 2024-01-19T04:15:35.277 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:35.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd8cc066500 msgr2=0x7fd8cc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd8cc066500 0x7fd8cc0689c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40079c0 tx=0x7fd8e4008040 comp rx=0 tx=0).stop 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 msgr2=0x7fd8f4156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f4156570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c7a0 tx=0x7fd8ec00cc60 comp rx=0 tx=0).stop 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 shutdown_connections 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd8cc066500 0x7fd8cc0689c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8f40c7e30 0x7fd8f4156570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40c4df0 0x7fd8f4151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 --2- 172.21.15.32:0/1502665904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8f40af8c0 0x7fd8f4155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 >> 172.21.15.32:0/1502665904 conn(0x7fd8f4071fa0 msgr2=0x7fd8f40c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 shutdown_connections 2024-01-19T04:15:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.275+0000 7fd8f8e00640 1 -- 172.21.15.32:0/1502665904 wait complete. 2024-01-19T04:15:35.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:15:35.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b9800640 1 Processor -- start 2024-01-19T04:15:35.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b9800640 1 -- start start 2024-01-19T04:15:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b9800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff7b40720b0 0x7ff7b415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b9800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b4072730 con 0x7ff7b414eb90 2024-01-19T04:15:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b9800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b4155580 con 0x7ff7b41550e0 2024-01-19T04:15:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b9800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b4072a10 con 0x7ff7b40720b0 2024-01-19T04:15:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b2a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff7b414eb90 0x7ff7b41549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36892/0 (socket says 172.21.15.32:36892) 2024-01-19T04:15:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b2a00640 1 -- 172.21.15.32:0/3620416122 learned_addr learned my addr 172.21.15.32:0/3620416122 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b3400640 1 --2- 172.21.15.32:0/3620416122 >> v2:172.21.15.67:3300/0 conn(0x7ff7b40720b0 0x7ff7b415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b1600640 1 -- 172.21.15.32:0/3620416122 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911486183 0 0) 0x7ff7b4072730 con 0x7ff7b414eb90 2024-01-19T04:15:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b1600640 1 -- 172.21.15.32:0/3620416122 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff794003530 con 0x7ff7b414eb90 2024-01-19T04:15:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b3400640 1 -- 172.21.15.32:0/3620416122 >> v1:172.21.15.67:6789/0 conn(0x7ff7b41550e0 legacy=0x7ff7b40719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b3400640 1 -- 172.21.15.32:0/3620416122 >> v1:172.21.15.32:6789/0 conn(0x7ff7b414eb90 legacy=0x7ff7b41549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.439+0000 7ff7b3400640 1 -- 172.21.15.32:0/3620416122 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4155860 con 0x7ff7b40720b0 2024-01-19T04:15:35.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b3400640 1 --2- 172.21.15.32:0/3620416122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b40720b0 0x7ff7b415cd10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009d90 tx=0x7ff7ac01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939e5a37b3f31f27 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b1600640 1 -- 172.21.15.32:0/3620416122 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a5780 con 0x7ff7b40720b0 2024-01-19T04:15:35.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b1600640 1 -- 172.21.15.32:0/3620416122 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0a58e0 con 0x7ff7b40720b0 2024-01-19T04:15:35.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b1600640 1 -- 172.21.15.32:0/3620416122 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a5c70 con 0x7ff7b40720b0 2024-01-19T04:15:35.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b9800640 1 -- 172.21.15.32:0/3620416122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b40720b0 msgr2=0x7ff7b415cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b9800640 1 --2- 172.21.15.32:0/3620416122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b40720b0 0x7ff7b415cd10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009d90 tx=0x7ff7ac01c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b9800640 1 -- 172.21.15.32:0/3620416122 shutdown_connections 2024-01-19T04:15:35.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b9800640 1 --2- 172.21.15.32:0/3620416122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b40720b0 0x7ff7b415cd10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b9800640 1 -- 172.21.15.32:0/3620416122 >> 172.21.15.32:0/3620416122 conn(0x7ff7b40c25a0 msgr2=0x7ff7b40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:35.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.443+0000 7ff7b9800640 1 -- 172.21.15.32:0/3620416122 shutdown_connections 2024-01-19T04:15:35.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 -- 172.21.15.32:0/3620416122 wait complete. 2024-01-19T04:15:35.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 Processor -- start 2024-01-19T04:15:35.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 -- start start 2024-01-19T04:15:35.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7b40720b0 0x7ff7b4153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b414eb90 0x7ff7b406cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7b41550e0 0x7ff7b41ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b414bb20 con 0x7ff7b41550e0 2024-01-19T04:15:35.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b4153fc0 con 0x7ff7b414eb90 2024-01-19T04:15:35.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b9800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b41f0b10 con 0x7ff7b40720b0 2024-01-19T04:15:35.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7b41550e0 0x7ff7b41ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7b41550e0 0x7ff7b41ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35970/0 (socket says 172.21.15.32:35970) 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 -- 172.21.15.32:0/642226787 learned_addr learned my addr 172.21.15.32:0/642226787 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b2a00640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7b40720b0 0x7ff7b4153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b2000640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b414eb90 0x7ff7b406cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 -- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7b40720b0 msgr2=0x7ff7b4153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7b40720b0 0x7ff7b4153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 -- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b414eb90 msgr2=0x7ff7b406cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b414eb90 0x7ff7b406cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 -- 172.21.15.32:0/642226787 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009a70 con 0x7ff7b41550e0 2024-01-19T04:15:35.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7b3400640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7b41550e0 0x7ff7b41ed5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0b0040 tx=0x7ff7ac019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7aaa00640 1 -- 172.21.15.32:0/642226787 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0b9650 con 0x7ff7b41550e0 2024-01-19T04:15:35.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.447+0000 7ff7aaa00640 1 -- 172.21.15.32:0/642226787 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0b97b0 con 0x7ff7b41550e0 2024-01-19T04:15:35.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7aaa00640 1 -- 172.21.15.32:0/642226787 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0b9b20 con 0x7ff7b41550e0 2024-01-19T04:15:35.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b41541b0 con 0x7ff7b41550e0 2024-01-19T04:15:35.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b41f1040 con 0x7ff7b41550e0 2024-01-19T04:15:35.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b40749f0 con 0x7ff7b41550e0 2024-01-19T04:15:35.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7aaa00640 1 -- 172.21.15.32:0/642226787 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff7ac0b9c80 con 0x7ff7b41550e0 2024-01-19T04:15:35.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7aaa00640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff78c066500 0x7ff78c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7aaa00640 1 -- 172.21.15.32:0/642226787 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7ac11eeb0 con 0x7ff7b41550e0 2024-01-19T04:15:35.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7b2a00640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff78c066500 0x7ff78c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.451+0000 7ff7b2a00640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff78c066500 0x7ff78c0689c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40011f0 tx=0x7ff7a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.455+0000 7ff7aaa00640 1 -- 172.21.15.32:0/642226787 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff7ac0ec1e0 con 0x7ff7b41550e0 2024-01-19T04:15:35.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.615+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7b40c54d0 con 0x7ff7b41550e0 2024-01-19T04:15:35.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.615+0000 7ff7aaa00640 1 -- 172.21.15.32:0/642226787 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7ac0ef800 con 0x7ff7b41550e0 2024-01-19T04:15:35.622 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff78c066500 msgr2=0x7ff78c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff78c066500 0x7ff78c0689c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40011f0 tx=0x7ff7a4009040 comp rx=0 tx=0).stop 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7b41550e0 msgr2=0x7ff7b41ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7b41550e0 0x7ff7b41ed5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0b0040 tx=0x7ff7ac019660 comp rx=0 tx=0).stop 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 shutdown_connections 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff78c066500 0x7ff78c0689c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7b41550e0 0x7ff7b41ed5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b414eb90 0x7ff7b406cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 --2- 172.21.15.32:0/642226787 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7b40720b0 0x7ff7b4153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 >> 172.21.15.32:0/642226787 conn(0x7ff7b40c25a0 msgr2=0x7ff7b40a6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 shutdown_connections 2024-01-19T04:15:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.619+0000 7ff7b9800640 1 -- 172.21.15.32:0/642226787 wait complete. 2024-01-19T04:15:35.644 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:15:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6178a00640 1 Processor -- start 2024-01-19T04:15:35.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6178a00640 1 -- start start 2024-01-19T04:15:35.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6178a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61701550e0 0x7f61700719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6178a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617006c670 0x7f6170071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6178a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6170072730 con 0x7f617014eb90 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6178a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6170072a10 con 0x7f61701550e0 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6178a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617014ef70 con 0x7f617006c670 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6175600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61701550e0 0x7f61700719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6176a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617006c670 0x7f6170071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6176000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f617014eb90 0x7f61701549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:54082/0 (socket says 172.21.15.32:54082) 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6175600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61701550e0 0x7f61700719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:56450/0 (socket says 172.21.15.32:56450) 2024-01-19T04:15:35.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6176000640 1 -- 172.21.15.32:0/2518462637 learned_addr learned my addr 172.21.15.32:0/2518462637 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:35.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6175600640 1 -- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617006c670 msgr2=0x7f6170071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:35.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6175600640 1 --2- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617006c670 0x7f6170071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6175600640 1 -- 172.21.15.32:0/2518462637 >> v1:172.21.15.67:6789/0 conn(0x7f617014eb90 legacy=0x7f61701549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6175600640 1 -- 172.21.15.32:0/2518462637 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170155580 con 0x7f61701550e0 2024-01-19T04:15:35.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6174c00640 1 -- 172.21.15.32:0/2518462637 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472747296 0 0) 0x7f6170072730 con 0x7f617014eb90 2024-01-19T04:15:35.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.783+0000 7f6176a00640 1 --2- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617006c670 0x7f6170071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:35.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6175600640 1 --2- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 0x7f61700719a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f61580097c0 tx=0x7f615801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6295de7a302c6aa2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6174c00640 1 -- 172.21.15.32:0/2518462637 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580ab600 con 0x7f61701550e0 2024-01-19T04:15:35.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6174c00640 1 -- 172.21.15.32:0/2518462637 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61580a7050 con 0x7f61701550e0 2024-01-19T04:15:35.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6174c00640 1 -- 172.21.15.32:0/2518462637 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580ab980 con 0x7f61701550e0 2024-01-19T04:15:35.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 -- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 msgr2=0x7f61700719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 --2- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 0x7f61700719a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f61580097c0 tx=0x7f615801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 -- 172.21.15.32:0/2518462637 shutdown_connections 2024-01-19T04:15:35.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 --2- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617006c670 0x7f6170071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 --2- 172.21.15.32:0/2518462637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 0x7f61700719a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 -- 172.21.15.32:0/2518462637 >> 172.21.15.32:0/2518462637 conn(0x7f61700c25a0 msgr2=0x7f61700c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:35.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 -- 172.21.15.32:0/2518462637 shutdown_connections 2024-01-19T04:15:35.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.787+0000 7f6178a00640 1 -- 172.21.15.32:0/2518462637 wait complete. 2024-01-19T04:15:35.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 Processor -- start 2024-01-19T04:15:35.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 -- start start 2024-01-19T04:15:35.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f617006c670 0x7f6170153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617014eb90 0x7f61701517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 0x7f6170151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6170154b80 con 0x7f617006c670 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617014f9b0 con 0x7f61701550e0 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617014c4b0 con 0x7f617014eb90 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f617006c670 0x7f6170153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f617006c670 0x7f6170153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35986/0 (socket says 172.21.15.32:35986) 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 -- 172.21.15.32:0/1956112988 learned_addr learned my addr 172.21.15.32:0/1956112988 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6175600640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617014eb90 0x7f61701517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176a00640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 0x7f6170151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 -- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617014eb90 msgr2=0x7f61701517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617014eb90 0x7f61701517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 -- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 msgr2=0x7f6170151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 0x7f6170151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 -- 172.21.15.32:0/1956112988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168009a70 con 0x7f617006c670 2024-01-19T04:15:35.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6176000640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f617006c670 0x7f6170153340 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f616000c480 tx=0x7f616000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f616e000640 1 -- 172.21.15.32:0/1956112988 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160005cf0 con 0x7f617006c670 2024-01-19T04:15:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f616e000640 1 -- 172.21.15.32:0/1956112988 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160005e50 con 0x7f617006c670 2024-01-19T04:15:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f616e000640 1 -- 172.21.15.32:0/1956112988 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600072f0 con 0x7f617006c670 2024-01-19T04:15:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6158009420 con 0x7f617006c670 2024-01-19T04:15:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.791+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61701548a0 con 0x7f617006c670 2024-01-19T04:15:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.795+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61700749f0 con 0x7f617006c670 2024-01-19T04:15:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.795+0000 7f616e000640 1 -- 172.21.15.32:0/1956112988 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6160007450 con 0x7f617006c670 2024-01-19T04:15:35.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.795+0000 7f616e000640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6148066500 0x7f61480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:35.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.795+0000 7f616e000640 1 -- 172.21.15.32:0/1956112988 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61600833c0 con 0x7f617006c670 2024-01-19T04:15:35.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.795+0000 7f6175600640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6148066500 0x7f61480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:35.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.795+0000 7f6175600640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6148066500 0x7f61480689c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f61580ad000 tx=0x7f61580a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:35.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.799+0000 7f616e000640 1 -- 172.21.15.32:0/1956112988 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6160050700 con 0x7f617006c670 2024-01-19T04:15:35.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.955+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f617014f780 con 0x7f617006c670 2024-01-19T04:15:35.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f616e000640 1 -- 172.21.15.32:0/1956112988 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6160053d20 con 0x7f617006c670 2024-01-19T04:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:15:35.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6148066500 msgr2=0x7f61480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6148066500 0x7f61480689c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f61580ad000 tx=0x7f61580a4f90 comp rx=0 tx=0).stop 2024-01-19T04:15:35.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f617006c670 msgr2=0x7f6170153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f617006c670 0x7f6170153340 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f616000c480 tx=0x7f616000c880 comp rx=0 tx=0).stop 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 shutdown_connections 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6148066500 0x7f61480689c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61701550e0 0x7f6170151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f617014eb90 0x7f61701517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 --2- 172.21.15.32:0/1956112988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f617006c670 0x7f6170153340 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 >> 172.21.15.32:0/1956112988 conn(0x7f61700c25a0 msgr2=0x7f617006d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 shutdown_connections 2024-01-19T04:15:35.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:35.959+0000 7f6178a00640 1 -- 172.21.15.32:0/1956112988 wait complete. 2024-01-19T04:15:35.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:36.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.119+0000 7fa09fe00640 1 Processor -- start 2024-01-19T04:15:36.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.119+0000 7fa09fe00640 1 -- start start 2024-01-19T04:15:36.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.119+0000 7fa09fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0980acee0 0x7fa098070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.119+0000 7fa09fe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0981530d0 con 0x7fa0980c7050 2024-01-19T04:15:36.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.119+0000 7fa09fe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0980c78a0 con 0x7fa0980c7430 2024-01-19T04:15:36.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.119+0000 7fa09fe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0981524c0 con 0x7fa0980acee0 2024-01-19T04:15:36.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa09d400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa0980c7050 0x7fa0980c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36908/0 (socket says 172.21.15.32:36908) 2024-01-19T04:15:36.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa09d400640 1 -- 172.21.15.32:0/526052119 learned_addr learned my addr 172.21.15.32:0/526052119 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa09ca00640 1 --2- 172.21.15.32:0/526052119 >> v2:172.21.15.67:3300/0 conn(0x7fa0980acee0 0x7fa098070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844276966 0 0) 0x7fa0981530d0 con 0x7fa0980c7050 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa078003530 con 0x7fa0980c7050 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723513033 0 0) 0x7fa0980c78a0 con 0x7fa0980c7430 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0981530d0 con 0x7fa0980c7430 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa09ca00640 1 -- 172.21.15.32:0/526052119 >> v1:172.21.15.67:6789/0 conn(0x7fa0980c7430 legacy=0x7fa0980c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa09ca00640 1 -- 172.21.15.32:0/526052119 >> v1:172.21.15.32:6789/0 conn(0x7fa0980c7050 legacy=0x7fa0980c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712964897 0 0) 0x7fa078003530 con 0x7fa0980c7050 2024-01-19T04:15:36.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa09ca00640 1 -- 172.21.15.32:0/526052119 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0981527a0 con 0x7fa0980acee0 2024-01-19T04:15:36.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.123+0000 7fa09ca00640 1 --2- 172.21.15.32:0/526052119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980acee0 0x7fa098070230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa0800097c0 tx=0x7fa08001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f30eae7ac83e47 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088001680 con 0x7fa0980acee0 2024-01-19T04:15:36.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0800a7050 con 0x7fa0980acee0 2024-01-19T04:15:36.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa097e00640 1 -- 172.21.15.32:0/526052119 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800ab620 con 0x7fa0980acee0 2024-01-19T04:15:36.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- 172.21.15.32:0/526052119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980acee0 msgr2=0x7fa098070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 --2- 172.21.15.32:0/526052119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980acee0 0x7fa098070230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa0800097c0 tx=0x7fa08001c310 comp rx=0 tx=0).stop 2024-01-19T04:15:36.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- 172.21.15.32:0/526052119 shutdown_connections 2024-01-19T04:15:36.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 --2- 172.21.15.32:0/526052119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980acee0 0x7fa098070230 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- 172.21.15.32:0/526052119 >> 172.21.15.32:0/526052119 conn(0x7fa0980a99f0 msgr2=0x7fa0980a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:36.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- 172.21.15.32:0/526052119 shutdown_connections 2024-01-19T04:15:36.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- 172.21.15.32:0/526052119 wait complete. 2024-01-19T04:15:36.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 Processor -- start 2024-01-19T04:15:36.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- start start 2024-01-19T04:15:36.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0980acee0 0x7fa09815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980c7050 0x7fa0980c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0980c7430 0x7fa09815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981571b0 con 0x7fa0980c7430 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981f1180 con 0x7fa0980c7050 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.127+0000 7fa09fe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981f0600 con 0x7fa0980acee0 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0980c7430 0x7fa09815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09d400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0980acee0 0x7fa09815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0980c7430 0x7fa09815b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35992/0 (socket says 172.21.15.32:35992) 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 -- 172.21.15.32:0/2293355906 learned_addr learned my addr 172.21.15.32:0/2293355906 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09ca00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980c7050 0x7fa0980c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 -- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0980acee0 msgr2=0x7fa09815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0980acee0 0x7fa09815c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 -- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980c7050 msgr2=0x7fa0980c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980c7050 0x7fa0980c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 -- 172.21.15.32:0/2293355906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080009420 con 0x7fa0980c7430 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09d400640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0980acee0 0x7fa09815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09de00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0980c7430 0x7fa09815b2a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c730 tx=0x7fa09000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa095600640 1 -- 172.21.15.32:0/2293355906 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090003b80 con 0x7fa0980c7430 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa095600640 1 -- 172.21.15.32:0/2293355906 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa090003ce0 con 0x7fa0980c7430 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa095600640 1 -- 172.21.15.32:0/2293355906 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000aa90 con 0x7fa0980c7430 2024-01-19T04:15:36.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0981f08e0 con 0x7fa0980c7430 2024-01-19T04:15:36.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0981f0ea0 con 0x7fa0980c7430 2024-01-19T04:15:36.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0980749f0 con 0x7fa0980c7430 2024-01-19T04:15:36.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.131+0000 7fa095600640 1 -- 172.21.15.32:0/2293355906 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa09000abf0 con 0x7fa0980c7430 2024-01-19T04:15:36.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.135+0000 7fa095600640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa070066500 0x7fa0700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.135+0000 7fa095600640 1 -- 172.21.15.32:0/2293355906 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa090083c20 con 0x7fa0980c7430 2024-01-19T04:15:36.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.135+0000 7fa09d400640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa070066500 0x7fa0700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.135+0000 7fa09d400640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa070066500 0x7fa0700689c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa088001af0 tx=0x7fa088001a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.139+0000 7fa095600640 1 -- 172.21.15.32:0/2293355906 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa090050ed0 con 0x7fa0980c7430 2024-01-19T04:15:36.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.335+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0980a97d0 con 0x7fa0980c7430 2024-01-19T04:15:36.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.335+0000 7fa095600640 1 -- 172.21.15.32:0/2293355906 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fa0900544f0 con 0x7fa0980c7430 2024-01-19T04:15:36.340 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:36.340 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:36.341 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.335+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa070066500 msgr2=0x7fa0700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.335+0000 7fa09fe00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa070066500 0x7fa0700689c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa088001af0 tx=0x7fa088001a40 comp rx=0 tx=0).stop 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.335+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0980c7430 msgr2=0x7fa09815b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.335+0000 7fa09fe00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0980c7430 0x7fa09815b2a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c730 tx=0x7fa09000cbf0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 shutdown_connections 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa070066500 0x7fa0700689c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0980c7430 0x7fa09815b2a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0980c7050 0x7fa0980c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 --2- 172.21.15.32:0/2293355906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0980acee0 0x7fa09815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 >> 172.21.15.32:0/2293355906 conn(0x7fa0980a99f0 msgr2=0x7fa09806fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 shutdown_connections 2024-01-19T04:15:36.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.339+0000 7fa09fe00640 1 -- 172.21.15.32:0/2293355906 wait complete. 2024-01-19T04:15:36.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:36.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3cad200640 1 Processor -- start 2024-01-19T04:15:36.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3cad200640 1 -- start start 2024-01-19T04:15:36.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3cad200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3cad200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca81533a0 con 0x7f3ca80a6d30 2024-01-19T04:15:36.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3cad200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca8152800 con 0x7f3ca80c6e20 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3cad200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8156380 con 0x7f3ca806fda0 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca5400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3ca80a6d30 0x7f3ca815acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36912/0 (socket says 172.21.15.32:36912) 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca5400640 1 -- 172.21.15.32:0/600530763 learned_addr learned my addr 172.21.15.32:0/600530763 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca6800640 1 --2- 172.21.15.32:0/600530763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca4a00640 1 -- 172.21.15.32:0/600530763 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902200908 0 0) 0x7f3c90001120 con 0x7f3ca80a6d30 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca4a00640 1 -- 172.21.15.32:0/600530763 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c88003530 con 0x7f3ca80a6d30 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca4a00640 1 -- 172.21.15.32:0/600530763 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681509114 0 0) 0x7f3ca8152800 con 0x7f3ca80c6e20 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca4a00640 1 -- 172.21.15.32:0/600530763 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c90001120 con 0x7f3ca80c6e20 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca6800640 1 -- 172.21.15.32:0/600530763 >> v1:172.21.15.67:6789/0 conn(0x7f3ca80c6e20 legacy=0x7f3ca8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca6800640 1 -- 172.21.15.32:0/600530763 >> v1:172.21.15.32:6789/0 conn(0x7f3ca80a6d30 legacy=0x7f3ca815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.499+0000 7f3ca6800640 1 -- 172.21.15.32:0/600530763 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8156590 con 0x7f3ca806fda0 2024-01-19T04:15:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3ca6800640 1 --2- 172.21.15.32:0/600530763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c7200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009dc0 tx=0x7f3ca001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d06a751db8b7594c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3ca4a00640 1 -- 172.21.15.32:0/600530763 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00a5870 con 0x7f3ca806fda0 2024-01-19T04:15:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3ca4a00640 1 -- 172.21.15.32:0/600530763 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca00a59d0 con 0x7f3ca806fda0 2024-01-19T04:15:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3ca4a00640 1 -- 172.21.15.32:0/600530763 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00a5d60 con 0x7f3ca806fda0 2024-01-19T04:15:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3cad200640 1 -- 172.21.15.32:0/600530763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 msgr2=0x7f3ca80c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3cad200640 1 --2- 172.21.15.32:0/600530763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c7200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009dc0 tx=0x7f3ca001c8e0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3cad200640 1 -- 172.21.15.32:0/600530763 shutdown_connections 2024-01-19T04:15:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3cad200640 1 --2- 172.21.15.32:0/600530763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c7200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3cad200640 1 -- 172.21.15.32:0/600530763 >> 172.21.15.32:0/600530763 conn(0x7f3ca80a9870 msgr2=0x7f3ca80a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3cad200640 1 -- 172.21.15.32:0/600530763 shutdown_connections 2024-01-19T04:15:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.503+0000 7f3cad200640 1 -- 172.21.15.32:0/600530763 wait complete. 2024-01-19T04:15:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 Processor -- start 2024-01-19T04:15:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 -- start start 2024-01-19T04:15:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80a6d30 0x7f3ca8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca80c6e20 0x7f3ca814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80bf750 con 0x7f3ca80a6d30 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca814dd40 con 0x7f3ca80c6e20 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca814f3b0 con 0x7f3ca806fda0 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80a6d30 0x7f3ca8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80a6d30 0x7f3ca8154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36004/0 (socket says 172.21.15.32:36004) 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 -- 172.21.15.32:0/3917954921 learned_addr learned my addr 172.21.15.32:0/3917954921 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5e00640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca6800640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca80c6e20 0x7f3ca814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 -- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 msgr2=0x7f3ca80c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 -- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca80c6e20 msgr2=0x7f3ca814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca80c6e20 0x7f3ca814e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 -- 172.21.15.32:0/3917954921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0009a70 con 0x7f3ca80a6d30 2024-01-19T04:15:36.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3ca5400640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80a6d30 0x7f3ca8154c60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000c680 tx=0x7f3c9000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3c9e000640 1 -- 172.21.15.32:0/3917954921 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c90005ac0 con 0x7f3ca80a6d30 2024-01-19T04:15:36.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3c9e000640 1 -- 172.21.15.32:0/3917954921 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c90005c20 con 0x7f3ca80a6d30 2024-01-19T04:15:36.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3c9e000640 1 -- 172.21.15.32:0/3917954921 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c90007070 con 0x7f3ca80a6d30 2024-01-19T04:15:36.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca81eee10 con 0x7f3ca80a6d30 2024-01-19T04:15:36.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.507+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca80a9270 con 0x7f3ca80a6d30 2024-01-19T04:15:36.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.511+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca814def0 con 0x7f3ca80a6d30 2024-01-19T04:15:36.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.511+0000 7f3c9e000640 1 -- 172.21.15.32:0/3917954921 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3c900071d0 con 0x7f3ca80a6d30 2024-01-19T04:15:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.511+0000 7f3c9e000640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3c80066500 0x7f3c800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.511+0000 7f3c9e000640 1 -- 172.21.15.32:0/3917954921 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c90083380 con 0x7f3ca80a6d30 2024-01-19T04:15:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.511+0000 7f3ca5e00640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3c80066500 0x7f3c800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.511+0000 7f3ca5e00640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3c80066500 0x7f3c800689c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c980011f0 tx=0x7f3c98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.515+0000 7f3c9e000640 1 -- 172.21.15.32:0/3917954921 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3c900506c0 con 0x7f3ca80a6d30 2024-01-19T04:15:36.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ca8154520 con 0x7f3ca80a6d30 2024-01-19T04:15:36.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3c9e000640 1 -- 172.21.15.32:0/3917954921 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f3ca8154520 con 0x7f3ca80a6d30 2024-01-19T04:15:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:36.683 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:36.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3c80066500 msgr2=0x7f3c800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3c80066500 0x7f3c800689c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c980011f0 tx=0x7f3c98009040 comp rx=0 tx=0).stop 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80a6d30 msgr2=0x7f3ca8154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80a6d30 0x7f3ca8154c60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000c680 tx=0x7f3c9000cb40 comp rx=0 tx=0).stop 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 shutdown_connections 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3c80066500 0x7f3c800689c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca80c6e20 0x7f3ca814e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80a6d30 0x7f3ca8154c60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 --2- 172.21.15.32:0/3917954921 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3ca806fda0 0x7f3ca80c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.679+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 >> 172.21.15.32:0/3917954921 conn(0x7f3ca80a9870 msgr2=0x7f3ca8070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.683+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 shutdown_connections 2024-01-19T04:15:36.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.683+0000 7f3cad200640 1 -- 172.21.15.32:0/3917954921 wait complete. 2024-01-19T04:15:36.706 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T04:15:36.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:36.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f6767200640 1 Processor -- start 2024-01-19T04:15:36.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f6767200640 1 -- start start 2024-01-19T04:15:36.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f6767200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67600c42b0 0x7f67600c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f6767200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c5740 0x7f67600c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f6767200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600c0c90 con 0x7f676006beb0 2024-01-19T04:15:36.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f6767200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6760150f90 con 0x7f67600c42b0 2024-01-19T04:15:36.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f6767200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67600c1660 con 0x7f67600c5740 2024-01-19T04:15:36.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f675fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67600c42b0 0x7f67600c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f675fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67600c42b0 0x7f67600c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36016/0 (socket says 172.21.15.32:36016) 2024-01-19T04:15:36.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f675fe00640 1 -- 172.21.15.32:0/2858273471 learned_addr learned my addr 172.21.15.32:0/2858273471 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:36.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f675f400640 1 --2- 172.21.15.32:0/2858273471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c5740 0x7f67600c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.843+0000 7f675fe00640 1 -- 172.21.15.32:0/2858273471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c5740 msgr2=0x7f67600c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:36.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f675fe00640 1 --2- 172.21.15.32:0/2858273471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c5740 0x7f67600c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f675fe00640 1 -- 172.21.15.32:0/2858273471 >> v1:172.21.15.67:6789/0 conn(0x7f676006beb0 legacy=0x7f6760154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f675fe00640 1 -- 172.21.15.32:0/2858273471 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760150cb0 con 0x7f67600c42b0 2024-01-19T04:15:36.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f675fe00640 1 --2- 172.21.15.32:0/2858273471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c42b0 0x7f67600c4690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f67500098a0 tx=0x7f675001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7e1a22b9d644a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f675ea00640 1 -- 172.21.15.32:0/2858273471 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500ab600 con 0x7f67600c42b0 2024-01-19T04:15:36.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f675ea00640 1 -- 172.21.15.32:0/2858273471 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67500a7050 con 0x7f67600c42b0 2024-01-19T04:15:36.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f675ea00640 1 -- 172.21.15.32:0/2858273471 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500ab980 con 0x7f67600c42b0 2024-01-19T04:15:36.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f6767200640 1 -- 172.21.15.32:0/2858273471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c42b0 msgr2=0x7f67600c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.847+0000 7f6767200640 1 --2- 172.21.15.32:0/2858273471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c42b0 0x7f67600c4690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f67500098a0 tx=0x7f675001c460 comp rx=0 tx=0).stop 2024-01-19T04:15:36.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- 172.21.15.32:0/2858273471 shutdown_connections 2024-01-19T04:15:36.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 --2- 172.21.15.32:0/2858273471 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c5740 0x7f67600c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 --2- 172.21.15.32:0/2858273471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c42b0 0x7f67600c4690 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- 172.21.15.32:0/2858273471 >> 172.21.15.32:0/2858273471 conn(0x7f67600c5b20 msgr2=0x7f67600c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:36.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- 172.21.15.32:0/2858273471 shutdown_connections 2024-01-19T04:15:36.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- 172.21.15.32:0/2858273471 wait complete. 2024-01-19T04:15:36.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 Processor -- start 2024-01-19T04:15:36.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- start start 2024-01-19T04:15:36.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676006beb0 0x7f67600718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c42b0 0x7f67600a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c5740 0x7f676014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67601ed9b0 con 0x7f67600c5740 2024-01-19T04:15:36.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67601ecd50 con 0x7f676006beb0 2024-01-19T04:15:36.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6767200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67601ed010 con 0x7f67600c42b0 2024-01-19T04:15:36.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6765200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c5740 0x7f676014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6765200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c5740 0x7f676014cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36022/0 (socket says 172.21.15.32:36022) 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6765200640 1 -- 172.21.15.32:0/3002174519 learned_addr learned my addr 172.21.15.32:0/3002174519 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f675f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c42b0 0x7f67600a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f675fe00640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676006beb0 0x7f67600718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f675f400640 1 -- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676006beb0 msgr2=0x7f67600718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f675f400640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676006beb0 0x7f67600718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f675f400640 1 -- 172.21.15.32:0/3002174519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c5740 msgr2=0x7f676014cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f675f400640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c5740 0x7f676014cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f675f400640 1 -- 172.21.15.32:0/3002174519 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500094d0 con 0x7f67600c42b0 2024-01-19T04:15:36.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.851+0000 7f6765200640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c5740 0x7f676014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:36.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f675f400640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c42b0 0x7f67600a5530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f674800e880 tx=0x7f674800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6757e00640 1 -- 172.21.15.32:0/3002174519 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800c940 con 0x7f67600c42b0 2024-01-19T04:15:36.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6757e00640 1 -- 172.21.15.32:0/3002174519 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674800caa0 con 0x7f67600c42b0 2024-01-19T04:15:36.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6757e00640 1 -- 172.21.15.32:0/3002174519 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800ce50 con 0x7f67600c42b0 2024-01-19T04:15:36.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67601ed2f0 con 0x7f67600c42b0 2024-01-19T04:15:36.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676014ebb0 con 0x7f67600c42b0 2024-01-19T04:15:36.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67601edcd0 con 0x7f67600c42b0 2024-01-19T04:15:36.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6757e00640 1 -- 172.21.15.32:0/3002174519 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6748013470 con 0x7f67600c42b0 2024-01-19T04:15:36.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6757e00640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6738066500 0x7f67380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:36.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f6757e00640 1 -- 172.21.15.32:0/3002174519 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6748083f90 con 0x7f67600c42b0 2024-01-19T04:15:36.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.855+0000 7f675fe00640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6738066500 0x7f67380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:36.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.859+0000 7f675fe00640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6738066500 0x7f67380689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67500ad000 tx=0x7f67500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:36.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:36.863+0000 7f6757e00640 1 -- 172.21.15.32:0/3002174519 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f67480512d0 con 0x7f67600c42b0 2024-01-19T04:15:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.059+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67601ed150 con 0x7f67600c42b0 2024-01-19T04:15:37.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.059+0000 7f6757e00640 1 -- 172.21.15.32:0/3002174519 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f67601ed150 con 0x7f67600c42b0 2024-01-19T04:15:37.065 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:37.065 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:37.065 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6738066500 msgr2=0x7f67380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6738066500 0x7f67380689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67500ad000 tx=0x7f67500a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c42b0 msgr2=0x7f67600a5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c42b0 0x7f67600a5530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f674800e880 tx=0x7f674800ed40 comp rx=0 tx=0).stop 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 shutdown_connections 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6738066500 0x7f67380689c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67600c5740 0x7f676014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67600c42b0 0x7f67600a5530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 --2- 172.21.15.32:0/3002174519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f676006beb0 0x7f67600718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 >> 172.21.15.32:0/3002174519 conn(0x7f67600c5b20 msgr2=0x7f676015e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:37.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 shutdown_connections 2024-01-19T04:15:37.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.063+0000 7f6767200640 1 -- 172.21.15.32:0/3002174519 wait complete. 2024-01-19T04:15:37.088 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:37.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.223+0000 7f6d33600640 1 Processor -- start 2024-01-19T04:15:37.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d33600640 1 -- start start 2024-01-19T04:15:37.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d33600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c0c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d33600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d2c0c4c50 0x7f6d2c0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d33600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c0c7470 con 0x7f6d2c158030 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d33600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c158b20 con 0x7f6d2c0c4c50 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d33600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0c2d60 con 0x7f6d2c06fee0 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d31600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d2c0c4c50 0x7f6d2c0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d31600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d2c0c4c50 0x7f6d2c0c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36028/0 (socket says 172.21.15.32:36028) 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d31600640 1 -- 172.21.15.32:0/2797171243 learned_addr learned my addr 172.21.15.32:0/2797171243 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d30c00640 1 --1- 172.21.15.32:0/2797171243 >> v1:172.21.15.32:6789/0 conn(0x7f6d2c158030 0x7f6d2c158410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36918/0 (socket says 172.21.15.32:36918) 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d2be00640 1 --2- 172.21.15.32:0/2797171243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c0c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d31600640 1 -- 172.21.15.32:0/2797171243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 msgr2=0x7f6d2c0c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d31600640 1 --2- 172.21.15.32:0/2797171243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c0c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d31600640 1 -- 172.21.15.32:0/2797171243 >> v1:172.21.15.32:6789/0 conn(0x7f6d2c158030 legacy=0x7f6d2c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.227+0000 7f6d31600640 1 -- 172.21.15.32:0/2797171243 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0c3040 con 0x7f6d2c0c4c50 2024-01-19T04:15:37.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d31600640 1 --2- 172.21.15.32:0/2797171243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c0c4c50 0x7f6d2c0c5fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e50 tx=0x7f6d2401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1c5b51a2edba31 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d2b400640 1 -- 172.21.15.32:0/2797171243 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0c6d20 con 0x7f6d2c0c4c50 2024-01-19T04:15:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d2b400640 1 -- 172.21.15.32:0/2797171243 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d240a5860 con 0x7f6d2c0c4c50 2024-01-19T04:15:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d2b400640 1 -- 172.21.15.32:0/2797171243 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d240a5bf0 con 0x7f6d2c0c4c50 2024-01-19T04:15:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 -- 172.21.15.32:0/2797171243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c0c4c50 msgr2=0x7f6d2c0c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 --2- 172.21.15.32:0/2797171243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c0c4c50 0x7f6d2c0c5fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e50 tx=0x7f6d2401c980 comp rx=0 tx=0).stop 2024-01-19T04:15:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 -- 172.21.15.32:0/2797171243 shutdown_connections 2024-01-19T04:15:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 --2- 172.21.15.32:0/2797171243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c0c4c50 0x7f6d2c0c5fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 --2- 172.21.15.32:0/2797171243 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 -- 172.21.15.32:0/2797171243 >> 172.21.15.32:0/2797171243 conn(0x7f6d2c0a99f0 msgr2=0x7f6d2c0a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 -- 172.21.15.32:0/2797171243 shutdown_connections 2024-01-19T04:15:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 -- 172.21.15.32:0/2797171243 wait complete. 2024-01-19T04:15:37.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 Processor -- start 2024-01-19T04:15:37.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.231+0000 7f6d33600640 1 -- start start 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c14f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2c0c4c50 0x7f6d2c1f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c158030 0x7f6d2c0a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c14ed60 con 0x7f6d2c158030 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c1ed700 con 0x7f6d2c0c4c50 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c1ed9e0 con 0x7f6d2c06fee0 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c158030 0x7f6d2c0a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c158030 0x7f6d2c0a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36044/0 (socket says 172.21.15.32:36044) 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 -- 172.21.15.32:0/1806965488 learned_addr learned my addr 172.21.15.32:0/1806965488 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d30c00640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c14f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d2be00640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2c0c4c50 0x7f6d2c1f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 -- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 msgr2=0x7f6d2c14f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c14f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 -- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2c0c4c50 msgr2=0x7f6d2c1f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2c0c4c50 0x7f6d2c1f0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 -- 172.21.15.32:0/1806965488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009b30 con 0x7f6d2c158030 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d31600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c158030 0x7f6d2c0a6da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6d2401a5b0 tx=0x7f6d24019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d28c00640 1 -- 172.21.15.32:0/1806965488 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d240b8880 con 0x7f6d2c158030 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d28c00640 1 -- 172.21.15.32:0/1806965488 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d240b89e0 con 0x7f6d2c158030 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d28c00640 1 -- 172.21.15.32:0/1806965488 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d240b8d90 con 0x7f6d2c158030 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c0aaeb0 con 0x7f6d2c158030 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c156090 con 0x7f6d2c158030 2024-01-19T04:15:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.235+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c14eed0 con 0x7f6d2c158030 2024-01-19T04:15:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.239+0000 7f6d28c00640 1 -- 172.21.15.32:0/1806965488 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6d240b6440 con 0x7f6d2c158030 2024-01-19T04:15:37.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.239+0000 7f6d28c00640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d04066500 0x7f6d040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.239+0000 7f6d28c00640 1 -- 172.21.15.32:0/1806965488 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d2411f390 con 0x7f6d2c158030 2024-01-19T04:15:37.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.239+0000 7f6d30c00640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d04066500 0x7f6d040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.239+0000 7f6d30c00640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d04066500 0x7f6d040689c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0a7810 tx=0x7f6d1c007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.243+0000 7f6d28c00640 1 -- 172.21.15.32:0/1806965488 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6d240ec830 con 0x7f6d2c158030 2024-01-19T04:15:37.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.435+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d2c0749f0 con 0x7f6d2c158030 2024-01-19T04:15:37.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.435+0000 7f6d28c00640 1 -- 172.21.15.32:0/1806965488 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f6d24009510 con 0x7f6d2c158030 2024-01-19T04:15:37.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:37.441 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2142633360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2142633360},{"type":"v1","addr":"172.21.15.32:6835","nonce":2142633360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/2915859265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2915859265},{"type":"v1","addr":"172.21.15.67:6836","nonce":2915859265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/1709715963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":1709715963},{"type":"v1","addr":"172.21.15.67:6837","nonce":1709715963}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:02.043532+0000","modified":"2024-01-19T04:15:05.050467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6834/3007887666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3007887666},{"type":"v1","addr":"172.21.15.32:6834","nonce":3007887666}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T04:15:37.441 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-01-19T04:15:37.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d04066500 msgr2=0x7f6d040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d04066500 0x7f6d040689c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0a7810 tx=0x7f6d1c007e90 comp rx=0 tx=0).stop 2024-01-19T04:15:37.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c158030 msgr2=0x7f6d2c0a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c158030 0x7f6d2c0a6da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6d2401a5b0 tx=0x7f6d24019720 comp rx=0 tx=0).stop 2024-01-19T04:15:37.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 shutdown_connections 2024-01-19T04:15:37.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d04066500 0x7f6d040689c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d2c158030 0x7f6d2c0a6da0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2c0c4c50 0x7f6d2c1f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 --2- 172.21.15.32:0/1806965488 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d2c06fee0 0x7f6d2c14f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 >> 172.21.15.32:0/1806965488 conn(0x7f6d2c0a99f0 msgr2=0x7f6d2c0a9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:37.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 shutdown_connections 2024-01-19T04:15:37.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.439+0000 7f6d33600640 1 -- 172.21.15.32:0/1806965488 wait complete. 2024-01-19T04:15:37.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:37.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc855c00640 1 Processor -- start 2024-01-19T04:15:37.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc855c00640 1 -- start start 2024-01-19T04:15:37.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc855c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 0x7fc8500a6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc855c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc8500a5cc0 0x7fc8500bbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc855c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8500c6580 con 0x7fc8500bc4b0 2024-01-19T04:15:37.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc855c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8500c4b10 con 0x7fc8500a5cc0 2024-01-19T04:15:37.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc855c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500c6860 con 0x7fc85006bf00 2024-01-19T04:15:37.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc84f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc8500bc4b0 0x7fc850155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36928/0 (socket says 172.21.15.32:36928) 2024-01-19T04:15:37.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc84f400640 1 -- 172.21.15.32:0/2683832387 learned_addr learned my addr 172.21.15.32:0/2683832387 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:37.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.599+0000 7fc84e000640 1 --2- 172.21.15.32:0/2683832387 >> v2:172.21.15.67:3300/0 conn(0x7fc8500a5cc0 0x7fc8500bbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 0x7fc8500a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058395237 0 0) 0x7fc8500c6580 con 0x7fc8500bc4b0 2024-01-19T04:15:37.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc830003530 con 0x7fc8500bc4b0 2024-01-19T04:15:37.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3511190943 0 0) 0x7fc830003530 con 0x7fc8500bc4b0 2024-01-19T04:15:37.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 msgr2=0x7fc8500a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 0x7fc8500a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 >> v2:172.21.15.67:3300/0 conn(0x7fc8500a5cc0 msgr2=0x7fc8500bbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 --2- 172.21.15.32:0/2683832387 >> v2:172.21.15.67:3300/0 conn(0x7fc8500a5cc0 0x7fc8500bbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500c4d20 con 0x7fc8500bc4b0 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fc848001a00 con 0x7fc8500bc4b0 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 >> v1:172.21.15.32:6789/0 conn(0x7fc8500bc4b0 legacy=0x7fc850155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc830003980 0x7fc830003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8300047d0 0x7fc830004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 0x7fc830005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500c4b10 con 0x7fc830003980 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500c6860 con 0x7fc8300047d0 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83000b990 con 0x7fc85006bf00 2024-01-19T04:15:37.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc830003980 0x7fc830003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84f400640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 0x7fc830005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84e000640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8300047d0 0x7fc830004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 -- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 msgr2=0x7fc830005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:37.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc85006bf00 0x7fc830005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 -- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8300047d0 msgr2=0x7fc830004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:37.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8300047d0 0x7fc830004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 -- 172.21.15.32:0/2683832387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830003530 con 0x7fc830003980 2024-01-19T04:15:37.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.603+0000 7fc84ea00640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc830003980 0x7fc830003da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc840009ae0 tx=0x7fc84001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98413c4964b77177 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a6460 con 0x7fc830003980 2024-01-19T04:15:37.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8400a65c0 con 0x7fc830003980 2024-01-19T04:15:37.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc84d600640 1 -- 172.21.15.32:0/2683832387 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a6970 con 0x7fc830003980 2024-01-19T04:15:37.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- 172.21.15.32:0/2683832387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc830003980 msgr2=0x7fc830003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 --2- 172.21.15.32:0/2683832387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc830003980 0x7fc830003da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc840009ae0 tx=0x7fc84001c9f0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc84f400640 1 -- 172.21.15.32:0/2683832387 reap_dead start 2024-01-19T04:15:37.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- 172.21.15.32:0/2683832387 shutdown_connections 2024-01-19T04:15:37.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- 172.21.15.32:0/2683832387 >> 172.21.15.32:0/2683832387 conn(0x7fc8500c7040 msgr2=0x7fc8500c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:37.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- 172.21.15.32:0/2683832387 shutdown_connections 2024-01-19T04:15:37.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- 172.21.15.32:0/2683832387 wait complete. 2024-01-19T04:15:37.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 Processor -- start 2024-01-19T04:15:37.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- start start 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc830003980 0x7fc8500abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8500be740 0x7fc85006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8501eb5d0 0x7fc8501eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500ab520 con 0x7fc8500be740 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500ab7c0 con 0x7fc830003980 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.607+0000 7fc855c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8501512a0 con 0x7fc8501eb5d0 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8500be740 0x7fc85006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8500be740 0x7fc85006ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36066/0 (socket says 172.21.15.32:36066) 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 -- 172.21.15.32:0/3021326853 learned_addr learned my addr 172.21.15.32:0/3021326853 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84ea00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc830003980 0x7fc8500abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84f400640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8501eb5d0 0x7fc8501eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 -- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8501eb5d0 msgr2=0x7fc8501eeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8501eb5d0 0x7fc8501eeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 -- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc830003980 msgr2=0x7fc8500abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc830003980 0x7fc8500abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 -- 172.21.15.32:0/3021326853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc850151580 con 0x7fc8500be740 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc84e000640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8500be740 0x7fc85006ddc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc838011660 tx=0x7fc838011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc846a00640 1 -- 172.21.15.32:0/3021326853 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800f9c0 con 0x7fc8500be740 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc846a00640 1 -- 172.21.15.32:0/3021326853 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800fb20 con 0x7fc8500be740 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc850151860 con 0x7fc8500be740 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc846a00640 1 -- 172.21.15.32:0/3021326853 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800fe90 con 0x7fc8500be740 2024-01-19T04:15:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8500c0d60 con 0x7fc8500be740 2024-01-19T04:15:37.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8500ac190 con 0x7fc8500be740 2024-01-19T04:15:37.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.611+0000 7fc846a00640 1 -- 172.21.15.32:0/3021326853 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc838015460 con 0x7fc8500be740 2024-01-19T04:15:37.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.615+0000 7fc846a00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc828066530 0x7fc8280689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.615+0000 7fc846a00640 1 -- 172.21.15.32:0/3021326853 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc838084610 con 0x7fc8500be740 2024-01-19T04:15:37.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.615+0000 7fc84ea00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc828066530 0x7fc8280689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.615+0000 7fc84ea00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc828066530 0x7fc8280689f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ad000 tx=0x7fc8400b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.619+0000 7fc846a00640 1 -- 172.21.15.32:0/3021326853 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc8380518a0 con 0x7fc8500be740 2024-01-19T04:15:37.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.779+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc850067340 con 0x7fc8500be740 2024-01-19T04:15:37.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.779+0000 7fc846a00640 1 -- 172.21.15.32:0/3021326853 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16410 (secure 0 0 0) 0x7fc838054ec0 con 0x7fc8500be740 2024-01-19T04:15:37.785 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:37.785 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:03.653251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:14:59.970975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:01.037334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:37.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc828066530 msgr2=0x7fc8280689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc828066530 0x7fc8280689f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ad000 tx=0x7fc8400b3040 comp rx=0 tx=0).stop 2024-01-19T04:15:37.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8500be740 msgr2=0x7fc85006ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8500be740 0x7fc85006ddc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc838011660 tx=0x7fc838011b20 comp rx=0 tx=0).stop 2024-01-19T04:15:37.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 shutdown_connections 2024-01-19T04:15:37.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc828066530 0x7fc8280689f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc8501eb5d0 0x7fc8501eeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8500be740 0x7fc85006ddc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 --2- 172.21.15.32:0/3021326853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc830003980 0x7fc8500abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 >> 172.21.15.32:0/3021326853 conn(0x7fc8500c7040 msgr2=0x7fc850151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:37.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 shutdown_connections 2024-01-19T04:15:37.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.783+0000 7fc855c00640 1 -- 172.21.15.32:0/3021326853 wait complete. 2024-01-19T04:15:37.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-19T04:15:37.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f855b400640 1 Processor -- start 2024-01-19T04:15:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f855b400640 1 -- start start 2024-01-19T04:15:37.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f855b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f85540c09a0 0x7f85541551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f855b400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8554072860 con 0x7f8554151dd0 2024-01-19T04:15:37.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f855b400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540c0db0 con 0x7f85540701f0 2024-01-19T04:15:37.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f855b400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540bfae0 con 0x7f85540c09a0 2024-01-19T04:15:37.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f8559400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f85540c09a0 0x7f85541551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f8558a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8554151dd0 0x7f85540bf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59334/0 (socket says 172.21.15.32:59334) 2024-01-19T04:15:37.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f8558a00640 1 -- 172.21.15.32:0/3165269935 learned_addr learned my addr 172.21.15.32:0/3165269935 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f8559400640 1 -- 172.21.15.32:0/3165269935 >> v1:172.21.15.67:6789/0 conn(0x7f85540701f0 legacy=0x7f855406d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f8559400640 1 -- 172.21.15.32:0/3165269935 >> v1:172.21.15.32:6789/0 conn(0x7f8554151dd0 legacy=0x7f85540bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f8559400640 1 -- 172.21.15.32:0/3165269935 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855406df20 con 0x7f85540c09a0 2024-01-19T04:15:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.947+0000 7f8553400640 1 -- 172.21.15.32:0/3165269935 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414550448 0 0) 0x7f8554072860 con 0x7f8554151dd0 2024-01-19T04:15:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f8559400640 1 --2- 172.21.15.32:0/3165269935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f85541551a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f854c009d90 tx=0x7f854c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc992d44e6753a2f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f8553400640 1 -- 172.21.15.32:0/3165269935 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0a5910 con 0x7f85540c09a0 2024-01-19T04:15:37.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f8553400640 1 -- 172.21.15.32:0/3165269935 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0a5a70 con 0x7f85540c09a0 2024-01-19T04:15:37.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f8553400640 1 -- 172.21.15.32:0/3165269935 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0a5e00 con 0x7f85540c09a0 2024-01-19T04:15:37.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f855b400640 1 -- 172.21.15.32:0/3165269935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 msgr2=0x7f85541551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f855b400640 1 --2- 172.21.15.32:0/3165269935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f85541551a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f854c009d90 tx=0x7f854c01c850 comp rx=0 tx=0).stop 2024-01-19T04:15:37.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f855b400640 1 -- 172.21.15.32:0/3165269935 shutdown_connections 2024-01-19T04:15:37.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f855b400640 1 --2- 172.21.15.32:0/3165269935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f85541551a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f855b400640 1 -- 172.21.15.32:0/3165269935 >> 172.21.15.32:0/3165269935 conn(0x7f85540c2aa0 msgr2=0x7f85540c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f855b400640 1 -- 172.21.15.32:0/3165269935 shutdown_connections 2024-01-19T04:15:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.951+0000 7f855b400640 1 -- 172.21.15.32:0/3165269935 wait complete. 2024-01-19T04:15:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 Processor -- start 2024-01-19T04:15:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 -- start start 2024-01-19T04:15:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85540701f0 0x7f855414f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f855414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8554151dd0 0x7f855414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85541578f0 con 0x7f85540c09a0 2024-01-19T04:15:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554158550 con 0x7f8554151dd0 2024-01-19T04:15:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85541ed400 con 0x7f85540701f0 2024-01-19T04:15:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f855414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f855414e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49594/0 (socket says 172.21.15.32:49594) 2024-01-19T04:15:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 -- 172.21.15.32:0/1580219503 learned_addr learned my addr 172.21.15.32:0/1580219503 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8559400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8554151dd0 0x7f855414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8558a00640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85540701f0 0x7f855414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 -- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85540701f0 msgr2=0x7f855414f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85540701f0 0x7f855414f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 -- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8554151dd0 msgr2=0x7f855414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8554151dd0 0x7f855414cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 -- 172.21.15.32:0/1580219503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009a70 con 0x7f85540c09a0 2024-01-19T04:15:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8559400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8554151dd0 0x7f855414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8553e00640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f855414e1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b410 tx=0x7f853c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8550c00640 1 -- 172.21.15.32:0/1580219503 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c004020 con 0x7f85540c09a0 2024-01-19T04:15:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8550c00640 1 -- 172.21.15.32:0/1580219503 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c004180 con 0x7f85540c09a0 2024-01-19T04:15:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85541587f0 con 0x7f85540c09a0 2024-01-19T04:15:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f8550c00640 1 -- 172.21.15.32:0/1580219503 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c011630 con 0x7f85540c09a0 2024-01-19T04:15:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.955+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85541ed6e0 con 0x7f85540c09a0 2024-01-19T04:15:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.959+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855414e6e0 con 0x7f85540c09a0 2024-01-19T04:15:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.959+0000 7f8550c00640 1 -- 172.21.15.32:0/1580219503 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f853c011790 con 0x7f85540c09a0 2024-01-19T04:15:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.959+0000 7f8550c00640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f852c066500 0x7f852c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:37.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.959+0000 7f8550c00640 1 -- 172.21.15.32:0/1580219503 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f853c083c00 con 0x7f85540c09a0 2024-01-19T04:15:37.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.959+0000 7f8558a00640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f852c066500 0x7f852c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:37.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.959+0000 7f8558a00640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f852c066500 0x7f852c0689c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8544000f70 tx=0x7f8544007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:37.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:37.963+0000 7f8550c00640 1 -- 172.21.15.32:0/1580219503 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f853c050e90 con 0x7f85540c09a0 2024-01-19T04:15:38.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.163+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f85540749f0 con 0x7f85540c09a0 2024-01-19T04:15:38.167 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-01-19T04:15:38.163+0000 7f2af4c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T04:15:38.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.163+0000 7f8550c00640 1 -- 172.21.15.32:0/1580219503 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f853c015090 con 0x7f85540c09a0 2024-01-19T04:15:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f852c066500 msgr2=0x7f852c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f852c066500 0x7f852c0689c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8544000f70 tx=0x7f8544007b60 comp rx=0 tx=0).stop 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 msgr2=0x7f855414e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f855414e1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b410 tx=0x7f853c00b8d0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 shutdown_connections 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f852c066500 0x7f852c0689c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8554151dd0 0x7f855414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c09a0 0x7f855414e1a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 --2- 172.21.15.32:0/1580219503 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85540701f0 0x7f855414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 >> 172.21.15.32:0/1580219503 conn(0x7f85540c2aa0 msgr2=0x7f8554150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 shutdown_connections 2024-01-19T04:15:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.167+0000 7f855b400640 1 -- 172.21.15.32:0/1580219503 wait complete. 2024-01-19T04:15:38.187 INFO:tasks.ceph.mds.a.smithi032.stderr: -5466> 2024-01-19T04:15:05.224+0000 7f9ac8600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:15:38.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-19T04:15:38.240 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-01-19T04:15:38.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.339+0000 7f683dc00640 1 Processor -- start 2024-01-19T04:15:38.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.339+0000 7f683dc00640 1 -- start start 2024-01-19T04:15:38.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f683dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68381550e0 0x7f68380719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:38.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f683dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f683806c670 0x7f6838071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:38.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f683dc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6838072730 con 0x7f683814eb90 2024-01-19T04:15:38.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f683dc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6838072a10 con 0x7f683806c670 2024-01-19T04:15:38.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f683dc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683814ef70 con 0x7f68381550e0 2024-01-19T04:15:38.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6837400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f683806c670 0x7f6838071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6836a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f683814eb90 0x7f68381549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59356/0 (socket says 172.21.15.32:59356) 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6836a00640 1 -- 172.21.15.32:0/2697291777 learned_addr learned my addr 172.21.15.32:0/2697291777 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6836000640 1 --2- 172.21.15.32:0/2697291777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68381550e0 0x7f68380719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6837400640 1 -- 172.21.15.32:0/2697291777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68381550e0 msgr2=0x7f68380719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6837400640 1 --2- 172.21.15.32:0/2697291777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68381550e0 0x7f68380719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6837400640 1 -- 172.21.15.32:0/2697291777 >> v1:172.21.15.32:6789/0 conn(0x7f683814eb90 legacy=0x7f68381549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6837400640 1 -- 172.21.15.32:0/2697291777 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838155580 con 0x7f683806c670 2024-01-19T04:15:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6835600640 1 -- 172.21.15.32:0/2697291777 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337954401 0 0) 0x7f6838072730 con 0x7f683814eb90 2024-01-19T04:15:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.343+0000 7f6837400640 1 --2- 172.21.15.32:0/2697291777 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f683806c670 0x7f6838071ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6830009d90 tx=0x7f683001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf8a363317d3ebc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f6835600640 1 -- 172.21.15.32:0/2697291777 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300a5890 con 0x7f683806c670 2024-01-19T04:15:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f6835600640 1 -- 172.21.15.32:0/2697291777 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68300a59f0 con 0x7f683806c670 2024-01-19T04:15:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f6835600640 1 -- 172.21.15.32:0/2697291777 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300a5d80 con 0x7f683806c670 2024-01-19T04:15:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- 172.21.15.32:0/2697291777 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f683806c670 msgr2=0x7f6838071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 --2- 172.21.15.32:0/2697291777 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f683806c670 0x7f6838071ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6830009d90 tx=0x7f683001c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- 172.21.15.32:0/2697291777 shutdown_connections 2024-01-19T04:15:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 --2- 172.21.15.32:0/2697291777 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f683806c670 0x7f6838071ee0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 --2- 172.21.15.32:0/2697291777 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f68381550e0 0x7f68380719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- 172.21.15.32:0/2697291777 >> 172.21.15.32:0/2697291777 conn(0x7f68380c25a0 msgr2=0x7f68380c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- 172.21.15.32:0/2697291777 shutdown_connections 2024-01-19T04:15:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- 172.21.15.32:0/2697291777 wait complete. 2024-01-19T04:15:38.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 Processor -- start 2024-01-19T04:15:38.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- start start 2024-01-19T04:15:38.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f683806c670 0x7f683814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683814eb90 0x7f68381f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68381550e0 0x7f68380bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6838150130 con 0x7f68381550e0 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6838150be0 con 0x7f683814eb90 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.347+0000 7f683dc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68381f1420 con 0x7f683806c670 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68381550e0 0x7f68380bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68381550e0 0x7f68380bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49614/0 (socket says 172.21.15.32:49614) 2024-01-19T04:15:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 -- 172.21.15.32:0/411624141 learned_addr learned my addr 172.21.15.32:0/411624141 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:38.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6836a00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f683806c670 0x7f683814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:38.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6836000640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683814eb90 0x7f68381f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:38.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 -- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f683806c670 msgr2=0x7f683814fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:38.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f683806c670 0x7f683814fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 -- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683814eb90 msgr2=0x7f68381f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683814eb90 0x7f68381f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 -- 172.21.15.32:0/411624141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830009a70 con 0x7f68381550e0 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f6837400640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68381550e0 0x7f68380bf130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f683001af70 tx=0x7f6830019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f682ea00640 1 -- 172.21.15.32:0/411624141 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300b9860 con 0x7f68381550e0 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f682ea00640 1 -- 172.21.15.32:0/411624141 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68300b99c0 con 0x7f68381550e0 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68380a8c50 con 0x7f68381550e0 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f682ea00640 1 -- 172.21.15.32:0/411624141 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300b9d30 con 0x7f68381550e0 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6838150870 con 0x7f68381550e0 2024-01-19T04:15:38.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683814f910 con 0x7f68381550e0 2024-01-19T04:15:38.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.351+0000 7f682ea00640 1 -- 172.21.15.32:0/411624141 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f68300ad440 con 0x7f68381550e0 2024-01-19T04:15:38.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.355+0000 7f682ea00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6810066500 0x7f68100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:38.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.355+0000 7f682ea00640 1 -- 172.21.15.32:0/411624141 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f683011f1a0 con 0x7f68381550e0 2024-01-19T04:15:38.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.355+0000 7f6836a00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6810066500 0x7f68100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:38.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.355+0000 7f6836a00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6810066500 0x7f68100689c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6828000f70 tx=0x7f6828007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:38.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.359+0000 7f682ea00640 1 -- 172.21.15.32:0/411624141 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f683814f910 con 0x7f68381550e0 2024-01-19T04:15:38.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:38.547+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f68380a54a0 con 0x7f68381550e0 2024-01-19T04:15:39.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.167+0000 7f682ea00640 1 -- 172.21.15.32:0/411624141 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f68380a54a0 con 0x7f68381550e0 2024-01-19T04:15:39.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6810066500 msgr2=0x7f68100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6810066500 0x7f68100689c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6828000f70 tx=0x7f6828007b60 comp rx=0 tx=0).stop 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68381550e0 msgr2=0x7f68380bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68381550e0 0x7f68380bf130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f683001af70 tx=0x7f6830019660 comp rx=0 tx=0).stop 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 shutdown_connections 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6810066500 0x7f68100689c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68381550e0 0x7f68380bf130 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f683814eb90 0x7f68381f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 --2- 172.21.15.32:0/411624141 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f683806c670 0x7f683814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 >> 172.21.15.32:0/411624141 conn(0x7f68380c25a0 msgr2=0x7f68380c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 shutdown_connections 2024-01-19T04:15:39.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.171+0000 7f683dc00640 1 -- 172.21.15.32:0/411624141 wait complete. 2024-01-19T04:15:39.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-19T04:15:39.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf86800640 1 Processor -- start 2024-01-19T04:15:39.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf86800640 1 -- start start 2024-01-19T04:15:39.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf86800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 0x7faf80154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf86800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf80155930 con 0x7faf8006c220 2024-01-19T04:15:39.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf86800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf800a4e90 con 0x7faf800c5750 2024-01-19T04:15:39.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf86800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf800c20e0 con 0x7faf801549a0 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faf8006c220 0x7faf800c4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59360/0 (socket says 172.21.15.32:59360) 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 -- 172.21.15.32:0/219451612 learned_addr learned my addr 172.21.15.32:0/219451612 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7f400640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 0x7faf80154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968926663 0 0) 0x7faf80155930 con 0x7faf8006c220 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf60003530 con 0x7faf8006c220 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321628389 0 0) 0x7faf60003530 con 0x7faf8006c220 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 msgr2=0x7faf80154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:39.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 0x7faf80154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 >> v1:172.21.15.67:6789/0 conn(0x7faf800c5750 legacy=0x7faf8015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf801555c0 con 0x7faf8006c220 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7faf68001680 con 0x7faf8006c220 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 >> v1:172.21.15.32:6789/0 conn(0x7faf8006c220 legacy=0x7faf800c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 0x7faf600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf60003ef0 0x7faf600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf60004d10 0x7faf60005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf800c20e0 con 0x7faf60003ef0 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6000baa0 con 0x7faf60004d10 2024-01-19T04:15:39.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6000bc60 con 0x7faf801549a0 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf60003ef0 0x7faf600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7f400640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 0x7faf600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7fe00640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf60004d10 0x7faf60005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 -- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 msgr2=0x7faf600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf801549a0 0x7faf600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 -- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf60004d10 msgr2=0x7faf60005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf60004d10 0x7faf60005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7ea00640 1 -- 172.21.15.32:0/219451612 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60003530 con 0x7faf60003ef0 2024-01-19T04:15:39.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.391+0000 7faf7fe00640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf60004d10 0x7faf60005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf7ea00640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf60003ef0 0x7faf600047d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c160 tx=0x7faf6801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f83c6a34abdda36 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68005ae0 con 0x7faf60003ef0 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68005c60 con 0x7faf60003ef0 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf7e000640 1 -- 172.21.15.32:0/219451612 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680a5ae0 con 0x7faf60003ef0 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf86800640 1 -- 172.21.15.32:0/219451612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf60003ef0 msgr2=0x7faf600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf86800640 1 --2- 172.21.15.32:0/219451612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf60003ef0 0x7faf600047d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c160 tx=0x7faf6801cba0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf7fe00640 1 -- 172.21.15.32:0/219451612 reap_dead start 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf86800640 1 -- 172.21.15.32:0/219451612 shutdown_connections 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.395+0000 7faf86800640 1 -- 172.21.15.32:0/219451612 >> 172.21.15.32:0/219451612 conn(0x7faf800c5b40 msgr2=0x7faf800c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 -- 172.21.15.32:0/219451612 shutdown_connections 2024-01-19T04:15:39.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 -- 172.21.15.32:0/219451612 wait complete. 2024-01-19T04:15:39.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 Processor -- start 2024-01-19T04:15:39.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 -- start start 2024-01-19T04:15:39.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf60003ef0 0x7faf80147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf8014d7e0 0x7faf80146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf801472f0 0x7faf8014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8014b1d0 con 0x7faf801472f0 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80147b70 con 0x7faf8014d7e0 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf86800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf80147890 con 0x7faf60003ef0 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf801472f0 0x7faf8014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf801472f0 0x7faf8014f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49630/0 (socket says 172.21.15.32:49630) 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 -- 172.21.15.32:0/2605870079 learned_addr learned my addr 172.21.15.32:0/2605870079 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7f400640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf60003ef0 0x7faf80147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7ea00640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf8014d7e0 0x7faf80146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 -- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf60003ef0 msgr2=0x7faf80147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf60003ef0 0x7faf80147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 -- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf8014d7e0 msgr2=0x7faf80146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf8014d7e0 0x7faf80146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:39.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.399+0000 7faf7fe00640 1 -- 172.21.15.32:0/2605870079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8014a830 con 0x7faf801472f0 2024-01-19T04:15:39.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf7fe00640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf801472f0 0x7faf8014f230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf8006fe80 tx=0x7faf78010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:39.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf77400640 1 -- 172.21.15.32:0/2605870079 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78019070 con 0x7faf801472f0 2024-01-19T04:15:39.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf77400640 1 -- 172.21.15.32:0/2605870079 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800d070 con 0x7faf801472f0 2024-01-19T04:15:39.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf77400640 1 -- 172.21.15.32:0/2605870079 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78003db0 con 0x7faf801472f0 2024-01-19T04:15:39.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8014ab10 con 0x7faf801472f0 2024-01-19T04:15:39.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf801512b0 con 0x7faf801472f0 2024-01-19T04:15:39.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8004e980 con 0x7faf801472f0 2024-01-19T04:15:39.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf77400640 1 -- 172.21.15.32:0/2605870079 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faf78006b60 con 0x7faf801472f0 2024-01-19T04:15:39.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf77400640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf58066530 0x7faf580689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:39.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf77400640 1 -- 172.21.15.32:0/2605870079 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5795+0+0 (secure 0 0 0) 0x7faf78086740 con 0x7faf801472f0 2024-01-19T04:15:39.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.403+0000 7faf7f400640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf58066530 0x7faf580689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:39.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.407+0000 7faf7f400640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf58066530 0x7faf580689f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf800c0850 tx=0x7faf70009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:39.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.407+0000 7faf77400640 1 -- 172.21.15.32:0/2605870079 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faf78053a20 con 0x7faf801472f0 2024-01-19T04:15:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:39.567+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf800c5530 con 0x7faf801472f0 2024-01-19T04:15:40.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.167+0000 7faf77400640 1 -- 172.21.15.32:0/2605870079 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7faf78057040 con 0x7faf801472f0 2024-01-19T04:15:40.173 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf58066530 msgr2=0x7faf580689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf58066530 0x7faf580689f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf800c0850 tx=0x7faf70009190 comp rx=0 tx=0).stop 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf801472f0 msgr2=0x7faf8014f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf801472f0 0x7faf8014f230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf8006fe80 tx=0x7faf78010dd0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 shutdown_connections 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf58066530 0x7faf580689f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf801472f0 0x7faf8014f230 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf8014d7e0 0x7faf80146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 --2- 172.21.15.32:0/2605870079 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf60003ef0 0x7faf80147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 >> 172.21.15.32:0/2605870079 conn(0x7faf800c5b40 msgr2=0x7faf80151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 shutdown_connections 2024-01-19T04:15:40.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.171+0000 7faf86800640 1 -- 172.21.15.32:0/2605870079 wait complete. 2024-01-19T04:15:40.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-19T04:15:40.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bfba00640 1 Processor -- start 2024-01-19T04:15:40.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bfba00640 1 -- start start 2024-01-19T04:15:40.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bfba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 0x7f3bf40720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bfba00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3bf40c20d0 0x7f3bf406c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bfba00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf4153140 con 0x7f3bf4072620 2024-01-19T04:15:40.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bfba00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf4152530 con 0x7f3bf40c20d0 2024-01-19T04:15:40.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bfba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4152810 con 0x7f3bf414f9a0 2024-01-19T04:15:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bf9a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3bf4072620 0x7f3bf406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59362/0 (socket says 172.21.15.32:59362) 2024-01-19T04:15:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.339+0000 7f3bf9a00640 1 -- 172.21.15.32:0/1887206976 learned_addr learned my addr 172.21.15.32:0/1887206976 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:40.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 0x7f3bf40720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3e00640 1 --2- 172.21.15.32:0/1887206976 >> v2:172.21.15.67:3300/0 conn(0x7f3bf40c20d0 0x7f3bf406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341989117 0 0) 0x7f3bf4153140 con 0x7f3bf4072620 2024-01-19T04:15:40.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd4003530 con 0x7f3bf4072620 2024-01-19T04:15:40.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 149814992 0 0) 0x7f3bd4003530 con 0x7f3bf4072620 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 msgr2=0x7f3bf40720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 0x7f3bf40720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 >> v2:172.21.15.67:3300/0 conn(0x7f3bf40c20d0 msgr2=0x7f3bf406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 --2- 172.21.15.32:0/1887206976 >> v2:172.21.15.67:3300/0 conn(0x7f3bf40c20d0 0x7f3bf406c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4152af0 con 0x7f3bf4072620 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f3bec001a00 con 0x7f3bf4072620 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 >> v1:172.21.15.32:6789/0 conn(0x7f3bf4072620 legacy=0x7f3bf406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd4003980 0x7f3bd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 0x7f3bd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4004d10 0x7f3bd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4152530 con 0x7f3bd4003980 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4152810 con 0x7f3bd4004d10 2024-01-19T04:15:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd400b990 con 0x7f3bf414f9a0 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd4003980 0x7f3bd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9a00640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4004d10 0x7f3bd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf3e00640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 0x7f3bd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9000640 1 -- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 msgr2=0x7f3bd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf414f9a0 0x7f3bd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9000640 1 -- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4004d10 msgr2=0x7f3bd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4004d10 0x7f3bd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.343+0000 7f3bf9000640 1 -- 172.21.15.32:0/1887206976 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4003530 con 0x7f3bd4003980 2024-01-19T04:15:40.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd4003980 0x7f3bd4003da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009ae0 tx=0x7f3be401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ebff6b3bef406b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:40.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40a5530 con 0x7f3bd4003980 2024-01-19T04:15:40.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be40a5690 con 0x7f3bd4003980 2024-01-19T04:15:40.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bf3400640 1 -- 172.21.15.32:0/1887206976 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40a5a40 con 0x7f3bd4003980 2024-01-19T04:15:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 -- 172.21.15.32:0/1887206976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd4003980 msgr2=0x7f3bd4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 --2- 172.21.15.32:0/1887206976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd4003980 0x7f3bd4003da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009ae0 tx=0x7f3be401ca50 comp rx=0 tx=0).stop 2024-01-19T04:15:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bf9a00640 1 -- 172.21.15.32:0/1887206976 reap_dead start 2024-01-19T04:15:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 -- 172.21.15.32:0/1887206976 shutdown_connections 2024-01-19T04:15:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 -- 172.21.15.32:0/1887206976 >> 172.21.15.32:0/1887206976 conn(0x7f3bf40c5b40 msgr2=0x7f3bf40c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 -- 172.21.15.32:0/1887206976 shutdown_connections 2024-01-19T04:15:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 -- 172.21.15.32:0/1887206976 wait complete. 2024-01-19T04:15:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 Processor -- start 2024-01-19T04:15:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 -- start start 2024-01-19T04:15:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4003980 0x7f3bf41ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf41ee920 0x7f3bf41498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.347+0000 7f3bfba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf4149df0 0x7f3bf4141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bfba00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf41eef30 con 0x7f3bf41ee920 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bfba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40ab570 con 0x7f3bd4003980 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bfba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40aba00 con 0x7f3bf4149df0 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf41ee920 0x7f3bf41498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf41ee920 0x7f3bf41498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49646/0 (socket says 172.21.15.32:49646) 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 -- 172.21.15.32:0/1798594434 learned_addr learned my addr 172.21.15.32:0/1798594434 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4003980 0x7f3bf41ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 -- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf4149df0 msgr2=0x7f3bf4141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf4149df0 0x7f3bf4141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 -- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4003980 msgr2=0x7f3bf41ee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4003980 0x7f3bf41ee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 -- 172.21.15.32:0/1798594434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf40aac40 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf3e00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf41ee920 0x7f3bf41498b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0119b0 tx=0x7f3bdc011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf0c00640 1 -- 172.21.15.32:0/1798594434 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc004240 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf0c00640 1 -- 172.21.15.32:0/1798594434 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0043a0 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf0c00640 1 -- 172.21.15.32:0/1798594434 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00fa80 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf40aaf20 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40c6580 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf4067c10 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.351+0000 7f3bf0c00640 1 -- 172.21.15.32:0/1798594434 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3bdc00fbe0 con 0x7f3bf41ee920 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.355+0000 7f3bf0c00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bcc066500 0x7f3bcc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.355+0000 7f3bf0c00640 1 -- 172.21.15.32:0/1798594434 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3bdc084270 con 0x7f3bf41ee920 2024-01-19T04:15:40.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.355+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bcc066500 0x7f3bcc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:40.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.355+0000 7f3bf9000640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bcc066500 0x7f3bcc0689c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3be40af000 tx=0x7f3be40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:40.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.359+0000 7f3bf0c00640 1 -- 172.21.15.32:0/1798594434 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3bdc051710 con 0x7f3bf41ee920 2024-01-19T04:15:40.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:40.515+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3bf404e980 con 0x7f3bf41ee920 2024-01-19T04:15:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.175+0000 7f3bf0c00640 1 -- 172.21.15.32:0/1798594434 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3bdc054d30 con 0x7f3bf41ee920 2024-01-19T04:15:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bcc066500 msgr2=0x7f3bcc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bcc066500 0x7f3bcc0689c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3be40af000 tx=0x7f3be40046d0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf41ee920 msgr2=0x7f3bf41498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf41ee920 0x7f3bf41498b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0119b0 tx=0x7f3bdc011e70 comp rx=0 tx=0).stop 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 shutdown_connections 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bcc066500 0x7f3bcc0689c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bf4149df0 0x7f3bf4141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf41ee920 0x7f3bf41498b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 --2- 172.21.15.32:0/1798594434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd4003980 0x7f3bf41ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 >> 172.21.15.32:0/1798594434 conn(0x7f3bf40c5b40 msgr2=0x7f3bf414f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:41.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 shutdown_connections 2024-01-19T04:15:41.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.179+0000 7f3bfba00640 1 -- 172.21.15.32:0/1798594434 wait complete. 2024-01-19T04:15:41.213 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-19T04:15:41.213 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-19T04:15:41.213 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-19T04:15:41.213 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:15:41.213 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-19T04:15:41.213 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-19T04:15:41.214 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-19T04:15:41.214 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:15:41.214 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-19T04:15:41.214 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-19T04:15:41.214 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-19T04:15:41.214 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:15:41.214 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-19T04:15:41.214 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-19T04:15:41.215 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-19T04:15:41.215 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:15:41.231 INFO:tasks.ceph.mds.a:Stopped 2024-01-19T04:15:41.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-19T04:15:41.232 INFO:tasks.ceph.mds.c:Stopped 2024-01-19T04:15:41.232 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-19T04:15:41.233 INFO:tasks.ceph.mds.d:Stopped 2024-01-19T04:15:41.233 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-19T04:15:41.234 INFO:tasks.ceph.mds.b:Stopped 2024-01-19T04:15:41.234 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-19T04:15:41.276 INFO:tasks.ceph.mds.a:Started 2024-01-19T04:15:41.277 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:41.278 INFO:tasks.ceph.mds.c:Started 2024-01-19T04:15:41.278 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:41.279 INFO:tasks.ceph.mds.d:Started 2024-01-19T04:15:41.280 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:41.281 INFO:tasks.ceph.mds.b:Started 2024-01-19T04:15:41.281 DEBUG:teuthology.parallel:result is None 2024-01-19T04:15:41.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-19T04:15:41.367 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-01-19T04:15:41.369 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-01-19T04:15:41.375 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2024-01-19T04:15:41.375 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2024-01-19T04:15:41.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37e1e00640 1 Processor -- start 2024-01-19T04:15:41.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37e1e00640 1 -- start start 2024-01-19T04:15:41.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37e1e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f37dc14fb50 0x7f37dc06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:41.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37e1e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f37dc0c04a0 0x7f37dc0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:41.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37e1e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc071e80 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37e1e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc1535c0 con 0x7f37dc0c04a0 2024-01-19T04:15:41.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37e1e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc0726c0 con 0x7f37dc14fb50 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37db400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f37dc0a4ec0 0x7f37dc155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59374/0 (socket says 172.21.15.32:59374) 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37da000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f37dc0c04a0 0x7f37dc0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37db400640 1 -- 172.21.15.32:0/3307620156 learned_addr learned my addr 172.21.15.32:0/3307620156 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37daa00640 1 --2- 172.21.15.32:0/3307620156 >> v2:172.21.15.67:3300/0 conn(0x7f37dc14fb50 0x7f37dc06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37da000640 1 -- 172.21.15.32:0/3307620156 >> v2:172.21.15.67:3300/0 conn(0x7f37dc14fb50 msgr2=0x7f37dc06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37da000640 1 --2- 172.21.15.32:0/3307620156 >> v2:172.21.15.67:3300/0 conn(0x7f37dc14fb50 0x7f37dc06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37da000640 1 -- 172.21.15.32:0/3307620156 >> v1:172.21.15.32:6789/0 conn(0x7f37dc0a4ec0 legacy=0x7f37dc155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37da000640 1 -- 172.21.15.32:0/3307620156 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0c0a20 con 0x7f37dc0c04a0 2024-01-19T04:15:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.427+0000 7f37d9600640 1 -- 172.21.15.32:0/3307620156 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22663131 0 0) 0x7f37dc071e80 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37da000640 1 --2- 172.21.15.32:0/3307620156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0c04a0 0x7f37dc0c1230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06f5f0 tx=0x7f37c401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5f4d4416182e33 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:41.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37d9600640 1 -- 172.21.15.32:0/3307620156 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40ab600 con 0x7f37dc0c04a0 2024-01-19T04:15:41.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37d9600640 1 -- 172.21.15.32:0/3307620156 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c40a7050 con 0x7f37dc0c04a0 2024-01-19T04:15:41.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37d9600640 1 -- 172.21.15.32:0/3307620156 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40ab980 con 0x7f37dc0c04a0 2024-01-19T04:15:41.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37e1e00640 1 -- 172.21.15.32:0/3307620156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0c04a0 msgr2=0x7f37dc0c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:41.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3307620156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0c04a0 0x7f37dc0c1230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06f5f0 tx=0x7f37c401c3d0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37e1e00640 1 -- 172.21.15.32:0/3307620156 shutdown_connections 2024-01-19T04:15:41.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3307620156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0c04a0 0x7f37dc0c1230 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3307620156 >> v2:172.21.15.67:3300/0 conn(0x7f37dc14fb50 0x7f37dc06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.431+0000 7f37e1e00640 1 -- 172.21.15.32:0/3307620156 >> 172.21.15.32:0/3307620156 conn(0x7f37dc0c5b20 msgr2=0x7f37dc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:41.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 -- 172.21.15.32:0/3307620156 shutdown_connections 2024-01-19T04:15:41.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 -- 172.21.15.32:0/3307620156 wait complete. 2024-01-19T04:15:41.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 Processor -- start 2024-01-19T04:15:41.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 -- start start 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0a4ec0 0x7f37dc14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37dc0c04a0 0x7f37dc1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37dc14fb50 0x7f37dc1ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1577e0 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0a9d20 con 0x7f37dc0c04a0 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0aa000 con 0x7f37dc14fb50 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0a4ec0 0x7f37dc14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0a4ec0 0x7f37dc14f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49710/0 (socket says 172.21.15.32:49710) 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 -- 172.21.15.32:0/3562225041 learned_addr learned my addr 172.21.15.32:0/3562225041 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37da000640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37dc0c04a0 0x7f37dc1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37db400640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37dc14fb50 0x7f37dc1ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:41.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 -- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37dc14fb50 msgr2=0x7f37dc1ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37dc14fb50 0x7f37dc1ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 -- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37dc0c04a0 msgr2=0x7f37dc1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37dc0c04a0 0x7f37dc1516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 -- 172.21.15.32:0/3562225041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4009420 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37da000640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37dc0c04a0 0x7f37dc1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37db400640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37dc14fb50 0x7f37dc1ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37daa00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0a4ec0 0x7f37dc14f1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e8a0 tx=0x7f37cc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37d3400640 1 -- 172.21.15.32:0/3562225041 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc009510 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37d3400640 1 -- 172.21.15.32:0/3562225041 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc00c8e0 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc152140 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.435+0000 7f37d3400640 1 -- 172.21.15.32:0/3562225041 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00cc50 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.439+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc157a30 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.439+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc0749f0 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.439+0000 7f37d3400640 1 -- 172.21.15.32:0/3562225041 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f37cc013470 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.439+0000 7f37d3400640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f37b4066500 0x7f37b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:41.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.439+0000 7f37d3400640 1 -- 172.21.15.32:0/3562225041 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f37cc083fe0 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.439+0000 7f37da000640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f37b4066500 0x7f37b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:41.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.439+0000 7f37da000640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f37b4066500 0x7f37b40689c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37c40ad000 tx=0x7f37c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:41.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.443+0000 7f37d3400640 1 -- 172.21.15.32:0/3562225041 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f37cc051570 con 0x7f37dc0a4ec0 2024-01-19T04:15:41.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:41.615+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f37dc0a61d0 con 0x7f37dc0a4ec0 2024-01-19T04:15:42.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.639+0000 7f37d3400640 1 -- 172.21.15.32:0/3562225041 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f37cc017080 con 0x7f37dc0a4ec0 2024-01-19T04:15:42.646 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f37b4066500 msgr2=0x7f37b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f37b4066500 0x7f37b40689c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37c40ad000 tx=0x7f37c4008040 comp rx=0 tx=0).stop 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0a4ec0 msgr2=0x7f37dc14f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0a4ec0 0x7f37dc14f1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e8a0 tx=0x7f37cc00eca0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 shutdown_connections 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f37b4066500 0x7f37b40689c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f37dc14fb50 0x7f37dc1ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37dc0c04a0 0x7f37dc1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 --2- 172.21.15.32:0/3562225041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37dc0a4ec0 0x7f37dc14f1e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 >> 172.21.15.32:0/3562225041 conn(0x7f37dc0c5b20 msgr2=0x7f37dc0c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 shutdown_connections 2024-01-19T04:15:42.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.643+0000 7f37e1e00640 1 -- 172.21.15.32:0/3562225041 wait complete. 2024-01-19T04:15:42.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-19T04:15:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc78d600640 1 Processor -- start 2024-01-19T04:15:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc78d600640 1 -- start start 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc78d600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc78806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc78d600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc7880c04a0 0x7fc7880c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc78d600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc788071e80 con 0x7fc7880a4ec0 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc78d600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7881535c0 con 0x7fc7880c04a0 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc78d600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880726c0 con 0x7fc78814fb50 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc787400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc7880a4ec0 0x7fc788155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59384/0 (socket says 172.21.15.32:59384) 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc787400640 1 -- 172.21.15.32:0/2294691094 learned_addr learned my addr 172.21.15.32:0/2294691094 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc786a00640 1 --2- 172.21.15.32:0/2294691094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc78806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc786000640 1 --2- 172.21.15.32:0/2294691094 >> v2:172.21.15.67:3300/0 conn(0x7fc7880c04a0 0x7fc7880c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc785600640 1 -- 172.21.15.32:0/2294691094 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122530554 0 0) 0x7fc788071e80 con 0x7fc7880a4ec0 2024-01-19T04:15:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc785600640 1 -- 172.21.15.32:0/2294691094 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc768003530 con 0x7fc7880a4ec0 2024-01-19T04:15:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc786a00640 1 -- 172.21.15.32:0/2294691094 >> v2:172.21.15.67:3300/0 conn(0x7fc7880c04a0 msgr2=0x7fc7880c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc786a00640 1 --2- 172.21.15.32:0/2294691094 >> v2:172.21.15.67:3300/0 conn(0x7fc7880c04a0 0x7fc7880c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc786a00640 1 -- 172.21.15.32:0/2294691094 >> v1:172.21.15.32:6789/0 conn(0x7fc7880a4ec0 legacy=0x7fc788155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:42.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.815+0000 7fc786a00640 1 -- 172.21.15.32:0/2294691094 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880c0a20 con 0x7fc78814fb50 2024-01-19T04:15:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc786a00640 1 --2- 172.21.15.32:0/2294691094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc78806fec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7780097f0 tx=0x7fc77801c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51f04803a48dc37 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc785600640 1 -- 172.21.15.32:0/2294691094 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780001a00 con 0x7fc78814fb50 2024-01-19T04:15:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc785600640 1 -- 172.21.15.32:0/2294691094 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780a7050 con 0x7fc78814fb50 2024-01-19T04:15:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc785600640 1 -- 172.21.15.32:0/2294691094 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780ab620 con 0x7fc78814fb50 2024-01-19T04:15:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 -- 172.21.15.32:0/2294691094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 msgr2=0x7fc78806fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 --2- 172.21.15.32:0/2294691094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc78806fec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7780097f0 tx=0x7fc77801c270 comp rx=0 tx=0).stop 2024-01-19T04:15:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 -- 172.21.15.32:0/2294691094 shutdown_connections 2024-01-19T04:15:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 --2- 172.21.15.32:0/2294691094 >> v2:172.21.15.67:3300/0 conn(0x7fc7880c04a0 0x7fc7880c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 --2- 172.21.15.32:0/2294691094 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc78806fec0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 -- 172.21.15.32:0/2294691094 >> 172.21.15.32:0/2294691094 conn(0x7fc7880c5b20 msgr2=0x7fc7880c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 -- 172.21.15.32:0/2294691094 shutdown_connections 2024-01-19T04:15:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.819+0000 7fc78d600640 1 -- 172.21.15.32:0/2294691094 wait complete. 2024-01-19T04:15:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 Processor -- start 2024-01-19T04:15:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 -- start start 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880a4ec0 0x7fc7881f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7880c04a0 0x7fc7881ee050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc7880a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7881560c0 con 0x7fc7880a4ec0 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7881edc00 con 0x7fc7880c04a0 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880ab780 con 0x7fc78814fb50 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880a4ec0 0x7fc7881f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880a4ec0 0x7fc7881f1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49720/0 (socket says 172.21.15.32:49720) 2024-01-19T04:15:42.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 -- 172.21.15.32:0/2331873992 learned_addr learned my addr 172.21.15.32:0/2331873992 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786000640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7880c04a0 0x7fc7881ee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc787400640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc7880a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 -- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 msgr2=0x7fc7880a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc7880a6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 -- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7880c04a0 msgr2=0x7fc7881ee050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7880c04a0 0x7fc7881ee050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 -- 172.21.15.32:0/2331873992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009420 con 0x7fc7880a4ec0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc787400640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc7880a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc786a00640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880a4ec0 0x7fc7881f1510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7780ae040 tx=0x7fc77801aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc77ea00640 1 -- 172.21.15.32:0/2331873992 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780b7450 con 0x7fc7880a4ec0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc77ea00640 1 -- 172.21.15.32:0/2331873992 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780b75d0 con 0x7fc7880a4ec0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7881f0d30 con 0x7fc7880a4ec0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc77ea00640 1 -- 172.21.15.32:0/2331873992 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780b7980 con 0x7fc7880a4ec0 2024-01-19T04:15:42.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.823+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7880abd20 con 0x7fc7880a4ec0 2024-01-19T04:15:42.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.827+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7880749f0 con 0x7fc7880a4ec0 2024-01-19T04:15:42.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.827+0000 7fc77ea00640 1 -- 172.21.15.32:0/2331873992 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc7780b7ae0 con 0x7fc7880a4ec0 2024-01-19T04:15:42.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.827+0000 7fc77ea00640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc760066500 0x7fc7600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:42.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.827+0000 7fc77ea00640 1 -- 172.21.15.32:0/2331873992 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc77811e270 con 0x7fc7880a4ec0 2024-01-19T04:15:42.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.827+0000 7fc786000640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc760066500 0x7fc7600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:42.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.827+0000 7fc786000640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc760066500 0x7fc7600689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc7881509c0 tx=0x7fc770009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:42.831+0000 7fc77ea00640 1 -- 172.21.15.32:0/2331873992 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc7780eb970 con 0x7fc7880a4ec0 2024-01-19T04:15:43.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.043+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc78814e950 con 0x7fc7880a4ec0 2024-01-19T04:15:43.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.043+0000 7fc77ea00640 1 -- 172.21.15.32:0/2331873992 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7fc7780eef90 con 0x7fc7880a4ec0 2024-01-19T04:15:43.049 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llsgveIhAArI1FfqpAbZbP5H/QNDKrQQ==", 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2024-01-19T04:15:43.050 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llsvlALxAADpa3U031IE67W85H0Rma6w==", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll/F8cKhAAq6nC5ppnbAIpyfxBqU9v+w==", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:15:43.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll61LHNhAAOWD4NF6ea4C6MYxR8v55lw==", 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAE96llXf/LDxAA6FgZ7EGq0C9TUTaB/CiGAw==", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAH96llm63KFRAAyoUf8Z0jVpxh86JaeudxpA==", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAK96ll4IdoGhAAkyqz5g83r8gpFWdpV+JHAw==", 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAN96ll0o3YHhAAXaXcV6Ew3ARVzOeheB2Qdg==", 2024-01-19T04:15:43.054 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAT96lluolMKhAAhtGB4RrqfaeFoh0Cw+FWcw==", 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAW96llGp39MBAArcnkxmH6H79g0uLV/tbMYg==", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAZ96ll5MxcNhAAt6AgzeQup4/mAyqV/A4/ug==", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAd96ll193uABAA/uFXx3ffBrEgBS+jU7LwYA==", 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2024-01-19T04:15:43.057 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q==", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ==", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-01-19T04:15:43.058 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llHuQFBBAAAEiDpbymhxmIcRRV//whZA==", 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mds", 2024-01-19T04:15:43.059 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAs96ll4PoSMxAAPDGtn3uBSRIJ48NpyBOHLw==", 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mds" 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mgr", 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAs96llvwQTMxAA1paZ8onPF8L6566VlRkjZQ==", 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-osd", 2024-01-19T04:15:43.060 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAs96llhA0TMxAAymIM+EqHqAvzcuAd8jzulw==", 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-osd" 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd", 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAs96llZBoTMxAASAuVje6/W4fSxkgtQYnPhw==", 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAs96llASMTMxAApoQuXqlQirpL+zEGoJ4img==", 2024-01-19T04:15:43.061 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rgw", 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAs96llhy4TMxAAPoQr1k8DBVhz8QfFM7o5sg==", 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll838IHBAAatsDTMrKtOZVb2U6Jkhyvg==", 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.062 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llu+oOGBAAAeqd9zD1YxEG+kXxhgkPUA==", 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-01-19T04:15:43.063 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:15:43.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc760066500 msgr2=0x7fc7600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc760066500 0x7fc7600689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc7881509c0 tx=0x7fc770009190 comp rx=0 tx=0).stop 2024-01-19T04:15:43.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880a4ec0 msgr2=0x7fc7881f1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880a4ec0 0x7fc7881f1510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7780ae040 tx=0x7fc77801aab0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 shutdown_connections 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc760066500 0x7fc7600689c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc78814fb50 0x7fc7880a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7880c04a0 0x7fc7881ee050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 --2- 172.21.15.32:0/2331873992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880a4ec0 0x7fc7881f1510 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 >> 172.21.15.32:0/2331873992 conn(0x7fc7880c5b20 msgr2=0x7fc7880c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 shutdown_connections 2024-01-19T04:15:43.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.047+0000 7fc78d600640 1 -- 172.21.15.32:0/2331873992 wait complete. 2024-01-19T04:15:43.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-19T04:15:43.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b9de00640 1 Processor -- start 2024-01-19T04:15:43.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b9de00640 1 -- start start 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b9de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b9806f520 0x7f3b9806f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b9de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b9806ecf0 0x7f3b98158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b9de00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b98158fe0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b9de00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980a8d80 con 0x7f3b9806f520 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b9de00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980aa150 con 0x7f3b9806ecf0 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b96a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b9806f520 0x7f3b9806f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b96a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b9806f520 0x7f3b9806f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49734/0 (socket says 172.21.15.32:49734) 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b96a00640 1 -- 172.21.15.32:0/877184107 learned_addr learned my addr 172.21.15.32:0/877184107 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b97e00640 1 --2- 172.21.15.32:0/877184107 >> v2:172.21.15.67:3300/0 conn(0x7f3b9806ecf0 0x7f3b98158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b96a00640 1 -- 172.21.15.32:0/877184107 >> v2:172.21.15.67:3300/0 conn(0x7f3b9806ecf0 msgr2=0x7f3b98158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b96a00640 1 --2- 172.21.15.32:0/877184107 >> v2:172.21.15.67:3300/0 conn(0x7f3b9806ecf0 0x7f3b98158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b96a00640 1 -- 172.21.15.32:0/877184107 >> v1:172.21.15.67:6789/0 conn(0x7f3b9806e8a0 legacy=0x7f3b980a9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.211+0000 7f3b96a00640 1 -- 172.21.15.32:0/877184107 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980c3c50 con 0x7f3b9806f520 2024-01-19T04:15:43.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b96a00640 1 --2- 172.21.15.32:0/877184107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806f520 0x7f3b9806f900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3b9806d3b0 tx=0x7f3b8801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea74127aab05c989 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:43.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b96000640 1 -- 172.21.15.32:0/877184107 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880ab600 con 0x7f3b9806f520 2024-01-19T04:15:43.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b96000640 1 -- 172.21.15.32:0/877184107 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b880a7050 con 0x7f3b9806f520 2024-01-19T04:15:43.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b96000640 1 -- 172.21.15.32:0/877184107 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880ab980 con 0x7f3b9806f520 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 -- 172.21.15.32:0/877184107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806f520 msgr2=0x7f3b9806f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 --2- 172.21.15.32:0/877184107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806f520 0x7f3b9806f900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3b9806d3b0 tx=0x7f3b8801c3e0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 -- 172.21.15.32:0/877184107 shutdown_connections 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 --2- 172.21.15.32:0/877184107 >> v2:172.21.15.67:3300/0 conn(0x7f3b9806ecf0 0x7f3b98158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 --2- 172.21.15.32:0/877184107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806f520 0x7f3b9806f900 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 -- 172.21.15.32:0/877184107 >> 172.21.15.32:0/877184107 conn(0x7f3b9806d6c0 msgr2=0x7f3b9806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 -- 172.21.15.32:0/877184107 shutdown_connections 2024-01-19T04:15:43.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.215+0000 7f3b9de00640 1 -- 172.21.15.32:0/877184107 wait complete. 2024-01-19T04:15:43.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 Processor -- start 2024-01-19T04:15:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 -- start start 2024-01-19T04:15:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806e8a0 0x7f3b98154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b9806ecf0 0x7f3b9814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b9806f520 0x7f3b9814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c62f0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981f5bf0 con 0x7f3b9806f520 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981f5760 con 0x7f3b9806ecf0 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806e8a0 0x7f3b98154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b8fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b9806ecf0 0x7f3b9814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806e8a0 0x7f3b98154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49750/0 (socket says 172.21.15.32:49750) 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 -- 172.21.15.32:0/987880434 learned_addr learned my addr 172.21.15.32:0/987880434 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b97e00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b9806f520 0x7f3b9814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 -- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b9806ecf0 msgr2=0x7f3b9814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b9806ecf0 0x7f3b9814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 -- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b9806f520 msgr2=0x7f3b9814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b9806f520 0x7f3b9814f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 -- 172.21.15.32:0/987880434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880094d0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b96a00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806e8a0 0x7f3b98154bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3b88018ff0 tx=0x7f3b88019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b8f400640 1 -- 172.21.15.32:0/987880434 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880b4420 con 0x7f3b9806e8a0 2024-01-19T04:15:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b8f400640 1 -- 172.21.15.32:0/987880434 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b880b4580 con 0x7f3b9806e8a0 2024-01-19T04:15:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b8f400640 1 -- 172.21.15.32:0/987880434 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880b48f0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b981f4e30 con 0x7f3b9806e8a0 2024-01-19T04:15:43.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.219+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b981f53f0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.223+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9804e980 con 0x7f3b9806e8a0 2024-01-19T04:15:43.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.223+0000 7f3b8f400640 1 -- 172.21.15.32:0/987880434 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3b880b2070 con 0x7f3b9806e8a0 2024-01-19T04:15:43.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.223+0000 7f3b8f400640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b70066500 0x7f3b700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.223+0000 7f3b8f400640 1 -- 172.21.15.32:0/987880434 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3b8811d6b0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.223+0000 7f3b8fe00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b70066500 0x7f3b700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.227+0000 7f3b8fe00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b70066500 0x7f3b700689c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b981248b0 tx=0x7f3b80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:43.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.227+0000 7f3b8f400640 1 -- 172.21.15.32:0/987880434 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3b880eacb0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.451+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3b980c4de0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.451+0000 7f3b8f400640 1 -- 172.21.15.32:0/987880434 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3b880ee2d0 con 0x7f3b9806e8a0 2024-01-19T04:15:43.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b70066500 msgr2=0x7f3b700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b70066500 0x7f3b700689c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b981248b0 tx=0x7f3b80009040 comp rx=0 tx=0).stop 2024-01-19T04:15:43.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806e8a0 msgr2=0x7f3b98154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806e8a0 0x7f3b98154bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3b88018ff0 tx=0x7f3b88019180 comp rx=0 tx=0).stop 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 shutdown_connections 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b70066500 0x7f3b700689c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b9806f520 0x7f3b9814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b9806ecf0 0x7f3b9814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 --2- 172.21.15.32:0/987880434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b9806e8a0 0x7f3b98154bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 >> 172.21.15.32:0/987880434 conn(0x7f3b9806d6c0 msgr2=0x7f3b980ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 shutdown_connections 2024-01-19T04:15:43.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.455+0000 7f3b9de00640 1 -- 172.21.15.32:0/987880434 wait complete. 2024-01-19T04:15:43.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-19T04:15:43.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.615+0000 7f6ba5400640 1 Processor -- start 2024-01-19T04:15:43.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.615+0000 7f6ba5400640 1 -- start start 2024-01-19T04:15:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6ba5400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba00c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6ba5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6ba006eb70 0x7f6ba006f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6ba5400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba00c5b40 con 0x7f6ba0151f30 2024-01-19T04:15:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6ba5400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba01551e0 con 0x7f6ba006eb70 2024-01-19T04:15:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6ba5400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0155710 con 0x7f6ba006fda0 2024-01-19T04:15:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9f200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6ba006eb70 0x7f6ba006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9e800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6ba0151f30 0x7f6ba00c4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59394/0 (socket says 172.21.15.32:59394) 2024-01-19T04:15:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9e800640 1 -- 172.21.15.32:0/1409840905 learned_addr learned my addr 172.21.15.32:0/1409840905 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9f200640 1 -- 172.21.15.32:0/1409840905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 msgr2=0x7f6ba00c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9de00640 1 --2- 172.21.15.32:0/1409840905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba00c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9f200640 1 --2- 172.21.15.32:0/1409840905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba00c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9f200640 1 -- 172.21.15.32:0/1409840905 >> v1:172.21.15.32:6789/0 conn(0x7f6ba0151f30 legacy=0x7f6ba00c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9f200640 1 -- 172.21.15.32:0/1409840905 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00c3fa0 con 0x7f6ba006eb70 2024-01-19T04:15:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9d400640 1 -- 172.21.15.32:0/1409840905 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196073410 0 0) 0x7f6ba00c5b40 con 0x7f6ba0151f30 2024-01-19T04:15:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9de00640 1 --2- 172.21.15.32:0/1409840905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba00c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:43.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.619+0000 7f6b9f200640 1 --2- 172.21.15.32:0/1409840905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba006eb70 0x7f6ba006f000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009d90 tx=0x7f6b9801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dfad2d7c4703da server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:43.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6b9d400640 1 -- 172.21.15.32:0/1409840905 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980a5890 con 0x7f6ba006eb70 2024-01-19T04:15:43.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6b9d400640 1 -- 172.21.15.32:0/1409840905 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b980a59f0 con 0x7f6ba006eb70 2024-01-19T04:15:43.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6b9d400640 1 -- 172.21.15.32:0/1409840905 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980a5d80 con 0x7f6ba006eb70 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- 172.21.15.32:0/1409840905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba006eb70 msgr2=0x7f6ba006f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 --2- 172.21.15.32:0/1409840905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba006eb70 0x7f6ba006f000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009d90 tx=0x7f6b9801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- 172.21.15.32:0/1409840905 shutdown_connections 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 --2- 172.21.15.32:0/1409840905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba006eb70 0x7f6ba006f000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 --2- 172.21.15.32:0/1409840905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba00c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- 172.21.15.32:0/1409840905 >> 172.21.15.32:0/1409840905 conn(0x7f6ba00a9870 msgr2=0x7f6ba00a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- 172.21.15.32:0/1409840905 shutdown_connections 2024-01-19T04:15:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- 172.21.15.32:0/1409840905 wait complete. 2024-01-19T04:15:43.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 Processor -- start 2024-01-19T04:15:43.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- start start 2024-01-19T04:15:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba006eb70 0x7f6ba00bd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba006bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba0151f30 0x7f6ba006c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba006c190 con 0x7f6ba0151f30 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00a90b0 con 0x7f6ba006eb70 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.623+0000 7f6ba5400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba006b970 con 0x7f6ba006fda0 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba0151f30 0x7f6ba006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba0151f30 0x7f6ba006c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49762/0 (socket says 172.21.15.32:49762) 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 -- 172.21.15.32:0/2098145169 learned_addr learned my addr 172.21.15.32:0/2098145169 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9de00640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba006bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9e800640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba006eb70 0x7f6ba00bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 -- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 msgr2=0x7f6ba006bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba006bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 -- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba006eb70 msgr2=0x7f6ba00bd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba006eb70 0x7f6ba00bd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 -- 172.21.15.32:0/2098145169 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009a70 con 0x7f6ba0151f30 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9e800640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba006eb70 0x7f6ba00bd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9de00640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba006bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b9f200640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba0151f30 0x7f6ba006c640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b9801af70 tx=0x7f6b98019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b96a00640 1 -- 172.21.15.32:0/2098145169 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980b9860 con 0x7f6ba0151f30 2024-01-19T04:15:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b96a00640 1 -- 172.21.15.32:0/2098145169 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b980b99c0 con 0x7f6ba0151f30 2024-01-19T04:15:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b96a00640 1 -- 172.21.15.32:0/2098145169 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980b9d50 con 0x7f6ba0151f30 2024-01-19T04:15:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba0149e00 con 0x7f6ba0151f30 2024-01-19T04:15:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba014a3c0 con 0x7f6ba0151f30 2024-01-19T04:15:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba00749f0 con 0x7f6ba0151f30 2024-01-19T04:15:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.627+0000 7f6b96a00640 1 -- 172.21.15.32:0/2098145169 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6b980ad440 con 0x7f6ba0151f30 2024-01-19T04:15:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.631+0000 7f6b96a00640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b78066530 0x7f6b780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.631+0000 7f6b96a00640 1 -- 172.21.15.32:0/2098145169 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b9811efc0 con 0x7f6ba0151f30 2024-01-19T04:15:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.631+0000 7f6b9e800640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b78066530 0x7f6b780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:43.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.631+0000 7f6b9e800640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b78066530 0x7f6b780689f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b90000f70 tx=0x7f6b90007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.635+0000 7f6b96a00640 1 -- 172.21.15.32:0/2098145169 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6b980ec660 con 0x7f6ba0151f30 2024-01-19T04:15:43.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.851+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f6ba0067b80 con 0x7f6ba0151f30 2024-01-19T04:15:43.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.851+0000 7f6b96a00640 1 -- 172.21.15.32:0/2098145169 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6b980efc80 con 0x7f6ba0151f30 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b78066530 msgr2=0x7f6b780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b78066530 0x7f6b780689f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b90000f70 tx=0x7f6b90007cb0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba0151f30 msgr2=0x7f6ba006c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba0151f30 0x7f6ba006c640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b9801af70 tx=0x7f6b98019660 comp rx=0 tx=0).stop 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 shutdown_connections 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b78066530 0x7f6b780689f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ba0151f30 0x7f6ba006c640 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ba006fda0 0x7f6ba006bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 --2- 172.21.15.32:0/2098145169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba006eb70 0x7f6ba00bd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 >> 172.21.15.32:0/2098145169 conn(0x7f6ba00a9870 msgr2=0x7f6ba015e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 shutdown_connections 2024-01-19T04:15:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:43.855+0000 7f6ba5400640 1 -- 172.21.15.32:0/2098145169 wait complete. 2024-01-19T04:15:43.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-19T04:15:44.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.015+0000 7f73e4e00640 1 Processor -- start 2024-01-19T04:15:44.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.015+0000 7f73e4e00640 1 -- start start 2024-01-19T04:15:44.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73e4e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73e00c42b0 0x7f73e00c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73e4e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73e00c1120 0x7f73e015b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73e4e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00c0c90 con 0x7f73e00c5740 2024-01-19T04:15:44.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73e4e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e0150f90 con 0x7f73e00c42b0 2024-01-19T04:15:44.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73e4e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e0150cb0 con 0x7f73e00c1120 2024-01-19T04:15:44.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dd400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f73e00c5740 0x7f73e006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59410/0 (socket says 172.21.15.32:59410) 2024-01-19T04:15:44.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dde00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73e00c42b0 0x7f73e00c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dd400640 1 -- 172.21.15.32:0/3257350866 learned_addr learned my addr 172.21.15.32:0/3257350866 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:44.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73de800640 1 --2- 172.21.15.32:0/3257350866 >> v2:172.21.15.67:3300/0 conn(0x7f73e00c1120 0x7f73e015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dde00640 1 -- 172.21.15.32:0/3257350866 >> v2:172.21.15.67:3300/0 conn(0x7f73e00c1120 msgr2=0x7f73e015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:44.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dde00640 1 --2- 172.21.15.32:0/3257350866 >> v2:172.21.15.67:3300/0 conn(0x7f73e00c1120 0x7f73e015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dde00640 1 -- 172.21.15.32:0/3257350866 >> v1:172.21.15.32:6789/0 conn(0x7f73e00c5740 legacy=0x7f73e006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dca00640 1 -- 172.21.15.32:0/3257350866 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830434705 0 0) 0x7f73e00c0c90 con 0x7f73e00c5740 2024-01-19T04:15:44.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dde00640 1 -- 172.21.15.32:0/3257350866 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00c0640 con 0x7f73e00c42b0 2024-01-19T04:15:44.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dde00640 1 --2- 172.21.15.32:0/3257350866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e00c4690 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f73e00c1970 tx=0x7f73d001ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19a8dcf6d41f671 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.019+0000 7f73dca00640 1 -- 172.21.15.32:0/3257350866 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d00ab600 con 0x7f73e00c42b0 2024-01-19T04:15:44.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73dca00640 1 -- 172.21.15.32:0/3257350866 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d00a7050 con 0x7f73e00c42b0 2024-01-19T04:15:44.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73dca00640 1 -- 172.21.15.32:0/3257350866 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d00ab980 con 0x7f73e00c42b0 2024-01-19T04:15:44.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- 172.21.15.32:0/3257350866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 msgr2=0x7f73e00c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 --2- 172.21.15.32:0/3257350866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e00c4690 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f73e00c1970 tx=0x7f73d001ce00 comp rx=0 tx=0).stop 2024-01-19T04:15:44.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- 172.21.15.32:0/3257350866 shutdown_connections 2024-01-19T04:15:44.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 --2- 172.21.15.32:0/3257350866 >> v2:172.21.15.67:3300/0 conn(0x7f73e00c1120 0x7f73e015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 --2- 172.21.15.32:0/3257350866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e00c4690 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- 172.21.15.32:0/3257350866 >> 172.21.15.32:0/3257350866 conn(0x7f73e00c5b20 msgr2=0x7f73e00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:44.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- 172.21.15.32:0/3257350866 shutdown_connections 2024-01-19T04:15:44.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- 172.21.15.32:0/3257350866 wait complete. 2024-01-19T04:15:44.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 Processor -- start 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- start start 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e00c1120 0x7f73e01503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e0147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e00c5740 0x7f73e014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0148470 con 0x7f73e00c42b0 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e01ecd80 con 0x7f73e00c1120 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.023+0000 7f73e4e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e014ea60 con 0x7f73e00c5740 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e0147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e0147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49774/0 (socket says 172.21.15.32:49774) 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 -- 172.21.15.32:0/1208293051 learned_addr learned my addr 172.21.15.32:0/1208293051 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73de800640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e00c5740 0x7f73e014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dde00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e00c1120 0x7f73e01503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 -- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e00c5740 msgr2=0x7f73e014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e00c5740 0x7f73e014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 -- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e00c1120 msgr2=0x7f73e01503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e00c1120 0x7f73e01503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 -- 172.21.15.32:0/1208293051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0009420 con 0x7f73e00c42b0 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73dd400640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e0147400 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f73c80011f0 tx=0x7f73c800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73d6000640 1 -- 172.21.15.32:0/1208293051 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c80074e0 con 0x7f73e00c42b0 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73d6000640 1 -- 172.21.15.32:0/1208293051 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8007640 con 0x7f73e00c42b0 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73d6000640 1 -- 172.21.15.32:0/1208293051 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8004a10 con 0x7f73e00c42b0 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e01ecf90 con 0x7f73e00c42b0 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e01ed550 con 0x7f73e00c42b0 2024-01-19T04:15:44.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e00749f0 con 0x7f73e00c42b0 2024-01-19T04:15:44.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.027+0000 7f73d6000640 1 -- 172.21.15.32:0/1208293051 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f73c8004b70 con 0x7f73e00c42b0 2024-01-19T04:15:44.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.031+0000 7f73d6000640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73b8066500 0x7f73b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.031+0000 7f73d6000640 1 -- 172.21.15.32:0/1208293051 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f73c8082da0 con 0x7f73e00c42b0 2024-01-19T04:15:44.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.031+0000 7f73dde00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73b8066500 0x7f73b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.031+0000 7f73dde00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73b8066500 0x7f73b80689c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73e0070270 tx=0x7f73d0004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.035+0000 7f73d6000640 1 -- 172.21.15.32:0/1208293051 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f73c8050430 con 0x7f73e00c42b0 2024-01-19T04:15:44.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.251+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f73e00c5210 con 0x7f73e00c42b0 2024-01-19T04:15:44.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.251+0000 7f73d6000640 1 -- 172.21.15.32:0/1208293051 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f73c8018020 con 0x7f73e00c42b0 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73b8066500 msgr2=0x7f73b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73b8066500 0x7f73b80689c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73e0070270 tx=0x7f73d0004740 comp rx=0 tx=0).stop 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 msgr2=0x7f73e0147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e0147400 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f73c80011f0 tx=0x7f73c800c9b0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 shutdown_connections 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73b8066500 0x7f73b80689c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73e00c5740 0x7f73e014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73e00c42b0 0x7f73e0147400 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 --2- 172.21.15.32:0/1208293051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73e00c1120 0x7f73e01503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 >> 172.21.15.32:0/1208293051 conn(0x7f73e00c5b20 msgr2=0x7f73e00c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:44.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 shutdown_connections 2024-01-19T04:15:44.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.255+0000 7f73e4e00640 1 -- 172.21.15.32:0/1208293051 wait complete. 2024-01-19T04:15:44.279 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-19T04:15:44.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.415+0000 7fa9a6600640 1 Processor -- start 2024-01-19T04:15:44.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.415+0000 7fa9a6600640 1 -- start start 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa9a6600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa9a6600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9a00a4ec0 0x7fa9a00c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa9a6600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a0071e80 con 0x7fa9a014fb50 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa9a6600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a01535c0 con 0x7fa9a00a4ec0 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa9a6600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00726c0 con 0x7fa9a00c04a0 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9a00a4ec0 0x7fa9a00c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa9a014fb50 0x7fa9a006fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59426/0 (socket says 172.21.15.32:59426) 2024-01-19T04:15:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99f400640 1 -- 172.21.15.32:0/3506443754 learned_addr learned my addr 172.21.15.32:0/3506443754 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:44.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99ea00640 1 --2- 172.21.15.32:0/3506443754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99fe00640 1 -- 172.21.15.32:0/3506443754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 msgr2=0x7fa9a00c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:44.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99fe00640 1 --2- 172.21.15.32:0/3506443754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99fe00640 1 -- 172.21.15.32:0/3506443754 >> v1:172.21.15.32:6789/0 conn(0x7fa9a014fb50 legacy=0x7fa9a006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.419+0000 7fa99fe00640 1 -- 172.21.15.32:0/3506443754 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a00c1cb0 con 0x7fa9a00a4ec0 2024-01-19T04:15:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa99fe00640 1 --2- 172.21.15.32:0/3506443754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a00a4ec0 0x7fa9a00c1770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa998009dc0 tx=0x7fa99801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6cc288bcffcc45 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa99e000640 1 -- 172.21.15.32:0/3506443754 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980a5760 con 0x7fa9a00a4ec0 2024-01-19T04:15:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa99e000640 1 -- 172.21.15.32:0/3506443754 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9980a58c0 con 0x7fa9a00a4ec0 2024-01-19T04:15:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa99e000640 1 -- 172.21.15.32:0/3506443754 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980a5c50 con 0x7fa9a00a4ec0 2024-01-19T04:15:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 -- 172.21.15.32:0/3506443754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a00a4ec0 msgr2=0x7fa9a00c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 --2- 172.21.15.32:0/3506443754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a00a4ec0 0x7fa9a00c1770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa998009dc0 tx=0x7fa99801c8a0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 -- 172.21.15.32:0/3506443754 shutdown_connections 2024-01-19T04:15:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 --2- 172.21.15.32:0/3506443754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a00a4ec0 0x7fa9a00c1770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 --2- 172.21.15.32:0/3506443754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 -- 172.21.15.32:0/3506443754 >> 172.21.15.32:0/3506443754 conn(0x7fa9a00c5b20 msgr2=0x7fa9a00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 -- 172.21.15.32:0/3506443754 shutdown_connections 2024-01-19T04:15:44.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 -- 172.21.15.32:0/3506443754 wait complete. 2024-01-19T04:15:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 Processor -- start 2024-01-19T04:15:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.423+0000 7fa9a6600640 1 -- start start 2024-01-19T04:15:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9a00a4ec0 0x7fa9a00a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a014fb50 0x7fa9a01f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0154a80 con 0x7fa9a014fb50 2024-01-19T04:15:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00a9a30 con 0x7fa9a00a4ec0 2024-01-19T04:15:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00a9750 con 0x7fa9a00c04a0 2024-01-19T04:15:44.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a014fb50 0x7fa9a01f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a014fb50 0x7fa9a01f02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49800/0 (socket says 172.21.15.32:49800) 2024-01-19T04:15:44.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 -- 172.21.15.32:0/2503648111 learned_addr learned my addr 172.21.15.32:0/2503648111 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:44.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99f400640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9a00a4ec0 0x7fa9a00a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99ea00640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 -- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 msgr2=0x7fa9a00bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00bf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 -- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9a00a4ec0 msgr2=0x7fa9a00a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9a00a4ec0 0x7fa9a00a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 -- 172.21.15.32:0/2503648111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998009a70 con 0x7fa9a014fb50 2024-01-19T04:15:44.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa99fe00640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a014fb50 0x7fa9a01f02e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa99801af50 tx=0x7fa998019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa997400640 1 -- 172.21.15.32:0/2503648111 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980b9650 con 0x7fa9a014fb50 2024-01-19T04:15:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa997400640 1 -- 172.21.15.32:0/2503648111 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9980b97b0 con 0x7fa9a014fb50 2024-01-19T04:15:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a0155240 con 0x7fa9a014fb50 2024-01-19T04:15:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa997400640 1 -- 172.21.15.32:0/2503648111 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980b9b40 con 0x7fa9a014fb50 2024-01-19T04:15:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a0155800 con 0x7fa9a014fb50 2024-01-19T04:15:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a00749f0 con 0x7fa9a014fb50 2024-01-19T04:15:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.427+0000 7fa997400640 1 -- 172.21.15.32:0/2503648111 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa9980b9ca0 con 0x7fa9a014fb50 2024-01-19T04:15:44.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.431+0000 7fa997400640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa978066500 0x7fa9780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.431+0000 7fa997400640 1 -- 172.21.15.32:0/2503648111 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa99811ecb0 con 0x7fa9a014fb50 2024-01-19T04:15:44.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.431+0000 7fa99f400640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa978066500 0x7fa9780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.431+0000 7fa99f400640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa978066500 0x7fa9780689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa990000f70 tx=0x7fa990007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.435+0000 7fa997400640 1 -- 172.21.15.32:0/2503648111 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa9980ec2b0 con 0x7fa9a014fb50 2024-01-19T04:15:44.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.651+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa9a0152de0 con 0x7fa9a014fb50 2024-01-19T04:15:44.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.655+0000 7fa997400640 1 -- 172.21.15.32:0/2503648111 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa9980ef8d0 con 0x7fa9a014fb50 2024-01-19T04:15:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa978066500 msgr2=0x7fa9780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa978066500 0x7fa9780689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa990000f70 tx=0x7fa990007e90 comp rx=0 tx=0).stop 2024-01-19T04:15:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a014fb50 msgr2=0x7fa9a01f02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a014fb50 0x7fa9a01f02e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa99801af50 tx=0x7fa998019640 comp rx=0 tx=0).stop 2024-01-19T04:15:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 shutdown_connections 2024-01-19T04:15:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa978066500 0x7fa9780689c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a014fb50 0x7fa9a01f02e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9a00c04a0 0x7fa9a00bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 --2- 172.21.15.32:0/2503648111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9a00a4ec0 0x7fa9a00a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 >> 172.21.15.32:0/2503648111 conn(0x7fa9a00c5b20 msgr2=0x7fa9a006fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 shutdown_connections 2024-01-19T04:15:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.659+0000 7fa9a6600640 1 -- 172.21.15.32:0/2503648111 wait complete. 2024-01-19T04:15:44.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-19T04:15:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.819+0000 7fe5a9400640 1 Processor -- start 2024-01-19T04:15:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.819+0000 7fe5a9400640 1 -- start start 2024-01-19T04:15:44.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.819+0000 7fe5a9400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe5a4072310 0x7fe5a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.819+0000 7fe5a9400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40c44f0 con 0x7fe5a4155320 2024-01-19T04:15:44.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.819+0000 7fe5a9400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40c4980 con 0x7fe5a40c54b0 2024-01-19T04:15:44.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.819+0000 7fe5a9400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a40c3bc0 con 0x7fe5a4072310 2024-01-19T04:15:44.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a3200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe5a4072310 0x7fe5a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a2800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe5a4155320 0x7fe5a40a4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59442/0 (socket says 172.21.15.32:59442) 2024-01-19T04:15:44.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a2800640 1 -- 172.21.15.32:0/3766571574 learned_addr learned my addr 172.21.15.32:0/3766571574 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:44.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a3200640 1 -- 172.21.15.32:0/3766571574 >> v1:172.21.15.67:6789/0 conn(0x7fe5a40c54b0 legacy=0x7fe5a406cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a3200640 1 -- 172.21.15.32:0/3766571574 >> v1:172.21.15.32:6789/0 conn(0x7fe5a4155320 legacy=0x7fe5a40a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a3200640 1 -- 172.21.15.32:0/3766571574 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40c3ea0 con 0x7fe5a4072310 2024-01-19T04:15:44.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a3200640 1 --2- 172.21.15.32:0/3766571574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a4072310 0x7fe5a406d390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009d90 tx=0x7fe59c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bae5ab758ee81b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a1400640 1 -- 172.21.15.32:0/3766571574 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0a5a00 con 0x7fe5a4072310 2024-01-19T04:15:44.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a1400640 1 -- 172.21.15.32:0/3766571574 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c0a5b60 con 0x7fe5a4072310 2024-01-19T04:15:44.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.823+0000 7fe5a1400640 1 -- 172.21.15.32:0/3766571574 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0ad440 con 0x7fe5a4072310 2024-01-19T04:15:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- 172.21.15.32:0/3766571574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a4072310 msgr2=0x7fe5a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 --2- 172.21.15.32:0/3766571574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a4072310 0x7fe5a406d390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009d90 tx=0x7fe59c01c920 comp rx=0 tx=0).stop 2024-01-19T04:15:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- 172.21.15.32:0/3766571574 shutdown_connections 2024-01-19T04:15:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 --2- 172.21.15.32:0/3766571574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a4072310 0x7fe5a406d390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- 172.21.15.32:0/3766571574 >> 172.21.15.32:0/3766571574 conn(0x7fe5a40c5b20 msgr2=0x7fe5a40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:44.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- 172.21.15.32:0/3766571574 shutdown_connections 2024-01-19T04:15:44.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- 172.21.15.32:0/3766571574 wait complete. 2024-01-19T04:15:44.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 Processor -- start 2024-01-19T04:15:44.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- start start 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5a4072310 0x7fe5a40a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a40c54b0 0x7fe5a40aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5a4155320 0x7fe5a4071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40ab300 con 0x7fe5a40c54b0 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a41f0ca0 con 0x7fe5a4072310 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a9400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a41f0970 con 0x7fe5a4155320 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a40c54b0 0x7fe5a40aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a40c54b0 0x7fe5a40aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49826/0 (socket says 172.21.15.32:49826) 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.827+0000 7fe5a1e00640 1 -- 172.21.15.32:0/877984960 learned_addr learned my addr 172.21.15.32:0/877984960 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a2800640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5a4072310 0x7fe5a40a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a3200640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5a4155320 0x7fe5a4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a1e00640 1 -- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5a4155320 msgr2=0x7fe5a4071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a1e00640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5a4155320 0x7fe5a4071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a1e00640 1 -- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5a4072310 msgr2=0x7fe5a40a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a1e00640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5a4072310 0x7fe5a40a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a1e00640 1 -- 172.21.15.32:0/877984960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c009a70 con 0x7fe5a40c54b0 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a3200640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5a4155320 0x7fe5a4071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a2800640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5a4072310 0x7fe5a40a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a1e00640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a40c54b0 0x7fe5a40aadc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c370 tx=0x7fe58c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe59aa00640 1 -- 172.21.15.32:0/877984960 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0052d0 con 0x7fe5a40c54b0 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe59aa00640 1 -- 172.21.15.32:0/877984960 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c005430 con 0x7fe5a40c54b0 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe59aa00640 1 -- 172.21.15.32:0/877984960 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c007260 con 0x7fe5a40c54b0 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a4151730 con 0x7fe5a40c54b0 2024-01-19T04:15:44.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a4151cf0 con 0x7fe5a40c54b0 2024-01-19T04:15:44.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a40749f0 con 0x7fe5a40c54b0 2024-01-19T04:15:44.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe59aa00640 1 -- 172.21.15.32:0/877984960 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe58c0073c0 con 0x7fe5a40c54b0 2024-01-19T04:15:44.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe59aa00640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe57c066500 0x7fe57c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:44.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.831+0000 7fe59aa00640 1 -- 172.21.15.32:0/877984960 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe58c082e50 con 0x7fe5a40c54b0 2024-01-19T04:15:44.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.835+0000 7fe5a2800640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe57c066500 0x7fe57c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:44.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.835+0000 7fe5a2800640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe57c066500 0x7fe57c0689c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe594005890 tx=0x7fe594009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:44.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:44.839+0000 7fe59aa00640 1 -- 172.21.15.32:0/877984960 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe58c0504d0 con 0x7fe5a40c54b0 2024-01-19T04:15:45.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.051+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe5a415fea0 con 0x7fe5a40c54b0 2024-01-19T04:15:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.055+0000 7fe59aa00640 1 -- 172.21.15.32:0/877984960 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe58c053af0 con 0x7fe5a40c54b0 2024-01-19T04:15:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe57c066500 msgr2=0x7fe57c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe57c066500 0x7fe57c0689c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe594005890 tx=0x7fe594009040 comp rx=0 tx=0).stop 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a40c54b0 msgr2=0x7fe5a40aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a40c54b0 0x7fe5a40aadc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c370 tx=0x7fe58c00c830 comp rx=0 tx=0).stop 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 shutdown_connections 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe57c066500 0x7fe57c0689c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe5a4155320 0x7fe5a4071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a40c54b0 0x7fe5a40aadc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 --2- 172.21.15.32:0/877984960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5a4072310 0x7fe5a40a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 >> 172.21.15.32:0/877984960 conn(0x7fe5a40c5b20 msgr2=0x7fe5a40c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 shutdown_connections 2024-01-19T04:15:45.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.059+0000 7fe5a9400640 1 -- 172.21.15.32:0/877984960 wait complete. 2024-01-19T04:15:45.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-19T04:15:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.219+0000 7f9415200640 1 Processor -- start 2024-01-19T04:15:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f9415200640 1 -- start start 2024-01-19T04:15:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f9415200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9410151de0 0x7f94100c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f9415200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94101547e0 con 0x7f94100a7200 2024-01-19T04:15:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f9415200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94100c1db0 con 0x7f9410154c70 2024-01-19T04:15:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f9415200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94101521c0 con 0x7f9410151de0 2024-01-19T04:15:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f940de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9410151de0 0x7f94100c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f940d400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f94100a7200 0x7f94100c3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59458/0 (socket says 172.21.15.32:59458) 2024-01-19T04:15:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f940d400640 1 -- 172.21.15.32:0/1547835504 learned_addr learned my addr 172.21.15.32:0/1547835504 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f940de00640 1 -- 172.21.15.32:0/1547835504 >> v1:172.21.15.67:6789/0 conn(0x7f9410154c70 legacy=0x7f94101550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f940de00640 1 -- 172.21.15.32:0/1547835504 >> v1:172.21.15.32:6789/0 conn(0x7f94100a7200 legacy=0x7f94100c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.223+0000 7f940de00640 1 -- 172.21.15.32:0/1547835504 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941006f820 con 0x7f9410151de0 2024-01-19T04:15:45.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f940de00640 1 --2- 172.21.15.32:0/1547835504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9410151de0 0x7f94100c1870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f94000097c0 tx=0x7f940001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6c2c1487d3fbad server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f940ca00640 1 -- 172.21.15.32:0/1547835504 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000ab600 con 0x7f9410151de0 2024-01-19T04:15:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f940ca00640 1 -- 172.21.15.32:0/1547835504 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000a7050 con 0x7f9410151de0 2024-01-19T04:15:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f940ca00640 1 -- 172.21.15.32:0/1547835504 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000ab980 con 0x7f9410151de0 2024-01-19T04:15:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 -- 172.21.15.32:0/1547835504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9410151de0 msgr2=0x7f94100c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 --2- 172.21.15.32:0/1547835504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9410151de0 0x7f94100c1870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f94000097c0 tx=0x7f940001c380 comp rx=0 tx=0).stop 2024-01-19T04:15:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 -- 172.21.15.32:0/1547835504 shutdown_connections 2024-01-19T04:15:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 --2- 172.21.15.32:0/1547835504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9410151de0 0x7f94100c1870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 -- 172.21.15.32:0/1547835504 >> 172.21.15.32:0/1547835504 conn(0x7f94100726d0 msgr2=0x7f94100663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 -- 172.21.15.32:0/1547835504 shutdown_connections 2024-01-19T04:15:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 -- 172.21.15.32:0/1547835504 wait complete. 2024-01-19T04:15:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 Processor -- start 2024-01-19T04:15:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.227+0000 7f9415200640 1 -- start start 2024-01-19T04:15:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94100a7200 0x7f941006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9410151de0 0x7f9410145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9410154c70 0x7f9410146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94100aa4c0 con 0x7f94100a7200 2024-01-19T04:15:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410156a80 con 0x7f9410154c70 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9410156780 con 0x7f9410151de0 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94100a7200 0x7f941006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94100a7200 0x7f941006cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49848/0 (socket says 172.21.15.32:49848) 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 -- 172.21.15.32:0/2515132227 learned_addr learned my addr 172.21.15.32:0/2515132227 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940d400640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9410151de0 0x7f9410145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940e800640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9410154c70 0x7f9410146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 -- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9410151de0 msgr2=0x7f9410145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9410151de0 0x7f9410145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 -- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9410154c70 msgr2=0x7f9410146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9410154c70 0x7f9410146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 -- 172.21.15.32:0/2515132227 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9400009420 con 0x7f94100a7200 2024-01-19T04:15:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f940de00640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94100a7200 0x7f941006cdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9400018f90 tx=0x7f940001abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9406000640 1 -- 172.21.15.32:0/2515132227 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000b7650 con 0x7f94100a7200 2024-01-19T04:15:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9406000640 1 -- 172.21.15.32:0/2515132227 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000abe90 con 0x7f94100a7200 2024-01-19T04:15:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9410157ba0 con 0x7f94100a7200 2024-01-19T04:15:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9406000640 1 -- 172.21.15.32:0/2515132227 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000b7a10 con 0x7f94100a7200 2024-01-19T04:15:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94100acf60 con 0x7f94100a7200 2024-01-19T04:15:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.231+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94100749f0 con 0x7f94100a7200 2024-01-19T04:15:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.235+0000 7f9406000640 1 -- 172.21.15.32:0/2515132227 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f94000b7b70 con 0x7f94100a7200 2024-01-19T04:15:45.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.235+0000 7f9406000640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e8066500 0x7f93e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.235+0000 7f9406000640 1 -- 172.21.15.32:0/2515132227 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f940011e3a0 con 0x7f94100a7200 2024-01-19T04:15:45.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.235+0000 7f940d400640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e8066500 0x7f93e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.235+0000 7f940d400640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e8066500 0x7f93e80689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f941015ff90 tx=0x7f93f8007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.239+0000 7f9406000640 1 -- 172.21.15.32:0/2515132227 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f94000ebbf0 con 0x7f94100a7200 2024-01-19T04:15:45.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.451+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f94100c1650 con 0x7f94100a7200 2024-01-19T04:15:45.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.455+0000 7f9406000640 1 -- 172.21.15.32:0/2515132227 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f94000bb0a0 con 0x7f94100a7200 2024-01-19T04:15:45.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e8066500 msgr2=0x7f93e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e8066500 0x7f93e80689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f941015ff90 tx=0x7f93f8007e90 comp rx=0 tx=0).stop 2024-01-19T04:15:45.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94100a7200 msgr2=0x7f941006cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94100a7200 0x7f941006cdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9400018f90 tx=0x7f940001abc0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 shutdown_connections 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e8066500 0x7f93e80689c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9410154c70 0x7f9410146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9410151de0 0x7f9410145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 --2- 172.21.15.32:0/2515132227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94100a7200 0x7f941006cdc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 >> 172.21.15.32:0/2515132227 conn(0x7f94100726d0 msgr2=0x7f9410152520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 shutdown_connections 2024-01-19T04:15:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.459+0000 7f9415200640 1 -- 172.21.15.32:0/2515132227 wait complete. 2024-01-19T04:15:45.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:45.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f170f000640 1 Processor -- start 2024-01-19T04:15:45.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f170f000640 1 -- start start 2024-01-19T04:15:45.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f170f000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17080c55e0 0x7f1708151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f170f000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17080c1d40 con 0x7f1708147f90 2024-01-19T04:15:45.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f170f000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17080c0810 con 0x7f17080c18b0 2024-01-19T04:15:45.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f170f000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170806c5c0 con 0x7f17080c55e0 2024-01-19T04:15:45.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1707e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1708147f90 0x7f170806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59464/0 (socket says 172.21.15.32:59464) 2024-01-19T04:15:45.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1707e00640 1 -- 172.21.15.32:0/501036032 learned_addr learned my addr 172.21.15.32:0/501036032 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:45.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121149545 0 0) 0x7f17080c1d40 con 0x7f1708147f90 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1707400640 1 --2- 172.21.15.32:0/501036032 >> v2:172.21.15.67:3300/0 conn(0x7f17080c55e0 0x7f1708151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e8003530 con 0x7f1708147f90 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1800881116 0 0) 0x7f16e8003530 con 0x7f1708147f90 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 >> v2:172.21.15.67:3300/0 conn(0x7f17080c55e0 msgr2=0x7f1708151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 --2- 172.21.15.32:0/501036032 >> v2:172.21.15.67:3300/0 conn(0x7f17080c55e0 0x7f1708151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 >> v1:172.21.15.67:6789/0 conn(0x7f17080c18b0 legacy=0x7f17080a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080c0af0 con 0x7f1708147f90 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f16f8001680 con 0x7f1708147f90 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 >> v1:172.21.15.32:6789/0 conn(0x7f1708147f90 legacy=0x7f170806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f16e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16e80047d0 0x7f16e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8005190 0x7f16e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170806c5c0 con 0x7f16e8003980 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e800c130 con 0x7f16e8005190 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e800c2f0 con 0x7f16e80047d0 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1707e00640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f16e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f170d000640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8005190 0x7f16e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.619+0000 7f1707400640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16e80047d0 0x7f16e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1707e00640 1 -- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16e80047d0 msgr2=0x7f16e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1707e00640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16e80047d0 0x7f16e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1707e00640 1 -- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8005190 msgr2=0x7f16e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1707e00640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8005190 0x7f16e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f170d000640 1 -- 172.21.15.32:0/501036032 reap_dead start 2024-01-19T04:15:45.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1707e00640 1 -- 172.21.15.32:0/501036032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8003530 con 0x7f16e8003980 2024-01-19T04:15:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1707e00640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f16e8003da0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c240 tx=0x7f16f801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7f62e0ea70033 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8005ae0 con 0x7f16e8003980 2024-01-19T04:15:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8005c40 con 0x7f16e8003980 2024-01-19T04:15:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f1706a00640 1 -- 172.21.15.32:0/501036032 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80a5a40 con 0x7f16e8003980 2024-01-19T04:15:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f170f000640 1 -- 172.21.15.32:0/501036032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 msgr2=0x7f16e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.623+0000 7f170f000640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f16e8003da0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c240 tx=0x7f16f801cc10 comp rx=0 tx=0).stop 2024-01-19T04:15:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- 172.21.15.32:0/501036032 shutdown_connections 2024-01-19T04:15:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 --2- 172.21.15.32:0/501036032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f16e8003da0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- 172.21.15.32:0/501036032 >> 172.21.15.32:0/501036032 conn(0x7f17080c5b20 msgr2=0x7f17080c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- 172.21.15.32:0/501036032 shutdown_connections 2024-01-19T04:15:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- 172.21.15.32:0/501036032 wait complete. 2024-01-19T04:15:45.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 Processor -- start 2024-01-19T04:15:45.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- start start 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f1708143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1708150d70 0x7f17081edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17081ee270 0x7f1708144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17081ee700 con 0x7f16e8003980 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17080aa180 con 0x7f1708150d70 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170f000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1708144800 con 0x7f17081ee270 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f1708143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f1708143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49856/0 (socket says 172.21.15.32:49856) 2024-01-19T04:15:45.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 -- 172.21.15.32:0/3414999547 learned_addr learned my addr 172.21.15.32:0/3414999547 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707400640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1708150d70 0x7f17081edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f170d000640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17081ee270 0x7f1708144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 -- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17081ee270 msgr2=0x7f1708144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17081ee270 0x7f1708144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 -- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1708150d70 msgr2=0x7f17081edd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1708150d70 0x7f17081edd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 -- 172.21.15.32:0/3414999547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080a9740 con 0x7f16e8003980 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.627+0000 7f1707e00640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f1708143b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f16f8000c10 tx=0x7f16e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f16ffe00640 1 -- 172.21.15.32:0/3414999547 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80b4070 con 0x7f16e8003980 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f16ffe00640 1 -- 172.21.15.32:0/3414999547 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8001440 con 0x7f16e8003980 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17080a9460 con 0x7f16e8003980 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f16ffe00640 1 -- 172.21.15.32:0/3414999547 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80a5800 con 0x7f16e8003980 2024-01-19T04:15:45.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17081509a0 con 0x7f16e8003980 2024-01-19T04:15:45.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1708150b90 con 0x7f16e8003980 2024-01-19T04:15:45.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f16ffe00640 1 -- 172.21.15.32:0/3414999547 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f16f80a5960 con 0x7f16e8003980 2024-01-19T04:15:45.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f16ffe00640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16e0066530 0x7f16e00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f16ffe00640 1 -- 172.21.15.32:0/3414999547 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f16f811d960 con 0x7f16e8003980 2024-01-19T04:15:45.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.631+0000 7f1707400640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16e0066530 0x7f16e00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.635+0000 7f1707400640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16e0066530 0x7f16e00689f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17081511f0 tx=0x7f16f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.635+0000 7f16ffe00640 1 -- 172.21.15.32:0/3414999547 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f16f80eaf40 con 0x7f16e8003980 2024-01-19T04:15:45.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.795+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17080749f0 con 0x7f16e8003980 2024-01-19T04:15:45.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f16ffe00640 1 -- 172.21.15.32:0/3414999547 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12762 (secure 0 0 0) 0x7f16f80ee560 con 0x7f16e8003980 2024-01-19T04:15:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:45.802 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:42.641742+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16e0066530 msgr2=0x7f16e00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16e0066530 0x7f16e00689f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17081511f0 tx=0x7f16f0008040 comp rx=0 tx=0).stop 2024-01-19T04:15:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 msgr2=0x7f1708143b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f1708143b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f16f8000c10 tx=0x7f16e8005800 comp rx=0 tx=0).stop 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 shutdown_connections 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16e0066530 0x7f16e00689f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17081ee270 0x7f1708144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1708150d70 0x7f17081edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 --2- 172.21.15.32:0/3414999547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16e8003980 0x7f1708143b70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 >> 172.21.15.32:0/3414999547 conn(0x7f17080c5b20 msgr2=0x7f17080c2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 shutdown_connections 2024-01-19T04:15:45.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.799+0000 7f170f000640 1 -- 172.21.15.32:0/3414999547 wait complete. 2024-01-19T04:15:45.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:15:45.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:15:45.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.963+0000 7f9412e00640 1 Processor -- start 2024-01-19T04:15:45.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f9412e00640 1 -- start start 2024-01-19T04:15:45.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f9412e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f940c06f5b0 0x7f940c0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f9412e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f940c06ae10 0x7f940c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f9412e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c06a6a0 con 0x7f940c0c15c0 2024-01-19T04:15:45.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f9412e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c154e70 con 0x7f940c06f5b0 2024-01-19T04:15:45.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f9412e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c155150 con 0x7f940c06ae10 2024-01-19T04:15:45.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f940b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f940c06f5b0 0x7f940c0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f940be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f940c0c15c0 0x7f940c154690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59470/0 (socket says 172.21.15.32:59470) 2024-01-19T04:15:45.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f940be00640 1 -- 172.21.15.32:0/1476582931 learned_addr learned my addr 172.21.15.32:0/1476582931 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:45.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f9410e00640 1 --2- 172.21.15.32:0/1476582931 >> v2:172.21.15.67:3300/0 conn(0x7f940c06ae10 0x7f940c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f940b400640 1 -- 172.21.15.32:0/1476582931 >> v2:172.21.15.67:3300/0 conn(0x7f940c06ae10 msgr2=0x7f940c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:45.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f940b400640 1 --2- 172.21.15.32:0/1476582931 >> v2:172.21.15.67:3300/0 conn(0x7f940c06ae10 0x7f940c151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f940b400640 1 -- 172.21.15.32:0/1476582931 >> v1:172.21.15.32:6789/0 conn(0x7f940c0c15c0 legacy=0x7f940c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.967+0000 7f940b400640 1 -- 172.21.15.32:0/1476582931 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c155430 con 0x7f940c06f5b0 2024-01-19T04:15:45.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f940b400640 1 --2- 172.21.15.32:0/1476582931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06f5b0 0x7f940c0c19a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f940c070ea0 tx=0x7f93f401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212ff708a347674c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f940aa00640 1 -- 172.21.15.32:0/1476582931 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40ab600 con 0x7f940c06f5b0 2024-01-19T04:15:45.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f940aa00640 1 -- 172.21.15.32:0/1476582931 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f40a7050 con 0x7f940c06f5b0 2024-01-19T04:15:45.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f940aa00640 1 -- 172.21.15.32:0/1476582931 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40ab980 con 0x7f940c06f5b0 2024-01-19T04:15:45.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 -- 172.21.15.32:0/1476582931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06f5b0 msgr2=0x7f940c0c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 --2- 172.21.15.32:0/1476582931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06f5b0 0x7f940c0c19a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f940c070ea0 tx=0x7f93f401c3d0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 -- 172.21.15.32:0/1476582931 shutdown_connections 2024-01-19T04:15:45.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 --2- 172.21.15.32:0/1476582931 >> v2:172.21.15.67:3300/0 conn(0x7f940c06ae10 0x7f940c151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 --2- 172.21.15.32:0/1476582931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06f5b0 0x7f940c0c19a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 -- 172.21.15.32:0/1476582931 >> 172.21.15.32:0/1476582931 conn(0x7f940c0c36c0 msgr2=0x7f940c0c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:45.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 -- 172.21.15.32:0/1476582931 shutdown_connections 2024-01-19T04:15:45.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 -- 172.21.15.32:0/1476582931 wait complete. 2024-01-19T04:15:45.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.971+0000 7f9412e00640 1 Processor -- start 2024-01-19T04:15:45.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 -- start start 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06ae10 0x7f940c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f940c06f5b0 0x7f940c1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f940c0c15c0 0x7f940c150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c1505c0 con 0x7f940c06ae10 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c1525a0 con 0x7f940c0c15c0 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c1f1920 con 0x7f940c06f5b0 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06ae10 0x7f940c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06ae10 0x7f940c148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49874/0 (socket says 172.21.15.32:49874) 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 -- 172.21.15.32:0/1701471880 learned_addr learned my addr 172.21.15.32:0/1701471880 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:45.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940b400640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f940c06f5b0 0x7f940c1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9410e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f940c0c15c0 0x7f940c150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 -- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f940c06f5b0 msgr2=0x7f940c1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f940c06f5b0 0x7f940c1492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 -- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f940c0c15c0 msgr2=0x7f940c150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f940c0c15c0 0x7f940c150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 -- 172.21.15.32:0/1701471880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4009420 con 0x7f940c06ae10 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9410e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f940c0c15c0 0x7f940c150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f940be00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06ae10 0x7f940c148da0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c420 tx=0x7f93fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9403e00640 1 -- 172.21.15.32:0/1701471880 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc005cf0 con 0x7f940c06ae10 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9403e00640 1 -- 172.21.15.32:0/1701471880 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc005e50 con 0x7f940c06ae10 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c0a5fd0 con 0x7f940c06ae10 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9403e00640 1 -- 172.21.15.32:0/1701471880 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0072f0 con 0x7f940c06ae10 2024-01-19T04:15:45.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c14f0d0 con 0x7f940c06ae10 2024-01-19T04:15:45.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.975+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940c04f1d0 con 0x7f940c06ae10 2024-01-19T04:15:45.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.979+0000 7f9403e00640 1 -- 172.21.15.32:0/1701471880 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f93fc007450 con 0x7f940c06ae10 2024-01-19T04:15:45.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.979+0000 7f9403e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e4066500 0x7f93e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:45.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.979+0000 7f9403e00640 1 -- 172.21.15.32:0/1701471880 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93fc083150 con 0x7f940c06ae10 2024-01-19T04:15:45.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.979+0000 7f940b400640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e4066500 0x7f93e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:45.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.979+0000 7f940b400640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e4066500 0x7f93e40689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ad000 tx=0x7f93f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:45.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:45.983+0000 7f9403e00640 1 -- 172.21.15.32:0/1701471880 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f93fc050730 con 0x7f940c06ae10 2024-01-19T04:15:46.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f940c152760 con 0x7f940c06ae10 2024-01-19T04:15:46.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9403e00640 1 -- 172.21.15.32:0/1701471880 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93fc0170a0 con 0x7f940c06ae10 2024-01-19T04:15:46.147 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e4066500 msgr2=0x7f93e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e4066500 0x7f93e40689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ad000 tx=0x7f93f4008040 comp rx=0 tx=0).stop 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06ae10 msgr2=0x7f940c148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06ae10 0x7f940c148da0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c420 tx=0x7f93fc00c8e0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 shutdown_connections 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f93e4066500 0x7f93e40689c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f940c0c15c0 0x7f940c150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f940c06f5b0 0x7f940c1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 --2- 172.21.15.32:0/1701471880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f940c06ae10 0x7f940c148da0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 >> 172.21.15.32:0/1701471880 conn(0x7f940c0c36c0 msgr2=0x7f940c0a7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:46.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 shutdown_connections 2024-01-19T04:15:46.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.143+0000 7f9412e00640 1 -- 172.21.15.32:0/1701471880 wait complete. 2024-01-19T04:15:46.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:15:46.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab3800640 1 Processor -- start 2024-01-19T04:15:46.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab3800640 1 -- start start 2024-01-19T04:15:46.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab3800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0c04a0 0x7f9aac0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab3800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9aac0a4ec0 0x7f9aac0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab3800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac071e80 con 0x7f9aac14fb50 2024-01-19T04:15:46.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab3800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac1535c0 con 0x7f9aac0a4ec0 2024-01-19T04:15:46.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab3800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0726c0 con 0x7f9aac0c04a0 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab1800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9aac0a4ec0 0x7f9aac0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab1800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9aac0a4ec0 0x7f9aac0c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49878/0 (socket says 172.21.15.32:49878) 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab1800640 1 -- 172.21.15.32:0/2048717247 learned_addr learned my addr 172.21.15.32:0/2048717247 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9aabe00640 1 --2- 172.21.15.32:0/2048717247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0c04a0 0x7f9aac0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab1800640 1 -- 172.21.15.32:0/2048717247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0c04a0 msgr2=0x7f9aac0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab1800640 1 --2- 172.21.15.32:0/2048717247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0c04a0 0x7f9aac0c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab1800640 1 -- 172.21.15.32:0/2048717247 >> v1:172.21.15.67:6789/0 conn(0x7f9aac14fb50 legacy=0x7f9aac06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.307+0000 7f9ab1800640 1 -- 172.21.15.32:0/2048717247 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0c1cb0 con 0x7f9aac0a4ec0 2024-01-19T04:15:46.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab1800640 1 --2- 172.21.15.32:0/2048717247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0a4ec0 0x7f9aac0c1770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009e80 tx=0x7f9aa401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6852e37c125fe919 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:46.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9aab400640 1 -- 172.21.15.32:0/2048717247 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a5620 con 0x7f9aac0a4ec0 2024-01-19T04:15:46.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9aab400640 1 -- 172.21.15.32:0/2048717247 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40a5780 con 0x7f9aac0a4ec0 2024-01-19T04:15:46.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9aab400640 1 -- 172.21.15.32:0/2048717247 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a5b10 con 0x7f9aac0a4ec0 2024-01-19T04:15:46.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 -- 172.21.15.32:0/2048717247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0a4ec0 msgr2=0x7f9aac0c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 --2- 172.21.15.32:0/2048717247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0a4ec0 0x7f9aac0c1770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009e80 tx=0x7f9aa401c960 comp rx=0 tx=0).stop 2024-01-19T04:15:46.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 -- 172.21.15.32:0/2048717247 shutdown_connections 2024-01-19T04:15:46.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 --2- 172.21.15.32:0/2048717247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0a4ec0 0x7f9aac0c1770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 --2- 172.21.15.32:0/2048717247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0c04a0 0x7f9aac0c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 -- 172.21.15.32:0/2048717247 >> 172.21.15.32:0/2048717247 conn(0x7f9aac0c5b20 msgr2=0x7f9aac0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:46.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 -- 172.21.15.32:0/2048717247 shutdown_connections 2024-01-19T04:15:46.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.311+0000 7f9ab3800640 1 -- 172.21.15.32:0/2048717247 wait complete. 2024-01-19T04:15:46.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 Processor -- start 2024-01-19T04:15:46.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 -- start start 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0a4ec0 0x7f9aac0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0c04a0 0x7f9aac153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac14fb50 0x7f9aac0c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac06d690 con 0x7f9aac0c04a0 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0a9ac0 con 0x7f9aac14fb50 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0a9500 con 0x7f9aac0a4ec0 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0c04a0 0x7f9aac153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0c04a0 0x7f9aac153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49888/0 (socket says 172.21.15.32:49888) 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 -- 172.21.15.32:0/4283684056 learned_addr learned my addr 172.21.15.32:0/4283684056 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab1800640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac14fb50 0x7f9aac0c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab0e00640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0a4ec0 0x7f9aac0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 -- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0a4ec0 msgr2=0x7f9aac0a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0a4ec0 0x7f9aac0a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 -- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac14fb50 msgr2=0x7f9aac0c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac14fb50 0x7f9aac0c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 -- 172.21.15.32:0/4283684056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa4009b30 con 0x7f9aac0c04a0 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aabe00640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0c04a0 0x7f9aac153920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400d800 tx=0x7f9a9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aa8c00640 1 -- 172.21.15.32:0/4283684056 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400b6c0 con 0x7f9aac0c04a0 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aa8c00640 1 -- 172.21.15.32:0/4283684056 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9400b820 con 0x7f9aac0c04a0 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac0a97e0 con 0x7f9aac0c04a0 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9aa8c00640 1 -- 172.21.15.32:0/4283684056 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400bb90 con 0x7f9aac0c04a0 2024-01-19T04:15:46.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.315+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac1ed160 con 0x7f9aac0c04a0 2024-01-19T04:15:46.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.319+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac1ed320 con 0x7f9aac0c04a0 2024-01-19T04:15:46.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.319+0000 7f9aa8c00640 1 -- 172.21.15.32:0/4283684056 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9a9400bcf0 con 0x7f9aac0c04a0 2024-01-19T04:15:46.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.319+0000 7f9aa8c00640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a84066500 0x7f9a840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.319+0000 7f9aa8c00640 1 -- 172.21.15.32:0/4283684056 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a94083f70 con 0x7f9aac0c04a0 2024-01-19T04:15:46.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.319+0000 7f9ab0e00640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a84066500 0x7f9a840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.319+0000 7f9ab0e00640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a84066500 0x7f9a840689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c001810 tx=0x7f9a9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:46.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.323+0000 7f9aa8c00640 1 -- 172.21.15.32:0/4283684056 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9a94051600 con 0x7f9aac0c04a0 2024-01-19T04:15:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9aac0749f0 con 0x7f9aac0c04a0 2024-01-19T04:15:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9aa8c00640 1 -- 172.21.15.32:0/4283684056 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9a94054c20 con 0x7f9aac0c04a0 2024-01-19T04:15:46.490 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:46.491 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-01-19T04:15:46.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:15:46.491 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-01-19T04:15:46.491 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-01-19T04:15:46.491 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:15:46.491 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a84066500 msgr2=0x7f9a840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a84066500 0x7f9a840689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c001810 tx=0x7f9a9c009040 comp rx=0 tx=0).stop 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0c04a0 msgr2=0x7f9aac153920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0c04a0 0x7f9aac153920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400d800 tx=0x7f9a9400dcc0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 shutdown_connections 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a84066500 0x7f9a840689c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9aac14fb50 0x7f9aac0c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9aac0c04a0 0x7f9aac153920 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 --2- 172.21.15.32:0/4283684056 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9aac0a4ec0 0x7f9aac0a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 >> 172.21.15.32:0/4283684056 conn(0x7f9aac0c5b20 msgr2=0x7f9aac14f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 shutdown_connections 2024-01-19T04:15:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.487+0000 7f9ab3800640 1 -- 172.21.15.32:0/4283684056 wait complete. 2024-01-19T04:15:46.513 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-19T04:15:46.513 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-19T04:15:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8eac00640 1 Processor -- start 2024-01-19T04:15:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8eac00640 1 -- start start 2024-01-19T04:15:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8eac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 0x7ff8e41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8eac00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8e4156720 0x7ff8e415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8eac00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e40a70d0 con 0x7ff8e40706d0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8eac00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e40a6df0 con 0x7ff8e4156720 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8eac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e4155c40 con 0x7ff8e40a72f0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff8e40706d0 0x7ff8e40c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59484/0 (socket says 172.21.15.32:59484) 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 -- 172.21.15.32:0/3645074040 learned_addr learned my addr 172.21.15.32:0/3645074040 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 0x7ff8e41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e8c00640 1 --2- 172.21.15.32:0/3645074040 >> v2:172.21.15.67:3300/0 conn(0x7ff8e4156720 0x7ff8e415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138749965 0 0) 0x7ff8e40a70d0 con 0x7ff8e40706d0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c4003530 con 0x7ff8e40706d0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861065545 0 0) 0x7ff8c4003530 con 0x7ff8e40706d0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 msgr2=0x7ff8e41525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 0x7ff8e41525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 >> v2:172.21.15.67:3300/0 conn(0x7ff8e4156720 msgr2=0x7ff8e415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 --2- 172.21.15.32:0/3645074040 >> v2:172.21.15.67:3300/0 conn(0x7ff8e4156720 0x7ff8e415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e4155f20 con 0x7ff8e40706d0 2024-01-19T04:15:46.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7ff8d4001680 con 0x7ff8e40706d0 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e8c00640 1 --2- 172.21.15.32:0/3645074040 >> v2:172.21.15.67:3300/0 conn(0x7ff8e4156720 0x7ff8e415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 >> v1:172.21.15.32:6789/0 conn(0x7ff8e40706d0 legacy=0x7ff8e40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8c4003980 0x7ff8c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8c40047d0 0x7ff8c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 0x7ff8c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40a6df0 con 0x7ff8c4003980 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e4155c40 con 0x7ff8c40047d0 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c400b9e0 con 0x7ff8e40a72f0 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8c4003980 0x7ff8c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8c40047d0 0x7ff8c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e8c00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 0x7ff8c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 -- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 msgr2=0x7ff8c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 0x7ff8c4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 -- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8c40047d0 msgr2=0x7ff8c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:46.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8c40047d0 0x7ff8c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3e00640 1 -- 172.21.15.32:0/3645074040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4003530 con 0x7ff8c4003980 2024-01-19T04:15:46.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e8c00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8e40a72f0 0x7ff8c4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:46.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.655+0000 7ff8e3400640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8c40047d0 0x7ff8c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:46.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8c4003980 0x7ff8c4003da0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400c1c0 tx=0x7ff8d401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6b3a51c9da9866 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:46.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40058e0 con 0x7ff8c4003980 2024-01-19T04:15:46.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4005a60 con 0x7ff8c4003980 2024-01-19T04:15:46.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8e2a00640 1 -- 172.21.15.32:0/3645074040 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4005e10 con 0x7ff8c4003980 2024-01-19T04:15:46.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8eac00640 1 -- 172.21.15.32:0/3645074040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8c4003980 msgr2=0x7ff8c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8eac00640 1 --2- 172.21.15.32:0/3645074040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8c4003980 0x7ff8c4003da0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400c1c0 tx=0x7ff8d401cc00 comp rx=0 tx=0).stop 2024-01-19T04:15:46.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8e8c00640 1 -- 172.21.15.32:0/3645074040 reap_dead start 2024-01-19T04:15:46.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8eac00640 1 -- 172.21.15.32:0/3645074040 shutdown_connections 2024-01-19T04:15:46.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8eac00640 1 -- 172.21.15.32:0/3645074040 >> 172.21.15.32:0/3645074040 conn(0x7ff8e40a99f0 msgr2=0x7ff8e40a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:46.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8eac00640 1 -- 172.21.15.32:0/3645074040 shutdown_connections 2024-01-19T04:15:46.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.659+0000 7ff8eac00640 1 -- 172.21.15.32:0/3645074040 wait complete. 2024-01-19T04:15:46.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 Processor -- start 2024-01-19T04:15:46.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 -- start start 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8c4003980 0x7ff8e40c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e406d480 0x7ff8e41edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8e41ee0c0 0x7ff8e41f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e41513e0 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e41f09a0 con 0x7ff8e406d480 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415cc00 con 0x7ff8c4003980 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8e41ee0c0 0x7ff8e41f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8e41ee0c0 0x7ff8e41f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49902/0 (socket says 172.21.15.32:49902) 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 -- 172.21.15.32:0/230409727 learned_addr learned my addr 172.21.15.32:0/230409727 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e3400640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e406d480 0x7ff8e41edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8c4003980 0x7ff8e40c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 -- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8c4003980 msgr2=0x7ff8e40c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8c4003980 0x7ff8e40c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 -- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e406d480 msgr2=0x7ff8e41edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e406d480 0x7ff8e41edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 -- 172.21.15.32:0/230409727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e4154b30 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e3400640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e406d480 0x7ff8e41edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8c4003980 0x7ff8e40c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8e8c00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8e41ee0c0 0x7ff8e41f0df0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4074600 tx=0x7ff8dc00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8dbe00640 1 -- 172.21.15.32:0/230409727 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc016620 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8dbe00640 1 -- 172.21.15.32:0/230409727 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc016780 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8dbe00640 1 -- 172.21.15.32:0/230409727 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc016b10 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.663+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e4154e10 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.667+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e40c1c70 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.667+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e4067c10 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.667+0000 7ff8dbe00640 1 -- 172.21.15.32:0/230409727 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff8dc016c70 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.667+0000 7ff8dbe00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8bc066500 0x7ff8bc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:46.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.667+0000 7ff8dbe00640 1 -- 172.21.15.32:0/230409727 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8dc0848f0 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.667+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8bc066500 0x7ff8bc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:46.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.671+0000 7ff8e3e00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8bc066500 0x7ff8bc0689c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40aa000 tx=0x7ff8d4001940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:46.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.671+0000 7ff8dbe00640 1 -- 172.21.15.32:0/230409727 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff8dc051ed0 con 0x7ff8e41ee0c0 2024-01-19T04:15:46.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:46.835+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff8e404e980 con 0x7ff8e41ee0c0 2024-01-19T04:15:47.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8dbe00640 1 -- 172.21.15.32:0/230409727 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff8dc0554f0 con 0x7ff8e41ee0c0 2024-01-19T04:15:47.627 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-01-19T04:15:47.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8bc066500 msgr2=0x7ff8bc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:47.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8bc066500 0x7ff8bc0689c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40aa000 tx=0x7ff8d4001940 comp rx=0 tx=0).stop 2024-01-19T04:15:47.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8e41ee0c0 msgr2=0x7ff8e41f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:47.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8e41ee0c0 0x7ff8e41f0df0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4074600 tx=0x7ff8dc00f810 comp rx=0 tx=0).stop 2024-01-19T04:15:47.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 shutdown_connections 2024-01-19T04:15:47.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff8bc066500 0x7ff8bc0689c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:47.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8e41ee0c0 0x7ff8e41f0df0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:47.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8e406d480 0x7ff8e41edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:47.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 --2- 172.21.15.32:0/230409727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff8c4003980 0x7ff8e40c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:47.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 >> 172.21.15.32:0/230409727 conn(0x7ff8e40a99f0 msgr2=0x7ff8e40a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:47.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 shutdown_connections 2024-01-19T04:15:47.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.627+0000 7ff8eac00640 1 -- 172.21.15.32:0/230409727 wait complete. 2024-01-19T04:15:47.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:15:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2212a00640 1 Processor -- start 2024-01-19T04:15:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2212a00640 1 -- start start 2024-01-19T04:15:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2212a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c06f5b0 0x7f220c0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2212a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c06a6a0 con 0x7f220c06ae10 2024-01-19T04:15:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2212a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c154e70 con 0x7f220c0c15c0 2024-01-19T04:15:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2212a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c155150 con 0x7f220c06f5b0 2024-01-19T04:15:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2210a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f220c06ae10 0x7f220c151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54858/0 (socket says 172.21.15.32:54858) 2024-01-19T04:15:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f2210a00640 1 -- 172.21.15.32:0/286833516 learned_addr learned my addr 172.21.15.32:0/286833516 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220b400640 1 --2- 172.21.15.32:0/286833516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c06f5b0 0x7f220c0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220aa00640 1 -- 172.21.15.32:0/286833516 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207552696 0 0) 0x7f220c06a6a0 con 0x7f220c06ae10 2024-01-19T04:15:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220aa00640 1 -- 172.21.15.32:0/286833516 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ec003530 con 0x7f220c06ae10 2024-01-19T04:15:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220aa00640 1 -- 172.21.15.32:0/286833516 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009541346 0 0) 0x7f220c154e70 con 0x7f220c0c15c0 2024-01-19T04:15:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220aa00640 1 -- 172.21.15.32:0/286833516 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f220c06a6a0 con 0x7f220c0c15c0 2024-01-19T04:15:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220b400640 1 -- 172.21.15.32:0/286833516 >> v1:172.21.15.67:6789/0 conn(0x7f220c0c15c0 legacy=0x7f220c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220b400640 1 -- 172.21.15.32:0/286833516 >> v1:172.21.15.32:6789/0 conn(0x7f220c06ae10 legacy=0x7f220c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.799+0000 7f220b400640 1 -- 172.21.15.32:0/286833516 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c155430 con 0x7f220c06f5b0 2024-01-19T04:15:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f220b400640 1 --2- 172.21.15.32:0/286833516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c06f5b0 0x7f220c0c19a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21f40097f0 tx=0x7f21f401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca4a82e61a88e879 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f220aa00640 1 -- 172.21.15.32:0/286833516 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40ab650 con 0x7f220c06f5b0 2024-01-19T04:15:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f220aa00640 1 -- 172.21.15.32:0/286833516 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f40ab7b0 con 0x7f220c06f5b0 2024-01-19T04:15:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f220aa00640 1 -- 172.21.15.32:0/286833516 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40abb40 con 0x7f220c06f5b0 2024-01-19T04:15:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f2212a00640 1 -- 172.21.15.32:0/286833516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c06f5b0 msgr2=0x7f220c0c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f2212a00640 1 --2- 172.21.15.32:0/286833516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c06f5b0 0x7f220c0c19a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21f40097f0 tx=0x7f21f401c430 comp rx=0 tx=0).stop 2024-01-19T04:15:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f2212a00640 1 -- 172.21.15.32:0/286833516 shutdown_connections 2024-01-19T04:15:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f2212a00640 1 --2- 172.21.15.32:0/286833516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c06f5b0 0x7f220c0c19a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f2212a00640 1 -- 172.21.15.32:0/286833516 >> 172.21.15.32:0/286833516 conn(0x7f220c0c36c0 msgr2=0x7f220c0c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f2212a00640 1 -- 172.21.15.32:0/286833516 shutdown_connections 2024-01-19T04:15:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.803+0000 7f2212a00640 1 -- 172.21.15.32:0/286833516 wait complete. 2024-01-19T04:15:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 Processor -- start 2024-01-19T04:15:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 -- start start 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f220c06ae10 0x7f220c0aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f220c06f5b0 0x7f220c14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c0c15c0 0x7f220c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c151480 con 0x7f220c06f5b0 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1ee190 con 0x7f220c06ae10 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c150b50 con 0x7f220c0c15c0 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f220c06f5b0 0x7f220c14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f220c06f5b0 0x7f220c14e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33528/0 (socket says 172.21.15.32:33528) 2024-01-19T04:15:47.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 -- 172.21.15.32:0/3163385842 learned_addr learned my addr 172.21.15.32:0/3163385842 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2210a00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c0c15c0 0x7f220c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220be00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f220c06ae10 0x7f220c0aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 -- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c0c15c0 msgr2=0x7f220c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c0c15c0 0x7f220c14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 -- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f220c06ae10 msgr2=0x7f220c0aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f220c06ae10 0x7f220c0aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 -- 172.21.15.32:0/3163385842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f4009420 con 0x7f220c06f5b0 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220be00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f220c06ae10 0x7f220c0aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:47.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f220b400640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f220c06f5b0 0x7f220c14e270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f21f4019040 tx=0x7f21f401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:47.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2203e00640 1 -- 172.21.15.32:0/3163385842 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40bf610 con 0x7f220c06f5b0 2024-01-19T04:15:47.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2203e00640 1 -- 172.21.15.32:0/3163385842 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f40bf790 con 0x7f220c06f5b0 2024-01-19T04:15:47.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2203e00640 1 -- 172.21.15.32:0/3163385842 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40bfb40 con 0x7f220c06f5b0 2024-01-19T04:15:47.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c150e30 con 0x7f220c06f5b0 2024-01-19T04:15:47.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.807+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0ab460 con 0x7f220c06f5b0 2024-01-19T04:15:47.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.811+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c0c6870 con 0x7f220c06f5b0 2024-01-19T04:15:47.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.811+0000 7f2203e00640 1 -- 172.21.15.32:0/3163385842 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f21f40b5400 con 0x7f220c06f5b0 2024-01-19T04:15:47.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.811+0000 7f2203e00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21e4066530 0x7f21e40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:47.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.811+0000 7f2203e00640 1 -- 172.21.15.32:0/3163385842 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f21f411ef00 con 0x7f220c06f5b0 2024-01-19T04:15:47.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.811+0000 7f220be00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21e4066530 0x7f21e40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:47.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.811+0000 7f220be00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21e4066530 0x7f21e40689f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f220c0a6870 tx=0x7f21fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:47.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.815+0000 7f2203e00640 1 -- 172.21.15.32:0/3163385842 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f21f40ec5a0 con 0x7f220c06f5b0 2024-01-19T04:15:47.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:47.975+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f220c04f1d0 con 0x7f220c06f5b0 2024-01-19T04:15:48.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.630+0000 7f2203e00640 1 -- 172.21.15.32:0/3163385842 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f21f40c40d0 con 0x7f220c06f5b0 2024-01-19T04:15:48.634 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-01-19T04:15:48.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21e4066530 msgr2=0x7f21e40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:48.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21e4066530 0x7f21e40689f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f220c0a6870 tx=0x7f21fc009040 comp rx=0 tx=0).stop 2024-01-19T04:15:48.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f220c06f5b0 msgr2=0x7f220c14e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:48.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f220c06f5b0 0x7f220c14e270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f21f4019040 tx=0x7f21f401ac70 comp rx=0 tx=0).stop 2024-01-19T04:15:48.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 shutdown_connections 2024-01-19T04:15:48.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21e4066530 0x7f21e40689f0 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f220c0a6870 tx=0x7f21fc009040 comp rx=0 tx=0).stop 2024-01-19T04:15:48.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f220c0c15c0 0x7f220c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f220c06f5b0 0x7f220c14e270 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 --2- 172.21.15.32:0/3163385842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f220c06ae10 0x7f220c0aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 >> 172.21.15.32:0/3163385842 conn(0x7f220c0c36c0 msgr2=0x7f220c0c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:48.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 shutdown_connections 2024-01-19T04:15:48.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.634+0000 7f2212a00640 1 -- 172.21.15.32:0/3163385842 wait complete. 2024-01-19T04:15:48.679 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-19T04:15:48.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7493a00640 1 Processor -- start 2024-01-19T04:15:48.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7493a00640 1 -- start start 2024-01-19T04:15:48.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7493a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c0c15c0 0x7f748c0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:48.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7493a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f748c06f5b0 0x7f748c154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:48.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7493a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c06a6a0 con 0x7f748c06ae10 2024-01-19T04:15:48.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7493a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c154bd0 con 0x7f748c06f5b0 2024-01-19T04:15:48.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7493a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c154e70 con 0x7f748c0c15c0 2024-01-19T04:15:48.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f748be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f748c06f5b0 0x7f748c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:48.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7491000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c0c15c0 0x7f748c0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:48.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7491000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c0c15c0 0x7f748c0c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:56704/0 (socket says 172.21.15.32:56704) 2024-01-19T04:15:48.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f748be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f748c06f5b0 0x7f748c154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:36288/0 (socket says 172.21.15.32:36288) 2024-01-19T04:15:48.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7491000640 1 -- 172.21.15.32:0/2985774726 learned_addr learned my addr 172.21.15.32:0/2985774726 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:48.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.822+0000 7f7491a00640 1 --1- 172.21.15.32:0/2985774726 >> v1:172.21.15.67:6789/0 conn(0x7f748c06ae10 0x7f748c151a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:40346/0 (socket says 172.21.15.32:40346) 2024-01-19T04:15:48.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f7491000640 1 -- 172.21.15.32:0/2985774726 >> v2:172.21.15.67:3300/0 conn(0x7f748c06f5b0 msgr2=0x7f748c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:48.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f7491000640 1 --2- 172.21.15.32:0/2985774726 >> v2:172.21.15.67:3300/0 conn(0x7f748c06f5b0 0x7f748c154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f7491000640 1 -- 172.21.15.32:0/2985774726 >> v1:172.21.15.67:6789/0 conn(0x7f748c06ae10 legacy=0x7f748c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:48.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f7491000640 1 -- 172.21.15.32:0/2985774726 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c155150 con 0x7f748c0c15c0 2024-01-19T04:15:48.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f748be00640 1 --2- 172.21.15.32:0/2985774726 >> v2:172.21.15.67:3300/0 conn(0x7f748c06f5b0 0x7f748c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:48.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f7491000640 1 --2- 172.21.15.32:0/2985774726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c0c15c0 0x7f748c0c19a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f747c009870 tx=0x7f747c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53649a1315ed9ea1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:48.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f748b400640 1 -- 172.21.15.32:0/2985774726 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0ac620 con 0x7f748c0c15c0 2024-01-19T04:15:48.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f748b400640 1 -- 172.21.15.32:0/2985774726 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c0ac780 con 0x7f748c0c15c0 2024-01-19T04:15:48.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.826+0000 7f748b400640 1 -- 172.21.15.32:0/2985774726 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0acb10 con 0x7f748c0c15c0 2024-01-19T04:15:48.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- 172.21.15.32:0/2985774726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c0c15c0 msgr2=0x7f748c0c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:48.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 --2- 172.21.15.32:0/2985774726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c0c15c0 0x7f748c0c19a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f747c009870 tx=0x7f747c01c4b0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- 172.21.15.32:0/2985774726 shutdown_connections 2024-01-19T04:15:48.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 --2- 172.21.15.32:0/2985774726 >> v2:172.21.15.67:3300/0 conn(0x7f748c06f5b0 0x7f748c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 --2- 172.21.15.32:0/2985774726 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c0c15c0 0x7f748c0c19a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- 172.21.15.32:0/2985774726 >> 172.21.15.32:0/2985774726 conn(0x7f748c0c36c0 msgr2=0x7f748c0c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:48.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- 172.21.15.32:0/2985774726 shutdown_connections 2024-01-19T04:15:48.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- 172.21.15.32:0/2985774726 wait complete. 2024-01-19T04:15:48.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 Processor -- start 2024-01-19T04:15:48.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- start start 2024-01-19T04:15:48.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f748c06ae10 0x7f748c1f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:48.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c06f5b0 0x7f748c1513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:48.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c0c15c0 0x7f748c1eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:48.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1ee800 con 0x7f748c0c15c0 2024-01-19T04:15:48.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f12c0 con 0x7f748c06ae10 2024-01-19T04:15:48.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7493a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0ab310 con 0x7f748c06f5b0 2024-01-19T04:15:48.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7491a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c0c15c0 0x7f748c1eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:48.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7491a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c0c15c0 0x7f748c1eec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33530/0 (socket says 172.21.15.32:33530) 2024-01-19T04:15:48.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7491a00640 1 -- 172.21.15.32:0/3284272394 learned_addr learned my addr 172.21.15.32:0/3284272394 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:48.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f7491000640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f748c06ae10 0x7f748c1f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:48.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f748be00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c06f5b0 0x7f748c1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.830+0000 7f748be00640 1 -- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f748c06ae10 msgr2=0x7f748c1f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f748be00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f748c06ae10 0x7f748c1f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f748be00640 1 -- 172.21.15.32:0/3284272394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c0c15c0 msgr2=0x7f748c1eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f748be00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c0c15c0 0x7f748c1eec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f748be00640 1 -- 172.21.15.32:0/3284272394 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009420 con 0x7f748c06f5b0 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7491a00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c0c15c0 0x7f748c1eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f748be00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c06f5b0 0x7f748c1513d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f747400e9e0 tx=0x7f747400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:48.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7488c00640 1 -- 172.21.15.32:0/3284272394 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400c9d0 con 0x7f748c06f5b0 2024-01-19T04:15:48.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7488c00640 1 -- 172.21.15.32:0/3284272394 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400cb30 con 0x7f748c06f5b0 2024-01-19T04:15:48.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7488c00640 1 -- 172.21.15.32:0/3284272394 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400cee0 con 0x7f748c06f5b0 2024-01-19T04:15:48.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c0094d0 con 0x7f748c06f5b0 2024-01-19T04:15:48.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c1ee420 con 0x7f748c06f5b0 2024-01-19T04:15:48.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c04f1d0 con 0x7f748c06f5b0 2024-01-19T04:15:48.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.834+0000 7f7488c00640 1 -- 172.21.15.32:0/3284272394 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f74740059a0 con 0x7f748c06f5b0 2024-01-19T04:15:48.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.838+0000 7f7488c00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7464066530 0x7f74640689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:48.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.838+0000 7f7488c00640 1 -- 172.21.15.32:0/3284272394 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7474084500 con 0x7f748c06f5b0 2024-01-19T04:15:48.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.838+0000 7f7491000640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7464066530 0x7f74640689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:48.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.838+0000 7f7491000640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7464066530 0x7f74640689f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f747c0ae000 tx=0x7f747c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:48.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:48.842+0000 7f7488c00640 1 -- 172.21.15.32:0/3284272394 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7474051a20 con 0x7f748c06f5b0 2024-01-19T04:15:49.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.034+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f748c067c10 con 0x7f748c06f5b0 2024-01-19T04:15:49.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.638+0000 7f7488c00640 1 -- 172.21.15.32:0/3284272394 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7474055040 con 0x7f748c06f5b0 2024-01-19T04:15:49.645 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 4 and data pool 5 2024-01-19T04:15:49.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7464066530 msgr2=0x7f74640689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:49.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7464066530 0x7f74640689f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f747c0ae000 tx=0x7f747c0a7000 comp rx=0 tx=0).stop 2024-01-19T04:15:49.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c06f5b0 msgr2=0x7f748c1513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:49.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c06f5b0 0x7f748c1513d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f747400e9e0 tx=0x7f747400eea0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 shutdown_connections 2024-01-19T04:15:49.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7464066530 0x7f74640689f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c0c15c0 0x7f748c1eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f748c06f5b0 0x7f748c1513d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 --2- 172.21.15.32:0/3284272394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f748c06ae10 0x7f748c1f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 >> 172.21.15.32:0/3284272394 conn(0x7f748c0c36c0 msgr2=0x7f748c0715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:49.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.650+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 shutdown_connections 2024-01-19T04:15:49.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.654+0000 7f7493a00640 1 -- 172.21.15.32:0/3284272394 wait complete. 2024-01-19T04:15:49.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:49.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ee00640 1 Processor -- start 2024-01-19T04:15:49.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ee00640 1 -- start start 2024-01-19T04:15:49.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ee00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f180c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:49.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ee00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f1806eb70 0x7f0f1806f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:49.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ee00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180c5b40 con 0x7f0f1806fda0 2024-01-19T04:15:49.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ee00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f181551e0 con 0x7f0f1806eb70 2024-01-19T04:15:49.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ee00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18155710 con 0x7f0f18151f30 2024-01-19T04:15:49.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f17400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0f1806fda0 0x7f0f180c4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54866/0 (socket says 172.21.15.32:54866) 2024-01-19T04:15:49.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f17400640 1 -- 172.21.15.32:0/561439991 learned_addr learned my addr 172.21.15.32:0/561439991 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:49.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ce00640 1 --2- 172.21.15.32:0/561439991 >> v2:172.21.15.32:3300/0 conn(0x7f0f1806eb70 0x7f0f1806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:49.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f17e00640 1 --2- 172.21.15.32:0/561439991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f180c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:49.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ce00640 1 -- 172.21.15.32:0/561439991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 msgr2=0x7f0f180c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:49.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ce00640 1 --2- 172.21.15.32:0/561439991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f180c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ce00640 1 -- 172.21.15.32:0/561439991 >> v1:172.21.15.32:6789/0 conn(0x7f0f1806fda0 legacy=0x7f0f180c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:49.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f16a00640 1 -- 172.21.15.32:0/561439991 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220694455 0 0) 0x7f0f180c5b40 con 0x7f0f1806fda0 2024-01-19T04:15:49.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.830+0000 7f0f1ce00640 1 -- 172.21.15.32:0/561439991 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180c3fa0 con 0x7f0f1806eb70 2024-01-19T04:15:49.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ce00640 1 --2- 172.21.15.32:0/561439991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806eb70 0x7f0f1806f000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009d90 tx=0x7f0f1001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fe10d59e143b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:49.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f16a00640 1 -- 172.21.15.32:0/561439991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100a5890 con 0x7f0f1806eb70 2024-01-19T04:15:49.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f16a00640 1 -- 172.21.15.32:0/561439991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f100a59f0 con 0x7f0f1806eb70 2024-01-19T04:15:49.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f16a00640 1 -- 172.21.15.32:0/561439991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100a5d80 con 0x7f0f1806eb70 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 -- 172.21.15.32:0/561439991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806eb70 msgr2=0x7f0f1806f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/561439991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806eb70 0x7f0f1806f000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009d90 tx=0x7f0f1001c8c0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 -- 172.21.15.32:0/561439991 shutdown_connections 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/561439991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806eb70 0x7f0f1806f000 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/561439991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f180c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 -- 172.21.15.32:0/561439991 >> 172.21.15.32:0/561439991 conn(0x7f0f180a9870 msgr2=0x7f0f180a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 -- 172.21.15.32:0/561439991 shutdown_connections 2024-01-19T04:15:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.834+0000 7f0f1ee00640 1 -- 172.21.15.32:0/561439991 wait complete. 2024-01-19T04:15:49.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 Processor -- start 2024-01-19T04:15:49.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 -- start start 2024-01-19T04:15:49.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1806eb70 0x7f0f180c00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:49.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806fda0 0x7f0f180bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:49.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f1814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:49.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181edda0 con 0x7f0f1806fda0 2024-01-19T04:15:49.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181ed160 con 0x7f0f1806eb70 2024-01-19T04:15:49.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c0620 con 0x7f0f18151f30 2024-01-19T04:15:49.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806fda0 0x7f0f180bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806fda0 0x7f0f180bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33552/0 (socket says 172.21.15.32:33552) 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 -- 172.21.15.32:0/1009021750 learned_addr learned my addr 172.21.15.32:0/1009021750 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17e00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1806eb70 0x7f0f180c00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ce00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f1814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 -- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 msgr2=0x7f0f1814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f1814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 -- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1806eb70 msgr2=0x7f0f180c00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1806eb70 0x7f0f180c00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 -- 172.21.15.32:0/1009021750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009a70 con 0x7f0f1806fda0 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17e00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1806eb70 0x7f0f180c00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:49.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f17400640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806fda0 0x7f0f180bef70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c4b0 tx=0x7f0f0000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:49.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f0fe00640 1 -- 172.21.15.32:0/1009021750 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f000074e0 con 0x7f0f1806fda0 2024-01-19T04:15:49.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f0fe00640 1 -- 172.21.15.32:0/1009021750 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f00007660 con 0x7f0f1806fda0 2024-01-19T04:15:49.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f181ed400 con 0x7f0f1806fda0 2024-01-19T04:15:49.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f0fe00640 1 -- 172.21.15.32:0/1009021750 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00004a30 con 0x7f0f1806fda0 2024-01-19T04:15:49.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.838+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f181ed9c0 con 0x7f0f1806fda0 2024-01-19T04:15:49.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.842+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f180749f0 con 0x7f0f1806fda0 2024-01-19T04:15:49.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.842+0000 7f0f0fe00640 1 -- 172.21.15.32:0/1009021750 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0f00004b90 con 0x7f0f1806fda0 2024-01-19T04:15:49.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.842+0000 7f0f0fe00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ef0066500 0x7f0ef00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:49.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.842+0000 7f0f0fe00640 1 -- 172.21.15.32:0/1009021750 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f000834a0 con 0x7f0f1806fda0 2024-01-19T04:15:49.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.842+0000 7f0f17e00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ef0066500 0x7f0ef00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:49.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.842+0000 7f0f17e00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ef0066500 0x7f0ef00689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009b10 tx=0x7f0f08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:49.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:49.846+0000 7f0f0fe00640 1 -- 172.21.15.32:0/1009021750 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0f00050760 con 0x7f0f1806fda0 2024-01-19T04:15:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.006+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f18067b80 con 0x7f0f1806fda0 2024-01-19T04:15:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.006+0000 7f0f0fe00640 1 -- 172.21.15.32:0/1009021750 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16487 (secure 0 0 0) 0x7f0f00053d80 con 0x7f0f1806fda0 2024-01-19T04:15:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:50.010 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":34,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:49.039422+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:50.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ef0066500 msgr2=0x7f0ef00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ef0066500 0x7f0ef00689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009b10 tx=0x7f0f08008040 comp rx=0 tx=0).stop 2024-01-19T04:15:50.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806fda0 msgr2=0x7f0f180bef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806fda0 0x7f0f180bef70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c4b0 tx=0x7f0f0000c970 comp rx=0 tx=0).stop 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 shutdown_connections 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ef0066500 0x7f0ef00689c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0f18151f30 0x7f0f1814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f1806fda0 0x7f0f180bef70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 --2- 172.21.15.32:0/1009021750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f1806eb70 0x7f0f180c00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 >> 172.21.15.32:0/1009021750 conn(0x7f0f180a9870 msgr2=0x7f0f181542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 shutdown_connections 2024-01-19T04:15:50.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.010+0000 7f0f1ee00640 1 -- 172.21.15.32:0/1009021750 wait complete. 2024-01-19T04:15:50.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:50.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f4181e00640 1 Processor -- start 2024-01-19T04:15:50.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f4181e00640 1 -- start start 2024-01-19T04:15:50.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f4181e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c0c55e0 0x7f417c151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f4181e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f417c0c18b0 0x7f417c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f4181e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c0c1d10 con 0x7f417c147f90 2024-01-19T04:15:50.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f4181e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c06c5c0 con 0x7f417c0c18b0 2024-01-19T04:15:50.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f4181e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0c0810 con 0x7f417c0c55e0 2024-01-19T04:15:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c0c55e0 0x7f417c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c0c55e0 0x7f417c151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:56732/0 (socket says 172.21.15.32:56732) 2024-01-19T04:15:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417a000640 1 -- 172.21.15.32:0/2631211099 learned_addr learned my addr 172.21.15.32:0/2631211099 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:50.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f417c0c18b0 0x7f417c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417aa00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f417c147f90 0x7f417c06beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:40360/0 (socket says 172.21.15.32:40360) 2024-01-19T04:15:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417b400640 1 -- 172.21.15.32:0/2631211099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c0c55e0 msgr2=0x7f417c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417b400640 1 --2- 172.21.15.32:0/2631211099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c0c55e0 0x7f417c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417b400640 1 -- 172.21.15.32:0/2631211099 >> v1:172.21.15.67:6789/0 conn(0x7f417c147f90 legacy=0x7f417c06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.174+0000 7f417b400640 1 -- 172.21.15.32:0/2631211099 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0c0af0 con 0x7f417c0c18b0 2024-01-19T04:15:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f417b400640 1 --2- 172.21.15.32:0/2631211099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 0x7f417c0a4d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4174009d90 tx=0x7f417401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51510ff3fc99d28a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4179600640 1 -- 172.21.15.32:0/2631211099 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740a5950 con 0x7f417c0c18b0 2024-01-19T04:15:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4179600640 1 -- 172.21.15.32:0/2631211099 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41740a5ab0 con 0x7f417c0c18b0 2024-01-19T04:15:50.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4179600640 1 -- 172.21.15.32:0/2631211099 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740a5e40 con 0x7f417c0c18b0 2024-01-19T04:15:50.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 -- 172.21.15.32:0/2631211099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 msgr2=0x7f417c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 --2- 172.21.15.32:0/2631211099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 0x7f417c0a4d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4174009d90 tx=0x7f417401c890 comp rx=0 tx=0).stop 2024-01-19T04:15:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 -- 172.21.15.32:0/2631211099 shutdown_connections 2024-01-19T04:15:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 --2- 172.21.15.32:0/2631211099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 0x7f417c0a4d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 --2- 172.21.15.32:0/2631211099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c0c55e0 0x7f417c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 -- 172.21.15.32:0/2631211099 >> 172.21.15.32:0/2631211099 conn(0x7f417c0c5b20 msgr2=0x7f417c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 -- 172.21.15.32:0/2631211099 shutdown_connections 2024-01-19T04:15:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.178+0000 7f4181e00640 1 -- 172.21.15.32:0/2631211099 wait complete. 2024-01-19T04:15:50.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 Processor -- start 2024-01-19T04:15:50.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 -- start start 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 0x7f417c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f417c0c55e0 0x7f417c144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c147f90 0x7f417c1452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0a8940 con 0x7f417c0c55e0 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0a8b90 con 0x7f417c0c18b0 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0a8e70 con 0x7f417c147f90 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f417c0c55e0 0x7f417c144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f417c0c55e0 0x7f417c144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33554/0 (socket says 172.21.15.32:33554) 2024-01-19T04:15:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 -- 172.21.15.32:0/3010832384 learned_addr learned my addr 172.21.15.32:0/3010832384 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417aa00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 0x7f417c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417b400640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c147f90 0x7f417c1452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 -- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c147f90 msgr2=0x7f417c1452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c147f90 0x7f417c1452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 -- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 msgr2=0x7f417c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 0x7f417c06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 -- 172.21.15.32:0/3010832384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009a70 con 0x7f417c0c55e0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f417a000640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f417c0c55e0 0x7f417c144d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f416400eb10 tx=0x7f416400d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4173400640 1 -- 172.21.15.32:0/3010832384 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164010440 con 0x7f417c0c55e0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4173400640 1 -- 172.21.15.32:0/3010832384 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41640105a0 con 0x7f417c0c55e0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c0a9150 con 0x7f417c0c55e0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4173400640 1 -- 172.21.15.32:0/3010832384 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164010910 con 0x7f417c0c55e0 2024-01-19T04:15:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.182+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c0bf2b0 con 0x7f417c0c55e0 2024-01-19T04:15:50.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.186+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c0749f0 con 0x7f417c0c55e0 2024-01-19T04:15:50.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.186+0000 7f4173400640 1 -- 172.21.15.32:0/3010832384 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4164010a70 con 0x7f417c0c55e0 2024-01-19T04:15:50.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.186+0000 7f4173400640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4154066500 0x7f41540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.186+0000 7f4173400640 1 -- 172.21.15.32:0/3010832384 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41640846d0 con 0x7f417c0c55e0 2024-01-19T04:15:50.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.186+0000 7f417aa00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4154066500 0x7f41540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.186+0000 7f417aa00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4154066500 0x7f41540689c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f416c000f70 tx=0x7f416c007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.190+0000 7f4173400640 1 -- 172.21.15.32:0/3010832384 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4164051a10 con 0x7f417c0c55e0 2024-01-19T04:15:50.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.350+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f417c0c21d0 con 0x7f417c0c55e0 2024-01-19T04:15:50.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.350+0000 7f4173400640 1 -- 172.21.15.32:0/3010832384 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16487 (secure 0 0 0) 0x7f4164055030 con 0x7f417c0c55e0 2024-01-19T04:15:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:50.353 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":34,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:49.039422+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4154066500 msgr2=0x7f41540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4154066500 0x7f41540689c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f416c000f70 tx=0x7f416c007e90 comp rx=0 tx=0).stop 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f417c0c55e0 msgr2=0x7f417c144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f417c0c55e0 0x7f417c144d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f416400eb10 tx=0x7f416400d350 comp rx=0 tx=0).stop 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 shutdown_connections 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4154066500 0x7f41540689c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f417c147f90 0x7f417c1452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f417c0c55e0 0x7f417c144d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 --2- 172.21.15.32:0/3010832384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f417c0c18b0 0x7f417c06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 >> 172.21.15.32:0/3010832384 conn(0x7f417c0c5b20 msgr2=0x7f417c14f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:50.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 shutdown_connections 2024-01-19T04:15:50.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.354+0000 7f4181e00640 1 -- 172.21.15.32:0/3010832384 wait complete. 2024-01-19T04:15:50.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-19T04:15:50.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c9e600640 1 Processor -- start 2024-01-19T04:15:50.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c9e600640 1 -- start start 2024-01-19T04:15:50.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c9e600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c980723b0 0x7f6c98152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c9e600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980a4ea0 con 0x7f6c9806d440 2024-01-19T04:15:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c9e600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c98152a20 con 0x7f6c980c2080 2024-01-19T04:15:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c9e600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c981524a0 con 0x7f6c980723b0 2024-01-19T04:15:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c97e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6c9806d440 0x7f6c980c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54878/0 (socket says 172.21.15.32:54878) 2024-01-19T04:15:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c97e00640 1 -- 172.21.15.32:0/1472335964 learned_addr learned my addr 172.21.15.32:0/1472335964 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c97400640 1 --2- 172.21.15.32:0/1472335964 >> v2:172.21.15.67:3300/0 conn(0x7f6c980723b0 0x7f6c98152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c96000640 1 -- 172.21.15.32:0/1472335964 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420003059 0 0) 0x7f6c980a4ea0 con 0x7f6c9806d440 2024-01-19T04:15:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c96000640 1 -- 172.21.15.32:0/1472335964 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c78003530 con 0x7f6c9806d440 2024-01-19T04:15:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c96000640 1 -- 172.21.15.32:0/1472335964 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323511676 0 0) 0x7f6c98152a20 con 0x7f6c980c2080 2024-01-19T04:15:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c96000640 1 -- 172.21.15.32:0/1472335964 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c980a4ea0 con 0x7f6c980c2080 2024-01-19T04:15:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c97400640 1 -- 172.21.15.32:0/1472335964 >> v1:172.21.15.67:6789/0 conn(0x7f6c980c2080 legacy=0x7f6c98155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c97400640 1 -- 172.21.15.32:0/1472335964 >> v1:172.21.15.32:6789/0 conn(0x7f6c9806d440 legacy=0x7f6c980c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.518+0000 7f6c97400640 1 -- 172.21.15.32:0/1472335964 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c981533f0 con 0x7f6c980723b0 2024-01-19T04:15:50.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c97400640 1 --2- 172.21.15.32:0/1472335964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c980723b0 0x7f6c98152eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6c880097c0 tx=0x7f6c8801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9a3b41bae7fd3d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:50.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c96000640 1 -- 172.21.15.32:0/1472335964 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880ad660 con 0x7f6c980723b0 2024-01-19T04:15:50.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c96000640 1 -- 172.21.15.32:0/1472335964 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c880ad7c0 con 0x7f6c980723b0 2024-01-19T04:15:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c96000640 1 -- 172.21.15.32:0/1472335964 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880adb50 con 0x7f6c980723b0 2024-01-19T04:15:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c9e600640 1 -- 172.21.15.32:0/1472335964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c980723b0 msgr2=0x7f6c98152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c9e600640 1 --2- 172.21.15.32:0/1472335964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c980723b0 0x7f6c98152eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6c880097c0 tx=0x7f6c8801c360 comp rx=0 tx=0).stop 2024-01-19T04:15:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c9e600640 1 -- 172.21.15.32:0/1472335964 shutdown_connections 2024-01-19T04:15:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c9e600640 1 --2- 172.21.15.32:0/1472335964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c980723b0 0x7f6c98152eb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c9e600640 1 -- 172.21.15.32:0/1472335964 >> 172.21.15.32:0/1472335964 conn(0x7f6c980c25a0 msgr2=0x7f6c980c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c9e600640 1 -- 172.21.15.32:0/1472335964 shutdown_connections 2024-01-19T04:15:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.522+0000 7f6c9e600640 1 -- 172.21.15.32:0/1472335964 wait complete. 2024-01-19T04:15:50.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 Processor -- start 2024-01-19T04:15:50.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 -- start start 2024-01-19T04:15:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c9806d440 0x7f6c98144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c980723b0 0x7f6c980beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c980c2080 0x7f6c980bf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98153940 con 0x7f6c980c2080 2024-01-19T04:15:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98154d00 con 0x7f6c9806d440 2024-01-19T04:15:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98070470 con 0x7f6c980723b0 2024-01-19T04:15:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c980c2080 0x7f6c980bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c9806d440 0x7f6c98144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c980c2080 0x7f6c980bf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33568/0 (socket says 172.21.15.32:33568) 2024-01-19T04:15:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 -- 172.21.15.32:0/313309925 learned_addr learned my addr 172.21.15.32:0/313309925 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c96a00640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c980723b0 0x7f6c980beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 -- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c980723b0 msgr2=0x7f6c980beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c980723b0 0x7f6c980beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 -- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c9806d440 msgr2=0x7f6c98144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:50.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c9806d440 0x7f6c98144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:50.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 -- 172.21.15.32:0/313309925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88009420 con 0x7f6c980c2080 2024-01-19T04:15:50.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c97e00640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c980c2080 0x7f6c980bf410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000caa0 tx=0x7f6c9000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:50.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c8f400640 1 -- 172.21.15.32:0/313309925 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000ac00 con 0x7f6c980c2080 2024-01-19T04:15:50.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c8f400640 1 -- 172.21.15.32:0/313309925 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9000ad80 con 0x7f6c980c2080 2024-01-19T04:15:50.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c8f400640 1 -- 172.21.15.32:0/313309925 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90012640 con 0x7f6c980c2080 2024-01-19T04:15:50.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9806ff40 con 0x7f6c980c2080 2024-01-19T04:15:50.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.526+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98155580 con 0x7f6c980c2080 2024-01-19T04:15:50.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.530+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98155710 con 0x7f6c980c2080 2024-01-19T04:15:50.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.530+0000 7f6c8f400640 1 -- 172.21.15.32:0/313309925 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6c90007070 con 0x7f6c980c2080 2024-01-19T04:15:50.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.530+0000 7f6c8f400640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c70066500 0x7f6c700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:50.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.530+0000 7f6c8f400640 1 -- 172.21.15.32:0/313309925 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c90083de0 con 0x7f6c980c2080 2024-01-19T04:15:50.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.530+0000 7f6c97400640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c70066500 0x7f6c700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:50.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.530+0000 7f6c97400640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c70066500 0x7f6c700689c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c880af000 tx=0x7f6c88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:50.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.534+0000 7f6c8f400640 1 -- 172.21.15.32:0/313309925 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6c90051090 con 0x7f6c980c2080 2024-01-19T04:15:50.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:50.734+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6c980749f0 con 0x7f6c980c2080 2024-01-19T04:15:51.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.658+0000 7f6c8f400640 1 -- 172.21.15.32:0/313309925 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6c900170b0 con 0x7f6c980c2080 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c70066500 msgr2=0x7f6c700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c70066500 0x7f6c700689c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c880af000 tx=0x7f6c88008040 comp rx=0 tx=0).stop 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c980c2080 msgr2=0x7f6c980bf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c980c2080 0x7f6c980bf410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000caa0 tx=0x7f6c9000cf60 comp rx=0 tx=0).stop 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 shutdown_connections 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c70066500 0x7f6c700689c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c980c2080 0x7f6c980bf410 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c980723b0 0x7f6c980beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 --2- 172.21.15.32:0/313309925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c9806d440 0x7f6c98144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 >> 172.21.15.32:0/313309925 conn(0x7f6c980c25a0 msgr2=0x7f6c98150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:51.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 shutdown_connections 2024-01-19T04:15:51.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.662+0000 7f6c9e600640 1 -- 172.21.15.32:0/313309925 wait complete. 2024-01-19T04:15:51.689 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T04:15:51.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-19T04:15:51.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad6c00640 1 Processor -- start 2024-01-19T04:15:51.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad6c00640 1 -- start start 2024-01-19T04:15:51.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad6c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ad0151b80 0x7f0ad0155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:51.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad6c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad00c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:51.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad6c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad00c2d30 con 0x7f0ad0157cc0 2024-01-19T04:15:51.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad6c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00c34a0 con 0x7f0ad0151b80 2024-01-19T04:15:51.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad6c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0155730 con 0x7f0ad00c6360 2024-01-19T04:15:51.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acfe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ad0151b80 0x7f0ad0155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:51.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad4c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad00c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad4c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad00c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:56744/0 (socket says 172.21.15.32:56744) 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acf400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0ad0157cc0 0x7f0ad00c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:40378/0 (socket says 172.21.15.32:40378) 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acfe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ad0151b80 0x7f0ad0155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:36336/0 (socket says 172.21.15.32:36336) 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad4c00640 1 -- 172.21.15.32:0/2860917247 learned_addr learned my addr 172.21.15.32:0/2860917247 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acfe00640 1 -- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 msgr2=0x7f0ad00c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acfe00640 1 --2- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad00c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acfe00640 1 -- 172.21.15.32:0/2860917247 >> v1:172.21.15.67:6789/0 conn(0x7f0ad0157cc0 legacy=0x7f0ad00c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acfe00640 1 -- 172.21.15.32:0/2860917247 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00c3010 con 0x7f0ad0151b80 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0ad4c00640 1 --2- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad00c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:51.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.838+0000 7f0acea00640 1 -- 172.21.15.32:0/2860917247 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227987847 0 0) 0x7f0ad00c2d30 con 0x7f0ad0157cc0 2024-01-19T04:15:51.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0acfe00640 1 --2- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad0155150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00097c0 tx=0x7f0ac001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ebb95009f7a5f88 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:51.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0acea00640 1 -- 172.21.15.32:0/2860917247 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00ad660 con 0x7f0ad0151b80 2024-01-19T04:15:51.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0acea00640 1 -- 172.21.15.32:0/2860917247 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac00ad7c0 con 0x7f0ad0151b80 2024-01-19T04:15:51.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0acea00640 1 -- 172.21.15.32:0/2860917247 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00adb50 con 0x7f0ad0151b80 2024-01-19T04:15:51.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 -- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 msgr2=0x7f0ad0155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:51.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad0155150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00097c0 tx=0x7f0ac001c450 comp rx=0 tx=0).stop 2024-01-19T04:15:51.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 -- 172.21.15.32:0/2860917247 shutdown_connections 2024-01-19T04:15:51.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad00c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/2860917247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad0155150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 -- 172.21.15.32:0/2860917247 >> 172.21.15.32:0/2860917247 conn(0x7f0ad00c7d40 msgr2=0x7f0ad00c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:51.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 -- 172.21.15.32:0/2860917247 shutdown_connections 2024-01-19T04:15:51.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.842+0000 7f0ad6c00640 1 -- 172.21.15.32:0/2860917247 wait complete. 2024-01-19T04:15:51.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 Processor -- start 2024-01-19T04:15:51.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 -- start start 2024-01-19T04:15:51.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:51.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad00ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:51.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ad0157cc0 0x7f0ad0146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:51.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad01527e0 con 0x7f0ad0157cc0 2024-01-19T04:15:51.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad01f0bb0 con 0x7f0ad0151b80 2024-01-19T04:15:51.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad01f0e90 con 0x7f0ad00c6360 2024-01-19T04:15:51.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ad0157cc0 0x7f0ad0146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ad0157cc0 0x7f0ad0146360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33574/0 (socket says 172.21.15.32:33574) 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 -- 172.21.15.32:0/3611105026 learned_addr learned my addr 172.21.15.32:0/3611105026 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0acf400640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad00ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 -- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 msgr2=0x7f0ad01573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0acfe00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad01573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 -- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 msgr2=0x7f0ad00ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad00ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 -- 172.21.15.32:0/3611105026 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8009b30 con 0x7f0ad0157cc0 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0acf400640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad00ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0acfe00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad01573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad4c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ad0157cc0 0x7f0ad0146360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800efc0 tx=0x7f0ac800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ac7e00640 1 -- 172.21.15.32:0/3611105026 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8018070 con 0x7f0ad0157cc0 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ac7e00640 1 -- 172.21.15.32:0/3611105026 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac800f040 con 0x7f0ad0157cc0 2024-01-19T04:15:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ac7e00640 1 -- 172.21.15.32:0/3611105026 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800ce00 con 0x7f0ad0157cc0 2024-01-19T04:15:51.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac0009420 con 0x7f0ad0157cc0 2024-01-19T04:15:51.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.846+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad0152d10 con 0x7f0ad0157cc0 2024-01-19T04:15:51.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.850+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad01f1050 con 0x7f0ad0157cc0 2024-01-19T04:15:51.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.850+0000 7f0ac7e00640 1 -- 172.21.15.32:0/3611105026 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0ac8014480 con 0x7f0ad0157cc0 2024-01-19T04:15:51.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.850+0000 7f0ac7e00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0aa8066500 0x7f0aa80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:51.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.850+0000 7f0ac7e00640 1 -- 172.21.15.32:0/3611105026 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ac8084170 con 0x7f0ad0157cc0 2024-01-19T04:15:51.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.850+0000 7f0acfe00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0aa8066500 0x7f0aa80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:51.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.850+0000 7f0acfe00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0aa8066500 0x7f0aa80689c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00af000 tx=0x7f0ac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:51.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:51.854+0000 7f0ac7e00640 1 -- 172.21.15.32:0/3611105026 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0ad01f1050 con 0x7f0ad0157cc0 2024-01-19T04:15:52.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.050+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ad01f1050 con 0x7f0ad0157cc0 2024-01-19T04:15:52.189 INFO:tasks.ceph.mds.a.smithi032.stderr:2024-01-19T04:15:52.186+0000 7f3ac1e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:15:52.271 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:15:52.274 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:15:52.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.666+0000 7f0ac7e00640 1 -- 172.21.15.32:0/3611105026 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ad01f1050 con 0x7f0ad0157cc0 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0aa8066500 msgr2=0x7f0aa80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0aa8066500 0x7f0aa80689c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00af000 tx=0x7f0ac0008040 comp rx=0 tx=0).stop 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ad0157cc0 msgr2=0x7f0ad0146360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ad0157cc0 0x7f0ad0146360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800efc0 tx=0x7f0ac800c490 comp rx=0 tx=0).stop 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 shutdown_connections 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0aa8066500 0x7f0aa80689c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ad0157cc0 0x7f0ad0146360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad0151b80 0x7f0ad00ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 --2- 172.21.15.32:0/3611105026 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ad00c6360 0x7f0ad01573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 >> 172.21.15.32:0/3611105026 conn(0x7f0ad00c7d40 msgr2=0x7f0ad014db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 shutdown_connections 2024-01-19T04:15:52.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.670+0000 7f0ad6c00640 1 -- 172.21.15.32:0/3611105026 wait complete. 2024-01-19T04:15:52.695 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-19T04:15:52.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:52.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b15c00640 1 Processor -- start 2024-01-19T04:15:52.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b15c00640 1 -- start start 2024-01-19T04:15:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b15c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b1014fb50 0x7f3b1006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b15c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b15c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b10071e80 con 0x7f3b100c04a0 2024-01-19T04:15:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b15c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b101535c0 con 0x7f3b1014fb50 2024-01-19T04:15:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b15c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b100726c0 con 0x7f3b100a4ec0 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b1014fb50 0x7f3b1006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:56750/0 (socket says 172.21.15.32:56750) 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0f400640 1 -- 172.21.15.32:0/2566835901 learned_addr learned my addr 172.21.15.32:0/2566835901 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0e000640 1 --1- 172.21.15.32:0/2566835901 >> v1:172.21.15.67:6789/0 conn(0x7f3b100c04a0 0x7f3b100c1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:40384/0 (socket says 172.21.15.32:40384) 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0f400640 1 -- 172.21.15.32:0/2566835901 >> v2:172.21.15.67:3300/0 conn(0x7f3b1014fb50 msgr2=0x7f3b1006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0f400640 1 --2- 172.21.15.32:0/2566835901 >> v2:172.21.15.67:3300/0 conn(0x7f3b1014fb50 0x7f3b1006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0f400640 1 -- 172.21.15.32:0/2566835901 >> v1:172.21.15.67:6789/0 conn(0x7f3b100c04a0 legacy=0x7f3b100c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.838+0000 7f3b0f400640 1 -- 172.21.15.32:0/2566835901 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b100c0a20 con 0x7f3b100a4ec0 2024-01-19T04:15:52.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b0f400640 1 --2- 172.21.15.32:0/2566835901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1015cf00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009e50 tx=0x7f3b0801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b1686eefbabafa server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:52.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b0d600640 1 -- 172.21.15.32:0/2566835901 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080a5640 con 0x7f3b100a4ec0 2024-01-19T04:15:52.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b0d600640 1 -- 172.21.15.32:0/2566835901 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b080a57a0 con 0x7f3b100a4ec0 2024-01-19T04:15:52.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b0d600640 1 -- 172.21.15.32:0/2566835901 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080a5b30 con 0x7f3b100a4ec0 2024-01-19T04:15:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 -- 172.21.15.32:0/2566835901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 msgr2=0x7f3b1015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2566835901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1015cf00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009e50 tx=0x7f3b0801c980 comp rx=0 tx=0).stop 2024-01-19T04:15:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 -- 172.21.15.32:0/2566835901 shutdown_connections 2024-01-19T04:15:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2566835901 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1015cf00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2566835901 >> v2:172.21.15.67:3300/0 conn(0x7f3b1014fb50 0x7f3b1006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 -- 172.21.15.32:0/2566835901 >> 172.21.15.32:0/2566835901 conn(0x7f3b100c5b20 msgr2=0x7f3b100c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 -- 172.21.15.32:0/2566835901 shutdown_connections 2024-01-19T04:15:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.842+0000 7f3b15c00640 1 -- 172.21.15.32:0/2566835901 wait complete. 2024-01-19T04:15:52.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 Processor -- start 2024-01-19T04:15:52.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 -- start start 2024-01-19T04:15:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b100c04a0 0x7f3b101f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b1014fb50 0x7f3b101f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b10147d00 con 0x7f3b100c04a0 2024-01-19T04:15:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b100a8ea0 con 0x7f3b1014fb50 2024-01-19T04:15:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b101483c0 con 0x7f3b100a4ec0 2024-01-19T04:15:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b100c04a0 0x7f3b101f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b100c04a0 0x7f3b101f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33584/0 (socket says 172.21.15.32:33584) 2024-01-19T04:15:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 -- 172.21.15.32:0/2722675507 learned_addr learned my addr 172.21.15.32:0/2722675507 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0ea00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0f400640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b1014fb50 0x7f3b101f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 -- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 msgr2=0x7f3b1006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 -- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b1014fb50 msgr2=0x7f3b101f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b1014fb50 0x7f3b101f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 -- 172.21.15.32:0/2722675507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08009b30 con 0x7f3b100c04a0 2024-01-19T04:15:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0f400640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b1014fb50 0x7f3b101f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b0e000640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b100c04a0 0x7f3b101f1370 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c420 tx=0x7f3af800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b06a00640 1 -- 172.21.15.32:0/2722675507 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80074e0 con 0x7f3b100c04a0 2024-01-19T04:15:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b06a00640 1 -- 172.21.15.32:0/2722675507 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8007640 con 0x7f3b100c04a0 2024-01-19T04:15:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b101477d0 con 0x7f3b100c04a0 2024-01-19T04:15:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b06a00640 1 -- 172.21.15.32:0/2722675507 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8004a30 con 0x7f3b100c04a0 2024-01-19T04:15:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.846+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b10148050 con 0x7f3b100c04a0 2024-01-19T04:15:52.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.850+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b10148570 con 0x7f3b100c04a0 2024-01-19T04:15:52.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.850+0000 7f3b06a00640 1 -- 172.21.15.32:0/2722675507 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3af8004b90 con 0x7f3b100c04a0 2024-01-19T04:15:52.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.850+0000 7f3b06a00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ae8066500 0x7f3ae80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.850+0000 7f3b06a00640 1 -- 172.21.15.32:0/2722675507 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3af8083930 con 0x7f3b100c04a0 2024-01-19T04:15:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.850+0000 7f3b0ea00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ae8066500 0x7f3ae80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.850+0000 7f3b0ea00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ae8066500 0x7f3ae80689c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b10149d00 tx=0x7f3b00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:52.854+0000 7f3b06a00640 1 -- 172.21.15.32:0/2722675507 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3b10148570 con 0x7f3b100c04a0 2024-01-19T04:15:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b10148570 con 0x7f3b100c04a0 2024-01-19T04:15:53.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b06a00640 1 -- 172.21.15.32:0/2722675507 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f3b10148570 con 0x7f3b100c04a0 2024-01-19T04:15:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:53.047 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:49.039759+0000","modified":"2024-01-19T04:15:52.052125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6835/884465323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":884465323},{"type":"v1","addr":"172.21.15.32:6835","nonce":884465323}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T04:15:53.047 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 16 2024-01-19T04:15:53.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ae8066500 msgr2=0x7f3ae80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ae8066500 0x7f3ae80689c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b10149d00 tx=0x7f3b00008040 comp rx=0 tx=0).stop 2024-01-19T04:15:53.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b100c04a0 msgr2=0x7f3b101f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b100c04a0 0x7f3b101f1370 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c420 tx=0x7f3af800c8e0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 shutdown_connections 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3ae8066500 0x7f3ae80689c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b1014fb50 0x7f3b101f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b100c04a0 0x7f3b101f1370 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 --2- 172.21.15.32:0/2722675507 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3b100a4ec0 0x7f3b1006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 >> 172.21.15.32:0/2722675507 conn(0x7f3b100c5b20 msgr2=0x7f3b10151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 shutdown_connections 2024-01-19T04:15:53.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.046+0000 7f3b15c00640 1 -- 172.21.15.32:0/2722675507 wait complete. 2024-01-19T04:15:53.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:15:53.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.210+0000 7f9cd8000640 1 Processor -- start 2024-01-19T04:15:53.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.210+0000 7f9cd8000640 1 -- start start 2024-01-19T04:15:53.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd8000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9cd014fb50 0x7f9cd006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd8000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd0071e80 con 0x7f9cd00a4ec0 2024-01-19T04:15:53.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd8000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd00726c0 con 0x7f9cd00c04a0 2024-01-19T04:15:53.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd8000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd01535c0 con 0x7f9cd014fb50 2024-01-19T04:15:53.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd6000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9cd00a4ec0 0x7f9cd015cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54890/0 (socket says 172.21.15.32:54890) 2024-01-19T04:15:53.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd6000640 1 -- 172.21.15.32:0/823529761 learned_addr learned my addr 172.21.15.32:0/823529761 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:53.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd5600640 1 --2- 172.21.15.32:0/823529761 >> v2:172.21.15.67:3300/0 conn(0x7f9cd014fb50 0x7f9cd006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251604396 0 0) 0x7f9cd0071e80 con 0x7f9cd00a4ec0 2024-01-19T04:15:53.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb0003530 con 0x7f9cd00a4ec0 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348986797 0 0) 0x7f9cb0003530 con 0x7f9cd00a4ec0 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 >> v2:172.21.15.67:3300/0 conn(0x7f9cd014fb50 msgr2=0x7f9cd006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 --2- 172.21.15.32:0/823529761 >> v2:172.21.15.67:3300/0 conn(0x7f9cd014fb50 0x7f9cd006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 >> v1:172.21.15.67:6789/0 conn(0x7f9cd00c04a0 legacy=0x7f9cd00c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00c0a20 con 0x7f9cd00a4ec0 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f9cc8001a00 con 0x7f9cd00a4ec0 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 >> v1:172.21.15.32:6789/0 conn(0x7f9cd00a4ec0 legacy=0x7f9cd015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0003980 0x7f9cb0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb0004380 0x7f9cb0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cb00050f0 0x7f9cb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd01535c0 con 0x7f9cb0004380 2024-01-19T04:15:53.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb000c030 con 0x7f9cb00050f0 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb000c1f0 con 0x7f9cb0003980 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd4c00640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb0004380 0x7f9cb0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd6000640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cb00050f0 0x7f9cb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd5600640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0003980 0x7f9cb0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd4c00640 1 -- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0003980 msgr2=0x7f9cb0003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd4c00640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0003980 0x7f9cb0003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd4c00640 1 -- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cb00050f0 msgr2=0x7f9cb000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd4c00640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cb00050f0 0x7f9cb000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd4c00640 1 -- 172.21.15.32:0/823529761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0003530 con 0x7f9cb0004380 2024-01-19T04:15:53.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.214+0000 7f9cd6000640 1 -- 172.21.15.32:0/823529761 reap_dead start 2024-01-19T04:15:53.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd4c00640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb0004380 0x7f9cb0004850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8001910 tx=0x7f9cb801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b76d82e4106b44 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80a88b0 con 0x7f9cb0004380 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb80a8a30 con 0x7f9cb0004380 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9ccfe00640 1 -- 172.21.15.32:0/823529761 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80a8de0 con 0x7f9cb0004380 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd8000640 1 -- 172.21.15.32:0/823529761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb0004380 msgr2=0x7f9cb0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd8000640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb0004380 0x7f9cb0004850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8001910 tx=0x7f9cb801ec90 comp rx=0 tx=0).stop 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd8000640 1 -- 172.21.15.32:0/823529761 shutdown_connections 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd8000640 1 --2- 172.21.15.32:0/823529761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb0004380 0x7f9cb0004850 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd8000640 1 -- 172.21.15.32:0/823529761 >> 172.21.15.32:0/823529761 conn(0x7f9cd00c5b20 msgr2=0x7f9cd00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd8000640 1 -- 172.21.15.32:0/823529761 shutdown_connections 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.218+0000 7f9cd8000640 1 -- 172.21.15.32:0/823529761 wait complete. 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 Processor -- start 2024-01-19T04:15:53.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 -- start start 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0004380 0x7f9cd01ea600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cd014c920 0x7f9cd00a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cd00a64a0 0x7f9cd00ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd01561b0 con 0x7f9cd014c920 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00a5ad0 con 0x7f9cd00a64a0 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd01eab40 con 0x7f9cb0004380 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cd014c920 0x7f9cd00a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cd014c920 0x7f9cd00a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33600/0 (socket says 172.21.15.32:33600) 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 -- 172.21.15.32:0/2380198849 learned_addr learned my addr 172.21.15.32:0/2380198849 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd6000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cd00a64a0 0x7f9cd00ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd5600640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0004380 0x7f9cd01ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 -- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0004380 msgr2=0x7f9cd01ea600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0004380 0x7f9cd01ea600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 -- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cd00a64a0 msgr2=0x7f9cd00ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cd00a64a0 0x7f9cd00ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 -- 172.21.15.32:0/2380198849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00a6d90 con 0x7f9cd014c920 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd6000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cd00a64a0 0x7f9cd00ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd5600640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0004380 0x7f9cd01ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd4c00640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cd014c920 0x7f9cd00a5f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9cb801eac0 tx=0x7f9cb801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9ccd600640 1 -- 172.21.15.32:0/2380198849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80069e0 con 0x7f9cd014c920 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9ccd600640 1 -- 172.21.15.32:0/2380198849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb8006b40 con 0x7f9cd014c920 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9ccd600640 1 -- 172.21.15.32:0/2380198849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8007030 con 0x7f9cd014c920 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd00a7070 con 0x7f9cd014c920 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd00a7350 con 0x7f9cd014c920 2024-01-19T04:15:53.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.222+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd00749f0 con 0x7f9cd014c920 2024-01-19T04:15:53.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.226+0000 7f9ccd600640 1 -- 172.21.15.32:0/2380198849 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9cb80b7070 con 0x7f9cd014c920 2024-01-19T04:15:53.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.226+0000 7f9ccd600640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ca8066500 0x7f9ca80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.226+0000 7f9ccd600640 1 -- 172.21.15.32:0/2380198849 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cb81211f0 con 0x7f9cd014c920 2024-01-19T04:15:53.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.226+0000 7f9cd5600640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ca8066500 0x7f9ca80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.226+0000 7f9cd5600640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ca8066500 0x7f9ca80689c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0050320 tx=0x7f9cc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.230+0000 7f9ccd600640 1 -- 172.21.15.32:0/2380198849 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9cb80ee5a0 con 0x7f9cd014c920 2024-01-19T04:15:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.390+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cd00c56e0 con 0x7f9cd014c920 2024-01-19T04:15:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.390+0000 7f9ccd600640 1 -- 172.21.15.32:0/2380198849 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f9cb80f1bc0 con 0x7f9cd014c920 2024-01-19T04:15:53.393 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:53.393 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:50.636645+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:15:53.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ca8066500 msgr2=0x7f9ca80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ca8066500 0x7f9ca80689c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0050320 tx=0x7f9cc0008040 comp rx=0 tx=0).stop 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cd014c920 msgr2=0x7f9cd00a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cd014c920 0x7f9cd00a5f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9cb801eac0 tx=0x7f9cb801ba30 comp rx=0 tx=0).stop 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 shutdown_connections 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ca8066500 0x7f9ca80689c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cd00a64a0 0x7f9cd00ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cd014c920 0x7f9cd00a5f60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 --2- 172.21.15.32:0/2380198849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cb0004380 0x7f9cd01ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 >> 172.21.15.32:0/2380198849 conn(0x7f9cd00c5b20 msgr2=0x7f9cd014df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 shutdown_connections 2024-01-19T04:15:53.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.394+0000 7f9cd8000640 1 -- 172.21.15.32:0/2380198849 wait complete. 2024-01-19T04:15:53.415 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:15:53.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:53.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.554+0000 7f541a000640 1 Processor -- start 2024-01-19T04:15:53.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.554+0000 7f541a000640 1 -- start start 2024-01-19T04:15:53.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.554+0000 7f541a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5414147f90 0x7f5414151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.554+0000 7f541a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54140c55e0 0x7f54140c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.554+0000 7f541a000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54140c0810 con 0x7f541406beb0 2024-01-19T04:15:53.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.554+0000 7f541a000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140c1df0 con 0x7f54140c55e0 2024-01-19T04:15:53.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.554+0000 7f541a000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c0af0 con 0x7f5414147f90 2024-01-19T04:15:53.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5412a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54140c55e0 0x7f54140c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5414147f90 0x7f5414151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f541406beb0 0x7f54140a4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:40396/0 (socket says 172.21.15.32:40396) 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5412a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54140c55e0 0x7f54140c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:36380/0 (socket says 172.21.15.32:36380) 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413e00640 1 -- 172.21.15.32:0/4065164610 learned_addr learned my addr 172.21.15.32:0/4065164610 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5414147f90 0x7f5414151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:56792/0 (socket says 172.21.15.32:56792) 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413400640 1 -- 172.21.15.32:0/4065164610 >> v2:172.21.15.67:3300/0 conn(0x7f54140c55e0 msgr2=0x7f54140c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413400640 1 --2- 172.21.15.32:0/4065164610 >> v2:172.21.15.67:3300/0 conn(0x7f54140c55e0 0x7f54140c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413400640 1 -- 172.21.15.32:0/4065164610 >> v1:172.21.15.67:6789/0 conn(0x7f541406beb0 legacy=0x7f54140a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5412000640 1 -- 172.21.15.32:0/4065164610 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078465868 0 0) 0x7f54140c0810 con 0x7f541406beb0 2024-01-19T04:15:53.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413400640 1 -- 172.21.15.32:0/4065164610 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140c0dd0 con 0x7f5414147f90 2024-01-19T04:15:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.558+0000 7f5413400640 1 --2- 172.21.15.32:0/4065164610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5414147f90 0x7f5414151350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54040097c0 tx=0x7f540401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d7726427d30084 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f5412000640 1 -- 172.21.15.32:0/4065164610 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040ac620 con 0x7f5414147f90 2024-01-19T04:15:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f5412000640 1 -- 172.21.15.32:0/4065164610 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040ac780 con 0x7f5414147f90 2024-01-19T04:15:53.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f5412000640 1 -- 172.21.15.32:0/4065164610 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040acb10 con 0x7f5414147f90 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- 172.21.15.32:0/4065164610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5414147f90 msgr2=0x7f5414151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 --2- 172.21.15.32:0/4065164610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5414147f90 0x7f5414151350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54040097c0 tx=0x7f540401c3c0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- 172.21.15.32:0/4065164610 shutdown_connections 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 --2- 172.21.15.32:0/4065164610 >> v2:172.21.15.67:3300/0 conn(0x7f54140c55e0 0x7f54140c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 --2- 172.21.15.32:0/4065164610 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5414147f90 0x7f5414151350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- 172.21.15.32:0/4065164610 >> 172.21.15.32:0/4065164610 conn(0x7f54140c5b20 msgr2=0x7f54140c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- 172.21.15.32:0/4065164610 shutdown_connections 2024-01-19T04:15:53.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- 172.21.15.32:0/4065164610 wait complete. 2024-01-19T04:15:53.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 Processor -- start 2024-01-19T04:15:53.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- start start 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f541406beb0 0x7f5414154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54140c55e0 0x7f5414146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414147f90 0x7f5414147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54141f1230 con 0x7f541406beb0 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54141f1780 con 0x7f5414147f90 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.562+0000 7f541a000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5414148530 con 0x7f54140c55e0 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f541406beb0 0x7f5414154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f541406beb0 0x7f5414154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33616/0 (socket says 172.21.15.32:33616) 2024-01-19T04:15:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 -- 172.21.15.32:0/3491076849 learned_addr learned my addr 172.21.15.32:0/3491076849 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413e00640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414147f90 0x7f5414147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5412a00640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54140c55e0 0x7f5414146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 -- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54140c55e0 msgr2=0x7f5414146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54140c55e0 0x7f5414146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 -- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414147f90 msgr2=0x7f5414147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414147f90 0x7f5414147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 -- 172.21.15.32:0/3491076849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009420 con 0x7f541406beb0 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413e00640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414147f90 0x7f5414147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f5413400640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f541406beb0 0x7f5414154b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5404019ff0 tx=0x7f540401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f540b400640 1 -- 172.21.15.32:0/3491076849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040b8450 con 0x7f541406beb0 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f540b400640 1 -- 172.21.15.32:0/3491076849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040b85d0 con 0x7f541406beb0 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54141f14a0 con 0x7f541406beb0 2024-01-19T04:15:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f540b400640 1 -- 172.21.15.32:0/3491076849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040b8980 con 0x7f541406beb0 2024-01-19T04:15:53.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54141550b0 con 0x7f541406beb0 2024-01-19T04:15:53.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54140749f0 con 0x7f541406beb0 2024-01-19T04:15:53.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.566+0000 7f540b400640 1 -- 172.21.15.32:0/3491076849 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f54040aa070 con 0x7f541406beb0 2024-01-19T04:15:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.570+0000 7f540b400640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f53ec066530 0x7f53ec0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.570+0000 7f540b400640 1 -- 172.21.15.32:0/3491076849 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f540411e220 con 0x7f541406beb0 2024-01-19T04:15:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.570+0000 7f5412a00640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f53ec066530 0x7f53ec0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.570+0000 7f5412a00640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f53ec066530 0x7f53ec0689f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54140c4b20 tx=0x7f53fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.574+0000 7f540b400640 1 -- 172.21.15.32:0/3491076849 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f54040eb600 con 0x7f541406beb0 2024-01-19T04:15:53.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.730+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5414067760 con 0x7f53ec066530 2024-01-19T04:15:53.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.738+0000 7f540b400640 1 -- 172.21.15.32:0/3491076849 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261002 (secure 0 0 0) 0x7f5414067760 con 0x7f53ec066530 2024-01-19T04:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f53ec066530 msgr2=0x7f53ec0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f53ec066530 0x7f53ec0689f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54140c4b20 tx=0x7f53fc009190 comp rx=0 tx=0).stop 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f541406beb0 msgr2=0x7f5414154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f541406beb0 0x7f5414154b70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5404019ff0 tx=0x7f540401ac00 comp rx=0 tx=0).stop 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 shutdown_connections 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f53ec066530 0x7f53ec0689f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5414147f90 0x7f5414147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54140c55e0 0x7f5414146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 --2- 172.21.15.32:0/3491076849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f541406beb0 0x7f5414154b70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 >> 172.21.15.32:0/3491076849 conn(0x7f54140c5b20 msgr2=0x7f541406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 shutdown_connections 2024-01-19T04:15:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.742+0000 7f541a000640 1 -- 172.21.15.32:0/3491076849 wait complete. 2024-01-19T04:15:53.762 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-01-19T04:15:52.040476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236784,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737936,"statfs":{"total":773094113280,"available":772851646464,"internally_reserved":0,"allocated":4042752,"data_stored":2245389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.410549"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668471+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:49.668471+0000","last_peered":"2024-01-19T04:15:49.668471+0000","last_clean":"2024-01-19T04:15:49.668471+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:49.668471+0000","last_undegraded":"2024-01-19T04:15:49.668471+0000","last_fullsized":"2024-01-19T04:15:49.668471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676092+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:49.676092+0000","last_peered":"2024-01-19T04:15:49.676092+0000","last_clean":"2024-01-19T04:15:49.676092+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:49.676092+0000","last_undegraded":"2024-01-19T04:15:49.676092+0000","last_fullsized":"2024-01-19T04:15:49.676092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650023+0000","last_change":"2024-01-19T04:15:48.650023+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650023+0000","last_undegraded":"2024-01-19T04:15:48.650023+0000","last_fullsized":"2024-01-19T04:15:48.650023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645535+0000","last_change":"2024-01-19T04:15:48.645535+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645535+0000","last_undegraded":"2024-01-19T04:15:48.645535+0000","last_fullsized":"2024-01-19T04:15:48.645535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666020+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:49.666020+0000","last_peered":"2024-01-19T04:15:49.666020+0000","last_clean":"2024-01-19T04:15:49.666020+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:49.666020+0000","last_undegraded":"2024-01-19T04:15:49.666020+0000","last_fullsized":"2024-01-19T04:15:49.666020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669768+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:49.669768+0000","last_peered":"2024-01-19T04:15:49.669768+0000","last_clean":"2024-01-19T04:15:49.669768+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:49.669768+0000","last_undegraded":"2024-01-19T04:15:49.669768+0000","last_fullsized":"2024-01-19T04:15:49.669768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678951+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:49.678951+0000","last_peered":"2024-01-19T04:15:49.678951+0000","last_clean":"2024-01-19T04:15:49.678951+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:49.678951+0000","last_undegraded":"2024-01-19T04:15:49.678951+0000","last_fullsized":"2024-01-19T04:15:49.678951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651444+0000","last_change":"2024-01-19T04:15:48.651444+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651444+0000","last_undegraded":"2024-01-19T04:15:48.651444+0000","last_fullsized":"2024-01-19T04:15:48.651444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669844+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:49.669844+0000","last_peered":"2024-01-19T04:15:49.669844+0000","last_clean":"2024-01-19T04:15:49.669844+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:49.669844+0000","last_undegraded":"2024-01-19T04:15:49.669844+0000","last_fullsized":"2024-01-19T04:15:49.669844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676171+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:49.676171+0000","last_peered":"2024-01-19T04:15:49.676171+0000","last_clean":"2024-01-19T04:15:49.676171+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:49.676171+0000","last_undegraded":"2024-01-19T04:15:49.676171+0000","last_fullsized":"2024-01-19T04:15:49.676171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.644524+0000","last_change":"2024-01-19T04:15:48.644524+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.644524+0000","last_undegraded":"2024-01-19T04:15:48.644524+0000","last_fullsized":"2024-01-19T04:15:48.644524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676387+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:49.676387+0000","last_peered":"2024-01-19T04:15:49.676387+0000","last_clean":"2024-01-19T04:15:49.676387+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:49.676387+0000","last_undegraded":"2024-01-19T04:15:49.676387+0000","last_fullsized":"2024-01-19T04:15:49.676387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:03.072421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666662+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:49.666662+0000","last_peered":"2024-01-19T04:15:49.666662+0000","last_clean":"2024-01-19T04:15:49.666662+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:49.666662+0000","last_undegraded":"2024-01-19T04:15:49.666662+0000","last_fullsized":"2024-01-19T04:15:49.666662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668881+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:49.668881+0000","last_peered":"2024-01-19T04:15:49.668881+0000","last_clean":"2024-01-19T04:15:49.668881+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:49.668881+0000","last_undegraded":"2024-01-19T04:15:49.668881+0000","last_fullsized":"2024-01-19T04:15:49.668881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645213+0000","last_change":"2024-01-19T04:15:48.645213+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645213+0000","last_undegraded":"2024-01-19T04:15:48.645213+0000","last_fullsized":"2024-01-19T04:15:48.645213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670531+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:49.670531+0000","last_peered":"2024-01-19T04:15:49.670531+0000","last_clean":"2024-01-19T04:15:49.670531+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:49.670531+0000","last_undegraded":"2024-01-19T04:15:49.670531+0000","last_fullsized":"2024-01-19T04:15:49.670531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678899+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:49.678899+0000","last_peered":"2024-01-19T04:15:49.678899+0000","last_clean":"2024-01-19T04:15:49.678899+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:49.678899+0000","last_undegraded":"2024-01-19T04:15:49.678899+0000","last_fullsized":"2024-01-19T04:15:49.678899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641469+0000","last_change":"2024-01-19T04:15:48.641469+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641469+0000","last_undegraded":"2024-01-19T04:15:48.641469+0000","last_fullsized":"2024-01-19T04:15:48.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676153+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:49.676153+0000","last_peered":"2024-01-19T04:15:49.676153+0000","last_clean":"2024-01-19T04:15:49.676153+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:49.676153+0000","last_undegraded":"2024-01-19T04:15:49.676153+0000","last_fullsized":"2024-01-19T04:15:49.676153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651292+0000","last_change":"2024-01-19T04:15:48.651292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651292+0000","last_undegraded":"2024-01-19T04:15:48.651292+0000","last_fullsized":"2024-01-19T04:15:48.651292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650320+0000","last_change":"2024-01-19T04:15:48.650320+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650320+0000","last_undegraded":"2024-01-19T04:15:48.650320+0000","last_fullsized":"2024-01-19T04:15:48.650320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676350+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:49.676350+0000","last_peered":"2024-01-19T04:15:49.676350+0000","last_clean":"2024-01-19T04:15:49.676350+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:49.676350+0000","last_undegraded":"2024-01-19T04:15:49.676350+0000","last_fullsized":"2024-01-19T04:15:49.676350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680534+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:49.680534+0000","last_peered":"2024-01-19T04:15:49.680534+0000","last_clean":"2024-01-19T04:15:49.680534+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:49.680534+0000","last_undegraded":"2024-01-19T04:15:49.680534+0000","last_fullsized":"2024-01-19T04:15:49.680534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.655741+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:49.655741+0000","last_peered":"2024-01-19T04:15:49.655741+0000","last_clean":"2024-01-19T04:15:49.655741+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:49.655741+0000","last_undegraded":"2024-01-19T04:15:49.655741+0000","last_fullsized":"2024-01-19T04:15:49.655741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668171+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:49.668171+0000","last_peered":"2024-01-19T04:15:49.668171+0000","last_clean":"2024-01-19T04:15:49.668171+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:49.668171+0000","last_undegraded":"2024-01-19T04:15:49.668171+0000","last_fullsized":"2024-01-19T04:15:49.668171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670090+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:49.670090+0000","last_peered":"2024-01-19T04:15:49.670090+0000","last_clean":"2024-01-19T04:15:49.670090+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:49.670090+0000","last_undegraded":"2024-01-19T04:15:49.670090+0000","last_fullsized":"2024-01-19T04:15:49.670090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.642670+0000","last_change":"2024-01-19T04:15:48.642670+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.642670+0000","last_undegraded":"2024-01-19T04:15:48.642670+0000","last_fullsized":"2024-01-19T04:15:48.642670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678384+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:49.678384+0000","last_peered":"2024-01-19T04:15:49.678384+0000","last_clean":"2024-01-19T04:15:49.678384+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:49.678384+0000","last_undegraded":"2024-01-19T04:15:49.678384+0000","last_fullsized":"2024-01-19T04:15:49.678384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672132+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:49.672132+0000","last_peered":"2024-01-19T04:15:49.672132+0000","last_clean":"2024-01-19T04:15:49.672132+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:49.672132+0000","last_undegraded":"2024-01-19T04:15:49.672132+0000","last_fullsized":"2024-01-19T04:15:49.672132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664952+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:15:48.664952+0000","last_peered":"2024-01-19T04:15:48.664952+0000","last_clean":"2024-01-19T04:15:48.664952+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:15:48.664952+0000","last_undegraded":"2024-01-19T04:15:48.664952+0000","last_fullsized":"2024-01-19T04:15:48.664952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680610+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:49.680610+0000","last_peered":"2024-01-19T04:15:49.680610+0000","last_clean":"2024-01-19T04:15:49.680610+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:49.680610+0000","last_undegraded":"2024-01-19T04:15:49.680610+0000","last_fullsized":"2024-01-19T04:15:49.680610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-19T04:15:47.633618+0000","last_change":"2024-01-19T04:15:47.633618+0000","last_active":"2024-01-19T04:15:47.625553+0000","last_peered":"2024-01-19T04:15:47.625553+0000","last_clean":"2024-01-19T04:15:47.625553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:47.633618+0000","last_undegraded":"2024-01-19T04:15:47.633618+0000","last_fullsized":"2024-01-19T04:15:47.633618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649945+0000","last_change":"2024-01-19T04:15:48.649945+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649945+0000","last_undegraded":"2024-01-19T04:15:48.649945+0000","last_fullsized":"2024-01-19T04:15:48.649945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661721+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:15:48.661721+0000","last_peered":"2024-01-19T04:15:48.661721+0000","last_clean":"2024-01-19T04:15:48.661721+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:15:48.661721+0000","last_undegraded":"2024-01-19T04:15:48.661721+0000","last_fullsized":"2024-01-19T04:15:48.661721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:39.528701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670141+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:49.670141+0000","last_peered":"2024-01-19T04:15:49.670141+0000","last_clean":"2024-01-19T04:15:49.670141+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:49.670141+0000","last_undegraded":"2024-01-19T04:15:49.670141+0000","last_fullsized":"2024-01-19T04:15:49.670141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677397+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:49.677397+0000","last_peered":"2024-01-19T04:15:49.677397+0000","last_clean":"2024-01-19T04:15:49.677397+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:49.677397+0000","last_undegraded":"2024-01-19T04:15:49.677397+0000","last_fullsized":"2024-01-19T04:15:49.677397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.663229+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:49.663229+0000","last_peered":"2024-01-19T04:15:49.663229+0000","last_clean":"2024-01-19T04:15:49.663229+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:49.663229+0000","last_undegraded":"2024-01-19T04:15:49.663229+0000","last_fullsized":"2024-01-19T04:15:49.663229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677100+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:49.677100+0000","last_peered":"2024-01-19T04:15:49.677100+0000","last_clean":"2024-01-19T04:15:49.677100+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:49.677100+0000","last_undegraded":"2024-01-19T04:15:49.677100+0000","last_fullsized":"2024-01-19T04:15:49.677100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678851+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:49.678851+0000","last_peered":"2024-01-19T04:15:49.678851+0000","last_clean":"2024-01-19T04:15:49.678851+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:49.678851+0000","last_undegraded":"2024-01-19T04:15:49.678851+0000","last_fullsized":"2024-01-19T04:15:49.678851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-19T04:15:47.634128+0000","last_change":"2024-01-19T04:15:47.634128+0000","last_active":"2024-01-19T04:15:47.625553+0000","last_peered":"2024-01-19T04:15:47.625553+0000","last_clean":"2024-01-19T04:15:47.625553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:47.634128+0000","last_undegraded":"2024-01-19T04:15:47.634128+0000","last_fullsized":"2024-01-19T04:15:47.634128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647292+0000","last_change":"2024-01-19T04:15:48.647292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647292+0000","last_undegraded":"2024-01-19T04:15:48.647292+0000","last_fullsized":"2024-01-19T04:15:48.647292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656947+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:49.656947+0000","last_peered":"2024-01-19T04:15:49.656947+0000","last_clean":"2024-01-19T04:15:49.656947+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:49.656947+0000","last_undegraded":"2024-01-19T04:15:49.656947+0000","last_fullsized":"2024-01-19T04:15:49.656947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676221+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:49.676221+0000","last_peered":"2024-01-19T04:15:49.676221+0000","last_clean":"2024-01-19T04:15:49.676221+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:49.676221+0000","last_undegraded":"2024-01-19T04:15:49.676221+0000","last_fullsized":"2024-01-19T04:15:49.676221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-19T04:15:47.634037+0000","last_change":"2024-01-19T04:15:47.634037+0000","last_active":"2024-01-19T04:15:47.625553+0000","last_peered":"2024-01-19T04:15:47.625553+0000","last_clean":"2024-01-19T04:15:47.625553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:47.634037+0000","last_undegraded":"2024-01-19T04:15:47.634037+0000","last_fullsized":"2024-01-19T04:15:47.634037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.652008+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:15:48.652008+0000","last_peered":"2024-01-19T04:15:48.652008+0000","last_clean":"2024-01-19T04:15:48.652008+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:15:48.652008+0000","last_undegraded":"2024-01-19T04:15:48.652008+0000","last_fullsized":"2024-01-19T04:15:48.652008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678079+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:49.678079+0000","last_peered":"2024-01-19T04:15:49.678079+0000","last_clean":"2024-01-19T04:15:49.678079+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:49.678079+0000","last_undegraded":"2024-01-19T04:15:49.678079+0000","last_fullsized":"2024-01-19T04:15:49.678079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676118+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:49.676118+0000","last_peered":"2024-01-19T04:15:49.676118+0000","last_clean":"2024-01-19T04:15:49.676118+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:49.676118+0000","last_undegraded":"2024-01-19T04:15:49.676118+0000","last_fullsized":"2024-01-19T04:15:49.676118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-19T04:15:47.634285+0000","last_change":"2024-01-19T04:15:47.634285+0000","last_active":"2024-01-19T04:15:47.625553+0000","last_peered":"2024-01-19T04:15:47.625553+0000","last_clean":"2024-01-19T04:15:47.625553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:47.634285+0000","last_undegraded":"2024-01-19T04:15:47.634285+0000","last_fullsized":"2024-01-19T04:15:47.634285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647172+0000","last_change":"2024-01-19T04:15:48.647172+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647172+0000","last_undegraded":"2024-01-19T04:15:48.647172+0000","last_fullsized":"2024-01-19T04:15:48.647172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673342+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:49.673342+0000","last_peered":"2024-01-19T04:15:49.673342+0000","last_clean":"2024-01-19T04:15:49.673342+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:49.673342+0000","last_undegraded":"2024-01-19T04:15:49.673342+0000","last_fullsized":"2024-01-19T04:15:49.673342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662615+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:15:48.662615+0000","last_peered":"2024-01-19T04:15:48.662615+0000","last_clean":"2024-01-19T04:15:48.662615+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:15:48.662615+0000","last_undegraded":"2024-01-19T04:15:48.662615+0000","last_fullsized":"2024-01-19T04:15:48.662615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669955+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:49.669955+0000","last_peered":"2024-01-19T04:15:49.669955+0000","last_clean":"2024-01-19T04:15:49.669955+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:49.669955+0000","last_undegraded":"2024-01-19T04:15:49.669955+0000","last_fullsized":"2024-01-19T04:15:49.669955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-19T04:15:47.633583+0000","last_change":"2024-01-19T04:15:47.633583+0000","last_active":"2024-01-19T04:15:47.625553+0000","last_peered":"2024-01-19T04:15:47.625553+0000","last_clean":"2024-01-19T04:15:47.625553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:47.633583+0000","last_undegraded":"2024-01-19T04:15:47.633583+0000","last_fullsized":"2024-01-19T04:15:47.633583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672209+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:49.672209+0000","last_peered":"2024-01-19T04:15:49.672209+0000","last_clean":"2024-01-19T04:15:49.672209+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:49.672209+0000","last_undegraded":"2024-01-19T04:15:49.672209+0000","last_fullsized":"2024-01-19T04:15:49.672209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-19T04:15:47.635093+0000","last_change":"2024-01-19T04:15:47.635093+0000","last_active":"2024-01-19T04:15:47.625553+0000","last_peered":"2024-01-19T04:15:47.625553+0000","last_clean":"2024-01-19T04:15:47.625553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:47.635093+0000","last_undegraded":"2024-01-19T04:15:47.635093+0000","last_fullsized":"2024-01-19T04:15:47.635093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680503+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:49.680503+0000","last_peered":"2024-01-19T04:15:49.680503+0000","last_clean":"2024-01-19T04:15:49.680503+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:49.680503+0000","last_undegraded":"2024-01-19T04:15:49.680503+0000","last_fullsized":"2024-01-19T04:15:49.680503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662772+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:15:48.662772+0000","last_peered":"2024-01-19T04:15:48.662772+0000","last_clean":"2024-01-19T04:15:48.662772+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:15:48.662772+0000","last_undegraded":"2024-01-19T04:15:48.662772+0000","last_fullsized":"2024-01-19T04:15:48.662772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677595+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:49.677595+0000","last_peered":"2024-01-19T04:15:49.677595+0000","last_clean":"2024-01-19T04:15:49.677595+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:49.677595+0000","last_undegraded":"2024-01-19T04:15:49.677595+0000","last_fullsized":"2024-01-19T04:15:49.677595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673222+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:49.673222+0000","last_peered":"2024-01-19T04:15:49.673222+0000","last_clean":"2024-01-19T04:15:49.673222+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:49.673222+0000","last_undegraded":"2024-01-19T04:15:49.673222+0000","last_fullsized":"2024-01-19T04:15:49.673222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649584+0000","last_change":"2024-01-19T04:15:48.649584+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649584+0000","last_undegraded":"2024-01-19T04:15:48.649584+0000","last_fullsized":"2024-01-19T04:15:48.649584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.671984+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:49.671984+0000","last_peered":"2024-01-19T04:15:49.671984+0000","last_clean":"2024-01-19T04:15:49.671984+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:49.671984+0000","last_undegraded":"2024-01-19T04:15:49.671984+0000","last_fullsized":"2024-01-19T04:15:49.671984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.646862+0000","last_change":"2024-01-19T04:15:48.646862+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.646862+0000","last_undegraded":"2024-01-19T04:15:48.646862+0000","last_fullsized":"2024-01-19T04:15:48.646862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.648427+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:49.648427+0000","last_peered":"2024-01-19T04:15:49.648427+0000","last_clean":"2024-01-19T04:15:49.648427+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:49.648427+0000","last_undegraded":"2024-01-19T04:15:49.648427+0000","last_fullsized":"2024-01-19T04:15:49.648427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647962+0000","last_change":"2024-01-19T04:15:48.647962+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647962+0000","last_undegraded":"2024-01-19T04:15:48.647962+0000","last_fullsized":"2024-01-19T04:15:48.647962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.663106+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:15:48.663106+0000","last_peered":"2024-01-19T04:15:48.663106+0000","last_clean":"2024-01-19T04:15:48.663106+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:15:48.663106+0000","last_undegraded":"2024-01-19T04:15:48.663106+0000","last_fullsized":"2024-01-19T04:15:48.663106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643940+0000","last_change":"2024-01-19T04:15:48.643940+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643940+0000","last_undegraded":"2024-01-19T04:15:48.643940+0000","last_fullsized":"2024-01-19T04:15:48.643940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.646876+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:49.646876+0000","last_peered":"2024-01-19T04:15:49.646876+0000","last_clean":"2024-01-19T04:15:49.646876+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:49.646876+0000","last_undegraded":"2024-01-19T04:15:49.646876+0000","last_fullsized":"2024-01-19T04:15:49.646876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643338+0000","last_change":"2024-01-19T04:15:48.643338+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643338+0000","last_undegraded":"2024-01-19T04:15:48.643338+0000","last_fullsized":"2024-01-19T04:15:48.643338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656957+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:49.656957+0000","last_peered":"2024-01-19T04:15:49.656957+0000","last_clean":"2024-01-19T04:15:49.656957+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:49.656957+0000","last_undegraded":"2024-01-19T04:15:49.656957+0000","last_fullsized":"2024-01-19T04:15:49.656957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666656+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:49.666656+0000","last_peered":"2024-01-19T04:15:49.666656+0000","last_clean":"2024-01-19T04:15:49.666656+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:49.666656+0000","last_undegraded":"2024-01-19T04:15:49.666656+0000","last_fullsized":"2024-01-19T04:15:49.666656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651014+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:49.651014+0000","last_peered":"2024-01-19T04:15:49.651014+0000","last_clean":"2024-01-19T04:15:49.651014+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:49.651014+0000","last_undegraded":"2024-01-19T04:15:49.651014+0000","last_fullsized":"2024-01-19T04:15:49.651014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645416+0000","last_change":"2024-01-19T04:15:48.645416+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645416+0000","last_undegraded":"2024-01-19T04:15:48.645416+0000","last_fullsized":"2024-01-19T04:15:48.645416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664162+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:15:48.664162+0000","last_peered":"2024-01-19T04:15:48.664162+0000","last_clean":"2024-01-19T04:15:48.664162+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:15:48.664162+0000","last_undegraded":"2024-01-19T04:15:48.664162+0000","last_fullsized":"2024-01-19T04:15:48.664162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676123+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:49.676123+0000","last_peered":"2024-01-19T04:15:49.676123+0000","last_clean":"2024-01-19T04:15:49.676123+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:49.676123+0000","last_undegraded":"2024-01-19T04:15:49.676123+0000","last_fullsized":"2024-01-19T04:15:49.676123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664961+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:15:48.664961+0000","last_peered":"2024-01-19T04:15:48.664961+0000","last_clean":"2024-01-19T04:15:48.664961+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:15:48.664961+0000","last_undegraded":"2024-01-19T04:15:48.664961+0000","last_fullsized":"2024-01-19T04:15:48.664961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641996+0000","last_change":"2024-01-19T04:15:48.641996+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641996+0000","last_undegraded":"2024-01-19T04:15:48.641996+0000","last_fullsized":"2024-01-19T04:15:48.641996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662751+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:15:48.662751+0000","last_peered":"2024-01-19T04:15:48.662751+0000","last_clean":"2024-01-19T04:15:48.662751+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:15:48.662751+0000","last_undegraded":"2024-01-19T04:15:48.662751+0000","last_fullsized":"2024-01-19T04:15:48.662751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668564+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:49.668564+0000","last_peered":"2024-01-19T04:15:49.668564+0000","last_clean":"2024-01-19T04:15:49.668564+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:49.668564+0000","last_undegraded":"2024-01-19T04:15:49.668564+0000","last_fullsized":"2024-01-19T04:15:49.668564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661560+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:15:48.661560+0000","last_peered":"2024-01-19T04:15:48.661560+0000","last_clean":"2024-01-19T04:15:48.661560+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:15:48.661560+0000","last_undegraded":"2024-01-19T04:15:48.661560+0000","last_fullsized":"2024-01-19T04:15:48.661560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641934+0000","last_change":"2024-01-19T04:15:48.641934+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641934+0000","last_undegraded":"2024-01-19T04:15:48.641934+0000","last_fullsized":"2024-01-19T04:15:48.641934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662639+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:15:48.662639+0000","last_peered":"2024-01-19T04:15:48.662639+0000","last_clean":"2024-01-19T04:15:48.662639+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:15:48.662639+0000","last_undegraded":"2024-01-19T04:15:48.662639+0000","last_fullsized":"2024-01-19T04:15:48.662639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:15:48.628711+0000","last_change":"2024-01-19T04:15:48.628711+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.628711+0000","last_undegraded":"2024-01-19T04:15:48.628711+0000","last_fullsized":"2024-01-19T04:15:48.628711+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.657082+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:49.657082+0000","last_peered":"2024-01-19T04:15:49.657082+0000","last_clean":"2024-01-19T04:15:49.657082+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:49.657082+0000","last_undegraded":"2024-01-19T04:15:49.657082+0000","last_fullsized":"2024-01-19T04:15:49.657082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678883+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:49.678883+0000","last_peered":"2024-01-19T04:15:49.678883+0000","last_clean":"2024-01-19T04:15:49.678883+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:49.678883+0000","last_undegraded":"2024-01-19T04:15:49.678883+0000","last_fullsized":"2024-01-19T04:15:49.678883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:54.821580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-19T04:15:47.633538+0000","last_change":"2024-01-19T04:15:47.633538+0000","last_active":"2024-01-19T04:15:47.625553+0000","last_peered":"2024-01-19T04:15:47.625553+0000","last_clean":"2024-01-19T04:15:47.625553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:47.633538+0000","last_undegraded":"2024-01-19T04:15:47.633538+0000","last_fullsized":"2024-01-19T04:15:47.633538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669787+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:49.669787+0000","last_peered":"2024-01-19T04:15:49.669787+0000","last_clean":"2024-01-19T04:15:49.669787+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:49.669787+0000","last_undegraded":"2024-01-19T04:15:49.669787+0000","last_fullsized":"2024-01-19T04:15:49.669787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.647622+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:49.647622+0000","last_peered":"2024-01-19T04:15:49.647622+0000","last_clean":"2024-01-19T04:15:49.647622+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:49.647622+0000","last_undegraded":"2024-01-19T04:15:49.647622+0000","last_fullsized":"2024-01-19T04:15:49.647622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.653449+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:48.653449+0000","last_peered":"2024-01-19T04:15:48.653449+0000","last_clean":"2024-01-19T04:15:48.653449+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:48.653449+0000","last_undegraded":"2024-01-19T04:15:48.653449+0000","last_fullsized":"2024-01-19T04:15:48.653449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":725603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":142626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":4,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":128968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":719336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":335872,"data_stored":123151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:53.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:53.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.942+0000 7f1af6200640 1 Processor -- start 2024-01-19T04:15:53.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.942+0000 7f1af6200640 1 -- start start 2024-01-19T04:15:53.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1af6200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1af0147f90 0x7f1af0151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1af6200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1af00c55e0 0x7f1af00c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1af6200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af00c0810 con 0x7f1af006beb0 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1af6200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af00c1df0 con 0x7f1af0147f90 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1af6200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af00c0af0 con 0x7f1af00c55e0 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aef400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1af0147f90 0x7f1af0151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aef400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1af0147f90 0x7f1af0151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33620/0 (socket says 172.21.15.32:33620) 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aef400640 1 -- 172.21.15.32:0/4042875275 learned_addr learned my addr 172.21.15.32:0/4042875275 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aeea00640 1 --2- 172.21.15.32:0/4042875275 >> v2:172.21.15.67:3300/0 conn(0x7f1af00c55e0 0x7f1af00c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aef400640 1 -- 172.21.15.32:0/4042875275 >> v2:172.21.15.67:3300/0 conn(0x7f1af00c55e0 msgr2=0x7f1af00c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aef400640 1 --2- 172.21.15.32:0/4042875275 >> v2:172.21.15.67:3300/0 conn(0x7f1af00c55e0 0x7f1af00c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aef400640 1 -- 172.21.15.32:0/4042875275 >> v1:172.21.15.67:6789/0 conn(0x7f1af006beb0 legacy=0x7f1af00a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.946+0000 7f1aef400640 1 -- 172.21.15.32:0/4042875275 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af00c0dd0 con 0x7f1af0147f90 2024-01-19T04:15:53.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1aef400640 1 --2- 172.21.15.32:0/4042875275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af0147f90 0x7f1af0151350 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1af0073ee0 tx=0x7f1ae001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21c3617ebdabc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1aee000640 1 -- 172.21.15.32:0/4042875275 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00ab640 con 0x7f1af0147f90 2024-01-19T04:15:53.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1aee000640 1 -- 172.21.15.32:0/4042875275 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00a7070 con 0x7f1af0147f90 2024-01-19T04:15:53.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1aee000640 1 -- 172.21.15.32:0/4042875275 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00ab9c0 con 0x7f1af0147f90 2024-01-19T04:15:53.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 -- 172.21.15.32:0/4042875275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af0147f90 msgr2=0x7f1af0151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 --2- 172.21.15.32:0/4042875275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af0147f90 0x7f1af0151350 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1af0073ee0 tx=0x7f1ae001c440 comp rx=0 tx=0).stop 2024-01-19T04:15:53.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 -- 172.21.15.32:0/4042875275 shutdown_connections 2024-01-19T04:15:53.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 --2- 172.21.15.32:0/4042875275 >> v2:172.21.15.67:3300/0 conn(0x7f1af00c55e0 0x7f1af00c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 --2- 172.21.15.32:0/4042875275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af0147f90 0x7f1af0151350 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 -- 172.21.15.32:0/4042875275 >> 172.21.15.32:0/4042875275 conn(0x7f1af00c5b20 msgr2=0x7f1af00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:53.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 -- 172.21.15.32:0/4042875275 shutdown_connections 2024-01-19T04:15:53.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 -- 172.21.15.32:0/4042875275 wait complete. 2024-01-19T04:15:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 Processor -- start 2024-01-19T04:15:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.950+0000 7f1af6200640 1 -- start start 2024-01-19T04:15:53.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af006beb0 0x7f1af00aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af00c55e0 0x7f1af01f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0147f90 0x7f1af015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0154580 con 0x7f1af006beb0 2024-01-19T04:15:53.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af01f16a0 con 0x7f1af00c55e0 2024-01-19T04:15:53.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00ab5f0 con 0x7f1af0147f90 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af006beb0 0x7f1af00aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af006beb0 0x7f1af00aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33622/0 (socket says 172.21.15.32:33622) 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 -- 172.21.15.32:0/3732943508 learned_addr learned my addr 172.21.15.32:0/3732943508 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aefe00640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0147f90 0x7f1af015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aeea00640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af00c55e0 0x7f1af01f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 -- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0147f90 msgr2=0x7f1af015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0147f90 0x7f1af015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 -- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af00c55e0 msgr2=0x7f1af01f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af00c55e0 0x7f1af01f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 -- 172.21.15.32:0/3732943508 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00094d0 con 0x7f1af006beb0 2024-01-19T04:15:53.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1aef400640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af006beb0 0x7f1af00aacc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0019050 tx=0x7f1ae001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1ae7400640 1 -- 172.21.15.32:0/3732943508 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00be3f0 con 0x7f1af006beb0 2024-01-19T04:15:53.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1ae7400640 1 -- 172.21.15.32:0/3732943508 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00be550 con 0x7f1af006beb0 2024-01-19T04:15:53.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1ae7400640 1 -- 172.21.15.32:0/3732943508 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00be900 con 0x7f1af006beb0 2024-01-19T04:15:53.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af00ab310 con 0x7f1af006beb0 2024-01-19T04:15:53.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af01541a0 con 0x7f1af006beb0 2024-01-19T04:15:53.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.954+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af01546c0 con 0x7f1af006beb0 2024-01-19T04:15:53.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.958+0000 7f1ae7400640 1 -- 172.21.15.32:0/3732943508 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1ae00c7440 con 0x7f1af006beb0 2024-01-19T04:15:53.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.958+0000 7f1ae7400640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1ac8066530 0x7f1ac80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:53.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.958+0000 7f1ae7400640 1 -- 172.21.15.32:0/3732943508 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ae011e6f0 con 0x7f1af006beb0 2024-01-19T04:15:53.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.958+0000 7f1aeea00640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1ac8066530 0x7f1ac80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:53.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.958+0000 7f1aeea00640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1ac8066530 0x7f1ac80689f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1af006c790 tx=0x7f1ad8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:53.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:53.962+0000 7f1ae7400640 1 -- 172.21.15.32:0/3732943508 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1af01546c0 con 0x7f1af006beb0 2024-01-19T04:15:54.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.118+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1af0072850 con 0x7f1ac8066530 2024-01-19T04:15:54.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.126+0000 7f1ae7400640 1 -- 172.21.15.32:0/3732943508 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266012 (secure 0 0 0) 0x7f1ad800b670 con 0x7f1ac8066530 2024-01-19T04:15:54.130 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:54.131 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:54.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1ac8066530 msgr2=0x7f1ac80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1ac8066530 0x7f1ac80689f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1af006c790 tx=0x7f1ad8008040 comp rx=0 tx=0).stop 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af006beb0 msgr2=0x7f1af00aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af006beb0 0x7f1af00aacc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0019050 tx=0x7f1ae001ac80 comp rx=0 tx=0).stop 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 shutdown_connections 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1ac8066530 0x7f1ac80689f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1af0147f90 0x7f1af015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1af00c55e0 0x7f1af01f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 --2- 172.21.15.32:0/3732943508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1af006beb0 0x7f1af00aacc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 >> 172.21.15.32:0/3732943508 conn(0x7f1af00c5b20 msgr2=0x7f1af00c4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 shutdown_connections 2024-01-19T04:15:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.130+0000 7f1af6200640 1 -- 172.21.15.32:0/3732943508 wait complete. 2024-01-19T04:15:54.151 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-01-19T04:15:54.040829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236836,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737884,"statfs":{"total":773094113280,"available":772851593216,"internally_reserved":0,"allocated":4108288,"data_stored":2272182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001161"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668471+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:49.668471+0000","last_peered":"2024-01-19T04:15:49.668471+0000","last_clean":"2024-01-19T04:15:49.668471+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:49.668471+0000","last_undegraded":"2024-01-19T04:15:49.668471+0000","last_fullsized":"2024-01-19T04:15:49.668471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641586+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:15:50.641586+0000","last_peered":"2024-01-19T04:15:50.641586+0000","last_clean":"2024-01-19T04:15:50.641586+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:15:50.641586+0000","last_undegraded":"2024-01-19T04:15:50.641586+0000","last_fullsized":"2024-01-19T04:15:50.641586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676092+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:49.676092+0000","last_peered":"2024-01-19T04:15:49.676092+0000","last_clean":"2024-01-19T04:15:49.676092+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:49.676092+0000","last_undegraded":"2024-01-19T04:15:49.676092+0000","last_fullsized":"2024-01-19T04:15:49.676092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650023+0000","last_change":"2024-01-19T04:15:48.650023+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650023+0000","last_undegraded":"2024-01-19T04:15:48.650023+0000","last_fullsized":"2024-01-19T04:15:48.650023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645535+0000","last_change":"2024-01-19T04:15:48.645535+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645535+0000","last_undegraded":"2024-01-19T04:15:48.645535+0000","last_fullsized":"2024-01-19T04:15:48.645535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640911+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:15:50.640911+0000","last_peered":"2024-01-19T04:15:50.640911+0000","last_clean":"2024-01-19T04:15:50.640911+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:15:50.640911+0000","last_undegraded":"2024-01-19T04:15:50.640911+0000","last_fullsized":"2024-01-19T04:15:50.640911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666020+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:49.666020+0000","last_peered":"2024-01-19T04:15:49.666020+0000","last_clean":"2024-01-19T04:15:49.666020+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:49.666020+0000","last_undegraded":"2024-01-19T04:15:49.666020+0000","last_fullsized":"2024-01-19T04:15:49.666020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669768+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:49.669768+0000","last_peered":"2024-01-19T04:15:49.669768+0000","last_clean":"2024-01-19T04:15:49.669768+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:49.669768+0000","last_undegraded":"2024-01-19T04:15:49.669768+0000","last_fullsized":"2024-01-19T04:15:49.669768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678951+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:49.678951+0000","last_peered":"2024-01-19T04:15:49.678951+0000","last_clean":"2024-01-19T04:15:49.678951+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:49.678951+0000","last_undegraded":"2024-01-19T04:15:49.678951+0000","last_fullsized":"2024-01-19T04:15:49.678951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651444+0000","last_change":"2024-01-19T04:15:48.651444+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651444+0000","last_undegraded":"2024-01-19T04:15:48.651444+0000","last_fullsized":"2024-01-19T04:15:48.651444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669844+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:49.669844+0000","last_peered":"2024-01-19T04:15:49.669844+0000","last_clean":"2024-01-19T04:15:49.669844+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:49.669844+0000","last_undegraded":"2024-01-19T04:15:49.669844+0000","last_fullsized":"2024-01-19T04:15:49.669844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676171+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:49.676171+0000","last_peered":"2024-01-19T04:15:49.676171+0000","last_clean":"2024-01-19T04:15:49.676171+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:49.676171+0000","last_undegraded":"2024-01-19T04:15:49.676171+0000","last_fullsized":"2024-01-19T04:15:49.676171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.644524+0000","last_change":"2024-01-19T04:15:48.644524+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.644524+0000","last_undegraded":"2024-01-19T04:15:48.644524+0000","last_fullsized":"2024-01-19T04:15:48.644524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640965+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:15:50.640965+0000","last_peered":"2024-01-19T04:15:50.640965+0000","last_clean":"2024-01-19T04:15:50.640965+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:15:50.640965+0000","last_undegraded":"2024-01-19T04:15:50.640965+0000","last_fullsized":"2024-01-19T04:15:50.640965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676387+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:49.676387+0000","last_peered":"2024-01-19T04:15:49.676387+0000","last_clean":"2024-01-19T04:15:49.676387+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:49.676387+0000","last_undegraded":"2024-01-19T04:15:49.676387+0000","last_fullsized":"2024-01-19T04:15:49.676387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:03.072421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666662+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:49.666662+0000","last_peered":"2024-01-19T04:15:49.666662+0000","last_clean":"2024-01-19T04:15:49.666662+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:49.666662+0000","last_undegraded":"2024-01-19T04:15:49.666662+0000","last_fullsized":"2024-01-19T04:15:49.666662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668881+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:49.668881+0000","last_peered":"2024-01-19T04:15:49.668881+0000","last_clean":"2024-01-19T04:15:49.668881+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:49.668881+0000","last_undegraded":"2024-01-19T04:15:49.668881+0000","last_fullsized":"2024-01-19T04:15:49.668881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641405+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:15:50.641405+0000","last_peered":"2024-01-19T04:15:50.641405+0000","last_clean":"2024-01-19T04:15:50.641405+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:15:50.641405+0000","last_undegraded":"2024-01-19T04:15:50.641405+0000","last_fullsized":"2024-01-19T04:15:50.641405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641164+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:15:50.641164+0000","last_peered":"2024-01-19T04:15:50.641164+0000","last_clean":"2024-01-19T04:15:50.641164+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:15:50.641164+0000","last_undegraded":"2024-01-19T04:15:50.641164+0000","last_fullsized":"2024-01-19T04:15:50.641164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645213+0000","last_change":"2024-01-19T04:15:48.645213+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645213+0000","last_undegraded":"2024-01-19T04:15:48.645213+0000","last_fullsized":"2024-01-19T04:15:48.645213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670531+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:49.670531+0000","last_peered":"2024-01-19T04:15:49.670531+0000","last_clean":"2024-01-19T04:15:49.670531+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:49.670531+0000","last_undegraded":"2024-01-19T04:15:49.670531+0000","last_fullsized":"2024-01-19T04:15:49.670531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678899+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:49.678899+0000","last_peered":"2024-01-19T04:15:49.678899+0000","last_clean":"2024-01-19T04:15:49.678899+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:49.678899+0000","last_undegraded":"2024-01-19T04:15:49.678899+0000","last_fullsized":"2024-01-19T04:15:49.678899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641469+0000","last_change":"2024-01-19T04:15:48.641469+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641469+0000","last_undegraded":"2024-01-19T04:15:48.641469+0000","last_fullsized":"2024-01-19T04:15:48.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676153+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:49.676153+0000","last_peered":"2024-01-19T04:15:49.676153+0000","last_clean":"2024-01-19T04:15:49.676153+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:49.676153+0000","last_undegraded":"2024-01-19T04:15:49.676153+0000","last_fullsized":"2024-01-19T04:15:49.676153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651292+0000","last_change":"2024-01-19T04:15:48.651292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651292+0000","last_undegraded":"2024-01-19T04:15:48.651292+0000","last_fullsized":"2024-01-19T04:15:48.651292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641469+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:15:50.641469+0000","last_peered":"2024-01-19T04:15:50.641469+0000","last_clean":"2024-01-19T04:15:50.641469+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:15:50.641469+0000","last_undegraded":"2024-01-19T04:15:50.641469+0000","last_fullsized":"2024-01-19T04:15:50.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650320+0000","last_change":"2024-01-19T04:15:48.650320+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650320+0000","last_undegraded":"2024-01-19T04:15:48.650320+0000","last_fullsized":"2024-01-19T04:15:48.650320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676350+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:49.676350+0000","last_peered":"2024-01-19T04:15:49.676350+0000","last_clean":"2024-01-19T04:15:49.676350+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:49.676350+0000","last_undegraded":"2024-01-19T04:15:49.676350+0000","last_fullsized":"2024-01-19T04:15:49.676350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680534+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:49.680534+0000","last_peered":"2024-01-19T04:15:49.680534+0000","last_clean":"2024-01-19T04:15:49.680534+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:49.680534+0000","last_undegraded":"2024-01-19T04:15:49.680534+0000","last_fullsized":"2024-01-19T04:15:49.680534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.655741+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:49.655741+0000","last_peered":"2024-01-19T04:15:49.655741+0000","last_clean":"2024-01-19T04:15:49.655741+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:49.655741+0000","last_undegraded":"2024-01-19T04:15:49.655741+0000","last_fullsized":"2024-01-19T04:15:49.655741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668171+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:49.668171+0000","last_peered":"2024-01-19T04:15:49.668171+0000","last_clean":"2024-01-19T04:15:49.668171+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:49.668171+0000","last_undegraded":"2024-01-19T04:15:49.668171+0000","last_fullsized":"2024-01-19T04:15:49.668171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670090+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:49.670090+0000","last_peered":"2024-01-19T04:15:49.670090+0000","last_clean":"2024-01-19T04:15:49.670090+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:49.670090+0000","last_undegraded":"2024-01-19T04:15:49.670090+0000","last_fullsized":"2024-01-19T04:15:49.670090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.642670+0000","last_change":"2024-01-19T04:15:48.642670+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.642670+0000","last_undegraded":"2024-01-19T04:15:48.642670+0000","last_fullsized":"2024-01-19T04:15:48.642670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678384+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:49.678384+0000","last_peered":"2024-01-19T04:15:49.678384+0000","last_clean":"2024-01-19T04:15:49.678384+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:49.678384+0000","last_undegraded":"2024-01-19T04:15:49.678384+0000","last_fullsized":"2024-01-19T04:15:49.678384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672132+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:49.672132+0000","last_peered":"2024-01-19T04:15:49.672132+0000","last_clean":"2024-01-19T04:15:49.672132+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:49.672132+0000","last_undegraded":"2024-01-19T04:15:49.672132+0000","last_fullsized":"2024-01-19T04:15:49.672132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664952+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:15:48.664952+0000","last_peered":"2024-01-19T04:15:48.664952+0000","last_clean":"2024-01-19T04:15:48.664952+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:15:48.664952+0000","last_undegraded":"2024-01-19T04:15:48.664952+0000","last_fullsized":"2024-01-19T04:15:48.664952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680610+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:49.680610+0000","last_peered":"2024-01-19T04:15:49.680610+0000","last_clean":"2024-01-19T04:15:49.680610+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:49.680610+0000","last_undegraded":"2024-01-19T04:15:49.680610+0000","last_fullsized":"2024-01-19T04:15:49.680610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678989+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:15:49.678989+0000","last_peered":"2024-01-19T04:15:49.678989+0000","last_clean":"2024-01-19T04:15:49.678989+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:15:49.678989+0000","last_undegraded":"2024-01-19T04:15:49.678989+0000","last_fullsized":"2024-01-19T04:15:49.678989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649945+0000","last_change":"2024-01-19T04:15:48.649945+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649945+0000","last_undegraded":"2024-01-19T04:15:48.649945+0000","last_fullsized":"2024-01-19T04:15:48.649945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661721+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:15:48.661721+0000","last_peered":"2024-01-19T04:15:48.661721+0000","last_clean":"2024-01-19T04:15:48.661721+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:15:48.661721+0000","last_undegraded":"2024-01-19T04:15:48.661721+0000","last_fullsized":"2024-01-19T04:15:48.661721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:39.528701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670141+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:49.670141+0000","last_peered":"2024-01-19T04:15:49.670141+0000","last_clean":"2024-01-19T04:15:49.670141+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:49.670141+0000","last_undegraded":"2024-01-19T04:15:49.670141+0000","last_fullsized":"2024-01-19T04:15:49.670141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677397+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:49.677397+0000","last_peered":"2024-01-19T04:15:49.677397+0000","last_clean":"2024-01-19T04:15:49.677397+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:49.677397+0000","last_undegraded":"2024-01-19T04:15:49.677397+0000","last_fullsized":"2024-01-19T04:15:49.677397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.663229+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:49.663229+0000","last_peered":"2024-01-19T04:15:49.663229+0000","last_clean":"2024-01-19T04:15:49.663229+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:49.663229+0000","last_undegraded":"2024-01-19T04:15:49.663229+0000","last_fullsized":"2024-01-19T04:15:49.663229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677100+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:49.677100+0000","last_peered":"2024-01-19T04:15:49.677100+0000","last_clean":"2024-01-19T04:15:49.677100+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:49.677100+0000","last_undegraded":"2024-01-19T04:15:49.677100+0000","last_fullsized":"2024-01-19T04:15:49.677100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678851+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:49.678851+0000","last_peered":"2024-01-19T04:15:49.678851+0000","last_clean":"2024-01-19T04:15:49.678851+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:49.678851+0000","last_undegraded":"2024-01-19T04:15:49.678851+0000","last_fullsized":"2024-01-19T04:15:49.678851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.649952+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:15:49.649952+0000","last_peered":"2024-01-19T04:15:49.649952+0000","last_clean":"2024-01-19T04:15:49.649952+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:15:49.649952+0000","last_undegraded":"2024-01-19T04:15:49.649952+0000","last_fullsized":"2024-01-19T04:15:49.649952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647292+0000","last_change":"2024-01-19T04:15:48.647292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647292+0000","last_undegraded":"2024-01-19T04:15:48.647292+0000","last_fullsized":"2024-01-19T04:15:48.647292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656947+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:49.656947+0000","last_peered":"2024-01-19T04:15:49.656947+0000","last_clean":"2024-01-19T04:15:49.656947+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:49.656947+0000","last_undegraded":"2024-01-19T04:15:49.656947+0000","last_fullsized":"2024-01-19T04:15:49.656947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676221+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:49.676221+0000","last_peered":"2024-01-19T04:15:49.676221+0000","last_clean":"2024-01-19T04:15:49.676221+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:49.676221+0000","last_undegraded":"2024-01-19T04:15:49.676221+0000","last_fullsized":"2024-01-19T04:15:49.676221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651426+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:15:49.651426+0000","last_peered":"2024-01-19T04:15:49.651426+0000","last_clean":"2024-01-19T04:15:49.651426+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:15:49.651426+0000","last_undegraded":"2024-01-19T04:15:49.651426+0000","last_fullsized":"2024-01-19T04:15:49.651426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641366+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:15:50.641366+0000","last_peered":"2024-01-19T04:15:50.641366+0000","last_clean":"2024-01-19T04:15:50.641366+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:15:50.641366+0000","last_undegraded":"2024-01-19T04:15:50.641366+0000","last_fullsized":"2024-01-19T04:15:50.641366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.652008+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:15:48.652008+0000","last_peered":"2024-01-19T04:15:48.652008+0000","last_clean":"2024-01-19T04:15:48.652008+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:15:48.652008+0000","last_undegraded":"2024-01-19T04:15:48.652008+0000","last_fullsized":"2024-01-19T04:15:48.652008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641572+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:15:50.641572+0000","last_peered":"2024-01-19T04:15:50.641572+0000","last_clean":"2024-01-19T04:15:50.641572+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:15:50.641572+0000","last_undegraded":"2024-01-19T04:15:50.641572+0000","last_fullsized":"2024-01-19T04:15:50.641572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678079+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:49.678079+0000","last_peered":"2024-01-19T04:15:49.678079+0000","last_clean":"2024-01-19T04:15:49.678079+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:49.678079+0000","last_undegraded":"2024-01-19T04:15:49.678079+0000","last_fullsized":"2024-01-19T04:15:49.678079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676118+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:49.676118+0000","last_peered":"2024-01-19T04:15:49.676118+0000","last_clean":"2024-01-19T04:15:49.676118+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:49.676118+0000","last_undegraded":"2024-01-19T04:15:49.676118+0000","last_fullsized":"2024-01-19T04:15:49.676118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.682705+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:15:49.682705+0000","last_peered":"2024-01-19T04:15:49.682705+0000","last_clean":"2024-01-19T04:15:49.682705+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:15:49.682705+0000","last_undegraded":"2024-01-19T04:15:49.682705+0000","last_fullsized":"2024-01-19T04:15:49.682705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647172+0000","last_change":"2024-01-19T04:15:48.647172+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647172+0000","last_undegraded":"2024-01-19T04:15:48.647172+0000","last_fullsized":"2024-01-19T04:15:48.647172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673342+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:49.673342+0000","last_peered":"2024-01-19T04:15:49.673342+0000","last_clean":"2024-01-19T04:15:49.673342+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:49.673342+0000","last_undegraded":"2024-01-19T04:15:49.673342+0000","last_fullsized":"2024-01-19T04:15:49.673342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641100+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:15:50.641100+0000","last_peered":"2024-01-19T04:15:50.641100+0000","last_clean":"2024-01-19T04:15:50.641100+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:15:50.641100+0000","last_undegraded":"2024-01-19T04:15:50.641100+0000","last_fullsized":"2024-01-19T04:15:50.641100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662615+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:15:48.662615+0000","last_peered":"2024-01-19T04:15:48.662615+0000","last_clean":"2024-01-19T04:15:48.662615+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:15:48.662615+0000","last_undegraded":"2024-01-19T04:15:48.662615+0000","last_fullsized":"2024-01-19T04:15:48.662615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669955+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:49.669955+0000","last_peered":"2024-01-19T04:15:49.669955+0000","last_clean":"2024-01-19T04:15:49.669955+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:49.669955+0000","last_undegraded":"2024-01-19T04:15:49.669955+0000","last_fullsized":"2024-01-19T04:15:49.669955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650073+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:15:49.650073+0000","last_peered":"2024-01-19T04:15:49.650073+0000","last_clean":"2024-01-19T04:15:49.650073+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:15:49.650073+0000","last_undegraded":"2024-01-19T04:15:49.650073+0000","last_fullsized":"2024-01-19T04:15:49.650073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672209+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:49.672209+0000","last_peered":"2024-01-19T04:15:49.672209+0000","last_clean":"2024-01-19T04:15:49.672209+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:49.672209+0000","last_undegraded":"2024-01-19T04:15:49.672209+0000","last_fullsized":"2024-01-19T04:15:49.672209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.681628+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:15:49.681628+0000","last_peered":"2024-01-19T04:15:49.681628+0000","last_clean":"2024-01-19T04:15:49.681628+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:15:49.681628+0000","last_undegraded":"2024-01-19T04:15:49.681628+0000","last_fullsized":"2024-01-19T04:15:49.681628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680503+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:49.680503+0000","last_peered":"2024-01-19T04:15:49.680503+0000","last_clean":"2024-01-19T04:15:49.680503+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:49.680503+0000","last_undegraded":"2024-01-19T04:15:49.680503+0000","last_fullsized":"2024-01-19T04:15:49.680503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662772+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:15:48.662772+0000","last_peered":"2024-01-19T04:15:48.662772+0000","last_clean":"2024-01-19T04:15:48.662772+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:15:48.662772+0000","last_undegraded":"2024-01-19T04:15:48.662772+0000","last_fullsized":"2024-01-19T04:15:48.662772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677595+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:49.677595+0000","last_peered":"2024-01-19T04:15:49.677595+0000","last_clean":"2024-01-19T04:15:49.677595+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:49.677595+0000","last_undegraded":"2024-01-19T04:15:49.677595+0000","last_fullsized":"2024-01-19T04:15:49.677595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673222+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:49.673222+0000","last_peered":"2024-01-19T04:15:49.673222+0000","last_clean":"2024-01-19T04:15:49.673222+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:49.673222+0000","last_undegraded":"2024-01-19T04:15:49.673222+0000","last_fullsized":"2024-01-19T04:15:49.673222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649584+0000","last_change":"2024-01-19T04:15:48.649584+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649584+0000","last_undegraded":"2024-01-19T04:15:48.649584+0000","last_fullsized":"2024-01-19T04:15:48.649584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.671984+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:49.671984+0000","last_peered":"2024-01-19T04:15:49.671984+0000","last_clean":"2024-01-19T04:15:49.671984+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:49.671984+0000","last_undegraded":"2024-01-19T04:15:49.671984+0000","last_fullsized":"2024-01-19T04:15:49.671984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.646862+0000","last_change":"2024-01-19T04:15:48.646862+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.646862+0000","last_undegraded":"2024-01-19T04:15:48.646862+0000","last_fullsized":"2024-01-19T04:15:48.646862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.648427+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:49.648427+0000","last_peered":"2024-01-19T04:15:49.648427+0000","last_clean":"2024-01-19T04:15:49.648427+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:49.648427+0000","last_undegraded":"2024-01-19T04:15:49.648427+0000","last_fullsized":"2024-01-19T04:15:49.648427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647962+0000","last_change":"2024-01-19T04:15:48.647962+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647962+0000","last_undegraded":"2024-01-19T04:15:48.647962+0000","last_fullsized":"2024-01-19T04:15:48.647962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.663106+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:15:48.663106+0000","last_peered":"2024-01-19T04:15:48.663106+0000","last_clean":"2024-01-19T04:15:48.663106+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:15:48.663106+0000","last_undegraded":"2024-01-19T04:15:48.663106+0000","last_fullsized":"2024-01-19T04:15:48.663106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643940+0000","last_change":"2024-01-19T04:15:48.643940+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643940+0000","last_undegraded":"2024-01-19T04:15:48.643940+0000","last_fullsized":"2024-01-19T04:15:48.643940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.646876+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:49.646876+0000","last_peered":"2024-01-19T04:15:49.646876+0000","last_clean":"2024-01-19T04:15:49.646876+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:49.646876+0000","last_undegraded":"2024-01-19T04:15:49.646876+0000","last_fullsized":"2024-01-19T04:15:49.646876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643338+0000","last_change":"2024-01-19T04:15:48.643338+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643338+0000","last_undegraded":"2024-01-19T04:15:48.643338+0000","last_fullsized":"2024-01-19T04:15:48.643338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656957+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:49.656957+0000","last_peered":"2024-01-19T04:15:49.656957+0000","last_clean":"2024-01-19T04:15:49.656957+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:49.656957+0000","last_undegraded":"2024-01-19T04:15:49.656957+0000","last_fullsized":"2024-01-19T04:15:49.656957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666656+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:49.666656+0000","last_peered":"2024-01-19T04:15:49.666656+0000","last_clean":"2024-01-19T04:15:49.666656+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:49.666656+0000","last_undegraded":"2024-01-19T04:15:49.666656+0000","last_fullsized":"2024-01-19T04:15:49.666656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651014+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:49.651014+0000","last_peered":"2024-01-19T04:15:49.651014+0000","last_clean":"2024-01-19T04:15:49.651014+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:49.651014+0000","last_undegraded":"2024-01-19T04:15:49.651014+0000","last_fullsized":"2024-01-19T04:15:49.651014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645416+0000","last_change":"2024-01-19T04:15:48.645416+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645416+0000","last_undegraded":"2024-01-19T04:15:48.645416+0000","last_fullsized":"2024-01-19T04:15:48.645416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664162+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:15:48.664162+0000","last_peered":"2024-01-19T04:15:48.664162+0000","last_clean":"2024-01-19T04:15:48.664162+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:15:48.664162+0000","last_undegraded":"2024-01-19T04:15:48.664162+0000","last_fullsized":"2024-01-19T04:15:48.664162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676123+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:49.676123+0000","last_peered":"2024-01-19T04:15:49.676123+0000","last_clean":"2024-01-19T04:15:49.676123+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:49.676123+0000","last_undegraded":"2024-01-19T04:15:49.676123+0000","last_fullsized":"2024-01-19T04:15:49.676123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664961+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:15:48.664961+0000","last_peered":"2024-01-19T04:15:48.664961+0000","last_clean":"2024-01-19T04:15:48.664961+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:15:48.664961+0000","last_undegraded":"2024-01-19T04:15:48.664961+0000","last_fullsized":"2024-01-19T04:15:48.664961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641996+0000","last_change":"2024-01-19T04:15:48.641996+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641996+0000","last_undegraded":"2024-01-19T04:15:48.641996+0000","last_fullsized":"2024-01-19T04:15:48.641996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662751+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:15:48.662751+0000","last_peered":"2024-01-19T04:15:48.662751+0000","last_clean":"2024-01-19T04:15:48.662751+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:15:48.662751+0000","last_undegraded":"2024-01-19T04:15:48.662751+0000","last_fullsized":"2024-01-19T04:15:48.662751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668564+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:49.668564+0000","last_peered":"2024-01-19T04:15:49.668564+0000","last_clean":"2024-01-19T04:15:49.668564+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:49.668564+0000","last_undegraded":"2024-01-19T04:15:49.668564+0000","last_fullsized":"2024-01-19T04:15:49.668564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661560+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:15:48.661560+0000","last_peered":"2024-01-19T04:15:48.661560+0000","last_clean":"2024-01-19T04:15:48.661560+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:15:48.661560+0000","last_undegraded":"2024-01-19T04:15:48.661560+0000","last_fullsized":"2024-01-19T04:15:48.661560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641934+0000","last_change":"2024-01-19T04:15:48.641934+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641934+0000","last_undegraded":"2024-01-19T04:15:48.641934+0000","last_fullsized":"2024-01-19T04:15:48.641934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662639+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:15:48.662639+0000","last_peered":"2024-01-19T04:15:48.662639+0000","last_clean":"2024-01-19T04:15:48.662639+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:15:48.662639+0000","last_undegraded":"2024-01-19T04:15:48.662639+0000","last_fullsized":"2024-01-19T04:15:48.662639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640762+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:15:50.640762+0000","last_peered":"2024-01-19T04:15:50.640762+0000","last_clean":"2024-01-19T04:15:50.640762+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:15:50.640762+0000","last_undegraded":"2024-01-19T04:15:50.640762+0000","last_fullsized":"2024-01-19T04:15:50.640762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.657082+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:49.657082+0000","last_peered":"2024-01-19T04:15:49.657082+0000","last_clean":"2024-01-19T04:15:49.657082+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:49.657082+0000","last_undegraded":"2024-01-19T04:15:49.657082+0000","last_fullsized":"2024-01-19T04:15:49.657082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678883+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:49.678883+0000","last_peered":"2024-01-19T04:15:49.678883+0000","last_clean":"2024-01-19T04:15:49.678883+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:49.678883+0000","last_undegraded":"2024-01-19T04:15:49.678883+0000","last_fullsized":"2024-01-19T04:15:49.678883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:54.821580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650111+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:15:49.650111+0000","last_peered":"2024-01-19T04:15:49.650111+0000","last_clean":"2024-01-19T04:15:49.650111+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:15:49.650111+0000","last_undegraded":"2024-01-19T04:15:49.650111+0000","last_fullsized":"2024-01-19T04:15:49.650111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669787+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:49.669787+0000","last_peered":"2024-01-19T04:15:49.669787+0000","last_clean":"2024-01-19T04:15:49.669787+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:49.669787+0000","last_undegraded":"2024-01-19T04:15:49.669787+0000","last_fullsized":"2024-01-19T04:15:49.669787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.647622+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:49.647622+0000","last_peered":"2024-01-19T04:15:49.647622+0000","last_clean":"2024-01-19T04:15:49.647622+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:49.647622+0000","last_undegraded":"2024-01-19T04:15:49.647622+0000","last_fullsized":"2024-01-19T04:15:49.647622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.653449+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:48.653449+0000","last_peered":"2024-01-19T04:15:48.653449+0000","last_clean":"2024-01-19T04:15:48.653449+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:48.653449+0000","last_undegraded":"2024-01-19T04:15:48.653449+0000","last_fullsized":"2024-01-19T04:15:48.653449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":725603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":142626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":4,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":128968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":719336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":149944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.379}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:54.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:54.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.334+0000 7f71b7600640 1 Processor -- start 2024-01-19T04:15:54.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.334+0000 7f71b7600640 1 -- start start 2024-01-19T04:15:54.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b7600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f71b0151b00 0x7f71b00bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b7600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71b00c06f0 0x7f71b00c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b7600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0066580 0x7f71b00c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b7600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00c10a0 con 0x7f71b00c06f0 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b7600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00c1380 con 0x7f71b0151b00 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b7600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c2290 con 0x7f71b0066580 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71b00c06f0 0x7f71b00c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71b00c06f0 0x7f71b00c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33634/0 (socket says 172.21.15.32:33634) 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b4c00640 1 --2- 172.21.15.32:0/3971027905 >> v2:172.21.15.67:3300/0 conn(0x7f71b0151b00 0x7f71b00bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 -- 172.21.15.32:0/3971027905 learned_addr learned my addr 172.21.15.32:0/3971027905 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71b5600640 1 --2- 172.21.15.32:0/3971027905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0066580 0x7f71b00c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 -- 172.21.15.32:0/3971027905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0066580 msgr2=0x7f71b00c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 --2- 172.21.15.32:0/3971027905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0066580 0x7f71b00c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 -- 172.21.15.32:0/3971027905 >> v2:172.21.15.67:3300/0 conn(0x7f71b0151b00 msgr2=0x7f71b00bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:54.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 --2- 172.21.15.32:0/3971027905 >> v2:172.21.15.67:3300/0 conn(0x7f71b0151b00 0x7f71b00bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.338+0000 7f71afe00640 1 -- 172.21.15.32:0/3971027905 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0066a40 con 0x7f71b00c06f0 2024-01-19T04:15:54.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71afe00640 1 --2- 172.21.15.32:0/3971027905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b00c1810 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f71b0073070 tx=0x7f719801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf2301b82a058c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:54.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71af400640 1 -- 172.21.15.32:0/3971027905 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980ab600 con 0x7f71b00c06f0 2024-01-19T04:15:54.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71af400640 1 -- 172.21.15.32:0/3971027905 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71980a7050 con 0x7f71b00c06f0 2024-01-19T04:15:54.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71af400640 1 -- 172.21.15.32:0/3971027905 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980ab980 con 0x7f71b00c06f0 2024-01-19T04:15:54.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 -- 172.21.15.32:0/3971027905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 msgr2=0x7f71b00c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 --2- 172.21.15.32:0/3971027905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b00c1810 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f71b0073070 tx=0x7f719801c3b0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 -- 172.21.15.32:0/3971027905 shutdown_connections 2024-01-19T04:15:54.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 --2- 172.21.15.32:0/3971027905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0066580 0x7f71b00c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 --2- 172.21.15.32:0/3971027905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b00c1810 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 --2- 172.21.15.32:0/3971027905 >> v2:172.21.15.67:3300/0 conn(0x7f71b0151b00 0x7f71b00bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 -- 172.21.15.32:0/3971027905 >> 172.21.15.32:0/3971027905 conn(0x7f71b00c2f00 msgr2=0x7f71b00c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:54.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 -- 172.21.15.32:0/3971027905 shutdown_connections 2024-01-19T04:15:54.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 -- 172.21.15.32:0/3971027905 wait complete. 2024-01-19T04:15:54.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 Processor -- start 2024-01-19T04:15:54.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.342+0000 7f71b7600640 1 -- start start 2024-01-19T04:15:54.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71b0066580 0x7f71b01476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b01f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0151b00 0x7f71b01f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c48f0 con 0x7f71b00c06f0 2024-01-19T04:15:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c42a0 con 0x7f71b0066580 2024-01-19T04:15:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0145120 con 0x7f71b0151b00 2024-01-19T04:15:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b01f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b01f0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33638/0 (socket says 172.21.15.32:33638) 2024-01-19T04:15:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 -- 172.21.15.32:0/2869417904 learned_addr learned my addr 172.21.15.32:0/2869417904 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b4c00640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71b0066580 0x7f71b01476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b5600640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0151b00 0x7f71b01f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 -- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0151b00 msgr2=0x7f71b01f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0151b00 0x7f71b01f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 -- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71b0066580 msgr2=0x7f71b01476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71b0066580 0x7f71b01476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 -- 172.21.15.32:0/2869417904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980094d0 con 0x7f71b00c06f0 2024-01-19T04:15:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71afe00640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b01f0bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f71980ae040 tx=0x7f71b01555a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71acc00640 1 -- 172.21.15.32:0/2869417904 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980b4420 con 0x7f71b00c06f0 2024-01-19T04:15:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71acc00640 1 -- 172.21.15.32:0/2869417904 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71980b4580 con 0x7f71b00c06f0 2024-01-19T04:15:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71acc00640 1 -- 172.21.15.32:0/2869417904 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980b48f0 con 0x7f71b00c06f0 2024-01-19T04:15:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b0152060 con 0x7f71b00c06f0 2024-01-19T04:15:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b01457c0 con 0x7f71b00c06f0 2024-01-19T04:15:54.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.346+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b00c4a30 con 0x7f71b00c06f0 2024-01-19T04:15:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.350+0000 7f71acc00640 1 -- 172.21.15.32:0/2869417904 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f71980b2070 con 0x7f71b00c06f0 2024-01-19T04:15:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.350+0000 7f71acc00640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7188066530 0x7f71880689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.350+0000 7f71acc00640 1 -- 172.21.15.32:0/2869417904 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f719811d810 con 0x7f71b00c06f0 2024-01-19T04:15:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.350+0000 7f71b4c00640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7188066530 0x7f71880689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.350+0000 7f71b4c00640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7188066530 0x7f71880689f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f71b01eb490 tx=0x7f71a0006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.354+0000 7f71acc00640 1 -- 172.21.15.32:0/2869417904 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f71b00c4a30 con 0x7f71b00c06f0 2024-01-19T04:15:54.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.510+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71b0154da0 con 0x7f7188066530 2024-01-19T04:15:54.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.514+0000 7f71acc00640 1 -- 172.21.15.32:0/2869417904 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266012 (secure 0 0 0) 0x7f71a00059a0 con 0x7f7188066530 2024-01-19T04:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:54.524 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:54.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7188066530 msgr2=0x7f71880689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7188066530 0x7f71880689f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f71b01eb490 tx=0x7f71a0006f90 comp rx=0 tx=0).stop 2024-01-19T04:15:54.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 msgr2=0x7f71b01f0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b01f0bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f71980ae040 tx=0x7f71b01555a0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 shutdown_connections 2024-01-19T04:15:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7188066530 0x7f71880689f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f71b0151b00 0x7f71b01f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71b00c06f0 0x7f71b01f0bc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 --2- 172.21.15.32:0/2869417904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71b0066580 0x7f71b01476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 >> 172.21.15.32:0/2869417904 conn(0x7f71b00c2f00 msgr2=0x7f71b015e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 shutdown_connections 2024-01-19T04:15:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.518+0000 7f71b7600640 1 -- 172.21.15.32:0/2869417904 wait complete. 2024-01-19T04:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-01-19T04:15:54.040829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236836,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737884,"statfs":{"total":773094113280,"available":772851593216,"internally_reserved":0,"allocated":4108288,"data_stored":2272182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001161"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668471+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:49.668471+0000","last_peered":"2024-01-19T04:15:49.668471+0000","last_clean":"2024-01-19T04:15:49.668471+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:49.668471+0000","last_undegraded":"2024-01-19T04:15:49.668471+0000","last_fullsized":"2024-01-19T04:15:49.668471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641586+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:15:50.641586+0000","last_peered":"2024-01-19T04:15:50.641586+0000","last_clean":"2024-01-19T04:15:50.641586+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:15:50.641586+0000","last_undegraded":"2024-01-19T04:15:50.641586+0000","last_fullsized":"2024-01-19T04:15:50.641586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676092+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:49.676092+0000","last_peered":"2024-01-19T04:15:49.676092+0000","last_clean":"2024-01-19T04:15:49.676092+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:49.676092+0000","last_undegraded":"2024-01-19T04:15:49.676092+0000","last_fullsized":"2024-01-19T04:15:49.676092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650023+0000","last_change":"2024-01-19T04:15:48.650023+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650023+0000","last_undegraded":"2024-01-19T04:15:48.650023+0000","last_fullsized":"2024-01-19T04:15:48.650023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645535+0000","last_change":"2024-01-19T04:15:48.645535+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645535+0000","last_undegraded":"2024-01-19T04:15:48.645535+0000","last_fullsized":"2024-01-19T04:15:48.645535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640911+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:15:50.640911+0000","last_peered":"2024-01-19T04:15:50.640911+0000","last_clean":"2024-01-19T04:15:50.640911+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:15:50.640911+0000","last_undegraded":"2024-01-19T04:15:50.640911+0000","last_fullsized":"2024-01-19T04:15:50.640911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666020+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:49.666020+0000","last_peered":"2024-01-19T04:15:49.666020+0000","last_clean":"2024-01-19T04:15:49.666020+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:49.666020+0000","last_undegraded":"2024-01-19T04:15:49.666020+0000","last_fullsized":"2024-01-19T04:15:49.666020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669768+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:49.669768+0000","last_peered":"2024-01-19T04:15:49.669768+0000","last_clean":"2024-01-19T04:15:49.669768+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:49.669768+0000","last_undegraded":"2024-01-19T04:15:49.669768+0000","last_fullsized":"2024-01-19T04:15:49.669768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678951+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:49.678951+0000","last_peered":"2024-01-19T04:15:49.678951+0000","last_clean":"2024-01-19T04:15:49.678951+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:49.678951+0000","last_undegraded":"2024-01-19T04:15:49.678951+0000","last_fullsized":"2024-01-19T04:15:49.678951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651444+0000","last_change":"2024-01-19T04:15:48.651444+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651444+0000","last_undegraded":"2024-01-19T04:15:48.651444+0000","last_fullsized":"2024-01-19T04:15:48.651444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669844+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:49.669844+0000","last_peered":"2024-01-19T04:15:49.669844+0000","last_clean":"2024-01-19T04:15:49.669844+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:49.669844+0000","last_undegraded":"2024-01-19T04:15:49.669844+0000","last_fullsized":"2024-01-19T04:15:49.669844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676171+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:49.676171+0000","last_peered":"2024-01-19T04:15:49.676171+0000","last_clean":"2024-01-19T04:15:49.676171+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:49.676171+0000","last_undegraded":"2024-01-19T04:15:49.676171+0000","last_fullsized":"2024-01-19T04:15:49.676171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.644524+0000","last_change":"2024-01-19T04:15:48.644524+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.644524+0000","last_undegraded":"2024-01-19T04:15:48.644524+0000","last_fullsized":"2024-01-19T04:15:48.644524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640965+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:15:50.640965+0000","last_peered":"2024-01-19T04:15:50.640965+0000","last_clean":"2024-01-19T04:15:50.640965+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:15:50.640965+0000","last_undegraded":"2024-01-19T04:15:50.640965+0000","last_fullsized":"2024-01-19T04:15:50.640965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676387+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:49.676387+0000","last_peered":"2024-01-19T04:15:49.676387+0000","last_clean":"2024-01-19T04:15:49.676387+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:49.676387+0000","last_undegraded":"2024-01-19T04:15:49.676387+0000","last_fullsized":"2024-01-19T04:15:49.676387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:03.072421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666662+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:49.666662+0000","last_peered":"2024-01-19T04:15:49.666662+0000","last_clean":"2024-01-19T04:15:49.666662+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:49.666662+0000","last_undegraded":"2024-01-19T04:15:49.666662+0000","last_fullsized":"2024-01-19T04:15:49.666662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668881+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:49.668881+0000","last_peered":"2024-01-19T04:15:49.668881+0000","last_clean":"2024-01-19T04:15:49.668881+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:49.668881+0000","last_undegraded":"2024-01-19T04:15:49.668881+0000","last_fullsized":"2024-01-19T04:15:49.668881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641405+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:15:50.641405+0000","last_peered":"2024-01-19T04:15:50.641405+0000","last_clean":"2024-01-19T04:15:50.641405+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:15:50.641405+0000","last_undegraded":"2024-01-19T04:15:50.641405+0000","last_fullsized":"2024-01-19T04:15:50.641405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641164+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:15:50.641164+0000","last_peered":"2024-01-19T04:15:50.641164+0000","last_clean":"2024-01-19T04:15:50.641164+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:15:50.641164+0000","last_undegraded":"2024-01-19T04:15:50.641164+0000","last_fullsized":"2024-01-19T04:15:50.641164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645213+0000","last_change":"2024-01-19T04:15:48.645213+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645213+0000","last_undegraded":"2024-01-19T04:15:48.645213+0000","last_fullsized":"2024-01-19T04:15:48.645213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670531+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:49.670531+0000","last_peered":"2024-01-19T04:15:49.670531+0000","last_clean":"2024-01-19T04:15:49.670531+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:49.670531+0000","last_undegraded":"2024-01-19T04:15:49.670531+0000","last_fullsized":"2024-01-19T04:15:49.670531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678899+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:49.678899+0000","last_peered":"2024-01-19T04:15:49.678899+0000","last_clean":"2024-01-19T04:15:49.678899+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:49.678899+0000","last_undegraded":"2024-01-19T04:15:49.678899+0000","last_fullsized":"2024-01-19T04:15:49.678899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641469+0000","last_change":"2024-01-19T04:15:48.641469+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641469+0000","last_undegraded":"2024-01-19T04:15:48.641469+0000","last_fullsized":"2024-01-19T04:15:48.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676153+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:49.676153+0000","last_peered":"2024-01-19T04:15:49.676153+0000","last_clean":"2024-01-19T04:15:49.676153+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:49.676153+0000","last_undegraded":"2024-01-19T04:15:49.676153+0000","last_fullsized":"2024-01-19T04:15:49.676153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651292+0000","last_change":"2024-01-19T04:15:48.651292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651292+0000","last_undegraded":"2024-01-19T04:15:48.651292+0000","last_fullsized":"2024-01-19T04:15:48.651292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641469+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:15:50.641469+0000","last_peered":"2024-01-19T04:15:50.641469+0000","last_clean":"2024-01-19T04:15:50.641469+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:15:50.641469+0000","last_undegraded":"2024-01-19T04:15:50.641469+0000","last_fullsized":"2024-01-19T04:15:50.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650320+0000","last_change":"2024-01-19T04:15:48.650320+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650320+0000","last_undegraded":"2024-01-19T04:15:48.650320+0000","last_fullsized":"2024-01-19T04:15:48.650320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676350+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:49.676350+0000","last_peered":"2024-01-19T04:15:49.676350+0000","last_clean":"2024-01-19T04:15:49.676350+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:49.676350+0000","last_undegraded":"2024-01-19T04:15:49.676350+0000","last_fullsized":"2024-01-19T04:15:49.676350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680534+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:49.680534+0000","last_peered":"2024-01-19T04:15:49.680534+0000","last_clean":"2024-01-19T04:15:49.680534+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:49.680534+0000","last_undegraded":"2024-01-19T04:15:49.680534+0000","last_fullsized":"2024-01-19T04:15:49.680534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.655741+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:49.655741+0000","last_peered":"2024-01-19T04:15:49.655741+0000","last_clean":"2024-01-19T04:15:49.655741+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:49.655741+0000","last_undegraded":"2024-01-19T04:15:49.655741+0000","last_fullsized":"2024-01-19T04:15:49.655741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668171+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:49.668171+0000","last_peered":"2024-01-19T04:15:49.668171+0000","last_clean":"2024-01-19T04:15:49.668171+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:49.668171+0000","last_undegraded":"2024-01-19T04:15:49.668171+0000","last_fullsized":"2024-01-19T04:15:49.668171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670090+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:49.670090+0000","last_peered":"2024-01-19T04:15:49.670090+0000","last_clean":"2024-01-19T04:15:49.670090+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:49.670090+0000","last_undegraded":"2024-01-19T04:15:49.670090+0000","last_fullsized":"2024-01-19T04:15:49.670090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.642670+0000","last_change":"2024-01-19T04:15:48.642670+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.642670+0000","last_undegraded":"2024-01-19T04:15:48.642670+0000","last_fullsized":"2024-01-19T04:15:48.642670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678384+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:49.678384+0000","last_peered":"2024-01-19T04:15:49.678384+0000","last_clean":"2024-01-19T04:15:49.678384+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:49.678384+0000","last_undegraded":"2024-01-19T04:15:49.678384+0000","last_fullsized":"2024-01-19T04:15:49.678384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672132+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:49.672132+0000","last_peered":"2024-01-19T04:15:49.672132+0000","last_clean":"2024-01-19T04:15:49.672132+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:49.672132+0000","last_undegraded":"2024-01-19T04:15:49.672132+0000","last_fullsized":"2024-01-19T04:15:49.672132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664952+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:15:48.664952+0000","last_peered":"2024-01-19T04:15:48.664952+0000","last_clean":"2024-01-19T04:15:48.664952+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:15:48.664952+0000","last_undegraded":"2024-01-19T04:15:48.664952+0000","last_fullsized":"2024-01-19T04:15:48.664952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680610+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:49.680610+0000","last_peered":"2024-01-19T04:15:49.680610+0000","last_clean":"2024-01-19T04:15:49.680610+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:49.680610+0000","last_undegraded":"2024-01-19T04:15:49.680610+0000","last_fullsized":"2024-01-19T04:15:49.680610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678989+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:15:49.678989+0000","last_peered":"2024-01-19T04:15:49.678989+0000","last_clean":"2024-01-19T04:15:49.678989+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:15:49.678989+0000","last_undegraded":"2024-01-19T04:15:49.678989+0000","last_fullsized":"2024-01-19T04:15:49.678989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649945+0000","last_change":"2024-01-19T04:15:48.649945+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649945+0000","last_undegraded":"2024-01-19T04:15:48.649945+0000","last_fullsized":"2024-01-19T04:15:48.649945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661721+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:15:48.661721+0000","last_peered":"2024-01-19T04:15:48.661721+0000","last_clean":"2024-01-19T04:15:48.661721+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:15:48.661721+0000","last_undegraded":"2024-01-19T04:15:48.661721+0000","last_fullsized":"2024-01-19T04:15:48.661721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:39.528701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670141+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:49.670141+0000","last_peered":"2024-01-19T04:15:49.670141+0000","last_clean":"2024-01-19T04:15:49.670141+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:49.670141+0000","last_undegraded":"2024-01-19T04:15:49.670141+0000","last_fullsized":"2024-01-19T04:15:49.670141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677397+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:49.677397+0000","last_peered":"2024-01-19T04:15:49.677397+0000","last_clean":"2024-01-19T04:15:49.677397+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:49.677397+0000","last_undegraded":"2024-01-19T04:15:49.677397+0000","last_fullsized":"2024-01-19T04:15:49.677397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.663229+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:49.663229+0000","last_peered":"2024-01-19T04:15:49.663229+0000","last_clean":"2024-01-19T04:15:49.663229+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:49.663229+0000","last_undegraded":"2024-01-19T04:15:49.663229+0000","last_fullsized":"2024-01-19T04:15:49.663229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677100+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:49.677100+0000","last_peered":"2024-01-19T04:15:49.677100+0000","last_clean":"2024-01-19T04:15:49.677100+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:49.677100+0000","last_undegraded":"2024-01-19T04:15:49.677100+0000","last_fullsized":"2024-01-19T04:15:49.677100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678851+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:49.678851+0000","last_peered":"2024-01-19T04:15:49.678851+0000","last_clean":"2024-01-19T04:15:49.678851+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:49.678851+0000","last_undegraded":"2024-01-19T04:15:49.678851+0000","last_fullsized":"2024-01-19T04:15:49.678851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.649952+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:15:49.649952+0000","last_peered":"2024-01-19T04:15:49.649952+0000","last_clean":"2024-01-19T04:15:49.649952+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:15:49.649952+0000","last_undegraded":"2024-01-19T04:15:49.649952+0000","last_fullsized":"2024-01-19T04:15:49.649952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647292+0000","last_change":"2024-01-19T04:15:48.647292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647292+0000","last_undegraded":"2024-01-19T04:15:48.647292+0000","last_fullsized":"2024-01-19T04:15:48.647292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656947+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:49.656947+0000","last_peered":"2024-01-19T04:15:49.656947+0000","last_clean":"2024-01-19T04:15:49.656947+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:49.656947+0000","last_undegraded":"2024-01-19T04:15:49.656947+0000","last_fullsized":"2024-01-19T04:15:49.656947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676221+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:49.676221+0000","last_peered":"2024-01-19T04:15:49.676221+0000","last_clean":"2024-01-19T04:15:49.676221+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:49.676221+0000","last_undegraded":"2024-01-19T04:15:49.676221+0000","last_fullsized":"2024-01-19T04:15:49.676221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651426+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:15:49.651426+0000","last_peered":"2024-01-19T04:15:49.651426+0000","last_clean":"2024-01-19T04:15:49.651426+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:15:49.651426+0000","last_undegraded":"2024-01-19T04:15:49.651426+0000","last_fullsized":"2024-01-19T04:15:49.651426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641366+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:15:50.641366+0000","last_peered":"2024-01-19T04:15:50.641366+0000","last_clean":"2024-01-19T04:15:50.641366+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:15:50.641366+0000","last_undegraded":"2024-01-19T04:15:50.641366+0000","last_fullsized":"2024-01-19T04:15:50.641366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.652008+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:15:48.652008+0000","last_peered":"2024-01-19T04:15:48.652008+0000","last_clean":"2024-01-19T04:15:48.652008+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:15:48.652008+0000","last_undegraded":"2024-01-19T04:15:48.652008+0000","last_fullsized":"2024-01-19T04:15:48.652008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641572+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:15:50.641572+0000","last_peered":"2024-01-19T04:15:50.641572+0000","last_clean":"2024-01-19T04:15:50.641572+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:15:50.641572+0000","last_undegraded":"2024-01-19T04:15:50.641572+0000","last_fullsized":"2024-01-19T04:15:50.641572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678079+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:49.678079+0000","last_peered":"2024-01-19T04:15:49.678079+0000","last_clean":"2024-01-19T04:15:49.678079+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:49.678079+0000","last_undegraded":"2024-01-19T04:15:49.678079+0000","last_fullsized":"2024-01-19T04:15:49.678079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676118+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:49.676118+0000","last_peered":"2024-01-19T04:15:49.676118+0000","last_clean":"2024-01-19T04:15:49.676118+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:49.676118+0000","last_undegraded":"2024-01-19T04:15:49.676118+0000","last_fullsized":"2024-01-19T04:15:49.676118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.682705+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:15:49.682705+0000","last_peered":"2024-01-19T04:15:49.682705+0000","last_clean":"2024-01-19T04:15:49.682705+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:15:49.682705+0000","last_undegraded":"2024-01-19T04:15:49.682705+0000","last_fullsized":"2024-01-19T04:15:49.682705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647172+0000","last_change":"2024-01-19T04:15:48.647172+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647172+0000","last_undegraded":"2024-01-19T04:15:48.647172+0000","last_fullsized":"2024-01-19T04:15:48.647172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673342+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:49.673342+0000","last_peered":"2024-01-19T04:15:49.673342+0000","last_clean":"2024-01-19T04:15:49.673342+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:49.673342+0000","last_undegraded":"2024-01-19T04:15:49.673342+0000","last_fullsized":"2024-01-19T04:15:49.673342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641100+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:15:50.641100+0000","last_peered":"2024-01-19T04:15:50.641100+0000","last_clean":"2024-01-19T04:15:50.641100+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:15:50.641100+0000","last_undegraded":"2024-01-19T04:15:50.641100+0000","last_fullsized":"2024-01-19T04:15:50.641100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662615+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:15:48.662615+0000","last_peered":"2024-01-19T04:15:48.662615+0000","last_clean":"2024-01-19T04:15:48.662615+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:15:48.662615+0000","last_undegraded":"2024-01-19T04:15:48.662615+0000","last_fullsized":"2024-01-19T04:15:48.662615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669955+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:49.669955+0000","last_peered":"2024-01-19T04:15:49.669955+0000","last_clean":"2024-01-19T04:15:49.669955+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:49.669955+0000","last_undegraded":"2024-01-19T04:15:49.669955+0000","last_fullsized":"2024-01-19T04:15:49.669955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650073+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:15:49.650073+0000","last_peered":"2024-01-19T04:15:49.650073+0000","last_clean":"2024-01-19T04:15:49.650073+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:15:49.650073+0000","last_undegraded":"2024-01-19T04:15:49.650073+0000","last_fullsized":"2024-01-19T04:15:49.650073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672209+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:49.672209+0000","last_peered":"2024-01-19T04:15:49.672209+0000","last_clean":"2024-01-19T04:15:49.672209+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:49.672209+0000","last_undegraded":"2024-01-19T04:15:49.672209+0000","last_fullsized":"2024-01-19T04:15:49.672209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.681628+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:15:49.681628+0000","last_peered":"2024-01-19T04:15:49.681628+0000","last_clean":"2024-01-19T04:15:49.681628+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:15:49.681628+0000","last_undegraded":"2024-01-19T04:15:49.681628+0000","last_fullsized":"2024-01-19T04:15:49.681628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680503+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:49.680503+0000","last_peered":"2024-01-19T04:15:49.680503+0000","last_clean":"2024-01-19T04:15:49.680503+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:49.680503+0000","last_undegraded":"2024-01-19T04:15:49.680503+0000","last_fullsized":"2024-01-19T04:15:49.680503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662772+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:15:48.662772+0000","last_peered":"2024-01-19T04:15:48.662772+0000","last_clean":"2024-01-19T04:15:48.662772+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:15:48.662772+0000","last_undegraded":"2024-01-19T04:15:48.662772+0000","last_fullsized":"2024-01-19T04:15:48.662772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677595+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:49.677595+0000","last_peered":"2024-01-19T04:15:49.677595+0000","last_clean":"2024-01-19T04:15:49.677595+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:49.677595+0000","last_undegraded":"2024-01-19T04:15:49.677595+0000","last_fullsized":"2024-01-19T04:15:49.677595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673222+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:49.673222+0000","last_peered":"2024-01-19T04:15:49.673222+0000","last_clean":"2024-01-19T04:15:49.673222+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:49.673222+0000","last_undegraded":"2024-01-19T04:15:49.673222+0000","last_fullsized":"2024-01-19T04:15:49.673222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649584+0000","last_change":"2024-01-19T04:15:48.649584+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649584+0000","last_undegraded":"2024-01-19T04:15:48.649584+0000","last_fullsized":"2024-01-19T04:15:48.649584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.671984+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:49.671984+0000","last_peered":"2024-01-19T04:15:49.671984+0000","last_clean":"2024-01-19T04:15:49.671984+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:49.671984+0000","last_undegraded":"2024-01-19T04:15:49.671984+0000","last_fullsized":"2024-01-19T04:15:49.671984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.646862+0000","last_change":"2024-01-19T04:15:48.646862+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.646862+0000","last_undegraded":"2024-01-19T04:15:48.646862+0000","last_fullsized":"2024-01-19T04:15:48.646862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.648427+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:49.648427+0000","last_peered":"2024-01-19T04:15:49.648427+0000","last_clean":"2024-01-19T04:15:49.648427+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:49.648427+0000","last_undegraded":"2024-01-19T04:15:49.648427+0000","last_fullsized":"2024-01-19T04:15:49.648427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647962+0000","last_change":"2024-01-19T04:15:48.647962+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647962+0000","last_undegraded":"2024-01-19T04:15:48.647962+0000","last_fullsized":"2024-01-19T04:15:48.647962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.663106+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:15:48.663106+0000","last_peered":"2024-01-19T04:15:48.663106+0000","last_clean":"2024-01-19T04:15:48.663106+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:15:48.663106+0000","last_undegraded":"2024-01-19T04:15:48.663106+0000","last_fullsized":"2024-01-19T04:15:48.663106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643940+0000","last_change":"2024-01-19T04:15:48.643940+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643940+0000","last_undegraded":"2024-01-19T04:15:48.643940+0000","last_fullsized":"2024-01-19T04:15:48.643940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.646876+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:49.646876+0000","last_peered":"2024-01-19T04:15:49.646876+0000","last_clean":"2024-01-19T04:15:49.646876+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:49.646876+0000","last_undegraded":"2024-01-19T04:15:49.646876+0000","last_fullsized":"2024-01-19T04:15:49.646876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643338+0000","last_change":"2024-01-19T04:15:48.643338+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643338+0000","last_undegraded":"2024-01-19T04:15:48.643338+0000","last_fullsized":"2024-01-19T04:15:48.643338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656957+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:49.656957+0000","last_peered":"2024-01-19T04:15:49.656957+0000","last_clean":"2024-01-19T04:15:49.656957+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:49.656957+0000","last_undegraded":"2024-01-19T04:15:49.656957+0000","last_fullsized":"2024-01-19T04:15:49.656957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666656+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:49.666656+0000","last_peered":"2024-01-19T04:15:49.666656+0000","last_clean":"2024-01-19T04:15:49.666656+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:49.666656+0000","last_undegraded":"2024-01-19T04:15:49.666656+0000","last_fullsized":"2024-01-19T04:15:49.666656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651014+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:49.651014+0000","last_peered":"2024-01-19T04:15:49.651014+0000","last_clean":"2024-01-19T04:15:49.651014+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:49.651014+0000","last_undegraded":"2024-01-19T04:15:49.651014+0000","last_fullsized":"2024-01-19T04:15:49.651014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645416+0000","last_change":"2024-01-19T04:15:48.645416+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645416+0000","last_undegraded":"2024-01-19T04:15:48.645416+0000","last_fullsized":"2024-01-19T04:15:48.645416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664162+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:15:48.664162+0000","last_peered":"2024-01-19T04:15:48.664162+0000","last_clean":"2024-01-19T04:15:48.664162+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:15:48.664162+0000","last_undegraded":"2024-01-19T04:15:48.664162+0000","last_fullsized":"2024-01-19T04:15:48.664162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676123+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:49.676123+0000","last_peered":"2024-01-19T04:15:49.676123+0000","last_clean":"2024-01-19T04:15:49.676123+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:49.676123+0000","last_undegraded":"2024-01-19T04:15:49.676123+0000","last_fullsized":"2024-01-19T04:15:49.676123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664961+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:15:48.664961+0000","last_peered":"2024-01-19T04:15:48.664961+0000","last_clean":"2024-01-19T04:15:48.664961+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:15:48.664961+0000","last_undegraded":"2024-01-19T04:15:48.664961+0000","last_fullsized":"2024-01-19T04:15:48.664961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641996+0000","last_change":"2024-01-19T04:15:48.641996+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641996+0000","last_undegraded":"2024-01-19T04:15:48.641996+0000","last_fullsized":"2024-01-19T04:15:48.641996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662751+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:15:48.662751+0000","last_peered":"2024-01-19T04:15:48.662751+0000","last_clean":"2024-01-19T04:15:48.662751+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:15:48.662751+0000","last_undegraded":"2024-01-19T04:15:48.662751+0000","last_fullsized":"2024-01-19T04:15:48.662751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668564+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:49.668564+0000","last_peered":"2024-01-19T04:15:49.668564+0000","last_clean":"2024-01-19T04:15:49.668564+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:49.668564+0000","last_undegraded":"2024-01-19T04:15:49.668564+0000","last_fullsized":"2024-01-19T04:15:49.668564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661560+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:15:48.661560+0000","last_peered":"2024-01-19T04:15:48.661560+0000","last_clean":"2024-01-19T04:15:48.661560+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:15:48.661560+0000","last_undegraded":"2024-01-19T04:15:48.661560+0000","last_fullsized":"2024-01-19T04:15:48.661560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641934+0000","last_change":"2024-01-19T04:15:48.641934+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641934+0000","last_undegraded":"2024-01-19T04:15:48.641934+0000","last_fullsized":"2024-01-19T04:15:48.641934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662639+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:15:48.662639+0000","last_peered":"2024-01-19T04:15:48.662639+0000","last_clean":"2024-01-19T04:15:48.662639+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:15:48.662639+0000","last_undegraded":"2024-01-19T04:15:48.662639+0000","last_fullsized":"2024-01-19T04:15:48.662639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640762+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:15:50.640762+0000","last_peered":"2024-01-19T04:15:50.640762+0000","last_clean":"2024-01-19T04:15:50.640762+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:15:50.640762+0000","last_undegraded":"2024-01-19T04:15:50.640762+0000","last_fullsized":"2024-01-19T04:15:50.640762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.657082+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:49.657082+0000","last_peered":"2024-01-19T04:15:49.657082+0000","last_clean":"2024-01-19T04:15:49.657082+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:49.657082+0000","last_undegraded":"2024-01-19T04:15:49.657082+0000","last_fullsized":"2024-01-19T04:15:49.657082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678883+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:49.678883+0000","last_peered":"2024-01-19T04:15:49.678883+0000","last_clean":"2024-01-19T04:15:49.678883+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:49.678883+0000","last_undegraded":"2024-01-19T04:15:49.678883+0000","last_fullsized":"2024-01-19T04:15:49.678883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:54.821580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650111+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:15:49.650111+0000","last_peered":"2024-01-19T04:15:49.650111+0000","last_clean":"2024-01-19T04:15:49.650111+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:15:49.650111+0000","last_undegraded":"2024-01-19T04:15:49.650111+0000","last_fullsized":"2024-01-19T04:15:49.650111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669787+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:49.669787+0000","last_peered":"2024-01-19T04:15:49.669787+0000","last_clean":"2024-01-19T04:15:49.669787+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:49.669787+0000","last_undegraded":"2024-01-19T04:15:49.669787+0000","last_fullsized":"2024-01-19T04:15:49.669787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.647622+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:49.647622+0000","last_peered":"2024-01-19T04:15:49.647622+0000","last_clean":"2024-01-19T04:15:49.647622+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:49.647622+0000","last_undegraded":"2024-01-19T04:15:49.647622+0000","last_fullsized":"2024-01-19T04:15:49.647622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.653449+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:48.653449+0000","last_peered":"2024-01-19T04:15:48.653449+0000","last_clean":"2024-01-19T04:15:48.653449+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:48.653449+0000","last_undegraded":"2024-01-19T04:15:48.653449+0000","last_fullsized":"2024-01-19T04:15:48.653449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":725603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":142626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":4,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":128968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":719336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":149944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.379}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:54.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.650023+0000', 'last_change': '2024-01-19T04:15:48.650023+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.650023+0000', 'last_undegraded': '2024-01-19T04:15:48.650023+0000', 'last_fullsized': '2024-01-19T04:15:48.650023+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.645535+0000', 'last_change': '2024-01-19T04:15:48.645535+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.645535+0000', 'last_undegraded': '2024-01-19T04:15:48.645535+0000', 'last_fullsized': '2024-01-19T04:15:48.645535+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.651444+0000', 'last_change': '2024-01-19T04:15:48.651444+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.651444+0000', 'last_undegraded': '2024-01-19T04:15:48.651444+0000', 'last_fullsized': '2024-01-19T04:15:48.651444+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.644524+0000', 'last_change': '2024-01-19T04:15:48.644524+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.644524+0000', 'last_undegraded': '2024-01-19T04:15:48.644524+0000', 'last_fullsized': '2024-01-19T04:15:48.644524+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.645213+0000', 'last_change': '2024-01-19T04:15:48.645213+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.645213+0000', 'last_undegraded': '2024-01-19T04:15:48.645213+0000', 'last_fullsized': '2024-01-19T04:15:48.645213+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-01-19T04:15:54.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.641469+0000', 'last_change': '2024-01-19T04:15:48.641469+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.641469+0000', 'last_undegraded': '2024-01-19T04:15:48.641469+0000', 'last_fullsized': '2024-01-19T04:15:48.641469+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:15:54.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-01-19T04:15:54.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.651292+0000', 'last_change': '2024-01-19T04:15:48.651292+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.651292+0000', 'last_undegraded': '2024-01-19T04:15:48.651292+0000', 'last_fullsized': '2024-01-19T04:15:48.651292+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-01-19T04:15:54.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.650320+0000', 'last_change': '2024-01-19T04:15:48.650320+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.650320+0000', 'last_undegraded': '2024-01-19T04:15:48.650320+0000', 'last_fullsized': '2024-01-19T04:15:48.650320+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.642670+0000', 'last_change': '2024-01-19T04:15:48.642670+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.642670+0000', 'last_undegraded': '2024-01-19T04:15:48.642670+0000', 'last_fullsized': '2024-01-19T04:15:48.642670+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.649945+0000', 'last_change': '2024-01-19T04:15:48.649945+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.649945+0000', 'last_undegraded': '2024-01-19T04:15:48.649945+0000', 'last_fullsized': '2024-01-19T04:15:48.649945+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.647292+0000', 'last_change': '2024-01-19T04:15:48.647292+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.647292+0000', 'last_undegraded': '2024-01-19T04:15:48.647292+0000', 'last_fullsized': '2024-01-19T04:15:48.647292+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.647172+0000', 'last_change': '2024-01-19T04:15:48.647172+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.647172+0000', 'last_undegraded': '2024-01-19T04:15:48.647172+0000', 'last_fullsized': '2024-01-19T04:15:48.647172+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.649584+0000', 'last_change': '2024-01-19T04:15:48.649584+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.649584+0000', 'last_undegraded': '2024-01-19T04:15:48.649584+0000', 'last_fullsized': '2024-01-19T04:15:48.649584+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:15:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.646862+0000', 'last_change': '2024-01-19T04:15:48.646862+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.646862+0000', 'last_undegraded': '2024-01-19T04:15:48.646862+0000', 'last_fullsized': '2024-01-19T04:15:48.646862+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.647962+0000', 'last_change': '2024-01-19T04:15:48.647962+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.647962+0000', 'last_undegraded': '2024-01-19T04:15:48.647962+0000', 'last_fullsized': '2024-01-19T04:15:48.647962+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.643940+0000', 'last_change': '2024-01-19T04:15:48.643940+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.643940+0000', 'last_undegraded': '2024-01-19T04:15:48.643940+0000', 'last_fullsized': '2024-01-19T04:15:48.643940+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.643338+0000', 'last_change': '2024-01-19T04:15:48.643338+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.643338+0000', 'last_undegraded': '2024-01-19T04:15:48.643338+0000', 'last_fullsized': '2024-01-19T04:15:48.643338+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.645416+0000', 'last_change': '2024-01-19T04:15:48.645416+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.645416+0000', 'last_undegraded': '2024-01-19T04:15:48.645416+0000', 'last_fullsized': '2024-01-19T04:15:48.645416+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-01-19T04:15:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.641996+0000', 'last_change': '2024-01-19T04:15:48.641996+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.641996+0000', 'last_undegraded': '2024-01-19T04:15:48.641996+0000', 'last_fullsized': '2024-01-19T04:15:48.641996+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:15:54.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-01-19T04:15:54.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:15:48.641934+0000', 'last_change': '2024-01-19T04:15:48.641934+0000', 'last_active': '2024-01-19T04:15:48.628711+0000', 'last_peered': '2024-01-19T04:15:48.628711+0000', 'last_clean': '2024-01-19T04:15:48.628711+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:15:48.641934+0000', 'last_undegraded': '2024-01-19T04:15:48.641934+0000', 'last_fullsized': '2024-01-19T04:15:48.641934+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'last_clean_scrub_stamp': '2024-01-19T04:15:48.628711+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:15:54.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-19T04:15:54.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.726+0000 7f4790e00640 1 Processor -- start 2024-01-19T04:15:54.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.726+0000 7f4790e00640 1 -- start start 2024-01-19T04:15:54.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4790e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c0c1bc0 0x7f478c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4790e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f478c06fe50 0x7f478c154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4790e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c157d60 con 0x7f478c0c8290 2024-01-19T04:15:54.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4790e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c158040 con 0x7f478c06fe50 2024-01-19T04:15:54.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4790e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c158320 con 0x7f478c0c1bc0 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4789400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c0c1bc0 0x7f478c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f478a800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f478c06fe50 0x7f478c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f478a800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f478c06fe50 0x7f478c154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:36440/0 (socket says 172.21.15.32:36440) 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f478a800640 1 -- 172.21.15.32:0/698602048 learned_addr learned my addr 172.21.15.32:0/698602048 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4789400640 1 -- 172.21.15.32:0/698602048 >> v2:172.21.15.67:3300/0 conn(0x7f478c06fe50 msgr2=0x7f478c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4789400640 1 --2- 172.21.15.32:0/698602048 >> v2:172.21.15.67:3300/0 conn(0x7f478c06fe50 0x7f478c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4788a00640 1 -- 172.21.15.32:0/698602048 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653180920 0 0) 0x7f478c157d60 con 0x7f478c0c8290 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4789400640 1 -- 172.21.15.32:0/698602048 >> v1:172.21.15.67:6789/0 conn(0x7f478c0c8290 legacy=0x7f478c0a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f4789400640 1 -- 172.21.15.32:0/698602048 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c158600 con 0x7f478c0c1bc0 2024-01-19T04:15:54.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.730+0000 7f478a800640 1 --2- 172.21.15.32:0/698602048 >> v2:172.21.15.67:3300/0 conn(0x7f478c06fe50 0x7f478c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:15:54.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4789400640 1 --2- 172.21.15.32:0/698602048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c0c1bc0 0x7f478c06f910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47740097c0 tx=0x7f477401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef303aa451f6e889 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:54.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4788a00640 1 -- 172.21.15.32:0/698602048 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740ab600 con 0x7f478c0c1bc0 2024-01-19T04:15:54.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4788a00640 1 -- 172.21.15.32:0/698602048 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47740a7050 con 0x7f478c0c1bc0 2024-01-19T04:15:54.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4788a00640 1 -- 172.21.15.32:0/698602048 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740ab980 con 0x7f478c0c1bc0 2024-01-19T04:15:54.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 -- 172.21.15.32:0/698602048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c0c1bc0 msgr2=0x7f478c06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 --2- 172.21.15.32:0/698602048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c0c1bc0 0x7f478c06f910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47740097c0 tx=0x7f477401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 -- 172.21.15.32:0/698602048 shutdown_connections 2024-01-19T04:15:54.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 --2- 172.21.15.32:0/698602048 >> v2:172.21.15.67:3300/0 conn(0x7f478c06fe50 0x7f478c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 --2- 172.21.15.32:0/698602048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c0c1bc0 0x7f478c06f910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 -- 172.21.15.32:0/698602048 >> 172.21.15.32:0/698602048 conn(0x7f478c0726d0 msgr2=0x7f478c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:54.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 -- 172.21.15.32:0/698602048 shutdown_connections 2024-01-19T04:15:54.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.734+0000 7f4790e00640 1 -- 172.21.15.32:0/698602048 wait complete. 2024-01-19T04:15:54.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 Processor -- start 2024-01-19T04:15:54.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 -- start start 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c06fe50 0x7f478c1f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478c0c1bc0 0x7f478c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f478c0c8290 0x7f478c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c159420 con 0x7f478c0c8290 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c151450 con 0x7f478c0c1bc0 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c150e60 con 0x7f478c06fe50 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f478c0c8290 0x7f478c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f478c0c8290 0x7f478c1533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33646/0 (socket says 172.21.15.32:33646) 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 -- 172.21.15.32:0/2167018986 learned_addr learned my addr 172.21.15.32:0/2167018986 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4789400640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478c0c1bc0 0x7f478c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4789e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c06fe50 0x7f478c1f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 -- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c06fe50 msgr2=0x7f478c1f10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c06fe50 0x7f478c1f10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 -- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478c0c1bc0 msgr2=0x7f478c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478c0c1bc0 0x7f478c152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 -- 172.21.15.32:0/2167018986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009b30 con 0x7f478c0c8290 2024-01-19T04:15:54.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4789400640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478c0c1bc0 0x7f478c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:54.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f478a800640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f478c0c8290 0x7f478c1533c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f478400efc0 tx=0x7f478400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4782000640 1 -- 172.21.15.32:0/2167018986 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784018070 con 0x7f478c0c8290 2024-01-19T04:15:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4782000640 1 -- 172.21.15.32:0/2167018986 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400f040 con 0x7f478c0c8290 2024-01-19T04:15:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774009420 con 0x7f478c0c8290 2024-01-19T04:15:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4782000640 1 -- 172.21.15.32:0/2167018986 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400ce00 con 0x7f478c0c8290 2024-01-19T04:15:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c1555b0 con 0x7f478c0c8290 2024-01-19T04:15:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.738+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c0749f0 con 0x7f478c0c8290 2024-01-19T04:15:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.742+0000 7f4782000640 1 -- 172.21.15.32:0/2167018986 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4784014480 con 0x7f478c0c8290 2024-01-19T04:15:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.742+0000 7f4782000640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4764066500 0x7f47640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.742+0000 7f4782000640 1 -- 172.21.15.32:0/2167018986 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4784083f70 con 0x7f478c0c8290 2024-01-19T04:15:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.742+0000 7f4789e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4764066500 0x7f47640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.742+0000 7f4789e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4764066500 0x7f47640689c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f477c000f70 tx=0x7f477c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:54.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.746+0000 7f4782000640 1 -- 172.21.15.32:0/2167018986 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f47840b54d0 con 0x7f478c0c8290 2024-01-19T04:15:54.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f478c0a6e50 con 0x7f478c0c8290 2024-01-19T04:15:54.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4782000640 1 -- 172.21.15.32:0/2167018986 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1646 (secure 0 0 0) 0x7f47840512a0 con 0x7f478c0c8290 2024-01-19T04:15:54.963 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:54.963 INFO:teuthology.orchestra.run.smithi032.stdout:{"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1705637689,"num_in_osds":8,"osd_in_since":1705637679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":77},{"state_name":"creating+peering","count":20}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592756,"bytes_used":242520064,"bytes_avail":772851593216,"bytes_total":773094113280,"inactive_pgs_ratio":0.20618556439876556,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5031}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-19T04:15:52.040511+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-19T04:15:54.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4764066500 msgr2=0x7f47640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4764066500 0x7f47640689c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f477c000f70 tx=0x7f477c009040 comp rx=0 tx=0).stop 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f478c0c8290 msgr2=0x7f478c1533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f478c0c8290 0x7f478c1533c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f478400efc0 tx=0x7f478400c490 comp rx=0 tx=0).stop 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 shutdown_connections 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4764066500 0x7f47640689c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f478c0c8290 0x7f478c1533c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f478c0c1bc0 0x7f478c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 --2- 172.21.15.32:0/2167018986 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f478c06fe50 0x7f478c1f10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 >> 172.21.15.32:0/2167018986 conn(0x7f478c0726d0 msgr2=0x7f478c15e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 shutdown_connections 2024-01-19T04:15:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:54.962+0000 7f4790e00640 1 -- 172.21.15.32:0/2167018986 wait complete. 2024-01-19T04:15:54.984 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-19T04:15:54.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:55.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb05a600640 1 Processor -- start 2024-01-19T04:15:55.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb05a600640 1 -- start start 2024-01-19T04:15:55.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb05a600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0540c6e20 0x7fb0540c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:55.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb05a600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0541533a0 con 0x7fb0540a6d30 2024-01-19T04:15:55.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb05a600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054152800 con 0x7fb05406fda0 2024-01-19T04:15:55.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb05a600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb054156380 con 0x7fb0540c6e20 2024-01-19T04:15:55.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb053400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0540c6e20 0x7fb0540c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:55.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb052a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb0540a6d30 0x7fb054152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54900/0 (socket says 172.21.15.32:54900) 2024-01-19T04:15:55.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb052a00640 1 -- 172.21.15.32:0/1571897693 learned_addr learned my addr 172.21.15.32:0/1571897693 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:55.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb052000640 1 -- 172.21.15.32:0/1571897693 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424131374 0 0) 0x7fb03c001120 con 0x7fb0540a6d30 2024-01-19T04:15:55.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb053400640 1 -- 172.21.15.32:0/1571897693 >> v1:172.21.15.67:6789/0 conn(0x7fb05406fda0 legacy=0x7fb05415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:55.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb053400640 1 -- 172.21.15.32:0/1571897693 >> v1:172.21.15.32:6789/0 conn(0x7fb0540a6d30 legacy=0x7fb054152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:55.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.126+0000 7fb053400640 1 -- 172.21.15.32:0/1571897693 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054156590 con 0x7fb0540c6e20 2024-01-19T04:15:55.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb053400640 1 --2- 172.21.15.32:0/1571897693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0540c7200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb0440097c0 tx=0x7fb04401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880815397534e633 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:55.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb052000640 1 -- 172.21.15.32:0/1571897693 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440ab600 con 0x7fb0540c6e20 2024-01-19T04:15:55.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb052000640 1 -- 172.21.15.32:0/1571897693 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0440a7050 con 0x7fb0540c6e20 2024-01-19T04:15:55.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb052000640 1 -- 172.21.15.32:0/1571897693 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440ab980 con 0x7fb0540c6e20 2024-01-19T04:15:55.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb05a600640 1 -- 172.21.15.32:0/1571897693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 msgr2=0x7fb0540c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:55.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb05a600640 1 --2- 172.21.15.32:0/1571897693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0540c7200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb0440097c0 tx=0x7fb04401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb05a600640 1 -- 172.21.15.32:0/1571897693 shutdown_connections 2024-01-19T04:15:55.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb05a600640 1 --2- 172.21.15.32:0/1571897693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0540c7200 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb05a600640 1 -- 172.21.15.32:0/1571897693 >> 172.21.15.32:0/1571897693 conn(0x7fb0540a9870 msgr2=0x7fb0540a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:55.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb05a600640 1 -- 172.21.15.32:0/1571897693 shutdown_connections 2024-01-19T04:15:55.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.130+0000 7fb05a600640 1 -- 172.21.15.32:0/1571897693 wait complete. 2024-01-19T04:15:55.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 Processor -- start 2024-01-19T04:15:55.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 -- start start 2024-01-19T04:15:55.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb05406fda0 0x7fb0541f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0540a6d30 0x7fb05414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0541548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540bd1a0 con 0x7fb0540c6e20 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541f1230 con 0x7fb05406fda0 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541f1510 con 0x7fb0540a6d30 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0541548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0541548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33658/0 (socket says 172.21.15.32:33658) 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 -- 172.21.15.32:0/3997336489 learned_addr learned my addr 172.21.15.32:0/3997336489 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053400640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb05406fda0 0x7fb0541f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb052a00640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0540a6d30 0x7fb05414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 -- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0540a6d30 msgr2=0x7fb05414b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0540a6d30 0x7fb05414b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 -- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb05406fda0 msgr2=0x7fb0541f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:55.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb05406fda0 0x7fb0541f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 -- 172.21.15.32:0/3997336489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb044009420 con 0x7fb0540c6e20 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053400640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb05406fda0 0x7fb0541f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb053e00640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0541548a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c770 tx=0x7fb04c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb04b400640 1 -- 172.21.15.32:0/3997336489 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c003b80 con 0x7fb0540c6e20 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb04b400640 1 -- 172.21.15.32:0/3997336489 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c003ce0 con 0x7fb0540c6e20 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb04b400640 1 -- 172.21.15.32:0/3997336489 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00aa90 con 0x7fb0540c6e20 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0540bcc80 con 0x7fb0540c6e20 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05414c400 con 0x7fb0540c6e20 2024-01-19T04:15:55.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.134+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0540bcae0 con 0x7fb0540c6e20 2024-01-19T04:15:55.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.138+0000 7fb04b400640 1 -- 172.21.15.32:0/3997336489 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb04c00abf0 con 0x7fb0540c6e20 2024-01-19T04:15:55.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.138+0000 7fb04b400640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb02c066500 0x7fb02c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:55.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.138+0000 7fb04b400640 1 -- 172.21.15.32:0/3997336489 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb04c083d10 con 0x7fb0540c6e20 2024-01-19T04:15:55.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.138+0000 7fb053400640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb02c066500 0x7fb02c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:55.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.138+0000 7fb053400640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb02c066500 0x7fb02c0689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0440ad000 tx=0x7fb0440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:55.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.142+0000 7fb04b400640 1 -- 172.21.15.32:0/3997336489 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb0540bcae0 con 0x7fb0540c6e20 2024-01-19T04:15:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.298+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0540c6b10 con 0x7fb02c066500 2024-01-19T04:15:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.306+0000 7fb04b400640 1 -- 172.21.15.32:0/3997336489 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266012 (secure 0 0 0) 0x7fb0440ab860 con 0x7fb02c066500 2024-01-19T04:15:55.311 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb02c066500 msgr2=0x7fb02c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb02c066500 0x7fb02c0689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0440ad000 tx=0x7fb0440a6000 comp rx=0 tx=0).stop 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 msgr2=0x7fb0541548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0541548a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c770 tx=0x7fb04c00cc30 comp rx=0 tx=0).stop 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 shutdown_connections 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb02c066500 0x7fb02c0689c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540c6e20 0x7fb0541548a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb0540a6d30 0x7fb05414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 --2- 172.21.15.32:0/3997336489 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb05406fda0 0x7fb0541f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 >> 172.21.15.32:0/3997336489 conn(0x7fb0540a9870 msgr2=0x7fb0540a8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 shutdown_connections 2024-01-19T04:15:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:55.310+0000 7fb05a600640 1 -- 172.21.15.32:0/3997336489 wait complete. 2024-01-19T04:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-01-19T04:15:54.040829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236836,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737884,"statfs":{"total":773094113280,"available":772851593216,"internally_reserved":0,"allocated":4108288,"data_stored":2272182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001161"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668471+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:49.668471+0000","last_peered":"2024-01-19T04:15:49.668471+0000","last_clean":"2024-01-19T04:15:49.668471+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:49.668471+0000","last_undegraded":"2024-01-19T04:15:49.668471+0000","last_fullsized":"2024-01-19T04:15:49.668471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641586+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:15:50.641586+0000","last_peered":"2024-01-19T04:15:50.641586+0000","last_clean":"2024-01-19T04:15:50.641586+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:15:50.641586+0000","last_undegraded":"2024-01-19T04:15:50.641586+0000","last_fullsized":"2024-01-19T04:15:50.641586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676092+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:49.676092+0000","last_peered":"2024-01-19T04:15:49.676092+0000","last_clean":"2024-01-19T04:15:49.676092+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:49.676092+0000","last_undegraded":"2024-01-19T04:15:49.676092+0000","last_fullsized":"2024-01-19T04:15:49.676092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650023+0000","last_change":"2024-01-19T04:15:48.650023+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650023+0000","last_undegraded":"2024-01-19T04:15:48.650023+0000","last_fullsized":"2024-01-19T04:15:48.650023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645535+0000","last_change":"2024-01-19T04:15:48.645535+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645535+0000","last_undegraded":"2024-01-19T04:15:48.645535+0000","last_fullsized":"2024-01-19T04:15:48.645535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640911+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:15:50.640911+0000","last_peered":"2024-01-19T04:15:50.640911+0000","last_clean":"2024-01-19T04:15:50.640911+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:15:50.640911+0000","last_undegraded":"2024-01-19T04:15:50.640911+0000","last_fullsized":"2024-01-19T04:15:50.640911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666020+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:49.666020+0000","last_peered":"2024-01-19T04:15:49.666020+0000","last_clean":"2024-01-19T04:15:49.666020+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:49.666020+0000","last_undegraded":"2024-01-19T04:15:49.666020+0000","last_fullsized":"2024-01-19T04:15:49.666020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669768+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:49.669768+0000","last_peered":"2024-01-19T04:15:49.669768+0000","last_clean":"2024-01-19T04:15:49.669768+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:49.669768+0000","last_undegraded":"2024-01-19T04:15:49.669768+0000","last_fullsized":"2024-01-19T04:15:49.669768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678951+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:49.678951+0000","last_peered":"2024-01-19T04:15:49.678951+0000","last_clean":"2024-01-19T04:15:49.678951+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:49.678951+0000","last_undegraded":"2024-01-19T04:15:49.678951+0000","last_fullsized":"2024-01-19T04:15:49.678951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651444+0000","last_change":"2024-01-19T04:15:48.651444+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651444+0000","last_undegraded":"2024-01-19T04:15:48.651444+0000","last_fullsized":"2024-01-19T04:15:48.651444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669844+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:49.669844+0000","last_peered":"2024-01-19T04:15:49.669844+0000","last_clean":"2024-01-19T04:15:49.669844+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:49.669844+0000","last_undegraded":"2024-01-19T04:15:49.669844+0000","last_fullsized":"2024-01-19T04:15:49.669844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676171+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:49.676171+0000","last_peered":"2024-01-19T04:15:49.676171+0000","last_clean":"2024-01-19T04:15:49.676171+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:49.676171+0000","last_undegraded":"2024-01-19T04:15:49.676171+0000","last_fullsized":"2024-01-19T04:15:49.676171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.644524+0000","last_change":"2024-01-19T04:15:48.644524+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.644524+0000","last_undegraded":"2024-01-19T04:15:48.644524+0000","last_fullsized":"2024-01-19T04:15:48.644524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640965+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:15:50.640965+0000","last_peered":"2024-01-19T04:15:50.640965+0000","last_clean":"2024-01-19T04:15:50.640965+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:15:50.640965+0000","last_undegraded":"2024-01-19T04:15:50.640965+0000","last_fullsized":"2024-01-19T04:15:50.640965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676387+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:49.676387+0000","last_peered":"2024-01-19T04:15:49.676387+0000","last_clean":"2024-01-19T04:15:49.676387+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:49.676387+0000","last_undegraded":"2024-01-19T04:15:49.676387+0000","last_fullsized":"2024-01-19T04:15:49.676387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:03.072421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666662+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:49.666662+0000","last_peered":"2024-01-19T04:15:49.666662+0000","last_clean":"2024-01-19T04:15:49.666662+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:49.666662+0000","last_undegraded":"2024-01-19T04:15:49.666662+0000","last_fullsized":"2024-01-19T04:15:49.666662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668881+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:49.668881+0000","last_peered":"2024-01-19T04:15:49.668881+0000","last_clean":"2024-01-19T04:15:49.668881+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:49.668881+0000","last_undegraded":"2024-01-19T04:15:49.668881+0000","last_fullsized":"2024-01-19T04:15:49.668881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641405+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:15:50.641405+0000","last_peered":"2024-01-19T04:15:50.641405+0000","last_clean":"2024-01-19T04:15:50.641405+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:15:50.641405+0000","last_undegraded":"2024-01-19T04:15:50.641405+0000","last_fullsized":"2024-01-19T04:15:50.641405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641164+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:15:50.641164+0000","last_peered":"2024-01-19T04:15:50.641164+0000","last_clean":"2024-01-19T04:15:50.641164+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:15:50.641164+0000","last_undegraded":"2024-01-19T04:15:50.641164+0000","last_fullsized":"2024-01-19T04:15:50.641164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645213+0000","last_change":"2024-01-19T04:15:48.645213+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645213+0000","last_undegraded":"2024-01-19T04:15:48.645213+0000","last_fullsized":"2024-01-19T04:15:48.645213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670531+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:49.670531+0000","last_peered":"2024-01-19T04:15:49.670531+0000","last_clean":"2024-01-19T04:15:49.670531+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:49.670531+0000","last_undegraded":"2024-01-19T04:15:49.670531+0000","last_fullsized":"2024-01-19T04:15:49.670531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678899+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:49.678899+0000","last_peered":"2024-01-19T04:15:49.678899+0000","last_clean":"2024-01-19T04:15:49.678899+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:49.678899+0000","last_undegraded":"2024-01-19T04:15:49.678899+0000","last_fullsized":"2024-01-19T04:15:49.678899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641469+0000","last_change":"2024-01-19T04:15:48.641469+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641469+0000","last_undegraded":"2024-01-19T04:15:48.641469+0000","last_fullsized":"2024-01-19T04:15:48.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676153+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:49.676153+0000","last_peered":"2024-01-19T04:15:49.676153+0000","last_clean":"2024-01-19T04:15:49.676153+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:49.676153+0000","last_undegraded":"2024-01-19T04:15:49.676153+0000","last_fullsized":"2024-01-19T04:15:49.676153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.651292+0000","last_change":"2024-01-19T04:15:48.651292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.651292+0000","last_undegraded":"2024-01-19T04:15:48.651292+0000","last_fullsized":"2024-01-19T04:15:48.651292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641469+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:15:50.641469+0000","last_peered":"2024-01-19T04:15:50.641469+0000","last_clean":"2024-01-19T04:15:50.641469+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:15:50.641469+0000","last_undegraded":"2024-01-19T04:15:50.641469+0000","last_fullsized":"2024-01-19T04:15:50.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.650320+0000","last_change":"2024-01-19T04:15:48.650320+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.650320+0000","last_undegraded":"2024-01-19T04:15:48.650320+0000","last_fullsized":"2024-01-19T04:15:48.650320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676350+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:49.676350+0000","last_peered":"2024-01-19T04:15:49.676350+0000","last_clean":"2024-01-19T04:15:49.676350+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:49.676350+0000","last_undegraded":"2024-01-19T04:15:49.676350+0000","last_fullsized":"2024-01-19T04:15:49.676350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680534+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:49.680534+0000","last_peered":"2024-01-19T04:15:49.680534+0000","last_clean":"2024-01-19T04:15:49.680534+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:49.680534+0000","last_undegraded":"2024-01-19T04:15:49.680534+0000","last_fullsized":"2024-01-19T04:15:49.680534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.655741+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:49.655741+0000","last_peered":"2024-01-19T04:15:49.655741+0000","last_clean":"2024-01-19T04:15:49.655741+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:49.655741+0000","last_undegraded":"2024-01-19T04:15:49.655741+0000","last_fullsized":"2024-01-19T04:15:49.655741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668171+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:49.668171+0000","last_peered":"2024-01-19T04:15:49.668171+0000","last_clean":"2024-01-19T04:15:49.668171+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:49.668171+0000","last_undegraded":"2024-01-19T04:15:49.668171+0000","last_fullsized":"2024-01-19T04:15:49.668171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670090+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:49.670090+0000","last_peered":"2024-01-19T04:15:49.670090+0000","last_clean":"2024-01-19T04:15:49.670090+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:49.670090+0000","last_undegraded":"2024-01-19T04:15:49.670090+0000","last_fullsized":"2024-01-19T04:15:49.670090+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.642670+0000","last_change":"2024-01-19T04:15:48.642670+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.642670+0000","last_undegraded":"2024-01-19T04:15:48.642670+0000","last_fullsized":"2024-01-19T04:15:48.642670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678384+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:49.678384+0000","last_peered":"2024-01-19T04:15:49.678384+0000","last_clean":"2024-01-19T04:15:49.678384+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:49.678384+0000","last_undegraded":"2024-01-19T04:15:49.678384+0000","last_fullsized":"2024-01-19T04:15:49.678384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672132+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:49.672132+0000","last_peered":"2024-01-19T04:15:49.672132+0000","last_clean":"2024-01-19T04:15:49.672132+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:49.672132+0000","last_undegraded":"2024-01-19T04:15:49.672132+0000","last_fullsized":"2024-01-19T04:15:49.672132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:42.440150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664952+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:15:48.664952+0000","last_peered":"2024-01-19T04:15:48.664952+0000","last_clean":"2024-01-19T04:15:48.664952+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:15:48.664952+0000","last_undegraded":"2024-01-19T04:15:48.664952+0000","last_fullsized":"2024-01-19T04:15:48.664952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680610+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:49.680610+0000","last_peered":"2024-01-19T04:15:49.680610+0000","last_clean":"2024-01-19T04:15:49.680610+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:49.680610+0000","last_undegraded":"2024-01-19T04:15:49.680610+0000","last_fullsized":"2024-01-19T04:15:49.680610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678989+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:15:49.678989+0000","last_peered":"2024-01-19T04:15:49.678989+0000","last_clean":"2024-01-19T04:15:49.678989+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:15:49.678989+0000","last_undegraded":"2024-01-19T04:15:49.678989+0000","last_fullsized":"2024-01-19T04:15:49.678989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649945+0000","last_change":"2024-01-19T04:15:48.649945+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649945+0000","last_undegraded":"2024-01-19T04:15:48.649945+0000","last_fullsized":"2024-01-19T04:15:48.649945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661721+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:15:48.661721+0000","last_peered":"2024-01-19T04:15:48.661721+0000","last_clean":"2024-01-19T04:15:48.661721+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:15:48.661721+0000","last_undegraded":"2024-01-19T04:15:48.661721+0000","last_fullsized":"2024-01-19T04:15:48.661721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:39.528701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.670141+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:49.670141+0000","last_peered":"2024-01-19T04:15:49.670141+0000","last_clean":"2024-01-19T04:15:49.670141+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:49.670141+0000","last_undegraded":"2024-01-19T04:15:49.670141+0000","last_fullsized":"2024-01-19T04:15:49.670141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677397+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:49.677397+0000","last_peered":"2024-01-19T04:15:49.677397+0000","last_clean":"2024-01-19T04:15:49.677397+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:49.677397+0000","last_undegraded":"2024-01-19T04:15:49.677397+0000","last_fullsized":"2024-01-19T04:15:49.677397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.663229+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:49.663229+0000","last_peered":"2024-01-19T04:15:49.663229+0000","last_clean":"2024-01-19T04:15:49.663229+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:49.663229+0000","last_undegraded":"2024-01-19T04:15:49.663229+0000","last_fullsized":"2024-01-19T04:15:49.663229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677100+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:49.677100+0000","last_peered":"2024-01-19T04:15:49.677100+0000","last_clean":"2024-01-19T04:15:49.677100+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:49.677100+0000","last_undegraded":"2024-01-19T04:15:49.677100+0000","last_fullsized":"2024-01-19T04:15:49.677100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678851+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:49.678851+0000","last_peered":"2024-01-19T04:15:49.678851+0000","last_clean":"2024-01-19T04:15:49.678851+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:49.678851+0000","last_undegraded":"2024-01-19T04:15:49.678851+0000","last_fullsized":"2024-01-19T04:15:49.678851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.649952+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:15:49.649952+0000","last_peered":"2024-01-19T04:15:49.649952+0000","last_clean":"2024-01-19T04:15:49.649952+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:15:49.649952+0000","last_undegraded":"2024-01-19T04:15:49.649952+0000","last_fullsized":"2024-01-19T04:15:49.649952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647292+0000","last_change":"2024-01-19T04:15:48.647292+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647292+0000","last_undegraded":"2024-01-19T04:15:48.647292+0000","last_fullsized":"2024-01-19T04:15:48.647292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656947+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:49.656947+0000","last_peered":"2024-01-19T04:15:49.656947+0000","last_clean":"2024-01-19T04:15:49.656947+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:49.656947+0000","last_undegraded":"2024-01-19T04:15:49.656947+0000","last_fullsized":"2024-01-19T04:15:49.656947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676221+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:49.676221+0000","last_peered":"2024-01-19T04:15:49.676221+0000","last_clean":"2024-01-19T04:15:49.676221+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:49.676221+0000","last_undegraded":"2024-01-19T04:15:49.676221+0000","last_fullsized":"2024-01-19T04:15:49.676221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651426+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:15:49.651426+0000","last_peered":"2024-01-19T04:15:49.651426+0000","last_clean":"2024-01-19T04:15:49.651426+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:15:49.651426+0000","last_undegraded":"2024-01-19T04:15:49.651426+0000","last_fullsized":"2024-01-19T04:15:49.651426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641366+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:15:50.641366+0000","last_peered":"2024-01-19T04:15:50.641366+0000","last_clean":"2024-01-19T04:15:50.641366+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:15:50.641366+0000","last_undegraded":"2024-01-19T04:15:50.641366+0000","last_fullsized":"2024-01-19T04:15:50.641366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.652008+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:15:48.652008+0000","last_peered":"2024-01-19T04:15:48.652008+0000","last_clean":"2024-01-19T04:15:48.652008+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:15:48.652008+0000","last_undegraded":"2024-01-19T04:15:48.652008+0000","last_fullsized":"2024-01-19T04:15:48.652008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641572+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:15:50.641572+0000","last_peered":"2024-01-19T04:15:50.641572+0000","last_clean":"2024-01-19T04:15:50.641572+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:15:50.641572+0000","last_undegraded":"2024-01-19T04:15:50.641572+0000","last_fullsized":"2024-01-19T04:15:50.641572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678079+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:49.678079+0000","last_peered":"2024-01-19T04:15:49.678079+0000","last_clean":"2024-01-19T04:15:49.678079+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:49.678079+0000","last_undegraded":"2024-01-19T04:15:49.678079+0000","last_fullsized":"2024-01-19T04:15:49.678079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676118+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:49.676118+0000","last_peered":"2024-01-19T04:15:49.676118+0000","last_clean":"2024-01-19T04:15:49.676118+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:49.676118+0000","last_undegraded":"2024-01-19T04:15:49.676118+0000","last_fullsized":"2024-01-19T04:15:49.676118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.682705+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:15:49.682705+0000","last_peered":"2024-01-19T04:15:49.682705+0000","last_clean":"2024-01-19T04:15:49.682705+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:15:49.682705+0000","last_undegraded":"2024-01-19T04:15:49.682705+0000","last_fullsized":"2024-01-19T04:15:49.682705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647172+0000","last_change":"2024-01-19T04:15:48.647172+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647172+0000","last_undegraded":"2024-01-19T04:15:48.647172+0000","last_fullsized":"2024-01-19T04:15:48.647172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673342+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:49.673342+0000","last_peered":"2024-01-19T04:15:49.673342+0000","last_clean":"2024-01-19T04:15:49.673342+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:49.673342+0000","last_undegraded":"2024-01-19T04:15:49.673342+0000","last_fullsized":"2024-01-19T04:15:49.673342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641100+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:15:50.641100+0000","last_peered":"2024-01-19T04:15:50.641100+0000","last_clean":"2024-01-19T04:15:50.641100+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:15:50.641100+0000","last_undegraded":"2024-01-19T04:15:50.641100+0000","last_fullsized":"2024-01-19T04:15:50.641100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662615+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:15:48.662615+0000","last_peered":"2024-01-19T04:15:48.662615+0000","last_clean":"2024-01-19T04:15:48.662615+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:15:48.662615+0000","last_undegraded":"2024-01-19T04:15:48.662615+0000","last_fullsized":"2024-01-19T04:15:48.662615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669955+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:49.669955+0000","last_peered":"2024-01-19T04:15:49.669955+0000","last_clean":"2024-01-19T04:15:49.669955+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:49.669955+0000","last_undegraded":"2024-01-19T04:15:49.669955+0000","last_fullsized":"2024-01-19T04:15:49.669955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650073+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:15:49.650073+0000","last_peered":"2024-01-19T04:15:49.650073+0000","last_clean":"2024-01-19T04:15:49.650073+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:15:49.650073+0000","last_undegraded":"2024-01-19T04:15:49.650073+0000","last_fullsized":"2024-01-19T04:15:49.650073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.672209+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:49.672209+0000","last_peered":"2024-01-19T04:15:49.672209+0000","last_clean":"2024-01-19T04:15:49.672209+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:49.672209+0000","last_undegraded":"2024-01-19T04:15:49.672209+0000","last_fullsized":"2024-01-19T04:15:49.672209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:32.138686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.681628+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:15:49.681628+0000","last_peered":"2024-01-19T04:15:49.681628+0000","last_clean":"2024-01-19T04:15:49.681628+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:15:49.681628+0000","last_undegraded":"2024-01-19T04:15:49.681628+0000","last_fullsized":"2024-01-19T04:15:49.681628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680503+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:49.680503+0000","last_peered":"2024-01-19T04:15:49.680503+0000","last_clean":"2024-01-19T04:15:49.680503+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:49.680503+0000","last_undegraded":"2024-01-19T04:15:49.680503+0000","last_fullsized":"2024-01-19T04:15:49.680503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662772+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:15:48.662772+0000","last_peered":"2024-01-19T04:15:48.662772+0000","last_clean":"2024-01-19T04:15:48.662772+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:15:48.662772+0000","last_undegraded":"2024-01-19T04:15:48.662772+0000","last_fullsized":"2024-01-19T04:15:48.662772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.677595+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:49.677595+0000","last_peered":"2024-01-19T04:15:49.677595+0000","last_clean":"2024-01-19T04:15:49.677595+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:49.677595+0000","last_undegraded":"2024-01-19T04:15:49.677595+0000","last_fullsized":"2024-01-19T04:15:49.677595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673222+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:49.673222+0000","last_peered":"2024-01-19T04:15:49.673222+0000","last_clean":"2024-01-19T04:15:49.673222+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:49.673222+0000","last_undegraded":"2024-01-19T04:15:49.673222+0000","last_fullsized":"2024-01-19T04:15:49.673222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.649584+0000","last_change":"2024-01-19T04:15:48.649584+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.649584+0000","last_undegraded":"2024-01-19T04:15:48.649584+0000","last_fullsized":"2024-01-19T04:15:48.649584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.671984+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:49.671984+0000","last_peered":"2024-01-19T04:15:49.671984+0000","last_clean":"2024-01-19T04:15:49.671984+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:49.671984+0000","last_undegraded":"2024-01-19T04:15:49.671984+0000","last_fullsized":"2024-01-19T04:15:49.671984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.646862+0000","last_change":"2024-01-19T04:15:48.646862+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.646862+0000","last_undegraded":"2024-01-19T04:15:48.646862+0000","last_fullsized":"2024-01-19T04:15:48.646862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.648427+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:49.648427+0000","last_peered":"2024-01-19T04:15:49.648427+0000","last_clean":"2024-01-19T04:15:49.648427+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:49.648427+0000","last_undegraded":"2024-01-19T04:15:49.648427+0000","last_fullsized":"2024-01-19T04:15:49.648427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.647962+0000","last_change":"2024-01-19T04:15:48.647962+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.647962+0000","last_undegraded":"2024-01-19T04:15:48.647962+0000","last_fullsized":"2024-01-19T04:15:48.647962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.663106+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:15:48.663106+0000","last_peered":"2024-01-19T04:15:48.663106+0000","last_clean":"2024-01-19T04:15:48.663106+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:15:48.663106+0000","last_undegraded":"2024-01-19T04:15:48.663106+0000","last_fullsized":"2024-01-19T04:15:48.663106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643940+0000","last_change":"2024-01-19T04:15:48.643940+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643940+0000","last_undegraded":"2024-01-19T04:15:48.643940+0000","last_fullsized":"2024-01-19T04:15:48.643940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.646876+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:49.646876+0000","last_peered":"2024-01-19T04:15:49.646876+0000","last_clean":"2024-01-19T04:15:49.646876+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:49.646876+0000","last_undegraded":"2024-01-19T04:15:49.646876+0000","last_fullsized":"2024-01-19T04:15:49.646876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.643338+0000","last_change":"2024-01-19T04:15:48.643338+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.643338+0000","last_undegraded":"2024-01-19T04:15:48.643338+0000","last_fullsized":"2024-01-19T04:15:48.643338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.656957+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:49.656957+0000","last_peered":"2024-01-19T04:15:49.656957+0000","last_clean":"2024-01-19T04:15:49.656957+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:49.656957+0000","last_undegraded":"2024-01-19T04:15:49.656957+0000","last_fullsized":"2024-01-19T04:15:49.656957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.666656+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:49.666656+0000","last_peered":"2024-01-19T04:15:49.666656+0000","last_clean":"2024-01-19T04:15:49.666656+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:49.666656+0000","last_undegraded":"2024-01-19T04:15:49.666656+0000","last_fullsized":"2024-01-19T04:15:49.666656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651014+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:49.651014+0000","last_peered":"2024-01-19T04:15:49.651014+0000","last_clean":"2024-01-19T04:15:49.651014+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:49.651014+0000","last_undegraded":"2024-01-19T04:15:49.651014+0000","last_fullsized":"2024-01-19T04:15:49.651014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.645416+0000","last_change":"2024-01-19T04:15:48.645416+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.645416+0000","last_undegraded":"2024-01-19T04:15:48.645416+0000","last_fullsized":"2024-01-19T04:15:48.645416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664162+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:15:48.664162+0000","last_peered":"2024-01-19T04:15:48.664162+0000","last_clean":"2024-01-19T04:15:48.664162+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:15:48.664162+0000","last_undegraded":"2024-01-19T04:15:48.664162+0000","last_fullsized":"2024-01-19T04:15:48.664162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676123+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:49.676123+0000","last_peered":"2024-01-19T04:15:49.676123+0000","last_clean":"2024-01-19T04:15:49.676123+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:49.676123+0000","last_undegraded":"2024-01-19T04:15:49.676123+0000","last_fullsized":"2024-01-19T04:15:49.676123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.664961+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:15:48.664961+0000","last_peered":"2024-01-19T04:15:48.664961+0000","last_clean":"2024-01-19T04:15:48.664961+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:15:48.664961+0000","last_undegraded":"2024-01-19T04:15:48.664961+0000","last_fullsized":"2024-01-19T04:15:48.664961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641996+0000","last_change":"2024-01-19T04:15:48.641996+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641996+0000","last_undegraded":"2024-01-19T04:15:48.641996+0000","last_fullsized":"2024-01-19T04:15:48.641996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662751+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:15:48.662751+0000","last_peered":"2024-01-19T04:15:48.662751+0000","last_clean":"2024-01-19T04:15:48.662751+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:15:48.662751+0000","last_undegraded":"2024-01-19T04:15:48.662751+0000","last_fullsized":"2024-01-19T04:15:48.662751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.668564+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:49.668564+0000","last_peered":"2024-01-19T04:15:49.668564+0000","last_clean":"2024-01-19T04:15:49.668564+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:49.668564+0000","last_undegraded":"2024-01-19T04:15:49.668564+0000","last_fullsized":"2024-01-19T04:15:49.668564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.661560+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:15:48.661560+0000","last_peered":"2024-01-19T04:15:48.661560+0000","last_clean":"2024-01-19T04:15:48.661560+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:15:48.661560+0000","last_undegraded":"2024-01-19T04:15:48.661560+0000","last_fullsized":"2024-01-19T04:15:48.661560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-01-19T04:15:48.641934+0000","last_change":"2024-01-19T04:15:48.641934+0000","last_active":"2024-01-19T04:15:48.628711+0000","last_peered":"2024-01-19T04:15:48.628711+0000","last_clean":"2024-01-19T04:15:48.628711+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:15:48.641934+0000","last_undegraded":"2024-01-19T04:15:48.641934+0000","last_fullsized":"2024-01-19T04:15:48.641934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.662639+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:15:48.662639+0000","last_peered":"2024-01-19T04:15:48.662639+0000","last_clean":"2024-01-19T04:15:48.662639+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:15:48.662639+0000","last_undegraded":"2024-01-19T04:15:48.662639+0000","last_fullsized":"2024-01-19T04:15:48.662639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640762+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:15:50.640762+0000","last_peered":"2024-01-19T04:15:50.640762+0000","last_clean":"2024-01-19T04:15:50.640762+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:15:50.640762+0000","last_undegraded":"2024-01-19T04:15:50.640762+0000","last_fullsized":"2024-01-19T04:15:50.640762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.657082+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:49.657082+0000","last_peered":"2024-01-19T04:15:49.657082+0000","last_clean":"2024-01-19T04:15:49.657082+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:49.657082+0000","last_undegraded":"2024-01-19T04:15:49.657082+0000","last_fullsized":"2024-01-19T04:15:49.657082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678883+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:49.678883+0000","last_peered":"2024-01-19T04:15:49.678883+0000","last_clean":"2024-01-19T04:15:49.678883+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:49.678883+0000","last_undegraded":"2024-01-19T04:15:49.678883+0000","last_fullsized":"2024-01-19T04:15:49.678883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:48:54.821580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650111+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:15:49.650111+0000","last_peered":"2024-01-19T04:15:49.650111+0000","last_clean":"2024-01-19T04:15:49.650111+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:15:49.650111+0000","last_undegraded":"2024-01-19T04:15:49.650111+0000","last_fullsized":"2024-01-19T04:15:49.650111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669787+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:49.669787+0000","last_peered":"2024-01-19T04:15:49.669787+0000","last_clean":"2024-01-19T04:15:49.669787+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:49.669787+0000","last_undegraded":"2024-01-19T04:15:49.669787+0000","last_fullsized":"2024-01-19T04:15:49.669787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.647622+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:49.647622+0000","last_peered":"2024-01-19T04:15:49.647622+0000","last_clean":"2024-01-19T04:15:49.647622+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:49.647622+0000","last_undegraded":"2024-01-19T04:15:49.647622+0000","last_fullsized":"2024-01-19T04:15:49.647622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-19T04:15:48.653449+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:48.653449+0000","last_peered":"2024-01-19T04:15:48.653449+0000","last_clean":"2024-01-19T04:15:48.653449+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:48.653449+0000","last_undegraded":"2024-01-19T04:15:48.653449+0000","last_fullsized":"2024-01-19T04:15:48.653449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":725603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":142626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476750,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":4,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":135235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":128968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":719336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":149944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.379}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:58.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:15:58.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae79200640 1 Processor -- start 2024-01-19T04:15:58.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae79200640 1 -- start start 2024-01-19T04:15:58.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae79200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fae7414f8f0 0x7fae741559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae79200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae7414fcd0 0x7fae74155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae79200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae741530e0 con 0x7fae740c4130 2024-01-19T04:15:58.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae79200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae740c3130 con 0x7fae7414f8f0 2024-01-19T04:15:58.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae79200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae741527b0 con 0x7fae7414fcd0 2024-01-19T04:15:58.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae72800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fae740c4130 0x7fae740c4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41712/0 (socket says 172.21.15.32:41712) 2024-01-19T04:15:58.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae71e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fae7414f8f0 0x7fae741559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae72800640 1 -- 172.21.15.32:0/871554612 learned_addr learned my addr 172.21.15.32:0/871554612 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:58.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae71400640 1 --2- 172.21.15.32:0/871554612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae7414fcd0 0x7fae74155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae70a00640 1 -- 172.21.15.32:0/871554612 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762195609 0 0) 0x7fae741530e0 con 0x7fae740c4130 2024-01-19T04:15:58.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae71e00640 1 -- 172.21.15.32:0/871554612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae7414fcd0 msgr2=0x7fae74155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:58.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae71e00640 1 --2- 172.21.15.32:0/871554612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae7414fcd0 0x7fae74155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae71e00640 1 -- 172.21.15.32:0/871554612 >> v1:172.21.15.32:6789/0 conn(0x7fae740c4130 legacy=0x7fae740c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.490+0000 7fae71e00640 1 -- 172.21.15.32:0/871554612 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74152a90 con 0x7fae7414f8f0 2024-01-19T04:15:58.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae71e00640 1 --2- 172.21.15.32:0/871554612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae741559a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae640097c0 tx=0x7fae6401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568a75b5de4387fa server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:58.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae70a00640 1 -- 172.21.15.32:0/871554612 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640ab600 con 0x7fae7414f8f0 2024-01-19T04:15:58.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae70a00640 1 -- 172.21.15.32:0/871554612 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640ab760 con 0x7fae7414f8f0 2024-01-19T04:15:58.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae70a00640 1 -- 172.21.15.32:0/871554612 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640abaf0 con 0x7fae7414f8f0 2024-01-19T04:15:58.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 -- 172.21.15.32:0/871554612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 msgr2=0x7fae741559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 --2- 172.21.15.32:0/871554612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae741559a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae640097c0 tx=0x7fae6401c3e0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 -- 172.21.15.32:0/871554612 shutdown_connections 2024-01-19T04:15:58.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 --2- 172.21.15.32:0/871554612 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae7414fcd0 0x7fae74155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 --2- 172.21.15.32:0/871554612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae741559a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 -- 172.21.15.32:0/871554612 >> 172.21.15.32:0/871554612 conn(0x7fae7406ddb0 msgr2=0x7fae7406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:58.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 -- 172.21.15.32:0/871554612 shutdown_connections 2024-01-19T04:15:58.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.494+0000 7fae79200640 1 -- 172.21.15.32:0/871554612 wait complete. 2024-01-19T04:15:58.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 Processor -- start 2024-01-19T04:15:58.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 -- start start 2024-01-19T04:15:58.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae740c4130 0x7fae741edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae740b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae740b92a0 0x7fae740b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae741ee520 con 0x7fae7414f8f0 2024-01-19T04:15:58.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae740b4260 con 0x7fae740c4130 2024-01-19T04:15:58.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae740b5430 con 0x7fae740b92a0 2024-01-19T04:15:58.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae740b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae740b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43552/0 (socket says 172.21.15.32:43552) 2024-01-19T04:15:58.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 -- 172.21.15.32:0/2312297314 learned_addr learned my addr 172.21.15.32:0/2312297314 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:58.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71e00640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae740c4130 0x7fae741edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae72800640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae740b92a0 0x7fae740b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 -- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae740b92a0 msgr2=0x7fae740b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae740b92a0 0x7fae740b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 -- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae740c4130 msgr2=0x7fae741edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae740c4130 0x7fae741edfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 -- 172.21.15.32:0/2312297314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009420 con 0x7fae7414f8f0 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae72800640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae740b92a0 0x7fae740b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71e00640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae740c4130 0x7fae741edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae71400640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae740b7660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00e870 tx=0x7fae5c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae6a000640 1 -- 172.21.15.32:0/2312297314 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c009510 con 0x7fae7414f8f0 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae6a000640 1 -- 172.21.15.32:0/2312297314 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c00eec0 con 0x7fae7414f8f0 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae6a000640 1 -- 172.21.15.32:0/2312297314 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00cae0 con 0x7fae7414f8f0 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae740b9830 con 0x7fae7414f8f0 2024-01-19T04:15:58.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.498+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae740b3c10 con 0x7fae7414f8f0 2024-01-19T04:15:58.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.502+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae740749f0 con 0x7fae7414f8f0 2024-01-19T04:15:58.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.502+0000 7fae6a000640 1 -- 172.21.15.32:0/2312297314 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fae5c00cc40 con 0x7fae7414f8f0 2024-01-19T04:15:58.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.502+0000 7fae6a000640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae4c066500 0x7fae4c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.502+0000 7fae6a000640 1 -- 172.21.15.32:0/2312297314 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae5c084300 con 0x7fae7414f8f0 2024-01-19T04:15:58.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.502+0000 7fae71e00640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae4c066500 0x7fae4c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.502+0000 7fae71e00640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae4c066500 0x7fae4c0689c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fae640af000 tx=0x7fae64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:58.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.506+0000 7fae6a000640 1 -- 172.21.15.32:0/2312297314 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fae5c051590 con 0x7fae7414f8f0 2024-01-19T04:15:58.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.662+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae740b43a0 con 0x7fae4c066500 2024-01-19T04:15:58.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.670+0000 7fae6a000640 1 -- 172.21.15.32:0/2312297314 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289137 (secure 0 0 0) 0x7fae740b43a0 con 0x7fae4c066500 2024-01-19T04:15:58.676 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:58.677 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:15:58.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae4c066500 msgr2=0x7fae4c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae4c066500 0x7fae4c0689c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fae640af000 tx=0x7fae64008040 comp rx=0 tx=0).stop 2024-01-19T04:15:58.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 msgr2=0x7fae740b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae740b7660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00e870 tx=0x7fae5c00ec70 comp rx=0 tx=0).stop 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 shutdown_connections 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae4c066500 0x7fae4c0689c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae740b92a0 0x7fae740b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae7414f8f0 0x7fae740b7660 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 --2- 172.21.15.32:0/2312297314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae740c4130 0x7fae741edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 >> 172.21.15.32:0/2312297314 conn(0x7fae7406ddb0 msgr2=0x7fae7406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 shutdown_connections 2024-01-19T04:15:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.674+0000 7fae79200640 1 -- 172.21.15.32:0/2312297314 wait complete. 2024-01-19T04:15:58.698 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-01-19T04:15:58.041720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237052,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737668,"statfs":{"total":773094113280,"available":772851372032,"internally_reserved":0,"allocated":4333568,"data_stored":2372036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.403173"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393568+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:51.393568+0000","last_peered":"2024-01-19T04:15:51.393568+0000","last_clean":"2024-01-19T04:15:51.393568+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:51.393568+0000","last_undegraded":"2024-01-19T04:15:51.393568+0000","last_fullsized":"2024-01-19T04:15:51.393568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641586+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:15:50.641586+0000","last_peered":"2024-01-19T04:15:50.641586+0000","last_clean":"2024-01-19T04:15:50.641586+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:15:50.641586+0000","last_undegraded":"2024-01-19T04:15:50.641586+0000","last_fullsized":"2024-01-19T04:15:50.641586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642724+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:50.642724+0000","last_peered":"2024-01-19T04:15:50.642724+0000","last_clean":"2024-01-19T04:15:50.642724+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:50.642724+0000","last_undegraded":"2024-01-19T04:15:50.642724+0000","last_fullsized":"2024-01-19T04:15:50.642724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383372+0000","last_change":"2024-01-19T04:15:49.666858+0000","last_active":"2024-01-19T04:15:51.383372+0000","last_peered":"2024-01-19T04:15:51.383372+0000","last_clean":"2024-01-19T04:15:51.383372+0000","last_became_active":"2024-01-19T04:15:49.665093+0000","last_became_peered":"2024-01-19T04:15:49.665093+0000","last_unstale":"2024-01-19T04:15:51.383372+0000","last_undegraded":"2024-01-19T04:15:51.383372+0000","last_fullsized":"2024-01-19T04:15:51.383372+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.014698+0000","last_change":"2024-01-19T04:15:49.657523+0000","last_active":"2024-01-19T04:15:52.014698+0000","last_peered":"2024-01-19T04:15:52.014698+0000","last_clean":"2024-01-19T04:15:52.014698+0000","last_became_active":"2024-01-19T04:15:49.657239+0000","last_became_peered":"2024-01-19T04:15:49.657239+0000","last_unstale":"2024-01-19T04:15:52.014698+0000","last_undegraded":"2024-01-19T04:15:52.014698+0000","last_fullsized":"2024-01-19T04:15:52.014698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:50.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640911+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:15:50.640911+0000","last_peered":"2024-01-19T04:15:50.640911+0000","last_clean":"2024-01-19T04:15:50.640911+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:15:50.640911+0000","last_undegraded":"2024-01-19T04:15:50.640911+0000","last_fullsized":"2024-01-19T04:15:50.640911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277871+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:51.277871+0000","last_peered":"2024-01-19T04:15:51.277871+0000","last_clean":"2024-01-19T04:15:51.277871+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:51.277871+0000","last_undegraded":"2024-01-19T04:15:51.277871+0000","last_fullsized":"2024-01-19T04:15:51.277871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277680+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:51.277680+0000","last_peered":"2024-01-19T04:15:51.277680+0000","last_clean":"2024-01-19T04:15:51.277680+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:51.277680+0000","last_undegraded":"2024-01-19T04:15:51.277680+0000","last_fullsized":"2024-01-19T04:15:51.277680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016541+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:52.016541+0000","last_peered":"2024-01-19T04:15:52.016541+0000","last_clean":"2024-01-19T04:15:52.016541+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:52.016541+0000","last_undegraded":"2024-01-19T04:15:52.016541+0000","last_fullsized":"2024-01-19T04:15:52.016541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383750+0000","last_change":"2024-01-19T04:15:49.664498+0000","last_active":"2024-01-19T04:15:51.383750+0000","last_peered":"2024-01-19T04:15:51.383750+0000","last_clean":"2024-01-19T04:15:51.383750+0000","last_became_active":"2024-01-19T04:15:49.664196+0000","last_became_peered":"2024-01-19T04:15:49.664196+0000","last_unstale":"2024-01-19T04:15:51.383750+0000","last_undegraded":"2024-01-19T04:15:51.383750+0000","last_fullsized":"2024-01-19T04:15:51.383750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278196+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:51.278196+0000","last_peered":"2024-01-19T04:15:51.278196+0000","last_clean":"2024-01-19T04:15:51.278196+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:51.278196+0000","last_undegraded":"2024-01-19T04:15:51.278196+0000","last_fullsized":"2024-01-19T04:15:51.278196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642653+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:50.642653+0000","last_peered":"2024-01-19T04:15:50.642653+0000","last_clean":"2024-01-19T04:15:50.642653+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:50.642653+0000","last_undegraded":"2024-01-19T04:15:50.642653+0000","last_fullsized":"2024-01-19T04:15:50.642653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.014701+0000","last_change":"2024-01-19T04:15:49.657109+0000","last_active":"2024-01-19T04:15:52.014701+0000","last_peered":"2024-01-19T04:15:52.014701+0000","last_clean":"2024-01-19T04:15:52.014701+0000","last_became_active":"2024-01-19T04:15:49.656836+0000","last_became_peered":"2024-01-19T04:15:49.656836+0000","last_unstale":"2024-01-19T04:15:52.014701+0000","last_undegraded":"2024-01-19T04:15:52.014701+0000","last_fullsized":"2024-01-19T04:15:52.014701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:41.496335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640965+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:15:50.640965+0000","last_peered":"2024-01-19T04:15:50.640965+0000","last_clean":"2024-01-19T04:15:50.640965+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:15:50.640965+0000","last_undegraded":"2024-01-19T04:15:50.640965+0000","last_fullsized":"2024-01-19T04:15:50.640965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642317+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:50.642317+0000","last_peered":"2024-01-19T04:15:50.642317+0000","last_clean":"2024-01-19T04:15:50.642317+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:50.642317+0000","last_undegraded":"2024-01-19T04:15:50.642317+0000","last_fullsized":"2024-01-19T04:15:50.642317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278115+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:51.278115+0000","last_peered":"2024-01-19T04:15:51.278115+0000","last_clean":"2024-01-19T04:15:51.278115+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:51.278115+0000","last_undegraded":"2024-01-19T04:15:51.278115+0000","last_fullsized":"2024-01-19T04:15:51.278115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278260+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:51.278260+0000","last_peered":"2024-01-19T04:15:51.278260+0000","last_clean":"2024-01-19T04:15:51.278260+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:51.278260+0000","last_undegraded":"2024-01-19T04:15:51.278260+0000","last_fullsized":"2024-01-19T04:15:51.278260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641405+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:15:50.641405+0000","last_peered":"2024-01-19T04:15:50.641405+0000","last_clean":"2024-01-19T04:15:50.641405+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:15:50.641405+0000","last_undegraded":"2024-01-19T04:15:50.641405+0000","last_fullsized":"2024-01-19T04:15:50.641405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641164+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:15:50.641164+0000","last_peered":"2024-01-19T04:15:50.641164+0000","last_clean":"2024-01-19T04:15:50.641164+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:15:50.641164+0000","last_undegraded":"2024-01-19T04:15:50.641164+0000","last_fullsized":"2024-01-19T04:15:50.641164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.014988+0000","last_change":"2024-01-19T04:15:49.679977+0000","last_active":"2024-01-19T04:15:52.014988+0000","last_peered":"2024-01-19T04:15:52.014988+0000","last_clean":"2024-01-19T04:15:52.014988+0000","last_became_active":"2024-01-19T04:15:49.679706+0000","last_became_peered":"2024-01-19T04:15:49.679706+0000","last_unstale":"2024-01-19T04:15:52.014988+0000","last_undegraded":"2024-01-19T04:15:52.014988+0000","last_fullsized":"2024-01-19T04:15:52.014988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016134+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:52.016134+0000","last_peered":"2024-01-19T04:15:52.016134+0000","last_clean":"2024-01-19T04:15:52.016134+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:52.016134+0000","last_undegraded":"2024-01-19T04:15:52.016134+0000","last_fullsized":"2024-01-19T04:15:52.016134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016224+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:52.016224+0000","last_peered":"2024-01-19T04:15:52.016224+0000","last_clean":"2024-01-19T04:15:52.016224+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:52.016224+0000","last_undegraded":"2024-01-19T04:15:52.016224+0000","last_fullsized":"2024-01-19T04:15:52.016224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.380545+0000","last_change":"2024-01-19T04:15:49.645143+0000","last_active":"2024-01-19T04:15:51.380545+0000","last_peered":"2024-01-19T04:15:51.380545+0000","last_clean":"2024-01-19T04:15:51.380545+0000","last_became_active":"2024-01-19T04:15:49.644879+0000","last_became_peered":"2024-01-19T04:15:49.644879+0000","last_unstale":"2024-01-19T04:15:51.380545+0000","last_undegraded":"2024-01-19T04:15:51.380545+0000","last_fullsized":"2024-01-19T04:15:51.380545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642297+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:50.642297+0000","last_peered":"2024-01-19T04:15:50.642297+0000","last_clean":"2024-01-19T04:15:50.642297+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:50.642297+0000","last_undegraded":"2024-01-19T04:15:50.642297+0000","last_fullsized":"2024-01-19T04:15:50.642297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383905+0000","last_change":"2024-01-19T04:15:49.655156+0000","last_active":"2024-01-19T04:15:51.383905+0000","last_peered":"2024-01-19T04:15:51.383905+0000","last_clean":"2024-01-19T04:15:51.383905+0000","last_became_active":"2024-01-19T04:15:49.651743+0000","last_became_peered":"2024-01-19T04:15:49.651743+0000","last_unstale":"2024-01-19T04:15:51.383905+0000","last_undegraded":"2024-01-19T04:15:51.383905+0000","last_fullsized":"2024-01-19T04:15:51.383905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641469+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:15:50.641469+0000","last_peered":"2024-01-19T04:15:50.641469+0000","last_clean":"2024-01-19T04:15:50.641469+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:15:50.641469+0000","last_undegraded":"2024-01-19T04:15:50.641469+0000","last_fullsized":"2024-01-19T04:15:50.641469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383780+0000","last_change":"2024-01-19T04:15:49.672729+0000","last_active":"2024-01-19T04:15:51.383780+0000","last_peered":"2024-01-19T04:15:51.383780+0000","last_clean":"2024-01-19T04:15:51.383780+0000","last_became_active":"2024-01-19T04:15:49.672195+0000","last_became_peered":"2024-01-19T04:15:49.672195+0000","last_unstale":"2024-01-19T04:15:51.383780+0000","last_undegraded":"2024-01-19T04:15:51.383780+0000","last_fullsized":"2024-01-19T04:15:51.383780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642715+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:50.642715+0000","last_peered":"2024-01-19T04:15:50.642715+0000","last_clean":"2024-01-19T04:15:50.642715+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:50.642715+0000","last_undegraded":"2024-01-19T04:15:50.642715+0000","last_fullsized":"2024-01-19T04:15:50.642715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016203+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:52.016203+0000","last_peered":"2024-01-19T04:15:52.016203+0000","last_clean":"2024-01-19T04:15:52.016203+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:52.016203+0000","last_undegraded":"2024-01-19T04:15:52.016203+0000","last_fullsized":"2024-01-19T04:15:52.016203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278376+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:51.278376+0000","last_peered":"2024-01-19T04:15:51.278376+0000","last_clean":"2024-01-19T04:15:51.278376+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:51.278376+0000","last_undegraded":"2024-01-19T04:15:51.278376+0000","last_fullsized":"2024-01-19T04:15:51.278376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393521+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:51.393521+0000","last_peered":"2024-01-19T04:15:51.393521+0000","last_clean":"2024-01-19T04:15:51.393521+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:51.393521+0000","last_undegraded":"2024-01-19T04:15:51.393521+0000","last_fullsized":"2024-01-19T04:15:51.393521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277714+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:51.277714+0000","last_peered":"2024-01-19T04:15:51.277714+0000","last_clean":"2024-01-19T04:15:51.277714+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:51.277714+0000","last_undegraded":"2024-01-19T04:15:51.277714+0000","last_fullsized":"2024-01-19T04:15:51.277714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.380718+0000","last_change":"2024-01-19T04:15:49.650645+0000","last_active":"2024-01-19T04:15:51.380718+0000","last_peered":"2024-01-19T04:15:51.380718+0000","last_clean":"2024-01-19T04:15:51.380718+0000","last_became_active":"2024-01-19T04:15:49.650331+0000","last_became_peered":"2024-01-19T04:15:49.650331+0000","last_unstale":"2024-01-19T04:15:51.380718+0000","last_undegraded":"2024-01-19T04:15:51.380718+0000","last_fullsized":"2024-01-19T04:15:51.380718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.053977+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:50.053977+0000","last_peered":"2024-01-19T04:15:50.053977+0000","last_clean":"2024-01-19T04:15:50.053977+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:50.053977+0000","last_undegraded":"2024-01-19T04:15:50.053977+0000","last_fullsized":"2024-01-19T04:15:50.053977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393664+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:51.393664+0000","last_peered":"2024-01-19T04:15:51.393664+0000","last_clean":"2024-01-19T04:15:51.393664+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:51.393664+0000","last_undegraded":"2024-01-19T04:15:51.393664+0000","last_fullsized":"2024-01-19T04:15:51.393664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.669830+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:15:49.669830+0000","last_peered":"2024-01-19T04:15:49.669830+0000","last_clean":"2024-01-19T04:15:49.669830+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:15:49.669830+0000","last_undegraded":"2024-01-19T04:15:49.669830+0000","last_fullsized":"2024-01-19T04:15:49.669830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016331+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:52.016331+0000","last_peered":"2024-01-19T04:15:52.016331+0000","last_clean":"2024-01-19T04:15:52.016331+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:52.016331+0000","last_undegraded":"2024-01-19T04:15:52.016331+0000","last_fullsized":"2024-01-19T04:15:52.016331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.678989+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:15:49.678989+0000","last_peered":"2024-01-19T04:15:49.678989+0000","last_clean":"2024-01-19T04:15:49.678989+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:15:49.678989+0000","last_undegraded":"2024-01-19T04:15:49.678989+0000","last_fullsized":"2024-01-19T04:15:49.678989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383879+0000","last_change":"2024-01-19T04:15:49.671511+0000","last_active":"2024-01-19T04:15:51.383879+0000","last_peered":"2024-01-19T04:15:51.383879+0000","last_clean":"2024-01-19T04:15:51.383879+0000","last_became_active":"2024-01-19T04:15:49.670975+0000","last_became_peered":"2024-01-19T04:15:49.670975+0000","last_unstale":"2024-01-19T04:15:51.383879+0000","last_undegraded":"2024-01-19T04:15:51.383879+0000","last_fullsized":"2024-01-19T04:15:51.383879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.676037+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:15:49.676037+0000","last_peered":"2024-01-19T04:15:49.676037+0000","last_clean":"2024-01-19T04:15:49.676037+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:15:49.676037+0000","last_undegraded":"2024-01-19T04:15:49.676037+0000","last_fullsized":"2024-01-19T04:15:49.676037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:02.358517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278137+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:51.278137+0000","last_peered":"2024-01-19T04:15:51.278137+0000","last_clean":"2024-01-19T04:15:51.278137+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:51.278137+0000","last_undegraded":"2024-01-19T04:15:51.278137+0000","last_fullsized":"2024-01-19T04:15:51.278137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054540+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:50.054540+0000","last_peered":"2024-01-19T04:15:50.054540+0000","last_clean":"2024-01-19T04:15:50.054540+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:50.054540+0000","last_undegraded":"2024-01-19T04:15:50.054540+0000","last_fullsized":"2024-01-19T04:15:50.054540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642348+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:50.642348+0000","last_peered":"2024-01-19T04:15:50.642348+0000","last_clean":"2024-01-19T04:15:50.642348+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:50.642348+0000","last_undegraded":"2024-01-19T04:15:50.642348+0000","last_fullsized":"2024-01-19T04:15:50.642348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054519+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:50.054519+0000","last_peered":"2024-01-19T04:15:50.054519+0000","last_clean":"2024-01-19T04:15:50.054519+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:50.054519+0000","last_undegraded":"2024-01-19T04:15:50.054519+0000","last_fullsized":"2024-01-19T04:15:50.054519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015853+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:52.015853+0000","last_peered":"2024-01-19T04:15:52.015853+0000","last_clean":"2024-01-19T04:15:52.015853+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:52.015853+0000","last_undegraded":"2024-01-19T04:15:52.015853+0000","last_fullsized":"2024-01-19T04:15:52.015853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.649952+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:15:49.649952+0000","last_peered":"2024-01-19T04:15:49.649952+0000","last_clean":"2024-01-19T04:15:49.649952+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:15:49.649952+0000","last_undegraded":"2024-01-19T04:15:49.649952+0000","last_fullsized":"2024-01-19T04:15:49.649952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383211+0000","last_change":"2024-01-19T04:15:49.668312+0000","last_active":"2024-01-19T04:15:51.383211+0000","last_peered":"2024-01-19T04:15:51.383211+0000","last_clean":"2024-01-19T04:15:51.383211+0000","last_became_active":"2024-01-19T04:15:49.664719+0000","last_became_peered":"2024-01-19T04:15:49.664719+0000","last_unstale":"2024-01-19T04:15:51.383211+0000","last_undegraded":"2024-01-19T04:15:51.383211+0000","last_fullsized":"2024-01-19T04:15:51.383211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054476+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:50.054476+0000","last_peered":"2024-01-19T04:15:50.054476+0000","last_clean":"2024-01-19T04:15:50.054476+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:50.054476+0000","last_undegraded":"2024-01-19T04:15:50.054476+0000","last_fullsized":"2024-01-19T04:15:50.054476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642903+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:50.642903+0000","last_peered":"2024-01-19T04:15:50.642903+0000","last_clean":"2024-01-19T04:15:50.642903+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:50.642903+0000","last_undegraded":"2024-01-19T04:15:50.642903+0000","last_fullsized":"2024-01-19T04:15:50.642903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.651426+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:15:49.651426+0000","last_peered":"2024-01-19T04:15:49.651426+0000","last_clean":"2024-01-19T04:15:49.651426+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:15:49.651426+0000","last_undegraded":"2024-01-19T04:15:49.651426+0000","last_fullsized":"2024-01-19T04:15:49.651426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641366+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:15:50.641366+0000","last_peered":"2024-01-19T04:15:50.641366+0000","last_clean":"2024-01-19T04:15:50.641366+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:15:50.641366+0000","last_undegraded":"2024-01-19T04:15:50.641366+0000","last_fullsized":"2024-01-19T04:15:50.641366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.642215+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:15:49.642215+0000","last_peered":"2024-01-19T04:15:49.642215+0000","last_clean":"2024-01-19T04:15:49.642215+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:15:49.642215+0000","last_undegraded":"2024-01-19T04:15:49.642215+0000","last_fullsized":"2024-01-19T04:15:49.642215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641572+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:15:50.641572+0000","last_peered":"2024-01-19T04:15:50.641572+0000","last_clean":"2024-01-19T04:15:50.641572+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:15:50.641572+0000","last_undegraded":"2024-01-19T04:15:50.641572+0000","last_fullsized":"2024-01-19T04:15:50.641572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054382+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:50.054382+0000","last_peered":"2024-01-19T04:15:50.054382+0000","last_clean":"2024-01-19T04:15:50.054382+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:50.054382+0000","last_undegraded":"2024-01-19T04:15:50.054382+0000","last_fullsized":"2024-01-19T04:15:50.054382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642749+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:50.642749+0000","last_peered":"2024-01-19T04:15:50.642749+0000","last_clean":"2024-01-19T04:15:50.642749+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:50.642749+0000","last_undegraded":"2024-01-19T04:15:50.642749+0000","last_fullsized":"2024-01-19T04:15:50.642749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.682705+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:15:49.682705+0000","last_peered":"2024-01-19T04:15:49.682705+0000","last_clean":"2024-01-19T04:15:49.682705+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:15:49.682705+0000","last_undegraded":"2024-01-19T04:15:49.682705+0000","last_fullsized":"2024-01-19T04:15:49.682705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383232+0000","last_change":"2024-01-19T04:15:49.665258+0000","last_active":"2024-01-19T04:15:51.383232+0000","last_peered":"2024-01-19T04:15:51.383232+0000","last_clean":"2024-01-19T04:15:51.383232+0000","last_became_active":"2024-01-19T04:15:49.664987+0000","last_became_peered":"2024-01-19T04:15:49.664987+0000","last_unstale":"2024-01-19T04:15:51.383232+0000","last_undegraded":"2024-01-19T04:15:51.383232+0000","last_fullsized":"2024-01-19T04:15:51.383232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054548+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:50.054548+0000","last_peered":"2024-01-19T04:15:50.054548+0000","last_clean":"2024-01-19T04:15:50.054548+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:50.054548+0000","last_undegraded":"2024-01-19T04:15:50.054548+0000","last_fullsized":"2024-01-19T04:15:50.054548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.641100+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:15:50.641100+0000","last_peered":"2024-01-19T04:15:50.641100+0000","last_clean":"2024-01-19T04:15:50.641100+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:15:50.641100+0000","last_undegraded":"2024-01-19T04:15:50.641100+0000","last_fullsized":"2024-01-19T04:15:50.641100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.643689+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:15:49.643689+0000","last_peered":"2024-01-19T04:15:49.643689+0000","last_clean":"2024-01-19T04:15:49.643689+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:15:49.643689+0000","last_undegraded":"2024-01-19T04:15:49.643689+0000","last_fullsized":"2024-01-19T04:15:49.643689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277866+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:51.277866+0000","last_peered":"2024-01-19T04:15:51.277866+0000","last_clean":"2024-01-19T04:15:51.277866+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:51.277866+0000","last_undegraded":"2024-01-19T04:15:51.277866+0000","last_fullsized":"2024-01-19T04:15:51.277866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650073+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:15:49.650073+0000","last_peered":"2024-01-19T04:15:49.650073+0000","last_clean":"2024-01-19T04:15:49.650073+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:15:49.650073+0000","last_undegraded":"2024-01-19T04:15:49.650073+0000","last_fullsized":"2024-01-19T04:15:49.650073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393615+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:51.393615+0000","last_peered":"2024-01-19T04:15:51.393615+0000","last_clean":"2024-01-19T04:15:51.393615+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:51.393615+0000","last_undegraded":"2024-01-19T04:15:51.393615+0000","last_fullsized":"2024-01-19T04:15:51.393615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.681628+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:15:49.681628+0000","last_peered":"2024-01-19T04:15:49.681628+0000","last_clean":"2024-01-19T04:15:49.681628+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:15:49.681628+0000","last_undegraded":"2024-01-19T04:15:49.681628+0000","last_fullsized":"2024-01-19T04:15:49.681628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016464+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:52.016464+0000","last_peered":"2024-01-19T04:15:52.016464+0000","last_clean":"2024-01-19T04:15:52.016464+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:52.016464+0000","last_undegraded":"2024-01-19T04:15:52.016464+0000","last_fullsized":"2024-01-19T04:15:52.016464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.680494+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:15:49.680494+0000","last_peered":"2024-01-19T04:15:49.680494+0000","last_clean":"2024-01-19T04:15:49.680494+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:15:49.680494+0000","last_undegraded":"2024-01-19T04:15:49.680494+0000","last_fullsized":"2024-01-19T04:15:49.680494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642983+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:50.642983+0000","last_peered":"2024-01-19T04:15:50.642983+0000","last_clean":"2024-01-19T04:15:50.642983+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:50.642983+0000","last_undegraded":"2024-01-19T04:15:50.642983+0000","last_fullsized":"2024-01-19T04:15:50.642983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054636+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:50.054636+0000","last_peered":"2024-01-19T04:15:50.054636+0000","last_clean":"2024-01-19T04:15:50.054636+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:50.054636+0000","last_undegraded":"2024-01-19T04:15:50.054636+0000","last_fullsized":"2024-01-19T04:15:50.054636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.383339+0000","last_change":"2024-01-19T04:15:49.667350+0000","last_active":"2024-01-19T04:15:51.383339+0000","last_peered":"2024-01-19T04:15:51.383339+0000","last_clean":"2024-01-19T04:15:51.383339+0000","last_became_active":"2024-01-19T04:15:49.666589+0000","last_became_peered":"2024-01-19T04:15:49.666589+0000","last_unstale":"2024-01-19T04:15:51.383339+0000","last_undegraded":"2024-01-19T04:15:51.383339+0000","last_fullsized":"2024-01-19T04:15:51.383339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054607+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:50.054607+0000","last_peered":"2024-01-19T04:15:50.054607+0000","last_clean":"2024-01-19T04:15:50.054607+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:50.054607+0000","last_undegraded":"2024-01-19T04:15:50.054607+0000","last_fullsized":"2024-01-19T04:15:50.054607+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.014947+0000","last_change":"2024-01-19T04:15:49.658348+0000","last_active":"2024-01-19T04:15:52.014947+0000","last_peered":"2024-01-19T04:15:52.014947+0000","last_clean":"2024-01-19T04:15:52.014947+0000","last_became_active":"2024-01-19T04:15:49.656971+0000","last_became_peered":"2024-01-19T04:15:49.656971+0000","last_unstale":"2024-01-19T04:15:52.014947+0000","last_undegraded":"2024-01-19T04:15:52.014947+0000","last_fullsized":"2024-01-19T04:15:52.014947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054595+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:50.054595+0000","last_peered":"2024-01-19T04:15:50.054595+0000","last_clean":"2024-01-19T04:15:50.054595+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:50.054595+0000","last_undegraded":"2024-01-19T04:15:50.054595+0000","last_fullsized":"2024-01-19T04:15:50.054595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.014743+0000","last_change":"2024-01-19T04:15:49.669616+0000","last_active":"2024-01-19T04:15:52.014743+0000","last_peered":"2024-01-19T04:15:52.014743+0000","last_clean":"2024-01-19T04:15:52.014743+0000","last_became_active":"2024-01-19T04:15:49.667904+0000","last_became_peered":"2024-01-19T04:15:49.667904+0000","last_unstale":"2024-01-19T04:15:52.014743+0000","last_undegraded":"2024-01-19T04:15:52.014743+0000","last_fullsized":"2024-01-19T04:15:52.014743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:52.911948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.673264+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:15:49.673264+0000","last_peered":"2024-01-19T04:15:49.673264+0000","last_clean":"2024-01-19T04:15:49.673264+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:15:49.673264+0000","last_undegraded":"2024-01-19T04:15:49.673264+0000","last_fullsized":"2024-01-19T04:15:49.673264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.014822+0000","last_change":"2024-01-19T04:15:49.657920+0000","last_active":"2024-01-19T04:15:52.014822+0000","last_peered":"2024-01-19T04:15:52.014822+0000","last_clean":"2024-01-19T04:15:52.014822+0000","last_became_active":"2024-01-19T04:15:49.657332+0000","last_became_peered":"2024-01-19T04:15:49.657332+0000","last_unstale":"2024-01-19T04:15:52.014822+0000","last_undegraded":"2024-01-19T04:15:52.014822+0000","last_fullsized":"2024-01-19T04:15:52.014822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:10.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.053948+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:50.053948+0000","last_peered":"2024-01-19T04:15:50.053948+0000","last_clean":"2024-01-19T04:15:50.053948+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:50.053948+0000","last_undegraded":"2024-01-19T04:15:50.053948+0000","last_fullsized":"2024-01-19T04:15:50.053948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.014776+0000","last_change":"2024-01-19T04:15:49.660917+0000","last_active":"2024-01-19T04:15:52.014776+0000","last_peered":"2024-01-19T04:15:52.014776+0000","last_clean":"2024-01-19T04:15:52.014776+0000","last_became_active":"2024-01-19T04:15:49.655137+0000","last_became_peered":"2024-01-19T04:15:49.655137+0000","last_unstale":"2024-01-19T04:15:52.014776+0000","last_undegraded":"2024-01-19T04:15:52.014776+0000","last_fullsized":"2024-01-19T04:15:52.014776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:05:00.093326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054495+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:50.054495+0000","last_peered":"2024-01-19T04:15:50.054495+0000","last_clean":"2024-01-19T04:15:50.054495+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:50.054495+0000","last_undegraded":"2024-01-19T04:15:50.054495+0000","last_fullsized":"2024-01-19T04:15:50.054495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277801+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:51.277801+0000","last_peered":"2024-01-19T04:15:51.277801+0000","last_clean":"2024-01-19T04:15:51.277801+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:51.277801+0000","last_undegraded":"2024-01-19T04:15:51.277801+0000","last_fullsized":"2024-01-19T04:15:51.277801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054294+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:50.054294+0000","last_peered":"2024-01-19T04:15:50.054294+0000","last_clean":"2024-01-19T04:15:50.054294+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:50.054294+0000","last_undegraded":"2024-01-19T04:15:50.054294+0000","last_fullsized":"2024-01-19T04:15:50.054294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015035+0000","last_change":"2024-01-19T04:15:49.680184+0000","last_active":"2024-01-19T04:15:52.015035+0000","last_peered":"2024-01-19T04:15:52.015035+0000","last_clean":"2024-01-19T04:15:52.015035+0000","last_became_active":"2024-01-19T04:15:49.679925+0000","last_became_peered":"2024-01-19T04:15:49.679925+0000","last_unstale":"2024-01-19T04:15:52.015035+0000","last_undegraded":"2024-01-19T04:15:52.015035+0000","last_fullsized":"2024-01-19T04:15:52.015035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.681029+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:15:49.681029+0000","last_peered":"2024-01-19T04:15:49.681029+0000","last_clean":"2024-01-19T04:15:49.681029+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:15:49.681029+0000","last_undegraded":"2024-01-19T04:15:49.681029+0000","last_fullsized":"2024-01-19T04:15:49.681029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.643062+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:50.643062+0000","last_peered":"2024-01-19T04:15:50.643062+0000","last_clean":"2024-01-19T04:15:50.643062+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:50.643062+0000","last_undegraded":"2024-01-19T04:15:50.643062+0000","last_fullsized":"2024-01-19T04:15:50.643062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.380876+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:15:51.380876+0000","last_peered":"2024-01-19T04:15:51.380876+0000","last_clean":"2024-01-19T04:15:51.380876+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:15:51.380876+0000","last_undegraded":"2024-01-19T04:15:51.380876+0000","last_fullsized":"2024-01-19T04:15:51.380876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.380788+0000","last_change":"2024-01-19T04:15:49.667426+0000","last_active":"2024-01-19T04:15:51.380788+0000","last_peered":"2024-01-19T04:15:51.380788+0000","last_clean":"2024-01-19T04:15:51.380788+0000","last_became_active":"2024-01-19T04:15:49.667142+0000","last_became_peered":"2024-01-19T04:15:49.667142+0000","last_unstale":"2024-01-19T04:15:51.380788+0000","last_undegraded":"2024-01-19T04:15:51.380788+0000","last_fullsized":"2024-01-19T04:15:51.380788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.644065+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:15:49.644065+0000","last_peered":"2024-01-19T04:15:49.644065+0000","last_clean":"2024-01-19T04:15:49.644065+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:15:49.644065+0000","last_undegraded":"2024-01-19T04:15:49.644065+0000","last_fullsized":"2024-01-19T04:15:49.644065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393501+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:51.393501+0000","last_peered":"2024-01-19T04:15:51.393501+0000","last_clean":"2024-01-19T04:15:51.393501+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:51.393501+0000","last_undegraded":"2024-01-19T04:15:51.393501+0000","last_fullsized":"2024-01-19T04:15:51.393501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.642476+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:15:49.642476+0000","last_peered":"2024-01-19T04:15:49.642476+0000","last_clean":"2024-01-19T04:15:49.642476+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:15:49.642476+0000","last_undegraded":"2024-01-19T04:15:49.642476+0000","last_fullsized":"2024-01-19T04:15:49.642476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.380719+0000","last_change":"2024-01-19T04:15:49.653943+0000","last_active":"2024-01-19T04:15:51.380719+0000","last_peered":"2024-01-19T04:15:51.380719+0000","last_clean":"2024-01-19T04:15:51.380719+0000","last_became_active":"2024-01-19T04:15:49.653669+0000","last_became_peered":"2024-01-19T04:15:49.653669+0000","last_unstale":"2024-01-19T04:15:51.380719+0000","last_undegraded":"2024-01-19T04:15:51.380719+0000","last_fullsized":"2024-01-19T04:15:51.380719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.643831+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:15:49.643831+0000","last_peered":"2024-01-19T04:15:49.643831+0000","last_clean":"2024-01-19T04:15:49.643831+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:15:49.643831+0000","last_undegraded":"2024-01-19T04:15:49.643831+0000","last_fullsized":"2024-01-19T04:15:49.643831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.640762+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:15:50.640762+0000","last_peered":"2024-01-19T04:15:50.640762+0000","last_clean":"2024-01-19T04:15:50.640762+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:15:50.640762+0000","last_undegraded":"2024-01-19T04:15:50.640762+0000","last_fullsized":"2024-01-19T04:15:50.640762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.054505+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:50.054505+0000","last_peered":"2024-01-19T04:15:50.054505+0000","last_clean":"2024-01-19T04:15:50.054505+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:50.054505+0000","last_undegraded":"2024-01-19T04:15:50.054505+0000","last_fullsized":"2024-01-19T04:15:50.054505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015885+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:52.015885+0000","last_peered":"2024-01-19T04:15:52.015885+0000","last_clean":"2024-01-19T04:15:52.015885+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:52.015885+0000","last_undegraded":"2024-01-19T04:15:52.015885+0000","last_fullsized":"2024-01-19T04:15:52.015885+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.650111+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:15:49.650111+0000","last_peered":"2024-01-19T04:15:49.650111+0000","last_clean":"2024-01-19T04:15:49.650111+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:15:49.650111+0000","last_undegraded":"2024-01-19T04:15:49.650111+0000","last_fullsized":"2024-01-19T04:15:49.650111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277907+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:51.277907+0000","last_peered":"2024-01-19T04:15:51.277907+0000","last_clean":"2024-01-19T04:15:51.277907+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:51.277907+0000","last_undegraded":"2024-01-19T04:15:51.277907+0000","last_fullsized":"2024-01-19T04:15:51.277907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.053956+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:50.053956+0000","last_peered":"2024-01-19T04:15:50.053956+0000","last_clean":"2024-01-19T04:15:50.053956+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:50.053956+0000","last_undegraded":"2024-01-19T04:15:50.053956+0000","last_fullsized":"2024-01-19T04:15:50.053956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":174,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-19T04:15:49.643274+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:49.643274+0000","last_peered":"2024-01-19T04:15:49.643274+0000","last_clean":"2024-01-19T04:15:49.643274+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:49.643274+0000","last_undegraded":"2024-01-19T04:15:49.643274+0000","last_fullsized":"2024-01-19T04:15:49.643274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476752,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":738768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.79900000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.94799999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.874}]},{"osd":6,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77100000000000002}]}]},{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":148926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.435},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.59199999999999997}]}]},{"osd":5,"up_from":16,"seq":68719476751,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":148982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.629},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.746}]}]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":148414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.997}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.871}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.107}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":148380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.495},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.67500000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":149944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.32400000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.502}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.62},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.66300000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":738678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.499}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.432}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.71499999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":149944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.379}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:15:58.702 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:15:58.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-19T04:15:58.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc228200640 1 Processor -- start 2024-01-19T04:15:58.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc228200640 1 -- start start 2024-01-19T04:15:58.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc228200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc220151e60 0x7fc2200c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc228200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc228200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2200c36c0 con 0x7fc2200c1f60 2024-01-19T04:15:58.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc228200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2200c30e0 con 0x7fc220151e60 2024-01-19T04:15:58.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc228200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200c2b70 con 0x7fc2200c4fc0 2024-01-19T04:15:58.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc224e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc2200c1f60 0x7fc2200c48b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41714/0 (socket says 172.21.15.32:41714) 2024-01-19T04:15:58.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc224e00640 1 -- 172.21.15.32:0/102516519 learned_addr learned my addr 172.21.15.32:0/102516519 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:15:58.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.886+0000 7fc225800640 1 --2- 172.21.15.32:0/102516519 >> v2:172.21.15.32:3300/0 conn(0x7fc220151e60 0x7fc2200c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc226200640 1 --2- 172.21.15.32:0/102516519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc225800640 1 -- 172.21.15.32:0/102516519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 msgr2=0x7fc220155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:58.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc225800640 1 --2- 172.21.15.32:0/102516519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc225800640 1 -- 172.21.15.32:0/102516519 >> v1:172.21.15.32:6789/0 conn(0x7fc2200c1f60 legacy=0x7fc2200c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc225800640 1 -- 172.21.15.32:0/102516519 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2200c55a0 con 0x7fc220151e60 2024-01-19T04:15:58.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc21fe00640 1 -- 172.21.15.32:0/102516519 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246942010 0 0) 0x7fc208001120 con 0x7fc2200c1f60 2024-01-19T04:15:58.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc225800640 1 --2- 172.21.15.32:0/102516519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc220151e60 0x7fc2200c4240 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2100097c0 tx=0x7fc21001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294f6f0796c79c57 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:58.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc21fe00640 1 -- 172.21.15.32:0/102516519 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100ab600 con 0x7fc220151e60 2024-01-19T04:15:58.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc21fe00640 1 -- 172.21.15.32:0/102516519 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2100a7050 con 0x7fc220151e60 2024-01-19T04:15:58.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.890+0000 7fc21fe00640 1 -- 172.21.15.32:0/102516519 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100ab980 con 0x7fc220151e60 2024-01-19T04:15:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- 172.21.15.32:0/102516519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc220151e60 msgr2=0x7fc2200c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 --2- 172.21.15.32:0/102516519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc220151e60 0x7fc2200c4240 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2100097c0 tx=0x7fc21001c390 comp rx=0 tx=0).stop 2024-01-19T04:15:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- 172.21.15.32:0/102516519 shutdown_connections 2024-01-19T04:15:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 --2- 172.21.15.32:0/102516519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 --2- 172.21.15.32:0/102516519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc220151e60 0x7fc2200c4240 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- 172.21.15.32:0/102516519 >> 172.21.15.32:0/102516519 conn(0x7fc2200663f0 msgr2=0x7fc220066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- 172.21.15.32:0/102516519 shutdown_connections 2024-01-19T04:15:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- 172.21.15.32:0/102516519 wait complete. 2024-01-19T04:15:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 Processor -- start 2024-01-19T04:15:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- start start 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2200c1f60 0x7fc220157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc220151e60 0x7fc2201544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22014b6e0 con 0x7fc2200c1f60 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200aadf0 con 0x7fc220151e60 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc228200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2201f10e0 con 0x7fc2200c4fc0 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc225800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2200c1f60 0x7fc220157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc225800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2200c1f60 0x7fc220157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43562/0 (socket says 172.21.15.32:43562) 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.894+0000 7fc225800640 1 -- 172.21.15.32:0/3893935526 learned_addr learned my addr 172.21.15.32:0/3893935526 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc226200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc220151e60 0x7fc2201544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc224e00640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc225800640 1 -- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 msgr2=0x7fc220153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc225800640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc225800640 1 -- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc220151e60 msgr2=0x7fc2201544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc225800640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc220151e60 0x7fc2201544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc225800640 1 -- 172.21.15.32:0/3893935526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009420 con 0x7fc2200c1f60 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc226200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc220151e60 0x7fc2201544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc224e00640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc225800640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2200c1f60 0x7fc220157110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc210019fc0 tx=0x7fc210019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc21d600640 1 -- 172.21.15.32:0/3893935526 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100b4610 con 0x7fc2200c1f60 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc21d600640 1 -- 172.21.15.32:0/3893935526 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2100abe90 con 0x7fc2200c1f60 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc21d600640 1 -- 172.21.15.32:0/3893935526 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100b49d0 con 0x7fc2200c1f60 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2200c77d0 con 0x7fc2200c1f60 2024-01-19T04:15:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2201f13c0 con 0x7fc2200c1f60 2024-01-19T04:15:58.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2200749f0 con 0x7fc2200c1f60 2024-01-19T04:15:58.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc21d600640 1 -- 172.21.15.32:0/3893935526 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc2100b2040 con 0x7fc2200c1f60 2024-01-19T04:15:58.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc21d600640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1f8066500 0x7fc1f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:58.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.898+0000 7fc21d600640 1 -- 172.21.15.32:0/3893935526 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc21011df90 con 0x7fc2200c1f60 2024-01-19T04:15:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.902+0000 7fc224e00640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1f8066500 0x7fc1f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.902+0000 7fc224e00640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1f8066500 0x7fc1f80689c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc208007fd0 tx=0x7fc208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:58.902+0000 7fc21d600640 1 -- 172.21.15.32:0/3893935526 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc2100eb340 con 0x7fc2200c1f60 2024-01-19T04:15:59.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.118+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc220152470 con 0x7fc2200c1f60 2024-01-19T04:15:59.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.122+0000 7fc21d600640 1 -- 172.21.15.32:0/3893935526 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc2100ee960 con 0x7fc2200c1f60 2024-01-19T04:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-01-19T04:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q== 2024-01-19T04:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-01-19T04:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-01-19T04:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-19T04:15:59.125 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-01-19T04:15:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1f8066500 msgr2=0x7fc1f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1f8066500 0x7fc1f80689c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc208007fd0 tx=0x7fc208009040 comp rx=0 tx=0).stop 2024-01-19T04:15:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2200c1f60 msgr2=0x7fc220157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2200c1f60 0x7fc220157110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc210019fc0 tx=0x7fc210019130 comp rx=0 tx=0).stop 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 shutdown_connections 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc1f8066500 0x7fc1f80689c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc220151e60 0x7fc2201544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc2200c4fc0 0x7fc220153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 --2- 172.21.15.32:0/3893935526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2200c1f60 0x7fc220157110 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 >> 172.21.15.32:0/3893935526 conn(0x7fc2200663f0 msgr2=0x7fc220073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 shutdown_connections 2024-01-19T04:15:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.126+0000 7fc228200640 1 -- 172.21.15.32:0/3893935526 wait complete. 2024-01-19T04:15:59.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:15:59.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60b2a00640 1 Processor -- start 2024-01-19T04:15:59.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60b2a00640 1 -- start start 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60b2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac14fb50 0x7f60ac06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60b2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60ac0c04a0 0x7f60ac0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60b2a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac071e80 con 0x7f60ac0a4ec0 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60b2a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac1535c0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60b2a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0726c0 con 0x7f60ac14fb50 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60ab400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60ac0c04a0 0x7f60ac0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60ab400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60ac0c04a0 0x7f60ac0c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43564/0 (socket says 172.21.15.32:43564) 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60ab400640 1 -- 172.21.15.32:0/2751019065 learned_addr learned my addr 172.21.15.32:0/2751019065 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60abe00640 1 --2- 172.21.15.32:0/2751019065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac14fb50 0x7f60ac06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60ab400640 1 -- 172.21.15.32:0/2751019065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac14fb50 msgr2=0x7f60ac06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60ab400640 1 --2- 172.21.15.32:0/2751019065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac14fb50 0x7f60ac06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60ab400640 1 -- 172.21.15.32:0/2751019065 >> v1:172.21.15.67:6789/0 conn(0x7f60ac0a4ec0 legacy=0x7f60ac155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.286+0000 7f60ab400640 1 -- 172.21.15.32:0/2751019065 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0c0a20 con 0x7f60ac0c04a0 2024-01-19T04:15:59.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60ab400640 1 --2- 172.21.15.32:0/2751019065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0c1230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f60940098a0 tx=0x7f609401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b081cb3f7209ec server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:59.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60aaa00640 1 -- 172.21.15.32:0/2751019065 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940ab600 con 0x7f60ac0c04a0 2024-01-19T04:15:59.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60aaa00640 1 -- 172.21.15.32:0/2751019065 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60940a7050 con 0x7f60ac0c04a0 2024-01-19T04:15:59.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60aaa00640 1 -- 172.21.15.32:0/2751019065 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940ab980 con 0x7f60ac0c04a0 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 -- 172.21.15.32:0/2751019065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 msgr2=0x7f60ac0c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 --2- 172.21.15.32:0/2751019065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0c1230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f60940098a0 tx=0x7f609401c490 comp rx=0 tx=0).stop 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 -- 172.21.15.32:0/2751019065 shutdown_connections 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 --2- 172.21.15.32:0/2751019065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0c1230 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 --2- 172.21.15.32:0/2751019065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac14fb50 0x7f60ac06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 -- 172.21.15.32:0/2751019065 >> 172.21.15.32:0/2751019065 conn(0x7f60ac0c5b20 msgr2=0x7f60ac0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 -- 172.21.15.32:0/2751019065 shutdown_connections 2024-01-19T04:15:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.290+0000 7f60b2a00640 1 -- 172.21.15.32:0/2751019065 wait complete. 2024-01-19T04:15:59.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 Processor -- start 2024-01-19T04:15:59.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 -- start start 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac0a4ec0 0x7f60ac1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac14fb50 0x7f60ac1edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac1548f0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac151f40 con 0x7f60ac14fb50 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac1ed7e0 con 0x7f60ac0a4ec0 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43576/0 (socket says 172.21.15.32:43576) 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 -- 172.21.15.32:0/3666158512 learned_addr learned my addr 172.21.15.32:0/3666158512 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:15:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60abe00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac0a4ec0 0x7f60ac1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b0a00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac14fb50 0x7f60ac1edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 -- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac0a4ec0 msgr2=0x7f60ac1538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac0a4ec0 0x7f60ac1538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 -- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac14fb50 msgr2=0x7f60ac1edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac14fb50 0x7f60ac1edc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 -- 172.21.15.32:0/3666158512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60940094d0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60ab400640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0bf130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f609401a0c0 tx=0x7f609401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60a3e00640 1 -- 172.21.15.32:0/3666158512 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940b6620 con 0x7f60ac0c04a0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60a3e00640 1 -- 172.21.15.32:0/3666158512 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60940b67a0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac1ed490 con 0x7f60ac0c04a0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60a3e00640 1 -- 172.21.15.32:0/3666158512 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940b6b50 con 0x7f60ac0c04a0 2024-01-19T04:15:59.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.294+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac154db0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.298+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac1ed970 con 0x7f60ac0c04a0 2024-01-19T04:15:59.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.298+0000 7f60a3e00640 1 -- 172.21.15.32:0/3666158512 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f60940b2040 con 0x7f60ac0c04a0 2024-01-19T04:15:59.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.298+0000 7f60a3e00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6084066500 0x7f60840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:15:59.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.298+0000 7f60a3e00640 1 -- 172.21.15.32:0/3666158512 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f609411e2b0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.298+0000 7f60abe00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6084066500 0x7f60840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:15:59.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.298+0000 7f60abe00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6084066500 0x7f60840689c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0c2470 tx=0x7f609c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:15:59.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.302+0000 7f60a3e00640 1 -- 172.21.15.32:0/3666158512 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f60940eb5e0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.494+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60ac0749f0 con 0x7f60ac0c04a0 2024-01-19T04:15:59.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.494+0000 7f60a3e00640 1 -- 172.21.15.32:0/3666158512 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f60940eec00 con 0x7f60ac0c04a0 2024-01-19T04:15:59.497 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:15:59.497 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:49.039759+0000","modified":"2024-01-19T04:15:52.052125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6835/884465323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":884465323},{"type":"v1","addr":"172.21.15.32:6835","nonce":884465323}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T04:15:59.497 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 16 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6084066500 msgr2=0x7f60840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6084066500 0x7f60840689c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0c2470 tx=0x7f609c008040 comp rx=0 tx=0).stop 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 msgr2=0x7f60ac0bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0bf130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f609401a0c0 tx=0x7f609401acd0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 shutdown_connections 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6084066500 0x7f60840689c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ac14fb50 0x7f60ac1edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60ac0c04a0 0x7f60ac0bf130 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 --2- 172.21.15.32:0/3666158512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60ac0a4ec0 0x7f60ac1538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 >> 172.21.15.32:0/3666158512 conn(0x7f60ac0c5b20 msgr2=0x7f60ac0c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 shutdown_connections 2024-01-19T04:15:59.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:15:59.498+0000 7f60b2a00640 1 -- 172.21.15.32:0/3666158512 wait complete. 2024-01-19T04:15:59.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T04:15:49.039759+0000', 'modified': '2024-01-19T04:15:52.052125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5031}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5031': {'gid': 5031, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.32:6835/884465323', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6833', 'nonce': 884465323}, {'type': 'v1', 'addr': '172.21.15.32:6835', 'nonce': 884465323}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-19T04:15:59.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-19T04:15:59.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-19T04:16:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55b6200640 1 Processor -- start 2024-01-19T04:16:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55b6200640 1 -- start start 2024-01-19T04:16:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55b6200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f55b00a6d30 0x7f55b00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55b6200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55b006fda0 0x7f55b00c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55b6200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b01533a0 con 0x7f55b00c6e20 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55b6200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b0156380 con 0x7f55b006fda0 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55b6200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b014fe40 con 0x7f55b00a6d30 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55afe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55b006fda0 0x7f55b00c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55afe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55b006fda0 0x7f55b00c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43592/0 (socket says 172.21.15.32:43592) 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55afe00640 1 -- 172.21.15.32:0/2072773180 learned_addr learned my addr 172.21.15.32:0/2072773180 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.066+0000 7f55aea00640 1 --2- 172.21.15.32:0/2072773180 >> v2:172.21.15.67:3300/0 conn(0x7f55b00a6d30 0x7f55b00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55afe00640 1 -- 172.21.15.32:0/2072773180 >> v2:172.21.15.67:3300/0 conn(0x7f55b00a6d30 msgr2=0x7f55b00c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55afe00640 1 --2- 172.21.15.32:0/2072773180 >> v2:172.21.15.67:3300/0 conn(0x7f55b00a6d30 0x7f55b00c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55afe00640 1 -- 172.21.15.32:0/2072773180 >> v1:172.21.15.67:6789/0 conn(0x7f55b00c6e20 legacy=0x7f55b0152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55afe00640 1 -- 172.21.15.32:0/2072773180 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0152800 con 0x7f55b006fda0 2024-01-19T04:16:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55afe00640 1 --2- 172.21.15.32:0/2072773180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b006fda0 0x7f55b00c5b40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f55b0067390 tx=0x7f55a801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709a84f19eb3be0e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55ae000640 1 -- 172.21.15.32:0/2072773180 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80a5800 con 0x7f55b006fda0 2024-01-19T04:16:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55ae000640 1 -- 172.21.15.32:0/2072773180 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80a5960 con 0x7f55b006fda0 2024-01-19T04:16:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.070+0000 7f55ae000640 1 -- 172.21.15.32:0/2072773180 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80a5cf0 con 0x7f55b006fda0 2024-01-19T04:16:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- 172.21.15.32:0/2072773180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b006fda0 msgr2=0x7f55b00c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 --2- 172.21.15.32:0/2072773180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b006fda0 0x7f55b00c5b40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f55b0067390 tx=0x7f55a801c940 comp rx=0 tx=0).stop 2024-01-19T04:16:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- 172.21.15.32:0/2072773180 shutdown_connections 2024-01-19T04:16:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 --2- 172.21.15.32:0/2072773180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b006fda0 0x7f55b00c5b40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 --2- 172.21.15.32:0/2072773180 >> v2:172.21.15.67:3300/0 conn(0x7f55b00a6d30 0x7f55b00c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- 172.21.15.32:0/2072773180 >> 172.21.15.32:0/2072773180 conn(0x7f55b00a9870 msgr2=0x7f55b00a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- 172.21.15.32:0/2072773180 shutdown_connections 2024-01-19T04:16:00.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- 172.21.15.32:0/2072773180 wait complete. 2024-01-19T04:16:00.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 Processor -- start 2024-01-19T04:16:00.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- start start 2024-01-19T04:16:00.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55b006fda0 0x7f55b01ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b00a6d30 0x7f55b015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55b00c6e20 0x7f55b01f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0155e20 con 0x7f55b00a6d30 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0151d50 con 0x7f55b00c6e20 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55b6200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b01f0a40 con 0x7f55b006fda0 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b00a6d30 0x7f55b015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b00a6d30 0x7f55b015b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43596/0 (socket says 172.21.15.32:43596) 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 -- 172.21.15.32:0/4198481682 learned_addr learned my addr 172.21.15.32:0/4198481682 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55afe00640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55b00c6e20 0x7f55b01f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55af400640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55b006fda0 0x7f55b01ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 -- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55b006fda0 msgr2=0x7f55b01ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55b006fda0 0x7f55b01ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 -- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55b00c6e20 msgr2=0x7f55b01f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55b00c6e20 0x7f55b01f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55aea00640 1 -- 172.21.15.32:0/4198481682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8009b30 con 0x7f55b00a6d30 2024-01-19T04:16:00.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.074+0000 7f55afe00640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55b00c6e20 0x7f55b01f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:00.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55aea00640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b00a6d30 0x7f55b015b340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f559800e930 tx=0x7f559800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55a7400640 1 -- 172.21.15.32:0/4198481682 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598009690 con 0x7f55b00a6d30 2024-01-19T04:16:00.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55a7400640 1 -- 172.21.15.32:0/4198481682 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559800ca00 con 0x7f55b00a6d30 2024-01-19T04:16:00.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55a7400640 1 -- 172.21.15.32:0/4198481682 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800cd70 con 0x7f55b00a6d30 2024-01-19T04:16:00.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b006d340 con 0x7f55b00a6d30 2024-01-19T04:16:00.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b01f0c90 con 0x7f55b00a6d30 2024-01-19T04:16:00.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55a7400640 1 -- 172.21.15.32:0/4198481682 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5598013470 con 0x7f55b00a6d30 2024-01-19T04:16:00.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55a7400640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5588066500 0x7f55880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.078+0000 7f55a7400640 1 -- 172.21.15.32:0/4198481682 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5598084080 con 0x7f55b00a6d30 2024-01-19T04:16:00.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55af400640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5588066500 0x7f55880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 Processor -- start 2024-01-19T04:16:00.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- start start 2024-01-19T04:16:00.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55af400640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5588066500 0x7f55880689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f55b015bf00 tx=0x7f55a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49e58460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49e58d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49ea2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49cb6d70 con 0x55bf49e592c0 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49cb2ba0 con 0x55bf49e58080 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49cb00d0 con 0x55bf49e589a0 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49ea2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55aea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49e58d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55af400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49e58460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49ea2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43602/0 (socket says 172.21.15.32:43602) 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55aea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49e58d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:46388/0 (socket says 172.21.15.32:46388) 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 -- 172.21.15.32:0/3224312240 learned_addr learned my addr 172.21.15.32:0/3224312240 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 -- 172.21.15.32:0/3224312240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 msgr2=0x55bf49e58d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49e58d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 -- 172.21.15.32:0/3224312240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 msgr2=0x55bf49e58460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49e58460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 -- 172.21.15.32:0/3224312240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf499a2890 con 0x55bf49e592c0 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55aea00640 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49e58d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:00.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55afe00640 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49ea2810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f55a801a570 tx=0x7f55a8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1916237f9490dcbd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f559fe00640 1 -- 172.21.15.32:0/3224312240 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80b63f0 con 0x55bf49e592c0 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f559fe00640 1 -- 172.21.15.32:0/3224312240 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80b6550 con 0x55bf49e592c0 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f559fe00640 1 -- 172.21.15.32:0/3224312240 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80b68e0 con 0x55bf49e592c0 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- 172.21.15.32:0/3224312240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 msgr2=0x55bf49ea2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49ea2810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f55a801a570 tx=0x7f55a8004ac0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- 172.21.15.32:0/3224312240 shutdown_connections 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49ea2810 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49e58d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 --2- 172.21.15.32:0/3224312240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49e58460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- 172.21.15.32:0/3224312240 >> 172.21.15.32:0/3224312240 conn(0x55bf49e60d20 msgr2=0x55bf49e98580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- 172.21.15.32:0/3224312240 shutdown_connections 2024-01-19T04:16:00.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.082+0000 7f55b9757000 1 -- 172.21.15.32:0/3224312240 wait complete. 2024-01-19T04:16:00.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 -- start start 2024-01-19T04:16:00.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 Processor -- start 2024-01-19T04:16:00.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e58080 0x55bf49e5ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e589a0 0x55bf49e5d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49e5d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49cab9c0 con 0x55bf49e592c0 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49c63040 con 0x55bf49e589a0 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49c68ee0 con 0x55bf49e58080 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 10 client.0 _ll_register_callbacks cb 0x55bf49c661b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49e5d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49e5d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43612/0 (socket says 172.21.15.32:43612) 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 -- 172.21.15.32:0/2718362748 learned_addr learned my addr 172.21.15.32:0/2718362748 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55af400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e58080 0x55bf49e5ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55aea00640 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e589a0 0x55bf49e5d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 -- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e58080 msgr2=0x55bf49e5ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e58080 0x55bf49e5ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 -- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e589a0 msgr2=0x55bf49e5d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e589a0 0x55bf49e5d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 -- 172.21.15.32:0/2718362748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b01f0c90 con 0x55bf49e592c0 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55af400640 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e58080 0x55bf49e5ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:00.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55afe00640 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49e5d8b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f55a8000f90 tx=0x7f55a801b180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce04eba812067a60 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f559cc00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f559cc00640 1 -- 172.21.15.32:0/2718362748 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80ca420 con 0x55bf49e592c0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f559cc00640 1 -- 172.21.15.32:0/2718362748 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55a80ca580 con 0x55bf49e592c0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf49c31e30 con 0x55bf49e592c0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f559cc00640 1 -- 172.21.15.32:0/2718362748 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55a80ca740 con 0x55bf49e592c0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 10 client.5232 fetch_fsmap learned FSMap version 16 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f55b0152800 con 0x55bf49e592c0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f559cc00640 1 -- 172.21.15.32:0/2718362748 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf49c31e30 con 0x55bf49e592c0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f559cc00640 1 -- 172.21.15.32:0/2718362748 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f55a80ca8a0 con 0x55bf49e592c0 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 10 client.5232 fetch_fsmap finished waiting for FSMap version 16 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 10 client.5232 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 20 client.5232 populate_metadata read hostname 'smithi032' 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49eaab70 0x55bf49eacf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 4 client.5232 mds_command: new command op to 5031 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:16:00.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.086+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 --> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf49c68870 con 0x55bf49eaab70 2024-01-19T04:16:00.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55af400640 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49eaab70 0x55bf49eacf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55af400640 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49eaab70 0x55bf49eacf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a4c56a94a9e86e server_cookie=853675455fc28921 in_seq=0 out_seq=0 2024-01-19T04:16:00.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f559cc00640 10 client.5232 ms_handle_connect on v2:172.21.15.32:6833/884465323 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f559cc00640 1 -- 172.21.15.32:0/2718362748 <== mds.0 v2:172.21.15.32:6833/884465323 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bf49c68870 con 0x55bf49eaab70 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f559cc00640 10 client.5232 handle_command_reply: tid=0 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 client.5232 shutdown 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 msgr2=0x55bf49e5d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49e5d8b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f55a8000f90 tx=0x7f55a801b180 comp rx=0 tx=0).stop 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 shutdown_connections 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e592c0 0x55bf49e5d8b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49eaab70 0x55bf49eacf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e589a0 0x55bf49e5d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 --2- 172.21.15.32:0/2718362748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e58080 0x55bf49e5ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f559cc00640 0 client.5232 ms_handle_reset on v2:172.21.15.32:6833/884465323 2024-01-19T04:16:00.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 >> 172.21.15.32:0/2718362748 conn(0x55bf49e60d20 msgr2=0x55bf49e57780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 shutdown_connections 2024-01-19T04:16:00.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 1 -- 172.21.15.32:0/2718362748 wait complete. 2024-01-19T04:16:00.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.090+0000 7f55b9757000 20 client.5232 trim_cache size 0 max 16384 2024-01-19T04:16:00.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 Processor -- start 2024-01-19T04:16:00.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 -- start start 2024-01-19T04:16:00.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e58080 0x55bf49eaf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49eacf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e592c0 0x55bf49ead4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49963940 con 0x55bf49e58080 2024-01-19T04:16:00.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49ca2370 con 0x55bf49e592c0 2024-01-19T04:16:00.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49c72eb0 con 0x55bf49e589a0 2024-01-19T04:16:00.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e58080 0x55bf49eaf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e58080 0x55bf49eaf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43628/0 (socket says 172.21.15.32:43628) 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 -- 172.21.15.32:0/3771579705 learned_addr learned my addr 172.21.15.32:0/3771579705 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55aea00640 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49eacf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55afe00640 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e592c0 0x55bf49ead4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 -- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 msgr2=0x55bf49eacf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49eacf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 -- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e592c0 msgr2=0x55bf49ead4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e592c0 0x55bf49ead4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.106+0000 7f55af400640 1 -- 172.21.15.32:0/3771579705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf49c6b5e0 con 0x55bf49e58080 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55af400640 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e58080 0x55bf49eaf3b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f55a000f5a0 tx=0x7f55a0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de16a9afcb65912c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f559f400640 1 -- 172.21.15.32:0/3771579705 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0015ba0 con 0x55bf49e58080 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f559f400640 1 -- 172.21.15.32:0/3771579705 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a0015d00 con 0x55bf49e58080 2024-01-19T04:16:00.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f559f400640 1 -- 172.21.15.32:0/3771579705 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0015e90 con 0x55bf49e58080 2024-01-19T04:16:00.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- 172.21.15.32:0/3771579705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e58080 msgr2=0x55bf49eaf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e58080 0x55bf49eaf3b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f55a000f5a0 tx=0x7f55a0000ee0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- 172.21.15.32:0/3771579705 shutdown_connections 2024-01-19T04:16:00.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e592c0 0x55bf49ead4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e589a0 0x55bf49eacf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 --2- 172.21.15.32:0/3771579705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e58080 0x55bf49eaf3b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- 172.21.15.32:0/3771579705 >> 172.21.15.32:0/3771579705 conn(0x55bf49e60d20 msgr2=0x55bf49e93780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- 172.21.15.32:0/3771579705 shutdown_connections 2024-01-19T04:16:00.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- 172.21.15.32:0/3771579705 wait complete. 2024-01-19T04:16:00.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- start start 2024-01-19T04:16:00.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 Processor -- start 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49ec0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e589a0 0x55bf49ec1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e592c0 0x55bf49ec17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49ca8dc0 con 0x55bf49e589a0 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49cb43f0 con 0x55bf49e58080 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49cec440 con 0x55bf49e592c0 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55b9757000 10 client.0 _ll_register_callbacks cb 0x55bf49c6c0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55aea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e589a0 0x55bf49ec1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55af400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49ec0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55aea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e589a0 0x55bf49ec1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43640/0 (socket says 172.21.15.32:43640) 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55aea00640 1 -- 172.21.15.32:0/1962708583 learned_addr learned my addr 172.21.15.32:0/1962708583 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55afe00640 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e592c0 0x55bf49ec17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55aea00640 1 -- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e592c0 msgr2=0x55bf49ec17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55aea00640 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e592c0 0x55bf49ec17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55aea00640 1 -- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 msgr2=0x55bf49ec0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.110+0000 7f55aea00640 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49ec0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55aea00640 1 -- 172.21.15.32:0/1962708583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a0015460 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55af400640 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49ec0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55aea00640 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e589a0 0x55bf49ec1280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55980550d0 tx=0x7f55980592a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28a5ee30a90eea8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 1 -- 172.21.15.32:0/1962708583 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598054830 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 1 -- 172.21.15.32:0/1962708583 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55980535a0 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf49c5d4f0 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 1 -- 172.21.15.32:0/1962708583 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f559805cf00 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 10 client.5238 fetch_fsmap learned FSMap version 16 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bf49c518e0 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 1 -- 172.21.15.32:0/1962708583 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf49c5d4f0 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 1 -- 172.21.15.32:0/1962708583 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5598011070 con 0x55bf49e589a0 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 10 client.5238 fetch_fsmap finished waiting for FSMap version 16 2024-01-19T04:16:00.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 10 client.5238 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T04:16:00.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 20 client.5238 populate_metadata read hostname 'smithi032' 2024-01-19T04:16:00.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49f02b30 0x55bf49ec2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 4 client.5238 mds_command: new command op to 5031 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:16:00.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 --> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bf49caa310 con 0x55bf49f02b30 2024-01-19T04:16:00.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55af400640 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49f02b30 0x55bf49ec2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 10 client.5238 ms_handle_connect on v2:172.21.15.32:6833/884465323 2024-01-19T04:16:00.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55af400640 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49f02b30 0x55bf49ec2210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5179131081c520a server_cookie=ad71a02547cdf8cb in_seq=0 out_seq=0 2024-01-19T04:16:00.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 1 -- 172.21.15.32:0/1962708583 <== mds.0 v2:172.21.15.32:6833/884465323 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55bf49caa310 con 0x55bf49f02b30 2024-01-19T04:16:00.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 10 client.5238 handle_command_reply: tid=0 2024-01-19T04:16:00.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 client.5238 shutdown 2024-01-19T04:16:00.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e589a0 msgr2=0x55bf49ec1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e589a0 0x55bf49ec1280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55980550d0 tx=0x7f55980592a0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 shutdown_connections 2024-01-19T04:16:00.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55bf49e592c0 0x55bf49ec17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf49e589a0 0x55bf49ec1280 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.32:6833/884465323,v1:172.21.15.32:6835/884465323] conn(0x55bf49f02b30 0x55bf49ec2210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 --2- 172.21.15.32:0/1962708583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bf49e58080 0x55bf49ec0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f559cc00640 0 client.5238 ms_handle_reset on v2:172.21.15.32:6833/884465323 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 >> 172.21.15.32:0/1962708583 conn(0x55bf49e60d20 msgr2=0x55bf49e94010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 shutdown_connections 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 1 -- 172.21.15.32:0/1962708583 wait complete. 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.114+0000 7f55b9757000 20 client.5238 trim_cache size 0 max 16384 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "d7445317-ddd8-4205-bf5b-c51cd46cffd9", 2024-01-19T04:16:00.120 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5031, 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 10.479847005, 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 16, 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 35, 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 35, 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 18.742134393000001 2024-01-19T04:16:00.121 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5588066500 msgr2=0x7f55880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5588066500 0x7f55880689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f55b015bf00 tx=0x7f55a0009040 comp rx=0 tx=0).stop 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b00a6d30 msgr2=0x7f55b015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b00a6d30 0x7f55b015b340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f559800e930 tx=0x7f559800edf0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 shutdown_connections 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5588066500 0x7f55880689c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55b00c6e20 0x7f55b01f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55b00a6d30 0x7f55b015b340 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 --2- 172.21.15.32:0/4198481682 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f55b006fda0 0x7f55b01ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 >> 172.21.15.32:0/4198481682 conn(0x7f55b00a9870 msgr2=0x7f55b00a9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 shutdown_connections 2024-01-19T04:16:00.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.118+0000 7f55b6200640 1 -- 172.21.15.32:0/4198481682 wait complete. 2024-01-19T04:16:00.146 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:16:00.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f57000640 1 Processor -- start 2024-01-19T04:16:00.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f57000640 1 -- start start 2024-01-19T04:16:00.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f57000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f500c6e20 0x7f3f500c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f57000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f500a6d30 0x7f3f500c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f57000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f501533a0 con 0x7f3f5006fda0 2024-01-19T04:16:00.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f57000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f50156380 con 0x7f3f500a6d30 2024-01-19T04:16:00.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f57000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5014fe40 con 0x7f3f500c6e20 2024-01-19T04:16:00.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f55000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3f5006fda0 0x7f3f50152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41730/0 (socket says 172.21.15.32:41730) 2024-01-19T04:16:00.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f55000640 1 -- 172.21.15.32:0/4257252013 learned_addr learned my addr 172.21.15.32:0/4257252013 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:00.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4f400640 1 --2- 172.21.15.32:0/4257252013 >> v2:172.21.15.67:3300/0 conn(0x7f3f500a6d30 0x7f3f500c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4fe00640 1 --2- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f500c6e20 0x7f3f500c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4ea00640 1 -- 172.21.15.32:0/4257252013 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607958331 0 0) 0x7f3f480014a0 con 0x7f3f5006fda0 2024-01-19T04:16:00.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4ea00640 1 -- 172.21.15.32:0/4257252013 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f30003530 con 0x7f3f5006fda0 2024-01-19T04:16:00.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4f400640 1 -- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f500c6e20 msgr2=0x7f3f500c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:00.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4f400640 1 --2- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f500c6e20 0x7f3f500c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4f400640 1 -- 172.21.15.32:0/4257252013 >> v1:172.21.15.32:6789/0 conn(0x7f3f5006fda0 legacy=0x7f3f50152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.286+0000 7f3f4f400640 1 -- 172.21.15.32:0/4257252013 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50152800 con 0x7f3f500a6d30 2024-01-19T04:16:00.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f4f400640 1 --2- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f500c5b40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f380097c0 tx=0x7f3f3801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da06960964b1ab60 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f4ea00640 1 -- 172.21.15.32:0/4257252013 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380ad660 con 0x7f3f500a6d30 2024-01-19T04:16:00.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f4ea00640 1 -- 172.21.15.32:0/4257252013 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380ad7c0 con 0x7f3f500a6d30 2024-01-19T04:16:00.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f4ea00640 1 -- 172.21.15.32:0/4257252013 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380adb50 con 0x7f3f500a6d30 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 -- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 msgr2=0x7f3f500c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 --2- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f500c5b40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f380097c0 tx=0x7f3f3801c360 comp rx=0 tx=0).stop 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 -- 172.21.15.32:0/4257252013 shutdown_connections 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 --2- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f500c5b40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 --2- 172.21.15.32:0/4257252013 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f500c6e20 0x7f3f500c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 -- 172.21.15.32:0/4257252013 >> 172.21.15.32:0/4257252013 conn(0x7f3f500a9870 msgr2=0x7f3f500a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 -- 172.21.15.32:0/4257252013 shutdown_connections 2024-01-19T04:16:00.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.290+0000 7f3f57000640 1 -- 172.21.15.32:0/4257252013 wait complete. 2024-01-19T04:16:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 Processor -- start 2024-01-19T04:16:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 -- start start 2024-01-19T04:16:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f5006fda0 0x7f3f5015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f5006c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500c6e20 0x7f3f5006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501491b0 con 0x7f3f500c6e20 2024-01-19T04:16:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500bda00 con 0x7f3f500a6d30 2024-01-19T04:16:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5014f590 con 0x7f3f5006fda0 2024-01-19T04:16:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f55000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500c6e20 0x7f3f5006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f5006c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f55000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500c6e20 0x7f3f5006c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43648/0 (socket says 172.21.15.32:43648) 2024-01-19T04:16:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f55000640 1 -- 172.21.15.32:0/4135833391 learned_addr learned my addr 172.21.15.32:0/4135833391 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4fe00640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f5006fda0 0x7f3f5015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4f400640 1 -- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f5006fda0 msgr2=0x7f3f5015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4f400640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f5006fda0 0x7f3f5015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4f400640 1 -- 172.21.15.32:0/4135833391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500c6e20 msgr2=0x7f3f5006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4f400640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500c6e20 0x7f3f5006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4f400640 1 -- 172.21.15.32:0/4135833391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f38009420 con 0x7f3f500a6d30 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f55000640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500c6e20 0x7f3f5006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f4f400640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f5006c2a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f5006dcf0 tx=0x7f3f38019100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f47e00640 1 -- 172.21.15.32:0/4135833391 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380b6610 con 0x7f3f500a6d30 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f47e00640 1 -- 172.21.15.32:0/4135833391 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380b67b0 con 0x7f3f500a6d30 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f47e00640 1 -- 172.21.15.32:0/4135833391 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380b6b60 con 0x7f3f500a6d30 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50148910 con 0x7f3f500a6d30 2024-01-19T04:16:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.294+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f50148ed0 con 0x7f3f500a6d30 2024-01-19T04:16:00.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.298+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500bd860 con 0x7f3f500a6d30 2024-01-19T04:16:00.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.298+0000 7f3f47e00640 1 -- 172.21.15.32:0/4135833391 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3f380b4040 con 0x7f3f500a6d30 2024-01-19T04:16:00.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.298+0000 7f3f47e00640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3f28066500 0x7f3f280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:00.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.298+0000 7f3f47e00640 1 -- 172.21.15.32:0/4135833391 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f3811e620 con 0x7f3f500a6d30 2024-01-19T04:16:00.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.298+0000 7f3f4fe00640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3f28066500 0x7f3f280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:00.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.298+0000 7f3f4fe00640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3f28066500 0x7f3f280689c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009ac0 tx=0x7f3f40009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:00.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.306+0000 7f3f47e00640 1 -- 172.21.15.32:0/4135833391 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3f380eb950 con 0x7f3f500a6d30 2024-01-19T04:16:00.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f500bd860 con 0x7f3f500a6d30 2024-01-19T04:16:00.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f47e00640 1 -- 172.21.15.32:0/4135833391 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f500bd860 con 0x7f3f500a6d30 2024-01-19T04:16:00.507 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:16:00.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3f28066500 msgr2=0x7f3f280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3f28066500 0x7f3f280689c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009ac0 tx=0x7f3f40009190 comp rx=0 tx=0).stop 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 msgr2=0x7f3f5006c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f5006c2a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f5006dcf0 tx=0x7f3f38019100 comp rx=0 tx=0).stop 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 shutdown_connections 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3f28066500 0x7f3f280689c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f500c6e20 0x7f3f5006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f500a6d30 0x7f3f5006c2a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 --2- 172.21.15.32:0/4135833391 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3f5006fda0 0x7f3f5015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 >> 172.21.15.32:0/4135833391 conn(0x7f3f500a9870 msgr2=0x7f3f500a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 shutdown_connections 2024-01-19T04:16:00.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:00.506+0000 7f3f57000640 1 -- 172.21.15.32:0/4135833391 wait complete. 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:16:00.529 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:16:00.530 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:00.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:00.530 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-01-19T04:16:00.539 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-01-19T04:16:00.540 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42382sec preferred_lft 42382sec 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:1f:1a:e5:73 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:16:00.541 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:00.542 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:16:00.542 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:16:00.542 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:16:00.542 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:00.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:00.542 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:16:00.599 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-01-19T04:16:00.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:00.601 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-01-19T04:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-01-19T04:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-19T04:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-19T04:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:16:00.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:00.655 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:16:00.656 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:16:00.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-19T04:16:00.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-19T04:16:00.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-19T04:16:00.656 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:16:00.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:00.748 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T04:16:00.757 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:00.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:00.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-01-19T04:16:00.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:00.818 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:00.870 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:00.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:00.870 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:00.921 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-19T04:16:00.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:00.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:01.011 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:01.011 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:16:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:16:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:16:01.027 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:16:01.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.028 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:01.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.048 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:16:01.110 INFO:teuthology.orchestra.run.smithi032.stdout:client5247 2024-01-19T04:16:01.111 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:01.111 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:01.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:16:01.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.346+0000 7f34fb000640 1 Processor -- start 2024-01-19T04:16:01.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.346+0000 7f34fb000640 1 -- start start 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34fb000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34f40c5740 0x7f34f40c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34fb000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 0x7f34f415b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34fb000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f40c0c90 con 0x7f34f40c42b0 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34fb000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f4150f90 con 0x7f34f40c5740 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34fb000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4150cb0 con 0x7f34f40c1120 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f34f40c42b0 0x7f34f406beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41746/0 (socket says 172.21.15.32:41746) 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 -- 172.21.15.32:0/2024169423 learned_addr learned my addr 172.21.15.32:0/2024169423 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f9000640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 0x7f34f415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3400640 1 --2- 172.21.15.32:0/2024169423 >> v2:172.21.15.67:3300/0 conn(0x7f34f40c5740 0x7f34f40c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871187120 0 0) 0x7f34f40c0c90 con 0x7f34f40c42b0 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d4003530 con 0x7f34f40c42b0 2024-01-19T04:16:01.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1080075012 0 0) 0x7f34d4003530 con 0x7f34f40c42b0 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 msgr2=0x7f34f415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 0x7f34f415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 >> v2:172.21.15.67:3300/0 conn(0x7f34f40c5740 msgr2=0x7f34f40c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 --2- 172.21.15.32:0/2024169423 >> v2:172.21.15.67:3300/0 conn(0x7f34f40c5740 0x7f34f40c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40c0640 con 0x7f34f40c42b0 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f34e4001680 con 0x7f34f40c42b0 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 >> v1:172.21.15.32:6789/0 conn(0x7f34f40c42b0 legacy=0x7f34f406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 0x7f34d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34d4004d10 0x7f34d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4150f90 con 0x7f34d4003980 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4150cb0 con 0x7f34d4004d10 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4005960 con 0x7f34f40c1120 2024-01-19T04:16:01.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3400640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 0x7f34d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f9000640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34d4004d10 0x7f34d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 -- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 msgr2=0x7f34d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f40c1120 0x7f34d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 -- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34d4004d10 msgr2=0x7f34d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34d4004d10 0x7f34d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f3e00640 1 -- 172.21.15.32:0/2024169423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4003530 con 0x7f34d4003980 2024-01-19T04:16:01.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.350+0000 7f34f9000640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34d4004d10 0x7f34d4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:01.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34f3e00640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34d4003da0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c290 tx=0x7f34e401d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc28d6fbc9d949b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:01.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40058e0 con 0x7f34d4003980 2024-01-19T04:16:01.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e4005a40 con 0x7f34d4003980 2024-01-19T04:16:01.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34f2a00640 1 -- 172.21.15.32:0/2024169423 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4005df0 con 0x7f34d4003980 2024-01-19T04:16:01.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34fb000640 1 -- 172.21.15.32:0/2024169423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 msgr2=0x7f34d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:01.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34fb000640 1 --2- 172.21.15.32:0/2024169423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34d4003da0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c290 tx=0x7f34e401d710 comp rx=0 tx=0).stop 2024-01-19T04:16:01.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34f9000640 1 -- 172.21.15.32:0/2024169423 reap_dead start 2024-01-19T04:16:01.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34fb000640 1 -- 172.21.15.32:0/2024169423 shutdown_connections 2024-01-19T04:16:01.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34fb000640 1 -- 172.21.15.32:0/2024169423 >> 172.21.15.32:0/2024169423 conn(0x7f34f40c5b20 msgr2=0x7f34f40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:01.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34fb000640 1 -- 172.21.15.32:0/2024169423 shutdown_connections 2024-01-19T04:16:01.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.354+0000 7f34fb000640 1 -- 172.21.15.32:0/2024169423 wait complete. 2024-01-19T04:16:01.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 Processor -- start 2024-01-19T04:16:01.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 -- start start 2024-01-19T04:16:01.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34f4154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f41f0260 0x7f34f41f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f4151f10 0x7f34f4152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41f0d80 con 0x7f34d4003980 2024-01-19T04:16:01.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40abb20 con 0x7f34f41f0260 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41528d0 con 0x7f34f4151f10 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34f4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34f4154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43666/0 (socket says 172.21.15.32:43666) 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 -- 172.21.15.32:0/1619228973 learned_addr learned my addr 172.21.15.32:0/1619228973 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f9000640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f4151f10 0x7f34f4152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3400640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f41f0260 0x7f34f41f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 -- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f4151f10 msgr2=0x7f34f4152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f4151f10 0x7f34f4152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 -- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f41f0260 msgr2=0x7f34f41f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f41f0260 0x7f34f41f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 -- 172.21.15.32:0/1619228973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40ab560 con 0x7f34d4003980 2024-01-19T04:16:01.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34f3e00640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34f4154830 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34e40ab040 tx=0x7f34d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:01.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34ebe00640 1 -- 172.21.15.32:0/1619228973 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4005c30 con 0x7f34d4003980 2024-01-19T04:16:01.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34ebe00640 1 -- 172.21.15.32:0/1619228973 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e40a58a0 con 0x7f34d4003980 2024-01-19T04:16:01.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f40ab840 con 0x7f34d4003980 2024-01-19T04:16:01.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34ebe00640 1 -- 172.21.15.32:0/1619228973 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40a5c30 con 0x7f34d4003980 2024-01-19T04:16:01.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.358+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f41e41c0 con 0x7f34d4003980 2024-01-19T04:16:01.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.362+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f40c4eb0 con 0x7f34d4003980 2024-01-19T04:16:01.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.362+0000 7f34ebe00640 1 -- 172.21.15.32:0/1619228973 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f34e40047f0 con 0x7f34d4003980 2024-01-19T04:16:01.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.362+0000 7f34ebe00640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34cc066500 0x7f34cc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:01.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.362+0000 7f34ebe00640 1 -- 172.21.15.32:0/1619228973 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34e40b4030 con 0x7f34d4003980 2024-01-19T04:16:01.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.362+0000 7f34f3400640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34cc066500 0x7f34cc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:01.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.362+0000 7f34f3400640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34cc066500 0x7f34cc0689c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f34f414f3a0 tx=0x7f34dc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:01.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.366+0000 7f34ebe00640 1 -- 172.21.15.32:0/1619228973 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f34e40ea8e0 con 0x7f34d4003980 2024-01-19T04:16:01.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34f40749f0 con 0x7f34d4003980 2024-01-19T04:16:01.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34ebe00640 1 -- 172.21.15.32:0/1619228973 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f34e40be060 con 0x7f34d4003980 2024-01-19T04:16:01.563 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:16:01.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34cc066500 msgr2=0x7f34cc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:01.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34cc066500 0x7f34cc0689c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f34f414f3a0 tx=0x7f34dc009190 comp rx=0 tx=0).stop 2024-01-19T04:16:01.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 msgr2=0x7f34f4154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:01.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34f4154830 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34e40ab040 tx=0x7f34d4005800 comp rx=0 tx=0).stop 2024-01-19T04:16:01.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 shutdown_connections 2024-01-19T04:16:01.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34cc066500 0x7f34cc0689c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f4151f10 0x7f34f4152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f41f0260 0x7f34f41f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 --2- 172.21.15.32:0/1619228973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34d4003980 0x7f34f4154830 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:01.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 >> 172.21.15.32:0/1619228973 conn(0x7f34f40c5b20 msgr2=0x7f34f4070610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:01.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 shutdown_connections 2024-01-19T04:16:01.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:01.562+0000 7f34fb000640 1 -- 172.21.15.32:0/1619228973 wait complete. 2024-01-19T04:16:01.585 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:16:01.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:16:01.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:16:01.585 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-19T04:16:01.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:01.586 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:16:01.586 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:16:01.586 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:16:01.586 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:01.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.586 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:16:01.596 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:16:01.596 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:16:01.596 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:16:01.596 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:01.596 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:16:01.596 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:16:01.597 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:16:01.598 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:01.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.599 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:16:01.661 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:16:01.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.663 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:01.716 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:16:01.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.717 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:16:01.717 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:16:01.717 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:16:01.717 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:16:01.717 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:16:01.717 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:16:01.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.811 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:16:01.819 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:16:01.820 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:01.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.820 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:16:01.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:01.885 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:01.936 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:01.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:01.937 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:01.988 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-19T04:16:01.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:01.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:02.081 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:02.081 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:02.094 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:02.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:02.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:16:02.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:16:02.094 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:16:02.098 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:16:02.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:02.098 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:02.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:02.118 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:16:02.171 INFO:teuthology.orchestra.run.smithi067.stdout:client5256 2024-01-19T04:16:02.172 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:02.172 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:02.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-19T04:16:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9ebd200640 1 Processor -- start 2024-01-19T04:16:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9ebd200640 1 -- start start 2024-01-19T04:16:02.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9ebd200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9eb8155540 0x7f9eb80a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9ebd200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb80a5250 0x7f9eb806d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9ebd200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb806ddf0 con 0x7f9eb8157cf0 2024-01-19T04:16:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9ebd200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb81581f0 con 0x7f9eb8155540 2024-01-19T04:16:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9ebd200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb81584d0 con 0x7f9eb80a5250 2024-01-19T04:16:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9eb8155540 0x7f9eb80a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9eb8155540 0x7f9eb80a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43670/0 (socket says 172.21.15.32:43670) 2024-01-19T04:16:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9eb8157cf0 0x7f9eb806d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41762/0 (socket says 172.21.15.32:41762) 2024-01-19T04:16:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5e00640 1 -- 172.21.15.32:0/3346922508 learned_addr learned my addr 172.21.15.32:0/3346922508 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb6800640 1 --2- 172.21.15.32:0/3346922508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb80a5250 0x7f9eb806d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5e00640 1 -- 172.21.15.32:0/3346922508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb80a5250 msgr2=0x7f9eb806d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5e00640 1 --2- 172.21.15.32:0/3346922508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb80a5250 0x7f9eb806d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5e00640 1 -- 172.21.15.32:0/3346922508 >> v1:172.21.15.32:6789/0 conn(0x7f9eb8157cf0 legacy=0x7f9eb806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.362+0000 7f9eb5e00640 1 -- 172.21.15.32:0/3346922508 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb81587b0 con 0x7f9eb8155540 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9eb5e00640 1 --2- 172.21.15.32:0/3346922508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb80a4d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009870 tx=0x7f9ea801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5223e95f1ece6d50 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9eb4a00640 1 -- 172.21.15.32:0/3346922508 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80aa670 con 0x7f9eb8155540 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9eb4a00640 1 -- 172.21.15.32:0/3346922508 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80aa7d0 con 0x7f9eb8155540 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9eb4a00640 1 -- 172.21.15.32:0/3346922508 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80aab60 con 0x7f9eb8155540 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9ebd200640 1 -- 172.21.15.32:0/3346922508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 msgr2=0x7f9eb80a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9ebd200640 1 --2- 172.21.15.32:0/3346922508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb80a4d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009870 tx=0x7f9ea801c510 comp rx=0 tx=0).stop 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9ebd200640 1 -- 172.21.15.32:0/3346922508 shutdown_connections 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9ebd200640 1 --2- 172.21.15.32:0/3346922508 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb80a5250 0x7f9eb806d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9ebd200640 1 --2- 172.21.15.32:0/3346922508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb80a4d10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9ebd200640 1 -- 172.21.15.32:0/3346922508 >> 172.21.15.32:0/3346922508 conn(0x7f9eb80c5b20 msgr2=0x7f9eb80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.366+0000 7f9ebd200640 1 -- 172.21.15.32:0/3346922508 shutdown_connections 2024-01-19T04:16:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 -- 172.21.15.32:0/3346922508 wait complete. 2024-01-19T04:16:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 Processor -- start 2024-01-19T04:16:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 -- start start 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9eb80a5250 0x7f9eb80a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb81505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb8157cf0 0x7f9eb80a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb814ecd0 con 0x7f9eb8155540 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb814e6a0 con 0x7f9eb80a5250 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb814f7d0 con 0x7f9eb8157cf0 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb81505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb81505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43678/0 (socket says 172.21.15.32:43678) 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 -- 172.21.15.32:0/4143491370 learned_addr learned my addr 172.21.15.32:0/4143491370 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb6800640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb8157cf0 0x7f9eb80a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5e00640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9eb80a5250 0x7f9eb80a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 -- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb8157cf0 msgr2=0x7f9eb80a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb8157cf0 0x7f9eb80a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 -- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9eb80a5250 msgr2=0x7f9eb80a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9eb80a5250 0x7f9eb80a9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 -- 172.21.15.32:0/4143491370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80094d0 con 0x7f9eb8155540 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eb5400640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb81505b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c340 tx=0x7f9ea000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eae000640 1 -- 172.21.15.32:0/4143491370 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00074e0 con 0x7f9eb8155540 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eae000640 1 -- 172.21.15.32:0/4143491370 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0007640 con 0x7f9eb8155540 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb80bff50 con 0x7f9eb8155540 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9eae000640 1 -- 172.21.15.32:0/4143491370 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0004a30 con 0x7f9eb8155540 2024-01-19T04:16:02.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.370+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb814e960 con 0x7f9eb8155540 2024-01-19T04:16:02.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.374+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb806c2e0 con 0x7f9eb8155540 2024-01-19T04:16:02.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.374+0000 7f9eae000640 1 -- 172.21.15.32:0/4143491370 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9ea0004b90 con 0x7f9eb8155540 2024-01-19T04:16:02.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.374+0000 7f9eae000640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9e90066500 0x7f9e900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.374+0000 7f9eae000640 1 -- 172.21.15.32:0/4143491370 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ea00836c0 con 0x7f9eb8155540 2024-01-19T04:16:02.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.378+0000 7f9eb5e00640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9e90066500 0x7f9e900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.378+0000 7f9eb5e00640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9e90066500 0x7f9e900689c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ae000 tx=0x7f9ea80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:02.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.382+0000 7f9eae000640 1 -- 172.21.15.32:0/4143491370 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9ea0050a00 con 0x7f9eb8155540 2024-01-19T04:16:02.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f9eb80749f0 con 0x7f9eb8155540 2024-01-19T04:16:02.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9eae000640 1 -- 172.21.15.32:0/4143491370 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7f9ea0054020 con 0x7f9eb8155540 2024-01-19T04:16:02.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9e90066500 msgr2=0x7f9e900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9e90066500 0x7f9e900689c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ae000 tx=0x7f9ea80b5040 comp rx=0 tx=0).stop 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 msgr2=0x7f9eb81505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb81505b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c340 tx=0x7f9ea000c800 comp rx=0 tx=0).stop 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 shutdown_connections 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9e90066500 0x7f9e900689c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9eb8157cf0 0x7f9eb80a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9eb8155540 0x7f9eb81505b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 --2- 172.21.15.32:0/4143491370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9eb80a5250 0x7f9eb80a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 >> 172.21.15.32:0/4143491370 conn(0x7f9eb80c5b20 msgr2=0x7f9eb806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.594+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 shutdown_connections 2024-01-19T04:16:02.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.598+0000 7f9ebd200640 1 -- 172.21.15.32:0/4143491370 wait complete. 2024-01-19T04:16:02.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:02.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd5d800640 1 Processor -- start 2024-01-19T04:16:02.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd5d800640 1 -- start start 2024-01-19T04:16:02.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd5d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd580c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd5d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd5806eb70 0x7efd5806f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd5d800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd580c5b40 con 0x7efd5806fda0 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd5d800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd581551e0 con 0x7efd5806eb70 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd5d800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd58155710 con 0x7efd58151f30 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd57400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd5806eb70 0x7efd5806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd57400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd5806eb70 0x7efd5806f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43694/0 (socket says 172.21.15.32:43694) 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd57400640 1 -- 172.21.15.32:0/2755340287 learned_addr learned my addr 172.21.15.32:0/2755340287 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:02.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd56000640 1 --1- 172.21.15.32:0/2755340287 >> v1:172.21.15.32:6789/0 conn(0x7efd5806fda0 0x7efd580c4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41772/0 (socket says 172.21.15.32:41772) 2024-01-19T04:16:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd56a00640 1 --2- 172.21.15.32:0/2755340287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd580c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd57400640 1 -- 172.21.15.32:0/2755340287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 msgr2=0x7efd580c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd57400640 1 --2- 172.21.15.32:0/2755340287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd580c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd57400640 1 -- 172.21.15.32:0/2755340287 >> v1:172.21.15.32:6789/0 conn(0x7efd5806fda0 legacy=0x7efd580c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd55600640 1 -- 172.21.15.32:0/2755340287 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672104625 0 0) 0x7efd580c5b40 con 0x7efd5806fda0 2024-01-19T04:16:02.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.758+0000 7efd57400640 1 -- 172.21.15.32:0/2755340287 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580c3fa0 con 0x7efd5806eb70 2024-01-19T04:16:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd57400640 1 --2- 172.21.15.32:0/2755340287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd5806f000 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efd50009e50 tx=0x7efd5001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193ab0985359084 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd55600640 1 -- 172.21.15.32:0/2755340287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a5750 con 0x7efd5806eb70 2024-01-19T04:16:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd55600640 1 -- 172.21.15.32:0/2755340287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500a58b0 con 0x7efd5806eb70 2024-01-19T04:16:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd55600640 1 -- 172.21.15.32:0/2755340287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a5c40 con 0x7efd5806eb70 2024-01-19T04:16:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 -- 172.21.15.32:0/2755340287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 msgr2=0x7efd5806f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 --2- 172.21.15.32:0/2755340287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd5806f000 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efd50009e50 tx=0x7efd5001c980 comp rx=0 tx=0).stop 2024-01-19T04:16:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 -- 172.21.15.32:0/2755340287 shutdown_connections 2024-01-19T04:16:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 --2- 172.21.15.32:0/2755340287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd5806f000 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 --2- 172.21.15.32:0/2755340287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd580c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 -- 172.21.15.32:0/2755340287 >> 172.21.15.32:0/2755340287 conn(0x7efd580a9870 msgr2=0x7efd580a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:02.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 -- 172.21.15.32:0/2755340287 shutdown_connections 2024-01-19T04:16:02.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.762+0000 7efd5d800640 1 -- 172.21.15.32:0/2755340287 wait complete. 2024-01-19T04:16:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 Processor -- start 2024-01-19T04:16:02.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 -- start start 2024-01-19T04:16:02.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd581eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd5806fda0 0x7efd5814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd5814dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581569c0 con 0x7efd5806eb70 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5814d790 con 0x7efd5806fda0 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd581561b0 con 0x7efd58151f30 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd581eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd581eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43700/0 (socket says 172.21.15.32:43700) 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 -- 172.21.15.32:0/104742133 learned_addr learned my addr 172.21.15.32:0/104742133 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56000640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd5806fda0 0x7efd5814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd57400640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd5814dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 -- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 msgr2=0x7efd5814dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd5814dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 -- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd5806fda0 msgr2=0x7efd5814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd5806fda0 0x7efd5814bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 -- 172.21.15.32:0/104742133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009b30 con 0x7efd5806eb70 2024-01-19T04:16:02.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd56a00640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd581eeca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efd4800d5f0 tx=0x7efd4800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd4ea00640 1 -- 172.21.15.32:0/104742133 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480125f0 con 0x7efd5806eb70 2024-01-19T04:16:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd4ea00640 1 -- 172.21.15.32:0/104742133 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd48012750 con 0x7efd5806eb70 2024-01-19T04:16:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd4ea00640 1 -- 172.21.15.32:0/104742133 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48012ae0 con 0x7efd5806eb70 2024-01-19T04:16:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5814da30 con 0x7efd5806eb70 2024-01-19T04:16:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.766+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd58156400 con 0x7efd5806eb70 2024-01-19T04:16:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.770+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd580749f0 con 0x7efd5806eb70 2024-01-19T04:16:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.770+0000 7efd4ea00640 1 -- 172.21.15.32:0/104742133 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efd48012c40 con 0x7efd5806eb70 2024-01-19T04:16:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.770+0000 7efd4ea00640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd30066500 0x7efd300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.770+0000 7efd4ea00640 1 -- 172.21.15.32:0/104742133 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd480841a0 con 0x7efd5806eb70 2024-01-19T04:16:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.770+0000 7efd56000640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd30066500 0x7efd300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.770+0000 7efd56000640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd30066500 0x7efd300689c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efd580a88b0 tx=0x7efd40007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:02.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.774+0000 7efd4ea00640 1 -- 172.21.15.32:0/104742133 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efd48051580 con 0x7efd5806eb70 2024-01-19T04:16:02.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.934+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd58067b80 con 0x7efd5806eb70 2024-01-19T04:16:02.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.934+0000 7efd4ea00640 1 -- 172.21.15.32:0/104742133 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16474 (secure 0 0 0) 0x7efd48007380 con 0x7efd5806eb70 2024-01-19T04:16:02.938 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:02.938 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:15:50.636645+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd30066500 msgr2=0x7efd300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd30066500 0x7efd300689c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efd580a88b0 tx=0x7efd40007d60 comp rx=0 tx=0).stop 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 msgr2=0x7efd581eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd581eeca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efd4800d5f0 tx=0x7efd4800dab0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 shutdown_connections 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd30066500 0x7efd300689c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd58151f30 0x7efd5814dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd5806fda0 0x7efd5814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 --2- 172.21.15.32:0/104742133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd5806eb70 0x7efd581eeca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 >> 172.21.15.32:0/104742133 conn(0x7efd580a9870 msgr2=0x7efd5815e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:02.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 shutdown_connections 2024-01-19T04:16:02.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:02.938+0000 7efd5d800640 1 -- 172.21.15.32:0/104742133 wait complete. 2024-01-19T04:16:02.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:15:46.886973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:48.025571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:02.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:03.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff653e00640 1 Processor -- start 2024-01-19T04:16:03.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff653e00640 1 -- start start 2024-01-19T04:16:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff653e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff64c0c6f80 0x7ff64c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff653e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c0c6cc0 con 0x7ff64c1524e0 2024-01-19T04:16:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff653e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c155a50 con 0x7ff64c0c3830 2024-01-19T04:16:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff653e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c0c40b0 con 0x7ff64c0c6f80 2024-01-19T04:16:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff651400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff64c0c6f80 0x7ff64c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff651400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff64c0c6f80 0x7ff64c0c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43710/0 (socket says 172.21.15.32:43710) 2024-01-19T04:16:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff650a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff64c1524e0 0x7ff64c152920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41786/0 (socket says 172.21.15.32:41786) 2024-01-19T04:16:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.102+0000 7ff651400640 1 -- 172.21.15.32:0/3128581725 learned_addr learned my addr 172.21.15.32:0/3128581725 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff651400640 1 -- 172.21.15.32:0/3128581725 >> v1:172.21.15.67:6789/0 conn(0x7ff64c0c3830 legacy=0x7ff64c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff651400640 1 -- 172.21.15.32:0/3128581725 >> v1:172.21.15.32:6789/0 conn(0x7ff64c1524e0 legacy=0x7ff64c152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff651400640 1 -- 172.21.15.32:0/3128581725 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c155d10 con 0x7ff64c0c6f80 2024-01-19T04:16:03.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff64be00640 1 -- 172.21.15.32:0/3128581725 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380888733 0 0) 0x7ff64c0c6cc0 con 0x7ff64c1524e0 2024-01-19T04:16:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff651400640 1 --2- 172.21.15.32:0/3128581725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c0c7360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009870 tx=0x7ff63c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644e1ea5f8457d1e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff64be00640 1 -- 172.21.15.32:0/3128581725 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0aa670 con 0x7ff64c0c6f80 2024-01-19T04:16:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff64be00640 1 -- 172.21.15.32:0/3128581725 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c0aa7d0 con 0x7ff64c0c6f80 2024-01-19T04:16:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.106+0000 7ff64be00640 1 -- 172.21.15.32:0/3128581725 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0aab60 con 0x7ff64c0c6f80 2024-01-19T04:16:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- 172.21.15.32:0/3128581725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 msgr2=0x7ff64c0c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 --2- 172.21.15.32:0/3128581725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c0c7360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009870 tx=0x7ff63c01c510 comp rx=0 tx=0).stop 2024-01-19T04:16:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- 172.21.15.32:0/3128581725 shutdown_connections 2024-01-19T04:16:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 --2- 172.21.15.32:0/3128581725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c0c7360 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- 172.21.15.32:0/3128581725 >> 172.21.15.32:0/3128581725 conn(0x7ff64c0663f0 msgr2=0x7ff64c066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- 172.21.15.32:0/3128581725 shutdown_connections 2024-01-19T04:16:03.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- 172.21.15.32:0/3128581725 wait complete. 2024-01-19T04:16:03.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 Processor -- start 2024-01-19T04:16:03.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- start start 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff64c0c3830 0x7ff64c147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff64c1524e0 0x7ff64c1ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c148660 con 0x7ff64c0c6f80 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c14cc20 con 0x7ff64c0c3830 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff653e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c147790 con 0x7ff64c1524e0 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff650a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff650a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43718/0 (socket says 172.21.15.32:43718) 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff650a00640 1 -- 172.21.15.32:0/2812551942 learned_addr learned my addr 172.21.15.32:0/2812551942 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff651e00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff64c1524e0 0x7ff64c1ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff651400640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff64c0c3830 0x7ff64c147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff650a00640 1 -- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff64c1524e0 msgr2=0x7ff64c1ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff650a00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff64c1524e0 0x7ff64c1ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff650a00640 1 -- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff64c0c3830 msgr2=0x7ff64c147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.110+0000 7ff650a00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff64c0c3830 0x7ff64c147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff650a00640 1 -- 172.21.15.32:0/2812551942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0094d0 con 0x7ff64c0c6f80 2024-01-19T04:16:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff650a00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c148120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff63400c440 tx=0x7ff63400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff649600640 1 -- 172.21.15.32:0/2812551942 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340074e0 con 0x7ff64c0c6f80 2024-01-19T04:16:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff649600640 1 -- 172.21.15.32:0/2812551942 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff634007640 con 0x7ff64c0c6f80 2024-01-19T04:16:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c149760 con 0x7ff64c0c6f80 2024-01-19T04:16:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff649600640 1 -- 172.21.15.32:0/2812551942 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634004a10 con 0x7ff64c0c6f80 2024-01-19T04:16:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c0c1ca0 con 0x7ff64c0c6f80 2024-01-19T04:16:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c147900 con 0x7ff64c0c6f80 2024-01-19T04:16:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff649600640 1 -- 172.21.15.32:0/2812551942 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff634004b70 con 0x7ff64c0c6f80 2024-01-19T04:16:03.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff649600640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff624066500 0x7ff6240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.114+0000 7ff649600640 1 -- 172.21.15.32:0/2812551942 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff634082ef0 con 0x7ff64c0c6f80 2024-01-19T04:16:03.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.118+0000 7ff651400640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff624066500 0x7ff6240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.118+0000 7ff651400640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff624066500 0x7ff6240689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0ae000 tx=0x7ff63c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.118+0000 7ff649600640 1 -- 172.21.15.32:0/2812551942 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff64c147900 con 0x7ff64c0c6f80 2024-01-19T04:16:03.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff64c149760 con 0x7ff64c0c6f80 2024-01-19T04:16:03.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff649600640 1 -- 172.21.15.32:0/2812551942 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff64c149760 con 0x7ff64c0c6f80 2024-01-19T04:16:03.283 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff624066500 msgr2=0x7ff6240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff624066500 0x7ff6240689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0ae000 tx=0x7ff63c0b5040 comp rx=0 tx=0).stop 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 msgr2=0x7ff64c148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c148120 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff63400c440 tx=0x7ff63400c900 comp rx=0 tx=0).stop 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 shutdown_connections 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff624066500 0x7ff6240689c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff64c1524e0 0x7ff64c1ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff64c0c6f80 0x7ff64c148120 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 --2- 172.21.15.32:0/2812551942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff64c0c3830 0x7ff64c147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 >> 172.21.15.32:0/2812551942 conn(0x7ff64c0663f0 msgr2=0x7ff64c0ac4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:03.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 shutdown_connections 2024-01-19T04:16:03.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.282+0000 7ff653e00640 1 -- 172.21.15.32:0/2812551942 wait complete. 2024-01-19T04:16:03.305 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:16:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.446+0000 7f9097c00640 1 Processor -- start 2024-01-19T04:16:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.446+0000 7f9097c00640 1 -- start start 2024-01-19T04:16:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9097c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f909006f420 0x7f909006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9097c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f909006f800 0x7f9090071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9097c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909006b5e0 con 0x7f909006abe0 2024-01-19T04:16:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9097c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9090071f20 con 0x7f909006f420 2024-01-19T04:16:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9097c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900c5d00 con 0x7f909006f800 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f909006f420 0x7f909006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f909006abe0 0x7f90900a5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41802/0 (socket says 172.21.15.32:41802) 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095c00640 1 -- 172.21.15.32:0/2642215506 learned_addr learned my addr 172.21.15.32:0/2642215506 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f908fe00640 1 --2- 172.21.15.32:0/2642215506 >> v2:172.21.15.67:3300/0 conn(0x7f909006f800 0x7f9090071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095200640 1 -- 172.21.15.32:0/2642215506 >> v2:172.21.15.67:3300/0 conn(0x7f909006f800 msgr2=0x7f9090071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095200640 1 --2- 172.21.15.32:0/2642215506 >> v2:172.21.15.67:3300/0 conn(0x7f909006f800 0x7f9090071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095200640 1 -- 172.21.15.32:0/2642215506 >> v1:172.21.15.32:6789/0 conn(0x7f909006abe0 legacy=0x7f90900a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095200640 1 -- 172.21.15.32:0/2642215506 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900c5fe0 con 0x7f909006f420 2024-01-19T04:16:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f9095200640 1 --2- 172.21.15.32:0/2642215506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006f420 0x7f909006a6a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f90900c45b0 tx=0x7f908001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458d4aa4680acd58 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.450+0000 7f908f400640 1 -- 172.21.15.32:0/2642215506 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800a7070 con 0x7f909006f420 2024-01-19T04:16:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f908f400640 1 -- 172.21.15.32:0/2642215506 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90800ab430 con 0x7f909006f420 2024-01-19T04:16:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f908f400640 1 -- 172.21.15.32:0/2642215506 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800ab7c0 con 0x7f909006f420 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- 172.21.15.32:0/2642215506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006f420 msgr2=0x7f909006a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 --2- 172.21.15.32:0/2642215506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006f420 0x7f909006a6a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f90900c45b0 tx=0x7f908001c430 comp rx=0 tx=0).stop 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- 172.21.15.32:0/2642215506 shutdown_connections 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 --2- 172.21.15.32:0/2642215506 >> v2:172.21.15.67:3300/0 conn(0x7f909006f800 0x7f9090071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 --2- 172.21.15.32:0/2642215506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006f420 0x7f909006a6a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- 172.21.15.32:0/2642215506 >> 172.21.15.32:0/2642215506 conn(0x7f90900c36c0 msgr2=0x7f90900c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- 172.21.15.32:0/2642215506 shutdown_connections 2024-01-19T04:16:03.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- 172.21.15.32:0/2642215506 wait complete. 2024-01-19T04:16:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 Processor -- start 2024-01-19T04:16:03.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- start start 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006abe0 0x7f90900c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909006f420 0x7f90900c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f909006f800 0x7f90900a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900bd800 con 0x7f909006abe0 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006d060 con 0x7f909006f420 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9097c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900bccd0 con 0x7f909006f800 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.454+0000 7f9095200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006abe0 0x7f90900c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006abe0 0x7f90900c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43732/0 (socket says 172.21.15.32:43732) 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 -- 172.21.15.32:0/3024052562 learned_addr learned my addr 172.21.15.32:0/3024052562 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095c00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f909006f800 0x7f90900a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f908fe00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909006f420 0x7f90900c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 -- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f909006f800 msgr2=0x7f90900a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f909006f800 0x7f90900a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 -- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909006f420 msgr2=0x7f90900c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909006f420 0x7f90900c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 -- 172.21.15.32:0/3024052562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080009420 con 0x7f909006abe0 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9095200640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006abe0 0x7f90900c09f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f908001aae0 tx=0x7f908001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f908cc00640 1 -- 172.21.15.32:0/3024052562 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080006e20 con 0x7f909006abe0 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f908cc00640 1 -- 172.21.15.32:0/3024052562 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90800b5610 con 0x7f909006abe0 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90901f1240 con 0x7f909006abe0 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f908cc00640 1 -- 172.21.15.32:0/3024052562 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800b5980 con 0x7f909006abe0 2024-01-19T04:16:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90900c2de0 con 0x7f909006abe0 2024-01-19T04:16:03.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909004f1d0 con 0x7f909006abe0 2024-01-19T04:16:03.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.458+0000 7f908cc00640 1 -- 172.21.15.32:0/3024052562 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f90800b5ae0 con 0x7f909006abe0 2024-01-19T04:16:03.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.462+0000 7f908cc00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9068066500 0x7f90680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.462+0000 7f908cc00640 1 -- 172.21.15.32:0/3024052562 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f908011ea30 con 0x7f909006abe0 2024-01-19T04:16:03.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.462+0000 7f908fe00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9068066500 0x7f90680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.462+0000 7f908fe00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9068066500 0x7f90680689c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f909006d4a0 tx=0x7f9078009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.466+0000 7f908cc00640 1 -- 172.21.15.32:0/3024052562 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f90800ebf30 con 0x7f909006abe0 2024-01-19T04:16:03.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.626+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90900749f0 con 0x7f909006abe0 2024-01-19T04:16:03.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.626+0000 7f908cc00640 1 -- 172.21.15.32:0/3024052562 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90800ef550 con 0x7f909006abe0 2024-01-19T04:16:03.628 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.626+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9068066500 msgr2=0x7f90680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.626+0000 7f9097c00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9068066500 0x7f90680689c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f909006d4a0 tx=0x7f9078009190 comp rx=0 tx=0).stop 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.626+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006abe0 msgr2=0x7f90900c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.626+0000 7f9097c00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006abe0 0x7f90900c09f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f908001aae0 tx=0x7f908001ac70 comp rx=0 tx=0).stop 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 shutdown_connections 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9068066500 0x7f90680689c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f909006f800 0x7f90900a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f909006f420 0x7f90900c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 --2- 172.21.15.32:0/3024052562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f909006abe0 0x7f90900c09f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 >> 172.21.15.32:0/3024052562 conn(0x7f90900c36c0 msgr2=0x7f909006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:03.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 shutdown_connections 2024-01-19T04:16:03.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.630+0000 7f9097c00640 1 -- 172.21.15.32:0/3024052562 wait complete. 2024-01-19T04:16:03.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:16:03.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.790+0000 7f4a76c00640 1 Processor -- start 2024-01-19T04:16:03.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.790+0000 7f4a76c00640 1 -- start start 2024-01-19T04:16:03.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a76c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a7006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a76c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700c0eb0 con 0x7f4a700c55d0 2024-01-19T04:16:03.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a76c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700a5330 con 0x7f4a700705b0 2024-01-19T04:16:03.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a76c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7006e5c0 con 0x7f4a7006cab0 2024-01-19T04:16:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4a700c55d0 0x7f4a700c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41806/0 (socket says 172.21.15.32:41806) 2024-01-19T04:16:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6f400640 1 -- 172.21.15.32:0/307823462 learned_addr learned my addr 172.21.15.32:0/307823462 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6fe00640 1 --2- 172.21.15.32:0/307823462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a7006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6ea00640 1 -- 172.21.15.32:0/307823462 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461380986 0 0) 0x7f4a700c0eb0 con 0x7f4a700c55d0 2024-01-19T04:16:03.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6ea00640 1 -- 172.21.15.32:0/307823462 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a50003450 con 0x7f4a700c55d0 2024-01-19T04:16:03.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6ea00640 1 -- 172.21.15.32:0/307823462 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969813928 0 0) 0x7f4a700a5330 con 0x7f4a700705b0 2024-01-19T04:16:03.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6ea00640 1 -- 172.21.15.32:0/307823462 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a700c0eb0 con 0x7f4a700705b0 2024-01-19T04:16:03.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6fe00640 1 -- 172.21.15.32:0/307823462 >> v1:172.21.15.67:6789/0 conn(0x7f4a700705b0 legacy=0x7f4a7015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6fe00640 1 -- 172.21.15.32:0/307823462 >> v1:172.21.15.32:6789/0 conn(0x7f4a700c55d0 legacy=0x7f4a700c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.794+0000 7f4a6fe00640 1 -- 172.21.15.32:0/307823462 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a701516f0 con 0x7f4a7006cab0 2024-01-19T04:16:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a6fe00640 1 --2- 172.21.15.32:0/307823462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a7006ce90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a600097f0 tx=0x7f4a6001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f12602bc29f81c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a6ea00640 1 -- 172.21.15.32:0/307823462 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600aa5f0 con 0x7f4a7006cab0 2024-01-19T04:16:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a6ea00640 1 -- 172.21.15.32:0/307823462 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a600aa750 con 0x7f4a7006cab0 2024-01-19T04:16:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a6ea00640 1 -- 172.21.15.32:0/307823462 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600aaae0 con 0x7f4a7006cab0 2024-01-19T04:16:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a76c00640 1 -- 172.21.15.32:0/307823462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 msgr2=0x7f4a7006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a76c00640 1 --2- 172.21.15.32:0/307823462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a7006ce90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a600097f0 tx=0x7f4a6001c490 comp rx=0 tx=0).stop 2024-01-19T04:16:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a76c00640 1 -- 172.21.15.32:0/307823462 shutdown_connections 2024-01-19T04:16:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a76c00640 1 --2- 172.21.15.32:0/307823462 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a7006ce90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a76c00640 1 -- 172.21.15.32:0/307823462 >> 172.21.15.32:0/307823462 conn(0x7f4a700c25a0 msgr2=0x7f4a700c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a76c00640 1 -- 172.21.15.32:0/307823462 shutdown_connections 2024-01-19T04:16:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.798+0000 7f4a76c00640 1 -- 172.21.15.32:0/307823462 wait complete. 2024-01-19T04:16:03.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 Processor -- start 2024-01-19T04:16:03.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 -- start start 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a700a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a700705b0 0x7f4a701ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a700c55d0 0x7f4a7014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70147670 con 0x7f4a700c55d0 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7014ac50 con 0x7f4a700705b0 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a701ecdf0 con 0x7f4a7006cab0 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a700c55d0 0x7f4a7014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a700c55d0 0x7f4a7014fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43744/0 (socket says 172.21.15.32:43744) 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 -- 172.21.15.32:0/3495346072 learned_addr learned my addr 172.21.15.32:0/3495346072 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a6f400640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a700705b0 0x7f4a701ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a6fe00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a700a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 -- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 msgr2=0x7f4a700a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a700a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 -- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a700705b0 msgr2=0x7f4a701ec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a700705b0 0x7f4a701ec5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 -- 172.21.15.32:0/3495346072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009420 con 0x7f4a700c55d0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a74c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a700c55d0 0x7f4a7014fa80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c7a0 tx=0x7f4a6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a67e00640 1 -- 172.21.15.32:0/3495346072 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68003b80 con 0x7f4a700c55d0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a67e00640 1 -- 172.21.15.32:0/3495346072 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68003ce0 con 0x7f4a700c55d0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a67e00640 1 -- 172.21.15.32:0/3495346072 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800aa90 con 0x7f4a700c55d0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a701ed0d0 con 0x7f4a700c55d0 2024-01-19T04:16:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.802+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a70150680 con 0x7f4a700c55d0 2024-01-19T04:16:03.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.806+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7014f3c0 con 0x7f4a700c55d0 2024-01-19T04:16:03.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.806+0000 7f4a67e00640 1 -- 172.21.15.32:0/3495346072 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4a6800abf0 con 0x7f4a700c55d0 2024-01-19T04:16:03.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.806+0000 7f4a67e00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a48066530 0x7f4a480689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:03.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.806+0000 7f4a67e00640 1 -- 172.21.15.32:0/3495346072 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a68083be0 con 0x7f4a700c55d0 2024-01-19T04:16:03.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.806+0000 7f4a6fe00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a48066530 0x7f4a480689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:03.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.810+0000 7f4a6fe00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a48066530 0x7f4a480689f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4a600ae000 tx=0x7f4a600a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:03.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.810+0000 7f4a67e00640 1 -- 172.21.15.32:0/3495346072 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4a7014f3c0 con 0x7f4a700c55d0 2024-01-19T04:16:03.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.970+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a7014f3c0 con 0x7f4a700c55d0 2024-01-19T04:16:03.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.970+0000 7f4a67e00640 1 -- 172.21.15.32:0/3495346072 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a7014f3c0 con 0x7f4a700c55d0 2024-01-19T04:16:03.972 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.970+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a48066530 msgr2=0x7f4a480689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.970+0000 7f4a76c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a48066530 0x7f4a480689f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4a600ae000 tx=0x7f4a600a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.970+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a700c55d0 msgr2=0x7f4a7014fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.970+0000 7f4a76c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a700c55d0 0x7f4a7014fa80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c7a0 tx=0x7f4a6800cc60 comp rx=0 tx=0).stop 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 shutdown_connections 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a48066530 0x7f4a480689f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a700c55d0 0x7f4a7014fa80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a700705b0 0x7f4a701ec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 --2- 172.21.15.32:0/3495346072 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4a7006cab0 0x7f4a700a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:03.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 >> 172.21.15.32:0/3495346072 conn(0x7f4a700c25a0 msgr2=0x7f4a700c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:03.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 shutdown_connections 2024-01-19T04:16:03.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:03.974+0000 7f4a76c00640 1 -- 172.21.15.32:0/3495346072 wait complete. 2024-01-19T04:16:03.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:16:04.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.134+0000 7f2f66800640 1 Processor -- start 2024-01-19T04:16:04.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.134+0000 7f2f66800640 1 -- start start 2024-01-19T04:16:04.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f66800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2f600c5740 0x7f2f600c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f66800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f600c1120 0x7f2f6015b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f66800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f600c0c90 con 0x7f2f600c42b0 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f66800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f60150f90 con 0x7f2f600c5740 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f66800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f60150cb0 con 0x7f2f600c1120 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2f600c5740 0x7f2f600c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2f600c5740 0x7f2f600c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43758/0 (socket says 172.21.15.32:43758) 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 -- 172.21.15.32:0/3209082386 learned_addr learned my addr 172.21.15.32:0/3209082386 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5fe00640 1 --2- 172.21.15.32:0/3209082386 >> v2:172.21.15.67:3300/0 conn(0x7f2f600c1120 0x7f2f6015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 -- 172.21.15.32:0/3209082386 >> v2:172.21.15.67:3300/0 conn(0x7f2f600c1120 msgr2=0x7f2f6015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:04.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 --2- 172.21.15.32:0/3209082386 >> v2:172.21.15.67:3300/0 conn(0x7f2f600c1120 0x7f2f6015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 -- 172.21.15.32:0/3209082386 >> v1:172.21.15.67:6789/0 conn(0x7f2f600c42b0 legacy=0x7f2f6006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 -- 172.21.15.32:0/3209082386 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f600c0640 con 0x7f2f600c5740 2024-01-19T04:16:04.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.138+0000 7f2f5ea00640 1 --2- 172.21.15.32:0/3209082386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f600c4690 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f600c1970 tx=0x7f2f4801e270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8def570800ba9d72 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f5e000640 1 -- 172.21.15.32:0/3209082386 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480a6880 con 0x7f2f600c5740 2024-01-19T04:16:04.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f5e000640 1 -- 172.21.15.32:0/3209082386 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f480a69e0 con 0x7f2f600c5740 2024-01-19T04:16:04.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f5e000640 1 -- 172.21.15.32:0/3209082386 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480a6d70 con 0x7f2f600c5740 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- 172.21.15.32:0/3209082386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 msgr2=0x7f2f600c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 --2- 172.21.15.32:0/3209082386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f600c4690 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f600c1970 tx=0x7f2f4801e270 comp rx=0 tx=0).stop 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- 172.21.15.32:0/3209082386 shutdown_connections 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 --2- 172.21.15.32:0/3209082386 >> v2:172.21.15.67:3300/0 conn(0x7f2f600c1120 0x7f2f6015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 --2- 172.21.15.32:0/3209082386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f600c4690 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- 172.21.15.32:0/3209082386 >> 172.21.15.32:0/3209082386 conn(0x7f2f600c5b20 msgr2=0x7f2f600c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- 172.21.15.32:0/3209082386 shutdown_connections 2024-01-19T04:16:04.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- 172.21.15.32:0/3209082386 wait complete. 2024-01-19T04:16:04.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 Processor -- start 2024-01-19T04:16:04.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- start start 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f600c1120 0x7f2f600bc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f600c42b0 0x7f2f6014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f601503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f601508f0 con 0x7f2f600c5740 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600bcb80 con 0x7f2f600c42b0 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.142+0000 7f2f66800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6014f9e0 con 0x7f2f600c1120 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f601503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f601503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43760/0 (socket says 172.21.15.32:43760) 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f600c42b0 0x7f2f6014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5f400640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f600c1120 0x7f2f600bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5fe00640 1 -- 172.21.15.32:0/3061804681 learned_addr learned my addr 172.21.15.32:0/3061804681 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5ea00640 1 -- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f600c1120 msgr2=0x7f2f600bc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5ea00640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f600c1120 0x7f2f600bc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5ea00640 1 -- 172.21.15.32:0/3061804681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 msgr2=0x7f2f601503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5ea00640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f601503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5ea00640 1 -- 172.21.15.32:0/3061804681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4800a670 con 0x7f2f600c42b0 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5f400640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f600c1120 0x7f2f600bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f5ea00640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f600c42b0 0x7f2f6014fe70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006bad0 tx=0x7f2f4801a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f57400640 1 -- 172.21.15.32:0/3061804681 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480ae910 con 0x7f2f600c42b0 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f57400640 1 -- 172.21.15.32:0/3061804681 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f480aea70 con 0x7f2f600c42b0 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f57400640 1 -- 172.21.15.32:0/3061804681 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480aee20 con 0x7f2f600c42b0 2024-01-19T04:16:04.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f600bb450 con 0x7f2f600c42b0 2024-01-19T04:16:04.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6014f670 con 0x7f2f600c42b0 2024-01-19T04:16:04.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f600749f0 con 0x7f2f600c42b0 2024-01-19T04:16:04.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.146+0000 7f2f57400640 1 -- 172.21.15.32:0/3061804681 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2f480b9460 con 0x7f2f600c42b0 2024-01-19T04:16:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.150+0000 7f2f57400640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f38066500 0x7f2f380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.150+0000 7f2f57400640 1 -- 172.21.15.32:0/3061804681 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f4811dcf0 con 0x7f2f600c42b0 2024-01-19T04:16:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.150+0000 7f2f5f400640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f38066500 0x7f2f380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.150+0000 7f2f5f400640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f38066500 0x7f2f380689c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f600bfbe0 tx=0x7f2f50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.154+0000 7f2f57400640 1 -- 172.21.15.32:0/3061804681 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2f480eb0b0 con 0x7f2f600c42b0 2024-01-19T04:16:04.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.318+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2f600c5210 con 0x7f2f600c42b0 2024-01-19T04:16:04.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.318+0000 7f2f57400640 1 -- 172.21.15.32:0/3061804681 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+207 (secure 0 0 0) 0x7f2f480b30e0 con 0x7f2f600c42b0 2024-01-19T04:16:04.320 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 4, 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "cephfs_metadata" 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 5, 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "cephfs_data" 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:04.321 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f38066500 msgr2=0x7f2f380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f38066500 0x7f2f380689c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f600bfbe0 tx=0x7f2f50009040 comp rx=0 tx=0).stop 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f600c42b0 msgr2=0x7f2f6014fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f600c42b0 0x7f2f6014fe70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006bad0 tx=0x7f2f4801a5b0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 shutdown_connections 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2f38066500 0x7f2f380689c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f600c5740 0x7f2f601503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f600c42b0 0x7f2f6014fe70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 --2- 172.21.15.32:0/3061804681 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2f600c1120 0x7f2f600bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 >> 172.21.15.32:0/3061804681 conn(0x7f2f600c5b20 msgr2=0x7f2f600c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:04.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 shutdown_connections 2024-01-19T04:16:04.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.322+0000 7f2f66800640 1 -- 172.21.15.32:0/3061804681 wait complete. 2024-01-19T04:16:04.342 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-19T04:16:04.342 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-19T04:16:04.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd93800640 1 Processor -- start 2024-01-19T04:16:04.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd93800640 1 -- start start 2024-01-19T04:16:04.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd93800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd8c0c4a30 0x7fdd8c06ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd93800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0c5cc0 con 0x7fdd8c0c7560 2024-01-19T04:16:04.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd93800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0c7ab0 con 0x7fdd8c0c3240 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd93800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c0c1b80 con 0x7fdd8c0c4a30 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd91800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdd8c0c7560 0x7fdd8c0c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41810/0 (socket says 172.21.15.32:41810) 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.486+0000 7fdd91800640 1 -- 172.21.15.32:0/1841727932 learned_addr learned my addr 172.21.15.32:0/1841727932 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd90e00640 1 --2- 172.21.15.32:0/1841727932 >> v2:172.21.15.67:3300/0 conn(0x7fdd8c0c4a30 0x7fdd8c06ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd8b400640 1 -- 172.21.15.32:0/1841727932 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142818492 0 0) 0x7fdd8c0c5cc0 con 0x7fdd8c0c7560 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd8b400640 1 -- 172.21.15.32:0/1841727932 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd6c003530 con 0x7fdd8c0c7560 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd8b400640 1 -- 172.21.15.32:0/1841727932 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478692675 0 0) 0x7fdd8c0c7ab0 con 0x7fdd8c0c3240 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd8b400640 1 -- 172.21.15.32:0/1841727932 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd8c0c5cc0 con 0x7fdd8c0c3240 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd90e00640 1 -- 172.21.15.32:0/1841727932 >> v1:172.21.15.67:6789/0 conn(0x7fdd8c0c3240 legacy=0x7fdd8c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd90e00640 1 -- 172.21.15.32:0/1841727932 >> v1:172.21.15.32:6789/0 conn(0x7fdd8c0c7560 legacy=0x7fdd8c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd90e00640 1 -- 172.21.15.32:0/1841727932 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c0c1e60 con 0x7fdd8c0c4a30 2024-01-19T04:16:04.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd90e00640 1 --2- 172.21.15.32:0/1841727932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c4a30 0x7fdd8c06ff30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0097c0 tx=0x7fdd7c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4959710878b357cb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd8b400640 1 -- 172.21.15.32:0/1841727932 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0ab670 con 0x7fdd8c0c4a30 2024-01-19T04:16:04.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd8b400640 1 -- 172.21.15.32:0/1841727932 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c0ab7d0 con 0x7fdd8c0c4a30 2024-01-19T04:16:04.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.490+0000 7fdd8b400640 1 -- 172.21.15.32:0/1841727932 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0abb40 con 0x7fdd8c0c4a30 2024-01-19T04:16:04.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- 172.21.15.32:0/1841727932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c4a30 msgr2=0x7fdd8c06ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 --2- 172.21.15.32:0/1841727932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c4a30 0x7fdd8c06ff30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0097c0 tx=0x7fdd7c01c450 comp rx=0 tx=0).stop 2024-01-19T04:16:04.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- 172.21.15.32:0/1841727932 shutdown_connections 2024-01-19T04:16:04.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 --2- 172.21.15.32:0/1841727932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c4a30 0x7fdd8c06ff30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- 172.21.15.32:0/1841727932 >> 172.21.15.32:0/1841727932 conn(0x7fdd8c0a9af0 msgr2=0x7fdd8c0a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:04.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- 172.21.15.32:0/1841727932 shutdown_connections 2024-01-19T04:16:04.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- 172.21.15.32:0/1841727932 wait complete. 2024-01-19T04:16:04.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 Processor -- start 2024-01-19T04:16:04.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- start start 2024-01-19T04:16:04.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c3240 0x7fdd8c0ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd8c0c4a30 0x7fdd8c157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd8c0c7560 0x7fdd8c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c151000 con 0x7fdd8c0c7560 2024-01-19T04:16:04.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c150470 con 0x7fdd8c0c3240 2024-01-19T04:16:04.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd93800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c150730 con 0x7fdd8c0c4a30 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd91800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd8c0c7560 0x7fdd8c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd90e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c3240 0x7fdd8c0ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd91800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd8c0c7560 0x7fdd8c158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43774/0 (socket says 172.21.15.32:43774) 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd91800640 1 -- 172.21.15.32:0/1977446567 learned_addr learned my addr 172.21.15.32:0/1977446567 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd90e00640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c3240 0x7fdd8c0ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:54032/0 (socket says 172.21.15.32:54032) 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.494+0000 7fdd8be00640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd8c0c4a30 0x7fdd8c157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd91800640 1 -- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd8c0c4a30 msgr2=0x7fdd8c157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd91800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd8c0c4a30 0x7fdd8c157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd91800640 1 -- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c3240 msgr2=0x7fdd8c0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd91800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c3240 0x7fdd8c0ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd91800640 1 -- 172.21.15.32:0/1977446567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c009420 con 0x7fdd8c0c7560 2024-01-19T04:16:04.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd91800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd8c0c7560 0x7fdd8c158350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400caa0 tx=0x7fdd8400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd88c00640 1 -- 172.21.15.32:0/1977446567 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400ac00 con 0x7fdd8c0c7560 2024-01-19T04:16:04.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd88c00640 1 -- 172.21.15.32:0/1977446567 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400ad80 con 0x7fdd8c0c7560 2024-01-19T04:16:04.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c151250 con 0x7fdd8c0c7560 2024-01-19T04:16:04.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd88c00640 1 -- 172.21.15.32:0/1977446567 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84012640 con 0x7fdd8c0c7560 2024-01-19T04:16:04.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c154030 con 0x7fdd8c0c7560 2024-01-19T04:16:04.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c068290 con 0x7fdd8c0c7560 2024-01-19T04:16:04.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd88c00640 1 -- 172.21.15.32:0/1977446567 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdd84007070 con 0x7fdd8c0c7560 2024-01-19T04:16:04.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd88c00640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd64066500 0x7fdd640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.498+0000 7fdd88c00640 1 -- 172.21.15.32:0/1977446567 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd84083da0 con 0x7fdd8c0c7560 2024-01-19T04:16:04.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.502+0000 7fdd90e00640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd64066500 0x7fdd640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.502+0000 7fdd90e00640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd64066500 0x7fdd640689c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0af000 tx=0x7fdd7c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.502+0000 7fdd88c00640 1 -- 172.21.15.32:0/1977446567 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdd840510e0 con 0x7fdd8c0c7560 2024-01-19T04:16:04.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.670+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdd8c151440 con 0x7fdd8c0c7560 2024-01-19T04:16:04.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd88c00640 1 -- 172.21.15.32:0/1977446567 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v36) v1 ==== 140+0+0 (secure 0 0 0) 0x7fdd840170b0 con 0x7fdd8c0c7560 2024-01-19T04:16:04.767 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_metadata' created 2024-01-19T04:16:04.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd64066500 msgr2=0x7fdd640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd64066500 0x7fdd640689c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0af000 tx=0x7fdd7c0a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:04.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd8c0c7560 msgr2=0x7fdd8c158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd8c0c7560 0x7fdd8c158350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400caa0 tx=0x7fdd8400cf60 comp rx=0 tx=0).stop 2024-01-19T04:16:04.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 shutdown_connections 2024-01-19T04:16:04.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd64066500 0x7fdd640689c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd8c0c7560 0x7fdd8c158350 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd8c0c4a30 0x7fdd8c157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.766+0000 7fdd93800640 1 --2- 172.21.15.32:0/1977446567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8c0c3240 0x7fdd8c0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.770+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 >> 172.21.15.32:0/1977446567 conn(0x7fdd8c0a9af0 msgr2=0x7fdd8c0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:04.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.770+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 shutdown_connections 2024-01-19T04:16:04.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.770+0000 7fdd93800640 1 -- 172.21.15.32:0/1977446567 wait complete. 2024-01-19T04:16:04.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:16:04.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 Processor -- start 2024-01-19T04:16:04.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 -- start start 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc0723b0 0x7f96cc152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96cc0c2080 0x7f96cc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96cc06d440 0x7f96cc0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc1524a0 con 0x7f96cc06d440 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0a4ea0 con 0x7f96cc0c2080 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d4800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc152a20 con 0x7f96cc0723b0 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96cc06d440 0x7f96cc0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96cc06d440 0x7f96cc0c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43790/0 (socket says 172.21.15.32:43790) 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 -- 172.21.15.32:0/1343569041 learned_addr learned my addr 172.21.15.32:0/1343569041 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d1400640 1 --2- 172.21.15.32:0/1343569041 >> v2:172.21.15.67:3300/0 conn(0x7f96cc0c2080 0x7f96cc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d1e00640 1 --2- 172.21.15.32:0/1343569041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc0723b0 0x7f96cc152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 -- 172.21.15.32:0/1343569041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc0723b0 msgr2=0x7f96cc152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:04.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 --2- 172.21.15.32:0/1343569041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc0723b0 0x7f96cc152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 -- 172.21.15.32:0/1343569041 >> v2:172.21.15.67:3300/0 conn(0x7f96cc0c2080 msgr2=0x7f96cc155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:04.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 --2- 172.21.15.32:0/1343569041 >> v2:172.21.15.67:3300/0 conn(0x7f96cc0c2080 0x7f96cc155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d2800640 1 -- 172.21.15.32:0/1343569041 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc1533f0 con 0x7f96cc06d440 2024-01-19T04:16:04.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.942+0000 7f96d1e00640 1 --2- 172.21.15.32:0/1343569041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc0723b0 0x7f96cc152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:04.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d2800640 1 --2- 172.21.15.32:0/1343569041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc06d440 0x7f96cc0c4e50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0a8810 tx=0x7f96c401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee46dee124a9cd9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d0a00640 1 -- 172.21.15.32:0/1343569041 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40a5640 con 0x7f96cc06d440 2024-01-19T04:16:04.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d0a00640 1 -- 172.21.15.32:0/1343569041 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40a57a0 con 0x7f96cc06d440 2024-01-19T04:16:04.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d0a00640 1 -- 172.21.15.32:0/1343569041 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40a5b30 con 0x7f96cc06d440 2024-01-19T04:16:04.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 -- 172.21.15.32:0/1343569041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc06d440 msgr2=0x7f96cc0c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 --2- 172.21.15.32:0/1343569041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc06d440 0x7f96cc0c4e50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0a8810 tx=0x7f96c401c8b0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 -- 172.21.15.32:0/1343569041 shutdown_connections 2024-01-19T04:16:04.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 --2- 172.21.15.32:0/1343569041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc06d440 0x7f96cc0c4e50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 --2- 172.21.15.32:0/1343569041 >> v2:172.21.15.67:3300/0 conn(0x7f96cc0c2080 0x7f96cc155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 --2- 172.21.15.32:0/1343569041 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc0723b0 0x7f96cc152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 -- 172.21.15.32:0/1343569041 >> 172.21.15.32:0/1343569041 conn(0x7f96cc0c25a0 msgr2=0x7f96cc0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:04.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 -- 172.21.15.32:0/1343569041 shutdown_connections 2024-01-19T04:16:04.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.946+0000 7f96d4800640 1 -- 172.21.15.32:0/1343569041 wait complete. 2024-01-19T04:16:04.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 Processor -- start 2024-01-19T04:16:04.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 -- start start 2024-01-19T04:16:04.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc06d440 0x7f96cc1462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96cc0723b0 0x7f96cc151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc0c2080 0x7f96cc145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc146830 con 0x7f96cc0c2080 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0a64d0 con 0x7f96cc0723b0 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc155da0 con 0x7f96cc06d440 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc0c2080 0x7f96cc145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc0c2080 0x7f96cc145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43794/0 (socket says 172.21.15.32:43794) 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 -- 172.21.15.32:0/3398274506 learned_addr learned my addr 172.21.15.32:0/3398274506 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d1e00640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc06d440 0x7f96cc1462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d1400640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96cc0723b0 0x7f96cc151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 -- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc06d440 msgr2=0x7f96cc1462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc06d440 0x7f96cc1462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 -- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96cc0723b0 msgr2=0x7f96cc151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96cc0723b0 0x7f96cc151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 -- 172.21.15.32:0/3398274506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009b30 con 0x7f96cc0c2080 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d2800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc0c2080 0x7f96cc145330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f96c401af60 tx=0x7f96c4019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96ca000640 1 -- 172.21.15.32:0/3398274506 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40a5640 con 0x7f96cc0c2080 2024-01-19T04:16:04.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96ca000640 1 -- 172.21.15.32:0/3398274506 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40b8690 con 0x7f96cc0c2080 2024-01-19T04:16:04.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96ca000640 1 -- 172.21.15.32:0/3398274506 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40b8a40 con 0x7f96cc0c2080 2024-01-19T04:16:04.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc146010 con 0x7f96cc0c2080 2024-01-19T04:16:04.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.950+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc1555a0 con 0x7f96cc0c2080 2024-01-19T04:16:04.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.954+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc155100 con 0x7f96cc0c2080 2024-01-19T04:16:04.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.954+0000 7f96ca000640 1 -- 172.21.15.32:0/3398274506 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96c40b8ba0 con 0x7f96cc0c2080 2024-01-19T04:16:04.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.954+0000 7f96ca000640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96a4066500 0x7f96a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:04.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.954+0000 7f96ca000640 1 -- 172.21.15.32:0/3398274506 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f96c411f6f0 con 0x7f96cc0c2080 2024-01-19T04:16:04.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.954+0000 7f96d1e00640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96a4066500 0x7f96a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.958+0000 7f96d1e00640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96a4066500 0x7f96a40689c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0c4610 tx=0x7f96bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:04.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:04.958+0000 7f96ca000640 1 -- 172.21.15.32:0/3398274506 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f96c40eca00 con 0x7f96cc0c2080 2024-01-19T04:16:05.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.118+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f96cc155f60 con 0x7f96cc0c2080 2024-01-19T04:16:05.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.766+0000 7f96ca000640 1 -- 172.21.15.32:0/3398274506 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v37) v1 ==== 172+0+0 (secure 0 0 0) 0x7f96c40bc0d0 con 0x7f96cc0c2080 2024-01-19T04:16:05.770 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_data' created 2024-01-19T04:16:05.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96a4066500 msgr2=0x7f96a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96a4066500 0x7f96a40689c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0c4610 tx=0x7f96bc008040 comp rx=0 tx=0).stop 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc0c2080 msgr2=0x7f96cc145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc0c2080 0x7f96cc145330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f96c401af60 tx=0x7f96c4019650 comp rx=0 tx=0).stop 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 shutdown_connections 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96a4066500 0x7f96a40689c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96cc0c2080 0x7f96cc145330 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96cc0723b0 0x7f96cc151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 --2- 172.21.15.32:0/3398274506 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96cc06d440 0x7f96cc1462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.770+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 >> 172.21.15.32:0/3398274506 conn(0x7f96cc0c25a0 msgr2=0x7f96cc0c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:05.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.774+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 shutdown_connections 2024-01-19T04:16:05.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.774+0000 7f96d4800640 1 -- 172.21.15.32:0/3398274506 wait complete. 2024-01-19T04:16:05.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-19T04:16:05.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.958+0000 7fe1a9200640 1 Processor -- start 2024-01-19T04:16:05.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.958+0000 7fe1a9200640 1 -- start start 2024-01-19T04:16:05.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:05.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a9200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40c0eb0 con 0x7fe1a40705b0 2024-01-19T04:16:05.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a9200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40a5330 con 0x7fe1a406cab0 2024-01-19T04:16:05.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a9200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a406e5c0 con 0x7fe1a40c55d0 2024-01-19T04:16:05.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a2800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe1a40705b0 0x7fe1a415b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41826/0 (socket says 172.21.15.32:41826) 2024-01-19T04:16:05.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a2800640 1 -- 172.21.15.32:0/481625367 learned_addr learned my addr 172.21.15.32:0/481625367 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a1400640 1 --2- 172.21.15.32:0/481625367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682856111 0 0) 0x7fe1a40c0eb0 con 0x7fe1a40705b0 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe184003530 con 0x7fe1a40705b0 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473815017 0 0) 0x7fe1a40a5330 con 0x7fe1a406cab0 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a40c0eb0 con 0x7fe1a406cab0 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a1400640 1 -- 172.21.15.32:0/481625367 >> v1:172.21.15.67:6789/0 conn(0x7fe1a406cab0 legacy=0x7fe1a40c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a1400640 1 -- 172.21.15.32:0/481625367 >> v1:172.21.15.32:6789/0 conn(0x7fe1a40705b0 legacy=0x7fe1a415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:05.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3411191869 0 0) 0x7fe184003530 con 0x7fe1a40705b0 2024-01-19T04:16:05.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.962+0000 7fe1a1400640 1 -- 172.21.15.32:0/481625367 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a41516f0 con 0x7fe1a40c55d0 2024-01-19T04:16:05.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a1400640 1 --2- 172.21.15.32:0/481625367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a406ce90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9367d879bfcd6403 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:05.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c001a00 con 0x7fe1a40c55d0 2024-01-19T04:16:05.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c0a7050 con 0x7fe1a40c55d0 2024-01-19T04:16:05.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a0a00640 1 -- 172.21.15.32:0/481625367 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0ab620 con 0x7fe1a40c55d0 2024-01-19T04:16:05.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 -- 172.21.15.32:0/481625367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 msgr2=0x7fe1a406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:05.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 --2- 172.21.15.32:0/481625367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a406ce90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c01c3b0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 -- 172.21.15.32:0/481625367 shutdown_connections 2024-01-19T04:16:05.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 --2- 172.21.15.32:0/481625367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a406ce90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 -- 172.21.15.32:0/481625367 >> 172.21.15.32:0/481625367 conn(0x7fe1a40c25a0 msgr2=0x7fe1a40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:05.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 -- 172.21.15.32:0/481625367 shutdown_connections 2024-01-19T04:16:05.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 -- 172.21.15.32:0/481625367 wait complete. 2024-01-19T04:16:05.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 Processor -- start 2024-01-19T04:16:05.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.966+0000 7fe1a9200640 1 -- start start 2024-01-19T04:16:05.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1a406cab0 0x7fe1a41f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:05.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1a40705b0 0x7fe1a41f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a41eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40a8b90 con 0x7fe1a40705b0 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4150c70 con 0x7fe1a406cab0 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40c62f0 con 0x7fe1a40c55d0 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1a40705b0 0x7fe1a41f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1a40705b0 0x7fe1a41f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43800/0 (socket says 172.21.15.32:43800) 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 -- 172.21.15.32:0/3980856598 learned_addr learned my addr 172.21.15.32:0/3980856598 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a2800640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a41eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1e00640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1a406cab0 0x7fe1a41f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 -- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 msgr2=0x7fe1a41eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a41eeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 -- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1a406cab0 msgr2=0x7fe1a41f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1a406cab0 0x7fe1a41f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:05.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 -- 172.21.15.32:0/3980856598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c009420 con 0x7fe1a40705b0 2024-01-19T04:16:05.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a2800640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a41eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:05.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a1400640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1a40705b0 0x7fe1a41f10b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009740 tx=0x7fe18c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:05.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe19a000640 1 -- 172.21.15.32:0/3980856598 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0b4410 con 0x7fe1a40705b0 2024-01-19T04:16:05.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe19a000640 1 -- 172.21.15.32:0/3980856598 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c0b4570 con 0x7fe1a40705b0 2024-01-19T04:16:05.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4150340 con 0x7fe1a40705b0 2024-01-19T04:16:05.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe19a000640 1 -- 172.21.15.32:0/3980856598 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0b4900 con 0x7fe1a40705b0 2024-01-19T04:16:05.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a4150900 con 0x7fe1a40705b0 2024-01-19T04:16:05.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.970+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a41ee810 con 0x7fe1a40705b0 2024-01-19T04:16:05.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.974+0000 7fe19a000640 1 -- 172.21.15.32:0/3980856598 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe18c0b2040 con 0x7fe1a40705b0 2024-01-19T04:16:05.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.974+0000 7fe19a000640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe17c066500 0x7fe17c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:05.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.974+0000 7fe19a000640 1 -- 172.21.15.32:0/3980856598 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fe18c11e2b0 con 0x7fe1a40705b0 2024-01-19T04:16:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.974+0000 7fe1a1e00640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe17c066500 0x7fe17c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.978+0000 7fe1a1e00640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe17c066500 0x7fe17c0689c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe1940011f0 tx=0x7fe194009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:05.978+0000 7fe19a000640 1 -- 172.21.15.32:0/3980856598 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe18c0eb3d0 con 0x7fe1a40705b0 2024-01-19T04:16:06.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.174+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fe1a41ee810 con 0x7fe1a40705b0 2024-01-19T04:16:06.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.770+0000 7fe19a000640 1 -- 172.21.15.32:0/3980856598 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 175+0+0 (secure 0 0 0) 0x7fe1a41ee810 con 0x7fe1a40705b0 2024-01-19T04:16:06.771 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 6 and data pool 7 2024-01-19T04:16:06.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.770+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe17c066500 msgr2=0x7fe17c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:06.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.770+0000 7fe1a9200640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe17c066500 0x7fe17c0689c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe1940011f0 tx=0x7fe194009040 comp rx=0 tx=0).stop 2024-01-19T04:16:06.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.770+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1a40705b0 msgr2=0x7fe1a41f10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:06.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.770+0000 7fe1a9200640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1a40705b0 0x7fe1a41f10b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009740 tx=0x7fe18c019150 comp rx=0 tx=0).stop 2024-01-19T04:16:06.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 shutdown_connections 2024-01-19T04:16:06.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe17c066500 0x7fe17c0689c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe1a40c55d0 0x7fe1a41eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1a40705b0 0x7fe1a41f10b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 --2- 172.21.15.32:0/3980856598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1a406cab0 0x7fe1a41f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 >> 172.21.15.32:0/3980856598 conn(0x7fe1a40c25a0 msgr2=0x7fe1a414cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:06.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 shutdown_connections 2024-01-19T04:16:06.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.774+0000 7fe1a9200640 1 -- 172.21.15.32:0/3980856598 wait complete. 2024-01-19T04:16:06.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:06.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.942+0000 7fde55800640 1 Processor -- start 2024-01-19T04:16:06.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.942+0000 7fde55800640 1 -- start start 2024-01-19T04:16:06.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde55800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fde5014fb50 0x7fde5006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:06.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde55800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500c04a0 0x7fde500c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:06.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde55800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde50071e80 con 0x7fde500a4ec0 2024-01-19T04:16:06.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde55800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde501535c0 con 0x7fde5014fb50 2024-01-19T04:16:06.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde55800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500726c0 con 0x7fde500c04a0 2024-01-19T04:16:06.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fde500a4ec0 0x7fde50155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41834/0 (socket says 172.21.15.32:41834) 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4f400640 1 -- 172.21.15.32:0/415744868 learned_addr learned my addr 172.21.15.32:0/415744868 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4e000640 1 --2- 172.21.15.32:0/415744868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500c04a0 0x7fde500c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4ea00640 1 --2- 172.21.15.32:0/415744868 >> v2:172.21.15.67:3300/0 conn(0x7fde5014fb50 0x7fde5006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4d600640 1 -- 172.21.15.32:0/415744868 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240140603 0 0) 0x7fde50071e80 con 0x7fde500a4ec0 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4d600640 1 -- 172.21.15.32:0/415744868 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde30003530 con 0x7fde500a4ec0 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4e000640 1 -- 172.21.15.32:0/415744868 >> v2:172.21.15.67:3300/0 conn(0x7fde5014fb50 msgr2=0x7fde5006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4e000640 1 --2- 172.21.15.32:0/415744868 >> v2:172.21.15.67:3300/0 conn(0x7fde5014fb50 0x7fde5006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4e000640 1 -- 172.21.15.32:0/415744868 >> v1:172.21.15.32:6789/0 conn(0x7fde500a4ec0 legacy=0x7fde50155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4e000640 1 -- 172.21.15.32:0/415744868 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500c0a20 con 0x7fde500c04a0 2024-01-19T04:16:06.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.946+0000 7fde4ea00640 1 --2- 172.21.15.32:0/415744868 >> v2:172.21.15.67:3300/0 conn(0x7fde5014fb50 0x7fde5006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:06.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde4e000640 1 --2- 172.21.15.32:0/415744868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500c04a0 0x7fde500c1230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde380097f0 tx=0x7fde3801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ec399591c049896 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:06.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde4d600640 1 -- 172.21.15.32:0/415744868 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380ab600 con 0x7fde500c04a0 2024-01-19T04:16:06.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde4d600640 1 -- 172.21.15.32:0/415744868 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde380a7050 con 0x7fde500c04a0 2024-01-19T04:16:06.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde4d600640 1 -- 172.21.15.32:0/415744868 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380ab980 con 0x7fde500c04a0 2024-01-19T04:16:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 -- 172.21.15.32:0/415744868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500c04a0 msgr2=0x7fde500c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 --2- 172.21.15.32:0/415744868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500c04a0 0x7fde500c1230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde380097f0 tx=0x7fde3801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 -- 172.21.15.32:0/415744868 shutdown_connections 2024-01-19T04:16:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 --2- 172.21.15.32:0/415744868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500c04a0 0x7fde500c1230 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 --2- 172.21.15.32:0/415744868 >> v2:172.21.15.67:3300/0 conn(0x7fde5014fb50 0x7fde5006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 -- 172.21.15.32:0/415744868 >> 172.21.15.32:0/415744868 conn(0x7fde500c5b20 msgr2=0x7fde500c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 -- 172.21.15.32:0/415744868 shutdown_connections 2024-01-19T04:16:06.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.950+0000 7fde55800640 1 -- 172.21.15.32:0/415744868 wait complete. 2024-01-19T04:16:06.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 Processor -- start 2024-01-19T04:16:06.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 -- start start 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500a4ec0 0x7fde500a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500c04a0 0x7fde500a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5014fb50 0x7fde5014cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde501eb2d0 con 0x7fde5014fb50 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5014d7a0 con 0x7fde500c04a0 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500ab550 con 0x7fde500a4ec0 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5014fb50 0x7fde5014cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:06.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5014fb50 0x7fde5014cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43806/0 (socket says 172.21.15.32:43806) 2024-01-19T04:16:06.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 -- 172.21.15.32:0/912381873 learned_addr learned my addr 172.21.15.32:0/912381873 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:06.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4ea00640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500a4ec0 0x7fde500a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:06.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4e000640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500c04a0 0x7fde500a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:06.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 -- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500a4ec0 msgr2=0x7fde500a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:06.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500a4ec0 0x7fde500a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 -- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500c04a0 msgr2=0x7fde500a9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500c04a0 0x7fde500a9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:06.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 -- 172.21.15.32:0/912381873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009420 con 0x7fde5014fb50 2024-01-19T04:16:06.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde4f400640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5014fb50 0x7fde5014cb80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde4800caa0 tx=0x7fde4800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:06.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde46a00640 1 -- 172.21.15.32:0/912381873 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800ac00 con 0x7fde5014fb50 2024-01-19T04:16:06.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde46a00640 1 -- 172.21.15.32:0/912381873 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800ad60 con 0x7fde5014fb50 2024-01-19T04:16:06.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde46a00640 1 -- 172.21.15.32:0/912381873 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48012620 con 0x7fde5014fb50 2024-01-19T04:16:06.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde38009420 con 0x7fde5014fb50 2024-01-19T04:16:06.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.954+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde501eb4c0 con 0x7fde5014fb50 2024-01-19T04:16:06.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.958+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde500749f0 con 0x7fde5014fb50 2024-01-19T04:16:06.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.958+0000 7fde46a00640 1 -- 172.21.15.32:0/912381873 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fde48007070 con 0x7fde5014fb50 2024-01-19T04:16:06.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.958+0000 7fde46a00640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fde28066500 0x7fde280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:06.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.958+0000 7fde46a00640 1 -- 172.21.15.32:0/912381873 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fde48084190 con 0x7fde5014fb50 2024-01-19T04:16:06.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.958+0000 7fde4ea00640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fde28066500 0x7fde280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:06.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.958+0000 7fde4ea00640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fde28066500 0x7fde280689c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde50073e80 tx=0x7fde40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:06.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:06.962+0000 7fde46a00640 1 -- 172.21.15.32:0/912381873 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fde480510c0 con 0x7fde5014fb50 2024-01-19T04:16:07.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.122+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde50153700 con 0x7fde5014fb50 2024-01-19T04:16:07.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde46a00640 1 -- 172.21.15.32:0/912381873 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20147 (secure 0 0 0) 0x7fde480546e0 con 0x7fde5014fb50 2024-01-19T04:16:07.126 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:07.126 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:06.177020+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:07.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fde28066500 msgr2=0x7fde280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fde28066500 0x7fde280689c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde50073e80 tx=0x7fde40008040 comp rx=0 tx=0).stop 2024-01-19T04:16:07.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5014fb50 msgr2=0x7fde5014cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5014fb50 0x7fde5014cb80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde4800caa0 tx=0x7fde4800cf60 comp rx=0 tx=0).stop 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 shutdown_connections 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fde28066500 0x7fde280689c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde5014fb50 0x7fde5014cb80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde500c04a0 0x7fde500a9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 --2- 172.21.15.32:0/912381873 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fde500a4ec0 0x7fde500a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 >> 172.21.15.32:0/912381873 conn(0x7fde500c5b20 msgr2=0x7fde50151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 shutdown_connections 2024-01-19T04:16:07.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.126+0000 7fde55800640 1 -- 172.21.15.32:0/912381873 wait complete. 2024-01-19T04:16:07.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.286+0000 7fa2e7400640 1 Processor -- start 2024-01-19T04:16:07.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.286+0000 7fa2e7400640 1 -- start start 2024-01-19T04:16:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa2e00c78d0 0x7fa2e00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e7400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e00c6570 con 0x7fa2e006fa50 2024-01-19T04:16:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e7400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e00c81f0 con 0x7fa2e0155060 2024-01-19T04:16:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e7400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e0155560 con 0x7fa2e00c78d0 2024-01-19T04:16:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e5400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa2e006fa50 0x7fa2e00c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41846/0 (socket says 172.21.15.32:41846) 2024-01-19T04:16:07.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e5400640 1 -- 172.21.15.32:0/799562580 learned_addr learned my addr 172.21.15.32:0/799562580 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e4a00640 1 --2- 172.21.15.32:0/799562580 >> v2:172.21.15.67:3300/0 conn(0x7fa2e00c78d0 0x7fa2e00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443374415 0 0) 0x7fa2e00c6570 con 0x7fa2e006fa50 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c0003530 con 0x7fa2e006fa50 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430387071 0 0) 0x7fa2e00c81f0 con 0x7fa2e0155060 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e00c6570 con 0x7fa2e0155060 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737179250 0 0) 0x7fa2c0003530 con 0x7fa2e006fa50 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e4a00640 1 -- 172.21.15.32:0/799562580 >> v1:172.21.15.67:6789/0 conn(0x7fa2e0155060 legacy=0x7fa2e00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e4a00640 1 -- 172.21.15.32:0/799562580 >> v1:172.21.15.32:6789/0 conn(0x7fa2e006fa50 legacy=0x7fa2e00c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.290+0000 7fa2e4a00640 1 -- 172.21.15.32:0/799562580 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00c5c40 con 0x7fa2e00c78d0 2024-01-19T04:16:07.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e4a00640 1 --2- 172.21.15.32:0/799562580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e00c78d0 0x7fa2e00c7cb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00097c0 tx=0x7fa2d001c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8666b830e9f4a692 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:07.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8001a00 con 0x7fa2e00c78d0 2024-01-19T04:16:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d00a7050 con 0x7fa2e00c78d0 2024-01-19T04:16:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2df400640 1 -- 172.21.15.32:0/799562580 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00ab620 con 0x7fa2e00c78d0 2024-01-19T04:16:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 -- 172.21.15.32:0/799562580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e00c78d0 msgr2=0x7fa2e00c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 --2- 172.21.15.32:0/799562580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e00c78d0 0x7fa2e00c7cb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00097c0 tx=0x7fa2d001c250 comp rx=0 tx=0).stop 2024-01-19T04:16:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 -- 172.21.15.32:0/799562580 shutdown_connections 2024-01-19T04:16:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 --2- 172.21.15.32:0/799562580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e00c78d0 0x7fa2e00c7cb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 -- 172.21.15.32:0/799562580 >> 172.21.15.32:0/799562580 conn(0x7fa2e006ddb0 msgr2=0x7fa2e006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 -- 172.21.15.32:0/799562580 shutdown_connections 2024-01-19T04:16:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 -- 172.21.15.32:0/799562580 wait complete. 2024-01-19T04:16:07.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 Processor -- start 2024-01-19T04:16:07.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.294+0000 7fa2e7400640 1 -- start start 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e006fa50 0x7fa2e014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e00c78d0 0x7fa2e0150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2e0155060 0x7fa2e01f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e01edf10 con 0x7fa2e00c78d0 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00a76e0 con 0x7fa2e006fa50 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e014dd40 con 0x7fa2e0155060 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e00c78d0 0x7fa2e0150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e00c78d0 0x7fa2e0150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43808/0 (socket says 172.21.15.32:43808) 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 -- 172.21.15.32:0/2882696372 learned_addr learned my addr 172.21.15.32:0/2882696372 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e4a00640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e006fa50 0x7fa2e014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e5400640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2e0155060 0x7fa2e01f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 -- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2e0155060 msgr2=0x7fa2e01f0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2e0155060 0x7fa2e01f0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 -- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e006fa50 msgr2=0x7fa2e014d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e006fa50 0x7fa2e014d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 -- 172.21.15.32:0/2882696372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0009420 con 0x7fa2e00c78d0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dfe00640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e00c78d0 0x7fa2e0150b80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c3c0 tx=0x7fa2c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dcc00640 1 -- 172.21.15.32:0/2882696372 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80052d0 con 0x7fa2e00c78d0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dcc00640 1 -- 172.21.15.32:0/2882696372 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8005430 con 0x7fa2e00c78d0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2dcc00640 1 -- 172.21.15.32:0/2882696372 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8003840 con 0x7fa2e00c78d0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e014fc40 con 0x7fa2e00c78d0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e00a7930 con 0x7fa2e00c78d0 2024-01-19T04:16:07.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.298+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e00749f0 con 0x7fa2e00c78d0 2024-01-19T04:16:07.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.302+0000 7fa2dcc00640 1 -- 172.21.15.32:0/2882696372 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa2c80039a0 con 0x7fa2e00c78d0 2024-01-19T04:16:07.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.302+0000 7fa2dcc00640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa2b8066500 0x7fa2b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.302+0000 7fa2dcc00640 1 -- 172.21.15.32:0/2882696372 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa2c80836b0 con 0x7fa2e00c78d0 2024-01-19T04:16:07.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.302+0000 7fa2e4a00640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa2b8066500 0x7fa2b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.302+0000 7fa2e4a00640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa2b8066500 0x7fa2b80689c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00ad000 tx=0x7fa2d00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:07.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.306+0000 7fa2dcc00640 1 -- 172.21.15.32:0/2882696372 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa2c8050690 con 0x7fa2e00c78d0 2024-01-19T04:16:07.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.466+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2e0160d60 con 0x7fa2e00c78d0 2024-01-19T04:16:07.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2dcc00640 1 -- 172.21.15.32:0/2882696372 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20147 (secure 0 0 0) 0x7fa2c8053cb0 con 0x7fa2e00c78d0 2024-01-19T04:16:07.470 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:07.470 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:06.177020+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:07.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa2b8066500 msgr2=0x7fa2b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa2b8066500 0x7fa2b80689c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00ad000 tx=0x7fa2d00a6000 comp rx=0 tx=0).stop 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e00c78d0 msgr2=0x7fa2e0150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e00c78d0 0x7fa2e0150b80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c3c0 tx=0x7fa2c800c880 comp rx=0 tx=0).stop 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 shutdown_connections 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa2b8066500 0x7fa2b80689c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa2e0155060 0x7fa2e01f0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2e00c78d0 0x7fa2e0150b80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 --2- 172.21.15.32:0/2882696372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2e006fa50 0x7fa2e014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 >> 172.21.15.32:0/2882696372 conn(0x7fa2e006ddb0 msgr2=0x7fa2e0153ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 shutdown_connections 2024-01-19T04:16:07.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.470+0000 7fa2e7400640 1 -- 172.21.15.32:0/2882696372 wait complete. 2024-01-19T04:16:07.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-19T04:16:07.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3698a00640 1 Processor -- start 2024-01-19T04:16:07.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3698a00640 1 -- start start 2024-01-19T04:16:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3698a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36901565d0 0x7f36900c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3698a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f369006eeb0 0x7f369006f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3698a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900c6470 con 0x7f36900c82f0 2024-01-19T04:16:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3698a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900c6ff0 con 0x7f369006eeb0 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3698a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900c88a0 con 0x7f36901565d0 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f369006eeb0 0x7f369006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f369006eeb0 0x7f369006f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43818/0 (socket says 172.21.15.32:43818) 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696a00640 1 -- 172.21.15.32:0/2113277754 learned_addr learned my addr 172.21.15.32:0/2113277754 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696000640 1 --2- 172.21.15.32:0/2113277754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36901565d0 0x7f36900c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696a00640 1 -- 172.21.15.32:0/2113277754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36901565d0 msgr2=0x7f36900c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696a00640 1 --2- 172.21.15.32:0/2113277754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36901565d0 0x7f36900c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696a00640 1 -- 172.21.15.32:0/2113277754 >> v1:172.21.15.67:6789/0 conn(0x7f36900c82f0 legacy=0x7f36900c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.638+0000 7f3696a00640 1 -- 172.21.15.32:0/2113277754 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900c66c0 con 0x7f369006eeb0 2024-01-19T04:16:07.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3696a00640 1 --2- 172.21.15.32:0/2113277754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f369006eeb0 0x7f369006f310 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3688009e50 tx=0x7f368801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18edb16cd6b9181 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3694c00640 1 -- 172.21.15.32:0/2113277754 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880a5840 con 0x7f369006eeb0 2024-01-19T04:16:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3694c00640 1 -- 172.21.15.32:0/2113277754 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36880a59a0 con 0x7f369006eeb0 2024-01-19T04:16:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3694c00640 1 -- 172.21.15.32:0/2113277754 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880a5d30 con 0x7f369006eeb0 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 -- 172.21.15.32:0/2113277754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f369006eeb0 msgr2=0x7f369006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 --2- 172.21.15.32:0/2113277754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f369006eeb0 0x7f369006f310 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3688009e50 tx=0x7f368801c980 comp rx=0 tx=0).stop 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 -- 172.21.15.32:0/2113277754 shutdown_connections 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 --2- 172.21.15.32:0/2113277754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f369006eeb0 0x7f369006f310 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 --2- 172.21.15.32:0/2113277754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36901565d0 0x7f36900c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 -- 172.21.15.32:0/2113277754 >> 172.21.15.32:0/2113277754 conn(0x7f36900726d0 msgr2=0x7f36900663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 -- 172.21.15.32:0/2113277754 shutdown_connections 2024-01-19T04:16:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.642+0000 7f3698a00640 1 -- 172.21.15.32:0/2113277754 wait complete. 2024-01-19T04:16:07.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 Processor -- start 2024-01-19T04:16:07.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 -- start start 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f369006eeb0 0x7f3690152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36900c82f0 0x7f36900ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36901565d0 0x7f36900ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690150720 con 0x7f36900c82f0 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369014b150 con 0x7f36901565d0 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900abae0 con 0x7f369006eeb0 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36900c82f0 0x7f36900ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3696000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f369006eeb0 0x7f3690152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36900c82f0 0x7f36900ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43828/0 (socket says 172.21.15.32:43828) 2024-01-19T04:16:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3696a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36901565d0 0x7f36900ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 -- 172.21.15.32:0/4148831477 learned_addr learned my addr 172.21.15.32:0/4148831477 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 -- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f369006eeb0 msgr2=0x7f3690152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f369006eeb0 0x7f3690152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 -- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36901565d0 msgr2=0x7f36900ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36901565d0 0x7f36900ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 -- 172.21.15.32:0/4148831477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009b30 con 0x7f36900c82f0 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3695600640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36900c82f0 0x7f36900ab060 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f367800c450 tx=0x7f367800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f368e000640 1 -- 172.21.15.32:0/4148831477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780052d0 con 0x7f36900c82f0 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f368e000640 1 -- 172.21.15.32:0/4148831477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678005430 con 0x7f36900c82f0 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f368e000640 1 -- 172.21.15.32:0/4148831477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678007260 con 0x7f36900c82f0 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3690150bb0 con 0x7f36900c82f0 2024-01-19T04:16:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.646+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369014fdf0 con 0x7f36900c82f0 2024-01-19T04:16:07.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.650+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36901508d0 con 0x7f36900c82f0 2024-01-19T04:16:07.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.650+0000 7f368e000640 1 -- 172.21.15.32:0/4148831477 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f36780073c0 con 0x7f36900c82f0 2024-01-19T04:16:07.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.650+0000 7f368e000640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3668066500 0x7f36680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:07.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.650+0000 7f368e000640 1 -- 172.21.15.32:0/4148831477 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3678083960 con 0x7f36900c82f0 2024-01-19T04:16:07.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.650+0000 7f3696000640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3668066500 0x7f36680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:07.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.650+0000 7f3696000640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3668066500 0x7f36680689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3690152300 tx=0x7f3680009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:07.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.654+0000 7f368e000640 1 -- 172.21.15.32:0/4148831477 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f36901508d0 con 0x7f36900c82f0 2024-01-19T04:16:07.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:07.846+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f36901508d0 con 0x7f36900c82f0 2024-01-19T04:16:08.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.790+0000 7f368e000640 1 -- 172.21.15.32:0/4148831477 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7f36901508d0 con 0x7f36900c82f0 2024-01-19T04:16:08.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3668066500 msgr2=0x7f36680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:08.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3668066500 0x7f36680689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3690152300 tx=0x7f3680009190 comp rx=0 tx=0).stop 2024-01-19T04:16:08.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36900c82f0 msgr2=0x7f36900ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:08.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36900c82f0 0x7f36900ab060 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f367800c450 tx=0x7f367800c910 comp rx=0 tx=0).stop 2024-01-19T04:16:08.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 shutdown_connections 2024-01-19T04:16:08.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3668066500 0x7f36680689c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36901565d0 0x7f36900ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36900c82f0 0x7f36900ab060 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 --2- 172.21.15.32:0/4148831477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f369006eeb0 0x7f3690152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 >> 172.21.15.32:0/4148831477 conn(0x7f36900726d0 msgr2=0x7f36900a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:08.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 shutdown_connections 2024-01-19T04:16:08.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.794+0000 7f3698a00640 1 -- 172.21.15.32:0/4148831477 wait complete. 2024-01-19T04:16:08.820 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T04:16:08.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-19T04:16:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf3400640 1 Processor -- start 2024-01-19T04:16:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf3400640 1 -- start start 2024-01-19T04:16:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4cec072490 0x7f4cec06c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec0bf360 0x7f4cec0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf3400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0beed0 con 0x7f4cec155520 2024-01-19T04:16:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf3400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec06e0c0 con 0x7f4cec072490 2024-01-19T04:16:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0c3a80 con 0x7f4cec0bf360 2024-01-19T04:16:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cebe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4cec072490 0x7f4cec06c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf0a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4cec155520 0x7f4cec06d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41940/0 (socket says 172.21.15.32:41940) 2024-01-19T04:16:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cf0a00640 1 -- 172.21.15.32:0/2008660716 learned_addr learned my addr 172.21.15.32:0/2008660716 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cebe00640 1 -- 172.21.15.32:0/2008660716 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec0bf360 msgr2=0x7f4cec0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cebe00640 1 --2- 172.21.15.32:0/2008660716 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec0bf360 0x7f4cec0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cebe00640 1 -- 172.21.15.32:0/2008660716 >> v1:172.21.15.32:6789/0 conn(0x7f4cec155520 legacy=0x7f4cec06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.966+0000 7f4cebe00640 1 -- 172.21.15.32:0/2008660716 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0c3d60 con 0x7f4cec072490 2024-01-19T04:16:08.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.970+0000 7f4cebe00640 1 --2- 172.21.15.32:0/2008660716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec072490 0x7f4cec06c220 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40097c0 tx=0x7f4cd401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8920562b326b16 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:08.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.970+0000 7f4ceb400640 1 -- 172.21.15.32:0/2008660716 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40ab600 con 0x7f4cec072490 2024-01-19T04:16:08.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.970+0000 7f4ceb400640 1 -- 172.21.15.32:0/2008660716 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd40a7050 con 0x7f4cec072490 2024-01-19T04:16:08.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.970+0000 7f4ceb400640 1 -- 172.21.15.32:0/2008660716 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40ab980 con 0x7f4cec072490 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.970+0000 7f4cf3400640 1 -- 172.21.15.32:0/2008660716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec072490 msgr2=0x7f4cec06c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.970+0000 7f4cf3400640 1 --2- 172.21.15.32:0/2008660716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec072490 0x7f4cec06c220 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40097c0 tx=0x7f4cd401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- 172.21.15.32:0/2008660716 shutdown_connections 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 --2- 172.21.15.32:0/2008660716 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec0bf360 0x7f4cec0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 --2- 172.21.15.32:0/2008660716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec072490 0x7f4cec06c220 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- 172.21.15.32:0/2008660716 >> 172.21.15.32:0/2008660716 conn(0x7f4cec0c25a0 msgr2=0x7f4cec0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- 172.21.15.32:0/2008660716 shutdown_connections 2024-01-19T04:16:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- 172.21.15.32:0/2008660716 wait complete. 2024-01-19T04:16:08.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 Processor -- start 2024-01-19T04:16:08.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- start start 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec072490 0x7f4cec14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cec0bf360 0x7f4cec14c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec155520 0x7f4cec14de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec156b40 con 0x7f4cec155520 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec157100 con 0x7f4cec0bf360 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec155dc0 con 0x7f4cec072490 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec155520 0x7f4cec14de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec155520 0x7f4cec14de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43290/0 (socket says 172.21.15.32:43290) 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 -- 172.21.15.32:0/439050636 learned_addr learned my addr 172.21.15.32:0/439050636 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:08.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cebe00640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cec0bf360 0x7f4cec14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:08.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf0a00640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec072490 0x7f4cec14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 -- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec072490 msgr2=0x7f4cec14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec072490 0x7f4cec14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 -- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cec0bf360 msgr2=0x7f4cec14c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cec0bf360 0x7f4cec14c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.974+0000 7f4cf1400640 1 -- 172.21.15.32:0/439050636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4009420 con 0x7f4cec155520 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4cf1400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec155520 0x7f4cec14de50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b970 tx=0x7f4ce400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4ce8c00640 1 -- 172.21.15.32:0/439050636 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce400cb40 con 0x7f4cec155520 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4ce8c00640 1 -- 172.21.15.32:0/439050636 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce400ccc0 con 0x7f4cec155520 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec156d90 con 0x7f4cec155520 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4ce8c00640 1 -- 172.21.15.32:0/439050636 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4014680 con 0x7f4cec155520 2024-01-19T04:16:08.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec1586a0 con 0x7f4cec155520 2024-01-19T04:16:08.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec157270 con 0x7f4cec155520 2024-01-19T04:16:08.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4ce8c00640 1 -- 172.21.15.32:0/439050636 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4ce401d3b0 con 0x7f4cec155520 2024-01-19T04:16:08.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4ce8c00640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4cc4066500 0x7f4cc40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:08.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.978+0000 7f4ce8c00640 1 -- 172.21.15.32:0/439050636 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4ce4084170 con 0x7f4cec155520 2024-01-19T04:16:08.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.982+0000 7f4cf0a00640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4cc4066500 0x7f4cc40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:08.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.982+0000 7f4cf0a00640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4cc4066500 0x7f4cc40689c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000f70 tx=0x7f4cdc007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:08.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:08.982+0000 7f4ce8c00640 1 -- 172.21.15.32:0/439050636 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4ce40510c0 con 0x7f4cec155520 2024-01-19T04:16:09.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.178+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4cec0749f0 con 0x7f4cec155520 2024-01-19T04:16:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4ce8c00640 1 -- 172.21.15.32:0/439050636 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4ce40546e0 con 0x7f4cec155520 2024-01-19T04:16:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4cc4066500 msgr2=0x7f4cc40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4cc4066500 0x7f4cc40689c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000f70 tx=0x7f4cdc007e90 comp rx=0 tx=0).stop 2024-01-19T04:16:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec155520 msgr2=0x7f4cec14de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:09.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec155520 0x7f4cec14de50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b970 tx=0x7f4ce400be30 comp rx=0 tx=0).stop 2024-01-19T04:16:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 shutdown_connections 2024-01-19T04:16:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4cc4066500 0x7f4cc40689c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cec155520 0x7f4cec14de50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.794+0000 7f4cf3400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cec0bf360 0x7f4cec14c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.798+0000 7f4cf3400640 1 --2- 172.21.15.32:0/439050636 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4cec072490 0x7f4cec14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.798+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 >> 172.21.15.32:0/439050636 conn(0x7f4cec0c25a0 msgr2=0x7f4cec14aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:09.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.798+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 shutdown_connections 2024-01-19T04:16:09.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.798+0000 7f4cf3400640 1 -- 172.21.15.32:0/439050636 wait complete. 2024-01-19T04:16:09.821 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-19T04:16:09.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01dba00640 1 Processor -- start 2024-01-19T04:16:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01dba00640 1 -- start start 2024-01-19T04:16:09.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01dba00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f01d40c04a0 0x7f01d40c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:09.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01dba00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01d40a4ec0 0x7f01d40c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:09.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01dba00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d4071e80 con 0x7f01d414fb50 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01dba00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d41535c0 con 0x7f01d40a4ec0 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01dba00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d40726c0 con 0x7f01d40c04a0 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01d40a4ec0 0x7f01d40c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01d40a4ec0 0x7f01d40c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43298/0 (socket says 172.21.15.32:43298) 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9a00640 1 -- 172.21.15.32:0/2838880426 learned_addr learned my addr 172.21.15.32:0/2838880426 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f01d414fb50 0x7f01d406fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41946/0 (socket says 172.21.15.32:41946) 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d3e00640 1 --2- 172.21.15.32:0/2838880426 >> v2:172.21.15.67:3300/0 conn(0x7f01d40c04a0 0x7f01d40c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9a00640 1 -- 172.21.15.32:0/2838880426 >> v2:172.21.15.67:3300/0 conn(0x7f01d40c04a0 msgr2=0x7f01d40c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9a00640 1 --2- 172.21.15.32:0/2838880426 >> v2:172.21.15.67:3300/0 conn(0x7f01d40c04a0 0x7f01d40c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9a00640 1 -- 172.21.15.32:0/2838880426 >> v1:172.21.15.32:6789/0 conn(0x7f01d414fb50 legacy=0x7f01d406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d3400640 1 -- 172.21.15.32:0/2838880426 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114843586 0 0) 0x7f01d4071e80 con 0x7f01d414fb50 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d9a00640 1 -- 172.21.15.32:0/2838880426 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40c1cb0 con 0x7f01d40a4ec0 2024-01-19T04:16:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.962+0000 7f01d3e00640 1 --2- 172.21.15.32:0/2838880426 >> v2:172.21.15.67:3300/0 conn(0x7f01d40c04a0 0x7f01d40c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01d9a00640 1 --2- 172.21.15.32:0/2838880426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d40a4ec0 0x7f01d40c1770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01d4066fd0 tx=0x7f01cc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfa01ec99434319 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01d3400640 1 -- 172.21.15.32:0/2838880426 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0a5600 con 0x7f01d40a4ec0 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01d3400640 1 -- 172.21.15.32:0/2838880426 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc0a5760 con 0x7f01d40a4ec0 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01d3400640 1 -- 172.21.15.32:0/2838880426 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0a5af0 con 0x7f01d40a4ec0 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 -- 172.21.15.32:0/2838880426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d40a4ec0 msgr2=0x7f01d40c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 --2- 172.21.15.32:0/2838880426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d40a4ec0 0x7f01d40c1770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f01d4066fd0 tx=0x7f01cc01c940 comp rx=0 tx=0).stop 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 -- 172.21.15.32:0/2838880426 shutdown_connections 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 --2- 172.21.15.32:0/2838880426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d40a4ec0 0x7f01d40c1770 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 --2- 172.21.15.32:0/2838880426 >> v2:172.21.15.67:3300/0 conn(0x7f01d40c04a0 0x7f01d40c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 -- 172.21.15.32:0/2838880426 >> 172.21.15.32:0/2838880426 conn(0x7f01d40c5b20 msgr2=0x7f01d40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 -- 172.21.15.32:0/2838880426 shutdown_connections 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.966+0000 7f01dba00640 1 -- 172.21.15.32:0/2838880426 wait complete. 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 Processor -- start 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 -- start start 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40a4ec0 0x7f01d41ecb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40c04a0 0x7f01d41f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d414fb50 0x7f01d414bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4150760 con 0x7f01d414fb50 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41f0720 con 0x7f01d40a4ec0 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41f0a00 con 0x7f01d40c04a0 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d414fb50 0x7f01d414bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d414fb50 0x7f01d414bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43310/0 (socket says 172.21.15.32:43310) 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 -- 172.21.15.32:0/2968742969 learned_addr learned my addr 172.21.15.32:0/2968742969 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9000640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40a4ec0 0x7f01d41ecb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d3e00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40c04a0 0x7f01d41f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 -- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40c04a0 msgr2=0x7f01d41f00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40c04a0 0x7f01d41f00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 -- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40a4ec0 msgr2=0x7f01d41ecb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40a4ec0 0x7f01d41ecb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 -- 172.21.15.32:0/2968742969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009b30 con 0x7f01d414fb50 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d9a00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d414fb50 0x7f01d414bf70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f01cc019550 tx=0x7f01cc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d0c00640 1 -- 172.21.15.32:0/2968742969 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0a5600 con 0x7f01d414fb50 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d0c00640 1 -- 172.21.15.32:0/2968742969 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc0b8690 con 0x7f01d414fb50 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01d0c00640 1 -- 172.21.15.32:0/2968742969 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0b8a40 con 0x7f01d414fb50 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d41f0ce0 con 0x7f01d414fb50 2024-01-19T04:16:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.970+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d4151390 con 0x7f01d414fb50 2024-01-19T04:16:09.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.974+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d4072b30 con 0x7f01d414fb50 2024-01-19T04:16:09.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.974+0000 7f01d0c00640 1 -- 172.21.15.32:0/2968742969 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f01cc0b8ba0 con 0x7f01d414fb50 2024-01-19T04:16:09.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.974+0000 7f01d0c00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01ac066530 0x7f01ac0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:09.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.974+0000 7f01d0c00640 1 -- 172.21.15.32:0/2968742969 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f01cc11f150 con 0x7f01d414fb50 2024-01-19T04:16:09.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.974+0000 7f01d9000640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01ac066530 0x7f01ac0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:09.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.974+0000 7f01d9000640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01ac066530 0x7f01ac0689f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f01c4007fd0 tx=0x7f01c4007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:09.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:09.978+0000 7f01d0c00640 1 -- 172.21.15.32:0/2968742969 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f01d4072b30 con 0x7f01d414fb50 2024-01-19T04:16:10.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01d4072b30 con 0x7f01d414fb50 2024-01-19T04:16:10.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01d0c00640 1 -- 172.21.15.32:0/2968742969 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6177 (secure 0 0 0) 0x7f01d4072b30 con 0x7f01d414fb50 2024-01-19T04:16:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:10.177 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:49.039759+0000","modified":"2024-01-19T04:15:52.052125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6835/884465323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":884465323},{"type":"v1","addr":"172.21.15.32:6835","nonce":884465323}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 21 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01ac066530 msgr2=0x7f01ac0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01ac066530 0x7f01ac0689f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f01c4007fd0 tx=0x7f01c4007d60 comp rx=0 tx=0).stop 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d414fb50 msgr2=0x7f01d414bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d414fb50 0x7f01d414bf70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f01cc019550 tx=0x7f01cc0196e0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 shutdown_connections 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f01ac066530 0x7f01ac0689f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d414fb50 0x7f01d414bf70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f01d40c04a0 0x7f01d41f00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 --2- 172.21.15.32:0/2968742969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01d40a4ec0 0x7f01d41ecb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 >> 172.21.15.32:0/2968742969 conn(0x7f01d40c5b20 msgr2=0x7f01d414f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:10.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 shutdown_connections 2024-01-19T04:16:10.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.174+0000 7f01dba00640 1 -- 172.21.15.32:0/2968742969 wait complete. 2024-01-19T04:16:10.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:10.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.334+0000 7f17ac800640 1 Processor -- start 2024-01-19T04:16:10.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.334+0000 7f17ac800640 1 -- start start 2024-01-19T04:16:10.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17ac800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17a40c7050 0x7f17a4070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17ac800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17a40c7430 0x7f17a40c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17ac800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a41530d0 con 0x7f17a40acee0 2024-01-19T04:16:10.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17ac800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a40c78a0 con 0x7f17a40c7050 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17ac800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a40c68e0 con 0x7f17a40c7430 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17a9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17a40c7050 0x7f17a4070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17a9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f17a40c7050 0x7f17a4070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43326/0 (socket says 172.21.15.32:43326) 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17a9e00640 1 -- 172.21.15.32:0/1740293448 learned_addr learned my addr 172.21.15.32:0/1740293448 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17aa800640 1 --2- 172.21.15.32:0/1740293448 >> v2:172.21.15.67:3300/0 conn(0x7f17a40c7430 0x7f17a40c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17a9e00640 1 -- 172.21.15.32:0/1740293448 >> v2:172.21.15.67:3300/0 conn(0x7f17a40c7430 msgr2=0x7f17a40c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17a9e00640 1 --2- 172.21.15.32:0/1740293448 >> v2:172.21.15.67:3300/0 conn(0x7f17a40c7430 0x7f17a40c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17a9e00640 1 -- 172.21.15.32:0/1740293448 >> v1:172.21.15.67:6789/0 conn(0x7f17a40acee0 legacy=0x7f17a40c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.338+0000 7f17a9e00640 1 -- 172.21.15.32:0/1740293448 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a41524c0 con 0x7f17a40c7050 2024-01-19T04:16:10.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17a9e00640 1 --2- 172.21.15.32:0/1740293448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a4070230 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f17a40adeb0 tx=0x7f179401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2136f8e0bc0ff4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:10.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17a8a00640 1 -- 172.21.15.32:0/1740293448 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17940ad660 con 0x7f17a40c7050 2024-01-19T04:16:10.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17a8a00640 1 -- 172.21.15.32:0/1740293448 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17940ad7c0 con 0x7f17a40c7050 2024-01-19T04:16:10.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17a8a00640 1 -- 172.21.15.32:0/1740293448 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17940adb50 con 0x7f17a40c7050 2024-01-19T04:16:10.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 -- 172.21.15.32:0/1740293448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 msgr2=0x7f17a4070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 --2- 172.21.15.32:0/1740293448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a4070230 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f17a40adeb0 tx=0x7f179401c470 comp rx=0 tx=0).stop 2024-01-19T04:16:10.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 -- 172.21.15.32:0/1740293448 shutdown_connections 2024-01-19T04:16:10.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 --2- 172.21.15.32:0/1740293448 >> v2:172.21.15.67:3300/0 conn(0x7f17a40c7430 0x7f17a40c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 --2- 172.21.15.32:0/1740293448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a4070230 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 -- 172.21.15.32:0/1740293448 >> 172.21.15.32:0/1740293448 conn(0x7f17a40a99f0 msgr2=0x7f17a40a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:10.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 -- 172.21.15.32:0/1740293448 shutdown_connections 2024-01-19T04:16:10.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 -- 172.21.15.32:0/1740293448 wait complete. 2024-01-19T04:16:10.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 Processor -- start 2024-01-19T04:16:10.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 -- start start 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17a40acee0 0x7f17a406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a41f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.342+0000 7f17ac800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a40c7430 0x7f17a414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17ac800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40a7200 con 0x7f17a40c7050 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17ac800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41f0d30 con 0x7f17a40c7430 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17ac800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41f1010 con 0x7f17a40acee0 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a41f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17a40acee0 0x7f17a406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17a40acee0 0x7f17a406fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:60848/0 (socket says 172.21.15.32:60848) 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9e00640 1 -- 172.21.15.32:0/3968738572 learned_addr learned my addr 172.21.15.32:0/3968738572 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a41f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43328/0 (socket says 172.21.15.32:43328) 2024-01-19T04:16:10.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17aa800640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a40c7430 0x7f17a414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 -- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17a40acee0 msgr2=0x7f17a406fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17a40acee0 0x7f17a406fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 -- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a40c7430 msgr2=0x7f17a414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a40c7430 0x7f17a414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 -- 172.21.15.32:0/3968738572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940094d0 con 0x7f17a40c7050 2024-01-19T04:16:10.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9e00640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17a40acee0 0x7f17a406fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:10.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a9400640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a41f03e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c3c0 tx=0x7f178c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:10.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a2000640 1 -- 172.21.15.32:0/3968738572 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0052d0 con 0x7f17a40c7050 2024-01-19T04:16:10.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a2000640 1 -- 172.21.15.32:0/3968738572 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c005430 con 0x7f17a40c7050 2024-01-19T04:16:10.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a2000640 1 -- 172.21.15.32:0/3968738572 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c007260 con 0x7f17a40c7050 2024-01-19T04:16:10.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a41ee120 con 0x7f17a40c7050 2024-01-19T04:16:10.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a41ee6e0 con 0x7f17a40c7050 2024-01-19T04:16:10.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a41ee900 con 0x7f17a40c7050 2024-01-19T04:16:10.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.346+0000 7f17a2000640 1 -- 172.21.15.32:0/3968738572 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f178c0073c0 con 0x7f17a40c7050 2024-01-19T04:16:10.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.350+0000 7f17a2000640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f177c066500 0x7f177c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.350+0000 7f17a2000640 1 -- 172.21.15.32:0/3968738572 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f178c083590 con 0x7f17a40c7050 2024-01-19T04:16:10.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.350+0000 7f17a9e00640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f177c066500 0x7f177c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.350+0000 7f17a9e00640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f177c066500 0x7f177c0689c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f179401c4b0 tx=0x7f17940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:10.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.354+0000 7f17a2000640 1 -- 172.21.15.32:0/3968738572 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f178c0504e0 con 0x7f17a40c7050 2024-01-19T04:16:10.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.514+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17a40749f0 con 0x7f17a40c7050 2024-01-19T04:16:10.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.514+0000 7f17a2000640 1 -- 172.21.15.32:0/3968738572 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20134 (secure 0 0 0) 0x7f178c053b00 con 0x7f17a40c7050 2024-01-19T04:16:10.517 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:10.517 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:07.630852+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:10.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f177c066500 msgr2=0x7f177c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f177c066500 0x7f177c0689c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f179401c4b0 tx=0x7f17940a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:10.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 msgr2=0x7f17a41f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a41f03e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c3c0 tx=0x7f178c00c880 comp rx=0 tx=0).stop 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 shutdown_connections 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f177c066500 0x7f177c0689c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a40c7430 0x7f17a414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a40c7050 0x7f17a41f03e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 --2- 172.21.15.32:0/3968738572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f17a40acee0 0x7f17a406fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 >> 172.21.15.32:0/3968738572 conn(0x7f17a40a99f0 msgr2=0x7f17a40a8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 shutdown_connections 2024-01-19T04:16:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.518+0000 7f17ac800640 1 -- 172.21.15.32:0/3968738572 wait complete. 2024-01-19T04:16:10.540 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:16:10.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:16:10.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.678+0000 7f3a48a00640 1 Processor -- start 2024-01-19T04:16:10.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.678+0000 7f3a48a00640 1 -- start start 2024-01-19T04:16:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a48a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3a400c5740 0x7f3a400c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a48a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c1120 0x7f3a4015b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a48a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400c0c90 con 0x7f3a400c42b0 2024-01-19T04:16:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a48a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a40150f90 con 0x7f3a400c5740 2024-01-19T04:16:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a48a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40150cb0 con 0x7f3a400c1120 2024-01-19T04:16:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a45600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3a400c5740 0x7f3a400c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a45600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3a400c5740 0x7f3a400c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43344/0 (socket says 172.21.15.32:43344) 2024-01-19T04:16:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a45600640 1 -- 172.21.15.32:0/82252933 learned_addr learned my addr 172.21.15.32:0/82252933 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a46a00640 1 --2- 172.21.15.32:0/82252933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c1120 0x7f3a4015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a45600640 1 -- 172.21.15.32:0/82252933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c1120 msgr2=0x7f3a4015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a45600640 1 --2- 172.21.15.32:0/82252933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c1120 0x7f3a4015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a45600640 1 -- 172.21.15.32:0/82252933 >> v1:172.21.15.67:6789/0 conn(0x7f3a400c42b0 legacy=0x7f3a4006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.682+0000 7f3a45600640 1 -- 172.21.15.32:0/82252933 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400c0640 con 0x7f3a400c5740 2024-01-19T04:16:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a45600640 1 --2- 172.21.15.32:0/82252933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c5740 0x7f3a400c4690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009870 tx=0x7f3a2801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8efd842d101e952 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a44c00640 1 -- 172.21.15.32:0/82252933 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a280ac640 con 0x7f3a400c5740 2024-01-19T04:16:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a44c00640 1 -- 172.21.15.32:0/82252933 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a280ac7a0 con 0x7f3a400c5740 2024-01-19T04:16:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a44c00640 1 -- 172.21.15.32:0/82252933 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a280acb30 con 0x7f3a400c5740 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 -- 172.21.15.32:0/82252933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c5740 msgr2=0x7f3a400c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 --2- 172.21.15.32:0/82252933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c5740 0x7f3a400c4690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009870 tx=0x7f3a2801cee0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 -- 172.21.15.32:0/82252933 shutdown_connections 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 --2- 172.21.15.32:0/82252933 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c1120 0x7f3a4015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 --2- 172.21.15.32:0/82252933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c5740 0x7f3a400c4690 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 -- 172.21.15.32:0/82252933 >> 172.21.15.32:0/82252933 conn(0x7f3a400c5b20 msgr2=0x7f3a400c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 -- 172.21.15.32:0/82252933 shutdown_connections 2024-01-19T04:16:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 -- 172.21.15.32:0/82252933 wait complete. 2024-01-19T04:16:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 Processor -- start 2024-01-19T04:16:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.686+0000 7f3a48a00640 1 -- start start 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c1120 0x7f3a400a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a400c42b0 0x7f3a400aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c5740 0x7f3a400aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a401eb8b0 con 0x7f3a400c1120 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a401ebe10 con 0x7f3a400c42b0 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400a9630 con 0x7f3a400c5740 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c1120 0x7f3a400a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c1120 0x7f3a400a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43354/0 (socket says 172.21.15.32:43354) 2024-01-19T04:16:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 -- 172.21.15.32:0/301729153 learned_addr learned my addr 172.21.15.32:0/301729153 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46a00640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c5740 0x7f3a400aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a45600640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a400c42b0 0x7f3a400aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 -- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c5740 msgr2=0x7f3a400aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c5740 0x7f3a400aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 -- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a400c42b0 msgr2=0x7f3a400aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a400c42b0 0x7f3a400aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 -- 172.21.15.32:0/301729153 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280094d0 con 0x7f3a400c1120 2024-01-19T04:16:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a46000640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c1120 0x7f3a400a8ba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000c420 tx=0x7f3a3000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a3e000640 1 -- 172.21.15.32:0/301729153 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300052d0 con 0x7f3a400c1120 2024-01-19T04:16:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a3e000640 1 -- 172.21.15.32:0/301729153 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a30005430 con 0x7f3a400c1120 2024-01-19T04:16:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a3e000640 1 -- 172.21.15.32:0/301729153 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30007260 con 0x7f3a400c1120 2024-01-19T04:16:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4014d4f0 con 0x7f3a400c1120 2024-01-19T04:16:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a400a7190 con 0x7f3a400c1120 2024-01-19T04:16:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.690+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4014d730 con 0x7f3a400c1120 2024-01-19T04:16:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.694+0000 7f3a3e000640 1 -- 172.21.15.32:0/301729153 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3a300073c0 con 0x7f3a400c1120 2024-01-19T04:16:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.694+0000 7f3a3e000640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a18066530 0x7f3a180689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.694+0000 7f3a3e000640 1 -- 172.21.15.32:0/301729153 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3a300835d0 con 0x7f3a400c1120 2024-01-19T04:16:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.694+0000 7f3a45600640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a18066530 0x7f3a180689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:10.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.694+0000 7f3a45600640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a18066530 0x7f3a180689f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a280ae000 tx=0x7f3a28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.698+0000 7f3a3e000640 1 -- 172.21.15.32:0/301729153 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3a4014d730 con 0x7f3a400c1120 2024-01-19T04:16:10.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.854+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a400c4f30 con 0x7f3a18066530 2024-01-19T04:16:10.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.870+0000 7f3a3e000640 1 -- 172.21.15.32:0/301729153 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+521534 (secure 0 0 0) 0x7f3a280ac910 con 0x7f3a18066530 2024-01-19T04:16:10.875 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:10.879 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:16:10.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a18066530 msgr2=0x7f3a180689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a18066530 0x7f3a180689f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a280ae000 tx=0x7f3a28008040 comp rx=0 tx=0).stop 2024-01-19T04:16:10.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c1120 msgr2=0x7f3a400a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c1120 0x7f3a400a8ba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000c420 tx=0x7f3a3000c8e0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 shutdown_connections 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a18066530 0x7f3a180689f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a400c5740 0x7f3a400aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a400c42b0 0x7f3a400aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 --2- 172.21.15.32:0/301729153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a400c1120 0x7f3a400a8ba0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 >> 172.21.15.32:0/301729153 conn(0x7f3a400c5b20 msgr2=0x7f3a4014a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 shutdown_connections 2024-01-19T04:16:10.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:10.874+0000 7f3a48a00640 1 -- 172.21.15.32:0/301729153 wait complete. 2024-01-19T04:16:10.895 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-19T04:16:10.044297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596523,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":237,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237292,"kb_used_data":4472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737428,"statfs":{"total":773094113280,"available":772851126272,"internally_reserved":0,"allocated":4579328,"data_stored":2497919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.275128"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086760+0000","last_change":"2024-01-19T04:16:06.662967+0000","last_active":"2024-01-19T04:16:08.086760+0000","last_peered":"2024-01-19T04:16:08.086760+0000","last_clean":"2024-01-19T04:16:08.086760+0000","last_became_active":"2024-01-19T04:16:06.662697+0000","last_became_peered":"2024-01-19T04:16:06.662697+0000","last_unstale":"2024-01-19T04:16:08.086760+0000","last_undegraded":"2024-01-19T04:16:08.086760+0000","last_fullsized":"2024-01-19T04:16:08.086760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278168+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:51.278168+0000","last_peered":"2024-01-19T04:15:51.278168+0000","last_clean":"2024-01-19T04:15:51.278168+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:51.278168+0000","last_undegraded":"2024-01-19T04:15:51.278168+0000","last_fullsized":"2024-01-19T04:15:51.278168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393434+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:51.393434+0000","last_peered":"2024-01-19T04:15:51.393434+0000","last_clean":"2024-01-19T04:15:51.393434+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:51.393434+0000","last_undegraded":"2024-01-19T04:15:51.393434+0000","last_fullsized":"2024-01-19T04:15:51.393434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277965+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:51.277965+0000","last_peered":"2024-01-19T04:15:51.277965+0000","last_clean":"2024-01-19T04:15:51.277965+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:51.277965+0000","last_undegraded":"2024-01-19T04:15:51.277965+0000","last_fullsized":"2024-01-19T04:15:51.277965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.774083+0000","last_change":"2024-01-19T04:16:04.774083+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.774083+0000","last_undegraded":"2024-01-19T04:16:04.774083+0000","last_fullsized":"2024-01-19T04:16:04.774083+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659382+0000","last_change":"2024-01-19T04:16:06.654967+0000","last_active":"2024-01-19T04:16:06.659382+0000","last_peered":"2024-01-19T04:16:06.659382+0000","last_clean":"2024-01-19T04:16:06.659382+0000","last_became_active":"2024-01-19T04:16:06.653661+0000","last_became_peered":"2024-01-19T04:16:06.653661+0000","last_unstale":"2024-01-19T04:16:06.659382+0000","last_undegraded":"2024-01-19T04:16:06.659382+0000","last_fullsized":"2024-01-19T04:16:06.659382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:00:48.794156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788581+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:16:05.788581+0000","last_peered":"2024-01-19T04:16:05.788581+0000","last_clean":"2024-01-19T04:16:05.788581+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:16:05.788581+0000","last_undegraded":"2024-01-19T04:16:05.788581+0000","last_fullsized":"2024-01-19T04:16:05.788581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015937+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:52.015937+0000","last_peered":"2024-01-19T04:15:52.015937+0000","last_clean":"2024-01-19T04:15:52.015937+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:52.015937+0000","last_undegraded":"2024-01-19T04:15:52.015937+0000","last_fullsized":"2024-01-19T04:15:52.015937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779011+0000","last_change":"2024-01-19T04:16:04.779011+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779011+0000","last_undegraded":"2024-01-19T04:16:04.779011+0000","last_fullsized":"2024-01-19T04:16:04.779011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658445+0000","last_change":"2024-01-19T04:16:06.649757+0000","last_active":"2024-01-19T04:16:06.658445+0000","last_peered":"2024-01-19T04:16:06.658445+0000","last_clean":"2024-01-19T04:16:06.658445+0000","last_became_active":"2024-01-19T04:16:06.649522+0000","last_became_peered":"2024-01-19T04:16:06.649522+0000","last_unstale":"2024-01-19T04:16:06.658445+0000","last_undegraded":"2024-01-19T04:16:06.658445+0000","last_fullsized":"2024-01-19T04:16:06.658445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:52.103572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016060+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:52.016060+0000","last_peered":"2024-01-19T04:15:52.016060+0000","last_clean":"2024-01-19T04:15:52.016060+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:52.016060+0000","last_undegraded":"2024-01-19T04:15:52.016060+0000","last_fullsized":"2024-01-19T04:15:52.016060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788338+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:16:05.788338+0000","last_peered":"2024-01-19T04:16:05.788338+0000","last_clean":"2024-01-19T04:16:05.788338+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:16:05.788338+0000","last_undegraded":"2024-01-19T04:16:05.788338+0000","last_fullsized":"2024-01-19T04:16:05.788338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778670+0000","last_change":"2024-01-19T04:16:04.778670+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778670+0000","last_undegraded":"2024-01-19T04:16:04.778670+0000","last_fullsized":"2024-01-19T04:16:04.778670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637633+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:16:06.637633+0000","last_peered":"2024-01-19T04:16:06.637633+0000","last_clean":"2024-01-19T04:16:06.637633+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:16:06.637633+0000","last_undegraded":"2024-01-19T04:16:06.637633+0000","last_fullsized":"2024-01-19T04:16:06.637633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650232+0000","last_change":"2024-01-19T04:15:49.653943+0000","last_active":"2024-01-19T04:16:06.650232+0000","last_peered":"2024-01-19T04:16:06.650232+0000","last_clean":"2024-01-19T04:16:06.650232+0000","last_became_active":"2024-01-19T04:15:49.653669+0000","last_became_peered":"2024-01-19T04:15:49.653669+0000","last_unstale":"2024-01-19T04:16:06.650232+0000","last_undegraded":"2024-01-19T04:16:06.650232+0000","last_fullsized":"2024-01-19T04:16:06.650232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084761+0000","last_change":"2024-01-19T04:16:05.798495+0000","last_active":"2024-01-19T04:16:08.084761+0000","last_peered":"2024-01-19T04:16:08.084761+0000","last_clean":"2024-01-19T04:16:08.084761+0000","last_became_active":"2024-01-19T04:16:05.797905+0000","last_became_peered":"2024-01-19T04:16:05.797905+0000","last_unstale":"2024-01-19T04:16:08.084761+0000","last_undegraded":"2024-01-19T04:16:08.084761+0000","last_fullsized":"2024-01-19T04:16:08.084761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650407+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:16:06.650407+0000","last_peered":"2024-01-19T04:16:06.650407+0000","last_clean":"2024-01-19T04:16:06.650407+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:16:06.650407+0000","last_undegraded":"2024-01-19T04:16:06.650407+0000","last_fullsized":"2024-01-19T04:16:06.650407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393555+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:51.393555+0000","last_peered":"2024-01-19T04:15:51.393555+0000","last_clean":"2024-01-19T04:15:51.393555+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:51.393555+0000","last_undegraded":"2024-01-19T04:15:51.393555+0000","last_fullsized":"2024-01-19T04:15:51.393555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084600+0000","last_change":"2024-01-19T04:16:05.790864+0000","last_active":"2024-01-19T04:16:08.084600+0000","last_peered":"2024-01-19T04:16:08.084600+0000","last_clean":"2024-01-19T04:16:08.084600+0000","last_became_active":"2024-01-19T04:16:05.790554+0000","last_became_peered":"2024-01-19T04:16:05.790554+0000","last_unstale":"2024-01-19T04:16:08.084600+0000","last_undegraded":"2024-01-19T04:16:08.084600+0000","last_fullsized":"2024-01-19T04:16:08.084600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639010+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:16:06.639010+0000","last_peered":"2024-01-19T04:16:06.639010+0000","last_clean":"2024-01-19T04:16:06.639010+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:16:06.639010+0000","last_undegraded":"2024-01-19T04:16:06.639010+0000","last_fullsized":"2024-01-19T04:16:06.639010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650609+0000","last_change":"2024-01-19T04:15:49.667426+0000","last_active":"2024-01-19T04:16:06.650609+0000","last_peered":"2024-01-19T04:16:06.650609+0000","last_clean":"2024-01-19T04:16:06.650609+0000","last_became_active":"2024-01-19T04:15:49.667142+0000","last_became_peered":"2024-01-19T04:15:49.667142+0000","last_unstale":"2024-01-19T04:16:06.650609+0000","last_undegraded":"2024-01-19T04:16:06.650609+0000","last_fullsized":"2024-01-19T04:16:06.650609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640695+0000","last_change":"2024-01-19T04:16:05.797053+0000","last_active":"2024-01-19T04:16:06.640695+0000","last_peered":"2024-01-19T04:16:06.640695+0000","last_clean":"2024-01-19T04:16:06.640695+0000","last_became_active":"2024-01-19T04:16:05.796727+0000","last_became_peered":"2024-01-19T04:16:05.796727+0000","last_unstale":"2024-01-19T04:16:06.640695+0000","last_undegraded":"2024-01-19T04:16:06.640695+0000","last_fullsized":"2024-01-19T04:16:06.640695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:28:03.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651211+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:16:06.651211+0000","last_peered":"2024-01-19T04:16:06.651211+0000","last_clean":"2024-01-19T04:16:06.651211+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:16:06.651211+0000","last_undegraded":"2024-01-19T04:16:06.651211+0000","last_fullsized":"2024-01-19T04:16:06.651211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.643098+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:50.643098+0000","last_peered":"2024-01-19T04:15:50.643098+0000","last_clean":"2024-01-19T04:15:50.643098+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:50.643098+0000","last_undegraded":"2024-01-19T04:15:50.643098+0000","last_fullsized":"2024-01-19T04:15:50.643098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084410+0000","last_change":"2024-01-19T04:16:05.794126+0000","last_active":"2024-01-19T04:16:08.084410+0000","last_peered":"2024-01-19T04:16:08.084410+0000","last_clean":"2024-01-19T04:16:08.084410+0000","last_became_active":"2024-01-19T04:16:05.793821+0000","last_became_peered":"2024-01-19T04:16:05.793821+0000","last_unstale":"2024-01-19T04:16:08.084410+0000","last_undegraded":"2024-01-19T04:16:08.084410+0000","last_fullsized":"2024-01-19T04:16:08.084410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085125+0000","last_change":"2024-01-19T04:16:06.654711+0000","last_active":"2024-01-19T04:16:08.085125+0000","last_peered":"2024-01-19T04:16:08.085125+0000","last_clean":"2024-01-19T04:16:08.085125+0000","last_became_active":"2024-01-19T04:16:06.654442+0000","last_became_peered":"2024-01-19T04:16:06.654442+0000","last_unstale":"2024-01-19T04:16:08.085125+0000","last_undegraded":"2024-01-19T04:16:08.085125+0000","last_fullsized":"2024-01-19T04:16:08.085125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:13.662662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638284+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:16:06.638284+0000","last_peered":"2024-01-19T04:16:06.638284+0000","last_clean":"2024-01-19T04:16:06.638284+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:16:06.638284+0000","last_undegraded":"2024-01-19T04:16:06.638284+0000","last_fullsized":"2024-01-19T04:16:06.638284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634955+0000","last_change":"2024-01-19T04:15:49.680184+0000","last_active":"2024-01-19T04:16:06.634955+0000","last_peered":"2024-01-19T04:16:06.634955+0000","last_clean":"2024-01-19T04:16:06.634955+0000","last_became_active":"2024-01-19T04:15:49.679925+0000","last_became_peered":"2024-01-19T04:15:49.679925+0000","last_unstale":"2024-01-19T04:16:06.634955+0000","last_undegraded":"2024-01-19T04:16:06.634955+0000","last_fullsized":"2024-01-19T04:16:06.634955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778700+0000","last_change":"2024-01-19T04:16:04.778700+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778700+0000","last_undegraded":"2024-01-19T04:16:04.778700+0000","last_fullsized":"2024-01-19T04:16:04.778700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084379+0000","last_change":"2024-01-19T04:16:06.651279+0000","last_active":"2024-01-19T04:16:08.084379+0000","last_peered":"2024-01-19T04:16:08.084379+0000","last_clean":"2024-01-19T04:16:08.084379+0000","last_became_active":"2024-01-19T04:16:06.651097+0000","last_became_peered":"2024-01-19T04:16:06.651097+0000","last_unstale":"2024-01-19T04:16:08.084379+0000","last_undegraded":"2024-01-19T04:16:08.084379+0000","last_fullsized":"2024-01-19T04:16:08.084379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:25:40.860239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642266+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:50.642266+0000","last_peered":"2024-01-19T04:15:50.642266+0000","last_clean":"2024-01-19T04:15:50.642266+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:50.642266+0000","last_undegraded":"2024-01-19T04:15:50.642266+0000","last_fullsized":"2024-01-19T04:15:50.642266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277849+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:51.277849+0000","last_peered":"2024-01-19T04:15:51.277849+0000","last_clean":"2024-01-19T04:15:51.277849+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:51.277849+0000","last_undegraded":"2024-01-19T04:15:51.277849+0000","last_fullsized":"2024-01-19T04:15:51.277849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773895+0000","last_change":"2024-01-19T04:16:04.773895+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773895+0000","last_undegraded":"2024-01-19T04:16:04.773895+0000","last_fullsized":"2024-01-19T04:16:04.773895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659412+0000","last_change":"2024-01-19T04:16:06.655628+0000","last_active":"2024-01-19T04:16:06.659412+0000","last_peered":"2024-01-19T04:16:06.659412+0000","last_clean":"2024-01-19T04:16:06.659412+0000","last_became_active":"2024-01-19T04:16:06.653875+0000","last_became_peered":"2024-01-19T04:16:06.653875+0000","last_unstale":"2024-01-19T04:16:06.659412+0000","last_undegraded":"2024-01-19T04:16:06.659412+0000","last_fullsized":"2024-01-19T04:16:06.659412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:14.839980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016010+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:52.016010+0000","last_peered":"2024-01-19T04:15:52.016010+0000","last_clean":"2024-01-19T04:15:52.016010+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:52.016010+0000","last_undegraded":"2024-01-19T04:15:52.016010+0000","last_fullsized":"2024-01-19T04:15:52.016010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634212+0000","last_change":"2024-01-19T04:15:49.660917+0000","last_active":"2024-01-19T04:16:06.634212+0000","last_peered":"2024-01-19T04:16:06.634212+0000","last_clean":"2024-01-19T04:16:06.634212+0000","last_became_active":"2024-01-19T04:15:49.655137+0000","last_became_peered":"2024-01-19T04:15:49.655137+0000","last_unstale":"2024-01-19T04:16:06.634212+0000","last_undegraded":"2024-01-19T04:16:06.634212+0000","last_fullsized":"2024-01-19T04:16:06.634212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:05:00.093326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788476+0000","last_change":"2024-01-19T04:16:05.795319+0000","last_active":"2024-01-19T04:16:06.788476+0000","last_peered":"2024-01-19T04:16:06.788476+0000","last_clean":"2024-01-19T04:16:06.788476+0000","last_became_active":"2024-01-19T04:16:05.794958+0000","last_became_peered":"2024-01-19T04:16:05.794958+0000","last_unstale":"2024-01-19T04:16:06.788476+0000","last_undegraded":"2024-01-19T04:16:06.788476+0000","last_fullsized":"2024-01-19T04:16:06.788476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:55:40.046252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084469+0000","last_change":"2024-01-19T04:16:06.659222+0000","last_active":"2024-01-19T04:16:08.084469+0000","last_peered":"2024-01-19T04:16:08.084469+0000","last_clean":"2024-01-19T04:16:08.084469+0000","last_became_active":"2024-01-19T04:16:06.657419+0000","last_became_peered":"2024-01-19T04:16:06.657419+0000","last_unstale":"2024-01-19T04:16:08.084469+0000","last_undegraded":"2024-01-19T04:16:08.084469+0000","last_fullsized":"2024-01-19T04:16:08.084469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:38.868186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393598+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:51.393598+0000","last_peered":"2024-01-19T04:15:51.393598+0000","last_clean":"2024-01-19T04:15:51.393598+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:51.393598+0000","last_undegraded":"2024-01-19T04:15:51.393598+0000","last_fullsized":"2024-01-19T04:15:51.393598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633993+0000","last_change":"2024-01-19T04:15:49.657920+0000","last_active":"2024-01-19T04:16:06.633993+0000","last_peered":"2024-01-19T04:16:06.633993+0000","last_clean":"2024-01-19T04:16:06.633993+0000","last_became_active":"2024-01-19T04:15:49.657332+0000","last_became_peered":"2024-01-19T04:15:49.657332+0000","last_unstale":"2024-01-19T04:16:06.633993+0000","last_undegraded":"2024-01-19T04:16:06.633993+0000","last_fullsized":"2024-01-19T04:16:06.633993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:10.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778562+0000","last_change":"2024-01-19T04:16:04.778562+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778562+0000","last_undegraded":"2024-01-19T04:16:04.778562+0000","last_fullsized":"2024-01-19T04:16:04.778562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635132+0000","last_change":"2024-01-19T04:16:06.653073+0000","last_active":"2024-01-19T04:16:07.635132+0000","last_peered":"2024-01-19T04:16:07.635132+0000","last_clean":"2024-01-19T04:16:07.635132+0000","last_became_active":"2024-01-19T04:16:06.652783+0000","last_became_peered":"2024-01-19T04:16:06.652783+0000","last_unstale":"2024-01-19T04:16:07.635132+0000","last_undegraded":"2024-01-19T04:16:07.635132+0000","last_fullsized":"2024-01-19T04:16:07.635132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:43.230089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650249+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:16:06.650249+0000","last_peered":"2024-01-19T04:16:06.650249+0000","last_clean":"2024-01-19T04:16:06.650249+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:16:06.650249+0000","last_undegraded":"2024-01-19T04:16:06.650249+0000","last_fullsized":"2024-01-19T04:16:06.650249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633575+0000","last_change":"2024-01-19T04:15:49.669616+0000","last_active":"2024-01-19T04:16:06.633575+0000","last_peered":"2024-01-19T04:16:06.633575+0000","last_clean":"2024-01-19T04:16:06.633575+0000","last_became_active":"2024-01-19T04:15:49.667904+0000","last_became_peered":"2024-01-19T04:15:49.667904+0000","last_unstale":"2024-01-19T04:16:06.633575+0000","last_undegraded":"2024-01-19T04:16:06.633575+0000","last_fullsized":"2024-01-19T04:16:06.633575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:52.911948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084542+0000","last_change":"2024-01-19T04:16:05.797377+0000","last_active":"2024-01-19T04:16:08.084542+0000","last_peered":"2024-01-19T04:16:08.084542+0000","last_clean":"2024-01-19T04:16:08.084542+0000","last_became_active":"2024-01-19T04:16:05.797125+0000","last_became_peered":"2024-01-19T04:16:05.797125+0000","last_unstale":"2024-01-19T04:16:08.084542+0000","last_undegraded":"2024-01-19T04:16:08.084542+0000","last_fullsized":"2024-01-19T04:16:08.084542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086033+0000","last_change":"2024-01-19T04:16:06.651033+0000","last_active":"2024-01-19T04:16:08.086033+0000","last_peered":"2024-01-19T04:16:08.086033+0000","last_clean":"2024-01-19T04:16:08.086033+0000","last_became_active":"2024-01-19T04:16:06.650744+0000","last_became_peered":"2024-01-19T04:16:06.650744+0000","last_unstale":"2024-01-19T04:16:08.086033+0000","last_undegraded":"2024-01-19T04:16:08.086033+0000","last_fullsized":"2024-01-19T04:16:08.086033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:35:34.310303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016361+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:52.016361+0000","last_peered":"2024-01-19T04:15:52.016361+0000","last_clean":"2024-01-19T04:15:52.016361+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:52.016361+0000","last_undegraded":"2024-01-19T04:15:52.016361+0000","last_fullsized":"2024-01-19T04:15:52.016361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634096+0000","last_change":"2024-01-19T04:15:49.658348+0000","last_active":"2024-01-19T04:16:06.634096+0000","last_peered":"2024-01-19T04:16:06.634096+0000","last_clean":"2024-01-19T04:16:06.634096+0000","last_became_active":"2024-01-19T04:15:49.656971+0000","last_became_peered":"2024-01-19T04:15:49.656971+0000","last_unstale":"2024-01-19T04:16:06.634096+0000","last_undegraded":"2024-01-19T04:16:06.634096+0000","last_fullsized":"2024-01-19T04:16:06.634096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.780866+0000","last_change":"2024-01-19T04:16:04.780866+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.780866+0000","last_undegraded":"2024-01-19T04:16:04.780866+0000","last_fullsized":"2024-01-19T04:16:04.780866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635915+0000","last_change":"2024-01-19T04:16:06.648241+0000","last_active":"2024-01-19T04:16:07.635915+0000","last_peered":"2024-01-19T04:16:07.635915+0000","last_clean":"2024-01-19T04:16:07.635915+0000","last_became_active":"2024-01-19T04:16:06.647911+0000","last_became_peered":"2024-01-19T04:16:06.647911+0000","last_unstale":"2024-01-19T04:16:07.635915+0000","last_undegraded":"2024-01-19T04:16:07.635915+0000","last_fullsized":"2024-01-19T04:16:07.635915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:32.886100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016424+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:52.016424+0000","last_peered":"2024-01-19T04:15:52.016424+0000","last_clean":"2024-01-19T04:15:52.016424+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:52.016424+0000","last_undegraded":"2024-01-19T04:15:52.016424+0000","last_fullsized":"2024-01-19T04:15:52.016424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638798+0000","last_change":"2024-01-19T04:15:49.667350+0000","last_active":"2024-01-19T04:16:06.638798+0000","last_peered":"2024-01-19T04:16:06.638798+0000","last_clean":"2024-01-19T04:16:06.638798+0000","last_became_active":"2024-01-19T04:15:49.666589+0000","last_became_peered":"2024-01-19T04:15:49.666589+0000","last_unstale":"2024-01-19T04:16:06.638798+0000","last_undegraded":"2024-01-19T04:16:06.638798+0000","last_fullsized":"2024-01-19T04:16:06.638798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.636015+0000","last_change":"2024-01-19T04:16:05.790679+0000","last_active":"2024-01-19T04:16:07.636015+0000","last_peered":"2024-01-19T04:16:07.636015+0000","last_clean":"2024-01-19T04:16:07.636015+0000","last_became_active":"2024-01-19T04:16:05.790399+0000","last_became_peered":"2024-01-19T04:16:05.790399+0000","last_unstale":"2024-01-19T04:16:07.636015+0000","last_undegraded":"2024-01-19T04:16:07.636015+0000","last_fullsized":"2024-01-19T04:16:07.636015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:02.428657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016450+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:52.016450+0000","last_peered":"2024-01-19T04:15:52.016450+0000","last_clean":"2024-01-19T04:15:52.016450+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:52.016450+0000","last_undegraded":"2024-01-19T04:15:52.016450+0000","last_fullsized":"2024-01-19T04:15:52.016450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.643003+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:50.643003+0000","last_peered":"2024-01-19T04:15:50.643003+0000","last_clean":"2024-01-19T04:15:50.643003+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:50.643003+0000","last_undegraded":"2024-01-19T04:15:50.643003+0000","last_fullsized":"2024-01-19T04:15:50.643003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638696+0000","last_change":"2024-01-19T04:16:05.794503+0000","last_active":"2024-01-19T04:16:06.638696+0000","last_peered":"2024-01-19T04:16:06.638696+0000","last_clean":"2024-01-19T04:16:06.638696+0000","last_became_active":"2024-01-19T04:16:05.794177+0000","last_became_peered":"2024-01-19T04:16:05.794177+0000","last_unstale":"2024-01-19T04:16:06.638696+0000","last_undegraded":"2024-01-19T04:16:06.638696+0000","last_fullsized":"2024-01-19T04:16:06.638696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:09.555530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638194+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:16:06.638194+0000","last_peered":"2024-01-19T04:16:06.638194+0000","last_clean":"2024-01-19T04:16:06.638194+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:16:06.638194+0000","last_undegraded":"2024-01-19T04:16:06.638194+0000","last_fullsized":"2024-01-19T04:16:06.638194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016492+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:52.016492+0000","last_peered":"2024-01-19T04:15:52.016492+0000","last_clean":"2024-01-19T04:15:52.016492+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:52.016492+0000","last_undegraded":"2024-01-19T04:15:52.016492+0000","last_fullsized":"2024-01-19T04:15:52.016492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773997+0000","last_change":"2024-01-19T04:16:04.773997+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773997+0000","last_undegraded":"2024-01-19T04:16:04.773997+0000","last_fullsized":"2024-01-19T04:16:04.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086001+0000","last_change":"2024-01-19T04:16:06.663428+0000","last_active":"2024-01-19T04:16:08.086001+0000","last_peered":"2024-01-19T04:16:08.086001+0000","last_clean":"2024-01-19T04:16:08.086001+0000","last_became_active":"2024-01-19T04:16:06.662844+0000","last_became_peered":"2024-01-19T04:16:06.662844+0000","last_unstale":"2024-01-19T04:16:08.086001+0000","last_undegraded":"2024-01-19T04:16:08.086001+0000","last_fullsized":"2024-01-19T04:16:08.086001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:20.839193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788478+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:16:05.788478+0000","last_peered":"2024-01-19T04:16:05.788478+0000","last_clean":"2024-01-19T04:16:05.788478+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:16:05.788478+0000","last_undegraded":"2024-01-19T04:16:05.788478+0000","last_fullsized":"2024-01-19T04:16:05.788478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393658+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:51.393658+0000","last_peered":"2024-01-19T04:15:51.393658+0000","last_clean":"2024-01-19T04:15:51.393658+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:51.393658+0000","last_undegraded":"2024-01-19T04:15:51.393658+0000","last_fullsized":"2024-01-19T04:15:51.393658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778609+0000","last_change":"2024-01-19T04:16:04.778609+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778609+0000","last_undegraded":"2024-01-19T04:16:04.778609+0000","last_fullsized":"2024-01-19T04:16:04.778609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788470+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:16:05.788470+0000","last_peered":"2024-01-19T04:16:05.788470+0000","last_clean":"2024-01-19T04:16:05.788470+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:16:05.788470+0000","last_undegraded":"2024-01-19T04:16:05.788470+0000","last_fullsized":"2024-01-19T04:16:05.788470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277930+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:51.277930+0000","last_peered":"2024-01-19T04:15:51.277930+0000","last_clean":"2024-01-19T04:15:51.277930+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:51.277930+0000","last_undegraded":"2024-01-19T04:15:51.277930+0000","last_fullsized":"2024-01-19T04:15:51.277930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786740+0000","last_change":"2024-01-19T04:16:05.799883+0000","last_active":"2024-01-19T04:16:06.786740+0000","last_peered":"2024-01-19T04:16:06.786740+0000","last_clean":"2024-01-19T04:16:06.786740+0000","last_became_active":"2024-01-19T04:16:05.799581+0000","last_became_peered":"2024-01-19T04:16:05.799581+0000","last_unstale":"2024-01-19T04:16:06.786740+0000","last_undegraded":"2024-01-19T04:16:06.786740+0000","last_fullsized":"2024-01-19T04:16:06.786740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:55.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637532+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:16:06.637532+0000","last_peered":"2024-01-19T04:16:06.637532+0000","last_clean":"2024-01-19T04:16:06.637532+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:16:06.637532+0000","last_undegraded":"2024-01-19T04:16:06.637532+0000","last_fullsized":"2024-01-19T04:16:06.637532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790869+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:16:05.790869+0000","last_peered":"2024-01-19T04:16:05.790869+0000","last_clean":"2024-01-19T04:16:05.790869+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:16:05.790869+0000","last_undegraded":"2024-01-19T04:16:05.790869+0000","last_fullsized":"2024-01-19T04:16:05.790869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084369+0000","last_change":"2024-01-19T04:16:05.794058+0000","last_active":"2024-01-19T04:16:08.084369+0000","last_peered":"2024-01-19T04:16:08.084369+0000","last_clean":"2024-01-19T04:16:08.084369+0000","last_became_active":"2024-01-19T04:16:05.793542+0000","last_became_peered":"2024-01-19T04:16:05.793542+0000","last_unstale":"2024-01-19T04:16:08.084369+0000","last_undegraded":"2024-01-19T04:16:08.084369+0000","last_fullsized":"2024-01-19T04:16:08.084369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:08.794314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650910+0000","last_change":"2024-01-19T04:16:06.648682+0000","last_active":"2024-01-19T04:16:06.650910+0000","last_peered":"2024-01-19T04:16:06.650910+0000","last_clean":"2024-01-19T04:16:06.650910+0000","last_became_active":"2024-01-19T04:16:06.646754+0000","last_became_peered":"2024-01-19T04:16:06.646754+0000","last_unstale":"2024-01-19T04:16:06.650910+0000","last_undegraded":"2024-01-19T04:16:06.650910+0000","last_fullsized":"2024-01-19T04:16:06.650910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:35:59.042987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016417+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:52.016417+0000","last_peered":"2024-01-19T04:15:52.016417+0000","last_clean":"2024-01-19T04:15:52.016417+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:52.016417+0000","last_undegraded":"2024-01-19T04:15:52.016417+0000","last_fullsized":"2024-01-19T04:15:52.016417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637399+0000","last_change":"2024-01-19T04:15:49.665258+0000","last_active":"2024-01-19T04:16:06.637399+0000","last_peered":"2024-01-19T04:16:06.637399+0000","last_clean":"2024-01-19T04:16:06.637399+0000","last_became_active":"2024-01-19T04:15:49.664987+0000","last_became_peered":"2024-01-19T04:15:49.664987+0000","last_unstale":"2024-01-19T04:16:06.637399+0000","last_undegraded":"2024-01-19T04:16:06.637399+0000","last_fullsized":"2024-01-19T04:16:06.637399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637230+0000","last_change":"2024-01-19T04:16:05.799441+0000","last_active":"2024-01-19T04:16:06.637230+0000","last_peered":"2024-01-19T04:16:06.637230+0000","last_clean":"2024-01-19T04:16:06.637230+0000","last_became_active":"2024-01-19T04:16:05.799063+0000","last_became_peered":"2024-01-19T04:16:05.799063+0000","last_unstale":"2024-01-19T04:16:06.637230+0000","last_undegraded":"2024-01-19T04:16:06.637230+0000","last_fullsized":"2024-01-19T04:16:06.637230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:59:19.597563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"35'9","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791453+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:16:05.791453+0000","last_peered":"2024-01-19T04:16:05.791453+0000","last_clean":"2024-01-19T04:16:05.791453+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:16:05.791453+0000","last_undegraded":"2024-01-19T04:16:05.791453+0000","last_fullsized":"2024-01-19T04:16:05.791453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642801+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:50.642801+0000","last_peered":"2024-01-19T04:15:50.642801+0000","last_clean":"2024-01-19T04:15:50.642801+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:50.642801+0000","last_undegraded":"2024-01-19T04:15:50.642801+0000","last_fullsized":"2024-01-19T04:15:50.642801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086587+0000","last_change":"2024-01-19T04:16:05.801624+0000","last_active":"2024-01-19T04:16:08.086587+0000","last_peered":"2024-01-19T04:16:08.086587+0000","last_clean":"2024-01-19T04:16:08.086587+0000","last_became_active":"2024-01-19T04:16:05.801315+0000","last_became_peered":"2024-01-19T04:16:05.801315+0000","last_unstale":"2024-01-19T04:16:08.086587+0000","last_undegraded":"2024-01-19T04:16:08.086587+0000","last_fullsized":"2024-01-19T04:16:08.086587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642896+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:50.642896+0000","last_peered":"2024-01-19T04:15:50.642896+0000","last_clean":"2024-01-19T04:15:50.642896+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:50.642896+0000","last_undegraded":"2024-01-19T04:15:50.642896+0000","last_fullsized":"2024-01-19T04:15:50.642896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791301+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:16:05.791301+0000","last_peered":"2024-01-19T04:16:05.791301+0000","last_clean":"2024-01-19T04:16:05.791301+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:16:05.791301+0000","last_undegraded":"2024-01-19T04:16:05.791301+0000","last_fullsized":"2024-01-19T04:16:05.791301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779249+0000","last_change":"2024-01-19T04:16:04.779249+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779249+0000","last_undegraded":"2024-01-19T04:16:04.779249+0000","last_fullsized":"2024-01-19T04:16:04.779249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651137+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:16:06.651137+0000","last_peered":"2024-01-19T04:16:06.651137+0000","last_clean":"2024-01-19T04:16:06.651137+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:16:06.651137+0000","last_undegraded":"2024-01-19T04:16:06.651137+0000","last_fullsized":"2024-01-19T04:16:06.651137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793074+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:16:05.793074+0000","last_peered":"2024-01-19T04:16:05.793074+0000","last_clean":"2024-01-19T04:16:05.793074+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:16:05.793074+0000","last_undegraded":"2024-01-19T04:16:05.793074+0000","last_fullsized":"2024-01-19T04:16:05.793074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635828+0000","last_change":"2024-01-19T04:16:05.789419+0000","last_active":"2024-01-19T04:16:07.635828+0000","last_peered":"2024-01-19T04:16:07.635828+0000","last_clean":"2024-01-19T04:16:07.635828+0000","last_became_active":"2024-01-19T04:16:05.782405+0000","last_became_peered":"2024-01-19T04:16:05.782405+0000","last_unstale":"2024-01-19T04:16:07.635828+0000","last_undegraded":"2024-01-19T04:16:07.635828+0000","last_fullsized":"2024-01-19T04:16:07.635828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:43:13.226181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658899+0000","last_change":"2024-01-19T04:16:06.653820+0000","last_active":"2024-01-19T04:16:06.658899+0000","last_peered":"2024-01-19T04:16:06.658899+0000","last_clean":"2024-01-19T04:16:06.658899+0000","last_became_active":"2024-01-19T04:16:06.653551+0000","last_became_peered":"2024-01-19T04:16:06.653551+0000","last_unstale":"2024-01-19T04:16:06.658899+0000","last_undegraded":"2024-01-19T04:16:06.658899+0000","last_fullsized":"2024-01-19T04:16:06.658899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:28.058495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793160+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:16:05.793160+0000","last_peered":"2024-01-19T04:16:05.793160+0000","last_clean":"2024-01-19T04:16:05.793160+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:16:05.793160+0000","last_undegraded":"2024-01-19T04:16:05.793160+0000","last_fullsized":"2024-01-19T04:16:05.793160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642933+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:50.642933+0000","last_peered":"2024-01-19T04:15:50.642933+0000","last_clean":"2024-01-19T04:15:50.642933+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:50.642933+0000","last_undegraded":"2024-01-19T04:15:50.642933+0000","last_fullsized":"2024-01-19T04:15:50.642933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779187+0000","last_change":"2024-01-19T04:16:04.779187+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779187+0000","last_undegraded":"2024-01-19T04:16:04.779187+0000","last_fullsized":"2024-01-19T04:16:04.779187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085783+0000","last_change":"2024-01-19T04:16:06.656144+0000","last_active":"2024-01-19T04:16:08.085783+0000","last_peered":"2024-01-19T04:16:08.085783+0000","last_clean":"2024-01-19T04:16:08.085783+0000","last_became_active":"2024-01-19T04:16:06.655863+0000","last_became_peered":"2024-01-19T04:16:06.655863+0000","last_unstale":"2024-01-19T04:16:08.085783+0000","last_undegraded":"2024-01-19T04:16:08.085783+0000","last_fullsized":"2024-01-19T04:16:08.085783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:01:51.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015882+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:52.015882+0000","last_peered":"2024-01-19T04:15:52.015882+0000","last_clean":"2024-01-19T04:15:52.015882+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:52.015882+0000","last_undegraded":"2024-01-19T04:15:52.015882+0000","last_fullsized":"2024-01-19T04:15:52.015882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637132+0000","last_change":"2024-01-19T04:15:49.668312+0000","last_active":"2024-01-19T04:16:06.637132+0000","last_peered":"2024-01-19T04:16:06.637132+0000","last_clean":"2024-01-19T04:16:06.637132+0000","last_became_active":"2024-01-19T04:15:49.664719+0000","last_became_peered":"2024-01-19T04:15:49.664719+0000","last_unstale":"2024-01-19T04:16:06.637132+0000","last_undegraded":"2024-01-19T04:16:06.637132+0000","last_fullsized":"2024-01-19T04:16:06.637132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779700+0000","last_change":"2024-01-19T04:16:04.779700+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779700+0000","last_undegraded":"2024-01-19T04:16:04.779700+0000","last_fullsized":"2024-01-19T04:16:04.779700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788364+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:16:05.788364+0000","last_peered":"2024-01-19T04:16:05.788364+0000","last_clean":"2024-01-19T04:16:05.788364+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:16:05.788364+0000","last_undegraded":"2024-01-19T04:16:05.788364+0000","last_fullsized":"2024-01-19T04:16:05.788364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015917+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:52.015917+0000","last_peered":"2024-01-19T04:15:52.015917+0000","last_clean":"2024-01-19T04:15:52.015917+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:52.015917+0000","last_undegraded":"2024-01-19T04:15:52.015917+0000","last_fullsized":"2024-01-19T04:15:52.015917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788356+0000","last_change":"2024-01-19T04:16:05.799707+0000","last_active":"2024-01-19T04:16:06.788356+0000","last_peered":"2024-01-19T04:16:06.788356+0000","last_clean":"2024-01-19T04:16:06.788356+0000","last_became_active":"2024-01-19T04:16:05.799464+0000","last_became_peered":"2024-01-19T04:16:05.799464+0000","last_unstale":"2024-01-19T04:16:06.788356+0000","last_undegraded":"2024-01-19T04:16:06.788356+0000","last_fullsized":"2024-01-19T04:16:06.788356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:17:34.865737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016130+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:52.016130+0000","last_peered":"2024-01-19T04:15:52.016130+0000","last_clean":"2024-01-19T04:15:52.016130+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:52.016130+0000","last_undegraded":"2024-01-19T04:15:52.016130+0000","last_fullsized":"2024-01-19T04:15:52.016130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642393+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:50.642393+0000","last_peered":"2024-01-19T04:15:50.642393+0000","last_clean":"2024-01-19T04:15:50.642393+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:50.642393+0000","last_undegraded":"2024-01-19T04:15:50.642393+0000","last_fullsized":"2024-01-19T04:15:50.642393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084277+0000","last_change":"2024-01-19T04:16:05.798704+0000","last_active":"2024-01-19T04:16:08.084277+0000","last_peered":"2024-01-19T04:16:08.084277+0000","last_clean":"2024-01-19T04:16:08.084277+0000","last_became_active":"2024-01-19T04:16:05.798256+0000","last_became_peered":"2024-01-19T04:16:05.798256+0000","last_unstale":"2024-01-19T04:16:08.084277+0000","last_undegraded":"2024-01-19T04:16:08.084277+0000","last_fullsized":"2024-01-19T04:16:08.084277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.003940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084191+0000","last_change":"2024-01-19T04:16:06.661878+0000","last_active":"2024-01-19T04:16:08.084191+0000","last_peered":"2024-01-19T04:16:08.084191+0000","last_clean":"2024-01-19T04:16:08.084191+0000","last_became_active":"2024-01-19T04:16:06.661120+0000","last_became_peered":"2024-01-19T04:16:06.661120+0000","last_unstale":"2024-01-19T04:16:08.084191+0000","last_undegraded":"2024-01-19T04:16:08.084191+0000","last_fullsized":"2024-01-19T04:16:08.084191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:54.194344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016389+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:52.016389+0000","last_peered":"2024-01-19T04:15:52.016389+0000","last_clean":"2024-01-19T04:15:52.016389+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:52.016389+0000","last_undegraded":"2024-01-19T04:15:52.016389+0000","last_fullsized":"2024-01-19T04:15:52.016389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278193+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:51.278193+0000","last_peered":"2024-01-19T04:15:51.278193+0000","last_clean":"2024-01-19T04:15:51.278193+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:51.278193+0000","last_undegraded":"2024-01-19T04:15:51.278193+0000","last_fullsized":"2024-01-19T04:15:51.278193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773970+0000","last_change":"2024-01-19T04:16:04.773970+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773970+0000","last_undegraded":"2024-01-19T04:16:04.773970+0000","last_fullsized":"2024-01-19T04:16:04.773970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.780313+0000","last_change":"2024-01-19T04:16:04.780313+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.780313+0000","last_undegraded":"2024-01-19T04:16:04.780313+0000","last_fullsized":"2024-01-19T04:16:04.780313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.635048+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:16:06.635048+0000","last_peered":"2024-01-19T04:16:06.635048+0000","last_clean":"2024-01-19T04:16:06.635048+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:16:06.635048+0000","last_undegraded":"2024-01-19T04:16:06.635048+0000","last_fullsized":"2024-01-19T04:16:06.635048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:02.358517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641737+0000","last_change":"2024-01-19T04:15:49.671511+0000","last_active":"2024-01-19T04:16:06.641737+0000","last_peered":"2024-01-19T04:16:06.641737+0000","last_clean":"2024-01-19T04:16:06.641737+0000","last_became_active":"2024-01-19T04:15:49.670975+0000","last_became_peered":"2024-01-19T04:15:49.670975+0000","last_unstale":"2024-01-19T04:16:06.641737+0000","last_undegraded":"2024-01-19T04:16:06.641737+0000","last_fullsized":"2024-01-19T04:16:06.641737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086005+0000","last_change":"2024-01-19T04:16:06.645758+0000","last_active":"2024-01-19T04:16:08.086005+0000","last_peered":"2024-01-19T04:16:08.086005+0000","last_clean":"2024-01-19T04:16:08.086005+0000","last_became_active":"2024-01-19T04:16:06.645496+0000","last_became_peered":"2024-01-19T04:16:06.645496+0000","last_unstale":"2024-01-19T04:16:08.086005+0000","last_undegraded":"2024-01-19T04:16:08.086005+0000","last_fullsized":"2024-01-19T04:16:08.086005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:25.718378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786188+0000","last_change":"2024-01-19T04:16:05.792100+0000","last_active":"2024-01-19T04:16:06.786188+0000","last_peered":"2024-01-19T04:16:06.786188+0000","last_clean":"2024-01-19T04:16:06.786188+0000","last_became_active":"2024-01-19T04:16:05.791821+0000","last_became_peered":"2024-01-19T04:16:05.791821+0000","last_unstale":"2024-01-19T04:16:06.786188+0000","last_undegraded":"2024-01-19T04:16:06.786188+0000","last_fullsized":"2024-01-19T04:16:06.786188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:12:26.677056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791504+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:16:05.791504+0000","last_peered":"2024-01-19T04:16:05.791504+0000","last_clean":"2024-01-19T04:16:05.791504+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:16:05.791504+0000","last_undegraded":"2024-01-19T04:16:05.791504+0000","last_fullsized":"2024-01-19T04:16:05.791504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016381+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:52.016381+0000","last_peered":"2024-01-19T04:15:52.016381+0000","last_clean":"2024-01-19T04:15:52.016381+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:52.016381+0000","last_undegraded":"2024-01-19T04:15:52.016381+0000","last_fullsized":"2024-01-19T04:15:52.016381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084960+0000","last_change":"2024-01-19T04:16:06.653044+0000","last_active":"2024-01-19T04:16:08.084960+0000","last_peered":"2024-01-19T04:16:08.084960+0000","last_clean":"2024-01-19T04:16:08.084960+0000","last_became_active":"2024-01-19T04:16:06.652723+0000","last_became_peered":"2024-01-19T04:16:06.652723+0000","last_unstale":"2024-01-19T04:16:08.084960+0000","last_undegraded":"2024-01-19T04:16:08.084960+0000","last_fullsized":"2024-01-19T04:16:08.084960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:59.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651297+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:16:06.651297+0000","last_peered":"2024-01-19T04:16:06.651297+0000","last_clean":"2024-01-19T04:16:06.651297+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:16:06.651297+0000","last_undegraded":"2024-01-19T04:16:06.651297+0000","last_fullsized":"2024-01-19T04:16:06.651297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393693+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:51.393693+0000","last_peered":"2024-01-19T04:15:51.393693+0000","last_clean":"2024-01-19T04:15:51.393693+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:51.393693+0000","last_undegraded":"2024-01-19T04:15:51.393693+0000","last_fullsized":"2024-01-19T04:15:51.393693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778666+0000","last_change":"2024-01-19T04:16:04.778666+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778666+0000","last_undegraded":"2024-01-19T04:16:04.778666+0000","last_fullsized":"2024-01-19T04:16:04.778666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393719+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:51.393719+0000","last_peered":"2024-01-19T04:15:51.393719+0000","last_clean":"2024-01-19T04:15:51.393719+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:51.393719+0000","last_undegraded":"2024-01-19T04:15:51.393719+0000","last_fullsized":"2024-01-19T04:15:51.393719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651043+0000","last_change":"2024-01-19T04:15:49.650645+0000","last_active":"2024-01-19T04:16:06.651043+0000","last_peered":"2024-01-19T04:16:06.651043+0000","last_clean":"2024-01-19T04:16:06.651043+0000","last_became_active":"2024-01-19T04:15:49.650331+0000","last_became_peered":"2024-01-19T04:15:49.650331+0000","last_unstale":"2024-01-19T04:16:06.651043+0000","last_undegraded":"2024-01-19T04:16:06.651043+0000","last_fullsized":"2024-01-19T04:16:06.651043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085276+0000","last_change":"2024-01-19T04:16:05.791836+0000","last_active":"2024-01-19T04:16:08.085276+0000","last_peered":"2024-01-19T04:16:08.085276+0000","last_clean":"2024-01-19T04:16:08.085276+0000","last_became_active":"2024-01-19T04:16:05.791582+0000","last_became_peered":"2024-01-19T04:16:05.791582+0000","last_unstale":"2024-01-19T04:16:08.085276+0000","last_undegraded":"2024-01-19T04:16:08.085276+0000","last_fullsized":"2024-01-19T04:16:08.085276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277780+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:51.277780+0000","last_peered":"2024-01-19T04:15:51.277780+0000","last_clean":"2024-01-19T04:15:51.277780+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:51.277780+0000","last_undegraded":"2024-01-19T04:15:51.277780+0000","last_fullsized":"2024-01-19T04:15:51.277780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393567+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:51.393567+0000","last_peered":"2024-01-19T04:15:51.393567+0000","last_clean":"2024-01-19T04:15:51.393567+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:51.393567+0000","last_undegraded":"2024-01-19T04:15:51.393567+0000","last_fullsized":"2024-01-19T04:15:51.393567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635281+0000","last_change":"2024-01-19T04:16:06.644115+0000","last_active":"2024-01-19T04:16:07.635281+0000","last_peered":"2024-01-19T04:16:07.635281+0000","last_clean":"2024-01-19T04:16:07.635281+0000","last_became_active":"2024-01-19T04:16:06.643807+0000","last_became_peered":"2024-01-19T04:16:06.643807+0000","last_unstale":"2024-01-19T04:16:07.635281+0000","last_undegraded":"2024-01-19T04:16:07.635281+0000","last_fullsized":"2024-01-19T04:16:07.635281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:20.211567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278402+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:51.278402+0000","last_peered":"2024-01-19T04:15:51.278402+0000","last_clean":"2024-01-19T04:15:51.278402+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:51.278402+0000","last_undegraded":"2024-01-19T04:15:51.278402+0000","last_fullsized":"2024-01-19T04:15:51.278402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.648071+0000","last_change":"2024-01-19T04:16:06.645593+0000","last_active":"2024-01-19T04:16:06.648071+0000","last_peered":"2024-01-19T04:16:06.648071+0000","last_clean":"2024-01-19T04:16:06.648071+0000","last_became_active":"2024-01-19T04:16:06.645250+0000","last_became_peered":"2024-01-19T04:16:06.645250+0000","last_unstale":"2024-01-19T04:16:06.648071+0000","last_undegraded":"2024-01-19T04:16:06.648071+0000","last_fullsized":"2024-01-19T04:16:06.648071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:11:20.809247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016256+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:52.016256+0000","last_peered":"2024-01-19T04:15:52.016256+0000","last_clean":"2024-01-19T04:15:52.016256+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:52.016256+0000","last_undegraded":"2024-01-19T04:15:52.016256+0000","last_fullsized":"2024-01-19T04:15:52.016256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635962+0000","last_change":"2024-01-19T04:16:06.642681+0000","last_active":"2024-01-19T04:16:07.635962+0000","last_peered":"2024-01-19T04:16:07.635962+0000","last_clean":"2024-01-19T04:16:07.635962+0000","last_became_active":"2024-01-19T04:16:06.642382+0000","last_became_peered":"2024-01-19T04:16:06.642382+0000","last_unstale":"2024-01-19T04:16:07.635962+0000","last_undegraded":"2024-01-19T04:16:07.635962+0000","last_fullsized":"2024-01-19T04:16:07.635962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:47.006272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642785+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:50.642785+0000","last_peered":"2024-01-19T04:15:50.642785+0000","last_clean":"2024-01-19T04:15:50.642785+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:50.642785+0000","last_undegraded":"2024-01-19T04:15:50.642785+0000","last_fullsized":"2024-01-19T04:15:50.642785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641820+0000","last_change":"2024-01-19T04:15:49.672729+0000","last_active":"2024-01-19T04:16:06.641820+0000","last_peered":"2024-01-19T04:16:06.641820+0000","last_clean":"2024-01-19T04:16:06.641820+0000","last_became_active":"2024-01-19T04:15:49.672195+0000","last_became_peered":"2024-01-19T04:15:49.672195+0000","last_unstale":"2024-01-19T04:16:06.641820+0000","last_undegraded":"2024-01-19T04:16:06.641820+0000","last_fullsized":"2024-01-19T04:16:06.641820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793119+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:16:05.793119+0000","last_peered":"2024-01-19T04:16:05.793119+0000","last_clean":"2024-01-19T04:16:05.793119+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:16:05.793119+0000","last_undegraded":"2024-01-19T04:16:05.793119+0000","last_fullsized":"2024-01-19T04:16:05.793119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638035+0000","last_change":"2024-01-19T04:15:49.655156+0000","last_active":"2024-01-19T04:16:06.638035+0000","last_peered":"2024-01-19T04:16:06.638035+0000","last_clean":"2024-01-19T04:16:06.638035+0000","last_became_active":"2024-01-19T04:15:49.651743+0000","last_became_peered":"2024-01-19T04:15:49.651743+0000","last_unstale":"2024-01-19T04:16:06.638035+0000","last_undegraded":"2024-01-19T04:16:06.638035+0000","last_fullsized":"2024-01-19T04:16:06.638035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085040+0000","last_change":"2024-01-19T04:16:06.653368+0000","last_active":"2024-01-19T04:16:08.085040+0000","last_peered":"2024-01-19T04:16:08.085040+0000","last_clean":"2024-01-19T04:16:08.085040+0000","last_became_active":"2024-01-19T04:16:06.653083+0000","last_became_peered":"2024-01-19T04:16:06.653083+0000","last_unstale":"2024-01-19T04:16:08.085040+0000","last_undegraded":"2024-01-19T04:16:08.085040+0000","last_fullsized":"2024-01-19T04:16:08.085040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:48.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642352+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:50.642352+0000","last_peered":"2024-01-19T04:15:50.642352+0000","last_clean":"2024-01-19T04:15:50.642352+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:50.642352+0000","last_undegraded":"2024-01-19T04:15:50.642352+0000","last_fullsized":"2024-01-19T04:15:50.642352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659402+0000","last_change":"2024-01-19T04:16:06.655369+0000","last_active":"2024-01-19T04:16:06.659402+0000","last_peered":"2024-01-19T04:16:06.659402+0000","last_clean":"2024-01-19T04:16:06.659402+0000","last_became_active":"2024-01-19T04:16:06.655053+0000","last_became_peered":"2024-01-19T04:16:06.655053+0000","last_unstale":"2024-01-19T04:16:06.659402+0000","last_undegraded":"2024-01-19T04:16:06.659402+0000","last_fullsized":"2024-01-19T04:16:06.659402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:15.541954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.649648+0000","last_change":"2024-01-19T04:15:49.645143+0000","last_active":"2024-01-19T04:16:06.649648+0000","last_peered":"2024-01-19T04:16:06.649648+0000","last_clean":"2024-01-19T04:16:06.649648+0000","last_became_active":"2024-01-19T04:15:49.644879+0000","last_became_peered":"2024-01-19T04:15:49.644879+0000","last_unstale":"2024-01-19T04:16:06.649648+0000","last_undegraded":"2024-01-19T04:16:06.649648+0000","last_fullsized":"2024-01-19T04:16:06.649648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016274+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:52.016274+0000","last_peered":"2024-01-19T04:15:52.016274+0000","last_clean":"2024-01-19T04:15:52.016274+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:52.016274+0000","last_undegraded":"2024-01-19T04:15:52.016274+0000","last_fullsized":"2024-01-19T04:15:52.016274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016180+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:52.016180+0000","last_peered":"2024-01-19T04:15:52.016180+0000","last_clean":"2024-01-19T04:15:52.016180+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:52.016180+0000","last_undegraded":"2024-01-19T04:15:52.016180+0000","last_fullsized":"2024-01-19T04:15:52.016180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634937+0000","last_change":"2024-01-19T04:15:49.679977+0000","last_active":"2024-01-19T04:16:06.634937+0000","last_peered":"2024-01-19T04:16:06.634937+0000","last_clean":"2024-01-19T04:16:06.634937+0000","last_became_active":"2024-01-19T04:15:49.679706+0000","last_became_peered":"2024-01-19T04:15:49.679706+0000","last_unstale":"2024-01-19T04:16:06.634937+0000","last_undegraded":"2024-01-19T04:16:06.634937+0000","last_fullsized":"2024-01-19T04:16:06.634937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791409+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:16:05.791409+0000","last_peered":"2024-01-19T04:16:05.791409+0000","last_clean":"2024-01-19T04:16:05.791409+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:16:05.791409+0000","last_undegraded":"2024-01-19T04:16:05.791409+0000","last_fullsized":"2024-01-19T04:16:05.791409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635814+0000","last_change":"2024-01-19T04:16:06.656508+0000","last_active":"2024-01-19T04:16:07.635814+0000","last_peered":"2024-01-19T04:16:07.635814+0000","last_clean":"2024-01-19T04:16:07.635814+0000","last_became_active":"2024-01-19T04:16:06.656095+0000","last_became_peered":"2024-01-19T04:16:06.656095+0000","last_unstale":"2024-01-19T04:16:07.635814+0000","last_undegraded":"2024-01-19T04:16:07.635814+0000","last_fullsized":"2024-01-19T04:16:07.635814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:48.953287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793097+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:16:05.793097+0000","last_peered":"2024-01-19T04:16:05.793097+0000","last_clean":"2024-01-19T04:16:05.793097+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:16:05.793097+0000","last_undegraded":"2024-01-19T04:16:05.793097+0000","last_fullsized":"2024-01-19T04:16:05.793097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278301+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:51.278301+0000","last_peered":"2024-01-19T04:15:51.278301+0000","last_clean":"2024-01-19T04:15:51.278301+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:51.278301+0000","last_undegraded":"2024-01-19T04:15:51.278301+0000","last_fullsized":"2024-01-19T04:15:51.278301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084295+0000","last_change":"2024-01-19T04:16:06.658727+0000","last_active":"2024-01-19T04:16:08.084295+0000","last_peered":"2024-01-19T04:16:08.084295+0000","last_clean":"2024-01-19T04:16:08.084295+0000","last_became_active":"2024-01-19T04:16:06.657947+0000","last_became_peered":"2024-01-19T04:16:06.657947+0000","last_unstale":"2024-01-19T04:16:08.084295+0000","last_undegraded":"2024-01-19T04:16:08.084295+0000","last_fullsized":"2024-01-19T04:16:08.084295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:26.441618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278172+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:51.278172+0000","last_peered":"2024-01-19T04:15:51.278172+0000","last_clean":"2024-01-19T04:15:51.278172+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:51.278172+0000","last_undegraded":"2024-01-19T04:15:51.278172+0000","last_fullsized":"2024-01-19T04:15:51.278172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635326+0000","last_change":"2024-01-19T04:16:06.643237+0000","last_active":"2024-01-19T04:16:07.635326+0000","last_peered":"2024-01-19T04:16:07.635326+0000","last_clean":"2024-01-19T04:16:07.635326+0000","last_became_active":"2024-01-19T04:16:06.642898+0000","last_became_peered":"2024-01-19T04:16:06.642898+0000","last_unstale":"2024-01-19T04:16:07.635326+0000","last_undegraded":"2024-01-19T04:16:07.635326+0000","last_fullsized":"2024-01-19T04:16:07.635326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:26.134708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642358+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:50.642358+0000","last_peered":"2024-01-19T04:15:50.642358+0000","last_clean":"2024-01-19T04:15:50.642358+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:50.642358+0000","last_undegraded":"2024-01-19T04:15:50.642358+0000","last_fullsized":"2024-01-19T04:15:50.642358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790125+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:16:05.790125+0000","last_peered":"2024-01-19T04:16:05.790125+0000","last_clean":"2024-01-19T04:16:05.790125+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:16:05.790125+0000","last_undegraded":"2024-01-19T04:16:05.790125+0000","last_fullsized":"2024-01-19T04:16:05.790125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.653729+0000","last_change":"2024-01-19T04:16:06.651408+0000","last_active":"2024-01-19T04:16:06.653729+0000","last_peered":"2024-01-19T04:16:06.653729+0000","last_clean":"2024-01-19T04:16:06.653729+0000","last_became_active":"2024-01-19T04:16:06.651129+0000","last_became_peered":"2024-01-19T04:16:06.651129+0000","last_unstale":"2024-01-19T04:16:06.653729+0000","last_undegraded":"2024-01-19T04:16:06.653729+0000","last_fullsized":"2024-01-19T04:16:06.653729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:27.515777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633913+0000","last_change":"2024-01-19T04:15:49.657109+0000","last_active":"2024-01-19T04:16:06.633913+0000","last_peered":"2024-01-19T04:16:06.633913+0000","last_clean":"2024-01-19T04:16:06.633913+0000","last_became_active":"2024-01-19T04:15:49.656836+0000","last_became_peered":"2024-01-19T04:15:49.656836+0000","last_unstale":"2024-01-19T04:16:06.633913+0000","last_undegraded":"2024-01-19T04:16:06.633913+0000","last_fullsized":"2024-01-19T04:16:06.633913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:41.496335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086508+0000","last_change":"2024-01-19T04:16:06.660525+0000","last_active":"2024-01-19T04:16:08.086508+0000","last_peered":"2024-01-19T04:16:08.086508+0000","last_clean":"2024-01-19T04:16:08.086508+0000","last_became_active":"2024-01-19T04:16:06.659997+0000","last_became_peered":"2024-01-19T04:16:06.659997+0000","last_unstale":"2024-01-19T04:16:08.086508+0000","last_undegraded":"2024-01-19T04:16:08.086508+0000","last_fullsized":"2024-01-19T04:16:08.086508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:02.077588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642725+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:50.642725+0000","last_peered":"2024-01-19T04:15:50.642725+0000","last_clean":"2024-01-19T04:15:50.642725+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:50.642725+0000","last_undegraded":"2024-01-19T04:15:50.642725+0000","last_fullsized":"2024-01-19T04:15:50.642725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085834+0000","last_change":"2024-01-19T04:16:06.658837+0000","last_active":"2024-01-19T04:16:08.085834+0000","last_peered":"2024-01-19T04:16:08.085834+0000","last_clean":"2024-01-19T04:16:08.085834+0000","last_became_active":"2024-01-19T04:16:06.657952+0000","last_became_peered":"2024-01-19T04:16:06.657952+0000","last_unstale":"2024-01-19T04:16:08.085834+0000","last_undegraded":"2024-01-19T04:16:08.085834+0000","last_fullsized":"2024-01-19T04:16:08.085834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:30.123335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278237+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:51.278237+0000","last_peered":"2024-01-19T04:15:51.278237+0000","last_clean":"2024-01-19T04:15:51.278237+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:51.278237+0000","last_undegraded":"2024-01-19T04:15:51.278237+0000","last_fullsized":"2024-01-19T04:15:51.278237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638192+0000","last_change":"2024-01-19T04:15:49.664498+0000","last_active":"2024-01-19T04:16:06.638192+0000","last_peered":"2024-01-19T04:16:06.638192+0000","last_clean":"2024-01-19T04:16:06.638192+0000","last_became_active":"2024-01-19T04:15:49.664196+0000","last_became_peered":"2024-01-19T04:15:49.664196+0000","last_unstale":"2024-01-19T04:16:06.638192+0000","last_undegraded":"2024-01-19T04:16:06.638192+0000","last_fullsized":"2024-01-19T04:16:06.638192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086252+0000","last_change":"2024-01-19T04:16:06.657128+0000","last_active":"2024-01-19T04:16:08.086252+0000","last_peered":"2024-01-19T04:16:08.086252+0000","last_clean":"2024-01-19T04:16:08.086252+0000","last_became_active":"2024-01-19T04:16:06.656850+0000","last_became_peered":"2024-01-19T04:16:06.656850+0000","last_unstale":"2024-01-19T04:16:08.086252+0000","last_undegraded":"2024-01-19T04:16:08.086252+0000","last_fullsized":"2024-01-19T04:16:08.086252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:24:57.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016567+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:52.016567+0000","last_peered":"2024-01-19T04:15:52.016567+0000","last_clean":"2024-01-19T04:15:52.016567+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:52.016567+0000","last_undegraded":"2024-01-19T04:15:52.016567+0000","last_fullsized":"2024-01-19T04:15:52.016567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659051+0000","last_change":"2024-01-19T04:16:06.654727+0000","last_active":"2024-01-19T04:16:06.659051+0000","last_peered":"2024-01-19T04:16:06.659051+0000","last_clean":"2024-01-19T04:16:06.659051+0000","last_became_active":"2024-01-19T04:16:06.654482+0000","last_became_peered":"2024-01-19T04:16:06.654482+0000","last_unstale":"2024-01-19T04:16:06.659051+0000","last_undegraded":"2024-01-19T04:16:06.659051+0000","last_fullsized":"2024-01-19T04:16:06.659051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:52.554202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277738+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:51.277738+0000","last_peered":"2024-01-19T04:15:51.277738+0000","last_clean":"2024-01-19T04:15:51.277738+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:51.277738+0000","last_undegraded":"2024-01-19T04:15:51.277738+0000","last_fullsized":"2024-01-19T04:15:51.277738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278338+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:51.278338+0000","last_peered":"2024-01-19T04:15:51.278338+0000","last_clean":"2024-01-19T04:15:51.278338+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:51.278338+0000","last_undegraded":"2024-01-19T04:15:51.278338+0000","last_fullsized":"2024-01-19T04:15:51.278338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085378+0000","last_change":"2024-01-19T04:16:06.663270+0000","last_active":"2024-01-19T04:16:08.085378+0000","last_peered":"2024-01-19T04:16:08.085378+0000","last_clean":"2024-01-19T04:16:08.085378+0000","last_became_active":"2024-01-19T04:16:06.661491+0000","last_became_peered":"2024-01-19T04:16:06.661491+0000","last_unstale":"2024-01-19T04:16:08.085378+0000","last_undegraded":"2024-01-19T04:16:08.085378+0000","last_fullsized":"2024-01-19T04:16:08.085378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:15.679645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790041+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:16:05.790041+0000","last_peered":"2024-01-19T04:16:05.790041+0000","last_clean":"2024-01-19T04:16:05.790041+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:16:05.790041+0000","last_undegraded":"2024-01-19T04:16:05.790041+0000","last_fullsized":"2024-01-19T04:16:05.790041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633823+0000","last_change":"2024-01-19T04:15:49.657523+0000","last_active":"2024-01-19T04:16:06.633823+0000","last_peered":"2024-01-19T04:16:06.633823+0000","last_clean":"2024-01-19T04:16:06.633823+0000","last_became_active":"2024-01-19T04:15:49.657239+0000","last_became_peered":"2024-01-19T04:15:49.657239+0000","last_unstale":"2024-01-19T04:16:06.633823+0000","last_undegraded":"2024-01-19T04:16:06.633823+0000","last_fullsized":"2024-01-19T04:16:06.633823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:50.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638676+0000","last_change":"2024-01-19T04:15:49.666858+0000","last_active":"2024-01-19T04:16:06.638676+0000","last_peered":"2024-01-19T04:16:06.638676+0000","last_clean":"2024-01-19T04:16:06.638676+0000","last_became_active":"2024-01-19T04:15:49.665093+0000","last_became_peered":"2024-01-19T04:15:49.665093+0000","last_unstale":"2024-01-19T04:16:06.638676+0000","last_undegraded":"2024-01-19T04:16:06.638676+0000","last_fullsized":"2024-01-19T04:16:06.638676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642800+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:50.642800+0000","last_peered":"2024-01-19T04:15:50.642800+0000","last_clean":"2024-01-19T04:15:50.642800+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:50.642800+0000","last_undegraded":"2024-01-19T04:15:50.642800+0000","last_fullsized":"2024-01-19T04:15:50.642800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085694+0000","last_change":"2024-01-19T04:16:06.661023+0000","last_active":"2024-01-19T04:16:08.085694+0000","last_peered":"2024-01-19T04:16:08.085694+0000","last_clean":"2024-01-19T04:16:08.085694+0000","last_became_active":"2024-01-19T04:16:06.660642+0000","last_became_peered":"2024-01-19T04:16:06.660642+0000","last_unstale":"2024-01-19T04:16:08.085694+0000","last_undegraded":"2024-01-19T04:16:08.085694+0000","last_fullsized":"2024-01-19T04:16:08.085694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:00.472323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793039+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:16:05.793039+0000","last_peered":"2024-01-19T04:16:05.793039+0000","last_clean":"2024-01-19T04:16:05.793039+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:16:05.793039+0000","last_undegraded":"2024-01-19T04:16:05.793039+0000","last_fullsized":"2024-01-19T04:16:05.793039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393618+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:51.393618+0000","last_peered":"2024-01-19T04:15:51.393618+0000","last_clean":"2024-01-19T04:15:51.393618+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:51.393618+0000","last_undegraded":"2024-01-19T04:15:51.393618+0000","last_fullsized":"2024-01-19T04:15:51.393618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":738768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.93999999999999995}]}]},{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93500000000000005}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.044}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.1459999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0720000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.026}]}]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.746},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.81200000000000006}]}]},{"osd":4,"up_from":16,"seq":68719476755,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":148414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.505},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.624}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.745},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.76600000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":178597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.255},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80900000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":180092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.032},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.96299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":767295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.876},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.94299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":450560,"data_stored":173503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.745}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:16:10.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:16:11.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.074+0000 7fd05c200640 1 Processor -- start 2024-01-19T04:16:11.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.074+0000 7fd05c200640 1 -- start start 2024-01-19T04:16:11.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd05c200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd0540a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd05c200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540c44f0 con 0x7fd0540c54b0 2024-01-19T04:16:11.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd05c200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540c4980 con 0x7fd0540a52e0 2024-01-19T04:16:11.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd05c200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540c3bc0 con 0x7fd054155320 2024-01-19T04:16:11.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd058e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd0540c54b0 0x7fd05406cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41958/0 (socket says 172.21.15.32:41958) 2024-01-19T04:16:11.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd058e00640 1 -- 172.21.15.32:0/2199407767 learned_addr learned my addr 172.21.15.32:0/2199407767 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:11.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd059800640 1 --2- 172.21.15.32:0/2199407767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd0540a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd053e00640 1 -- 172.21.15.32:0/2199407767 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958381446 0 0) 0x7fd0540c44f0 con 0x7fd0540c54b0 2024-01-19T04:16:11.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd053e00640 1 -- 172.21.15.32:0/2199407767 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd034003530 con 0x7fd0540c54b0 2024-01-19T04:16:11.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd053e00640 1 -- 172.21.15.32:0/2199407767 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896304519 0 0) 0x7fd0540c4980 con 0x7fd0540a52e0 2024-01-19T04:16:11.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd059800640 1 -- 172.21.15.32:0/2199407767 >> v1:172.21.15.67:6789/0 conn(0x7fd0540a52e0 legacy=0x7fd05415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd059800640 1 -- 172.21.15.32:0/2199407767 >> v1:172.21.15.32:6789/0 conn(0x7fd0540c54b0 legacy=0x7fd05406cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.078+0000 7fd059800640 1 -- 172.21.15.32:0/2199407767 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540c3ea0 con 0x7fd054155320 2024-01-19T04:16:11.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd059800640 1 --2- 172.21.15.32:0/2199407767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd0540a4da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0440097f0 tx=0x7fd04401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ac2a374b61af05 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd053e00640 1 -- 172.21.15.32:0/2199407767 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440aa610 con 0x7fd054155320 2024-01-19T04:16:11.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd053e00640 1 -- 172.21.15.32:0/2199407767 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0440a6040 con 0x7fd054155320 2024-01-19T04:16:11.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd053e00640 1 -- 172.21.15.32:0/2199407767 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440aa990 con 0x7fd054155320 2024-01-19T04:16:11.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd05c200640 1 -- 172.21.15.32:0/2199407767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 msgr2=0x7fd0540a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd05c200640 1 --2- 172.21.15.32:0/2199407767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd0540a4da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0440097f0 tx=0x7fd04401c490 comp rx=0 tx=0).stop 2024-01-19T04:16:11.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd05c200640 1 -- 172.21.15.32:0/2199407767 shutdown_connections 2024-01-19T04:16:11.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd05c200640 1 --2- 172.21.15.32:0/2199407767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd0540a4da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd05c200640 1 -- 172.21.15.32:0/2199407767 >> 172.21.15.32:0/2199407767 conn(0x7fd0540c5b20 msgr2=0x7fd0540c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:11.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd05c200640 1 -- 172.21.15.32:0/2199407767 shutdown_connections 2024-01-19T04:16:11.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.082+0000 7fd05c200640 1 -- 172.21.15.32:0/2199407767 wait complete. 2024-01-19T04:16:11.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 Processor -- start 2024-01-19T04:16:11.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 -- start start 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0540a52e0 0x7fd05414ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0540c54b0 0x7fd05414da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd054147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054149f60 con 0x7fd0540c54b0 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054155d20 con 0x7fd0540a52e0 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0541493c0 con 0x7fd054155320 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0540c54b0 0x7fd05414da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0540c54b0 0x7fd05414da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43356/0 (socket says 172.21.15.32:43356) 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 -- 172.21.15.32:0/2336921216 learned_addr learned my addr 172.21.15.32:0/2336921216 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd059800640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0540a52e0 0x7fd05414ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05a200640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd054147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 -- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 msgr2=0x7fd054147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd054147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 -- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0540a52e0 msgr2=0x7fd05414ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0540a52e0 0x7fd05414ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 -- 172.21.15.32:0/2336921216 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009420 con 0x7fd0540c54b0 2024-01-19T04:16:11.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd058e00640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0540c54b0 0x7fd05414da50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00c3c0 tx=0x7fd03c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd051600640 1 -- 172.21.15.32:0/2336921216 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c005cf0 con 0x7fd0540c54b0 2024-01-19T04:16:11.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd051600640 1 -- 172.21.15.32:0/2336921216 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c005e50 con 0x7fd0540c54b0 2024-01-19T04:16:11.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0541496a0 con 0x7fd0540c54b0 2024-01-19T04:16:11.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd051600640 1 -- 172.21.15.32:0/2336921216 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0072f0 con 0x7fd0540c54b0 2024-01-19T04:16:11.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05414df90 con 0x7fd0540c54b0 2024-01-19T04:16:11.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.086+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd054155ed0 con 0x7fd0540c54b0 2024-01-19T04:16:11.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.090+0000 7fd051600640 1 -- 172.21.15.32:0/2336921216 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd03c007450 con 0x7fd0540c54b0 2024-01-19T04:16:11.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.090+0000 7fd051600640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd02c066530 0x7fd02c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.090+0000 7fd051600640 1 -- 172.21.15.32:0/2336921216 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd03c0836d0 con 0x7fd0540c54b0 2024-01-19T04:16:11.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.090+0000 7fd059800640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd02c066530 0x7fd02c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.090+0000 7fd059800640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd02c066530 0x7fd02c0689f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd0440ae000 tx=0x7fd0440a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.094+0000 7fd051600640 1 -- 172.21.15.32:0/2336921216 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd054155ed0 con 0x7fd0540c54b0 2024-01-19T04:16:11.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.250+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd05406d7a0 con 0x7fd02c066530 2024-01-19T04:16:11.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.262+0000 7fd051600640 1 -- 172.21.15.32:0/2336921216 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+521534 (secure 0 0 0) 0x7fd0440b5670 con 0x7fd02c066530 2024-01-19T04:16:11.270 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:11.274 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:16:11.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.266+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd02c066530 msgr2=0x7fd02c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.266+0000 7fd05c200640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd02c066530 0x7fd02c0689f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd0440ae000 tx=0x7fd0440a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:11.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.266+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0540c54b0 msgr2=0x7fd05414da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.266+0000 7fd05c200640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0540c54b0 0x7fd05414da50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00c3c0 tx=0x7fd03c00c880 comp rx=0 tx=0).stop 2024-01-19T04:16:11.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 shutdown_connections 2024-01-19T04:16:11.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd02c066530 0x7fd02c0689f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd054155320 0x7fd054147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0540c54b0 0x7fd05414da50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 --2- 172.21.15.32:0/2336921216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0540a52e0 0x7fd05414ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 >> 172.21.15.32:0/2336921216 conn(0x7fd0540c5b20 msgr2=0x7fd0541534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:11.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 shutdown_connections 2024-01-19T04:16:11.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.270+0000 7fd05c200640 1 -- 172.21.15.32:0/2336921216 wait complete. 2024-01-19T04:16:11.290 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-19T04:16:10.044297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596523,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":237,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237292,"kb_used_data":4472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737428,"statfs":{"total":773094113280,"available":772851126272,"internally_reserved":0,"allocated":4579328,"data_stored":2497919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.275128"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086760+0000","last_change":"2024-01-19T04:16:06.662967+0000","last_active":"2024-01-19T04:16:08.086760+0000","last_peered":"2024-01-19T04:16:08.086760+0000","last_clean":"2024-01-19T04:16:08.086760+0000","last_became_active":"2024-01-19T04:16:06.662697+0000","last_became_peered":"2024-01-19T04:16:06.662697+0000","last_unstale":"2024-01-19T04:16:08.086760+0000","last_undegraded":"2024-01-19T04:16:08.086760+0000","last_fullsized":"2024-01-19T04:16:08.086760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278168+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:51.278168+0000","last_peered":"2024-01-19T04:15:51.278168+0000","last_clean":"2024-01-19T04:15:51.278168+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:51.278168+0000","last_undegraded":"2024-01-19T04:15:51.278168+0000","last_fullsized":"2024-01-19T04:15:51.278168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393434+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:51.393434+0000","last_peered":"2024-01-19T04:15:51.393434+0000","last_clean":"2024-01-19T04:15:51.393434+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:51.393434+0000","last_undegraded":"2024-01-19T04:15:51.393434+0000","last_fullsized":"2024-01-19T04:15:51.393434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277965+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:51.277965+0000","last_peered":"2024-01-19T04:15:51.277965+0000","last_clean":"2024-01-19T04:15:51.277965+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:51.277965+0000","last_undegraded":"2024-01-19T04:15:51.277965+0000","last_fullsized":"2024-01-19T04:15:51.277965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.774083+0000","last_change":"2024-01-19T04:16:04.774083+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.774083+0000","last_undegraded":"2024-01-19T04:16:04.774083+0000","last_fullsized":"2024-01-19T04:16:04.774083+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659382+0000","last_change":"2024-01-19T04:16:06.654967+0000","last_active":"2024-01-19T04:16:06.659382+0000","last_peered":"2024-01-19T04:16:06.659382+0000","last_clean":"2024-01-19T04:16:06.659382+0000","last_became_active":"2024-01-19T04:16:06.653661+0000","last_became_peered":"2024-01-19T04:16:06.653661+0000","last_unstale":"2024-01-19T04:16:06.659382+0000","last_undegraded":"2024-01-19T04:16:06.659382+0000","last_fullsized":"2024-01-19T04:16:06.659382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:00:48.794156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788581+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:16:05.788581+0000","last_peered":"2024-01-19T04:16:05.788581+0000","last_clean":"2024-01-19T04:16:05.788581+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:16:05.788581+0000","last_undegraded":"2024-01-19T04:16:05.788581+0000","last_fullsized":"2024-01-19T04:16:05.788581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015937+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:52.015937+0000","last_peered":"2024-01-19T04:15:52.015937+0000","last_clean":"2024-01-19T04:15:52.015937+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:52.015937+0000","last_undegraded":"2024-01-19T04:15:52.015937+0000","last_fullsized":"2024-01-19T04:15:52.015937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779011+0000","last_change":"2024-01-19T04:16:04.779011+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779011+0000","last_undegraded":"2024-01-19T04:16:04.779011+0000","last_fullsized":"2024-01-19T04:16:04.779011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658445+0000","last_change":"2024-01-19T04:16:06.649757+0000","last_active":"2024-01-19T04:16:06.658445+0000","last_peered":"2024-01-19T04:16:06.658445+0000","last_clean":"2024-01-19T04:16:06.658445+0000","last_became_active":"2024-01-19T04:16:06.649522+0000","last_became_peered":"2024-01-19T04:16:06.649522+0000","last_unstale":"2024-01-19T04:16:06.658445+0000","last_undegraded":"2024-01-19T04:16:06.658445+0000","last_fullsized":"2024-01-19T04:16:06.658445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:52.103572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016060+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:52.016060+0000","last_peered":"2024-01-19T04:15:52.016060+0000","last_clean":"2024-01-19T04:15:52.016060+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:52.016060+0000","last_undegraded":"2024-01-19T04:15:52.016060+0000","last_fullsized":"2024-01-19T04:15:52.016060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788338+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:16:05.788338+0000","last_peered":"2024-01-19T04:16:05.788338+0000","last_clean":"2024-01-19T04:16:05.788338+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:16:05.788338+0000","last_undegraded":"2024-01-19T04:16:05.788338+0000","last_fullsized":"2024-01-19T04:16:05.788338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778670+0000","last_change":"2024-01-19T04:16:04.778670+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778670+0000","last_undegraded":"2024-01-19T04:16:04.778670+0000","last_fullsized":"2024-01-19T04:16:04.778670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637633+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:16:06.637633+0000","last_peered":"2024-01-19T04:16:06.637633+0000","last_clean":"2024-01-19T04:16:06.637633+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:16:06.637633+0000","last_undegraded":"2024-01-19T04:16:06.637633+0000","last_fullsized":"2024-01-19T04:16:06.637633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650232+0000","last_change":"2024-01-19T04:15:49.653943+0000","last_active":"2024-01-19T04:16:06.650232+0000","last_peered":"2024-01-19T04:16:06.650232+0000","last_clean":"2024-01-19T04:16:06.650232+0000","last_became_active":"2024-01-19T04:15:49.653669+0000","last_became_peered":"2024-01-19T04:15:49.653669+0000","last_unstale":"2024-01-19T04:16:06.650232+0000","last_undegraded":"2024-01-19T04:16:06.650232+0000","last_fullsized":"2024-01-19T04:16:06.650232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084761+0000","last_change":"2024-01-19T04:16:05.798495+0000","last_active":"2024-01-19T04:16:08.084761+0000","last_peered":"2024-01-19T04:16:08.084761+0000","last_clean":"2024-01-19T04:16:08.084761+0000","last_became_active":"2024-01-19T04:16:05.797905+0000","last_became_peered":"2024-01-19T04:16:05.797905+0000","last_unstale":"2024-01-19T04:16:08.084761+0000","last_undegraded":"2024-01-19T04:16:08.084761+0000","last_fullsized":"2024-01-19T04:16:08.084761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650407+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:16:06.650407+0000","last_peered":"2024-01-19T04:16:06.650407+0000","last_clean":"2024-01-19T04:16:06.650407+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:16:06.650407+0000","last_undegraded":"2024-01-19T04:16:06.650407+0000","last_fullsized":"2024-01-19T04:16:06.650407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393555+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:51.393555+0000","last_peered":"2024-01-19T04:15:51.393555+0000","last_clean":"2024-01-19T04:15:51.393555+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:51.393555+0000","last_undegraded":"2024-01-19T04:15:51.393555+0000","last_fullsized":"2024-01-19T04:15:51.393555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084600+0000","last_change":"2024-01-19T04:16:05.790864+0000","last_active":"2024-01-19T04:16:08.084600+0000","last_peered":"2024-01-19T04:16:08.084600+0000","last_clean":"2024-01-19T04:16:08.084600+0000","last_became_active":"2024-01-19T04:16:05.790554+0000","last_became_peered":"2024-01-19T04:16:05.790554+0000","last_unstale":"2024-01-19T04:16:08.084600+0000","last_undegraded":"2024-01-19T04:16:08.084600+0000","last_fullsized":"2024-01-19T04:16:08.084600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639010+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:16:06.639010+0000","last_peered":"2024-01-19T04:16:06.639010+0000","last_clean":"2024-01-19T04:16:06.639010+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:16:06.639010+0000","last_undegraded":"2024-01-19T04:16:06.639010+0000","last_fullsized":"2024-01-19T04:16:06.639010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650609+0000","last_change":"2024-01-19T04:15:49.667426+0000","last_active":"2024-01-19T04:16:06.650609+0000","last_peered":"2024-01-19T04:16:06.650609+0000","last_clean":"2024-01-19T04:16:06.650609+0000","last_became_active":"2024-01-19T04:15:49.667142+0000","last_became_peered":"2024-01-19T04:15:49.667142+0000","last_unstale":"2024-01-19T04:16:06.650609+0000","last_undegraded":"2024-01-19T04:16:06.650609+0000","last_fullsized":"2024-01-19T04:16:06.650609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640695+0000","last_change":"2024-01-19T04:16:05.797053+0000","last_active":"2024-01-19T04:16:06.640695+0000","last_peered":"2024-01-19T04:16:06.640695+0000","last_clean":"2024-01-19T04:16:06.640695+0000","last_became_active":"2024-01-19T04:16:05.796727+0000","last_became_peered":"2024-01-19T04:16:05.796727+0000","last_unstale":"2024-01-19T04:16:06.640695+0000","last_undegraded":"2024-01-19T04:16:06.640695+0000","last_fullsized":"2024-01-19T04:16:06.640695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:28:03.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651211+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:16:06.651211+0000","last_peered":"2024-01-19T04:16:06.651211+0000","last_clean":"2024-01-19T04:16:06.651211+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:16:06.651211+0000","last_undegraded":"2024-01-19T04:16:06.651211+0000","last_fullsized":"2024-01-19T04:16:06.651211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.643098+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:50.643098+0000","last_peered":"2024-01-19T04:15:50.643098+0000","last_clean":"2024-01-19T04:15:50.643098+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:50.643098+0000","last_undegraded":"2024-01-19T04:15:50.643098+0000","last_fullsized":"2024-01-19T04:15:50.643098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084410+0000","last_change":"2024-01-19T04:16:05.794126+0000","last_active":"2024-01-19T04:16:08.084410+0000","last_peered":"2024-01-19T04:16:08.084410+0000","last_clean":"2024-01-19T04:16:08.084410+0000","last_became_active":"2024-01-19T04:16:05.793821+0000","last_became_peered":"2024-01-19T04:16:05.793821+0000","last_unstale":"2024-01-19T04:16:08.084410+0000","last_undegraded":"2024-01-19T04:16:08.084410+0000","last_fullsized":"2024-01-19T04:16:08.084410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085125+0000","last_change":"2024-01-19T04:16:06.654711+0000","last_active":"2024-01-19T04:16:08.085125+0000","last_peered":"2024-01-19T04:16:08.085125+0000","last_clean":"2024-01-19T04:16:08.085125+0000","last_became_active":"2024-01-19T04:16:06.654442+0000","last_became_peered":"2024-01-19T04:16:06.654442+0000","last_unstale":"2024-01-19T04:16:08.085125+0000","last_undegraded":"2024-01-19T04:16:08.085125+0000","last_fullsized":"2024-01-19T04:16:08.085125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:13.662662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638284+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:16:06.638284+0000","last_peered":"2024-01-19T04:16:06.638284+0000","last_clean":"2024-01-19T04:16:06.638284+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:16:06.638284+0000","last_undegraded":"2024-01-19T04:16:06.638284+0000","last_fullsized":"2024-01-19T04:16:06.638284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634955+0000","last_change":"2024-01-19T04:15:49.680184+0000","last_active":"2024-01-19T04:16:06.634955+0000","last_peered":"2024-01-19T04:16:06.634955+0000","last_clean":"2024-01-19T04:16:06.634955+0000","last_became_active":"2024-01-19T04:15:49.679925+0000","last_became_peered":"2024-01-19T04:15:49.679925+0000","last_unstale":"2024-01-19T04:16:06.634955+0000","last_undegraded":"2024-01-19T04:16:06.634955+0000","last_fullsized":"2024-01-19T04:16:06.634955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778700+0000","last_change":"2024-01-19T04:16:04.778700+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778700+0000","last_undegraded":"2024-01-19T04:16:04.778700+0000","last_fullsized":"2024-01-19T04:16:04.778700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084379+0000","last_change":"2024-01-19T04:16:06.651279+0000","last_active":"2024-01-19T04:16:08.084379+0000","last_peered":"2024-01-19T04:16:08.084379+0000","last_clean":"2024-01-19T04:16:08.084379+0000","last_became_active":"2024-01-19T04:16:06.651097+0000","last_became_peered":"2024-01-19T04:16:06.651097+0000","last_unstale":"2024-01-19T04:16:08.084379+0000","last_undegraded":"2024-01-19T04:16:08.084379+0000","last_fullsized":"2024-01-19T04:16:08.084379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:25:40.860239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642266+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:50.642266+0000","last_peered":"2024-01-19T04:15:50.642266+0000","last_clean":"2024-01-19T04:15:50.642266+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:50.642266+0000","last_undegraded":"2024-01-19T04:15:50.642266+0000","last_fullsized":"2024-01-19T04:15:50.642266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277849+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:51.277849+0000","last_peered":"2024-01-19T04:15:51.277849+0000","last_clean":"2024-01-19T04:15:51.277849+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:51.277849+0000","last_undegraded":"2024-01-19T04:15:51.277849+0000","last_fullsized":"2024-01-19T04:15:51.277849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773895+0000","last_change":"2024-01-19T04:16:04.773895+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773895+0000","last_undegraded":"2024-01-19T04:16:04.773895+0000","last_fullsized":"2024-01-19T04:16:04.773895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659412+0000","last_change":"2024-01-19T04:16:06.655628+0000","last_active":"2024-01-19T04:16:06.659412+0000","last_peered":"2024-01-19T04:16:06.659412+0000","last_clean":"2024-01-19T04:16:06.659412+0000","last_became_active":"2024-01-19T04:16:06.653875+0000","last_became_peered":"2024-01-19T04:16:06.653875+0000","last_unstale":"2024-01-19T04:16:06.659412+0000","last_undegraded":"2024-01-19T04:16:06.659412+0000","last_fullsized":"2024-01-19T04:16:06.659412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:14.839980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016010+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:52.016010+0000","last_peered":"2024-01-19T04:15:52.016010+0000","last_clean":"2024-01-19T04:15:52.016010+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:52.016010+0000","last_undegraded":"2024-01-19T04:15:52.016010+0000","last_fullsized":"2024-01-19T04:15:52.016010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634212+0000","last_change":"2024-01-19T04:15:49.660917+0000","last_active":"2024-01-19T04:16:06.634212+0000","last_peered":"2024-01-19T04:16:06.634212+0000","last_clean":"2024-01-19T04:16:06.634212+0000","last_became_active":"2024-01-19T04:15:49.655137+0000","last_became_peered":"2024-01-19T04:15:49.655137+0000","last_unstale":"2024-01-19T04:16:06.634212+0000","last_undegraded":"2024-01-19T04:16:06.634212+0000","last_fullsized":"2024-01-19T04:16:06.634212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:05:00.093326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788476+0000","last_change":"2024-01-19T04:16:05.795319+0000","last_active":"2024-01-19T04:16:06.788476+0000","last_peered":"2024-01-19T04:16:06.788476+0000","last_clean":"2024-01-19T04:16:06.788476+0000","last_became_active":"2024-01-19T04:16:05.794958+0000","last_became_peered":"2024-01-19T04:16:05.794958+0000","last_unstale":"2024-01-19T04:16:06.788476+0000","last_undegraded":"2024-01-19T04:16:06.788476+0000","last_fullsized":"2024-01-19T04:16:06.788476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:55:40.046252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084469+0000","last_change":"2024-01-19T04:16:06.659222+0000","last_active":"2024-01-19T04:16:08.084469+0000","last_peered":"2024-01-19T04:16:08.084469+0000","last_clean":"2024-01-19T04:16:08.084469+0000","last_became_active":"2024-01-19T04:16:06.657419+0000","last_became_peered":"2024-01-19T04:16:06.657419+0000","last_unstale":"2024-01-19T04:16:08.084469+0000","last_undegraded":"2024-01-19T04:16:08.084469+0000","last_fullsized":"2024-01-19T04:16:08.084469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:38.868186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393598+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:51.393598+0000","last_peered":"2024-01-19T04:15:51.393598+0000","last_clean":"2024-01-19T04:15:51.393598+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:51.393598+0000","last_undegraded":"2024-01-19T04:15:51.393598+0000","last_fullsized":"2024-01-19T04:15:51.393598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633993+0000","last_change":"2024-01-19T04:15:49.657920+0000","last_active":"2024-01-19T04:16:06.633993+0000","last_peered":"2024-01-19T04:16:06.633993+0000","last_clean":"2024-01-19T04:16:06.633993+0000","last_became_active":"2024-01-19T04:15:49.657332+0000","last_became_peered":"2024-01-19T04:15:49.657332+0000","last_unstale":"2024-01-19T04:16:06.633993+0000","last_undegraded":"2024-01-19T04:16:06.633993+0000","last_fullsized":"2024-01-19T04:16:06.633993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:10.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778562+0000","last_change":"2024-01-19T04:16:04.778562+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778562+0000","last_undegraded":"2024-01-19T04:16:04.778562+0000","last_fullsized":"2024-01-19T04:16:04.778562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635132+0000","last_change":"2024-01-19T04:16:06.653073+0000","last_active":"2024-01-19T04:16:07.635132+0000","last_peered":"2024-01-19T04:16:07.635132+0000","last_clean":"2024-01-19T04:16:07.635132+0000","last_became_active":"2024-01-19T04:16:06.652783+0000","last_became_peered":"2024-01-19T04:16:06.652783+0000","last_unstale":"2024-01-19T04:16:07.635132+0000","last_undegraded":"2024-01-19T04:16:07.635132+0000","last_fullsized":"2024-01-19T04:16:07.635132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:43.230089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650249+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:16:06.650249+0000","last_peered":"2024-01-19T04:16:06.650249+0000","last_clean":"2024-01-19T04:16:06.650249+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:16:06.650249+0000","last_undegraded":"2024-01-19T04:16:06.650249+0000","last_fullsized":"2024-01-19T04:16:06.650249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633575+0000","last_change":"2024-01-19T04:15:49.669616+0000","last_active":"2024-01-19T04:16:06.633575+0000","last_peered":"2024-01-19T04:16:06.633575+0000","last_clean":"2024-01-19T04:16:06.633575+0000","last_became_active":"2024-01-19T04:15:49.667904+0000","last_became_peered":"2024-01-19T04:15:49.667904+0000","last_unstale":"2024-01-19T04:16:06.633575+0000","last_undegraded":"2024-01-19T04:16:06.633575+0000","last_fullsized":"2024-01-19T04:16:06.633575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:52.911948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084542+0000","last_change":"2024-01-19T04:16:05.797377+0000","last_active":"2024-01-19T04:16:08.084542+0000","last_peered":"2024-01-19T04:16:08.084542+0000","last_clean":"2024-01-19T04:16:08.084542+0000","last_became_active":"2024-01-19T04:16:05.797125+0000","last_became_peered":"2024-01-19T04:16:05.797125+0000","last_unstale":"2024-01-19T04:16:08.084542+0000","last_undegraded":"2024-01-19T04:16:08.084542+0000","last_fullsized":"2024-01-19T04:16:08.084542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086033+0000","last_change":"2024-01-19T04:16:06.651033+0000","last_active":"2024-01-19T04:16:08.086033+0000","last_peered":"2024-01-19T04:16:08.086033+0000","last_clean":"2024-01-19T04:16:08.086033+0000","last_became_active":"2024-01-19T04:16:06.650744+0000","last_became_peered":"2024-01-19T04:16:06.650744+0000","last_unstale":"2024-01-19T04:16:08.086033+0000","last_undegraded":"2024-01-19T04:16:08.086033+0000","last_fullsized":"2024-01-19T04:16:08.086033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:35:34.310303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016361+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:52.016361+0000","last_peered":"2024-01-19T04:15:52.016361+0000","last_clean":"2024-01-19T04:15:52.016361+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:52.016361+0000","last_undegraded":"2024-01-19T04:15:52.016361+0000","last_fullsized":"2024-01-19T04:15:52.016361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634096+0000","last_change":"2024-01-19T04:15:49.658348+0000","last_active":"2024-01-19T04:16:06.634096+0000","last_peered":"2024-01-19T04:16:06.634096+0000","last_clean":"2024-01-19T04:16:06.634096+0000","last_became_active":"2024-01-19T04:15:49.656971+0000","last_became_peered":"2024-01-19T04:15:49.656971+0000","last_unstale":"2024-01-19T04:16:06.634096+0000","last_undegraded":"2024-01-19T04:16:06.634096+0000","last_fullsized":"2024-01-19T04:16:06.634096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.780866+0000","last_change":"2024-01-19T04:16:04.780866+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.780866+0000","last_undegraded":"2024-01-19T04:16:04.780866+0000","last_fullsized":"2024-01-19T04:16:04.780866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635915+0000","last_change":"2024-01-19T04:16:06.648241+0000","last_active":"2024-01-19T04:16:07.635915+0000","last_peered":"2024-01-19T04:16:07.635915+0000","last_clean":"2024-01-19T04:16:07.635915+0000","last_became_active":"2024-01-19T04:16:06.647911+0000","last_became_peered":"2024-01-19T04:16:06.647911+0000","last_unstale":"2024-01-19T04:16:07.635915+0000","last_undegraded":"2024-01-19T04:16:07.635915+0000","last_fullsized":"2024-01-19T04:16:07.635915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:32.886100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016424+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:52.016424+0000","last_peered":"2024-01-19T04:15:52.016424+0000","last_clean":"2024-01-19T04:15:52.016424+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:52.016424+0000","last_undegraded":"2024-01-19T04:15:52.016424+0000","last_fullsized":"2024-01-19T04:15:52.016424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638798+0000","last_change":"2024-01-19T04:15:49.667350+0000","last_active":"2024-01-19T04:16:06.638798+0000","last_peered":"2024-01-19T04:16:06.638798+0000","last_clean":"2024-01-19T04:16:06.638798+0000","last_became_active":"2024-01-19T04:15:49.666589+0000","last_became_peered":"2024-01-19T04:15:49.666589+0000","last_unstale":"2024-01-19T04:16:06.638798+0000","last_undegraded":"2024-01-19T04:16:06.638798+0000","last_fullsized":"2024-01-19T04:16:06.638798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.636015+0000","last_change":"2024-01-19T04:16:05.790679+0000","last_active":"2024-01-19T04:16:07.636015+0000","last_peered":"2024-01-19T04:16:07.636015+0000","last_clean":"2024-01-19T04:16:07.636015+0000","last_became_active":"2024-01-19T04:16:05.790399+0000","last_became_peered":"2024-01-19T04:16:05.790399+0000","last_unstale":"2024-01-19T04:16:07.636015+0000","last_undegraded":"2024-01-19T04:16:07.636015+0000","last_fullsized":"2024-01-19T04:16:07.636015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:02.428657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016450+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:52.016450+0000","last_peered":"2024-01-19T04:15:52.016450+0000","last_clean":"2024-01-19T04:15:52.016450+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:52.016450+0000","last_undegraded":"2024-01-19T04:15:52.016450+0000","last_fullsized":"2024-01-19T04:15:52.016450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.643003+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:50.643003+0000","last_peered":"2024-01-19T04:15:50.643003+0000","last_clean":"2024-01-19T04:15:50.643003+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:50.643003+0000","last_undegraded":"2024-01-19T04:15:50.643003+0000","last_fullsized":"2024-01-19T04:15:50.643003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638696+0000","last_change":"2024-01-19T04:16:05.794503+0000","last_active":"2024-01-19T04:16:06.638696+0000","last_peered":"2024-01-19T04:16:06.638696+0000","last_clean":"2024-01-19T04:16:06.638696+0000","last_became_active":"2024-01-19T04:16:05.794177+0000","last_became_peered":"2024-01-19T04:16:05.794177+0000","last_unstale":"2024-01-19T04:16:06.638696+0000","last_undegraded":"2024-01-19T04:16:06.638696+0000","last_fullsized":"2024-01-19T04:16:06.638696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:09.555530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638194+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:16:06.638194+0000","last_peered":"2024-01-19T04:16:06.638194+0000","last_clean":"2024-01-19T04:16:06.638194+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:16:06.638194+0000","last_undegraded":"2024-01-19T04:16:06.638194+0000","last_fullsized":"2024-01-19T04:16:06.638194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016492+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:52.016492+0000","last_peered":"2024-01-19T04:15:52.016492+0000","last_clean":"2024-01-19T04:15:52.016492+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:52.016492+0000","last_undegraded":"2024-01-19T04:15:52.016492+0000","last_fullsized":"2024-01-19T04:15:52.016492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773997+0000","last_change":"2024-01-19T04:16:04.773997+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773997+0000","last_undegraded":"2024-01-19T04:16:04.773997+0000","last_fullsized":"2024-01-19T04:16:04.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086001+0000","last_change":"2024-01-19T04:16:06.663428+0000","last_active":"2024-01-19T04:16:08.086001+0000","last_peered":"2024-01-19T04:16:08.086001+0000","last_clean":"2024-01-19T04:16:08.086001+0000","last_became_active":"2024-01-19T04:16:06.662844+0000","last_became_peered":"2024-01-19T04:16:06.662844+0000","last_unstale":"2024-01-19T04:16:08.086001+0000","last_undegraded":"2024-01-19T04:16:08.086001+0000","last_fullsized":"2024-01-19T04:16:08.086001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:20.839193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788478+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:16:05.788478+0000","last_peered":"2024-01-19T04:16:05.788478+0000","last_clean":"2024-01-19T04:16:05.788478+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:16:05.788478+0000","last_undegraded":"2024-01-19T04:16:05.788478+0000","last_fullsized":"2024-01-19T04:16:05.788478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393658+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:51.393658+0000","last_peered":"2024-01-19T04:15:51.393658+0000","last_clean":"2024-01-19T04:15:51.393658+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:51.393658+0000","last_undegraded":"2024-01-19T04:15:51.393658+0000","last_fullsized":"2024-01-19T04:15:51.393658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778609+0000","last_change":"2024-01-19T04:16:04.778609+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778609+0000","last_undegraded":"2024-01-19T04:16:04.778609+0000","last_fullsized":"2024-01-19T04:16:04.778609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788470+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:16:05.788470+0000","last_peered":"2024-01-19T04:16:05.788470+0000","last_clean":"2024-01-19T04:16:05.788470+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:16:05.788470+0000","last_undegraded":"2024-01-19T04:16:05.788470+0000","last_fullsized":"2024-01-19T04:16:05.788470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277930+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:51.277930+0000","last_peered":"2024-01-19T04:15:51.277930+0000","last_clean":"2024-01-19T04:15:51.277930+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:51.277930+0000","last_undegraded":"2024-01-19T04:15:51.277930+0000","last_fullsized":"2024-01-19T04:15:51.277930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786740+0000","last_change":"2024-01-19T04:16:05.799883+0000","last_active":"2024-01-19T04:16:06.786740+0000","last_peered":"2024-01-19T04:16:06.786740+0000","last_clean":"2024-01-19T04:16:06.786740+0000","last_became_active":"2024-01-19T04:16:05.799581+0000","last_became_peered":"2024-01-19T04:16:05.799581+0000","last_unstale":"2024-01-19T04:16:06.786740+0000","last_undegraded":"2024-01-19T04:16:06.786740+0000","last_fullsized":"2024-01-19T04:16:06.786740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:55.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637532+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:16:06.637532+0000","last_peered":"2024-01-19T04:16:06.637532+0000","last_clean":"2024-01-19T04:16:06.637532+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:16:06.637532+0000","last_undegraded":"2024-01-19T04:16:06.637532+0000","last_fullsized":"2024-01-19T04:16:06.637532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790869+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:16:05.790869+0000","last_peered":"2024-01-19T04:16:05.790869+0000","last_clean":"2024-01-19T04:16:05.790869+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:16:05.790869+0000","last_undegraded":"2024-01-19T04:16:05.790869+0000","last_fullsized":"2024-01-19T04:16:05.790869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084369+0000","last_change":"2024-01-19T04:16:05.794058+0000","last_active":"2024-01-19T04:16:08.084369+0000","last_peered":"2024-01-19T04:16:08.084369+0000","last_clean":"2024-01-19T04:16:08.084369+0000","last_became_active":"2024-01-19T04:16:05.793542+0000","last_became_peered":"2024-01-19T04:16:05.793542+0000","last_unstale":"2024-01-19T04:16:08.084369+0000","last_undegraded":"2024-01-19T04:16:08.084369+0000","last_fullsized":"2024-01-19T04:16:08.084369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:08.794314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650910+0000","last_change":"2024-01-19T04:16:06.648682+0000","last_active":"2024-01-19T04:16:06.650910+0000","last_peered":"2024-01-19T04:16:06.650910+0000","last_clean":"2024-01-19T04:16:06.650910+0000","last_became_active":"2024-01-19T04:16:06.646754+0000","last_became_peered":"2024-01-19T04:16:06.646754+0000","last_unstale":"2024-01-19T04:16:06.650910+0000","last_undegraded":"2024-01-19T04:16:06.650910+0000","last_fullsized":"2024-01-19T04:16:06.650910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:35:59.042987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016417+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:52.016417+0000","last_peered":"2024-01-19T04:15:52.016417+0000","last_clean":"2024-01-19T04:15:52.016417+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:52.016417+0000","last_undegraded":"2024-01-19T04:15:52.016417+0000","last_fullsized":"2024-01-19T04:15:52.016417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637399+0000","last_change":"2024-01-19T04:15:49.665258+0000","last_active":"2024-01-19T04:16:06.637399+0000","last_peered":"2024-01-19T04:16:06.637399+0000","last_clean":"2024-01-19T04:16:06.637399+0000","last_became_active":"2024-01-19T04:15:49.664987+0000","last_became_peered":"2024-01-19T04:15:49.664987+0000","last_unstale":"2024-01-19T04:16:06.637399+0000","last_undegraded":"2024-01-19T04:16:06.637399+0000","last_fullsized":"2024-01-19T04:16:06.637399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637230+0000","last_change":"2024-01-19T04:16:05.799441+0000","last_active":"2024-01-19T04:16:06.637230+0000","last_peered":"2024-01-19T04:16:06.637230+0000","last_clean":"2024-01-19T04:16:06.637230+0000","last_became_active":"2024-01-19T04:16:05.799063+0000","last_became_peered":"2024-01-19T04:16:05.799063+0000","last_unstale":"2024-01-19T04:16:06.637230+0000","last_undegraded":"2024-01-19T04:16:06.637230+0000","last_fullsized":"2024-01-19T04:16:06.637230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:59:19.597563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"35'9","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791453+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:16:05.791453+0000","last_peered":"2024-01-19T04:16:05.791453+0000","last_clean":"2024-01-19T04:16:05.791453+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:16:05.791453+0000","last_undegraded":"2024-01-19T04:16:05.791453+0000","last_fullsized":"2024-01-19T04:16:05.791453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642801+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:50.642801+0000","last_peered":"2024-01-19T04:15:50.642801+0000","last_clean":"2024-01-19T04:15:50.642801+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:50.642801+0000","last_undegraded":"2024-01-19T04:15:50.642801+0000","last_fullsized":"2024-01-19T04:15:50.642801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086587+0000","last_change":"2024-01-19T04:16:05.801624+0000","last_active":"2024-01-19T04:16:08.086587+0000","last_peered":"2024-01-19T04:16:08.086587+0000","last_clean":"2024-01-19T04:16:08.086587+0000","last_became_active":"2024-01-19T04:16:05.801315+0000","last_became_peered":"2024-01-19T04:16:05.801315+0000","last_unstale":"2024-01-19T04:16:08.086587+0000","last_undegraded":"2024-01-19T04:16:08.086587+0000","last_fullsized":"2024-01-19T04:16:08.086587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642896+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:50.642896+0000","last_peered":"2024-01-19T04:15:50.642896+0000","last_clean":"2024-01-19T04:15:50.642896+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:50.642896+0000","last_undegraded":"2024-01-19T04:15:50.642896+0000","last_fullsized":"2024-01-19T04:15:50.642896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791301+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:16:05.791301+0000","last_peered":"2024-01-19T04:16:05.791301+0000","last_clean":"2024-01-19T04:16:05.791301+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:16:05.791301+0000","last_undegraded":"2024-01-19T04:16:05.791301+0000","last_fullsized":"2024-01-19T04:16:05.791301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779249+0000","last_change":"2024-01-19T04:16:04.779249+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779249+0000","last_undegraded":"2024-01-19T04:16:04.779249+0000","last_fullsized":"2024-01-19T04:16:04.779249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651137+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:16:06.651137+0000","last_peered":"2024-01-19T04:16:06.651137+0000","last_clean":"2024-01-19T04:16:06.651137+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:16:06.651137+0000","last_undegraded":"2024-01-19T04:16:06.651137+0000","last_fullsized":"2024-01-19T04:16:06.651137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793074+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:16:05.793074+0000","last_peered":"2024-01-19T04:16:05.793074+0000","last_clean":"2024-01-19T04:16:05.793074+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:16:05.793074+0000","last_undegraded":"2024-01-19T04:16:05.793074+0000","last_fullsized":"2024-01-19T04:16:05.793074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635828+0000","last_change":"2024-01-19T04:16:05.789419+0000","last_active":"2024-01-19T04:16:07.635828+0000","last_peered":"2024-01-19T04:16:07.635828+0000","last_clean":"2024-01-19T04:16:07.635828+0000","last_became_active":"2024-01-19T04:16:05.782405+0000","last_became_peered":"2024-01-19T04:16:05.782405+0000","last_unstale":"2024-01-19T04:16:07.635828+0000","last_undegraded":"2024-01-19T04:16:07.635828+0000","last_fullsized":"2024-01-19T04:16:07.635828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:43:13.226181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658899+0000","last_change":"2024-01-19T04:16:06.653820+0000","last_active":"2024-01-19T04:16:06.658899+0000","last_peered":"2024-01-19T04:16:06.658899+0000","last_clean":"2024-01-19T04:16:06.658899+0000","last_became_active":"2024-01-19T04:16:06.653551+0000","last_became_peered":"2024-01-19T04:16:06.653551+0000","last_unstale":"2024-01-19T04:16:06.658899+0000","last_undegraded":"2024-01-19T04:16:06.658899+0000","last_fullsized":"2024-01-19T04:16:06.658899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:28.058495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793160+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:16:05.793160+0000","last_peered":"2024-01-19T04:16:05.793160+0000","last_clean":"2024-01-19T04:16:05.793160+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:16:05.793160+0000","last_undegraded":"2024-01-19T04:16:05.793160+0000","last_fullsized":"2024-01-19T04:16:05.793160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642933+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:50.642933+0000","last_peered":"2024-01-19T04:15:50.642933+0000","last_clean":"2024-01-19T04:15:50.642933+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:50.642933+0000","last_undegraded":"2024-01-19T04:15:50.642933+0000","last_fullsized":"2024-01-19T04:15:50.642933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779187+0000","last_change":"2024-01-19T04:16:04.779187+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779187+0000","last_undegraded":"2024-01-19T04:16:04.779187+0000","last_fullsized":"2024-01-19T04:16:04.779187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085783+0000","last_change":"2024-01-19T04:16:06.656144+0000","last_active":"2024-01-19T04:16:08.085783+0000","last_peered":"2024-01-19T04:16:08.085783+0000","last_clean":"2024-01-19T04:16:08.085783+0000","last_became_active":"2024-01-19T04:16:06.655863+0000","last_became_peered":"2024-01-19T04:16:06.655863+0000","last_unstale":"2024-01-19T04:16:08.085783+0000","last_undegraded":"2024-01-19T04:16:08.085783+0000","last_fullsized":"2024-01-19T04:16:08.085783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:01:51.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015882+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:52.015882+0000","last_peered":"2024-01-19T04:15:52.015882+0000","last_clean":"2024-01-19T04:15:52.015882+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:52.015882+0000","last_undegraded":"2024-01-19T04:15:52.015882+0000","last_fullsized":"2024-01-19T04:15:52.015882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637132+0000","last_change":"2024-01-19T04:15:49.668312+0000","last_active":"2024-01-19T04:16:06.637132+0000","last_peered":"2024-01-19T04:16:06.637132+0000","last_clean":"2024-01-19T04:16:06.637132+0000","last_became_active":"2024-01-19T04:15:49.664719+0000","last_became_peered":"2024-01-19T04:15:49.664719+0000","last_unstale":"2024-01-19T04:16:06.637132+0000","last_undegraded":"2024-01-19T04:16:06.637132+0000","last_fullsized":"2024-01-19T04:16:06.637132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779700+0000","last_change":"2024-01-19T04:16:04.779700+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779700+0000","last_undegraded":"2024-01-19T04:16:04.779700+0000","last_fullsized":"2024-01-19T04:16:04.779700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788364+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:16:05.788364+0000","last_peered":"2024-01-19T04:16:05.788364+0000","last_clean":"2024-01-19T04:16:05.788364+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:16:05.788364+0000","last_undegraded":"2024-01-19T04:16:05.788364+0000","last_fullsized":"2024-01-19T04:16:05.788364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015917+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:52.015917+0000","last_peered":"2024-01-19T04:15:52.015917+0000","last_clean":"2024-01-19T04:15:52.015917+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:52.015917+0000","last_undegraded":"2024-01-19T04:15:52.015917+0000","last_fullsized":"2024-01-19T04:15:52.015917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788356+0000","last_change":"2024-01-19T04:16:05.799707+0000","last_active":"2024-01-19T04:16:06.788356+0000","last_peered":"2024-01-19T04:16:06.788356+0000","last_clean":"2024-01-19T04:16:06.788356+0000","last_became_active":"2024-01-19T04:16:05.799464+0000","last_became_peered":"2024-01-19T04:16:05.799464+0000","last_unstale":"2024-01-19T04:16:06.788356+0000","last_undegraded":"2024-01-19T04:16:06.788356+0000","last_fullsized":"2024-01-19T04:16:06.788356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:17:34.865737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016130+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:52.016130+0000","last_peered":"2024-01-19T04:15:52.016130+0000","last_clean":"2024-01-19T04:15:52.016130+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:52.016130+0000","last_undegraded":"2024-01-19T04:15:52.016130+0000","last_fullsized":"2024-01-19T04:15:52.016130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642393+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:50.642393+0000","last_peered":"2024-01-19T04:15:50.642393+0000","last_clean":"2024-01-19T04:15:50.642393+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:50.642393+0000","last_undegraded":"2024-01-19T04:15:50.642393+0000","last_fullsized":"2024-01-19T04:15:50.642393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084277+0000","last_change":"2024-01-19T04:16:05.798704+0000","last_active":"2024-01-19T04:16:08.084277+0000","last_peered":"2024-01-19T04:16:08.084277+0000","last_clean":"2024-01-19T04:16:08.084277+0000","last_became_active":"2024-01-19T04:16:05.798256+0000","last_became_peered":"2024-01-19T04:16:05.798256+0000","last_unstale":"2024-01-19T04:16:08.084277+0000","last_undegraded":"2024-01-19T04:16:08.084277+0000","last_fullsized":"2024-01-19T04:16:08.084277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.003940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084191+0000","last_change":"2024-01-19T04:16:06.661878+0000","last_active":"2024-01-19T04:16:08.084191+0000","last_peered":"2024-01-19T04:16:08.084191+0000","last_clean":"2024-01-19T04:16:08.084191+0000","last_became_active":"2024-01-19T04:16:06.661120+0000","last_became_peered":"2024-01-19T04:16:06.661120+0000","last_unstale":"2024-01-19T04:16:08.084191+0000","last_undegraded":"2024-01-19T04:16:08.084191+0000","last_fullsized":"2024-01-19T04:16:08.084191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:54.194344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016389+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:52.016389+0000","last_peered":"2024-01-19T04:15:52.016389+0000","last_clean":"2024-01-19T04:15:52.016389+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:52.016389+0000","last_undegraded":"2024-01-19T04:15:52.016389+0000","last_fullsized":"2024-01-19T04:15:52.016389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278193+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:51.278193+0000","last_peered":"2024-01-19T04:15:51.278193+0000","last_clean":"2024-01-19T04:15:51.278193+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:51.278193+0000","last_undegraded":"2024-01-19T04:15:51.278193+0000","last_fullsized":"2024-01-19T04:15:51.278193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773970+0000","last_change":"2024-01-19T04:16:04.773970+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773970+0000","last_undegraded":"2024-01-19T04:16:04.773970+0000","last_fullsized":"2024-01-19T04:16:04.773970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.780313+0000","last_change":"2024-01-19T04:16:04.780313+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.780313+0000","last_undegraded":"2024-01-19T04:16:04.780313+0000","last_fullsized":"2024-01-19T04:16:04.780313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.635048+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:16:06.635048+0000","last_peered":"2024-01-19T04:16:06.635048+0000","last_clean":"2024-01-19T04:16:06.635048+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:16:06.635048+0000","last_undegraded":"2024-01-19T04:16:06.635048+0000","last_fullsized":"2024-01-19T04:16:06.635048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:02.358517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641737+0000","last_change":"2024-01-19T04:15:49.671511+0000","last_active":"2024-01-19T04:16:06.641737+0000","last_peered":"2024-01-19T04:16:06.641737+0000","last_clean":"2024-01-19T04:16:06.641737+0000","last_became_active":"2024-01-19T04:15:49.670975+0000","last_became_peered":"2024-01-19T04:15:49.670975+0000","last_unstale":"2024-01-19T04:16:06.641737+0000","last_undegraded":"2024-01-19T04:16:06.641737+0000","last_fullsized":"2024-01-19T04:16:06.641737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086005+0000","last_change":"2024-01-19T04:16:06.645758+0000","last_active":"2024-01-19T04:16:08.086005+0000","last_peered":"2024-01-19T04:16:08.086005+0000","last_clean":"2024-01-19T04:16:08.086005+0000","last_became_active":"2024-01-19T04:16:06.645496+0000","last_became_peered":"2024-01-19T04:16:06.645496+0000","last_unstale":"2024-01-19T04:16:08.086005+0000","last_undegraded":"2024-01-19T04:16:08.086005+0000","last_fullsized":"2024-01-19T04:16:08.086005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:25.718378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786188+0000","last_change":"2024-01-19T04:16:05.792100+0000","last_active":"2024-01-19T04:16:06.786188+0000","last_peered":"2024-01-19T04:16:06.786188+0000","last_clean":"2024-01-19T04:16:06.786188+0000","last_became_active":"2024-01-19T04:16:05.791821+0000","last_became_peered":"2024-01-19T04:16:05.791821+0000","last_unstale":"2024-01-19T04:16:06.786188+0000","last_undegraded":"2024-01-19T04:16:06.786188+0000","last_fullsized":"2024-01-19T04:16:06.786188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:12:26.677056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791504+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:16:05.791504+0000","last_peered":"2024-01-19T04:16:05.791504+0000","last_clean":"2024-01-19T04:16:05.791504+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:16:05.791504+0000","last_undegraded":"2024-01-19T04:16:05.791504+0000","last_fullsized":"2024-01-19T04:16:05.791504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016381+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:52.016381+0000","last_peered":"2024-01-19T04:15:52.016381+0000","last_clean":"2024-01-19T04:15:52.016381+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:52.016381+0000","last_undegraded":"2024-01-19T04:15:52.016381+0000","last_fullsized":"2024-01-19T04:15:52.016381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084960+0000","last_change":"2024-01-19T04:16:06.653044+0000","last_active":"2024-01-19T04:16:08.084960+0000","last_peered":"2024-01-19T04:16:08.084960+0000","last_clean":"2024-01-19T04:16:08.084960+0000","last_became_active":"2024-01-19T04:16:06.652723+0000","last_became_peered":"2024-01-19T04:16:06.652723+0000","last_unstale":"2024-01-19T04:16:08.084960+0000","last_undegraded":"2024-01-19T04:16:08.084960+0000","last_fullsized":"2024-01-19T04:16:08.084960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:59.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651297+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:16:06.651297+0000","last_peered":"2024-01-19T04:16:06.651297+0000","last_clean":"2024-01-19T04:16:06.651297+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:16:06.651297+0000","last_undegraded":"2024-01-19T04:16:06.651297+0000","last_fullsized":"2024-01-19T04:16:06.651297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393693+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:51.393693+0000","last_peered":"2024-01-19T04:15:51.393693+0000","last_clean":"2024-01-19T04:15:51.393693+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:51.393693+0000","last_undegraded":"2024-01-19T04:15:51.393693+0000","last_fullsized":"2024-01-19T04:15:51.393693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778666+0000","last_change":"2024-01-19T04:16:04.778666+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778666+0000","last_undegraded":"2024-01-19T04:16:04.778666+0000","last_fullsized":"2024-01-19T04:16:04.778666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393719+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:51.393719+0000","last_peered":"2024-01-19T04:15:51.393719+0000","last_clean":"2024-01-19T04:15:51.393719+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:51.393719+0000","last_undegraded":"2024-01-19T04:15:51.393719+0000","last_fullsized":"2024-01-19T04:15:51.393719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651043+0000","last_change":"2024-01-19T04:15:49.650645+0000","last_active":"2024-01-19T04:16:06.651043+0000","last_peered":"2024-01-19T04:16:06.651043+0000","last_clean":"2024-01-19T04:16:06.651043+0000","last_became_active":"2024-01-19T04:15:49.650331+0000","last_became_peered":"2024-01-19T04:15:49.650331+0000","last_unstale":"2024-01-19T04:16:06.651043+0000","last_undegraded":"2024-01-19T04:16:06.651043+0000","last_fullsized":"2024-01-19T04:16:06.651043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085276+0000","last_change":"2024-01-19T04:16:05.791836+0000","last_active":"2024-01-19T04:16:08.085276+0000","last_peered":"2024-01-19T04:16:08.085276+0000","last_clean":"2024-01-19T04:16:08.085276+0000","last_became_active":"2024-01-19T04:16:05.791582+0000","last_became_peered":"2024-01-19T04:16:05.791582+0000","last_unstale":"2024-01-19T04:16:08.085276+0000","last_undegraded":"2024-01-19T04:16:08.085276+0000","last_fullsized":"2024-01-19T04:16:08.085276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277780+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:51.277780+0000","last_peered":"2024-01-19T04:15:51.277780+0000","last_clean":"2024-01-19T04:15:51.277780+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:51.277780+0000","last_undegraded":"2024-01-19T04:15:51.277780+0000","last_fullsized":"2024-01-19T04:15:51.277780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393567+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:51.393567+0000","last_peered":"2024-01-19T04:15:51.393567+0000","last_clean":"2024-01-19T04:15:51.393567+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:51.393567+0000","last_undegraded":"2024-01-19T04:15:51.393567+0000","last_fullsized":"2024-01-19T04:15:51.393567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635281+0000","last_change":"2024-01-19T04:16:06.644115+0000","last_active":"2024-01-19T04:16:07.635281+0000","last_peered":"2024-01-19T04:16:07.635281+0000","last_clean":"2024-01-19T04:16:07.635281+0000","last_became_active":"2024-01-19T04:16:06.643807+0000","last_became_peered":"2024-01-19T04:16:06.643807+0000","last_unstale":"2024-01-19T04:16:07.635281+0000","last_undegraded":"2024-01-19T04:16:07.635281+0000","last_fullsized":"2024-01-19T04:16:07.635281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:20.211567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278402+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:51.278402+0000","last_peered":"2024-01-19T04:15:51.278402+0000","last_clean":"2024-01-19T04:15:51.278402+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:51.278402+0000","last_undegraded":"2024-01-19T04:15:51.278402+0000","last_fullsized":"2024-01-19T04:15:51.278402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.648071+0000","last_change":"2024-01-19T04:16:06.645593+0000","last_active":"2024-01-19T04:16:06.648071+0000","last_peered":"2024-01-19T04:16:06.648071+0000","last_clean":"2024-01-19T04:16:06.648071+0000","last_became_active":"2024-01-19T04:16:06.645250+0000","last_became_peered":"2024-01-19T04:16:06.645250+0000","last_unstale":"2024-01-19T04:16:06.648071+0000","last_undegraded":"2024-01-19T04:16:06.648071+0000","last_fullsized":"2024-01-19T04:16:06.648071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:11:20.809247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016256+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:52.016256+0000","last_peered":"2024-01-19T04:15:52.016256+0000","last_clean":"2024-01-19T04:15:52.016256+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:52.016256+0000","last_undegraded":"2024-01-19T04:15:52.016256+0000","last_fullsized":"2024-01-19T04:15:52.016256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635962+0000","last_change":"2024-01-19T04:16:06.642681+0000","last_active":"2024-01-19T04:16:07.635962+0000","last_peered":"2024-01-19T04:16:07.635962+0000","last_clean":"2024-01-19T04:16:07.635962+0000","last_became_active":"2024-01-19T04:16:06.642382+0000","last_became_peered":"2024-01-19T04:16:06.642382+0000","last_unstale":"2024-01-19T04:16:07.635962+0000","last_undegraded":"2024-01-19T04:16:07.635962+0000","last_fullsized":"2024-01-19T04:16:07.635962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:47.006272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642785+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:50.642785+0000","last_peered":"2024-01-19T04:15:50.642785+0000","last_clean":"2024-01-19T04:15:50.642785+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:50.642785+0000","last_undegraded":"2024-01-19T04:15:50.642785+0000","last_fullsized":"2024-01-19T04:15:50.642785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641820+0000","last_change":"2024-01-19T04:15:49.672729+0000","last_active":"2024-01-19T04:16:06.641820+0000","last_peered":"2024-01-19T04:16:06.641820+0000","last_clean":"2024-01-19T04:16:06.641820+0000","last_became_active":"2024-01-19T04:15:49.672195+0000","last_became_peered":"2024-01-19T04:15:49.672195+0000","last_unstale":"2024-01-19T04:16:06.641820+0000","last_undegraded":"2024-01-19T04:16:06.641820+0000","last_fullsized":"2024-01-19T04:16:06.641820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793119+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:16:05.793119+0000","last_peered":"2024-01-19T04:16:05.793119+0000","last_clean":"2024-01-19T04:16:05.793119+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:16:05.793119+0000","last_undegraded":"2024-01-19T04:16:05.793119+0000","last_fullsized":"2024-01-19T04:16:05.793119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638035+0000","last_change":"2024-01-19T04:15:49.655156+0000","last_active":"2024-01-19T04:16:06.638035+0000","last_peered":"2024-01-19T04:16:06.638035+0000","last_clean":"2024-01-19T04:16:06.638035+0000","last_became_active":"2024-01-19T04:15:49.651743+0000","last_became_peered":"2024-01-19T04:15:49.651743+0000","last_unstale":"2024-01-19T04:16:06.638035+0000","last_undegraded":"2024-01-19T04:16:06.638035+0000","last_fullsized":"2024-01-19T04:16:06.638035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085040+0000","last_change":"2024-01-19T04:16:06.653368+0000","last_active":"2024-01-19T04:16:08.085040+0000","last_peered":"2024-01-19T04:16:08.085040+0000","last_clean":"2024-01-19T04:16:08.085040+0000","last_became_active":"2024-01-19T04:16:06.653083+0000","last_became_peered":"2024-01-19T04:16:06.653083+0000","last_unstale":"2024-01-19T04:16:08.085040+0000","last_undegraded":"2024-01-19T04:16:08.085040+0000","last_fullsized":"2024-01-19T04:16:08.085040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:48.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642352+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:50.642352+0000","last_peered":"2024-01-19T04:15:50.642352+0000","last_clean":"2024-01-19T04:15:50.642352+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:50.642352+0000","last_undegraded":"2024-01-19T04:15:50.642352+0000","last_fullsized":"2024-01-19T04:15:50.642352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659402+0000","last_change":"2024-01-19T04:16:06.655369+0000","last_active":"2024-01-19T04:16:06.659402+0000","last_peered":"2024-01-19T04:16:06.659402+0000","last_clean":"2024-01-19T04:16:06.659402+0000","last_became_active":"2024-01-19T04:16:06.655053+0000","last_became_peered":"2024-01-19T04:16:06.655053+0000","last_unstale":"2024-01-19T04:16:06.659402+0000","last_undegraded":"2024-01-19T04:16:06.659402+0000","last_fullsized":"2024-01-19T04:16:06.659402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:15.541954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.649648+0000","last_change":"2024-01-19T04:15:49.645143+0000","last_active":"2024-01-19T04:16:06.649648+0000","last_peered":"2024-01-19T04:16:06.649648+0000","last_clean":"2024-01-19T04:16:06.649648+0000","last_became_active":"2024-01-19T04:15:49.644879+0000","last_became_peered":"2024-01-19T04:15:49.644879+0000","last_unstale":"2024-01-19T04:16:06.649648+0000","last_undegraded":"2024-01-19T04:16:06.649648+0000","last_fullsized":"2024-01-19T04:16:06.649648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016274+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:52.016274+0000","last_peered":"2024-01-19T04:15:52.016274+0000","last_clean":"2024-01-19T04:15:52.016274+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:52.016274+0000","last_undegraded":"2024-01-19T04:15:52.016274+0000","last_fullsized":"2024-01-19T04:15:52.016274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016180+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:52.016180+0000","last_peered":"2024-01-19T04:15:52.016180+0000","last_clean":"2024-01-19T04:15:52.016180+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:52.016180+0000","last_undegraded":"2024-01-19T04:15:52.016180+0000","last_fullsized":"2024-01-19T04:15:52.016180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634937+0000","last_change":"2024-01-19T04:15:49.679977+0000","last_active":"2024-01-19T04:16:06.634937+0000","last_peered":"2024-01-19T04:16:06.634937+0000","last_clean":"2024-01-19T04:16:06.634937+0000","last_became_active":"2024-01-19T04:15:49.679706+0000","last_became_peered":"2024-01-19T04:15:49.679706+0000","last_unstale":"2024-01-19T04:16:06.634937+0000","last_undegraded":"2024-01-19T04:16:06.634937+0000","last_fullsized":"2024-01-19T04:16:06.634937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791409+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:16:05.791409+0000","last_peered":"2024-01-19T04:16:05.791409+0000","last_clean":"2024-01-19T04:16:05.791409+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:16:05.791409+0000","last_undegraded":"2024-01-19T04:16:05.791409+0000","last_fullsized":"2024-01-19T04:16:05.791409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635814+0000","last_change":"2024-01-19T04:16:06.656508+0000","last_active":"2024-01-19T04:16:07.635814+0000","last_peered":"2024-01-19T04:16:07.635814+0000","last_clean":"2024-01-19T04:16:07.635814+0000","last_became_active":"2024-01-19T04:16:06.656095+0000","last_became_peered":"2024-01-19T04:16:06.656095+0000","last_unstale":"2024-01-19T04:16:07.635814+0000","last_undegraded":"2024-01-19T04:16:07.635814+0000","last_fullsized":"2024-01-19T04:16:07.635814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:48.953287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793097+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:16:05.793097+0000","last_peered":"2024-01-19T04:16:05.793097+0000","last_clean":"2024-01-19T04:16:05.793097+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:16:05.793097+0000","last_undegraded":"2024-01-19T04:16:05.793097+0000","last_fullsized":"2024-01-19T04:16:05.793097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278301+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:51.278301+0000","last_peered":"2024-01-19T04:15:51.278301+0000","last_clean":"2024-01-19T04:15:51.278301+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:51.278301+0000","last_undegraded":"2024-01-19T04:15:51.278301+0000","last_fullsized":"2024-01-19T04:15:51.278301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084295+0000","last_change":"2024-01-19T04:16:06.658727+0000","last_active":"2024-01-19T04:16:08.084295+0000","last_peered":"2024-01-19T04:16:08.084295+0000","last_clean":"2024-01-19T04:16:08.084295+0000","last_became_active":"2024-01-19T04:16:06.657947+0000","last_became_peered":"2024-01-19T04:16:06.657947+0000","last_unstale":"2024-01-19T04:16:08.084295+0000","last_undegraded":"2024-01-19T04:16:08.084295+0000","last_fullsized":"2024-01-19T04:16:08.084295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:26.441618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278172+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:51.278172+0000","last_peered":"2024-01-19T04:15:51.278172+0000","last_clean":"2024-01-19T04:15:51.278172+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:51.278172+0000","last_undegraded":"2024-01-19T04:15:51.278172+0000","last_fullsized":"2024-01-19T04:15:51.278172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635326+0000","last_change":"2024-01-19T04:16:06.643237+0000","last_active":"2024-01-19T04:16:07.635326+0000","last_peered":"2024-01-19T04:16:07.635326+0000","last_clean":"2024-01-19T04:16:07.635326+0000","last_became_active":"2024-01-19T04:16:06.642898+0000","last_became_peered":"2024-01-19T04:16:06.642898+0000","last_unstale":"2024-01-19T04:16:07.635326+0000","last_undegraded":"2024-01-19T04:16:07.635326+0000","last_fullsized":"2024-01-19T04:16:07.635326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:26.134708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642358+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:50.642358+0000","last_peered":"2024-01-19T04:15:50.642358+0000","last_clean":"2024-01-19T04:15:50.642358+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:50.642358+0000","last_undegraded":"2024-01-19T04:15:50.642358+0000","last_fullsized":"2024-01-19T04:15:50.642358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790125+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:16:05.790125+0000","last_peered":"2024-01-19T04:16:05.790125+0000","last_clean":"2024-01-19T04:16:05.790125+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:16:05.790125+0000","last_undegraded":"2024-01-19T04:16:05.790125+0000","last_fullsized":"2024-01-19T04:16:05.790125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.653729+0000","last_change":"2024-01-19T04:16:06.651408+0000","last_active":"2024-01-19T04:16:06.653729+0000","last_peered":"2024-01-19T04:16:06.653729+0000","last_clean":"2024-01-19T04:16:06.653729+0000","last_became_active":"2024-01-19T04:16:06.651129+0000","last_became_peered":"2024-01-19T04:16:06.651129+0000","last_unstale":"2024-01-19T04:16:06.653729+0000","last_undegraded":"2024-01-19T04:16:06.653729+0000","last_fullsized":"2024-01-19T04:16:06.653729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:27.515777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633913+0000","last_change":"2024-01-19T04:15:49.657109+0000","last_active":"2024-01-19T04:16:06.633913+0000","last_peered":"2024-01-19T04:16:06.633913+0000","last_clean":"2024-01-19T04:16:06.633913+0000","last_became_active":"2024-01-19T04:15:49.656836+0000","last_became_peered":"2024-01-19T04:15:49.656836+0000","last_unstale":"2024-01-19T04:16:06.633913+0000","last_undegraded":"2024-01-19T04:16:06.633913+0000","last_fullsized":"2024-01-19T04:16:06.633913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:41.496335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086508+0000","last_change":"2024-01-19T04:16:06.660525+0000","last_active":"2024-01-19T04:16:08.086508+0000","last_peered":"2024-01-19T04:16:08.086508+0000","last_clean":"2024-01-19T04:16:08.086508+0000","last_became_active":"2024-01-19T04:16:06.659997+0000","last_became_peered":"2024-01-19T04:16:06.659997+0000","last_unstale":"2024-01-19T04:16:08.086508+0000","last_undegraded":"2024-01-19T04:16:08.086508+0000","last_fullsized":"2024-01-19T04:16:08.086508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:02.077588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642725+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:50.642725+0000","last_peered":"2024-01-19T04:15:50.642725+0000","last_clean":"2024-01-19T04:15:50.642725+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:50.642725+0000","last_undegraded":"2024-01-19T04:15:50.642725+0000","last_fullsized":"2024-01-19T04:15:50.642725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085834+0000","last_change":"2024-01-19T04:16:06.658837+0000","last_active":"2024-01-19T04:16:08.085834+0000","last_peered":"2024-01-19T04:16:08.085834+0000","last_clean":"2024-01-19T04:16:08.085834+0000","last_became_active":"2024-01-19T04:16:06.657952+0000","last_became_peered":"2024-01-19T04:16:06.657952+0000","last_unstale":"2024-01-19T04:16:08.085834+0000","last_undegraded":"2024-01-19T04:16:08.085834+0000","last_fullsized":"2024-01-19T04:16:08.085834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:30.123335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278237+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:51.278237+0000","last_peered":"2024-01-19T04:15:51.278237+0000","last_clean":"2024-01-19T04:15:51.278237+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:51.278237+0000","last_undegraded":"2024-01-19T04:15:51.278237+0000","last_fullsized":"2024-01-19T04:15:51.278237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638192+0000","last_change":"2024-01-19T04:15:49.664498+0000","last_active":"2024-01-19T04:16:06.638192+0000","last_peered":"2024-01-19T04:16:06.638192+0000","last_clean":"2024-01-19T04:16:06.638192+0000","last_became_active":"2024-01-19T04:15:49.664196+0000","last_became_peered":"2024-01-19T04:15:49.664196+0000","last_unstale":"2024-01-19T04:16:06.638192+0000","last_undegraded":"2024-01-19T04:16:06.638192+0000","last_fullsized":"2024-01-19T04:16:06.638192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086252+0000","last_change":"2024-01-19T04:16:06.657128+0000","last_active":"2024-01-19T04:16:08.086252+0000","last_peered":"2024-01-19T04:16:08.086252+0000","last_clean":"2024-01-19T04:16:08.086252+0000","last_became_active":"2024-01-19T04:16:06.656850+0000","last_became_peered":"2024-01-19T04:16:06.656850+0000","last_unstale":"2024-01-19T04:16:08.086252+0000","last_undegraded":"2024-01-19T04:16:08.086252+0000","last_fullsized":"2024-01-19T04:16:08.086252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:24:57.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016567+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:52.016567+0000","last_peered":"2024-01-19T04:15:52.016567+0000","last_clean":"2024-01-19T04:15:52.016567+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:52.016567+0000","last_undegraded":"2024-01-19T04:15:52.016567+0000","last_fullsized":"2024-01-19T04:15:52.016567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659051+0000","last_change":"2024-01-19T04:16:06.654727+0000","last_active":"2024-01-19T04:16:06.659051+0000","last_peered":"2024-01-19T04:16:06.659051+0000","last_clean":"2024-01-19T04:16:06.659051+0000","last_became_active":"2024-01-19T04:16:06.654482+0000","last_became_peered":"2024-01-19T04:16:06.654482+0000","last_unstale":"2024-01-19T04:16:06.659051+0000","last_undegraded":"2024-01-19T04:16:06.659051+0000","last_fullsized":"2024-01-19T04:16:06.659051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:52.554202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277738+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:51.277738+0000","last_peered":"2024-01-19T04:15:51.277738+0000","last_clean":"2024-01-19T04:15:51.277738+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:51.277738+0000","last_undegraded":"2024-01-19T04:15:51.277738+0000","last_fullsized":"2024-01-19T04:15:51.277738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278338+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:51.278338+0000","last_peered":"2024-01-19T04:15:51.278338+0000","last_clean":"2024-01-19T04:15:51.278338+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:51.278338+0000","last_undegraded":"2024-01-19T04:15:51.278338+0000","last_fullsized":"2024-01-19T04:15:51.278338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085378+0000","last_change":"2024-01-19T04:16:06.663270+0000","last_active":"2024-01-19T04:16:08.085378+0000","last_peered":"2024-01-19T04:16:08.085378+0000","last_clean":"2024-01-19T04:16:08.085378+0000","last_became_active":"2024-01-19T04:16:06.661491+0000","last_became_peered":"2024-01-19T04:16:06.661491+0000","last_unstale":"2024-01-19T04:16:08.085378+0000","last_undegraded":"2024-01-19T04:16:08.085378+0000","last_fullsized":"2024-01-19T04:16:08.085378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:15.679645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790041+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:16:05.790041+0000","last_peered":"2024-01-19T04:16:05.790041+0000","last_clean":"2024-01-19T04:16:05.790041+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:16:05.790041+0000","last_undegraded":"2024-01-19T04:16:05.790041+0000","last_fullsized":"2024-01-19T04:16:05.790041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633823+0000","last_change":"2024-01-19T04:15:49.657523+0000","last_active":"2024-01-19T04:16:06.633823+0000","last_peered":"2024-01-19T04:16:06.633823+0000","last_clean":"2024-01-19T04:16:06.633823+0000","last_became_active":"2024-01-19T04:15:49.657239+0000","last_became_peered":"2024-01-19T04:15:49.657239+0000","last_unstale":"2024-01-19T04:16:06.633823+0000","last_undegraded":"2024-01-19T04:16:06.633823+0000","last_fullsized":"2024-01-19T04:16:06.633823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:50.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638676+0000","last_change":"2024-01-19T04:15:49.666858+0000","last_active":"2024-01-19T04:16:06.638676+0000","last_peered":"2024-01-19T04:16:06.638676+0000","last_clean":"2024-01-19T04:16:06.638676+0000","last_became_active":"2024-01-19T04:15:49.665093+0000","last_became_peered":"2024-01-19T04:15:49.665093+0000","last_unstale":"2024-01-19T04:16:06.638676+0000","last_undegraded":"2024-01-19T04:16:06.638676+0000","last_fullsized":"2024-01-19T04:16:06.638676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642800+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:50.642800+0000","last_peered":"2024-01-19T04:15:50.642800+0000","last_clean":"2024-01-19T04:15:50.642800+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:50.642800+0000","last_undegraded":"2024-01-19T04:15:50.642800+0000","last_fullsized":"2024-01-19T04:15:50.642800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085694+0000","last_change":"2024-01-19T04:16:06.661023+0000","last_active":"2024-01-19T04:16:08.085694+0000","last_peered":"2024-01-19T04:16:08.085694+0000","last_clean":"2024-01-19T04:16:08.085694+0000","last_became_active":"2024-01-19T04:16:06.660642+0000","last_became_peered":"2024-01-19T04:16:06.660642+0000","last_unstale":"2024-01-19T04:16:08.085694+0000","last_undegraded":"2024-01-19T04:16:08.085694+0000","last_fullsized":"2024-01-19T04:16:08.085694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:00.472323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793039+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:16:05.793039+0000","last_peered":"2024-01-19T04:16:05.793039+0000","last_clean":"2024-01-19T04:16:05.793039+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:16:05.793039+0000","last_undegraded":"2024-01-19T04:16:05.793039+0000","last_fullsized":"2024-01-19T04:16:05.793039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393618+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:51.393618+0000","last_peered":"2024-01-19T04:15:51.393618+0000","last_clean":"2024-01-19T04:15:51.393618+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:51.393618+0000","last_undegraded":"2024-01-19T04:15:51.393618+0000","last_fullsized":"2024-01-19T04:15:51.393618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":738768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.93999999999999995}]}]},{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93500000000000005}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.044}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.1459999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0720000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.026}]}]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.746},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.81200000000000006}]}]},{"osd":4,"up_from":16,"seq":68719476755,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":148414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.505},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.624}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.745},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.76600000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":178597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.255},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80900000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":180092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.032},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.96299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":767295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.876},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.94299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":450560,"data_stored":173503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.745}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:16:11.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:16:11.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd310200640 1 Processor -- start 2024-01-19T04:16:11.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd310200640 1 -- start start 2024-01-19T04:16:11.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd310200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3080c6e20 0x7fd3080c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd310200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd30806fda0 0x7fd3080c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd310200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3081533a0 con 0x7fd3080a6d30 2024-01-19T04:16:11.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd310200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd308156380 con 0x7fd30806fda0 2024-01-19T04:16:11.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd310200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30814fe40 con 0x7fd3080c6e20 2024-01-19T04:16:11.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30e200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd30806fda0 0x7fd3080c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30e200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd30806fda0 0x7fd3080c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43364/0 (socket says 172.21.15.32:43364) 2024-01-19T04:16:11.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30e200640 1 -- 172.21.15.32:0/3258730687 learned_addr learned my addr 172.21.15.32:0/3258730687 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:11.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30d800640 1 --2- 172.21.15.32:0/3258730687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3080c6e20 0x7fd3080c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30e200640 1 -- 172.21.15.32:0/3258730687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3080c6e20 msgr2=0x7fd3080c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:11.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30e200640 1 --2- 172.21.15.32:0/3258730687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3080c6e20 0x7fd3080c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30e200640 1 -- 172.21.15.32:0/3258730687 >> v1:172.21.15.67:6789/0 conn(0x7fd3080a6d30 legacy=0x7fd308152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.474+0000 7fd30e200640 1 -- 172.21.15.32:0/3258730687 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308152800 con 0x7fd30806fda0 2024-01-19T04:16:11.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd30e200640 1 --2- 172.21.15.32:0/3258730687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30806fda0 0x7fd3080c5b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd300009870 tx=0x7fd30001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e03d83704f8176 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd307e00640 1 -- 172.21.15.32:0/3258730687 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000ab620 con 0x7fd30806fda0 2024-01-19T04:16:11.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd307e00640 1 -- 172.21.15.32:0/3258730687 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3000ab780 con 0x7fd30806fda0 2024-01-19T04:16:11.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd307e00640 1 -- 172.21.15.32:0/3258730687 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000abb10 con 0x7fd30806fda0 2024-01-19T04:16:11.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 -- 172.21.15.32:0/3258730687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30806fda0 msgr2=0x7fd3080c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 --2- 172.21.15.32:0/3258730687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30806fda0 0x7fd3080c5b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd300009870 tx=0x7fd30001c420 comp rx=0 tx=0).stop 2024-01-19T04:16:11.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 -- 172.21.15.32:0/3258730687 shutdown_connections 2024-01-19T04:16:11.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 --2- 172.21.15.32:0/3258730687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30806fda0 0x7fd3080c5b40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 --2- 172.21.15.32:0/3258730687 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3080c6e20 0x7fd3080c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 -- 172.21.15.32:0/3258730687 >> 172.21.15.32:0/3258730687 conn(0x7fd3080a9870 msgr2=0x7fd3080a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:11.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 -- 172.21.15.32:0/3258730687 shutdown_connections 2024-01-19T04:16:11.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.478+0000 7fd310200640 1 -- 172.21.15.32:0/3258730687 wait complete. 2024-01-19T04:16:11.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 Processor -- start 2024-01-19T04:16:11.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 -- start start 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd30806fda0 0x7fd30814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3080a6d30 0x7fd3081f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3080c6e20 0x7fd3081f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081f0510 con 0x7fd3080a6d30 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081f1420 con 0x7fd3080c6e20 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30814b550 con 0x7fd30806fda0 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3080a6d30 0x7fd3081f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3080a6d30 0x7fd3081f09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43378/0 (socket says 172.21.15.32:43378) 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 -- 172.21.15.32:0/2547487559 learned_addr learned my addr 172.21.15.32:0/2547487559 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30e200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3080c6e20 0x7fd3081f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30d800640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd30806fda0 0x7fd30814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 -- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd30806fda0 msgr2=0x7fd30814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd30806fda0 0x7fd30814a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 -- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3080c6e20 msgr2=0x7fd3081f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3080c6e20 0x7fd3081f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 -- 172.21.15.32:0/2547487559 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3000094d0 con 0x7fd3080a6d30 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30e200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3080c6e20 0x7fd3081f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30d800640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd30806fda0 0x7fd30814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd30ce00640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3080a6d30 0x7fd3081f09a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c430 tx=0x7fd2f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd305600640 1 -- 172.21.15.32:0/2547487559 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80052d0 con 0x7fd3080a6d30 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd305600640 1 -- 172.21.15.32:0/2547487559 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8005430 con 0x7fd3080a6d30 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd305600640 1 -- 172.21.15.32:0/2547487559 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8007260 con 0x7fd3080a6d30 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30814b830 con 0x7fd3080a6d30 2024-01-19T04:16:11.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.482+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30814d240 con 0x7fd3080a6d30 2024-01-19T04:16:11.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.486+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3080749f0 con 0x7fd3080a6d30 2024-01-19T04:16:11.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.486+0000 7fd305600640 1 -- 172.21.15.32:0/2547487559 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd2f80073c0 con 0x7fd3080a6d30 2024-01-19T04:16:11.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.486+0000 7fd305600640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd2e0066500 0x7fd2e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.486+0000 7fd305600640 1 -- 172.21.15.32:0/2547487559 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd2f80833d0 con 0x7fd3080a6d30 2024-01-19T04:16:11.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.486+0000 7fd30d800640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd2e0066500 0x7fd2e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.486+0000 7fd30d800640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd2e0066500 0x7fd2e00689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00077a0 tx=0x7fd2f0009800 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.490+0000 7fd305600640 1 -- 172.21.15.32:0/2547487559 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd2f80503b0 con 0x7fd3080a6d30 2024-01-19T04:16:11.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.650+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3080c6b10 con 0x7fd2e0066500 2024-01-19T04:16:11.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.662+0000 7fd305600640 1 -- 172.21.15.32:0/2547487559 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+521534 (secure 0 0 0) 0x7fd2f0007d80 con 0x7fd2e0066500 2024-01-19T04:16:11.670 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:11.674 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:16:11.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd2e0066500 msgr2=0x7fd2e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd2e0066500 0x7fd2e00689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00077a0 tx=0x7fd2f0009800 comp rx=0 tx=0).stop 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3080a6d30 msgr2=0x7fd3081f09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3080a6d30 0x7fd3081f09a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c430 tx=0x7fd2f800c8f0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 shutdown_connections 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd2e0066500 0x7fd2e00689c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3080c6e20 0x7fd3081f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3080a6d30 0x7fd3081f09a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 --2- 172.21.15.32:0/2547487559 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd30806fda0 0x7fd30814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 >> 172.21.15.32:0/2547487559 conn(0x7fd3080a9870 msgr2=0x7fd30815bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 shutdown_connections 2024-01-19T04:16:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.670+0000 7fd310200640 1 -- 172.21.15.32:0/2547487559 wait complete. 2024-01-19T04:16:11.692 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-19T04:16:10.044297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596523,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":237,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237292,"kb_used_data":4472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737428,"statfs":{"total":773094113280,"available":772851126272,"internally_reserved":0,"allocated":4579328,"data_stored":2497919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.275128"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086760+0000","last_change":"2024-01-19T04:16:06.662967+0000","last_active":"2024-01-19T04:16:08.086760+0000","last_peered":"2024-01-19T04:16:08.086760+0000","last_clean":"2024-01-19T04:16:08.086760+0000","last_became_active":"2024-01-19T04:16:06.662697+0000","last_became_peered":"2024-01-19T04:16:06.662697+0000","last_unstale":"2024-01-19T04:16:08.086760+0000","last_undegraded":"2024-01-19T04:16:08.086760+0000","last_fullsized":"2024-01-19T04:16:08.086760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278168+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:15:51.278168+0000","last_peered":"2024-01-19T04:15:51.278168+0000","last_clean":"2024-01-19T04:15:51.278168+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:15:51.278168+0000","last_undegraded":"2024-01-19T04:15:51.278168+0000","last_fullsized":"2024-01-19T04:15:51.278168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393434+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:15:51.393434+0000","last_peered":"2024-01-19T04:15:51.393434+0000","last_clean":"2024-01-19T04:15:51.393434+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:15:51.393434+0000","last_undegraded":"2024-01-19T04:15:51.393434+0000","last_fullsized":"2024-01-19T04:15:51.393434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277965+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:15:51.277965+0000","last_peered":"2024-01-19T04:15:51.277965+0000","last_clean":"2024-01-19T04:15:51.277965+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:15:51.277965+0000","last_undegraded":"2024-01-19T04:15:51.277965+0000","last_fullsized":"2024-01-19T04:15:51.277965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.774083+0000","last_change":"2024-01-19T04:16:04.774083+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.774083+0000","last_undegraded":"2024-01-19T04:16:04.774083+0000","last_fullsized":"2024-01-19T04:16:04.774083+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659382+0000","last_change":"2024-01-19T04:16:06.654967+0000","last_active":"2024-01-19T04:16:06.659382+0000","last_peered":"2024-01-19T04:16:06.659382+0000","last_clean":"2024-01-19T04:16:06.659382+0000","last_became_active":"2024-01-19T04:16:06.653661+0000","last_became_peered":"2024-01-19T04:16:06.653661+0000","last_unstale":"2024-01-19T04:16:06.659382+0000","last_undegraded":"2024-01-19T04:16:06.659382+0000","last_fullsized":"2024-01-19T04:16:06.659382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:00:48.794156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788581+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:16:05.788581+0000","last_peered":"2024-01-19T04:16:05.788581+0000","last_clean":"2024-01-19T04:16:05.788581+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:16:05.788581+0000","last_undegraded":"2024-01-19T04:16:05.788581+0000","last_fullsized":"2024-01-19T04:16:05.788581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015937+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:15:52.015937+0000","last_peered":"2024-01-19T04:15:52.015937+0000","last_clean":"2024-01-19T04:15:52.015937+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:15:52.015937+0000","last_undegraded":"2024-01-19T04:15:52.015937+0000","last_fullsized":"2024-01-19T04:15:52.015937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779011+0000","last_change":"2024-01-19T04:16:04.779011+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779011+0000","last_undegraded":"2024-01-19T04:16:04.779011+0000","last_fullsized":"2024-01-19T04:16:04.779011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658445+0000","last_change":"2024-01-19T04:16:06.649757+0000","last_active":"2024-01-19T04:16:06.658445+0000","last_peered":"2024-01-19T04:16:06.658445+0000","last_clean":"2024-01-19T04:16:06.658445+0000","last_became_active":"2024-01-19T04:16:06.649522+0000","last_became_peered":"2024-01-19T04:16:06.649522+0000","last_unstale":"2024-01-19T04:16:06.658445+0000","last_undegraded":"2024-01-19T04:16:06.658445+0000","last_fullsized":"2024-01-19T04:16:06.658445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:52.103572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016060+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:15:52.016060+0000","last_peered":"2024-01-19T04:15:52.016060+0000","last_clean":"2024-01-19T04:15:52.016060+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:15:52.016060+0000","last_undegraded":"2024-01-19T04:15:52.016060+0000","last_fullsized":"2024-01-19T04:15:52.016060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788338+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:16:05.788338+0000","last_peered":"2024-01-19T04:16:05.788338+0000","last_clean":"2024-01-19T04:16:05.788338+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:16:05.788338+0000","last_undegraded":"2024-01-19T04:16:05.788338+0000","last_fullsized":"2024-01-19T04:16:05.788338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778670+0000","last_change":"2024-01-19T04:16:04.778670+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778670+0000","last_undegraded":"2024-01-19T04:16:04.778670+0000","last_fullsized":"2024-01-19T04:16:04.778670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637633+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:16:06.637633+0000","last_peered":"2024-01-19T04:16:06.637633+0000","last_clean":"2024-01-19T04:16:06.637633+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:16:06.637633+0000","last_undegraded":"2024-01-19T04:16:06.637633+0000","last_fullsized":"2024-01-19T04:16:06.637633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650232+0000","last_change":"2024-01-19T04:15:49.653943+0000","last_active":"2024-01-19T04:16:06.650232+0000","last_peered":"2024-01-19T04:16:06.650232+0000","last_clean":"2024-01-19T04:16:06.650232+0000","last_became_active":"2024-01-19T04:15:49.653669+0000","last_became_peered":"2024-01-19T04:15:49.653669+0000","last_unstale":"2024-01-19T04:16:06.650232+0000","last_undegraded":"2024-01-19T04:16:06.650232+0000","last_fullsized":"2024-01-19T04:16:06.650232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084761+0000","last_change":"2024-01-19T04:16:05.798495+0000","last_active":"2024-01-19T04:16:08.084761+0000","last_peered":"2024-01-19T04:16:08.084761+0000","last_clean":"2024-01-19T04:16:08.084761+0000","last_became_active":"2024-01-19T04:16:05.797905+0000","last_became_peered":"2024-01-19T04:16:05.797905+0000","last_unstale":"2024-01-19T04:16:08.084761+0000","last_undegraded":"2024-01-19T04:16:08.084761+0000","last_fullsized":"2024-01-19T04:16:08.084761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650407+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:16:06.650407+0000","last_peered":"2024-01-19T04:16:06.650407+0000","last_clean":"2024-01-19T04:16:06.650407+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:16:06.650407+0000","last_undegraded":"2024-01-19T04:16:06.650407+0000","last_fullsized":"2024-01-19T04:16:06.650407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393555+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:15:51.393555+0000","last_peered":"2024-01-19T04:15:51.393555+0000","last_clean":"2024-01-19T04:15:51.393555+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:15:51.393555+0000","last_undegraded":"2024-01-19T04:15:51.393555+0000","last_fullsized":"2024-01-19T04:15:51.393555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084600+0000","last_change":"2024-01-19T04:16:05.790864+0000","last_active":"2024-01-19T04:16:08.084600+0000","last_peered":"2024-01-19T04:16:08.084600+0000","last_clean":"2024-01-19T04:16:08.084600+0000","last_became_active":"2024-01-19T04:16:05.790554+0000","last_became_peered":"2024-01-19T04:16:05.790554+0000","last_unstale":"2024-01-19T04:16:08.084600+0000","last_undegraded":"2024-01-19T04:16:08.084600+0000","last_fullsized":"2024-01-19T04:16:08.084600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639010+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:16:06.639010+0000","last_peered":"2024-01-19T04:16:06.639010+0000","last_clean":"2024-01-19T04:16:06.639010+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:16:06.639010+0000","last_undegraded":"2024-01-19T04:16:06.639010+0000","last_fullsized":"2024-01-19T04:16:06.639010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650609+0000","last_change":"2024-01-19T04:15:49.667426+0000","last_active":"2024-01-19T04:16:06.650609+0000","last_peered":"2024-01-19T04:16:06.650609+0000","last_clean":"2024-01-19T04:16:06.650609+0000","last_became_active":"2024-01-19T04:15:49.667142+0000","last_became_peered":"2024-01-19T04:15:49.667142+0000","last_unstale":"2024-01-19T04:16:06.650609+0000","last_undegraded":"2024-01-19T04:16:06.650609+0000","last_fullsized":"2024-01-19T04:16:06.650609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640695+0000","last_change":"2024-01-19T04:16:05.797053+0000","last_active":"2024-01-19T04:16:06.640695+0000","last_peered":"2024-01-19T04:16:06.640695+0000","last_clean":"2024-01-19T04:16:06.640695+0000","last_became_active":"2024-01-19T04:16:05.796727+0000","last_became_peered":"2024-01-19T04:16:05.796727+0000","last_unstale":"2024-01-19T04:16:06.640695+0000","last_undegraded":"2024-01-19T04:16:06.640695+0000","last_fullsized":"2024-01-19T04:16:06.640695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:28:03.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651211+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:16:06.651211+0000","last_peered":"2024-01-19T04:16:06.651211+0000","last_clean":"2024-01-19T04:16:06.651211+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:16:06.651211+0000","last_undegraded":"2024-01-19T04:16:06.651211+0000","last_fullsized":"2024-01-19T04:16:06.651211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.643098+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:15:50.643098+0000","last_peered":"2024-01-19T04:15:50.643098+0000","last_clean":"2024-01-19T04:15:50.643098+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:15:50.643098+0000","last_undegraded":"2024-01-19T04:15:50.643098+0000","last_fullsized":"2024-01-19T04:15:50.643098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084410+0000","last_change":"2024-01-19T04:16:05.794126+0000","last_active":"2024-01-19T04:16:08.084410+0000","last_peered":"2024-01-19T04:16:08.084410+0000","last_clean":"2024-01-19T04:16:08.084410+0000","last_became_active":"2024-01-19T04:16:05.793821+0000","last_became_peered":"2024-01-19T04:16:05.793821+0000","last_unstale":"2024-01-19T04:16:08.084410+0000","last_undegraded":"2024-01-19T04:16:08.084410+0000","last_fullsized":"2024-01-19T04:16:08.084410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085125+0000","last_change":"2024-01-19T04:16:06.654711+0000","last_active":"2024-01-19T04:16:08.085125+0000","last_peered":"2024-01-19T04:16:08.085125+0000","last_clean":"2024-01-19T04:16:08.085125+0000","last_became_active":"2024-01-19T04:16:06.654442+0000","last_became_peered":"2024-01-19T04:16:06.654442+0000","last_unstale":"2024-01-19T04:16:08.085125+0000","last_undegraded":"2024-01-19T04:16:08.085125+0000","last_fullsized":"2024-01-19T04:16:08.085125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:13.662662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638284+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:16:06.638284+0000","last_peered":"2024-01-19T04:16:06.638284+0000","last_clean":"2024-01-19T04:16:06.638284+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:16:06.638284+0000","last_undegraded":"2024-01-19T04:16:06.638284+0000","last_fullsized":"2024-01-19T04:16:06.638284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634955+0000","last_change":"2024-01-19T04:15:49.680184+0000","last_active":"2024-01-19T04:16:06.634955+0000","last_peered":"2024-01-19T04:16:06.634955+0000","last_clean":"2024-01-19T04:16:06.634955+0000","last_became_active":"2024-01-19T04:15:49.679925+0000","last_became_peered":"2024-01-19T04:15:49.679925+0000","last_unstale":"2024-01-19T04:16:06.634955+0000","last_undegraded":"2024-01-19T04:16:06.634955+0000","last_fullsized":"2024-01-19T04:16:06.634955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778700+0000","last_change":"2024-01-19T04:16:04.778700+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778700+0000","last_undegraded":"2024-01-19T04:16:04.778700+0000","last_fullsized":"2024-01-19T04:16:04.778700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084379+0000","last_change":"2024-01-19T04:16:06.651279+0000","last_active":"2024-01-19T04:16:08.084379+0000","last_peered":"2024-01-19T04:16:08.084379+0000","last_clean":"2024-01-19T04:16:08.084379+0000","last_became_active":"2024-01-19T04:16:06.651097+0000","last_became_peered":"2024-01-19T04:16:06.651097+0000","last_unstale":"2024-01-19T04:16:08.084379+0000","last_undegraded":"2024-01-19T04:16:08.084379+0000","last_fullsized":"2024-01-19T04:16:08.084379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:25:40.860239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642266+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:15:50.642266+0000","last_peered":"2024-01-19T04:15:50.642266+0000","last_clean":"2024-01-19T04:15:50.642266+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:15:50.642266+0000","last_undegraded":"2024-01-19T04:15:50.642266+0000","last_fullsized":"2024-01-19T04:15:50.642266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277849+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:15:51.277849+0000","last_peered":"2024-01-19T04:15:51.277849+0000","last_clean":"2024-01-19T04:15:51.277849+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:15:51.277849+0000","last_undegraded":"2024-01-19T04:15:51.277849+0000","last_fullsized":"2024-01-19T04:15:51.277849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773895+0000","last_change":"2024-01-19T04:16:04.773895+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773895+0000","last_undegraded":"2024-01-19T04:16:04.773895+0000","last_fullsized":"2024-01-19T04:16:04.773895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659412+0000","last_change":"2024-01-19T04:16:06.655628+0000","last_active":"2024-01-19T04:16:06.659412+0000","last_peered":"2024-01-19T04:16:06.659412+0000","last_clean":"2024-01-19T04:16:06.659412+0000","last_became_active":"2024-01-19T04:16:06.653875+0000","last_became_peered":"2024-01-19T04:16:06.653875+0000","last_unstale":"2024-01-19T04:16:06.659412+0000","last_undegraded":"2024-01-19T04:16:06.659412+0000","last_fullsized":"2024-01-19T04:16:06.659412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:14.839980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016010+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:15:52.016010+0000","last_peered":"2024-01-19T04:15:52.016010+0000","last_clean":"2024-01-19T04:15:52.016010+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:15:52.016010+0000","last_undegraded":"2024-01-19T04:15:52.016010+0000","last_fullsized":"2024-01-19T04:15:52.016010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634212+0000","last_change":"2024-01-19T04:15:49.660917+0000","last_active":"2024-01-19T04:16:06.634212+0000","last_peered":"2024-01-19T04:16:06.634212+0000","last_clean":"2024-01-19T04:16:06.634212+0000","last_became_active":"2024-01-19T04:15:49.655137+0000","last_became_peered":"2024-01-19T04:15:49.655137+0000","last_unstale":"2024-01-19T04:16:06.634212+0000","last_undegraded":"2024-01-19T04:16:06.634212+0000","last_fullsized":"2024-01-19T04:16:06.634212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:05:00.093326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788476+0000","last_change":"2024-01-19T04:16:05.795319+0000","last_active":"2024-01-19T04:16:06.788476+0000","last_peered":"2024-01-19T04:16:06.788476+0000","last_clean":"2024-01-19T04:16:06.788476+0000","last_became_active":"2024-01-19T04:16:05.794958+0000","last_became_peered":"2024-01-19T04:16:05.794958+0000","last_unstale":"2024-01-19T04:16:06.788476+0000","last_undegraded":"2024-01-19T04:16:06.788476+0000","last_fullsized":"2024-01-19T04:16:06.788476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:55:40.046252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084469+0000","last_change":"2024-01-19T04:16:06.659222+0000","last_active":"2024-01-19T04:16:08.084469+0000","last_peered":"2024-01-19T04:16:08.084469+0000","last_clean":"2024-01-19T04:16:08.084469+0000","last_became_active":"2024-01-19T04:16:06.657419+0000","last_became_peered":"2024-01-19T04:16:06.657419+0000","last_unstale":"2024-01-19T04:16:08.084469+0000","last_undegraded":"2024-01-19T04:16:08.084469+0000","last_fullsized":"2024-01-19T04:16:08.084469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:38.868186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393598+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:15:51.393598+0000","last_peered":"2024-01-19T04:15:51.393598+0000","last_clean":"2024-01-19T04:15:51.393598+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:15:51.393598+0000","last_undegraded":"2024-01-19T04:15:51.393598+0000","last_fullsized":"2024-01-19T04:15:51.393598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633993+0000","last_change":"2024-01-19T04:15:49.657920+0000","last_active":"2024-01-19T04:16:06.633993+0000","last_peered":"2024-01-19T04:16:06.633993+0000","last_clean":"2024-01-19T04:16:06.633993+0000","last_became_active":"2024-01-19T04:15:49.657332+0000","last_became_peered":"2024-01-19T04:15:49.657332+0000","last_unstale":"2024-01-19T04:16:06.633993+0000","last_undegraded":"2024-01-19T04:16:06.633993+0000","last_fullsized":"2024-01-19T04:16:06.633993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:10.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778562+0000","last_change":"2024-01-19T04:16:04.778562+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778562+0000","last_undegraded":"2024-01-19T04:16:04.778562+0000","last_fullsized":"2024-01-19T04:16:04.778562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635132+0000","last_change":"2024-01-19T04:16:06.653073+0000","last_active":"2024-01-19T04:16:07.635132+0000","last_peered":"2024-01-19T04:16:07.635132+0000","last_clean":"2024-01-19T04:16:07.635132+0000","last_became_active":"2024-01-19T04:16:06.652783+0000","last_became_peered":"2024-01-19T04:16:06.652783+0000","last_unstale":"2024-01-19T04:16:07.635132+0000","last_undegraded":"2024-01-19T04:16:07.635132+0000","last_fullsized":"2024-01-19T04:16:07.635132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:43.230089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650249+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:16:06.650249+0000","last_peered":"2024-01-19T04:16:06.650249+0000","last_clean":"2024-01-19T04:16:06.650249+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:16:06.650249+0000","last_undegraded":"2024-01-19T04:16:06.650249+0000","last_fullsized":"2024-01-19T04:16:06.650249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633575+0000","last_change":"2024-01-19T04:15:49.669616+0000","last_active":"2024-01-19T04:16:06.633575+0000","last_peered":"2024-01-19T04:16:06.633575+0000","last_clean":"2024-01-19T04:16:06.633575+0000","last_became_active":"2024-01-19T04:15:49.667904+0000","last_became_peered":"2024-01-19T04:15:49.667904+0000","last_unstale":"2024-01-19T04:16:06.633575+0000","last_undegraded":"2024-01-19T04:16:06.633575+0000","last_fullsized":"2024-01-19T04:16:06.633575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:52.911948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084542+0000","last_change":"2024-01-19T04:16:05.797377+0000","last_active":"2024-01-19T04:16:08.084542+0000","last_peered":"2024-01-19T04:16:08.084542+0000","last_clean":"2024-01-19T04:16:08.084542+0000","last_became_active":"2024-01-19T04:16:05.797125+0000","last_became_peered":"2024-01-19T04:16:05.797125+0000","last_unstale":"2024-01-19T04:16:08.084542+0000","last_undegraded":"2024-01-19T04:16:08.084542+0000","last_fullsized":"2024-01-19T04:16:08.084542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086033+0000","last_change":"2024-01-19T04:16:06.651033+0000","last_active":"2024-01-19T04:16:08.086033+0000","last_peered":"2024-01-19T04:16:08.086033+0000","last_clean":"2024-01-19T04:16:08.086033+0000","last_became_active":"2024-01-19T04:16:06.650744+0000","last_became_peered":"2024-01-19T04:16:06.650744+0000","last_unstale":"2024-01-19T04:16:08.086033+0000","last_undegraded":"2024-01-19T04:16:08.086033+0000","last_fullsized":"2024-01-19T04:16:08.086033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:35:34.310303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016361+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:15:52.016361+0000","last_peered":"2024-01-19T04:15:52.016361+0000","last_clean":"2024-01-19T04:15:52.016361+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:15:52.016361+0000","last_undegraded":"2024-01-19T04:15:52.016361+0000","last_fullsized":"2024-01-19T04:15:52.016361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634096+0000","last_change":"2024-01-19T04:15:49.658348+0000","last_active":"2024-01-19T04:16:06.634096+0000","last_peered":"2024-01-19T04:16:06.634096+0000","last_clean":"2024-01-19T04:16:06.634096+0000","last_became_active":"2024-01-19T04:15:49.656971+0000","last_became_peered":"2024-01-19T04:15:49.656971+0000","last_unstale":"2024-01-19T04:16:06.634096+0000","last_undegraded":"2024-01-19T04:16:06.634096+0000","last_fullsized":"2024-01-19T04:16:06.634096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.780866+0000","last_change":"2024-01-19T04:16:04.780866+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.780866+0000","last_undegraded":"2024-01-19T04:16:04.780866+0000","last_fullsized":"2024-01-19T04:16:04.780866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635915+0000","last_change":"2024-01-19T04:16:06.648241+0000","last_active":"2024-01-19T04:16:07.635915+0000","last_peered":"2024-01-19T04:16:07.635915+0000","last_clean":"2024-01-19T04:16:07.635915+0000","last_became_active":"2024-01-19T04:16:06.647911+0000","last_became_peered":"2024-01-19T04:16:06.647911+0000","last_unstale":"2024-01-19T04:16:07.635915+0000","last_undegraded":"2024-01-19T04:16:07.635915+0000","last_fullsized":"2024-01-19T04:16:07.635915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:32.886100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016424+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:15:52.016424+0000","last_peered":"2024-01-19T04:15:52.016424+0000","last_clean":"2024-01-19T04:15:52.016424+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:15:52.016424+0000","last_undegraded":"2024-01-19T04:15:52.016424+0000","last_fullsized":"2024-01-19T04:15:52.016424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638798+0000","last_change":"2024-01-19T04:15:49.667350+0000","last_active":"2024-01-19T04:16:06.638798+0000","last_peered":"2024-01-19T04:16:06.638798+0000","last_clean":"2024-01-19T04:16:06.638798+0000","last_became_active":"2024-01-19T04:15:49.666589+0000","last_became_peered":"2024-01-19T04:15:49.666589+0000","last_unstale":"2024-01-19T04:16:06.638798+0000","last_undegraded":"2024-01-19T04:16:06.638798+0000","last_fullsized":"2024-01-19T04:16:06.638798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.636015+0000","last_change":"2024-01-19T04:16:05.790679+0000","last_active":"2024-01-19T04:16:07.636015+0000","last_peered":"2024-01-19T04:16:07.636015+0000","last_clean":"2024-01-19T04:16:07.636015+0000","last_became_active":"2024-01-19T04:16:05.790399+0000","last_became_peered":"2024-01-19T04:16:05.790399+0000","last_unstale":"2024-01-19T04:16:07.636015+0000","last_undegraded":"2024-01-19T04:16:07.636015+0000","last_fullsized":"2024-01-19T04:16:07.636015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:02.428657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016450+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:15:52.016450+0000","last_peered":"2024-01-19T04:15:52.016450+0000","last_clean":"2024-01-19T04:15:52.016450+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:15:52.016450+0000","last_undegraded":"2024-01-19T04:15:52.016450+0000","last_fullsized":"2024-01-19T04:15:52.016450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.643003+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:15:50.643003+0000","last_peered":"2024-01-19T04:15:50.643003+0000","last_clean":"2024-01-19T04:15:50.643003+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:15:50.643003+0000","last_undegraded":"2024-01-19T04:15:50.643003+0000","last_fullsized":"2024-01-19T04:15:50.643003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638696+0000","last_change":"2024-01-19T04:16:05.794503+0000","last_active":"2024-01-19T04:16:06.638696+0000","last_peered":"2024-01-19T04:16:06.638696+0000","last_clean":"2024-01-19T04:16:06.638696+0000","last_became_active":"2024-01-19T04:16:05.794177+0000","last_became_peered":"2024-01-19T04:16:05.794177+0000","last_unstale":"2024-01-19T04:16:06.638696+0000","last_undegraded":"2024-01-19T04:16:06.638696+0000","last_fullsized":"2024-01-19T04:16:06.638696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:09.555530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638194+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:16:06.638194+0000","last_peered":"2024-01-19T04:16:06.638194+0000","last_clean":"2024-01-19T04:16:06.638194+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:16:06.638194+0000","last_undegraded":"2024-01-19T04:16:06.638194+0000","last_fullsized":"2024-01-19T04:16:06.638194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016492+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:15:52.016492+0000","last_peered":"2024-01-19T04:15:52.016492+0000","last_clean":"2024-01-19T04:15:52.016492+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:15:52.016492+0000","last_undegraded":"2024-01-19T04:15:52.016492+0000","last_fullsized":"2024-01-19T04:15:52.016492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773997+0000","last_change":"2024-01-19T04:16:04.773997+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773997+0000","last_undegraded":"2024-01-19T04:16:04.773997+0000","last_fullsized":"2024-01-19T04:16:04.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086001+0000","last_change":"2024-01-19T04:16:06.663428+0000","last_active":"2024-01-19T04:16:08.086001+0000","last_peered":"2024-01-19T04:16:08.086001+0000","last_clean":"2024-01-19T04:16:08.086001+0000","last_became_active":"2024-01-19T04:16:06.662844+0000","last_became_peered":"2024-01-19T04:16:06.662844+0000","last_unstale":"2024-01-19T04:16:08.086001+0000","last_undegraded":"2024-01-19T04:16:08.086001+0000","last_fullsized":"2024-01-19T04:16:08.086001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:20.839193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788478+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:16:05.788478+0000","last_peered":"2024-01-19T04:16:05.788478+0000","last_clean":"2024-01-19T04:16:05.788478+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:16:05.788478+0000","last_undegraded":"2024-01-19T04:16:05.788478+0000","last_fullsized":"2024-01-19T04:16:05.788478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393658+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:15:51.393658+0000","last_peered":"2024-01-19T04:15:51.393658+0000","last_clean":"2024-01-19T04:15:51.393658+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:15:51.393658+0000","last_undegraded":"2024-01-19T04:15:51.393658+0000","last_fullsized":"2024-01-19T04:15:51.393658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778609+0000","last_change":"2024-01-19T04:16:04.778609+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778609+0000","last_undegraded":"2024-01-19T04:16:04.778609+0000","last_fullsized":"2024-01-19T04:16:04.778609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788470+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:16:05.788470+0000","last_peered":"2024-01-19T04:16:05.788470+0000","last_clean":"2024-01-19T04:16:05.788470+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:16:05.788470+0000","last_undegraded":"2024-01-19T04:16:05.788470+0000","last_fullsized":"2024-01-19T04:16:05.788470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277930+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:15:51.277930+0000","last_peered":"2024-01-19T04:15:51.277930+0000","last_clean":"2024-01-19T04:15:51.277930+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:15:51.277930+0000","last_undegraded":"2024-01-19T04:15:51.277930+0000","last_fullsized":"2024-01-19T04:15:51.277930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786740+0000","last_change":"2024-01-19T04:16:05.799883+0000","last_active":"2024-01-19T04:16:06.786740+0000","last_peered":"2024-01-19T04:16:06.786740+0000","last_clean":"2024-01-19T04:16:06.786740+0000","last_became_active":"2024-01-19T04:16:05.799581+0000","last_became_peered":"2024-01-19T04:16:05.799581+0000","last_unstale":"2024-01-19T04:16:06.786740+0000","last_undegraded":"2024-01-19T04:16:06.786740+0000","last_fullsized":"2024-01-19T04:16:06.786740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:55.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637532+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:16:06.637532+0000","last_peered":"2024-01-19T04:16:06.637532+0000","last_clean":"2024-01-19T04:16:06.637532+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:16:06.637532+0000","last_undegraded":"2024-01-19T04:16:06.637532+0000","last_fullsized":"2024-01-19T04:16:06.637532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790869+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:16:05.790869+0000","last_peered":"2024-01-19T04:16:05.790869+0000","last_clean":"2024-01-19T04:16:05.790869+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:16:05.790869+0000","last_undegraded":"2024-01-19T04:16:05.790869+0000","last_fullsized":"2024-01-19T04:16:05.790869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084369+0000","last_change":"2024-01-19T04:16:05.794058+0000","last_active":"2024-01-19T04:16:08.084369+0000","last_peered":"2024-01-19T04:16:08.084369+0000","last_clean":"2024-01-19T04:16:08.084369+0000","last_became_active":"2024-01-19T04:16:05.793542+0000","last_became_peered":"2024-01-19T04:16:05.793542+0000","last_unstale":"2024-01-19T04:16:08.084369+0000","last_undegraded":"2024-01-19T04:16:08.084369+0000","last_fullsized":"2024-01-19T04:16:08.084369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:08.794314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650910+0000","last_change":"2024-01-19T04:16:06.648682+0000","last_active":"2024-01-19T04:16:06.650910+0000","last_peered":"2024-01-19T04:16:06.650910+0000","last_clean":"2024-01-19T04:16:06.650910+0000","last_became_active":"2024-01-19T04:16:06.646754+0000","last_became_peered":"2024-01-19T04:16:06.646754+0000","last_unstale":"2024-01-19T04:16:06.650910+0000","last_undegraded":"2024-01-19T04:16:06.650910+0000","last_fullsized":"2024-01-19T04:16:06.650910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:35:59.042987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016417+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:15:52.016417+0000","last_peered":"2024-01-19T04:15:52.016417+0000","last_clean":"2024-01-19T04:15:52.016417+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:15:52.016417+0000","last_undegraded":"2024-01-19T04:15:52.016417+0000","last_fullsized":"2024-01-19T04:15:52.016417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637399+0000","last_change":"2024-01-19T04:15:49.665258+0000","last_active":"2024-01-19T04:16:06.637399+0000","last_peered":"2024-01-19T04:16:06.637399+0000","last_clean":"2024-01-19T04:16:06.637399+0000","last_became_active":"2024-01-19T04:15:49.664987+0000","last_became_peered":"2024-01-19T04:15:49.664987+0000","last_unstale":"2024-01-19T04:16:06.637399+0000","last_undegraded":"2024-01-19T04:16:06.637399+0000","last_fullsized":"2024-01-19T04:16:06.637399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637230+0000","last_change":"2024-01-19T04:16:05.799441+0000","last_active":"2024-01-19T04:16:06.637230+0000","last_peered":"2024-01-19T04:16:06.637230+0000","last_clean":"2024-01-19T04:16:06.637230+0000","last_became_active":"2024-01-19T04:16:05.799063+0000","last_became_peered":"2024-01-19T04:16:05.799063+0000","last_unstale":"2024-01-19T04:16:06.637230+0000","last_undegraded":"2024-01-19T04:16:06.637230+0000","last_fullsized":"2024-01-19T04:16:06.637230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:59:19.597563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"35'9","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791453+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:16:05.791453+0000","last_peered":"2024-01-19T04:16:05.791453+0000","last_clean":"2024-01-19T04:16:05.791453+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:16:05.791453+0000","last_undegraded":"2024-01-19T04:16:05.791453+0000","last_fullsized":"2024-01-19T04:16:05.791453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642801+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:15:50.642801+0000","last_peered":"2024-01-19T04:15:50.642801+0000","last_clean":"2024-01-19T04:15:50.642801+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:15:50.642801+0000","last_undegraded":"2024-01-19T04:15:50.642801+0000","last_fullsized":"2024-01-19T04:15:50.642801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086587+0000","last_change":"2024-01-19T04:16:05.801624+0000","last_active":"2024-01-19T04:16:08.086587+0000","last_peered":"2024-01-19T04:16:08.086587+0000","last_clean":"2024-01-19T04:16:08.086587+0000","last_became_active":"2024-01-19T04:16:05.801315+0000","last_became_peered":"2024-01-19T04:16:05.801315+0000","last_unstale":"2024-01-19T04:16:08.086587+0000","last_undegraded":"2024-01-19T04:16:08.086587+0000","last_fullsized":"2024-01-19T04:16:08.086587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642896+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:15:50.642896+0000","last_peered":"2024-01-19T04:15:50.642896+0000","last_clean":"2024-01-19T04:15:50.642896+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:15:50.642896+0000","last_undegraded":"2024-01-19T04:15:50.642896+0000","last_fullsized":"2024-01-19T04:15:50.642896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791301+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:16:05.791301+0000","last_peered":"2024-01-19T04:16:05.791301+0000","last_clean":"2024-01-19T04:16:05.791301+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:16:05.791301+0000","last_undegraded":"2024-01-19T04:16:05.791301+0000","last_fullsized":"2024-01-19T04:16:05.791301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779249+0000","last_change":"2024-01-19T04:16:04.779249+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779249+0000","last_undegraded":"2024-01-19T04:16:04.779249+0000","last_fullsized":"2024-01-19T04:16:04.779249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651137+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:16:06.651137+0000","last_peered":"2024-01-19T04:16:06.651137+0000","last_clean":"2024-01-19T04:16:06.651137+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:16:06.651137+0000","last_undegraded":"2024-01-19T04:16:06.651137+0000","last_fullsized":"2024-01-19T04:16:06.651137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793074+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:16:05.793074+0000","last_peered":"2024-01-19T04:16:05.793074+0000","last_clean":"2024-01-19T04:16:05.793074+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:16:05.793074+0000","last_undegraded":"2024-01-19T04:16:05.793074+0000","last_fullsized":"2024-01-19T04:16:05.793074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635828+0000","last_change":"2024-01-19T04:16:05.789419+0000","last_active":"2024-01-19T04:16:07.635828+0000","last_peered":"2024-01-19T04:16:07.635828+0000","last_clean":"2024-01-19T04:16:07.635828+0000","last_became_active":"2024-01-19T04:16:05.782405+0000","last_became_peered":"2024-01-19T04:16:05.782405+0000","last_unstale":"2024-01-19T04:16:07.635828+0000","last_undegraded":"2024-01-19T04:16:07.635828+0000","last_fullsized":"2024-01-19T04:16:07.635828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:43:13.226181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658899+0000","last_change":"2024-01-19T04:16:06.653820+0000","last_active":"2024-01-19T04:16:06.658899+0000","last_peered":"2024-01-19T04:16:06.658899+0000","last_clean":"2024-01-19T04:16:06.658899+0000","last_became_active":"2024-01-19T04:16:06.653551+0000","last_became_peered":"2024-01-19T04:16:06.653551+0000","last_unstale":"2024-01-19T04:16:06.658899+0000","last_undegraded":"2024-01-19T04:16:06.658899+0000","last_fullsized":"2024-01-19T04:16:06.658899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:28.058495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793160+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:16:05.793160+0000","last_peered":"2024-01-19T04:16:05.793160+0000","last_clean":"2024-01-19T04:16:05.793160+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:16:05.793160+0000","last_undegraded":"2024-01-19T04:16:05.793160+0000","last_fullsized":"2024-01-19T04:16:05.793160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642933+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:15:50.642933+0000","last_peered":"2024-01-19T04:15:50.642933+0000","last_clean":"2024-01-19T04:15:50.642933+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:15:50.642933+0000","last_undegraded":"2024-01-19T04:15:50.642933+0000","last_fullsized":"2024-01-19T04:15:50.642933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779187+0000","last_change":"2024-01-19T04:16:04.779187+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779187+0000","last_undegraded":"2024-01-19T04:16:04.779187+0000","last_fullsized":"2024-01-19T04:16:04.779187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085783+0000","last_change":"2024-01-19T04:16:06.656144+0000","last_active":"2024-01-19T04:16:08.085783+0000","last_peered":"2024-01-19T04:16:08.085783+0000","last_clean":"2024-01-19T04:16:08.085783+0000","last_became_active":"2024-01-19T04:16:06.655863+0000","last_became_peered":"2024-01-19T04:16:06.655863+0000","last_unstale":"2024-01-19T04:16:08.085783+0000","last_undegraded":"2024-01-19T04:16:08.085783+0000","last_fullsized":"2024-01-19T04:16:08.085783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:01:51.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015882+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:15:52.015882+0000","last_peered":"2024-01-19T04:15:52.015882+0000","last_clean":"2024-01-19T04:15:52.015882+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:15:52.015882+0000","last_undegraded":"2024-01-19T04:15:52.015882+0000","last_fullsized":"2024-01-19T04:15:52.015882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637132+0000","last_change":"2024-01-19T04:15:49.668312+0000","last_active":"2024-01-19T04:16:06.637132+0000","last_peered":"2024-01-19T04:16:06.637132+0000","last_clean":"2024-01-19T04:16:06.637132+0000","last_became_active":"2024-01-19T04:15:49.664719+0000","last_became_peered":"2024-01-19T04:15:49.664719+0000","last_unstale":"2024-01-19T04:16:06.637132+0000","last_undegraded":"2024-01-19T04:16:06.637132+0000","last_fullsized":"2024-01-19T04:16:06.637132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.779700+0000","last_change":"2024-01-19T04:16:04.779700+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.779700+0000","last_undegraded":"2024-01-19T04:16:04.779700+0000","last_fullsized":"2024-01-19T04:16:04.779700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788364+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:16:05.788364+0000","last_peered":"2024-01-19T04:16:05.788364+0000","last_clean":"2024-01-19T04:16:05.788364+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:16:05.788364+0000","last_undegraded":"2024-01-19T04:16:05.788364+0000","last_fullsized":"2024-01-19T04:16:05.788364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.015917+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:15:52.015917+0000","last_peered":"2024-01-19T04:15:52.015917+0000","last_clean":"2024-01-19T04:15:52.015917+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:15:52.015917+0000","last_undegraded":"2024-01-19T04:15:52.015917+0000","last_fullsized":"2024-01-19T04:15:52.015917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788356+0000","last_change":"2024-01-19T04:16:05.799707+0000","last_active":"2024-01-19T04:16:06.788356+0000","last_peered":"2024-01-19T04:16:06.788356+0000","last_clean":"2024-01-19T04:16:06.788356+0000","last_became_active":"2024-01-19T04:16:05.799464+0000","last_became_peered":"2024-01-19T04:16:05.799464+0000","last_unstale":"2024-01-19T04:16:06.788356+0000","last_undegraded":"2024-01-19T04:16:06.788356+0000","last_fullsized":"2024-01-19T04:16:06.788356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:17:34.865737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016130+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:15:52.016130+0000","last_peered":"2024-01-19T04:15:52.016130+0000","last_clean":"2024-01-19T04:15:52.016130+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:15:52.016130+0000","last_undegraded":"2024-01-19T04:15:52.016130+0000","last_fullsized":"2024-01-19T04:15:52.016130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642393+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:15:50.642393+0000","last_peered":"2024-01-19T04:15:50.642393+0000","last_clean":"2024-01-19T04:15:50.642393+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:15:50.642393+0000","last_undegraded":"2024-01-19T04:15:50.642393+0000","last_fullsized":"2024-01-19T04:15:50.642393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084277+0000","last_change":"2024-01-19T04:16:05.798704+0000","last_active":"2024-01-19T04:16:08.084277+0000","last_peered":"2024-01-19T04:16:08.084277+0000","last_clean":"2024-01-19T04:16:08.084277+0000","last_became_active":"2024-01-19T04:16:05.798256+0000","last_became_peered":"2024-01-19T04:16:05.798256+0000","last_unstale":"2024-01-19T04:16:08.084277+0000","last_undegraded":"2024-01-19T04:16:08.084277+0000","last_fullsized":"2024-01-19T04:16:08.084277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.003940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084191+0000","last_change":"2024-01-19T04:16:06.661878+0000","last_active":"2024-01-19T04:16:08.084191+0000","last_peered":"2024-01-19T04:16:08.084191+0000","last_clean":"2024-01-19T04:16:08.084191+0000","last_became_active":"2024-01-19T04:16:06.661120+0000","last_became_peered":"2024-01-19T04:16:06.661120+0000","last_unstale":"2024-01-19T04:16:08.084191+0000","last_undegraded":"2024-01-19T04:16:08.084191+0000","last_fullsized":"2024-01-19T04:16:08.084191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:54.194344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016389+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:15:52.016389+0000","last_peered":"2024-01-19T04:15:52.016389+0000","last_clean":"2024-01-19T04:15:52.016389+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:15:52.016389+0000","last_undegraded":"2024-01-19T04:15:52.016389+0000","last_fullsized":"2024-01-19T04:15:52.016389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278193+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:15:51.278193+0000","last_peered":"2024-01-19T04:15:51.278193+0000","last_clean":"2024-01-19T04:15:51.278193+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:15:51.278193+0000","last_undegraded":"2024-01-19T04:15:51.278193+0000","last_fullsized":"2024-01-19T04:15:51.278193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.773970+0000","last_change":"2024-01-19T04:16:04.773970+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.773970+0000","last_undegraded":"2024-01-19T04:16:04.773970+0000","last_fullsized":"2024-01-19T04:16:04.773970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.780313+0000","last_change":"2024-01-19T04:16:04.780313+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.780313+0000","last_undegraded":"2024-01-19T04:16:04.780313+0000","last_fullsized":"2024-01-19T04:16:04.780313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.635048+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:16:06.635048+0000","last_peered":"2024-01-19T04:16:06.635048+0000","last_clean":"2024-01-19T04:16:06.635048+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:16:06.635048+0000","last_undegraded":"2024-01-19T04:16:06.635048+0000","last_fullsized":"2024-01-19T04:16:06.635048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:02.358517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641737+0000","last_change":"2024-01-19T04:15:49.671511+0000","last_active":"2024-01-19T04:16:06.641737+0000","last_peered":"2024-01-19T04:16:06.641737+0000","last_clean":"2024-01-19T04:16:06.641737+0000","last_became_active":"2024-01-19T04:15:49.670975+0000","last_became_peered":"2024-01-19T04:15:49.670975+0000","last_unstale":"2024-01-19T04:16:06.641737+0000","last_undegraded":"2024-01-19T04:16:06.641737+0000","last_fullsized":"2024-01-19T04:16:06.641737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086005+0000","last_change":"2024-01-19T04:16:06.645758+0000","last_active":"2024-01-19T04:16:08.086005+0000","last_peered":"2024-01-19T04:16:08.086005+0000","last_clean":"2024-01-19T04:16:08.086005+0000","last_became_active":"2024-01-19T04:16:06.645496+0000","last_became_peered":"2024-01-19T04:16:06.645496+0000","last_unstale":"2024-01-19T04:16:08.086005+0000","last_undegraded":"2024-01-19T04:16:08.086005+0000","last_fullsized":"2024-01-19T04:16:08.086005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:25.718378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786188+0000","last_change":"2024-01-19T04:16:05.792100+0000","last_active":"2024-01-19T04:16:06.786188+0000","last_peered":"2024-01-19T04:16:06.786188+0000","last_clean":"2024-01-19T04:16:06.786188+0000","last_became_active":"2024-01-19T04:16:05.791821+0000","last_became_peered":"2024-01-19T04:16:05.791821+0000","last_unstale":"2024-01-19T04:16:06.786188+0000","last_undegraded":"2024-01-19T04:16:06.786188+0000","last_fullsized":"2024-01-19T04:16:06.786188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:12:26.677056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791504+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:16:05.791504+0000","last_peered":"2024-01-19T04:16:05.791504+0000","last_clean":"2024-01-19T04:16:05.791504+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:16:05.791504+0000","last_undegraded":"2024-01-19T04:16:05.791504+0000","last_fullsized":"2024-01-19T04:16:05.791504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016381+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:15:52.016381+0000","last_peered":"2024-01-19T04:15:52.016381+0000","last_clean":"2024-01-19T04:15:52.016381+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:15:52.016381+0000","last_undegraded":"2024-01-19T04:15:52.016381+0000","last_fullsized":"2024-01-19T04:15:52.016381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084960+0000","last_change":"2024-01-19T04:16:06.653044+0000","last_active":"2024-01-19T04:16:08.084960+0000","last_peered":"2024-01-19T04:16:08.084960+0000","last_clean":"2024-01-19T04:16:08.084960+0000","last_became_active":"2024-01-19T04:16:06.652723+0000","last_became_peered":"2024-01-19T04:16:06.652723+0000","last_unstale":"2024-01-19T04:16:08.084960+0000","last_undegraded":"2024-01-19T04:16:08.084960+0000","last_fullsized":"2024-01-19T04:16:08.084960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:59.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651297+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:16:06.651297+0000","last_peered":"2024-01-19T04:16:06.651297+0000","last_clean":"2024-01-19T04:16:06.651297+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:16:06.651297+0000","last_undegraded":"2024-01-19T04:16:06.651297+0000","last_fullsized":"2024-01-19T04:16:06.651297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393693+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:15:51.393693+0000","last_peered":"2024-01-19T04:15:51.393693+0000","last_clean":"2024-01-19T04:15:51.393693+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:15:51.393693+0000","last_undegraded":"2024-01-19T04:15:51.393693+0000","last_fullsized":"2024-01-19T04:15:51.393693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-01-19T04:16:04.778666+0000","last_change":"2024-01-19T04:16:04.778666+0000","last_active":"2024-01-19T04:16:04.765525+0000","last_peered":"2024-01-19T04:16:04.765525+0000","last_clean":"2024-01-19T04:16:04.765525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:04.778666+0000","last_undegraded":"2024-01-19T04:16:04.778666+0000","last_fullsized":"2024-01-19T04:16:04.778666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393719+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:15:51.393719+0000","last_peered":"2024-01-19T04:15:51.393719+0000","last_clean":"2024-01-19T04:15:51.393719+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:15:51.393719+0000","last_undegraded":"2024-01-19T04:15:51.393719+0000","last_fullsized":"2024-01-19T04:15:51.393719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651043+0000","last_change":"2024-01-19T04:15:49.650645+0000","last_active":"2024-01-19T04:16:06.651043+0000","last_peered":"2024-01-19T04:16:06.651043+0000","last_clean":"2024-01-19T04:16:06.651043+0000","last_became_active":"2024-01-19T04:15:49.650331+0000","last_became_peered":"2024-01-19T04:15:49.650331+0000","last_unstale":"2024-01-19T04:16:06.651043+0000","last_undegraded":"2024-01-19T04:16:06.651043+0000","last_fullsized":"2024-01-19T04:16:06.651043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085276+0000","last_change":"2024-01-19T04:16:05.791836+0000","last_active":"2024-01-19T04:16:08.085276+0000","last_peered":"2024-01-19T04:16:08.085276+0000","last_clean":"2024-01-19T04:16:08.085276+0000","last_became_active":"2024-01-19T04:16:05.791582+0000","last_became_peered":"2024-01-19T04:16:05.791582+0000","last_unstale":"2024-01-19T04:16:08.085276+0000","last_undegraded":"2024-01-19T04:16:08.085276+0000","last_fullsized":"2024-01-19T04:16:08.085276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277780+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:15:51.277780+0000","last_peered":"2024-01-19T04:15:51.277780+0000","last_clean":"2024-01-19T04:15:51.277780+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:15:51.277780+0000","last_undegraded":"2024-01-19T04:15:51.277780+0000","last_fullsized":"2024-01-19T04:15:51.277780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393567+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:15:51.393567+0000","last_peered":"2024-01-19T04:15:51.393567+0000","last_clean":"2024-01-19T04:15:51.393567+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:15:51.393567+0000","last_undegraded":"2024-01-19T04:15:51.393567+0000","last_fullsized":"2024-01-19T04:15:51.393567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635281+0000","last_change":"2024-01-19T04:16:06.644115+0000","last_active":"2024-01-19T04:16:07.635281+0000","last_peered":"2024-01-19T04:16:07.635281+0000","last_clean":"2024-01-19T04:16:07.635281+0000","last_became_active":"2024-01-19T04:16:06.643807+0000","last_became_peered":"2024-01-19T04:16:06.643807+0000","last_unstale":"2024-01-19T04:16:07.635281+0000","last_undegraded":"2024-01-19T04:16:07.635281+0000","last_fullsized":"2024-01-19T04:16:07.635281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:20.211567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278402+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:15:51.278402+0000","last_peered":"2024-01-19T04:15:51.278402+0000","last_clean":"2024-01-19T04:15:51.278402+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:15:51.278402+0000","last_undegraded":"2024-01-19T04:15:51.278402+0000","last_fullsized":"2024-01-19T04:15:51.278402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.648071+0000","last_change":"2024-01-19T04:16:06.645593+0000","last_active":"2024-01-19T04:16:06.648071+0000","last_peered":"2024-01-19T04:16:06.648071+0000","last_clean":"2024-01-19T04:16:06.648071+0000","last_became_active":"2024-01-19T04:16:06.645250+0000","last_became_peered":"2024-01-19T04:16:06.645250+0000","last_unstale":"2024-01-19T04:16:06.648071+0000","last_undegraded":"2024-01-19T04:16:06.648071+0000","last_fullsized":"2024-01-19T04:16:06.648071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:11:20.809247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016256+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:15:52.016256+0000","last_peered":"2024-01-19T04:15:52.016256+0000","last_clean":"2024-01-19T04:15:52.016256+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:15:52.016256+0000","last_undegraded":"2024-01-19T04:15:52.016256+0000","last_fullsized":"2024-01-19T04:15:52.016256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635962+0000","last_change":"2024-01-19T04:16:06.642681+0000","last_active":"2024-01-19T04:16:07.635962+0000","last_peered":"2024-01-19T04:16:07.635962+0000","last_clean":"2024-01-19T04:16:07.635962+0000","last_became_active":"2024-01-19T04:16:06.642382+0000","last_became_peered":"2024-01-19T04:16:06.642382+0000","last_unstale":"2024-01-19T04:16:07.635962+0000","last_undegraded":"2024-01-19T04:16:07.635962+0000","last_fullsized":"2024-01-19T04:16:07.635962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:47.006272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642785+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:15:50.642785+0000","last_peered":"2024-01-19T04:15:50.642785+0000","last_clean":"2024-01-19T04:15:50.642785+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:15:50.642785+0000","last_undegraded":"2024-01-19T04:15:50.642785+0000","last_fullsized":"2024-01-19T04:15:50.642785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641820+0000","last_change":"2024-01-19T04:15:49.672729+0000","last_active":"2024-01-19T04:16:06.641820+0000","last_peered":"2024-01-19T04:16:06.641820+0000","last_clean":"2024-01-19T04:16:06.641820+0000","last_became_active":"2024-01-19T04:15:49.672195+0000","last_became_peered":"2024-01-19T04:15:49.672195+0000","last_unstale":"2024-01-19T04:16:06.641820+0000","last_undegraded":"2024-01-19T04:16:06.641820+0000","last_fullsized":"2024-01-19T04:16:06.641820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793119+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:16:05.793119+0000","last_peered":"2024-01-19T04:16:05.793119+0000","last_clean":"2024-01-19T04:16:05.793119+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:16:05.793119+0000","last_undegraded":"2024-01-19T04:16:05.793119+0000","last_fullsized":"2024-01-19T04:16:05.793119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638035+0000","last_change":"2024-01-19T04:15:49.655156+0000","last_active":"2024-01-19T04:16:06.638035+0000","last_peered":"2024-01-19T04:16:06.638035+0000","last_clean":"2024-01-19T04:16:06.638035+0000","last_became_active":"2024-01-19T04:15:49.651743+0000","last_became_peered":"2024-01-19T04:15:49.651743+0000","last_unstale":"2024-01-19T04:16:06.638035+0000","last_undegraded":"2024-01-19T04:16:06.638035+0000","last_fullsized":"2024-01-19T04:16:06.638035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085040+0000","last_change":"2024-01-19T04:16:06.653368+0000","last_active":"2024-01-19T04:16:08.085040+0000","last_peered":"2024-01-19T04:16:08.085040+0000","last_clean":"2024-01-19T04:16:08.085040+0000","last_became_active":"2024-01-19T04:16:06.653083+0000","last_became_peered":"2024-01-19T04:16:06.653083+0000","last_unstale":"2024-01-19T04:16:08.085040+0000","last_undegraded":"2024-01-19T04:16:08.085040+0000","last_fullsized":"2024-01-19T04:16:08.085040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:48.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642352+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:15:50.642352+0000","last_peered":"2024-01-19T04:15:50.642352+0000","last_clean":"2024-01-19T04:15:50.642352+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:15:50.642352+0000","last_undegraded":"2024-01-19T04:15:50.642352+0000","last_fullsized":"2024-01-19T04:15:50.642352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659402+0000","last_change":"2024-01-19T04:16:06.655369+0000","last_active":"2024-01-19T04:16:06.659402+0000","last_peered":"2024-01-19T04:16:06.659402+0000","last_clean":"2024-01-19T04:16:06.659402+0000","last_became_active":"2024-01-19T04:16:06.655053+0000","last_became_peered":"2024-01-19T04:16:06.655053+0000","last_unstale":"2024-01-19T04:16:06.659402+0000","last_undegraded":"2024-01-19T04:16:06.659402+0000","last_fullsized":"2024-01-19T04:16:06.659402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:15.541954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.649648+0000","last_change":"2024-01-19T04:15:49.645143+0000","last_active":"2024-01-19T04:16:06.649648+0000","last_peered":"2024-01-19T04:16:06.649648+0000","last_clean":"2024-01-19T04:16:06.649648+0000","last_became_active":"2024-01-19T04:15:49.644879+0000","last_became_peered":"2024-01-19T04:15:49.644879+0000","last_unstale":"2024-01-19T04:16:06.649648+0000","last_undegraded":"2024-01-19T04:16:06.649648+0000","last_fullsized":"2024-01-19T04:16:06.649648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016274+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:15:52.016274+0000","last_peered":"2024-01-19T04:15:52.016274+0000","last_clean":"2024-01-19T04:15:52.016274+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:15:52.016274+0000","last_undegraded":"2024-01-19T04:15:52.016274+0000","last_fullsized":"2024-01-19T04:15:52.016274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016180+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:15:52.016180+0000","last_peered":"2024-01-19T04:15:52.016180+0000","last_clean":"2024-01-19T04:15:52.016180+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:15:52.016180+0000","last_undegraded":"2024-01-19T04:15:52.016180+0000","last_fullsized":"2024-01-19T04:15:52.016180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634937+0000","last_change":"2024-01-19T04:15:49.679977+0000","last_active":"2024-01-19T04:16:06.634937+0000","last_peered":"2024-01-19T04:16:06.634937+0000","last_clean":"2024-01-19T04:16:06.634937+0000","last_became_active":"2024-01-19T04:15:49.679706+0000","last_became_peered":"2024-01-19T04:15:49.679706+0000","last_unstale":"2024-01-19T04:16:06.634937+0000","last_undegraded":"2024-01-19T04:16:06.634937+0000","last_fullsized":"2024-01-19T04:16:06.634937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791409+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:16:05.791409+0000","last_peered":"2024-01-19T04:16:05.791409+0000","last_clean":"2024-01-19T04:16:05.791409+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:16:05.791409+0000","last_undegraded":"2024-01-19T04:16:05.791409+0000","last_fullsized":"2024-01-19T04:16:05.791409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635814+0000","last_change":"2024-01-19T04:16:06.656508+0000","last_active":"2024-01-19T04:16:07.635814+0000","last_peered":"2024-01-19T04:16:07.635814+0000","last_clean":"2024-01-19T04:16:07.635814+0000","last_became_active":"2024-01-19T04:16:06.656095+0000","last_became_peered":"2024-01-19T04:16:06.656095+0000","last_unstale":"2024-01-19T04:16:07.635814+0000","last_undegraded":"2024-01-19T04:16:07.635814+0000","last_fullsized":"2024-01-19T04:16:07.635814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:48.953287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793097+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:16:05.793097+0000","last_peered":"2024-01-19T04:16:05.793097+0000","last_clean":"2024-01-19T04:16:05.793097+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:16:05.793097+0000","last_undegraded":"2024-01-19T04:16:05.793097+0000","last_fullsized":"2024-01-19T04:16:05.793097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278301+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:15:51.278301+0000","last_peered":"2024-01-19T04:15:51.278301+0000","last_clean":"2024-01-19T04:15:51.278301+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:15:51.278301+0000","last_undegraded":"2024-01-19T04:15:51.278301+0000","last_fullsized":"2024-01-19T04:15:51.278301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084295+0000","last_change":"2024-01-19T04:16:06.658727+0000","last_active":"2024-01-19T04:16:08.084295+0000","last_peered":"2024-01-19T04:16:08.084295+0000","last_clean":"2024-01-19T04:16:08.084295+0000","last_became_active":"2024-01-19T04:16:06.657947+0000","last_became_peered":"2024-01-19T04:16:06.657947+0000","last_unstale":"2024-01-19T04:16:08.084295+0000","last_undegraded":"2024-01-19T04:16:08.084295+0000","last_fullsized":"2024-01-19T04:16:08.084295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:26.441618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278172+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:15:51.278172+0000","last_peered":"2024-01-19T04:15:51.278172+0000","last_clean":"2024-01-19T04:15:51.278172+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:15:51.278172+0000","last_undegraded":"2024-01-19T04:15:51.278172+0000","last_fullsized":"2024-01-19T04:15:51.278172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635326+0000","last_change":"2024-01-19T04:16:06.643237+0000","last_active":"2024-01-19T04:16:07.635326+0000","last_peered":"2024-01-19T04:16:07.635326+0000","last_clean":"2024-01-19T04:16:07.635326+0000","last_became_active":"2024-01-19T04:16:06.642898+0000","last_became_peered":"2024-01-19T04:16:06.642898+0000","last_unstale":"2024-01-19T04:16:07.635326+0000","last_undegraded":"2024-01-19T04:16:07.635326+0000","last_fullsized":"2024-01-19T04:16:07.635326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:26.134708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642358+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:15:50.642358+0000","last_peered":"2024-01-19T04:15:50.642358+0000","last_clean":"2024-01-19T04:15:50.642358+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:15:50.642358+0000","last_undegraded":"2024-01-19T04:15:50.642358+0000","last_fullsized":"2024-01-19T04:15:50.642358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790125+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:16:05.790125+0000","last_peered":"2024-01-19T04:16:05.790125+0000","last_clean":"2024-01-19T04:16:05.790125+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:16:05.790125+0000","last_undegraded":"2024-01-19T04:16:05.790125+0000","last_fullsized":"2024-01-19T04:16:05.790125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.653729+0000","last_change":"2024-01-19T04:16:06.651408+0000","last_active":"2024-01-19T04:16:06.653729+0000","last_peered":"2024-01-19T04:16:06.653729+0000","last_clean":"2024-01-19T04:16:06.653729+0000","last_became_active":"2024-01-19T04:16:06.651129+0000","last_became_peered":"2024-01-19T04:16:06.651129+0000","last_unstale":"2024-01-19T04:16:06.653729+0000","last_undegraded":"2024-01-19T04:16:06.653729+0000","last_fullsized":"2024-01-19T04:16:06.653729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:27.515777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633913+0000","last_change":"2024-01-19T04:15:49.657109+0000","last_active":"2024-01-19T04:16:06.633913+0000","last_peered":"2024-01-19T04:16:06.633913+0000","last_clean":"2024-01-19T04:16:06.633913+0000","last_became_active":"2024-01-19T04:15:49.656836+0000","last_became_peered":"2024-01-19T04:15:49.656836+0000","last_unstale":"2024-01-19T04:16:06.633913+0000","last_undegraded":"2024-01-19T04:16:06.633913+0000","last_fullsized":"2024-01-19T04:16:06.633913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:41.496335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086508+0000","last_change":"2024-01-19T04:16:06.660525+0000","last_active":"2024-01-19T04:16:08.086508+0000","last_peered":"2024-01-19T04:16:08.086508+0000","last_clean":"2024-01-19T04:16:08.086508+0000","last_became_active":"2024-01-19T04:16:06.659997+0000","last_became_peered":"2024-01-19T04:16:06.659997+0000","last_unstale":"2024-01-19T04:16:08.086508+0000","last_undegraded":"2024-01-19T04:16:08.086508+0000","last_fullsized":"2024-01-19T04:16:08.086508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:02.077588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642725+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:15:50.642725+0000","last_peered":"2024-01-19T04:15:50.642725+0000","last_clean":"2024-01-19T04:15:50.642725+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:15:50.642725+0000","last_undegraded":"2024-01-19T04:15:50.642725+0000","last_fullsized":"2024-01-19T04:15:50.642725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085834+0000","last_change":"2024-01-19T04:16:06.658837+0000","last_active":"2024-01-19T04:16:08.085834+0000","last_peered":"2024-01-19T04:16:08.085834+0000","last_clean":"2024-01-19T04:16:08.085834+0000","last_became_active":"2024-01-19T04:16:06.657952+0000","last_became_peered":"2024-01-19T04:16:06.657952+0000","last_unstale":"2024-01-19T04:16:08.085834+0000","last_undegraded":"2024-01-19T04:16:08.085834+0000","last_fullsized":"2024-01-19T04:16:08.085834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:30.123335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278237+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:15:51.278237+0000","last_peered":"2024-01-19T04:15:51.278237+0000","last_clean":"2024-01-19T04:15:51.278237+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:15:51.278237+0000","last_undegraded":"2024-01-19T04:15:51.278237+0000","last_fullsized":"2024-01-19T04:15:51.278237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638192+0000","last_change":"2024-01-19T04:15:49.664498+0000","last_active":"2024-01-19T04:16:06.638192+0000","last_peered":"2024-01-19T04:16:06.638192+0000","last_clean":"2024-01-19T04:16:06.638192+0000","last_became_active":"2024-01-19T04:15:49.664196+0000","last_became_peered":"2024-01-19T04:15:49.664196+0000","last_unstale":"2024-01-19T04:16:06.638192+0000","last_undegraded":"2024-01-19T04:16:06.638192+0000","last_fullsized":"2024-01-19T04:16:06.638192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086252+0000","last_change":"2024-01-19T04:16:06.657128+0000","last_active":"2024-01-19T04:16:08.086252+0000","last_peered":"2024-01-19T04:16:08.086252+0000","last_clean":"2024-01-19T04:16:08.086252+0000","last_became_active":"2024-01-19T04:16:06.656850+0000","last_became_peered":"2024-01-19T04:16:06.656850+0000","last_unstale":"2024-01-19T04:16:08.086252+0000","last_undegraded":"2024-01-19T04:16:08.086252+0000","last_fullsized":"2024-01-19T04:16:08.086252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:24:57.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:52.016567+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:15:52.016567+0000","last_peered":"2024-01-19T04:15:52.016567+0000","last_clean":"2024-01-19T04:15:52.016567+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:15:52.016567+0000","last_undegraded":"2024-01-19T04:15:52.016567+0000","last_fullsized":"2024-01-19T04:15:52.016567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659051+0000","last_change":"2024-01-19T04:16:06.654727+0000","last_active":"2024-01-19T04:16:06.659051+0000","last_peered":"2024-01-19T04:16:06.659051+0000","last_clean":"2024-01-19T04:16:06.659051+0000","last_became_active":"2024-01-19T04:16:06.654482+0000","last_became_peered":"2024-01-19T04:16:06.654482+0000","last_unstale":"2024-01-19T04:16:06.659051+0000","last_undegraded":"2024-01-19T04:16:06.659051+0000","last_fullsized":"2024-01-19T04:16:06.659051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:52.554202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.277738+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:15:51.277738+0000","last_peered":"2024-01-19T04:15:51.277738+0000","last_clean":"2024-01-19T04:15:51.277738+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:15:51.277738+0000","last_undegraded":"2024-01-19T04:15:51.277738+0000","last_fullsized":"2024-01-19T04:15:51.277738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.278338+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:15:51.278338+0000","last_peered":"2024-01-19T04:15:51.278338+0000","last_clean":"2024-01-19T04:15:51.278338+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:15:51.278338+0000","last_undegraded":"2024-01-19T04:15:51.278338+0000","last_fullsized":"2024-01-19T04:15:51.278338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085378+0000","last_change":"2024-01-19T04:16:06.663270+0000","last_active":"2024-01-19T04:16:08.085378+0000","last_peered":"2024-01-19T04:16:08.085378+0000","last_clean":"2024-01-19T04:16:08.085378+0000","last_became_active":"2024-01-19T04:16:06.661491+0000","last_became_peered":"2024-01-19T04:16:06.661491+0000","last_unstale":"2024-01-19T04:16:08.085378+0000","last_undegraded":"2024-01-19T04:16:08.085378+0000","last_fullsized":"2024-01-19T04:16:08.085378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:15.679645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790041+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:16:05.790041+0000","last_peered":"2024-01-19T04:16:05.790041+0000","last_clean":"2024-01-19T04:16:05.790041+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:16:05.790041+0000","last_undegraded":"2024-01-19T04:16:05.790041+0000","last_fullsized":"2024-01-19T04:16:05.790041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633823+0000","last_change":"2024-01-19T04:15:49.657523+0000","last_active":"2024-01-19T04:16:06.633823+0000","last_peered":"2024-01-19T04:16:06.633823+0000","last_clean":"2024-01-19T04:16:06.633823+0000","last_became_active":"2024-01-19T04:15:49.657239+0000","last_became_peered":"2024-01-19T04:15:49.657239+0000","last_unstale":"2024-01-19T04:16:06.633823+0000","last_undegraded":"2024-01-19T04:16:06.633823+0000","last_fullsized":"2024-01-19T04:16:06.633823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:50.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638676+0000","last_change":"2024-01-19T04:15:49.666858+0000","last_active":"2024-01-19T04:16:06.638676+0000","last_peered":"2024-01-19T04:16:06.638676+0000","last_clean":"2024-01-19T04:16:06.638676+0000","last_became_active":"2024-01-19T04:15:49.665093+0000","last_became_peered":"2024-01-19T04:15:49.665093+0000","last_unstale":"2024-01-19T04:16:06.638676+0000","last_undegraded":"2024-01-19T04:16:06.638676+0000","last_fullsized":"2024-01-19T04:16:06.638676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:50.642800+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:15:50.642800+0000","last_peered":"2024-01-19T04:15:50.642800+0000","last_clean":"2024-01-19T04:15:50.642800+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:15:50.642800+0000","last_undegraded":"2024-01-19T04:15:50.642800+0000","last_fullsized":"2024-01-19T04:15:50.642800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085694+0000","last_change":"2024-01-19T04:16:06.661023+0000","last_active":"2024-01-19T04:16:08.085694+0000","last_peered":"2024-01-19T04:16:08.085694+0000","last_clean":"2024-01-19T04:16:08.085694+0000","last_became_active":"2024-01-19T04:16:06.660642+0000","last_became_peered":"2024-01-19T04:16:06.660642+0000","last_unstale":"2024-01-19T04:16:08.085694+0000","last_undegraded":"2024-01-19T04:16:08.085694+0000","last_fullsized":"2024-01-19T04:16:08.085694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:00.472323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793039+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:16:05.793039+0000","last_peered":"2024-01-19T04:16:05.793039+0000","last_clean":"2024-01-19T04:16:05.793039+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:16:05.793039+0000","last_undegraded":"2024-01-19T04:16:05.793039+0000","last_fullsized":"2024-01-19T04:16:05.793039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:05.767857+0000","last_change":"2024-01-19T04:16:05.767857+0000","last_active":"2024-01-19T04:16:05.767857+0000","last_peered":"2024-01-19T04:16:05.767857+0000","last_clean":"2024-01-19T04:16:05.767857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:05.767857+0000","last_undegraded":"2024-01-19T04:16:05.767857+0000","last_fullsized":"2024-01-19T04:16:05.767857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-19T04:15:51.393618+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:15:51.393618+0000","last_peered":"2024-01-19T04:15:51.393618+0000","last_clean":"2024-01-19T04:15:51.393618+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:15:51.393618+0000","last_undegraded":"2024-01-19T04:15:51.393618+0000","last_fullsized":"2024-01-19T04:15:51.393618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":738768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.93999999999999995}]}]},{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93500000000000005}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.044}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.1459999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0720000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.026}]}]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.746},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.81200000000000006}]}]},{"osd":4,"up_from":16,"seq":68719476755,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":148414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.505},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.624}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.745},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.76600000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":178597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.255},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80900000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":180092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.032},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.96299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":767295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.876},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.94299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":450560,"data_stored":173503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.745}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:16:11.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-01-19T04:16:11.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.774083+0000', 'last_change': '2024-01-19T04:16:04.774083+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.774083+0000', 'last_undegraded': '2024-01-19T04:16:04.774083+0000', 'last_fullsized': '2024-01-19T04:16:04.774083+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-19T04:16:11.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-01-19T04:16:11.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.779011+0000', 'last_change': '2024-01-19T04:16:04.779011+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.779011+0000', 'last_undegraded': '2024-01-19T04:16:04.779011+0000', 'last_fullsized': '2024-01-19T04:16:04.779011+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T04:16:11.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-01-19T04:16:11.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.778670+0000', 'last_change': '2024-01-19T04:16:04.778670+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.778670+0000', 'last_undegraded': '2024-01-19T04:16:04.778670+0000', 'last_fullsized': '2024-01-19T04:16:04.778670+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.778700+0000', 'last_change': '2024-01-19T04:16:04.778700+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.778700+0000', 'last_undegraded': '2024-01-19T04:16:04.778700+0000', 'last_fullsized': '2024-01-19T04:16:04.778700+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.773895+0000', 'last_change': '2024-01-19T04:16:04.773895+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.773895+0000', 'last_undegraded': '2024-01-19T04:16:04.773895+0000', 'last_fullsized': '2024-01-19T04:16:04.773895+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-19T04:16:11.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.778562+0000', 'last_change': '2024-01-19T04:16:04.778562+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.778562+0000', 'last_undegraded': '2024-01-19T04:16:04.778562+0000', 'last_fullsized': '2024-01-19T04:16:04.778562+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.780866+0000', 'last_change': '2024-01-19T04:16:04.780866+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.780866+0000', 'last_undegraded': '2024-01-19T04:16:04.780866+0000', 'last_fullsized': '2024-01-19T04:16:04.780866+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.773997+0000', 'last_change': '2024-01-19T04:16:04.773997+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.773997+0000', 'last_undegraded': '2024-01-19T04:16:04.773997+0000', 'last_fullsized': '2024-01-19T04:16:04.773997+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.778609+0000', 'last_change': '2024-01-19T04:16:04.778609+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.778609+0000', 'last_undegraded': '2024-01-19T04:16:04.778609+0000', 'last_fullsized': '2024-01-19T04:16:04.778609+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-19T04:16:11.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.779249+0000', 'last_change': '2024-01-19T04:16:04.779249+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.779249+0000', 'last_undegraded': '2024-01-19T04:16:04.779249+0000', 'last_fullsized': '2024-01-19T04:16:04.779249+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-01-19T04:16:11.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.779187+0000', 'last_change': '2024-01-19T04:16:04.779187+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.779187+0000', 'last_undegraded': '2024-01-19T04:16:04.779187+0000', 'last_fullsized': '2024-01-19T04:16:04.779187+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.779700+0000', 'last_change': '2024-01-19T04:16:04.779700+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.779700+0000', 'last_undegraded': '2024-01-19T04:16:04.779700+0000', 'last_fullsized': '2024-01-19T04:16:04.779700+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.773970+0000', 'last_change': '2024-01-19T04:16:04.773970+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.773970+0000', 'last_undegraded': '2024-01-19T04:16:04.773970+0000', 'last_fullsized': '2024-01-19T04:16:04.773970+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-19T04:16:11.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.780313+0000', 'last_change': '2024-01-19T04:16:04.780313+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.780313+0000', 'last_undegraded': '2024-01-19T04:16:04.780313+0000', 'last_fullsized': '2024-01-19T04:16:04.780313+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:16:04.778666+0000', 'last_change': '2024-01-19T04:16:04.778666+0000', 'last_active': '2024-01-19T04:16:04.765525+0000', 'last_peered': '2024-01-19T04:16:04.765525+0000', 'last_clean': '2024-01-19T04:16:04.765525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:04.778666+0000', 'last_undegraded': '2024-01-19T04:16:04.778666+0000', 'last_fullsized': '2024-01-19T04:16:04.778666+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:04.765525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-01-19T04:16:11.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-01-19T04:16:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-01-19T04:16:11.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-01-19T04:16:11.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-01-19T04:16:11.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T04:16:05.767857+0000', 'last_change': '2024-01-19T04:16:05.767857+0000', 'last_active': '2024-01-19T04:16:05.767857+0000', 'last_peered': '2024-01-19T04:16:05.767857+0000', 'last_clean': '2024-01-19T04:16:05.767857+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:16:05.767857+0000', 'last_undegraded': '2024-01-19T04:16:05.767857+0000', 'last_fullsized': '2024-01-19T04:16:05.767857+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'last_clean_scrub_stamp': '2024-01-19T04:16:05.767857+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T04:16:11.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-19T04:16:11.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e83400640 1 Processor -- start 2024-01-19T04:16:11.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e83400640 1 -- start start 2024-01-19T04:16:11.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e83400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c1550e0 0x7f3e7c0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e83400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e7c06c670 0x7f3e7c071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e83400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c072730 con 0x7f3e7c14eb90 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e83400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c072a10 con 0x7f3e7c06c670 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e83400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c14ef70 con 0x7f3e7c1550e0 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e7be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c1550e0 0x7f3e7c0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e81400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3e7c06c670 0x7f3e7c071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e7be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c1550e0 0x7f3e7c0719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:60912/0 (socket says 172.21.15.32:60912) 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.874+0000 7f3e7be00640 1 -- 172.21.15.32:0/531898718 learned_addr learned my addr 172.21.15.32:0/531898718 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7be00640 1 -- 172.21.15.32:0/531898718 >> v2:172.21.15.67:3300/0 conn(0x7f3e7c06c670 msgr2=0x7f3e7c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7be00640 1 --2- 172.21.15.32:0/531898718 >> v2:172.21.15.67:3300/0 conn(0x7f3e7c06c670 0x7f3e7c071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7be00640 1 -- 172.21.15.32:0/531898718 >> v1:172.21.15.67:6789/0 conn(0x7f3e7c14eb90 legacy=0x7f3e7c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7be00640 1 -- 172.21.15.32:0/531898718 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c155580 con 0x7f3e7c1550e0 2024-01-19T04:16:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7be00640 1 --2- 172.21.15.32:0/531898718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c1550e0 0x7f3e7c0719a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e6401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc8a7d51de69cb9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7b400640 1 -- 172.21.15.32:0/531898718 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640ac620 con 0x7f3e7c1550e0 2024-01-19T04:16:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7b400640 1 -- 172.21.15.32:0/531898718 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e640ac780 con 0x7f3e7c1550e0 2024-01-19T04:16:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.878+0000 7f3e7b400640 1 -- 172.21.15.32:0/531898718 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640acb10 con 0x7f3e7c1550e0 2024-01-19T04:16:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- 172.21.15.32:0/531898718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c1550e0 msgr2=0x7f3e7c0719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 --2- 172.21.15.32:0/531898718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c1550e0 0x7f3e7c0719a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e6401c4b0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- 172.21.15.32:0/531898718 shutdown_connections 2024-01-19T04:16:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 --2- 172.21.15.32:0/531898718 >> v2:172.21.15.67:3300/0 conn(0x7f3e7c06c670 0x7f3e7c071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 --2- 172.21.15.32:0/531898718 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c1550e0 0x7f3e7c0719a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- 172.21.15.32:0/531898718 >> 172.21.15.32:0/531898718 conn(0x7f3e7c0c25a0 msgr2=0x7f3e7c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- 172.21.15.32:0/531898718 shutdown_connections 2024-01-19T04:16:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- 172.21.15.32:0/531898718 wait complete. 2024-01-19T04:16:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 Processor -- start 2024-01-19T04:16:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- start start 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c06c670 0x7f3e7c0a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e7c14eb90 0x7f3e7c1ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e7c1550e0 0x7f3e7c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c152eb0 con 0x7f3e7c1550e0 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0a7620 con 0x7f3e7c14eb90 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e83400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0c0490 con 0x7f3e7c06c670 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e81400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e7c1550e0 0x7f3e7c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e81400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e7c1550e0 0x7f3e7c15a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43382/0 (socket says 172.21.15.32:43382) 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e81400640 1 -- 172.21.15.32:0/931814200 learned_addr learned my addr 172.21.15.32:0/931814200 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e7be00640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e7c14eb90 0x7f3e7c1ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.882+0000 7f3e80a00640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c06c670 0x7f3e7c0a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e81400640 1 -- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c06c670 msgr2=0x7f3e7c0a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e81400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c06c670 0x7f3e7c0a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e81400640 1 -- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e7c14eb90 msgr2=0x7f3e7c1ed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e81400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e7c14eb90 0x7f3e7c1ed240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e81400640 1 -- 172.21.15.32:0/931814200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640094d0 con 0x7f3e7c1550e0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e81400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e7c1550e0 0x7f3e7c15a340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400efc0 tx=0x7f3e7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e78c00640 1 -- 172.21.15.32:0/931814200 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74014480 con 0x7f3e7c1550e0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e78c00640 1 -- 172.21.15.32:0/931814200 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7400f040 con 0x7f3e7c1550e0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e78c00640 1 -- 172.21.15.32:0/931814200 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74014820 con 0x7f3e7c1550e0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c0c0770 con 0x7f3e7c1550e0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c0a6bc0 con 0x7f3e7c1550e0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c0749f0 con 0x7f3e7c1550e0 2024-01-19T04:16:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e78c00640 1 -- 172.21.15.32:0/931814200 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3e74014980 con 0x7f3e7c1550e0 2024-01-19T04:16:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e78c00640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e54066530 0x7f3e540689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.886+0000 7f3e78c00640 1 -- 172.21.15.32:0/931814200 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3e74084f50 con 0x7f3e7c1550e0 2024-01-19T04:16:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.890+0000 7f3e80a00640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e54066530 0x7f3e540689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.890+0000 7f3e80a00640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e54066530 0x7f3e540689f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c001810 tx=0x7f3e6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:11.890+0000 7f3e78c00640 1 -- 172.21.15.32:0/931814200 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3e74051f30 con 0x7f3e7c1550e0 2024-01-19T04:16:12.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.106+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3e7c0c54d0 con 0x7f3e7c1550e0 2024-01-19T04:16:12.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.106+0000 7f3e78c00640 1 -- 172.21.15.32:0/931814200 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1826 (secure 0 0 0) 0x7f3e74018080 con 0x7f3e7c1550e0 2024-01-19T04:16:12.109 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:12.109 INFO:teuthology.orchestra.run.smithi032.stdout:{"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":95,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1705637689,"num_in_osds":8,"osd_in_since":1705637679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":146},{"state_name":"unknown","count":32},{"state_name":"creating+peering","count":15}],"num_pgs":193,"num_pools":5,"num_objects":39,"data_bytes":596523,"bytes_used":242987008,"bytes_avail":772851126272,"bytes_total":773094113280,"unknown_pgs_ratio":0.16580310463905334,"inactive_pgs_ratio":0.077720209956169128,"write_bytes_sec":2329,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":21,"id":2,"up":1,"in":1,"max":1,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5028},{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5031}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-19T04:15:52.040511+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e54066530 msgr2=0x7f3e540689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e54066530 0x7f3e540689f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c001810 tx=0x7f3e6c009040 comp rx=0 tx=0).stop 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e7c1550e0 msgr2=0x7f3e7c15a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e7c1550e0 0x7f3e7c15a340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400efc0 tx=0x7f3e7400c490 comp rx=0 tx=0).stop 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 shutdown_connections 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e54066530 0x7f3e540689f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e7c1550e0 0x7f3e7c15a340 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e7c14eb90 0x7f3e7c1ed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 --2- 172.21.15.32:0/931814200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e7c06c670 0x7f3e7c0a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 >> 172.21.15.32:0/931814200 conn(0x7f3e7c0c25a0 msgr2=0x7f3e7c14ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 shutdown_connections 2024-01-19T04:16:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.110+0000 7f3e83400640 1 -- 172.21.15.32:0/931814200 wait complete. 2024-01-19T04:16:12.130 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-19T04:16:12.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:16:12.190 INFO:tasks.ceph.mds.c.smithi032.stderr:2024-01-19T04:16:12.190+0000 7f7060e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:16:12.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c4400640 1 Processor -- start 2024-01-19T04:16:12.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c4400640 1 -- start start 2024-01-19T04:16:12.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c4400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87bc06dd40 0x7f87bc0a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:12.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c4400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc154b60 con 0x7f87bc0bfff0 2024-01-19T04:16:12.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c4400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc072820 con 0x7f87bc151d20 2024-01-19T04:16:12.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c4400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87bc152100 con 0x7f87bc06dd40 2024-01-19T04:16:12.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c2400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87bc06dd40 0x7f87bc0a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:12.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c2400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87bc06dd40 0x7f87bc0a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43392/0 (socket says 172.21.15.32:43392) 2024-01-19T04:16:12.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c2400640 1 -- 172.21.15.32:0/4235086943 learned_addr learned my addr 172.21.15.32:0/4235086943 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:12.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c2400640 1 -- 172.21.15.32:0/4235086943 >> v1:172.21.15.67:6789/0 conn(0x7f87bc151d20 legacy=0x7f87bc154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c2400640 1 -- 172.21.15.32:0/4235086943 >> v1:172.21.15.32:6789/0 conn(0x7f87bc0bfff0 legacy=0x7f87bc072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87c2400640 1 -- 172.21.15.32:0/4235086943 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc072b00 con 0x7f87bc06dd40 2024-01-19T04:16:12.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.270+0000 7f87bbe00640 1 -- 172.21.15.32:0/4235086943 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161675031 0 0) 0x7f87bc154b60 con 0x7f87bc0bfff0 2024-01-19T04:16:12.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c2400640 1 --2- 172.21.15.32:0/4235086943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc06dd40 0x7f87bc0a5eb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009e50 tx=0x7f87b401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0a83975a60f1c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:12.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87bbe00640 1 -- 172.21.15.32:0/4235086943 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b40a57f0 con 0x7f87bc06dd40 2024-01-19T04:16:12.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87bbe00640 1 -- 172.21.15.32:0/4235086943 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b40a5950 con 0x7f87bc06dd40 2024-01-19T04:16:12.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87bbe00640 1 -- 172.21.15.32:0/4235086943 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b40a5ce0 con 0x7f87bc06dd40 2024-01-19T04:16:12.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c4400640 1 -- 172.21.15.32:0/4235086943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc06dd40 msgr2=0x7f87bc0a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c4400640 1 --2- 172.21.15.32:0/4235086943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc06dd40 0x7f87bc0a5eb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009e50 tx=0x7f87b401ca10 comp rx=0 tx=0).stop 2024-01-19T04:16:12.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c4400640 1 -- 172.21.15.32:0/4235086943 shutdown_connections 2024-01-19T04:16:12.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c4400640 1 --2- 172.21.15.32:0/4235086943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc06dd40 0x7f87bc0a5eb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c4400640 1 -- 172.21.15.32:0/4235086943 >> 172.21.15.32:0/4235086943 conn(0x7f87bc0a8970 msgr2=0x7f87bc0a8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:12.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c4400640 1 -- 172.21.15.32:0/4235086943 shutdown_connections 2024-01-19T04:16:12.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.274+0000 7f87c4400640 1 -- 172.21.15.32:0/4235086943 wait complete. 2024-01-19T04:16:12.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 Processor -- start 2024-01-19T04:16:12.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 -- start start 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc06dd40 0x7f87bc0aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87bc0bfff0 0x7f87bc1f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc151d20 0x7f87bc145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0c0770 con 0x7f87bc151d20 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0ab430 con 0x7f87bc06dd40 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc1ed360 con 0x7f87bc0bfff0 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc151d20 0x7f87bc145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc151d20 0x7f87bc145fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43400/0 (socket says 172.21.15.32:43400) 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 -- 172.21.15.32:0/481374060 learned_addr learned my addr 172.21.15.32:0/481374060 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c1a00640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc06dd40 0x7f87bc0aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c1000640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87bc0bfff0 0x7f87bc1f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 -- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87bc0bfff0 msgr2=0x7f87bc1f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87bc0bfff0 0x7f87bc1f1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 -- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc06dd40 msgr2=0x7f87bc0aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc06dd40 0x7f87bc0aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 -- 172.21.15.32:0/481374060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b4009b30 con 0x7f87bc151d20 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c2400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc151d20 0x7f87bc145fd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f87b40af040 tx=0x7f87b40197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87b9600640 1 -- 172.21.15.32:0/481374060 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b8670 con 0x7f87bc151d20 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87b9600640 1 -- 172.21.15.32:0/481374060 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b40b87d0 con 0x7f87bc151d20 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87b9600640 1 -- 172.21.15.32:0/481374060 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b8b60 con 0x7f87bc151d20 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc0ab900 con 0x7f87bc151d20 2024-01-19T04:16:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.278+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc1ed570 con 0x7f87bc151d20 2024-01-19T04:16:12.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.282+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc0749f0 con 0x7f87bc151d20 2024-01-19T04:16:12.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.282+0000 7f87b9600640 1 -- 172.21.15.32:0/481374060 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f87b40b8cc0 con 0x7f87bc151d20 2024-01-19T04:16:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.282+0000 7f87b9600640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8794066530 0x7f87940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.282+0000 7f87b9600640 1 -- 172.21.15.32:0/481374060 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f87b411f2b0 con 0x7f87bc151d20 2024-01-19T04:16:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.282+0000 7f87c1a00640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8794066530 0x7f87940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:12.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.282+0000 7f87c1a00640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8794066530 0x7f87940689f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000f70 tx=0x7f87ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:12.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.286+0000 7f87b9600640 1 -- 172.21.15.32:0/481374060 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f87b40ec330 con 0x7f87bc151d20 2024-01-19T04:16:12.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.446+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87bc1f1840 con 0x7f8794066530 2024-01-19T04:16:12.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.462+0000 7f87b9600640 1 -- 172.21.15.32:0/481374060 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527627 (secure 0 0 0) 0x7f87ac001370 con 0x7f8794066530 2024-01-19T04:16:12.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:12.472 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8794066530 msgr2=0x7f87940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8794066530 0x7f87940689f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000f70 tx=0x7f87ac009040 comp rx=0 tx=0).stop 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc151d20 msgr2=0x7f87bc145fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc151d20 0x7f87bc145fd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f87b40af040 tx=0x7f87b40197b0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 shutdown_connections 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8794066530 0x7f87940689f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87bc151d20 0x7f87bc145fd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87bc0bfff0 0x7f87bc1f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 --2- 172.21.15.32:0/481374060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87bc06dd40 0x7f87bc0aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:12.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 >> 172.21.15.32:0/481374060 conn(0x7f87bc0a8970 msgr2=0x7f87bc0a8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:12.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 shutdown_connections 2024-01-19T04:16:12.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:12.466+0000 7f87c4400640 1 -- 172.21.15.32:0/481374060 wait complete. 2024-01-19T04:16:12.489 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-01-19T04:16:12.044898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":357,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237508,"kb_used_data":4668,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737212,"statfs":{"total":773094113280,"available":772850905088,"internally_reserved":0,"allocated":4780032,"data_stored":2601353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.272621"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086760+0000","last_change":"2024-01-19T04:16:06.662967+0000","last_active":"2024-01-19T04:16:08.086760+0000","last_peered":"2024-01-19T04:16:08.086760+0000","last_clean":"2024-01-19T04:16:08.086760+0000","last_became_active":"2024-01-19T04:16:06.662697+0000","last_became_peered":"2024-01-19T04:16:06.662697+0000","last_unstale":"2024-01-19T04:16:08.086760+0000","last_undegraded":"2024-01-19T04:16:08.086760+0000","last_fullsized":"2024-01-19T04:16:08.086760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642222+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:16:06.642222+0000","last_peered":"2024-01-19T04:16:06.642222+0000","last_clean":"2024-01-19T04:16:06.642222+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:16:06.642222+0000","last_undegraded":"2024-01-19T04:16:06.642222+0000","last_fullsized":"2024-01-19T04:16:06.642222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637564+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:16:06.637564+0000","last_peered":"2024-01-19T04:16:06.637564+0000","last_clean":"2024-01-19T04:16:06.637564+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:16:06.637564+0000","last_undegraded":"2024-01-19T04:16:06.637564+0000","last_fullsized":"2024-01-19T04:16:06.637564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643895+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:16:06.643895+0000","last_peered":"2024-01-19T04:16:06.643895+0000","last_clean":"2024-01-19T04:16:06.643895+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:16:06.643895+0000","last_undegraded":"2024-01-19T04:16:06.643895+0000","last_fullsized":"2024-01-19T04:16:06.643895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.787473+0000","last_change":"2024-01-19T04:16:05.796195+0000","last_active":"2024-01-19T04:16:06.787473+0000","last_peered":"2024-01-19T04:16:06.787473+0000","last_clean":"2024-01-19T04:16:06.787473+0000","last_became_active":"2024-01-19T04:16:05.795881+0000","last_became_peered":"2024-01-19T04:16:05.795881+0000","last_unstale":"2024-01-19T04:16:06.787473+0000","last_undegraded":"2024-01-19T04:16:06.787473+0000","last_fullsized":"2024-01-19T04:16:06.787473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:37.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659382+0000","last_change":"2024-01-19T04:16:06.654967+0000","last_active":"2024-01-19T04:16:06.659382+0000","last_peered":"2024-01-19T04:16:06.659382+0000","last_clean":"2024-01-19T04:16:06.659382+0000","last_became_active":"2024-01-19T04:16:06.653661+0000","last_became_peered":"2024-01-19T04:16:06.653661+0000","last_unstale":"2024-01-19T04:16:06.659382+0000","last_undegraded":"2024-01-19T04:16:06.659382+0000","last_fullsized":"2024-01-19T04:16:06.659382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:00:48.794156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788581+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:16:05.788581+0000","last_peered":"2024-01-19T04:16:05.788581+0000","last_clean":"2024-01-19T04:16:05.788581+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:16:05.788581+0000","last_undegraded":"2024-01-19T04:16:05.788581+0000","last_fullsized":"2024-01-19T04:16:05.788581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646415+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:16:06.646415+0000","last_peered":"2024-01-19T04:16:06.646415+0000","last_clean":"2024-01-19T04:16:06.646415+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:16:06.646415+0000","last_undegraded":"2024-01-19T04:16:06.646415+0000","last_fullsized":"2024-01-19T04:16:06.646415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644324+0000","last_change":"2024-01-19T04:16:05.798357+0000","last_active":"2024-01-19T04:16:06.644324+0000","last_peered":"2024-01-19T04:16:06.644324+0000","last_clean":"2024-01-19T04:16:06.644324+0000","last_became_active":"2024-01-19T04:16:05.797943+0000","last_became_peered":"2024-01-19T04:16:05.797943+0000","last_unstale":"2024-01-19T04:16:06.644324+0000","last_undegraded":"2024-01-19T04:16:06.644324+0000","last_fullsized":"2024-01-19T04:16:06.644324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658445+0000","last_change":"2024-01-19T04:16:06.649757+0000","last_active":"2024-01-19T04:16:06.658445+0000","last_peered":"2024-01-19T04:16:06.658445+0000","last_clean":"2024-01-19T04:16:06.658445+0000","last_became_active":"2024-01-19T04:16:06.649522+0000","last_became_peered":"2024-01-19T04:16:06.649522+0000","last_unstale":"2024-01-19T04:16:06.658445+0000","last_undegraded":"2024-01-19T04:16:06.658445+0000","last_fullsized":"2024-01-19T04:16:06.658445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:52.103572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646597+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:16:06.646597+0000","last_peered":"2024-01-19T04:16:06.646597+0000","last_clean":"2024-01-19T04:16:06.646597+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:16:06.646597+0000","last_undegraded":"2024-01-19T04:16:06.646597+0000","last_fullsized":"2024-01-19T04:16:06.646597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788338+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:16:05.788338+0000","last_peered":"2024-01-19T04:16:05.788338+0000","last_clean":"2024-01-19T04:16:05.788338+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:16:05.788338+0000","last_undegraded":"2024-01-19T04:16:05.788338+0000","last_fullsized":"2024-01-19T04:16:05.788338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642445+0000","last_change":"2024-01-19T04:16:05.796165+0000","last_active":"2024-01-19T04:16:06.642445+0000","last_peered":"2024-01-19T04:16:06.642445+0000","last_clean":"2024-01-19T04:16:06.642445+0000","last_became_active":"2024-01-19T04:16:05.795971+0000","last_became_peered":"2024-01-19T04:16:05.795971+0000","last_unstale":"2024-01-19T04:16:06.642445+0000","last_undegraded":"2024-01-19T04:16:06.642445+0000","last_fullsized":"2024-01-19T04:16:06.642445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:25.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.638475+0000","last_change":"2024-01-19T04:16:06.652148+0000","last_active":"2024-01-19T04:16:07.638475+0000","last_peered":"2024-01-19T04:16:07.638475+0000","last_clean":"2024-01-19T04:16:07.638475+0000","last_became_active":"2024-01-19T04:16:06.651819+0000","last_became_peered":"2024-01-19T04:16:06.651819+0000","last_unstale":"2024-01-19T04:16:07.638475+0000","last_undegraded":"2024-01-19T04:16:07.638475+0000","last_fullsized":"2024-01-19T04:16:07.638475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:55:31.123742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637633+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:16:06.637633+0000","last_peered":"2024-01-19T04:16:06.637633+0000","last_clean":"2024-01-19T04:16:06.637633+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:16:06.637633+0000","last_undegraded":"2024-01-19T04:16:06.637633+0000","last_fullsized":"2024-01-19T04:16:06.637633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650232+0000","last_change":"2024-01-19T04:15:49.653943+0000","last_active":"2024-01-19T04:16:06.650232+0000","last_peered":"2024-01-19T04:16:06.650232+0000","last_clean":"2024-01-19T04:16:06.650232+0000","last_became_active":"2024-01-19T04:15:49.653669+0000","last_became_peered":"2024-01-19T04:15:49.653669+0000","last_unstale":"2024-01-19T04:16:06.650232+0000","last_undegraded":"2024-01-19T04:16:06.650232+0000","last_fullsized":"2024-01-19T04:16:06.650232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084761+0000","last_change":"2024-01-19T04:16:05.798495+0000","last_active":"2024-01-19T04:16:08.084761+0000","last_peered":"2024-01-19T04:16:08.084761+0000","last_clean":"2024-01-19T04:16:08.084761+0000","last_became_active":"2024-01-19T04:16:05.797905+0000","last_became_peered":"2024-01-19T04:16:05.797905+0000","last_unstale":"2024-01-19T04:16:08.084761+0000","last_undegraded":"2024-01-19T04:16:08.084761+0000","last_fullsized":"2024-01-19T04:16:08.084761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084385+0000","last_change":"2024-01-19T04:16:06.657675+0000","last_active":"2024-01-19T04:16:08.084385+0000","last_peered":"2024-01-19T04:16:08.084385+0000","last_clean":"2024-01-19T04:16:08.084385+0000","last_became_active":"2024-01-19T04:16:06.657403+0000","last_became_peered":"2024-01-19T04:16:06.657403+0000","last_unstale":"2024-01-19T04:16:08.084385+0000","last_undegraded":"2024-01-19T04:16:08.084385+0000","last_fullsized":"2024-01-19T04:16:08.084385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:20.839193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650407+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:16:06.650407+0000","last_peered":"2024-01-19T04:16:06.650407+0000","last_clean":"2024-01-19T04:16:06.650407+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:16:06.650407+0000","last_undegraded":"2024-01-19T04:16:06.650407+0000","last_fullsized":"2024-01-19T04:16:06.650407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637174+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:16:06.637174+0000","last_peered":"2024-01-19T04:16:06.637174+0000","last_clean":"2024-01-19T04:16:06.637174+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:16:06.637174+0000","last_undegraded":"2024-01-19T04:16:06.637174+0000","last_fullsized":"2024-01-19T04:16:06.637174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084600+0000","last_change":"2024-01-19T04:16:05.790864+0000","last_active":"2024-01-19T04:16:08.084600+0000","last_peered":"2024-01-19T04:16:08.084600+0000","last_clean":"2024-01-19T04:16:08.084600+0000","last_became_active":"2024-01-19T04:16:05.790554+0000","last_became_peered":"2024-01-19T04:16:05.790554+0000","last_unstale":"2024-01-19T04:16:08.084600+0000","last_undegraded":"2024-01-19T04:16:08.084600+0000","last_fullsized":"2024-01-19T04:16:08.084600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086361+0000","last_change":"2024-01-19T04:16:06.658541+0000","last_active":"2024-01-19T04:16:08.086361+0000","last_peered":"2024-01-19T04:16:08.086361+0000","last_clean":"2024-01-19T04:16:08.086361+0000","last_became_active":"2024-01-19T04:16:06.657934+0000","last_became_peered":"2024-01-19T04:16:06.657934+0000","last_unstale":"2024-01-19T04:16:08.086361+0000","last_undegraded":"2024-01-19T04:16:08.086361+0000","last_fullsized":"2024-01-19T04:16:08.086361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:18:45.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639010+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:16:06.639010+0000","last_peered":"2024-01-19T04:16:06.639010+0000","last_clean":"2024-01-19T04:16:06.639010+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:16:06.639010+0000","last_undegraded":"2024-01-19T04:16:06.639010+0000","last_fullsized":"2024-01-19T04:16:06.639010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650609+0000","last_change":"2024-01-19T04:15:49.667426+0000","last_active":"2024-01-19T04:16:06.650609+0000","last_peered":"2024-01-19T04:16:06.650609+0000","last_clean":"2024-01-19T04:16:06.650609+0000","last_became_active":"2024-01-19T04:15:49.667142+0000","last_became_peered":"2024-01-19T04:15:49.667142+0000","last_unstale":"2024-01-19T04:16:06.650609+0000","last_undegraded":"2024-01-19T04:16:06.650609+0000","last_fullsized":"2024-01-19T04:16:06.650609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640695+0000","last_change":"2024-01-19T04:16:05.797053+0000","last_active":"2024-01-19T04:16:06.640695+0000","last_peered":"2024-01-19T04:16:06.640695+0000","last_clean":"2024-01-19T04:16:06.640695+0000","last_became_active":"2024-01-19T04:16:05.796727+0000","last_became_peered":"2024-01-19T04:16:05.796727+0000","last_unstale":"2024-01-19T04:16:06.640695+0000","last_undegraded":"2024-01-19T04:16:06.640695+0000","last_fullsized":"2024-01-19T04:16:06.640695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:28:03.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080592+0000","last_change":"2024-01-19T04:16:06.655879+0000","last_active":"2024-01-19T04:16:08.080592+0000","last_peered":"2024-01-19T04:16:08.080592+0000","last_clean":"2024-01-19T04:16:08.080592+0000","last_became_active":"2024-01-19T04:16:06.655559+0000","last_became_peered":"2024-01-19T04:16:06.655559+0000","last_unstale":"2024-01-19T04:16:08.080592+0000","last_undegraded":"2024-01-19T04:16:08.080592+0000","last_fullsized":"2024-01-19T04:16:08.080592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:48.677866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651211+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:16:06.651211+0000","last_peered":"2024-01-19T04:16:06.651211+0000","last_clean":"2024-01-19T04:16:06.651211+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:16:06.651211+0000","last_undegraded":"2024-01-19T04:16:06.651211+0000","last_fullsized":"2024-01-19T04:16:06.651211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641445+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:16:06.641445+0000","last_peered":"2024-01-19T04:16:06.641445+0000","last_clean":"2024-01-19T04:16:06.641445+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:16:06.641445+0000","last_undegraded":"2024-01-19T04:16:06.641445+0000","last_fullsized":"2024-01-19T04:16:06.641445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084410+0000","last_change":"2024-01-19T04:16:05.794126+0000","last_active":"2024-01-19T04:16:08.084410+0000","last_peered":"2024-01-19T04:16:08.084410+0000","last_clean":"2024-01-19T04:16:08.084410+0000","last_became_active":"2024-01-19T04:16:05.793821+0000","last_became_peered":"2024-01-19T04:16:05.793821+0000","last_unstale":"2024-01-19T04:16:08.084410+0000","last_undegraded":"2024-01-19T04:16:08.084410+0000","last_fullsized":"2024-01-19T04:16:08.084410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085125+0000","last_change":"2024-01-19T04:16:06.654711+0000","last_active":"2024-01-19T04:16:08.085125+0000","last_peered":"2024-01-19T04:16:08.085125+0000","last_clean":"2024-01-19T04:16:08.085125+0000","last_became_active":"2024-01-19T04:16:06.654442+0000","last_became_peered":"2024-01-19T04:16:06.654442+0000","last_unstale":"2024-01-19T04:16:08.085125+0000","last_undegraded":"2024-01-19T04:16:08.085125+0000","last_fullsized":"2024-01-19T04:16:08.085125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:13.662662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638284+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:16:06.638284+0000","last_peered":"2024-01-19T04:16:06.638284+0000","last_clean":"2024-01-19T04:16:06.638284+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:16:06.638284+0000","last_undegraded":"2024-01-19T04:16:06.638284+0000","last_fullsized":"2024-01-19T04:16:06.638284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634955+0000","last_change":"2024-01-19T04:15:49.680184+0000","last_active":"2024-01-19T04:16:06.634955+0000","last_peered":"2024-01-19T04:16:06.634955+0000","last_clean":"2024-01-19T04:16:06.634955+0000","last_became_active":"2024-01-19T04:15:49.679925+0000","last_became_peered":"2024-01-19T04:15:49.679925+0000","last_unstale":"2024-01-19T04:16:06.634955+0000","last_undegraded":"2024-01-19T04:16:06.634955+0000","last_fullsized":"2024-01-19T04:16:06.634955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644692+0000","last_change":"2024-01-19T04:16:05.796232+0000","last_active":"2024-01-19T04:16:06.644692+0000","last_peered":"2024-01-19T04:16:06.644692+0000","last_clean":"2024-01-19T04:16:06.644692+0000","last_became_active":"2024-01-19T04:16:05.795908+0000","last_became_peered":"2024-01-19T04:16:05.795908+0000","last_unstale":"2024-01-19T04:16:06.644692+0000","last_undegraded":"2024-01-19T04:16:06.644692+0000","last_fullsized":"2024-01-19T04:16:06.644692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:14.677313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084379+0000","last_change":"2024-01-19T04:16:06.651279+0000","last_active":"2024-01-19T04:16:08.084379+0000","last_peered":"2024-01-19T04:16:08.084379+0000","last_clean":"2024-01-19T04:16:08.084379+0000","last_became_active":"2024-01-19T04:16:06.651097+0000","last_became_peered":"2024-01-19T04:16:06.651097+0000","last_unstale":"2024-01-19T04:16:08.084379+0000","last_undegraded":"2024-01-19T04:16:08.084379+0000","last_fullsized":"2024-01-19T04:16:08.084379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:25:40.860239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639829+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:16:06.639829+0000","last_peered":"2024-01-19T04:16:06.639829+0000","last_clean":"2024-01-19T04:16:06.639829+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:16:06.639829+0000","last_undegraded":"2024-01-19T04:16:06.639829+0000","last_fullsized":"2024-01-19T04:16:06.639829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.647108+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:16:06.647108+0000","last_peered":"2024-01-19T04:16:06.647108+0000","last_clean":"2024-01-19T04:16:06.647108+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:16:06.647108+0000","last_undegraded":"2024-01-19T04:16:06.647108+0000","last_fullsized":"2024-01-19T04:16:06.647108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640162+0000","last_change":"2024-01-19T04:16:05.797613+0000","last_active":"2024-01-19T04:16:06.640162+0000","last_peered":"2024-01-19T04:16:06.640162+0000","last_clean":"2024-01-19T04:16:06.640162+0000","last_became_active":"2024-01-19T04:16:05.797323+0000","last_became_peered":"2024-01-19T04:16:05.797323+0000","last_unstale":"2024-01-19T04:16:06.640162+0000","last_undegraded":"2024-01-19T04:16:06.640162+0000","last_fullsized":"2024-01-19T04:16:06.640162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:53.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659412+0000","last_change":"2024-01-19T04:16:06.655628+0000","last_active":"2024-01-19T04:16:06.659412+0000","last_peered":"2024-01-19T04:16:06.659412+0000","last_clean":"2024-01-19T04:16:06.659412+0000","last_became_active":"2024-01-19T04:16:06.653875+0000","last_became_peered":"2024-01-19T04:16:06.653875+0000","last_unstale":"2024-01-19T04:16:06.659412+0000","last_undegraded":"2024-01-19T04:16:06.659412+0000","last_fullsized":"2024-01-19T04:16:06.659412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:14.839980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646506+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:16:06.646506+0000","last_peered":"2024-01-19T04:16:06.646506+0000","last_clean":"2024-01-19T04:16:06.646506+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:16:06.646506+0000","last_undegraded":"2024-01-19T04:16:06.646506+0000","last_fullsized":"2024-01-19T04:16:06.646506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634212+0000","last_change":"2024-01-19T04:15:49.660917+0000","last_active":"2024-01-19T04:16:06.634212+0000","last_peered":"2024-01-19T04:16:06.634212+0000","last_clean":"2024-01-19T04:16:06.634212+0000","last_became_active":"2024-01-19T04:15:49.655137+0000","last_became_peered":"2024-01-19T04:15:49.655137+0000","last_unstale":"2024-01-19T04:16:06.634212+0000","last_undegraded":"2024-01-19T04:16:06.634212+0000","last_fullsized":"2024-01-19T04:16:06.634212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:05:00.093326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788476+0000","last_change":"2024-01-19T04:16:05.795319+0000","last_active":"2024-01-19T04:16:06.788476+0000","last_peered":"2024-01-19T04:16:06.788476+0000","last_clean":"2024-01-19T04:16:06.788476+0000","last_became_active":"2024-01-19T04:16:05.794958+0000","last_became_peered":"2024-01-19T04:16:05.794958+0000","last_unstale":"2024-01-19T04:16:06.788476+0000","last_undegraded":"2024-01-19T04:16:06.788476+0000","last_fullsized":"2024-01-19T04:16:06.788476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:55:40.046252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084469+0000","last_change":"2024-01-19T04:16:06.659222+0000","last_active":"2024-01-19T04:16:08.084469+0000","last_peered":"2024-01-19T04:16:08.084469+0000","last_clean":"2024-01-19T04:16:08.084469+0000","last_became_active":"2024-01-19T04:16:06.657419+0000","last_became_peered":"2024-01-19T04:16:06.657419+0000","last_unstale":"2024-01-19T04:16:08.084469+0000","last_undegraded":"2024-01-19T04:16:08.084469+0000","last_fullsized":"2024-01-19T04:16:08.084469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:38.868186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637266+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:16:06.637266+0000","last_peered":"2024-01-19T04:16:06.637266+0000","last_clean":"2024-01-19T04:16:06.637266+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:16:06.637266+0000","last_undegraded":"2024-01-19T04:16:06.637266+0000","last_fullsized":"2024-01-19T04:16:06.637266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633993+0000","last_change":"2024-01-19T04:15:49.657920+0000","last_active":"2024-01-19T04:16:06.633993+0000","last_peered":"2024-01-19T04:16:06.633993+0000","last_clean":"2024-01-19T04:16:06.633993+0000","last_became_active":"2024-01-19T04:15:49.657332+0000","last_became_peered":"2024-01-19T04:15:49.657332+0000","last_unstale":"2024-01-19T04:16:06.633993+0000","last_undegraded":"2024-01-19T04:16:06.633993+0000","last_fullsized":"2024-01-19T04:16:06.633993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:10.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642720+0000","last_change":"2024-01-19T04:16:05.796585+0000","last_active":"2024-01-19T04:16:06.642720+0000","last_peered":"2024-01-19T04:16:06.642720+0000","last_clean":"2024-01-19T04:16:06.642720+0000","last_became_active":"2024-01-19T04:16:05.796302+0000","last_became_peered":"2024-01-19T04:16:05.796302+0000","last_unstale":"2024-01-19T04:16:06.642720+0000","last_undegraded":"2024-01-19T04:16:06.642720+0000","last_fullsized":"2024-01-19T04:16:06.642720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:37.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635132+0000","last_change":"2024-01-19T04:16:06.653073+0000","last_active":"2024-01-19T04:16:07.635132+0000","last_peered":"2024-01-19T04:16:07.635132+0000","last_clean":"2024-01-19T04:16:07.635132+0000","last_became_active":"2024-01-19T04:16:06.652783+0000","last_became_peered":"2024-01-19T04:16:06.652783+0000","last_unstale":"2024-01-19T04:16:07.635132+0000","last_undegraded":"2024-01-19T04:16:07.635132+0000","last_fullsized":"2024-01-19T04:16:07.635132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:43.230089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650249+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:16:06.650249+0000","last_peered":"2024-01-19T04:16:06.650249+0000","last_clean":"2024-01-19T04:16:06.650249+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:16:06.650249+0000","last_undegraded":"2024-01-19T04:16:06.650249+0000","last_fullsized":"2024-01-19T04:16:06.650249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633575+0000","last_change":"2024-01-19T04:15:49.669616+0000","last_active":"2024-01-19T04:16:06.633575+0000","last_peered":"2024-01-19T04:16:06.633575+0000","last_clean":"2024-01-19T04:16:06.633575+0000","last_became_active":"2024-01-19T04:15:49.667904+0000","last_became_peered":"2024-01-19T04:15:49.667904+0000","last_unstale":"2024-01-19T04:16:06.633575+0000","last_undegraded":"2024-01-19T04:16:06.633575+0000","last_fullsized":"2024-01-19T04:16:06.633575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:52.911948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084542+0000","last_change":"2024-01-19T04:16:05.797377+0000","last_active":"2024-01-19T04:16:08.084542+0000","last_peered":"2024-01-19T04:16:08.084542+0000","last_clean":"2024-01-19T04:16:08.084542+0000","last_became_active":"2024-01-19T04:16:05.797125+0000","last_became_peered":"2024-01-19T04:16:05.797125+0000","last_unstale":"2024-01-19T04:16:08.084542+0000","last_undegraded":"2024-01-19T04:16:08.084542+0000","last_fullsized":"2024-01-19T04:16:08.084542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086033+0000","last_change":"2024-01-19T04:16:06.651033+0000","last_active":"2024-01-19T04:16:08.086033+0000","last_peered":"2024-01-19T04:16:08.086033+0000","last_clean":"2024-01-19T04:16:08.086033+0000","last_became_active":"2024-01-19T04:16:06.650744+0000","last_became_peered":"2024-01-19T04:16:06.650744+0000","last_unstale":"2024-01-19T04:16:08.086033+0000","last_undegraded":"2024-01-19T04:16:08.086033+0000","last_fullsized":"2024-01-19T04:16:08.086033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:35:34.310303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645529+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:16:06.645529+0000","last_peered":"2024-01-19T04:16:06.645529+0000","last_clean":"2024-01-19T04:16:06.645529+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:16:06.645529+0000","last_undegraded":"2024-01-19T04:16:06.645529+0000","last_fullsized":"2024-01-19T04:16:06.645529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634096+0000","last_change":"2024-01-19T04:15:49.658348+0000","last_active":"2024-01-19T04:16:06.634096+0000","last_peered":"2024-01-19T04:16:06.634096+0000","last_clean":"2024-01-19T04:16:06.634096+0000","last_became_active":"2024-01-19T04:15:49.656971+0000","last_became_peered":"2024-01-19T04:15:49.656971+0000","last_unstale":"2024-01-19T04:16:06.634096+0000","last_undegraded":"2024-01-19T04:16:06.634096+0000","last_fullsized":"2024-01-19T04:16:06.634096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.784520+0000","last_change":"2024-01-19T04:16:05.794905+0000","last_active":"2024-01-19T04:16:06.784520+0000","last_peered":"2024-01-19T04:16:06.784520+0000","last_clean":"2024-01-19T04:16:06.784520+0000","last_became_active":"2024-01-19T04:16:05.794077+0000","last_became_peered":"2024-01-19T04:16:05.794077+0000","last_unstale":"2024-01-19T04:16:06.784520+0000","last_undegraded":"2024-01-19T04:16:06.784520+0000","last_fullsized":"2024-01-19T04:16:06.784520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:09.565547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635915+0000","last_change":"2024-01-19T04:16:06.648241+0000","last_active":"2024-01-19T04:16:07.635915+0000","last_peered":"2024-01-19T04:16:07.635915+0000","last_clean":"2024-01-19T04:16:07.635915+0000","last_became_active":"2024-01-19T04:16:06.647911+0000","last_became_peered":"2024-01-19T04:16:06.647911+0000","last_unstale":"2024-01-19T04:16:07.635915+0000","last_undegraded":"2024-01-19T04:16:07.635915+0000","last_fullsized":"2024-01-19T04:16:07.635915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:32.886100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645896+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:16:06.645896+0000","last_peered":"2024-01-19T04:16:06.645896+0000","last_clean":"2024-01-19T04:16:06.645896+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:16:06.645896+0000","last_undegraded":"2024-01-19T04:16:06.645896+0000","last_fullsized":"2024-01-19T04:16:06.645896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638798+0000","last_change":"2024-01-19T04:15:49.667350+0000","last_active":"2024-01-19T04:16:06.638798+0000","last_peered":"2024-01-19T04:16:06.638798+0000","last_clean":"2024-01-19T04:16:06.638798+0000","last_became_active":"2024-01-19T04:15:49.666589+0000","last_became_peered":"2024-01-19T04:15:49.666589+0000","last_unstale":"2024-01-19T04:16:06.638798+0000","last_undegraded":"2024-01-19T04:16:06.638798+0000","last_fullsized":"2024-01-19T04:16:06.638798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.636015+0000","last_change":"2024-01-19T04:16:05.790679+0000","last_active":"2024-01-19T04:16:07.636015+0000","last_peered":"2024-01-19T04:16:07.636015+0000","last_clean":"2024-01-19T04:16:07.636015+0000","last_became_active":"2024-01-19T04:16:05.790399+0000","last_became_peered":"2024-01-19T04:16:05.790399+0000","last_unstale":"2024-01-19T04:16:07.636015+0000","last_undegraded":"2024-01-19T04:16:07.636015+0000","last_fullsized":"2024-01-19T04:16:07.636015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:02.428657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085468+0000","last_change":"2024-01-19T04:16:06.658471+0000","last_active":"2024-01-19T04:16:08.085468+0000","last_peered":"2024-01-19T04:16:08.085468+0000","last_clean":"2024-01-19T04:16:08.085468+0000","last_became_active":"2024-01-19T04:16:06.657499+0000","last_became_peered":"2024-01-19T04:16:06.657499+0000","last_unstale":"2024-01-19T04:16:08.085468+0000","last_undegraded":"2024-01-19T04:16:08.085468+0000","last_fullsized":"2024-01-19T04:16:08.085468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:25:40.860239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646043+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:16:06.646043+0000","last_peered":"2024-01-19T04:16:06.646043+0000","last_clean":"2024-01-19T04:16:06.646043+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:16:06.646043+0000","last_undegraded":"2024-01-19T04:16:06.646043+0000","last_fullsized":"2024-01-19T04:16:06.646043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643211+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:16:06.643211+0000","last_peered":"2024-01-19T04:16:06.643211+0000","last_clean":"2024-01-19T04:16:06.643211+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:16:06.643211+0000","last_undegraded":"2024-01-19T04:16:06.643211+0000","last_fullsized":"2024-01-19T04:16:06.643211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638696+0000","last_change":"2024-01-19T04:16:05.794503+0000","last_active":"2024-01-19T04:16:06.638696+0000","last_peered":"2024-01-19T04:16:06.638696+0000","last_clean":"2024-01-19T04:16:06.638696+0000","last_became_active":"2024-01-19T04:16:05.794177+0000","last_became_peered":"2024-01-19T04:16:05.794177+0000","last_unstale":"2024-01-19T04:16:06.638696+0000","last_undegraded":"2024-01-19T04:16:06.638696+0000","last_fullsized":"2024-01-19T04:16:06.638696+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:09.555530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086031+0000","last_change":"2024-01-19T04:16:06.649355+0000","last_active":"2024-01-19T04:16:08.086031+0000","last_peered":"2024-01-19T04:16:08.086031+0000","last_clean":"2024-01-19T04:16:08.086031+0000","last_became_active":"2024-01-19T04:16:06.649070+0000","last_became_peered":"2024-01-19T04:16:06.649070+0000","last_unstale":"2024-01-19T04:16:08.086031+0000","last_undegraded":"2024-01-19T04:16:08.086031+0000","last_fullsized":"2024-01-19T04:16:08.086031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:07.379996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638194+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:16:06.638194+0000","last_peered":"2024-01-19T04:16:06.638194+0000","last_clean":"2024-01-19T04:16:06.638194+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:16:06.638194+0000","last_undegraded":"2024-01-19T04:16:06.638194+0000","last_fullsized":"2024-01-19T04:16:06.638194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645939+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:16:06.645939+0000","last_peered":"2024-01-19T04:16:06.645939+0000","last_clean":"2024-01-19T04:16:06.645939+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:16:06.645939+0000","last_undegraded":"2024-01-19T04:16:06.645939+0000","last_fullsized":"2024-01-19T04:16:06.645939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.785832+0000","last_change":"2024-01-19T04:16:05.797216+0000","last_active":"2024-01-19T04:16:06.785832+0000","last_peered":"2024-01-19T04:16:06.785832+0000","last_clean":"2024-01-19T04:16:06.785832+0000","last_became_active":"2024-01-19T04:16:05.796895+0000","last_became_peered":"2024-01-19T04:16:05.796895+0000","last_unstale":"2024-01-19T04:16:06.785832+0000","last_undegraded":"2024-01-19T04:16:06.785832+0000","last_fullsized":"2024-01-19T04:16:06.785832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:25.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086001+0000","last_change":"2024-01-19T04:16:06.663428+0000","last_active":"2024-01-19T04:16:08.086001+0000","last_peered":"2024-01-19T04:16:08.086001+0000","last_clean":"2024-01-19T04:16:08.086001+0000","last_became_active":"2024-01-19T04:16:06.662844+0000","last_became_peered":"2024-01-19T04:16:06.662844+0000","last_unstale":"2024-01-19T04:16:08.086001+0000","last_undegraded":"2024-01-19T04:16:08.086001+0000","last_fullsized":"2024-01-19T04:16:08.086001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:20.839193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788478+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:16:05.788478+0000","last_peered":"2024-01-19T04:16:05.788478+0000","last_clean":"2024-01-19T04:16:05.788478+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:16:05.788478+0000","last_undegraded":"2024-01-19T04:16:05.788478+0000","last_fullsized":"2024-01-19T04:16:05.788478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637102+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:16:06.637102+0000","last_peered":"2024-01-19T04:16:06.637102+0000","last_clean":"2024-01-19T04:16:06.637102+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:16:06.637102+0000","last_undegraded":"2024-01-19T04:16:06.637102+0000","last_fullsized":"2024-01-19T04:16:06.637102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641963+0000","last_change":"2024-01-19T04:16:05.796993+0000","last_active":"2024-01-19T04:16:06.641963+0000","last_peered":"2024-01-19T04:16:06.641963+0000","last_clean":"2024-01-19T04:16:06.641963+0000","last_became_active":"2024-01-19T04:16:05.796746+0000","last_became_peered":"2024-01-19T04:16:05.796746+0000","last_unstale":"2024-01-19T04:16:06.641963+0000","last_undegraded":"2024-01-19T04:16:06.641963+0000","last_fullsized":"2024-01-19T04:16:06.641963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:53.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085758+0000","last_change":"2024-01-19T04:16:06.654768+0000","last_active":"2024-01-19T04:16:08.085758+0000","last_peered":"2024-01-19T04:16:08.085758+0000","last_clean":"2024-01-19T04:16:08.085758+0000","last_became_active":"2024-01-19T04:16:06.654509+0000","last_became_peered":"2024-01-19T04:16:06.654509+0000","last_unstale":"2024-01-19T04:16:08.085758+0000","last_undegraded":"2024-01-19T04:16:08.085758+0000","last_fullsized":"2024-01-19T04:16:08.085758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:47.053128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788470+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:16:05.788470+0000","last_peered":"2024-01-19T04:16:05.788470+0000","last_clean":"2024-01-19T04:16:05.788470+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:16:05.788470+0000","last_undegraded":"2024-01-19T04:16:05.788470+0000","last_fullsized":"2024-01-19T04:16:05.788470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641631+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:16:06.641631+0000","last_peered":"2024-01-19T04:16:06.641631+0000","last_clean":"2024-01-19T04:16:06.641631+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:16:06.641631+0000","last_undegraded":"2024-01-19T04:16:06.641631+0000","last_fullsized":"2024-01-19T04:16:06.641631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786740+0000","last_change":"2024-01-19T04:16:05.799883+0000","last_active":"2024-01-19T04:16:06.786740+0000","last_peered":"2024-01-19T04:16:06.786740+0000","last_clean":"2024-01-19T04:16:06.786740+0000","last_became_active":"2024-01-19T04:16:05.799581+0000","last_became_peered":"2024-01-19T04:16:05.799581+0000","last_unstale":"2024-01-19T04:16:06.786740+0000","last_undegraded":"2024-01-19T04:16:06.786740+0000","last_fullsized":"2024-01-19T04:16:06.786740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:55.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080573+0000","last_change":"2024-01-19T04:16:06.661145+0000","last_active":"2024-01-19T04:16:08.080573+0000","last_peered":"2024-01-19T04:16:08.080573+0000","last_clean":"2024-01-19T04:16:08.080573+0000","last_became_active":"2024-01-19T04:16:06.660916+0000","last_became_peered":"2024-01-19T04:16:06.660916+0000","last_unstale":"2024-01-19T04:16:08.080573+0000","last_undegraded":"2024-01-19T04:16:08.080573+0000","last_fullsized":"2024-01-19T04:16:08.080573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:46.651098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637532+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:16:06.637532+0000","last_peered":"2024-01-19T04:16:06.637532+0000","last_clean":"2024-01-19T04:16:06.637532+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:16:06.637532+0000","last_undegraded":"2024-01-19T04:16:06.637532+0000","last_fullsized":"2024-01-19T04:16:06.637532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790869+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:16:05.790869+0000","last_peered":"2024-01-19T04:16:05.790869+0000","last_clean":"2024-01-19T04:16:05.790869+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:16:05.790869+0000","last_undegraded":"2024-01-19T04:16:05.790869+0000","last_fullsized":"2024-01-19T04:16:05.790869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084369+0000","last_change":"2024-01-19T04:16:05.794058+0000","last_active":"2024-01-19T04:16:08.084369+0000","last_peered":"2024-01-19T04:16:08.084369+0000","last_clean":"2024-01-19T04:16:08.084369+0000","last_became_active":"2024-01-19T04:16:05.793542+0000","last_became_peered":"2024-01-19T04:16:05.793542+0000","last_unstale":"2024-01-19T04:16:08.084369+0000","last_undegraded":"2024-01-19T04:16:08.084369+0000","last_fullsized":"2024-01-19T04:16:08.084369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:08.794314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650910+0000","last_change":"2024-01-19T04:16:06.648682+0000","last_active":"2024-01-19T04:16:06.650910+0000","last_peered":"2024-01-19T04:16:06.650910+0000","last_clean":"2024-01-19T04:16:06.650910+0000","last_became_active":"2024-01-19T04:16:06.646754+0000","last_became_peered":"2024-01-19T04:16:06.646754+0000","last_unstale":"2024-01-19T04:16:06.650910+0000","last_undegraded":"2024-01-19T04:16:06.650910+0000","last_fullsized":"2024-01-19T04:16:06.650910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:35:59.042987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645066+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:16:06.645066+0000","last_peered":"2024-01-19T04:16:06.645066+0000","last_clean":"2024-01-19T04:16:06.645066+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:16:06.645066+0000","last_undegraded":"2024-01-19T04:16:06.645066+0000","last_fullsized":"2024-01-19T04:16:06.645066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637399+0000","last_change":"2024-01-19T04:15:49.665258+0000","last_active":"2024-01-19T04:16:06.637399+0000","last_peered":"2024-01-19T04:16:06.637399+0000","last_clean":"2024-01-19T04:16:06.637399+0000","last_became_active":"2024-01-19T04:15:49.664987+0000","last_became_peered":"2024-01-19T04:15:49.664987+0000","last_unstale":"2024-01-19T04:16:06.637399+0000","last_undegraded":"2024-01-19T04:16:06.637399+0000","last_fullsized":"2024-01-19T04:16:06.637399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637230+0000","last_change":"2024-01-19T04:16:05.799441+0000","last_active":"2024-01-19T04:16:06.637230+0000","last_peered":"2024-01-19T04:16:06.637230+0000","last_clean":"2024-01-19T04:16:06.637230+0000","last_became_active":"2024-01-19T04:16:05.799063+0000","last_became_peered":"2024-01-19T04:16:05.799063+0000","last_unstale":"2024-01-19T04:16:06.637230+0000","last_undegraded":"2024-01-19T04:16:06.637230+0000","last_fullsized":"2024-01-19T04:16:06.637230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:59:19.597563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080796+0000","last_change":"2024-01-19T04:16:06.661032+0000","last_active":"2024-01-19T04:16:08.080796+0000","last_peered":"2024-01-19T04:16:08.080796+0000","last_clean":"2024-01-19T04:16:08.080796+0000","last_became_active":"2024-01-19T04:16:06.660739+0000","last_became_peered":"2024-01-19T04:16:06.660739+0000","last_unstale":"2024-01-19T04:16:08.080796+0000","last_undegraded":"2024-01-19T04:16:08.080796+0000","last_fullsized":"2024-01-19T04:16:08.080796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:50.140135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"35'9","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791453+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:16:05.791453+0000","last_peered":"2024-01-19T04:16:05.791453+0000","last_clean":"2024-01-19T04:16:05.791453+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:16:05.791453+0000","last_undegraded":"2024-01-19T04:16:05.791453+0000","last_fullsized":"2024-01-19T04:16:05.791453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640731+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:16:06.640731+0000","last_peered":"2024-01-19T04:16:06.640731+0000","last_clean":"2024-01-19T04:16:06.640731+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:16:06.640731+0000","last_undegraded":"2024-01-19T04:16:06.640731+0000","last_fullsized":"2024-01-19T04:16:06.640731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086587+0000","last_change":"2024-01-19T04:16:05.801624+0000","last_active":"2024-01-19T04:16:08.086587+0000","last_peered":"2024-01-19T04:16:08.086587+0000","last_clean":"2024-01-19T04:16:08.086587+0000","last_became_active":"2024-01-19T04:16:05.801315+0000","last_became_peered":"2024-01-19T04:16:05.801315+0000","last_unstale":"2024-01-19T04:16:08.086587+0000","last_undegraded":"2024-01-19T04:16:08.086587+0000","last_fullsized":"2024-01-19T04:16:08.086587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639313+0000","last_change":"2024-01-19T04:16:06.659279+0000","last_active":"2024-01-19T04:16:07.639313+0000","last_peered":"2024-01-19T04:16:07.639313+0000","last_clean":"2024-01-19T04:16:07.639313+0000","last_became_active":"2024-01-19T04:16:06.658980+0000","last_became_peered":"2024-01-19T04:16:06.658980+0000","last_unstale":"2024-01-19T04:16:07.639313+0000","last_undegraded":"2024-01-19T04:16:07.639313+0000","last_fullsized":"2024-01-19T04:16:07.639313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:13.662662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640878+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:16:06.640878+0000","last_peered":"2024-01-19T04:16:06.640878+0000","last_clean":"2024-01-19T04:16:06.640878+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:16:06.640878+0000","last_undegraded":"2024-01-19T04:16:06.640878+0000","last_fullsized":"2024-01-19T04:16:06.640878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791301+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:16:05.791301+0000","last_peered":"2024-01-19T04:16:05.791301+0000","last_clean":"2024-01-19T04:16:05.791301+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:16:05.791301+0000","last_undegraded":"2024-01-19T04:16:05.791301+0000","last_fullsized":"2024-01-19T04:16:05.791301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645197+0000","last_change":"2024-01-19T04:16:05.795050+0000","last_active":"2024-01-19T04:16:06.645197+0000","last_peered":"2024-01-19T04:16:06.645197+0000","last_clean":"2024-01-19T04:16:06.645197+0000","last_became_active":"2024-01-19T04:16:05.794748+0000","last_became_peered":"2024-01-19T04:16:05.794748+0000","last_unstale":"2024-01-19T04:16:06.645197+0000","last_undegraded":"2024-01-19T04:16:06.645197+0000","last_fullsized":"2024-01-19T04:16:06.645197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:36.215987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080403+0000","last_change":"2024-01-19T04:16:06.655156+0000","last_active":"2024-01-19T04:16:08.080403+0000","last_peered":"2024-01-19T04:16:08.080403+0000","last_clean":"2024-01-19T04:16:08.080403+0000","last_became_active":"2024-01-19T04:16:06.654868+0000","last_became_peered":"2024-01-19T04:16:06.654868+0000","last_unstale":"2024-01-19T04:16:08.080403+0000","last_undegraded":"2024-01-19T04:16:08.080403+0000","last_fullsized":"2024-01-19T04:16:08.080403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:09:17.227424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651137+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:16:06.651137+0000","last_peered":"2024-01-19T04:16:06.651137+0000","last_clean":"2024-01-19T04:16:06.651137+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:16:06.651137+0000","last_undegraded":"2024-01-19T04:16:06.651137+0000","last_fullsized":"2024-01-19T04:16:06.651137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793074+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:16:05.793074+0000","last_peered":"2024-01-19T04:16:05.793074+0000","last_clean":"2024-01-19T04:16:05.793074+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:16:05.793074+0000","last_undegraded":"2024-01-19T04:16:05.793074+0000","last_fullsized":"2024-01-19T04:16:05.793074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635828+0000","last_change":"2024-01-19T04:16:05.789419+0000","last_active":"2024-01-19T04:16:07.635828+0000","last_peered":"2024-01-19T04:16:07.635828+0000","last_clean":"2024-01-19T04:16:07.635828+0000","last_became_active":"2024-01-19T04:16:05.782405+0000","last_became_peered":"2024-01-19T04:16:05.782405+0000","last_unstale":"2024-01-19T04:16:07.635828+0000","last_undegraded":"2024-01-19T04:16:07.635828+0000","last_fullsized":"2024-01-19T04:16:07.635828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:43:13.226181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.658899+0000","last_change":"2024-01-19T04:16:06.653820+0000","last_active":"2024-01-19T04:16:06.658899+0000","last_peered":"2024-01-19T04:16:06.658899+0000","last_clean":"2024-01-19T04:16:06.658899+0000","last_became_active":"2024-01-19T04:16:06.653551+0000","last_became_peered":"2024-01-19T04:16:06.653551+0000","last_unstale":"2024-01-19T04:16:06.658899+0000","last_undegraded":"2024-01-19T04:16:06.658899+0000","last_fullsized":"2024-01-19T04:16:06.658899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:38:28.058495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793160+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:16:05.793160+0000","last_peered":"2024-01-19T04:16:05.793160+0000","last_clean":"2024-01-19T04:16:05.793160+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:16:05.793160+0000","last_undegraded":"2024-01-19T04:16:05.793160+0000","last_fullsized":"2024-01-19T04:16:05.793160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640926+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:16:06.640926+0000","last_peered":"2024-01-19T04:16:06.640926+0000","last_clean":"2024-01-19T04:16:06.640926+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:16:06.640926+0000","last_undegraded":"2024-01-19T04:16:06.640926+0000","last_fullsized":"2024-01-19T04:16:06.640926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788462+0000","last_change":"2024-01-19T04:16:05.793856+0000","last_active":"2024-01-19T04:16:06.788462+0000","last_peered":"2024-01-19T04:16:06.788462+0000","last_clean":"2024-01-19T04:16:06.788462+0000","last_became_active":"2024-01-19T04:16:05.793566+0000","last_became_peered":"2024-01-19T04:16:05.793566+0000","last_unstale":"2024-01-19T04:16:06.788462+0000","last_undegraded":"2024-01-19T04:16:06.788462+0000","last_fullsized":"2024-01-19T04:16:06.788462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:12.660330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085783+0000","last_change":"2024-01-19T04:16:06.656144+0000","last_active":"2024-01-19T04:16:08.085783+0000","last_peered":"2024-01-19T04:16:08.085783+0000","last_clean":"2024-01-19T04:16:08.085783+0000","last_became_active":"2024-01-19T04:16:06.655863+0000","last_became_peered":"2024-01-19T04:16:06.655863+0000","last_unstale":"2024-01-19T04:16:08.085783+0000","last_undegraded":"2024-01-19T04:16:08.085783+0000","last_fullsized":"2024-01-19T04:16:08.085783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:01:51.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643421+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:16:06.643421+0000","last_peered":"2024-01-19T04:16:06.643421+0000","last_clean":"2024-01-19T04:16:06.643421+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:16:06.643421+0000","last_undegraded":"2024-01-19T04:16:06.643421+0000","last_fullsized":"2024-01-19T04:16:06.643421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637132+0000","last_change":"2024-01-19T04:15:49.668312+0000","last_active":"2024-01-19T04:16:06.637132+0000","last_peered":"2024-01-19T04:16:06.637132+0000","last_clean":"2024-01-19T04:16:06.637132+0000","last_became_active":"2024-01-19T04:15:49.664719+0000","last_became_peered":"2024-01-19T04:15:49.664719+0000","last_unstale":"2024-01-19T04:16:06.637132+0000","last_undegraded":"2024-01-19T04:16:06.637132+0000","last_fullsized":"2024-01-19T04:16:06.637132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.785789+0000","last_change":"2024-01-19T04:16:05.788223+0000","last_active":"2024-01-19T04:16:06.785789+0000","last_peered":"2024-01-19T04:16:06.785789+0000","last_clean":"2024-01-19T04:16:06.785789+0000","last_became_active":"2024-01-19T04:16:05.787780+0000","last_became_peered":"2024-01-19T04:16:05.787780+0000","last_unstale":"2024-01-19T04:16:06.785789+0000","last_undegraded":"2024-01-19T04:16:06.785789+0000","last_fullsized":"2024-01-19T04:16:06.785789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.638484+0000","last_change":"2024-01-19T04:16:06.653246+0000","last_active":"2024-01-19T04:16:07.638484+0000","last_peered":"2024-01-19T04:16:07.638484+0000","last_clean":"2024-01-19T04:16:07.638484+0000","last_became_active":"2024-01-19T04:16:06.652929+0000","last_became_peered":"2024-01-19T04:16:06.652929+0000","last_unstale":"2024-01-19T04:16:07.638484+0000","last_undegraded":"2024-01-19T04:16:07.638484+0000","last_fullsized":"2024-01-19T04:16:07.638484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:16.789672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.788364+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:16:05.788364+0000","last_peered":"2024-01-19T04:16:05.788364+0000","last_clean":"2024-01-19T04:16:05.788364+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:16:05.788364+0000","last_undegraded":"2024-01-19T04:16:05.788364+0000","last_fullsized":"2024-01-19T04:16:05.788364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643325+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:16:06.643325+0000","last_peered":"2024-01-19T04:16:06.643325+0000","last_clean":"2024-01-19T04:16:06.643325+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:16:06.643325+0000","last_undegraded":"2024-01-19T04:16:06.643325+0000","last_fullsized":"2024-01-19T04:16:06.643325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788356+0000","last_change":"2024-01-19T04:16:05.799707+0000","last_active":"2024-01-19T04:16:06.788356+0000","last_peered":"2024-01-19T04:16:06.788356+0000","last_clean":"2024-01-19T04:16:06.788356+0000","last_became_active":"2024-01-19T04:16:05.799464+0000","last_became_peered":"2024-01-19T04:16:05.799464+0000","last_unstale":"2024-01-19T04:16:06.788356+0000","last_undegraded":"2024-01-19T04:16:06.788356+0000","last_fullsized":"2024-01-19T04:16:06.788356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:17:34.865737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084773+0000","last_change":"2024-01-19T04:16:06.655577+0000","last_active":"2024-01-19T04:16:08.084773+0000","last_peered":"2024-01-19T04:16:08.084773+0000","last_clean":"2024-01-19T04:16:08.084773+0000","last_became_active":"2024-01-19T04:16:06.653746+0000","last_became_peered":"2024-01-19T04:16:06.653746+0000","last_unstale":"2024-01-19T04:16:08.084773+0000","last_undegraded":"2024-01-19T04:16:08.084773+0000","last_fullsized":"2024-01-19T04:16:08.084773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:10.567880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644439+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:16:06.644439+0000","last_peered":"2024-01-19T04:16:06.644439+0000","last_clean":"2024-01-19T04:16:06.644439+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:16:06.644439+0000","last_undegraded":"2024-01-19T04:16:06.644439+0000","last_fullsized":"2024-01-19T04:16:06.644439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640299+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:16:06.640299+0000","last_peered":"2024-01-19T04:16:06.640299+0000","last_clean":"2024-01-19T04:16:06.640299+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:16:06.640299+0000","last_undegraded":"2024-01-19T04:16:06.640299+0000","last_fullsized":"2024-01-19T04:16:06.640299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084277+0000","last_change":"2024-01-19T04:16:05.798704+0000","last_active":"2024-01-19T04:16:08.084277+0000","last_peered":"2024-01-19T04:16:08.084277+0000","last_clean":"2024-01-19T04:16:08.084277+0000","last_became_active":"2024-01-19T04:16:05.798256+0000","last_became_peered":"2024-01-19T04:16:05.798256+0000","last_unstale":"2024-01-19T04:16:08.084277+0000","last_undegraded":"2024-01-19T04:16:08.084277+0000","last_fullsized":"2024-01-19T04:16:08.084277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.003940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084191+0000","last_change":"2024-01-19T04:16:06.661878+0000","last_active":"2024-01-19T04:16:08.084191+0000","last_peered":"2024-01-19T04:16:08.084191+0000","last_clean":"2024-01-19T04:16:08.084191+0000","last_became_active":"2024-01-19T04:16:06.661120+0000","last_became_peered":"2024-01-19T04:16:06.661120+0000","last_unstale":"2024-01-19T04:16:08.084191+0000","last_undegraded":"2024-01-19T04:16:08.084191+0000","last_fullsized":"2024-01-19T04:16:08.084191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:54.194344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644956+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:16:06.644956+0000","last_peered":"2024-01-19T04:16:06.644956+0000","last_clean":"2024-01-19T04:16:06.644956+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:16:06.644956+0000","last_undegraded":"2024-01-19T04:16:06.644956+0000","last_fullsized":"2024-01-19T04:16:06.644956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642057+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:16:06.642057+0000","last_peered":"2024-01-19T04:16:06.642057+0000","last_clean":"2024-01-19T04:16:06.642057+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:16:06.642057+0000","last_undegraded":"2024-01-19T04:16:06.642057+0000","last_fullsized":"2024-01-19T04:16:06.642057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640162+0000","last_change":"2024-01-19T04:16:05.797656+0000","last_active":"2024-01-19T04:16:06.640162+0000","last_peered":"2024-01-19T04:16:06.640162+0000","last_clean":"2024-01-19T04:16:06.640162+0000","last_became_active":"2024-01-19T04:16:05.797337+0000","last_became_peered":"2024-01-19T04:16:05.797337+0000","last_unstale":"2024-01-19T04:16:06.640162+0000","last_undegraded":"2024-01-19T04:16:06.640162+0000","last_fullsized":"2024-01-19T04:16:06.640162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:15.787339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085341+0000","last_change":"2024-01-19T04:16:06.650535+0000","last_active":"2024-01-19T04:16:08.085341+0000","last_peered":"2024-01-19T04:16:08.085341+0000","last_clean":"2024-01-19T04:16:08.085341+0000","last_became_active":"2024-01-19T04:16:06.648542+0000","last_became_peered":"2024-01-19T04:16:06.648542+0000","last_unstale":"2024-01-19T04:16:08.085341+0000","last_undegraded":"2024-01-19T04:16:08.085341+0000","last_fullsized":"2024-01-19T04:16:08.085341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:42.208383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.785181+0000","last_change":"2024-01-19T04:16:05.791457+0000","last_active":"2024-01-19T04:16:06.785181+0000","last_peered":"2024-01-19T04:16:06.785181+0000","last_clean":"2024-01-19T04:16:06.785181+0000","last_became_active":"2024-01-19T04:16:05.791179+0000","last_became_peered":"2024-01-19T04:16:05.791179+0000","last_unstale":"2024-01-19T04:16:06.785181+0000","last_undegraded":"2024-01-19T04:16:06.785181+0000","last_fullsized":"2024-01-19T04:16:06.785181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:43:04.534670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.635048+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:16:06.635048+0000","last_peered":"2024-01-19T04:16:06.635048+0000","last_clean":"2024-01-19T04:16:06.635048+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:16:06.635048+0000","last_undegraded":"2024-01-19T04:16:06.635048+0000","last_fullsized":"2024-01-19T04:16:06.635048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:02.358517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641737+0000","last_change":"2024-01-19T04:15:49.671511+0000","last_active":"2024-01-19T04:16:06.641737+0000","last_peered":"2024-01-19T04:16:06.641737+0000","last_clean":"2024-01-19T04:16:06.641737+0000","last_became_active":"2024-01-19T04:15:49.670975+0000","last_became_peered":"2024-01-19T04:15:49.670975+0000","last_unstale":"2024-01-19T04:16:06.641737+0000","last_undegraded":"2024-01-19T04:16:06.641737+0000","last_fullsized":"2024-01-19T04:16:06.641737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086005+0000","last_change":"2024-01-19T04:16:06.645758+0000","last_active":"2024-01-19T04:16:08.086005+0000","last_peered":"2024-01-19T04:16:08.086005+0000","last_clean":"2024-01-19T04:16:08.086005+0000","last_became_active":"2024-01-19T04:16:06.645496+0000","last_became_peered":"2024-01-19T04:16:06.645496+0000","last_unstale":"2024-01-19T04:16:08.086005+0000","last_undegraded":"2024-01-19T04:16:08.086005+0000","last_fullsized":"2024-01-19T04:16:08.086005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:25.718378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.786188+0000","last_change":"2024-01-19T04:16:05.792100+0000","last_active":"2024-01-19T04:16:06.786188+0000","last_peered":"2024-01-19T04:16:06.786188+0000","last_clean":"2024-01-19T04:16:06.786188+0000","last_became_active":"2024-01-19T04:16:05.791821+0000","last_became_peered":"2024-01-19T04:16:05.791821+0000","last_unstale":"2024-01-19T04:16:06.786188+0000","last_undegraded":"2024-01-19T04:16:06.786188+0000","last_fullsized":"2024-01-19T04:16:06.786188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:12:26.677056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791504+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:16:05.791504+0000","last_peered":"2024-01-19T04:16:05.791504+0000","last_clean":"2024-01-19T04:16:05.791504+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:16:05.791504+0000","last_undegraded":"2024-01-19T04:16:05.791504+0000","last_fullsized":"2024-01-19T04:16:05.791504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645410+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:16:06.645410+0000","last_peered":"2024-01-19T04:16:06.645410+0000","last_clean":"2024-01-19T04:16:06.645410+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:16:06.645410+0000","last_undegraded":"2024-01-19T04:16:06.645410+0000","last_fullsized":"2024-01-19T04:16:06.645410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084960+0000","last_change":"2024-01-19T04:16:06.653044+0000","last_active":"2024-01-19T04:16:08.084960+0000","last_peered":"2024-01-19T04:16:08.084960+0000","last_clean":"2024-01-19T04:16:08.084960+0000","last_became_active":"2024-01-19T04:16:06.652723+0000","last_became_peered":"2024-01-19T04:16:06.652723+0000","last_unstale":"2024-01-19T04:16:08.084960+0000","last_undegraded":"2024-01-19T04:16:08.084960+0000","last_fullsized":"2024-01-19T04:16:08.084960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:59.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651297+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:16:06.651297+0000","last_peered":"2024-01-19T04:16:06.651297+0000","last_clean":"2024-01-19T04:16:06.651297+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:16:06.651297+0000","last_undegraded":"2024-01-19T04:16:06.651297+0000","last_fullsized":"2024-01-19T04:16:06.651297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637803+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:16:06.637803+0000","last_peered":"2024-01-19T04:16:06.637803+0000","last_clean":"2024-01-19T04:16:06.637803+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:16:06.637803+0000","last_undegraded":"2024-01-19T04:16:06.637803+0000","last_fullsized":"2024-01-19T04:16:06.637803+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788125+0000","last_change":"2024-01-19T04:16:05.795506+0000","last_active":"2024-01-19T04:16:06.788125+0000","last_peered":"2024-01-19T04:16:06.788125+0000","last_clean":"2024-01-19T04:16:06.788125+0000","last_became_active":"2024-01-19T04:16:05.795164+0000","last_became_peered":"2024-01-19T04:16:05.795164+0000","last_unstale":"2024-01-19T04:16:06.788125+0000","last_undegraded":"2024-01-19T04:16:06.788125+0000","last_fullsized":"2024-01-19T04:16:06.788125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:47.180361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085421+0000","last_change":"2024-01-19T04:16:06.645494+0000","last_active":"2024-01-19T04:16:08.085421+0000","last_peered":"2024-01-19T04:16:08.085421+0000","last_clean":"2024-01-19T04:16:08.085421+0000","last_became_active":"2024-01-19T04:16:06.645206+0000","last_became_peered":"2024-01-19T04:16:06.645206+0000","last_unstale":"2024-01-19T04:16:08.085421+0000","last_undegraded":"2024-01-19T04:16:08.085421+0000","last_fullsized":"2024-01-19T04:16:08.085421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:09:17.227424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637854+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:16:06.637854+0000","last_peered":"2024-01-19T04:16:06.637854+0000","last_clean":"2024-01-19T04:16:06.637854+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:16:06.637854+0000","last_undegraded":"2024-01-19T04:16:06.637854+0000","last_fullsized":"2024-01-19T04:16:06.637854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651043+0000","last_change":"2024-01-19T04:15:49.650645+0000","last_active":"2024-01-19T04:16:06.651043+0000","last_peered":"2024-01-19T04:16:06.651043+0000","last_clean":"2024-01-19T04:16:06.651043+0000","last_became_active":"2024-01-19T04:15:49.650331+0000","last_became_peered":"2024-01-19T04:15:49.650331+0000","last_unstale":"2024-01-19T04:16:06.651043+0000","last_undegraded":"2024-01-19T04:16:06.651043+0000","last_fullsized":"2024-01-19T04:16:06.651043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085276+0000","last_change":"2024-01-19T04:16:05.791836+0000","last_active":"2024-01-19T04:16:08.085276+0000","last_peered":"2024-01-19T04:16:08.085276+0000","last_clean":"2024-01-19T04:16:08.085276+0000","last_became_active":"2024-01-19T04:16:05.791582+0000","last_became_peered":"2024-01-19T04:16:05.791582+0000","last_unstale":"2024-01-19T04:16:08.085276+0000","last_undegraded":"2024-01-19T04:16:08.085276+0000","last_fullsized":"2024-01-19T04:16:08.085276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.638594+0000","last_change":"2024-01-19T04:16:06.661306+0000","last_active":"2024-01-19T04:16:07.638594+0000","last_peered":"2024-01-19T04:16:07.638594+0000","last_clean":"2024-01-19T04:16:07.638594+0000","last_became_active":"2024-01-19T04:16:06.661013+0000","last_became_peered":"2024-01-19T04:16:06.661013+0000","last_unstale":"2024-01-19T04:16:07.638594+0000","last_undegraded":"2024-01-19T04:16:07.638594+0000","last_fullsized":"2024-01-19T04:16:07.638594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:54.194344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641556+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:16:06.641556+0000","last_peered":"2024-01-19T04:16:06.641556+0000","last_clean":"2024-01-19T04:16:06.641556+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:16:06.641556+0000","last_undegraded":"2024-01-19T04:16:06.641556+0000","last_fullsized":"2024-01-19T04:16:06.641556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086168+0000","last_change":"2024-01-19T04:16:06.655945+0000","last_active":"2024-01-19T04:16:08.086168+0000","last_peered":"2024-01-19T04:16:08.086168+0000","last_clean":"2024-01-19T04:16:08.086168+0000","last_became_active":"2024-01-19T04:16:06.655680+0000","last_became_peered":"2024-01-19T04:16:06.655680+0000","last_unstale":"2024-01-19T04:16:08.086168+0000","last_undegraded":"2024-01-19T04:16:08.086168+0000","last_fullsized":"2024-01-19T04:16:08.086168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:27.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.636913+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:16:06.636913+0000","last_peered":"2024-01-19T04:16:06.636913+0000","last_clean":"2024-01-19T04:16:06.636913+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:16:06.636913+0000","last_undegraded":"2024-01-19T04:16:06.636913+0000","last_fullsized":"2024-01-19T04:16:06.636913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635281+0000","last_change":"2024-01-19T04:16:06.644115+0000","last_active":"2024-01-19T04:16:07.635281+0000","last_peered":"2024-01-19T04:16:07.635281+0000","last_clean":"2024-01-19T04:16:07.635281+0000","last_became_active":"2024-01-19T04:16:06.643807+0000","last_became_peered":"2024-01-19T04:16:06.643807+0000","last_unstale":"2024-01-19T04:16:07.635281+0000","last_undegraded":"2024-01-19T04:16:07.635281+0000","last_fullsized":"2024-01-19T04:16:07.635281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:20.211567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642015+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:16:06.642015+0000","last_peered":"2024-01-19T04:16:06.642015+0000","last_clean":"2024-01-19T04:16:06.642015+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:16:06.642015+0000","last_undegraded":"2024-01-19T04:16:06.642015+0000","last_fullsized":"2024-01-19T04:16:06.642015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.648071+0000","last_change":"2024-01-19T04:16:06.645593+0000","last_active":"2024-01-19T04:16:06.648071+0000","last_peered":"2024-01-19T04:16:06.648071+0000","last_clean":"2024-01-19T04:16:06.648071+0000","last_became_active":"2024-01-19T04:16:06.645250+0000","last_became_peered":"2024-01-19T04:16:06.645250+0000","last_unstale":"2024-01-19T04:16:06.648071+0000","last_undegraded":"2024-01-19T04:16:06.648071+0000","last_fullsized":"2024-01-19T04:16:06.648071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:11:20.809247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644855+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:16:06.644855+0000","last_peered":"2024-01-19T04:16:06.644855+0000","last_clean":"2024-01-19T04:16:06.644855+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:16:06.644855+0000","last_undegraded":"2024-01-19T04:16:06.644855+0000","last_fullsized":"2024-01-19T04:16:06.644855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635962+0000","last_change":"2024-01-19T04:16:06.642681+0000","last_active":"2024-01-19T04:16:07.635962+0000","last_peered":"2024-01-19T04:16:07.635962+0000","last_clean":"2024-01-19T04:16:07.635962+0000","last_became_active":"2024-01-19T04:16:06.642382+0000","last_became_peered":"2024-01-19T04:16:06.642382+0000","last_unstale":"2024-01-19T04:16:07.635962+0000","last_undegraded":"2024-01-19T04:16:07.635962+0000","last_fullsized":"2024-01-19T04:16:07.635962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:47.006272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640658+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:16:06.640658+0000","last_peered":"2024-01-19T04:16:06.640658+0000","last_clean":"2024-01-19T04:16:06.640658+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:16:06.640658+0000","last_undegraded":"2024-01-19T04:16:06.640658+0000","last_fullsized":"2024-01-19T04:16:06.640658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086326+0000","last_change":"2024-01-19T04:16:06.644722+0000","last_active":"2024-01-19T04:16:08.086326+0000","last_peered":"2024-01-19T04:16:08.086326+0000","last_clean":"2024-01-19T04:16:08.086326+0000","last_became_active":"2024-01-19T04:16:06.644441+0000","last_became_peered":"2024-01-19T04:16:06.644441+0000","last_unstale":"2024-01-19T04:16:08.086326+0000","last_undegraded":"2024-01-19T04:16:08.086326+0000","last_fullsized":"2024-01-19T04:16:08.086326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:47:19.126540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641820+0000","last_change":"2024-01-19T04:15:49.672729+0000","last_active":"2024-01-19T04:16:06.641820+0000","last_peered":"2024-01-19T04:16:06.641820+0000","last_clean":"2024-01-19T04:16:06.641820+0000","last_became_active":"2024-01-19T04:15:49.672195+0000","last_became_peered":"2024-01-19T04:15:49.672195+0000","last_unstale":"2024-01-19T04:16:06.641820+0000","last_undegraded":"2024-01-19T04:16:06.641820+0000","last_fullsized":"2024-01-19T04:16:06.641820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085292+0000","last_change":"2024-01-19T04:16:06.648752+0000","last_active":"2024-01-19T04:16:08.085292+0000","last_peered":"2024-01-19T04:16:08.085292+0000","last_clean":"2024-01-19T04:16:08.085292+0000","last_became_active":"2024-01-19T04:16:06.648366+0000","last_became_peered":"2024-01-19T04:16:06.648366+0000","last_unstale":"2024-01-19T04:16:08.085292+0000","last_undegraded":"2024-01-19T04:16:08.085292+0000","last_fullsized":"2024-01-19T04:16:08.085292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793119+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:16:05.793119+0000","last_peered":"2024-01-19T04:16:05.793119+0000","last_clean":"2024-01-19T04:16:05.793119+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:16:05.793119+0000","last_undegraded":"2024-01-19T04:16:05.793119+0000","last_fullsized":"2024-01-19T04:16:05.793119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639099+0000","last_change":"2024-01-19T04:16:06.654563+0000","last_active":"2024-01-19T04:16:07.639099+0000","last_peered":"2024-01-19T04:16:07.639099+0000","last_clean":"2024-01-19T04:16:07.639099+0000","last_became_active":"2024-01-19T04:16:06.654166+0000","last_became_peered":"2024-01-19T04:16:06.654166+0000","last_unstale":"2024-01-19T04:16:07.639099+0000","last_undegraded":"2024-01-19T04:16:07.639099+0000","last_fullsized":"2024-01-19T04:16:07.639099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:26.441618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638035+0000","last_change":"2024-01-19T04:15:49.655156+0000","last_active":"2024-01-19T04:16:06.638035+0000","last_peered":"2024-01-19T04:16:06.638035+0000","last_clean":"2024-01-19T04:16:06.638035+0000","last_became_active":"2024-01-19T04:15:49.651743+0000","last_became_peered":"2024-01-19T04:15:49.651743+0000","last_unstale":"2024-01-19T04:16:06.638035+0000","last_undegraded":"2024-01-19T04:16:06.638035+0000","last_fullsized":"2024-01-19T04:16:06.638035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085040+0000","last_change":"2024-01-19T04:16:06.653368+0000","last_active":"2024-01-19T04:16:08.085040+0000","last_peered":"2024-01-19T04:16:08.085040+0000","last_clean":"2024-01-19T04:16:08.085040+0000","last_became_active":"2024-01-19T04:16:06.653083+0000","last_became_peered":"2024-01-19T04:16:06.653083+0000","last_unstale":"2024-01-19T04:16:08.085040+0000","last_undegraded":"2024-01-19T04:16:08.085040+0000","last_fullsized":"2024-01-19T04:16:08.085040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:48.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639730+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:16:06.639730+0000","last_peered":"2024-01-19T04:16:06.639730+0000","last_clean":"2024-01-19T04:16:06.639730+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:16:06.639730+0000","last_undegraded":"2024-01-19T04:16:06.639730+0000","last_fullsized":"2024-01-19T04:16:06.639730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659402+0000","last_change":"2024-01-19T04:16:06.655369+0000","last_active":"2024-01-19T04:16:06.659402+0000","last_peered":"2024-01-19T04:16:06.659402+0000","last_clean":"2024-01-19T04:16:06.659402+0000","last_became_active":"2024-01-19T04:16:06.655053+0000","last_became_peered":"2024-01-19T04:16:06.655053+0000","last_unstale":"2024-01-19T04:16:06.659402+0000","last_undegraded":"2024-01-19T04:16:06.659402+0000","last_fullsized":"2024-01-19T04:16:06.659402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:15.541954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.649648+0000","last_change":"2024-01-19T04:15:49.645143+0000","last_active":"2024-01-19T04:16:06.649648+0000","last_peered":"2024-01-19T04:16:06.649648+0000","last_clean":"2024-01-19T04:16:06.649648+0000","last_became_active":"2024-01-19T04:15:49.644879+0000","last_became_peered":"2024-01-19T04:15:49.644879+0000","last_unstale":"2024-01-19T04:16:06.649648+0000","last_undegraded":"2024-01-19T04:16:06.649648+0000","last_fullsized":"2024-01-19T04:16:06.649648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084725+0000","last_change":"2024-01-19T04:16:06.653011+0000","last_active":"2024-01-19T04:16:08.084725+0000","last_peered":"2024-01-19T04:16:08.084725+0000","last_clean":"2024-01-19T04:16:08.084725+0000","last_became_active":"2024-01-19T04:16:06.652708+0000","last_became_peered":"2024-01-19T04:16:06.652708+0000","last_unstale":"2024-01-19T04:16:08.084725+0000","last_undegraded":"2024-01-19T04:16:08.084725+0000","last_fullsized":"2024-01-19T04:16:08.084725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:37.218319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644172+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:16:06.644172+0000","last_peered":"2024-01-19T04:16:06.644172+0000","last_clean":"2024-01-19T04:16:06.644172+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:16:06.644172+0000","last_undegraded":"2024-01-19T04:16:06.644172+0000","last_fullsized":"2024-01-19T04:16:06.644172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085481+0000","last_change":"2024-01-19T04:16:06.653975+0000","last_active":"2024-01-19T04:16:08.085481+0000","last_peered":"2024-01-19T04:16:08.085481+0000","last_clean":"2024-01-19T04:16:08.085481+0000","last_became_active":"2024-01-19T04:16:06.652299+0000","last_became_peered":"2024-01-19T04:16:06.652299+0000","last_unstale":"2024-01-19T04:16:08.085481+0000","last_undegraded":"2024-01-19T04:16:08.085481+0000","last_fullsized":"2024-01-19T04:16:08.085481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:59.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644765+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:16:06.644765+0000","last_peered":"2024-01-19T04:16:06.644765+0000","last_clean":"2024-01-19T04:16:06.644765+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:16:06.644765+0000","last_undegraded":"2024-01-19T04:16:06.644765+0000","last_fullsized":"2024-01-19T04:16:06.644765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639255+0000","last_change":"2024-01-19T04:16:06.659934+0000","last_active":"2024-01-19T04:16:07.639255+0000","last_peered":"2024-01-19T04:16:07.639255+0000","last_clean":"2024-01-19T04:16:07.639255+0000","last_became_active":"2024-01-19T04:16:06.659055+0000","last_became_peered":"2024-01-19T04:16:06.659055+0000","last_unstale":"2024-01-19T04:16:07.639255+0000","last_undegraded":"2024-01-19T04:16:07.639255+0000","last_fullsized":"2024-01-19T04:16:07.639255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:48.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634937+0000","last_change":"2024-01-19T04:15:49.679977+0000","last_active":"2024-01-19T04:16:06.634937+0000","last_peered":"2024-01-19T04:16:06.634937+0000","last_clean":"2024-01-19T04:16:06.634937+0000","last_became_active":"2024-01-19T04:15:49.679706+0000","last_became_peered":"2024-01-19T04:15:49.679706+0000","last_unstale":"2024-01-19T04:16:06.634937+0000","last_undegraded":"2024-01-19T04:16:06.634937+0000","last_fullsized":"2024-01-19T04:16:06.634937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639343+0000","last_change":"2024-01-19T04:16:06.655197+0000","last_active":"2024-01-19T04:16:07.639343+0000","last_peered":"2024-01-19T04:16:07.639343+0000","last_clean":"2024-01-19T04:16:07.639343+0000","last_became_active":"2024-01-19T04:16:06.654021+0000","last_became_peered":"2024-01-19T04:16:06.654021+0000","last_unstale":"2024-01-19T04:16:07.639343+0000","last_undegraded":"2024-01-19T04:16:07.639343+0000","last_fullsized":"2024-01-19T04:16:07.639343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:15.679645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.791409+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:16:05.791409+0000","last_peered":"2024-01-19T04:16:05.791409+0000","last_clean":"2024-01-19T04:16:05.791409+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:16:05.791409+0000","last_undegraded":"2024-01-19T04:16:05.791409+0000","last_fullsized":"2024-01-19T04:16:05.791409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635814+0000","last_change":"2024-01-19T04:16:06.656508+0000","last_active":"2024-01-19T04:16:07.635814+0000","last_peered":"2024-01-19T04:16:07.635814+0000","last_clean":"2024-01-19T04:16:07.635814+0000","last_became_active":"2024-01-19T04:16:06.656095+0000","last_became_peered":"2024-01-19T04:16:06.656095+0000","last_unstale":"2024-01-19T04:16:07.635814+0000","last_undegraded":"2024-01-19T04:16:07.635814+0000","last_fullsized":"2024-01-19T04:16:07.635814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:48.953287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793097+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:16:05.793097+0000","last_peered":"2024-01-19T04:16:05.793097+0000","last_clean":"2024-01-19T04:16:05.793097+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:16:05.793097+0000","last_undegraded":"2024-01-19T04:16:05.793097+0000","last_fullsized":"2024-01-19T04:16:05.793097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085674+0000","last_change":"2024-01-19T04:16:06.659226+0000","last_active":"2024-01-19T04:16:08.085674+0000","last_peered":"2024-01-19T04:16:08.085674+0000","last_clean":"2024-01-19T04:16:08.085674+0000","last_became_active":"2024-01-19T04:16:06.658664+0000","last_became_peered":"2024-01-19T04:16:06.658664+0000","last_unstale":"2024-01-19T04:16:08.085674+0000","last_undegraded":"2024-01-19T04:16:08.085674+0000","last_fullsized":"2024-01-19T04:16:08.085674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:25.718378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644881+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:16:06.644881+0000","last_peered":"2024-01-19T04:16:06.644881+0000","last_clean":"2024-01-19T04:16:06.644881+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:16:06.644881+0000","last_undegraded":"2024-01-19T04:16:06.644881+0000","last_fullsized":"2024-01-19T04:16:06.644881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084295+0000","last_change":"2024-01-19T04:16:06.658727+0000","last_active":"2024-01-19T04:16:08.084295+0000","last_peered":"2024-01-19T04:16:08.084295+0000","last_clean":"2024-01-19T04:16:08.084295+0000","last_became_active":"2024-01-19T04:16:06.657947+0000","last_became_peered":"2024-01-19T04:16:06.657947+0000","last_unstale":"2024-01-19T04:16:08.084295+0000","last_undegraded":"2024-01-19T04:16:08.084295+0000","last_fullsized":"2024-01-19T04:16:08.084295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:26.441618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642120+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:16:06.642120+0000","last_peered":"2024-01-19T04:16:06.642120+0000","last_clean":"2024-01-19T04:16:06.642120+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:16:06.642120+0000","last_undegraded":"2024-01-19T04:16:06.642120+0000","last_fullsized":"2024-01-19T04:16:06.642120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635326+0000","last_change":"2024-01-19T04:16:06.643237+0000","last_active":"2024-01-19T04:16:07.635326+0000","last_peered":"2024-01-19T04:16:07.635326+0000","last_clean":"2024-01-19T04:16:07.635326+0000","last_became_active":"2024-01-19T04:16:06.642898+0000","last_became_peered":"2024-01-19T04:16:06.642898+0000","last_unstale":"2024-01-19T04:16:07.635326+0000","last_undegraded":"2024-01-19T04:16:07.635326+0000","last_fullsized":"2024-01-19T04:16:07.635326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:26.134708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639864+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:16:06.639864+0000","last_peered":"2024-01-19T04:16:06.639864+0000","last_clean":"2024-01-19T04:16:06.639864+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:16:06.639864+0000","last_undegraded":"2024-01-19T04:16:06.639864+0000","last_fullsized":"2024-01-19T04:16:06.639864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084790+0000","last_change":"2024-01-19T04:16:06.656893+0000","last_active":"2024-01-19T04:16:08.084790+0000","last_peered":"2024-01-19T04:16:08.084790+0000","last_clean":"2024-01-19T04:16:08.084790+0000","last_became_active":"2024-01-19T04:16:06.656606+0000","last_became_peered":"2024-01-19T04:16:06.656606+0000","last_unstale":"2024-01-19T04:16:08.084790+0000","last_undegraded":"2024-01-19T04:16:08.084790+0000","last_fullsized":"2024-01-19T04:16:08.084790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:43:05.537003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790125+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:16:05.790125+0000","last_peered":"2024-01-19T04:16:05.790125+0000","last_clean":"2024-01-19T04:16:05.790125+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:16:05.790125+0000","last_undegraded":"2024-01-19T04:16:05.790125+0000","last_fullsized":"2024-01-19T04:16:05.790125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.653729+0000","last_change":"2024-01-19T04:16:06.651408+0000","last_active":"2024-01-19T04:16:06.653729+0000","last_peered":"2024-01-19T04:16:06.653729+0000","last_clean":"2024-01-19T04:16:06.653729+0000","last_became_active":"2024-01-19T04:16:06.651129+0000","last_became_peered":"2024-01-19T04:16:06.651129+0000","last_unstale":"2024-01-19T04:16:06.653729+0000","last_undegraded":"2024-01-19T04:16:06.653729+0000","last_fullsized":"2024-01-19T04:16:06.653729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:27.515777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633913+0000","last_change":"2024-01-19T04:15:49.657109+0000","last_active":"2024-01-19T04:16:06.633913+0000","last_peered":"2024-01-19T04:16:06.633913+0000","last_clean":"2024-01-19T04:16:06.633913+0000","last_became_active":"2024-01-19T04:15:49.656836+0000","last_became_peered":"2024-01-19T04:15:49.656836+0000","last_unstale":"2024-01-19T04:16:06.633913+0000","last_undegraded":"2024-01-19T04:16:06.633913+0000","last_fullsized":"2024-01-19T04:16:06.633913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:41.496335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086508+0000","last_change":"2024-01-19T04:16:06.660525+0000","last_active":"2024-01-19T04:16:08.086508+0000","last_peered":"2024-01-19T04:16:08.086508+0000","last_clean":"2024-01-19T04:16:08.086508+0000","last_became_active":"2024-01-19T04:16:06.659997+0000","last_became_peered":"2024-01-19T04:16:06.659997+0000","last_unstale":"2024-01-19T04:16:08.086508+0000","last_undegraded":"2024-01-19T04:16:08.086508+0000","last_fullsized":"2024-01-19T04:16:08.086508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:02.077588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640656+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:16:06.640656+0000","last_peered":"2024-01-19T04:16:06.640656+0000","last_clean":"2024-01-19T04:16:06.640656+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:16:06.640656+0000","last_undegraded":"2024-01-19T04:16:06.640656+0000","last_fullsized":"2024-01-19T04:16:06.640656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085834+0000","last_change":"2024-01-19T04:16:06.658837+0000","last_active":"2024-01-19T04:16:08.085834+0000","last_peered":"2024-01-19T04:16:08.085834+0000","last_clean":"2024-01-19T04:16:08.085834+0000","last_became_active":"2024-01-19T04:16:06.657952+0000","last_became_peered":"2024-01-19T04:16:06.657952+0000","last_unstale":"2024-01-19T04:16:08.085834+0000","last_undegraded":"2024-01-19T04:16:08.085834+0000","last_fullsized":"2024-01-19T04:16:08.085834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:30.123335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644826+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:16:06.644826+0000","last_peered":"2024-01-19T04:16:06.644826+0000","last_clean":"2024-01-19T04:16:06.644826+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:16:06.644826+0000","last_undegraded":"2024-01-19T04:16:06.644826+0000","last_fullsized":"2024-01-19T04:16:06.644826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085376+0000","last_change":"2024-01-19T04:16:06.648708+0000","last_active":"2024-01-19T04:16:08.085376+0000","last_peered":"2024-01-19T04:16:08.085376+0000","last_clean":"2024-01-19T04:16:08.085376+0000","last_became_active":"2024-01-19T04:16:06.648345+0000","last_became_peered":"2024-01-19T04:16:06.648345+0000","last_unstale":"2024-01-19T04:16:08.085376+0000","last_undegraded":"2024-01-19T04:16:08.085376+0000","last_fullsized":"2024-01-19T04:16:08.085376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:02.077588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638192+0000","last_change":"2024-01-19T04:15:49.664498+0000","last_active":"2024-01-19T04:16:06.638192+0000","last_peered":"2024-01-19T04:16:06.638192+0000","last_clean":"2024-01-19T04:16:06.638192+0000","last_became_active":"2024-01-19T04:15:49.664196+0000","last_became_peered":"2024-01-19T04:15:49.664196+0000","last_unstale":"2024-01-19T04:16:06.638192+0000","last_undegraded":"2024-01-19T04:16:06.638192+0000","last_fullsized":"2024-01-19T04:16:06.638192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086252+0000","last_change":"2024-01-19T04:16:06.657128+0000","last_active":"2024-01-19T04:16:08.086252+0000","last_peered":"2024-01-19T04:16:08.086252+0000","last_clean":"2024-01-19T04:16:08.086252+0000","last_became_active":"2024-01-19T04:16:06.656850+0000","last_became_peered":"2024-01-19T04:16:06.656850+0000","last_unstale":"2024-01-19T04:16:08.086252+0000","last_undegraded":"2024-01-19T04:16:08.086252+0000","last_fullsized":"2024-01-19T04:16:08.086252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:24:57.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645376+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:16:06.645376+0000","last_peered":"2024-01-19T04:16:06.645376+0000","last_clean":"2024-01-19T04:16:06.645376+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:16:06.645376+0000","last_undegraded":"2024-01-19T04:16:06.645376+0000","last_fullsized":"2024-01-19T04:16:06.645376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.659051+0000","last_change":"2024-01-19T04:16:06.654727+0000","last_active":"2024-01-19T04:16:06.659051+0000","last_peered":"2024-01-19T04:16:06.659051+0000","last_clean":"2024-01-19T04:16:06.659051+0000","last_became_active":"2024-01-19T04:16:06.654482+0000","last_became_peered":"2024-01-19T04:16:06.654482+0000","last_unstale":"2024-01-19T04:16:06.659051+0000","last_undegraded":"2024-01-19T04:16:06.659051+0000","last_fullsized":"2024-01-19T04:16:06.659051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:52.554202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641486+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:16:06.641486+0000","last_peered":"2024-01-19T04:16:06.641486+0000","last_clean":"2024-01-19T04:16:06.641486+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:16:06.641486+0000","last_undegraded":"2024-01-19T04:16:06.641486+0000","last_fullsized":"2024-01-19T04:16:06.641486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084834+0000","last_change":"2024-01-19T04:16:06.659547+0000","last_active":"2024-01-19T04:16:08.084834+0000","last_peered":"2024-01-19T04:16:08.084834+0000","last_clean":"2024-01-19T04:16:08.084834+0000","last_became_active":"2024-01-19T04:16:06.659251+0000","last_became_peered":"2024-01-19T04:16:06.659251+0000","last_unstale":"2024-01-19T04:16:08.084834+0000","last_undegraded":"2024-01-19T04:16:08.084834+0000","last_fullsized":"2024-01-19T04:16:08.084834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:35:34.310303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.647196+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:16:06.647196+0000","last_peered":"2024-01-19T04:16:06.647196+0000","last_clean":"2024-01-19T04:16:06.647196+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:16:06.647196+0000","last_undegraded":"2024-01-19T04:16:06.647196+0000","last_fullsized":"2024-01-19T04:16:06.647196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085378+0000","last_change":"2024-01-19T04:16:06.663270+0000","last_active":"2024-01-19T04:16:08.085378+0000","last_peered":"2024-01-19T04:16:08.085378+0000","last_clean":"2024-01-19T04:16:08.085378+0000","last_became_active":"2024-01-19T04:16:06.661491+0000","last_became_peered":"2024-01-19T04:16:06.661491+0000","last_unstale":"2024-01-19T04:16:08.085378+0000","last_undegraded":"2024-01-19T04:16:08.085378+0000","last_fullsized":"2024-01-19T04:16:08.085378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:15.679645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.790041+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:16:05.790041+0000","last_peered":"2024-01-19T04:16:05.790041+0000","last_clean":"2024-01-19T04:16:05.790041+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:16:05.790041+0000","last_undegraded":"2024-01-19T04:16:05.790041+0000","last_fullsized":"2024-01-19T04:16:05.790041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080159+0000","last_change":"2024-01-19T04:16:06.658912+0000","last_active":"2024-01-19T04:16:08.080159+0000","last_peered":"2024-01-19T04:16:08.080159+0000","last_clean":"2024-01-19T04:16:08.080159+0000","last_became_active":"2024-01-19T04:16:06.657717+0000","last_became_peered":"2024-01-19T04:16:06.657717+0000","last_unstale":"2024-01-19T04:16:08.080159+0000","last_undegraded":"2024-01-19T04:16:08.080159+0000","last_fullsized":"2024-01-19T04:16:08.080159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633823+0000","last_change":"2024-01-19T04:15:49.657523+0000","last_active":"2024-01-19T04:16:06.633823+0000","last_peered":"2024-01-19T04:16:06.633823+0000","last_clean":"2024-01-19T04:16:06.633823+0000","last_became_active":"2024-01-19T04:15:49.657239+0000","last_became_peered":"2024-01-19T04:15:49.657239+0000","last_unstale":"2024-01-19T04:16:06.633823+0000","last_undegraded":"2024-01-19T04:16:06.633823+0000","last_fullsized":"2024-01-19T04:16:06.633823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:50.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085023+0000","last_change":"2024-01-19T04:16:06.659512+0000","last_active":"2024-01-19T04:16:08.085023+0000","last_peered":"2024-01-19T04:16:08.085023+0000","last_clean":"2024-01-19T04:16:08.085023+0000","last_became_active":"2024-01-19T04:16:06.659270+0000","last_became_peered":"2024-01-19T04:16:06.659270+0000","last_unstale":"2024-01-19T04:16:08.085023+0000","last_undegraded":"2024-01-19T04:16:08.085023+0000","last_fullsized":"2024-01-19T04:16:08.085023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:24:57.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638676+0000","last_change":"2024-01-19T04:15:49.666858+0000","last_active":"2024-01-19T04:16:06.638676+0000","last_peered":"2024-01-19T04:16:06.638676+0000","last_clean":"2024-01-19T04:16:06.638676+0000","last_became_active":"2024-01-19T04:15:49.665093+0000","last_became_peered":"2024-01-19T04:15:49.665093+0000","last_unstale":"2024-01-19T04:16:06.638676+0000","last_undegraded":"2024-01-19T04:16:06.638676+0000","last_fullsized":"2024-01-19T04:16:06.638676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080530+0000","last_change":"2024-01-19T04:16:06.654831+0000","last_active":"2024-01-19T04:16:08.080530+0000","last_peered":"2024-01-19T04:16:08.080530+0000","last_clean":"2024-01-19T04:16:08.080530+0000","last_became_active":"2024-01-19T04:16:06.654545+0000","last_became_peered":"2024-01-19T04:16:06.654545+0000","last_unstale":"2024-01-19T04:16:08.080530+0000","last_undegraded":"2024-01-19T04:16:08.080530+0000","last_fullsized":"2024-01-19T04:16:08.080530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:10:45.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640815+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:16:06.640815+0000","last_peered":"2024-01-19T04:16:06.640815+0000","last_clean":"2024-01-19T04:16:06.640815+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:16:06.640815+0000","last_undegraded":"2024-01-19T04:16:06.640815+0000","last_fullsized":"2024-01-19T04:16:06.640815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085694+0000","last_change":"2024-01-19T04:16:06.661023+0000","last_active":"2024-01-19T04:16:08.085694+0000","last_peered":"2024-01-19T04:16:08.085694+0000","last_clean":"2024-01-19T04:16:08.085694+0000","last_became_active":"2024-01-19T04:16:06.660642+0000","last_became_peered":"2024-01-19T04:16:06.660642+0000","last_unstale":"2024-01-19T04:16:08.085694+0000","last_undegraded":"2024-01-19T04:16:08.085694+0000","last_fullsized":"2024-01-19T04:16:08.085694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:00.472323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-19T04:16:05.793039+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:16:05.793039+0000","last_peered":"2024-01-19T04:16:05.793039+0000","last_clean":"2024-01-19T04:16:05.793039+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:16:05.793039+0000","last_undegraded":"2024-01-19T04:16:05.793039+0000","last_fullsized":"2024-01-19T04:16:05.793039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639131+0000","last_change":"2024-01-19T04:16:06.653710+0000","last_active":"2024-01-19T04:16:07.639131+0000","last_peered":"2024-01-19T04:16:07.639131+0000","last_clean":"2024-01-19T04:16:07.639131+0000","last_became_active":"2024-01-19T04:16:06.653239+0000","last_became_peered":"2024-01-19T04:16:06.653239+0000","last_unstale":"2024-01-19T04:16:07.639131+0000","last_undegraded":"2024-01-19T04:16:07.639131+0000","last_fullsized":"2024-01-19T04:16:07.639131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:38.868186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637755+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:16:06.637755+0000","last_peered":"2024-01-19T04:16:06.637755+0000","last_clean":"2024-01-19T04:16:06.637755+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:16:06.637755+0000","last_undegraded":"2024-01-19T04:16:06.637755+0000","last_fullsized":"2024-01-19T04:16:06.637755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476755,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":767441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.874}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.503},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.56999999999999995}]}]},{"osd":6,"up_from":16,"seq":68719476755,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":178181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.627},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.747},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.434}]}]},{"osd":5,"up_from":16,"seq":68719476754,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":177635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.86199999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476756,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":178609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.91100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":178597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.255},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80900000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":180092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.032},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.96299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":767295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.876},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.94299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":450560,"data_stored":173503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.745}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:16:15.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:16:15.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6df400640 1 Processor -- start 2024-01-19T04:16:15.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6df400640 1 -- start start 2024-01-19T04:16:15.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6df400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa6d814fb50 0x7fa6d806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6df400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d8071e80 con 0x7fa6d80a4ec0 2024-01-19T04:16:15.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6df400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d80726c0 con 0x7fa6d80c04a0 2024-01-19T04:16:15.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6df400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d81535c0 con 0x7fa6d814fb50 2024-01-19T04:16:15.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dd400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa6d80a4ec0 0x7fa6d815cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41964/0 (socket says 172.21.15.32:41964) 2024-01-19T04:16:15.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dd400640 1 -- 172.21.15.32:0/324829031 learned_addr learned my addr 172.21.15.32:0/324829031 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 --2- 172.21.15.32:0/324829031 >> v2:172.21.15.67:3300/0 conn(0x7fa6d814fb50 0x7fa6d806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246181369 0 0) 0x7fa6d8071e80 con 0x7fa6d80a4ec0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b8003530 con 0x7fa6d80a4ec0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520919717 0 0) 0x7fa6d80726c0 con 0x7fa6d80c04a0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d8071e80 con 0x7fa6d80c04a0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798832378 0 0) 0x7fa6b8003530 con 0x7fa6d80a4ec0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 >> v2:172.21.15.67:3300/0 conn(0x7fa6d814fb50 msgr2=0x7fa6d806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 --2- 172.21.15.32:0/324829031 >> v2:172.21.15.67:3300/0 conn(0x7fa6d814fb50 0x7fa6d806fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 >> v1:172.21.15.67:6789/0 conn(0x7fa6d80c04a0 legacy=0x7fa6d80c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80c0a20 con 0x7fa6d80a4ec0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fa6d0001a00 con 0x7fa6d80a4ec0 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 --2- 172.21.15.32:0/324829031 >> v2:172.21.15.67:3300/0 conn(0x7fa6d814fb50 0x7fa6d806fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 >> v1:172.21.15.32:6789/0 conn(0x7fa6d80a4ec0 legacy=0x7fa6d815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6b8003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6b80047d0 0x7fa6b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6b80051e0 0x7fa6b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81535c0 con 0x7fa6b8003b60 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b800c110 con 0x7fa6b80051e0 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b800c2d0 con 0x7fa6b80047d0 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6b8003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6d7e00640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6b80047d0 0x7fa6b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dd400640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6b80051e0 0x7fa6b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 -- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6b80047d0 msgr2=0x7fa6b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6b80047d0 0x7fa6b8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 -- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6b80051e0 msgr2=0x7fa6b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6b80051e0 0x7fa6b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dca00640 1 -- 172.21.15.32:0/324829031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8003530 con 0x7fa6b8003b60 2024-01-19T04:16:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dd400640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6b80051e0 0x7fa6b800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.650+0000 7fa6dd400640 1 -- 172.21.15.32:0/324829031 reap_dead start 2024-01-19T04:16:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6dca00640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6b8003f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009cb0 tx=0x7fa6c801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723eee993a4b424e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80a5690 con 0x7fa6b8003b60 2024-01-19T04:16:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c80a57f0 con 0x7fa6b8003b60 2024-01-19T04:16:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6d7400640 1 -- 172.21.15.32:0/324829031 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80a59e0 con 0x7fa6b8003b60 2024-01-19T04:16:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6df400640 1 -- 172.21.15.32:0/324829031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 msgr2=0x7fa6b8003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6df400640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6b8003f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009cb0 tx=0x7fa6c801cbf0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6df400640 1 -- 172.21.15.32:0/324829031 shutdown_connections 2024-01-19T04:16:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6df400640 1 --2- 172.21.15.32:0/324829031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6b8003f60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6df400640 1 -- 172.21.15.32:0/324829031 >> 172.21.15.32:0/324829031 conn(0x7fa6d80c5b20 msgr2=0x7fa6d80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:15.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6df400640 1 -- 172.21.15.32:0/324829031 shutdown_connections 2024-01-19T04:16:15.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.654+0000 7fa6df400640 1 -- 172.21.15.32:0/324829031 wait complete. 2024-01-19T04:16:15.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 Processor -- start 2024-01-19T04:16:15.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 -- start start 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6d80a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d806d3e0 0x7fa6d81dee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d806d8f0 0x7fa6d81df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81f14d0 con 0x7fa6b8003b60 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d814c250 con 0x7fa6d806d8f0 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81f0850 con 0x7fa6d806d3e0 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6d80a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6d80a6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43414/0 (socket says 172.21.15.32:43414) 2024-01-19T04:16:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 -- 172.21.15.32:0/2824793326 learned_addr learned my addr 172.21.15.32:0/2824793326 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6d7e00640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d806d3e0 0x7fa6d81dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dd400640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d806d8f0 0x7fa6d81df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 -- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d806d3e0 msgr2=0x7fa6d81dee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d806d3e0 0x7fa6d81dee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 -- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d806d8f0 msgr2=0x7fa6d81df3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d806d8f0 0x7fa6d81df3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 -- 172.21.15.32:0/2824793326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d81f0b30 con 0x7fa6b8003b60 2024-01-19T04:16:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6dca00640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6d80a6d40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009cb0 tx=0x7fa6c8019990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6d4c00640 1 -- 172.21.15.32:0/2824793326 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8006e40 con 0x7fa6b8003b60 2024-01-19T04:16:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6d4c00640 1 -- 172.21.15.32:0/2824793326 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c80b8450 con 0x7fa6b8003b60 2024-01-19T04:16:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6d4c00640 1 -- 172.21.15.32:0/2824793326 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80b8800 con 0x7fa6b8003b60 2024-01-19T04:16:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.658+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d81f0e10 con 0x7fa6b8003b60 2024-01-19T04:16:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.662+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d80a7280 con 0x7fa6b8003b60 2024-01-19T04:16:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.662+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d80749f0 con 0x7fa6b8003b60 2024-01-19T04:16:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.662+0000 7fa6d4c00640 1 -- 172.21.15.32:0/2824793326 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa6c80b4070 con 0x7fa6b8003b60 2024-01-19T04:16:15.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.662+0000 7fa6d4c00640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6b0066500 0x7fa6b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:15.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.662+0000 7fa6d4c00640 1 -- 172.21.15.32:0/2824793326 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa6c811e570 con 0x7fa6b8003b60 2024-01-19T04:16:15.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.662+0000 7fa6d7e00640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6b0066500 0x7fa6b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:15.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.662+0000 7fa6d7e00640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6b0066500 0x7fa6b00689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6d814c5b0 tx=0x7fa6c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:15.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.666+0000 7fa6d4c00640 1 -- 172.21.15.32:0/2824793326 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa6c80eb670 con 0x7fa6b8003b60 2024-01-19T04:16:15.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.822+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6d8072b30 con 0x7fa6b0066500 2024-01-19T04:16:15.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.838+0000 7fa6d4c00640 1 -- 172.21.15.32:0/2824793326 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527609 (secure 0 0 0) 0x7fa6c0012950 con 0x7fa6b0066500 2024-01-19T04:16:15.843 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6b0066500 msgr2=0x7fa6b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6b0066500 0x7fa6b00689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6d814c5b0 tx=0x7fa6c0009040 comp rx=0 tx=0).stop 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 msgr2=0x7fa6d80a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6d80a6d40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009cb0 tx=0x7fa6c8019990 comp rx=0 tx=0).stop 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 shutdown_connections 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6b0066500 0x7fa6b00689c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6d806d8f0 0x7fa6d81df3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6d806d3e0 0x7fa6d81dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 --2- 172.21.15.32:0/2824793326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6b8003b60 0x7fa6d80a6d40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 >> 172.21.15.32:0/2824793326 conn(0x7fa6d80c5b20 msgr2=0x7fa6d8144d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 shutdown_connections 2024-01-19T04:16:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:15.842+0000 7fa6df400640 1 -- 172.21.15.32:0/2824793326 wait complete. 2024-01-19T04:16:15.864 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-01-19T04:16:14.045464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":252,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":377,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237512,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737208,"statfs":{"total":773094113280,"available":772850900992,"internally_reserved":0,"allocated":4792320,"data_stored":2608510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001998"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086760+0000","last_change":"2024-01-19T04:16:06.662967+0000","last_active":"2024-01-19T04:16:08.086760+0000","last_peered":"2024-01-19T04:16:08.086760+0000","last_clean":"2024-01-19T04:16:08.086760+0000","last_became_active":"2024-01-19T04:16:06.662697+0000","last_became_peered":"2024-01-19T04:16:06.662697+0000","last_unstale":"2024-01-19T04:16:08.086760+0000","last_undegraded":"2024-01-19T04:16:08.086760+0000","last_fullsized":"2024-01-19T04:16:08.086760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642222+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:16:06.642222+0000","last_peered":"2024-01-19T04:16:06.642222+0000","last_clean":"2024-01-19T04:16:06.642222+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:16:06.642222+0000","last_undegraded":"2024-01-19T04:16:06.642222+0000","last_fullsized":"2024-01-19T04:16:06.642222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637564+0000","last_change":"2024-01-19T04:15:48.663958+0000","last_active":"2024-01-19T04:16:06.637564+0000","last_peered":"2024-01-19T04:16:06.637564+0000","last_clean":"2024-01-19T04:16:06.637564+0000","last_became_active":"2024-01-19T04:15:48.663688+0000","last_became_peered":"2024-01-19T04:15:48.663688+0000","last_unstale":"2024-01-19T04:16:06.637564+0000","last_undegraded":"2024-01-19T04:16:06.637564+0000","last_fullsized":"2024-01-19T04:16:06.637564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643895+0000","last_change":"2024-01-19T04:15:49.660042+0000","last_active":"2024-01-19T04:16:06.643895+0000","last_peered":"2024-01-19T04:16:06.643895+0000","last_clean":"2024-01-19T04:16:06.643895+0000","last_became_active":"2024-01-19T04:15:49.659782+0000","last_became_peered":"2024-01-19T04:15:49.659782+0000","last_unstale":"2024-01-19T04:16:06.643895+0000","last_undegraded":"2024-01-19T04:16:06.643895+0000","last_fullsized":"2024-01-19T04:16:06.643895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.787473+0000","last_change":"2024-01-19T04:16:05.796195+0000","last_active":"2024-01-19T04:16:06.787473+0000","last_peered":"2024-01-19T04:16:06.787473+0000","last_clean":"2024-01-19T04:16:06.787473+0000","last_became_active":"2024-01-19T04:16:05.795881+0000","last_became_peered":"2024-01-19T04:16:05.795881+0000","last_unstale":"2024-01-19T04:16:06.787473+0000","last_undegraded":"2024-01-19T04:16:06.787473+0000","last_fullsized":"2024-01-19T04:16:06.787473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:37.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.087124+0000","last_change":"2024-01-19T04:16:06.654967+0000","last_active":"2024-01-19T04:16:08.087124+0000","last_peered":"2024-01-19T04:16:08.087124+0000","last_clean":"2024-01-19T04:16:08.087124+0000","last_became_active":"2024-01-19T04:16:06.653661+0000","last_became_peered":"2024-01-19T04:16:06.653661+0000","last_unstale":"2024-01-19T04:16:08.087124+0000","last_undegraded":"2024-01-19T04:16:08.087124+0000","last_fullsized":"2024-01-19T04:16:08.087124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:19:23.450617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638266+0000","last_change":"2024-01-19T04:15:48.654622+0000","last_active":"2024-01-19T04:16:06.638266+0000","last_peered":"2024-01-19T04:16:06.638266+0000","last_clean":"2024-01-19T04:16:06.638266+0000","last_became_active":"2024-01-19T04:15:48.654344+0000","last_became_peered":"2024-01-19T04:15:48.654344+0000","last_unstale":"2024-01-19T04:16:06.638266+0000","last_undegraded":"2024-01-19T04:16:06.638266+0000","last_fullsized":"2024-01-19T04:16:06.638266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:54:34.694116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646415+0000","last_change":"2024-01-19T04:15:49.673875+0000","last_active":"2024-01-19T04:16:06.646415+0000","last_peered":"2024-01-19T04:16:06.646415+0000","last_clean":"2024-01-19T04:16:06.646415+0000","last_became_active":"2024-01-19T04:15:49.673605+0000","last_became_peered":"2024-01-19T04:15:49.673605+0000","last_unstale":"2024-01-19T04:16:06.646415+0000","last_undegraded":"2024-01-19T04:16:06.646415+0000","last_fullsized":"2024-01-19T04:16:06.646415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644324+0000","last_change":"2024-01-19T04:16:05.798357+0000","last_active":"2024-01-19T04:16:06.644324+0000","last_peered":"2024-01-19T04:16:06.644324+0000","last_clean":"2024-01-19T04:16:06.644324+0000","last_became_active":"2024-01-19T04:16:05.797943+0000","last_became_peered":"2024-01-19T04:16:05.797943+0000","last_unstale":"2024-01-19T04:16:06.644324+0000","last_undegraded":"2024-01-19T04:16:06.644324+0000","last_fullsized":"2024-01-19T04:16:06.644324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086656+0000","last_change":"2024-01-19T04:16:06.649757+0000","last_active":"2024-01-19T04:16:08.086656+0000","last_peered":"2024-01-19T04:16:08.086656+0000","last_clean":"2024-01-19T04:16:08.086656+0000","last_became_active":"2024-01-19T04:16:06.649522+0000","last_became_peered":"2024-01-19T04:16:06.649522+0000","last_unstale":"2024-01-19T04:16:08.086656+0000","last_undegraded":"2024-01-19T04:16:08.086656+0000","last_fullsized":"2024-01-19T04:16:08.086656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:20:12.457128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646597+0000","last_change":"2024-01-19T04:15:48.656031+0000","last_active":"2024-01-19T04:16:06.646597+0000","last_peered":"2024-01-19T04:16:06.646597+0000","last_clean":"2024-01-19T04:16:06.646597+0000","last_became_active":"2024-01-19T04:15:48.655728+0000","last_became_peered":"2024-01-19T04:15:48.655728+0000","last_unstale":"2024-01-19T04:16:06.646597+0000","last_undegraded":"2024-01-19T04:16:06.646597+0000","last_fullsized":"2024-01-19T04:16:06.646597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638084+0000","last_change":"2024-01-19T04:15:49.660662+0000","last_active":"2024-01-19T04:16:06.638084+0000","last_peered":"2024-01-19T04:16:06.638084+0000","last_clean":"2024-01-19T04:16:06.638084+0000","last_became_active":"2024-01-19T04:15:49.658831+0000","last_became_peered":"2024-01-19T04:15:49.658831+0000","last_unstale":"2024-01-19T04:16:06.638084+0000","last_undegraded":"2024-01-19T04:16:06.638084+0000","last_fullsized":"2024-01-19T04:16:06.638084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:19.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642445+0000","last_change":"2024-01-19T04:16:05.796165+0000","last_active":"2024-01-19T04:16:06.642445+0000","last_peered":"2024-01-19T04:16:06.642445+0000","last_clean":"2024-01-19T04:16:06.642445+0000","last_became_active":"2024-01-19T04:16:05.795971+0000","last_became_peered":"2024-01-19T04:16:05.795971+0000","last_unstale":"2024-01-19T04:16:06.642445+0000","last_undegraded":"2024-01-19T04:16:06.642445+0000","last_fullsized":"2024-01-19T04:16:06.642445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:25.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.638475+0000","last_change":"2024-01-19T04:16:06.652148+0000","last_active":"2024-01-19T04:16:07.638475+0000","last_peered":"2024-01-19T04:16:07.638475+0000","last_clean":"2024-01-19T04:16:07.638475+0000","last_became_active":"2024-01-19T04:16:06.651819+0000","last_became_peered":"2024-01-19T04:16:06.651819+0000","last_unstale":"2024-01-19T04:16:07.638475+0000","last_undegraded":"2024-01-19T04:16:07.638475+0000","last_fullsized":"2024-01-19T04:16:07.638475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:55:31.123742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637633+0000","last_change":"2024-01-19T04:15:48.658108+0000","last_active":"2024-01-19T04:16:06.637633+0000","last_peered":"2024-01-19T04:16:06.637633+0000","last_clean":"2024-01-19T04:16:06.637633+0000","last_became_active":"2024-01-19T04:15:48.657820+0000","last_became_peered":"2024-01-19T04:15:48.657820+0000","last_unstale":"2024-01-19T04:16:06.637633+0000","last_undegraded":"2024-01-19T04:16:06.637633+0000","last_fullsized":"2024-01-19T04:16:06.637633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650232+0000","last_change":"2024-01-19T04:15:49.653943+0000","last_active":"2024-01-19T04:16:06.650232+0000","last_peered":"2024-01-19T04:16:06.650232+0000","last_clean":"2024-01-19T04:16:06.650232+0000","last_became_active":"2024-01-19T04:15:49.653669+0000","last_became_peered":"2024-01-19T04:15:49.653669+0000","last_unstale":"2024-01-19T04:16:06.650232+0000","last_undegraded":"2024-01-19T04:16:06.650232+0000","last_fullsized":"2024-01-19T04:16:06.650232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084761+0000","last_change":"2024-01-19T04:16:05.798495+0000","last_active":"2024-01-19T04:16:08.084761+0000","last_peered":"2024-01-19T04:16:08.084761+0000","last_clean":"2024-01-19T04:16:08.084761+0000","last_became_active":"2024-01-19T04:16:05.797905+0000","last_became_peered":"2024-01-19T04:16:05.797905+0000","last_unstale":"2024-01-19T04:16:08.084761+0000","last_undegraded":"2024-01-19T04:16:08.084761+0000","last_fullsized":"2024-01-19T04:16:08.084761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084385+0000","last_change":"2024-01-19T04:16:06.657675+0000","last_active":"2024-01-19T04:16:08.084385+0000","last_peered":"2024-01-19T04:16:08.084385+0000","last_clean":"2024-01-19T04:16:08.084385+0000","last_became_active":"2024-01-19T04:16:06.657403+0000","last_became_peered":"2024-01-19T04:16:06.657403+0000","last_unstale":"2024-01-19T04:16:08.084385+0000","last_undegraded":"2024-01-19T04:16:08.084385+0000","last_fullsized":"2024-01-19T04:16:08.084385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:20.839193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650407+0000","last_change":"2024-01-19T04:15:48.657123+0000","last_active":"2024-01-19T04:16:06.650407+0000","last_peered":"2024-01-19T04:16:06.650407+0000","last_clean":"2024-01-19T04:16:06.650407+0000","last_became_active":"2024-01-19T04:15:48.656476+0000","last_became_peered":"2024-01-19T04:15:48.656476+0000","last_unstale":"2024-01-19T04:16:06.650407+0000","last_undegraded":"2024-01-19T04:16:06.650407+0000","last_fullsized":"2024-01-19T04:16:06.650407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637174+0000","last_change":"2024-01-19T04:15:49.665677+0000","last_active":"2024-01-19T04:16:06.637174+0000","last_peered":"2024-01-19T04:16:06.637174+0000","last_clean":"2024-01-19T04:16:06.637174+0000","last_became_active":"2024-01-19T04:15:49.665384+0000","last_became_peered":"2024-01-19T04:15:49.665384+0000","last_unstale":"2024-01-19T04:16:06.637174+0000","last_undegraded":"2024-01-19T04:16:06.637174+0000","last_fullsized":"2024-01-19T04:16:06.637174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:33:56.660266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084600+0000","last_change":"2024-01-19T04:16:05.790864+0000","last_active":"2024-01-19T04:16:08.084600+0000","last_peered":"2024-01-19T04:16:08.084600+0000","last_clean":"2024-01-19T04:16:08.084600+0000","last_became_active":"2024-01-19T04:16:05.790554+0000","last_became_peered":"2024-01-19T04:16:05.790554+0000","last_unstale":"2024-01-19T04:16:08.084600+0000","last_undegraded":"2024-01-19T04:16:08.084600+0000","last_fullsized":"2024-01-19T04:16:08.084600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:24.751392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086361+0000","last_change":"2024-01-19T04:16:06.658541+0000","last_active":"2024-01-19T04:16:08.086361+0000","last_peered":"2024-01-19T04:16:08.086361+0000","last_clean":"2024-01-19T04:16:08.086361+0000","last_became_active":"2024-01-19T04:16:06.657934+0000","last_became_peered":"2024-01-19T04:16:06.657934+0000","last_unstale":"2024-01-19T04:16:08.086361+0000","last_undegraded":"2024-01-19T04:16:08.086361+0000","last_fullsized":"2024-01-19T04:16:08.086361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:18:45.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639010+0000","last_change":"2024-01-19T04:15:48.657833+0000","last_active":"2024-01-19T04:16:06.639010+0000","last_peered":"2024-01-19T04:16:06.639010+0000","last_clean":"2024-01-19T04:16:06.639010+0000","last_became_active":"2024-01-19T04:15:48.657613+0000","last_became_peered":"2024-01-19T04:15:48.657613+0000","last_unstale":"2024-01-19T04:16:06.639010+0000","last_undegraded":"2024-01-19T04:16:06.639010+0000","last_fullsized":"2024-01-19T04:16:06.639010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650609+0000","last_change":"2024-01-19T04:15:49.667426+0000","last_active":"2024-01-19T04:16:06.650609+0000","last_peered":"2024-01-19T04:16:06.650609+0000","last_clean":"2024-01-19T04:16:06.650609+0000","last_became_active":"2024-01-19T04:15:49.667142+0000","last_became_peered":"2024-01-19T04:15:49.667142+0000","last_unstale":"2024-01-19T04:16:06.650609+0000","last_undegraded":"2024-01-19T04:16:06.650609+0000","last_fullsized":"2024-01-19T04:16:06.650609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085391+0000","last_change":"2024-01-19T04:16:05.797053+0000","last_active":"2024-01-19T04:16:08.085391+0000","last_peered":"2024-01-19T04:16:08.085391+0000","last_clean":"2024-01-19T04:16:08.085391+0000","last_became_active":"2024-01-19T04:16:05.796727+0000","last_became_peered":"2024-01-19T04:16:05.796727+0000","last_unstale":"2024-01-19T04:16:08.085391+0000","last_undegraded":"2024-01-19T04:16:08.085391+0000","last_fullsized":"2024-01-19T04:16:08.085391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:28:03.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080592+0000","last_change":"2024-01-19T04:16:06.655879+0000","last_active":"2024-01-19T04:16:08.080592+0000","last_peered":"2024-01-19T04:16:08.080592+0000","last_clean":"2024-01-19T04:16:08.080592+0000","last_became_active":"2024-01-19T04:16:06.655559+0000","last_became_peered":"2024-01-19T04:16:06.655559+0000","last_unstale":"2024-01-19T04:16:08.080592+0000","last_undegraded":"2024-01-19T04:16:08.080592+0000","last_fullsized":"2024-01-19T04:16:08.080592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:48.677866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651211+0000","last_change":"2024-01-19T04:15:48.663684+0000","last_active":"2024-01-19T04:16:06.651211+0000","last_peered":"2024-01-19T04:16:06.651211+0000","last_clean":"2024-01-19T04:16:06.651211+0000","last_became_active":"2024-01-19T04:15:48.663369+0000","last_became_peered":"2024-01-19T04:15:48.663369+0000","last_unstale":"2024-01-19T04:16:06.651211+0000","last_undegraded":"2024-01-19T04:16:06.651211+0000","last_fullsized":"2024-01-19T04:16:06.651211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641445+0000","last_change":"2024-01-19T04:15:49.660598+0000","last_active":"2024-01-19T04:16:06.641445+0000","last_peered":"2024-01-19T04:16:06.641445+0000","last_clean":"2024-01-19T04:16:06.641445+0000","last_became_active":"2024-01-19T04:15:49.660288+0000","last_became_peered":"2024-01-19T04:15:49.660288+0000","last_unstale":"2024-01-19T04:16:06.641445+0000","last_undegraded":"2024-01-19T04:16:06.641445+0000","last_fullsized":"2024-01-19T04:16:06.641445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084410+0000","last_change":"2024-01-19T04:16:05.794126+0000","last_active":"2024-01-19T04:16:08.084410+0000","last_peered":"2024-01-19T04:16:08.084410+0000","last_clean":"2024-01-19T04:16:08.084410+0000","last_became_active":"2024-01-19T04:16:05.793821+0000","last_became_peered":"2024-01-19T04:16:05.793821+0000","last_unstale":"2024-01-19T04:16:08.084410+0000","last_undegraded":"2024-01-19T04:16:08.084410+0000","last_fullsized":"2024-01-19T04:16:08.084410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085125+0000","last_change":"2024-01-19T04:16:06.654711+0000","last_active":"2024-01-19T04:16:08.085125+0000","last_peered":"2024-01-19T04:16:08.085125+0000","last_clean":"2024-01-19T04:16:08.085125+0000","last_became_active":"2024-01-19T04:16:06.654442+0000","last_became_peered":"2024-01-19T04:16:06.654442+0000","last_unstale":"2024-01-19T04:16:08.085125+0000","last_undegraded":"2024-01-19T04:16:08.085125+0000","last_fullsized":"2024-01-19T04:16:08.085125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:13.662662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638284+0000","last_change":"2024-01-19T04:15:48.662839+0000","last_active":"2024-01-19T04:16:06.638284+0000","last_peered":"2024-01-19T04:16:06.638284+0000","last_clean":"2024-01-19T04:16:06.638284+0000","last_became_active":"2024-01-19T04:15:48.662471+0000","last_became_peered":"2024-01-19T04:15:48.662471+0000","last_unstale":"2024-01-19T04:16:06.638284+0000","last_undegraded":"2024-01-19T04:16:06.638284+0000","last_fullsized":"2024-01-19T04:16:06.638284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:27:41.436992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634955+0000","last_change":"2024-01-19T04:15:49.680184+0000","last_active":"2024-01-19T04:16:06.634955+0000","last_peered":"2024-01-19T04:16:06.634955+0000","last_clean":"2024-01-19T04:16:06.634955+0000","last_became_active":"2024-01-19T04:15:49.679925+0000","last_became_peered":"2024-01-19T04:15:49.679925+0000","last_unstale":"2024-01-19T04:16:06.634955+0000","last_undegraded":"2024-01-19T04:16:06.634955+0000","last_fullsized":"2024-01-19T04:16:06.634955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:18.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644692+0000","last_change":"2024-01-19T04:16:05.796232+0000","last_active":"2024-01-19T04:16:06.644692+0000","last_peered":"2024-01-19T04:16:06.644692+0000","last_clean":"2024-01-19T04:16:06.644692+0000","last_became_active":"2024-01-19T04:16:05.795908+0000","last_became_peered":"2024-01-19T04:16:05.795908+0000","last_unstale":"2024-01-19T04:16:06.644692+0000","last_undegraded":"2024-01-19T04:16:06.644692+0000","last_fullsized":"2024-01-19T04:16:06.644692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:14.677313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084379+0000","last_change":"2024-01-19T04:16:06.651279+0000","last_active":"2024-01-19T04:16:08.084379+0000","last_peered":"2024-01-19T04:16:08.084379+0000","last_clean":"2024-01-19T04:16:08.084379+0000","last_became_active":"2024-01-19T04:16:06.651097+0000","last_became_peered":"2024-01-19T04:16:06.651097+0000","last_unstale":"2024-01-19T04:16:08.084379+0000","last_undegraded":"2024-01-19T04:16:08.084379+0000","last_fullsized":"2024-01-19T04:16:08.084379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:25:40.860239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639829+0000","last_change":"2024-01-19T04:15:48.657592+0000","last_active":"2024-01-19T04:16:06.639829+0000","last_peered":"2024-01-19T04:16:06.639829+0000","last_clean":"2024-01-19T04:16:06.639829+0000","last_became_active":"2024-01-19T04:15:48.657215+0000","last_became_peered":"2024-01-19T04:15:48.657215+0000","last_unstale":"2024-01-19T04:16:06.639829+0000","last_undegraded":"2024-01-19T04:16:06.639829+0000","last_fullsized":"2024-01-19T04:16:06.639829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:45.288685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.647108+0000","last_change":"2024-01-19T04:15:49.657147+0000","last_active":"2024-01-19T04:16:06.647108+0000","last_peered":"2024-01-19T04:16:06.647108+0000","last_clean":"2024-01-19T04:16:06.647108+0000","last_became_active":"2024-01-19T04:15:49.656059+0000","last_became_peered":"2024-01-19T04:15:49.656059+0000","last_unstale":"2024-01-19T04:16:06.647108+0000","last_undegraded":"2024-01-19T04:16:06.647108+0000","last_fullsized":"2024-01-19T04:16:06.647108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640162+0000","last_change":"2024-01-19T04:16:05.797613+0000","last_active":"2024-01-19T04:16:06.640162+0000","last_peered":"2024-01-19T04:16:06.640162+0000","last_clean":"2024-01-19T04:16:06.640162+0000","last_became_active":"2024-01-19T04:16:05.797323+0000","last_became_peered":"2024-01-19T04:16:05.797323+0000","last_unstale":"2024-01-19T04:16:06.640162+0000","last_undegraded":"2024-01-19T04:16:06.640162+0000","last_fullsized":"2024-01-19T04:16:06.640162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:53.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086549+0000","last_change":"2024-01-19T04:16:06.655628+0000","last_active":"2024-01-19T04:16:08.086549+0000","last_peered":"2024-01-19T04:16:08.086549+0000","last_clean":"2024-01-19T04:16:08.086549+0000","last_became_active":"2024-01-19T04:16:06.653875+0000","last_became_peered":"2024-01-19T04:16:06.653875+0000","last_unstale":"2024-01-19T04:16:08.086549+0000","last_undegraded":"2024-01-19T04:16:08.086549+0000","last_fullsized":"2024-01-19T04:16:08.086549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:39:46.883207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646506+0000","last_change":"2024-01-19T04:15:48.661261+0000","last_active":"2024-01-19T04:16:06.646506+0000","last_peered":"2024-01-19T04:16:06.646506+0000","last_clean":"2024-01-19T04:16:06.646506+0000","last_became_active":"2024-01-19T04:15:48.660981+0000","last_became_peered":"2024-01-19T04:15:48.660981+0000","last_unstale":"2024-01-19T04:16:06.646506+0000","last_undegraded":"2024-01-19T04:16:06.646506+0000","last_fullsized":"2024-01-19T04:16:06.646506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:04:59.090168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634212+0000","last_change":"2024-01-19T04:15:49.660917+0000","last_active":"2024-01-19T04:16:06.634212+0000","last_peered":"2024-01-19T04:16:06.634212+0000","last_clean":"2024-01-19T04:16:06.634212+0000","last_became_active":"2024-01-19T04:15:49.655137+0000","last_became_peered":"2024-01-19T04:15:49.655137+0000","last_unstale":"2024-01-19T04:16:06.634212+0000","last_undegraded":"2024-01-19T04:16:06.634212+0000","last_fullsized":"2024-01-19T04:16:06.634212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:05:00.093326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.050881+0000","last_change":"2024-01-19T04:16:05.795319+0000","last_active":"2024-01-19T04:16:08.050881+0000","last_peered":"2024-01-19T04:16:08.050881+0000","last_clean":"2024-01-19T04:16:08.050881+0000","last_became_active":"2024-01-19T04:16:05.794958+0000","last_became_peered":"2024-01-19T04:16:05.794958+0000","last_unstale":"2024-01-19T04:16:08.050881+0000","last_undegraded":"2024-01-19T04:16:08.050881+0000","last_fullsized":"2024-01-19T04:16:08.050881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:55:40.046252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084469+0000","last_change":"2024-01-19T04:16:06.659222+0000","last_active":"2024-01-19T04:16:08.084469+0000","last_peered":"2024-01-19T04:16:08.084469+0000","last_clean":"2024-01-19T04:16:08.084469+0000","last_became_active":"2024-01-19T04:16:06.657419+0000","last_became_peered":"2024-01-19T04:16:06.657419+0000","last_unstale":"2024-01-19T04:16:08.084469+0000","last_undegraded":"2024-01-19T04:16:08.084469+0000","last_fullsized":"2024-01-19T04:16:08.084469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:38.868186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637266+0000","last_change":"2024-01-19T04:15:48.663429+0000","last_active":"2024-01-19T04:16:06.637266+0000","last_peered":"2024-01-19T04:16:06.637266+0000","last_clean":"2024-01-19T04:16:06.637266+0000","last_became_active":"2024-01-19T04:15:48.663164+0000","last_became_peered":"2024-01-19T04:15:48.663164+0000","last_unstale":"2024-01-19T04:16:06.637266+0000","last_undegraded":"2024-01-19T04:16:06.637266+0000","last_fullsized":"2024-01-19T04:16:06.637266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633993+0000","last_change":"2024-01-19T04:15:49.657920+0000","last_active":"2024-01-19T04:16:06.633993+0000","last_peered":"2024-01-19T04:16:06.633993+0000","last_clean":"2024-01-19T04:16:06.633993+0000","last_became_active":"2024-01-19T04:15:49.657332+0000","last_became_peered":"2024-01-19T04:15:49.657332+0000","last_unstale":"2024-01-19T04:16:06.633993+0000","last_undegraded":"2024-01-19T04:16:06.633993+0000","last_fullsized":"2024-01-19T04:16:06.633993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:10.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642720+0000","last_change":"2024-01-19T04:16:05.796585+0000","last_active":"2024-01-19T04:16:06.642720+0000","last_peered":"2024-01-19T04:16:06.642720+0000","last_clean":"2024-01-19T04:16:06.642720+0000","last_became_active":"2024-01-19T04:16:05.796302+0000","last_became_peered":"2024-01-19T04:16:05.796302+0000","last_unstale":"2024-01-19T04:16:06.642720+0000","last_undegraded":"2024-01-19T04:16:06.642720+0000","last_fullsized":"2024-01-19T04:16:06.642720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:37.865854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635132+0000","last_change":"2024-01-19T04:16:06.653073+0000","last_active":"2024-01-19T04:16:07.635132+0000","last_peered":"2024-01-19T04:16:07.635132+0000","last_clean":"2024-01-19T04:16:07.635132+0000","last_became_active":"2024-01-19T04:16:06.652783+0000","last_became_peered":"2024-01-19T04:16:06.652783+0000","last_unstale":"2024-01-19T04:16:07.635132+0000","last_undegraded":"2024-01-19T04:16:07.635132+0000","last_fullsized":"2024-01-19T04:16:07.635132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:43.230089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.650249+0000","last_change":"2024-01-19T04:15:48.659102+0000","last_active":"2024-01-19T04:16:06.650249+0000","last_peered":"2024-01-19T04:16:06.650249+0000","last_clean":"2024-01-19T04:16:06.650249+0000","last_became_active":"2024-01-19T04:15:48.658841+0000","last_became_peered":"2024-01-19T04:15:48.658841+0000","last_unstale":"2024-01-19T04:16:06.650249+0000","last_undegraded":"2024-01-19T04:16:06.650249+0000","last_fullsized":"2024-01-19T04:16:06.650249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633575+0000","last_change":"2024-01-19T04:15:49.669616+0000","last_active":"2024-01-19T04:16:06.633575+0000","last_peered":"2024-01-19T04:16:06.633575+0000","last_clean":"2024-01-19T04:16:06.633575+0000","last_became_active":"2024-01-19T04:15:49.667904+0000","last_became_peered":"2024-01-19T04:15:49.667904+0000","last_unstale":"2024-01-19T04:16:06.633575+0000","last_undegraded":"2024-01-19T04:16:06.633575+0000","last_fullsized":"2024-01-19T04:16:06.633575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:52.911948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084542+0000","last_change":"2024-01-19T04:16:05.797377+0000","last_active":"2024-01-19T04:16:08.084542+0000","last_peered":"2024-01-19T04:16:08.084542+0000","last_clean":"2024-01-19T04:16:08.084542+0000","last_became_active":"2024-01-19T04:16:05.797125+0000","last_became_peered":"2024-01-19T04:16:05.797125+0000","last_unstale":"2024-01-19T04:16:08.084542+0000","last_undegraded":"2024-01-19T04:16:08.084542+0000","last_fullsized":"2024-01-19T04:16:08.084542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086033+0000","last_change":"2024-01-19T04:16:06.651033+0000","last_active":"2024-01-19T04:16:08.086033+0000","last_peered":"2024-01-19T04:16:08.086033+0000","last_clean":"2024-01-19T04:16:08.086033+0000","last_became_active":"2024-01-19T04:16:06.650744+0000","last_became_peered":"2024-01-19T04:16:06.650744+0000","last_unstale":"2024-01-19T04:16:08.086033+0000","last_undegraded":"2024-01-19T04:16:08.086033+0000","last_fullsized":"2024-01-19T04:16:08.086033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:35:34.310303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645529+0000","last_change":"2024-01-19T04:15:48.650949+0000","last_active":"2024-01-19T04:16:06.645529+0000","last_peered":"2024-01-19T04:16:06.645529+0000","last_clean":"2024-01-19T04:16:06.645529+0000","last_became_active":"2024-01-19T04:15:48.650575+0000","last_became_peered":"2024-01-19T04:15:48.650575+0000","last_unstale":"2024-01-19T04:16:06.645529+0000","last_undegraded":"2024-01-19T04:16:06.645529+0000","last_fullsized":"2024-01-19T04:16:06.645529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:08.468932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634096+0000","last_change":"2024-01-19T04:15:49.658348+0000","last_active":"2024-01-19T04:16:06.634096+0000","last_peered":"2024-01-19T04:16:06.634096+0000","last_clean":"2024-01-19T04:16:06.634096+0000","last_became_active":"2024-01-19T04:15:49.656971+0000","last_became_peered":"2024-01-19T04:15:49.656971+0000","last_unstale":"2024-01-19T04:16:06.634096+0000","last_undegraded":"2024-01-19T04:16:06.634096+0000","last_fullsized":"2024-01-19T04:16:06.634096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:40.085851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.784520+0000","last_change":"2024-01-19T04:16:05.794905+0000","last_active":"2024-01-19T04:16:06.784520+0000","last_peered":"2024-01-19T04:16:06.784520+0000","last_clean":"2024-01-19T04:16:06.784520+0000","last_became_active":"2024-01-19T04:16:05.794077+0000","last_became_peered":"2024-01-19T04:16:05.794077+0000","last_unstale":"2024-01-19T04:16:06.784520+0000","last_undegraded":"2024-01-19T04:16:06.784520+0000","last_fullsized":"2024-01-19T04:16:06.784520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:09.565547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635915+0000","last_change":"2024-01-19T04:16:06.648241+0000","last_active":"2024-01-19T04:16:07.635915+0000","last_peered":"2024-01-19T04:16:07.635915+0000","last_clean":"2024-01-19T04:16:07.635915+0000","last_became_active":"2024-01-19T04:16:06.647911+0000","last_became_peered":"2024-01-19T04:16:06.647911+0000","last_unstale":"2024-01-19T04:16:07.635915+0000","last_undegraded":"2024-01-19T04:16:07.635915+0000","last_fullsized":"2024-01-19T04:16:07.635915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:32.886100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645896+0000","last_change":"2024-01-19T04:15:48.661996+0000","last_active":"2024-01-19T04:16:06.645896+0000","last_peered":"2024-01-19T04:16:06.645896+0000","last_clean":"2024-01-19T04:16:06.645896+0000","last_became_active":"2024-01-19T04:15:48.661788+0000","last_became_peered":"2024-01-19T04:15:48.661788+0000","last_unstale":"2024-01-19T04:16:06.645896+0000","last_undegraded":"2024-01-19T04:16:06.645896+0000","last_fullsized":"2024-01-19T04:16:06.645896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:40.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638798+0000","last_change":"2024-01-19T04:15:49.667350+0000","last_active":"2024-01-19T04:16:06.638798+0000","last_peered":"2024-01-19T04:16:06.638798+0000","last_clean":"2024-01-19T04:16:06.638798+0000","last_became_active":"2024-01-19T04:15:49.666589+0000","last_became_peered":"2024-01-19T04:15:49.666589+0000","last_unstale":"2024-01-19T04:16:06.638798+0000","last_undegraded":"2024-01-19T04:16:06.638798+0000","last_fullsized":"2024-01-19T04:16:06.638798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.636015+0000","last_change":"2024-01-19T04:16:05.790679+0000","last_active":"2024-01-19T04:16:07.636015+0000","last_peered":"2024-01-19T04:16:07.636015+0000","last_clean":"2024-01-19T04:16:07.636015+0000","last_became_active":"2024-01-19T04:16:05.790399+0000","last_became_peered":"2024-01-19T04:16:05.790399+0000","last_unstale":"2024-01-19T04:16:07.636015+0000","last_undegraded":"2024-01-19T04:16:07.636015+0000","last_fullsized":"2024-01-19T04:16:07.636015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:00:02.428657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085468+0000","last_change":"2024-01-19T04:16:06.658471+0000","last_active":"2024-01-19T04:16:08.085468+0000","last_peered":"2024-01-19T04:16:08.085468+0000","last_clean":"2024-01-19T04:16:08.085468+0000","last_became_active":"2024-01-19T04:16:06.657499+0000","last_became_peered":"2024-01-19T04:16:06.657499+0000","last_unstale":"2024-01-19T04:16:08.085468+0000","last_undegraded":"2024-01-19T04:16:08.085468+0000","last_fullsized":"2024-01-19T04:16:08.085468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:25:40.860239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.646043+0000","last_change":"2024-01-19T04:15:48.656623+0000","last_active":"2024-01-19T04:16:06.646043+0000","last_peered":"2024-01-19T04:16:06.646043+0000","last_clean":"2024-01-19T04:16:06.646043+0000","last_became_active":"2024-01-19T04:15:48.656372+0000","last_became_peered":"2024-01-19T04:15:48.656372+0000","last_unstale":"2024-01-19T04:16:06.646043+0000","last_undegraded":"2024-01-19T04:16:06.646043+0000","last_fullsized":"2024-01-19T04:16:06.646043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:49.649703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643211+0000","last_change":"2024-01-19T04:15:49.667348+0000","last_active":"2024-01-19T04:16:06.643211+0000","last_peered":"2024-01-19T04:16:06.643211+0000","last_clean":"2024-01-19T04:16:06.643211+0000","last_became_active":"2024-01-19T04:15:49.666961+0000","last_became_peered":"2024-01-19T04:15:49.666961+0000","last_unstale":"2024-01-19T04:16:06.643211+0000","last_undegraded":"2024-01-19T04:16:06.643211+0000","last_fullsized":"2024-01-19T04:16:06.643211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.050913+0000","last_change":"2024-01-19T04:16:05.794503+0000","last_active":"2024-01-19T04:16:08.050913+0000","last_peered":"2024-01-19T04:16:08.050913+0000","last_clean":"2024-01-19T04:16:08.050913+0000","last_became_active":"2024-01-19T04:16:05.794177+0000","last_became_peered":"2024-01-19T04:16:05.794177+0000","last_unstale":"2024-01-19T04:16:08.050913+0000","last_undegraded":"2024-01-19T04:16:08.050913+0000","last_fullsized":"2024-01-19T04:16:08.050913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:09.555530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086031+0000","last_change":"2024-01-19T04:16:06.649355+0000","last_active":"2024-01-19T04:16:08.086031+0000","last_peered":"2024-01-19T04:16:08.086031+0000","last_clean":"2024-01-19T04:16:08.086031+0000","last_became_active":"2024-01-19T04:16:06.649070+0000","last_became_peered":"2024-01-19T04:16:06.649070+0000","last_unstale":"2024-01-19T04:16:08.086031+0000","last_undegraded":"2024-01-19T04:16:08.086031+0000","last_fullsized":"2024-01-19T04:16:08.086031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:13:07.379996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638194+0000","last_change":"2024-01-19T04:15:48.660581+0000","last_active":"2024-01-19T04:16:06.638194+0000","last_peered":"2024-01-19T04:16:06.638194+0000","last_clean":"2024-01-19T04:16:06.638194+0000","last_became_active":"2024-01-19T04:15:48.660293+0000","last_became_peered":"2024-01-19T04:15:48.660293+0000","last_unstale":"2024-01-19T04:16:06.638194+0000","last_undegraded":"2024-01-19T04:16:06.638194+0000","last_fullsized":"2024-01-19T04:16:06.638194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645939+0000","last_change":"2024-01-19T04:15:49.676889+0000","last_active":"2024-01-19T04:16:06.645939+0000","last_peered":"2024-01-19T04:16:06.645939+0000","last_clean":"2024-01-19T04:16:06.645939+0000","last_became_active":"2024-01-19T04:15:49.676523+0000","last_became_peered":"2024-01-19T04:15:49.676523+0000","last_unstale":"2024-01-19T04:16:06.645939+0000","last_undegraded":"2024-01-19T04:16:06.645939+0000","last_fullsized":"2024-01-19T04:16:06.645939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.785832+0000","last_change":"2024-01-19T04:16:05.797216+0000","last_active":"2024-01-19T04:16:06.785832+0000","last_peered":"2024-01-19T04:16:06.785832+0000","last_clean":"2024-01-19T04:16:06.785832+0000","last_became_active":"2024-01-19T04:16:05.796895+0000","last_became_peered":"2024-01-19T04:16:05.796895+0000","last_unstale":"2024-01-19T04:16:06.785832+0000","last_undegraded":"2024-01-19T04:16:06.785832+0000","last_fullsized":"2024-01-19T04:16:06.785832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:25.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086001+0000","last_change":"2024-01-19T04:16:06.663428+0000","last_active":"2024-01-19T04:16:08.086001+0000","last_peered":"2024-01-19T04:16:08.086001+0000","last_clean":"2024-01-19T04:16:08.086001+0000","last_became_active":"2024-01-19T04:16:06.662844+0000","last_became_peered":"2024-01-19T04:16:06.662844+0000","last_unstale":"2024-01-19T04:16:08.086001+0000","last_undegraded":"2024-01-19T04:16:08.086001+0000","last_fullsized":"2024-01-19T04:16:08.086001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:15:20.839193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638178+0000","last_change":"2024-01-19T04:15:48.656618+0000","last_active":"2024-01-19T04:16:06.638178+0000","last_peered":"2024-01-19T04:16:06.638178+0000","last_clean":"2024-01-19T04:16:06.638178+0000","last_became_active":"2024-01-19T04:15:48.656148+0000","last_became_peered":"2024-01-19T04:15:48.656148+0000","last_unstale":"2024-01-19T04:16:06.638178+0000","last_undegraded":"2024-01-19T04:16:06.638178+0000","last_fullsized":"2024-01-19T04:16:06.638178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:44.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637102+0000","last_change":"2024-01-19T04:15:49.668348+0000","last_active":"2024-01-19T04:16:06.637102+0000","last_peered":"2024-01-19T04:16:06.637102+0000","last_clean":"2024-01-19T04:16:06.637102+0000","last_became_active":"2024-01-19T04:15:49.667864+0000","last_became_peered":"2024-01-19T04:15:49.667864+0000","last_unstale":"2024-01-19T04:16:06.637102+0000","last_undegraded":"2024-01-19T04:16:06.637102+0000","last_fullsized":"2024-01-19T04:16:06.637102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:26.982423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641963+0000","last_change":"2024-01-19T04:16:05.796993+0000","last_active":"2024-01-19T04:16:06.641963+0000","last_peered":"2024-01-19T04:16:06.641963+0000","last_clean":"2024-01-19T04:16:06.641963+0000","last_became_active":"2024-01-19T04:16:05.796746+0000","last_became_peered":"2024-01-19T04:16:05.796746+0000","last_unstale":"2024-01-19T04:16:06.641963+0000","last_undegraded":"2024-01-19T04:16:06.641963+0000","last_fullsized":"2024-01-19T04:16:06.641963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:53.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085758+0000","last_change":"2024-01-19T04:16:06.654768+0000","last_active":"2024-01-19T04:16:08.085758+0000","last_peered":"2024-01-19T04:16:08.085758+0000","last_clean":"2024-01-19T04:16:08.085758+0000","last_became_active":"2024-01-19T04:16:06.654509+0000","last_became_peered":"2024-01-19T04:16:06.654509+0000","last_unstale":"2024-01-19T04:16:08.085758+0000","last_undegraded":"2024-01-19T04:16:08.085758+0000","last_fullsized":"2024-01-19T04:16:08.085758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:47.053128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637389+0000","last_change":"2024-01-19T04:15:48.649640+0000","last_active":"2024-01-19T04:16:06.637389+0000","last_peered":"2024-01-19T04:16:06.637389+0000","last_clean":"2024-01-19T04:16:06.637389+0000","last_became_active":"2024-01-19T04:15:48.649368+0000","last_became_peered":"2024-01-19T04:15:48.649368+0000","last_unstale":"2024-01-19T04:16:06.637389+0000","last_undegraded":"2024-01-19T04:16:06.637389+0000","last_fullsized":"2024-01-19T04:16:06.637389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.944713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641631+0000","last_change":"2024-01-19T04:15:49.665993+0000","last_active":"2024-01-19T04:16:06.641631+0000","last_peered":"2024-01-19T04:16:06.641631+0000","last_clean":"2024-01-19T04:16:06.641631+0000","last_became_active":"2024-01-19T04:15:49.665338+0000","last_became_peered":"2024-01-19T04:15:49.665338+0000","last_unstale":"2024-01-19T04:16:06.641631+0000","last_undegraded":"2024-01-19T04:16:06.641631+0000","last_fullsized":"2024-01-19T04:16:06.641631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.050874+0000","last_change":"2024-01-19T04:16:05.799883+0000","last_active":"2024-01-19T04:16:08.050874+0000","last_peered":"2024-01-19T04:16:08.050874+0000","last_clean":"2024-01-19T04:16:08.050874+0000","last_became_active":"2024-01-19T04:16:05.799581+0000","last_became_peered":"2024-01-19T04:16:05.799581+0000","last_unstale":"2024-01-19T04:16:08.050874+0000","last_undegraded":"2024-01-19T04:16:08.050874+0000","last_fullsized":"2024-01-19T04:16:08.050874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:50:55.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080573+0000","last_change":"2024-01-19T04:16:06.661145+0000","last_active":"2024-01-19T04:16:08.080573+0000","last_peered":"2024-01-19T04:16:08.080573+0000","last_clean":"2024-01-19T04:16:08.080573+0000","last_became_active":"2024-01-19T04:16:06.660916+0000","last_became_peered":"2024-01-19T04:16:06.660916+0000","last_unstale":"2024-01-19T04:16:08.080573+0000","last_undegraded":"2024-01-19T04:16:08.080573+0000","last_fullsized":"2024-01-19T04:16:08.080573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:46.651098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637532+0000","last_change":"2024-01-19T04:15:48.657317+0000","last_active":"2024-01-19T04:16:06.637532+0000","last_peered":"2024-01-19T04:16:06.637532+0000","last_clean":"2024-01-19T04:16:06.637532+0000","last_became_active":"2024-01-19T04:15:48.657048+0000","last_became_peered":"2024-01-19T04:15:48.657048+0000","last_unstale":"2024-01-19T04:16:06.637532+0000","last_undegraded":"2024-01-19T04:16:06.637532+0000","last_fullsized":"2024-01-19T04:16:06.637532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640284+0000","last_change":"2024-01-19T04:15:49.665041+0000","last_active":"2024-01-19T04:16:06.640284+0000","last_peered":"2024-01-19T04:16:06.640284+0000","last_clean":"2024-01-19T04:16:06.640284+0000","last_became_active":"2024-01-19T04:15:49.664797+0000","last_became_peered":"2024-01-19T04:15:49.664797+0000","last_unstale":"2024-01-19T04:16:06.640284+0000","last_undegraded":"2024-01-19T04:16:06.640284+0000","last_fullsized":"2024-01-19T04:16:06.640284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:13.052895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084369+0000","last_change":"2024-01-19T04:16:05.794058+0000","last_active":"2024-01-19T04:16:08.084369+0000","last_peered":"2024-01-19T04:16:08.084369+0000","last_clean":"2024-01-19T04:16:08.084369+0000","last_became_active":"2024-01-19T04:16:05.793542+0000","last_became_peered":"2024-01-19T04:16:05.793542+0000","last_unstale":"2024-01-19T04:16:08.084369+0000","last_undegraded":"2024-01-19T04:16:08.084369+0000","last_fullsized":"2024-01-19T04:16:08.084369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:08.794314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084614+0000","last_change":"2024-01-19T04:16:06.648682+0000","last_active":"2024-01-19T04:16:08.084614+0000","last_peered":"2024-01-19T04:16:08.084614+0000","last_clean":"2024-01-19T04:16:08.084614+0000","last_became_active":"2024-01-19T04:16:06.646754+0000","last_became_peered":"2024-01-19T04:16:06.646754+0000","last_unstale":"2024-01-19T04:16:08.084614+0000","last_undegraded":"2024-01-19T04:16:08.084614+0000","last_fullsized":"2024-01-19T04:16:08.084614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:05:58.537527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645066+0000","last_change":"2024-01-19T04:15:48.655232+0000","last_active":"2024-01-19T04:16:06.645066+0000","last_peered":"2024-01-19T04:16:06.645066+0000","last_clean":"2024-01-19T04:16:06.645066+0000","last_became_active":"2024-01-19T04:15:48.654912+0000","last_became_peered":"2024-01-19T04:15:48.654912+0000","last_unstale":"2024-01-19T04:16:06.645066+0000","last_undegraded":"2024-01-19T04:16:06.645066+0000","last_fullsized":"2024-01-19T04:16:06.645066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:32:17.917932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637399+0000","last_change":"2024-01-19T04:15:49.665258+0000","last_active":"2024-01-19T04:16:06.637399+0000","last_peered":"2024-01-19T04:16:06.637399+0000","last_clean":"2024-01-19T04:16:06.637399+0000","last_became_active":"2024-01-19T04:15:49.664987+0000","last_became_peered":"2024-01-19T04:15:49.664987+0000","last_unstale":"2024-01-19T04:16:06.637399+0000","last_undegraded":"2024-01-19T04:16:06.637399+0000","last_fullsized":"2024-01-19T04:16:06.637399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.050811+0000","last_change":"2024-01-19T04:16:05.799441+0000","last_active":"2024-01-19T04:16:08.050811+0000","last_peered":"2024-01-19T04:16:08.050811+0000","last_clean":"2024-01-19T04:16:08.050811+0000","last_became_active":"2024-01-19T04:16:05.799063+0000","last_became_peered":"2024-01-19T04:16:05.799063+0000","last_unstale":"2024-01-19T04:16:08.050811+0000","last_undegraded":"2024-01-19T04:16:08.050811+0000","last_fullsized":"2024-01-19T04:16:08.050811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:59:19.597563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080796+0000","last_change":"2024-01-19T04:16:06.661032+0000","last_active":"2024-01-19T04:16:08.080796+0000","last_peered":"2024-01-19T04:16:08.080796+0000","last_clean":"2024-01-19T04:16:08.080796+0000","last_became_active":"2024-01-19T04:16:06.660739+0000","last_became_peered":"2024-01-19T04:16:06.660739+0000","last_unstale":"2024-01-19T04:16:08.080796+0000","last_undegraded":"2024-01-19T04:16:08.080796+0000","last_fullsized":"2024-01-19T04:16:08.080796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:50.140135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"35'9","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639006+0000","last_change":"2024-01-19T04:15:48.660043+0000","last_active":"2024-01-19T04:16:06.639006+0000","last_peered":"2024-01-19T04:16:06.639006+0000","last_clean":"2024-01-19T04:16:06.639006+0000","last_became_active":"2024-01-19T04:15:48.659771+0000","last_became_peered":"2024-01-19T04:15:48.659771+0000","last_unstale":"2024-01-19T04:16:06.639006+0000","last_undegraded":"2024-01-19T04:16:06.639006+0000","last_fullsized":"2024-01-19T04:16:06.639006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:20.707537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640731+0000","last_change":"2024-01-19T04:15:49.659556+0000","last_active":"2024-01-19T04:16:06.640731+0000","last_peered":"2024-01-19T04:16:06.640731+0000","last_clean":"2024-01-19T04:16:06.640731+0000","last_became_active":"2024-01-19T04:15:49.658940+0000","last_became_peered":"2024-01-19T04:15:49.658940+0000","last_unstale":"2024-01-19T04:16:06.640731+0000","last_undegraded":"2024-01-19T04:16:06.640731+0000","last_fullsized":"2024-01-19T04:16:06.640731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086587+0000","last_change":"2024-01-19T04:16:05.801624+0000","last_active":"2024-01-19T04:16:08.086587+0000","last_peered":"2024-01-19T04:16:08.086587+0000","last_clean":"2024-01-19T04:16:08.086587+0000","last_became_active":"2024-01-19T04:16:05.801315+0000","last_became_peered":"2024-01-19T04:16:05.801315+0000","last_unstale":"2024-01-19T04:16:08.086587+0000","last_undegraded":"2024-01-19T04:16:08.086587+0000","last_fullsized":"2024-01-19T04:16:08.086587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639313+0000","last_change":"2024-01-19T04:16:06.659279+0000","last_active":"2024-01-19T04:16:07.639313+0000","last_peered":"2024-01-19T04:16:07.639313+0000","last_clean":"2024-01-19T04:16:07.639313+0000","last_became_active":"2024-01-19T04:16:06.658980+0000","last_became_peered":"2024-01-19T04:16:06.658980+0000","last_unstale":"2024-01-19T04:16:07.639313+0000","last_undegraded":"2024-01-19T04:16:07.639313+0000","last_fullsized":"2024-01-19T04:16:07.639313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:13.662662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640878+0000","last_change":"2024-01-19T04:15:48.660560+0000","last_active":"2024-01-19T04:16:06.640878+0000","last_peered":"2024-01-19T04:16:06.640878+0000","last_clean":"2024-01-19T04:16:06.640878+0000","last_became_active":"2024-01-19T04:15:48.660206+0000","last_became_peered":"2024-01-19T04:15:48.660206+0000","last_unstale":"2024-01-19T04:16:06.640878+0000","last_undegraded":"2024-01-19T04:16:06.640878+0000","last_fullsized":"2024-01-19T04:16:06.640878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:51.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638844+0000","last_change":"2024-01-19T04:15:49.662761+0000","last_active":"2024-01-19T04:16:06.638844+0000","last_peered":"2024-01-19T04:16:06.638844+0000","last_clean":"2024-01-19T04:16:06.638844+0000","last_became_active":"2024-01-19T04:15:49.662522+0000","last_became_peered":"2024-01-19T04:15:49.662522+0000","last_unstale":"2024-01-19T04:16:06.638844+0000","last_undegraded":"2024-01-19T04:16:06.638844+0000","last_fullsized":"2024-01-19T04:16:06.638844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:31:36.112170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645197+0000","last_change":"2024-01-19T04:16:05.795050+0000","last_active":"2024-01-19T04:16:06.645197+0000","last_peered":"2024-01-19T04:16:06.645197+0000","last_clean":"2024-01-19T04:16:06.645197+0000","last_became_active":"2024-01-19T04:16:05.794748+0000","last_became_peered":"2024-01-19T04:16:05.794748+0000","last_unstale":"2024-01-19T04:16:06.645197+0000","last_undegraded":"2024-01-19T04:16:06.645197+0000","last_fullsized":"2024-01-19T04:16:06.645197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:36.215987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080403+0000","last_change":"2024-01-19T04:16:06.655156+0000","last_active":"2024-01-19T04:16:08.080403+0000","last_peered":"2024-01-19T04:16:08.080403+0000","last_clean":"2024-01-19T04:16:08.080403+0000","last_became_active":"2024-01-19T04:16:06.654868+0000","last_became_peered":"2024-01-19T04:16:06.654868+0000","last_unstale":"2024-01-19T04:16:08.080403+0000","last_undegraded":"2024-01-19T04:16:08.080403+0000","last_fullsized":"2024-01-19T04:16:08.080403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:09:17.227424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651137+0000","last_change":"2024-01-19T04:15:48.651062+0000","last_active":"2024-01-19T04:16:06.651137+0000","last_peered":"2024-01-19T04:16:06.651137+0000","last_clean":"2024-01-19T04:16:06.651137+0000","last_became_active":"2024-01-19T04:15:48.650773+0000","last_became_peered":"2024-01-19T04:15:48.650773+0000","last_unstale":"2024-01-19T04:16:06.651137+0000","last_undegraded":"2024-01-19T04:16:06.651137+0000","last_fullsized":"2024-01-19T04:16:06.651137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641322+0000","last_change":"2024-01-19T04:15:49.675785+0000","last_active":"2024-01-19T04:16:06.641322+0000","last_peered":"2024-01-19T04:16:06.641322+0000","last_clean":"2024-01-19T04:16:06.641322+0000","last_became_active":"2024-01-19T04:15:49.674220+0000","last_became_peered":"2024-01-19T04:15:49.674220+0000","last_unstale":"2024-01-19T04:16:06.641322+0000","last_undegraded":"2024-01-19T04:16:06.641322+0000","last_fullsized":"2024-01-19T04:16:06.641322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:18:17.644219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635828+0000","last_change":"2024-01-19T04:16:05.789419+0000","last_active":"2024-01-19T04:16:07.635828+0000","last_peered":"2024-01-19T04:16:07.635828+0000","last_clean":"2024-01-19T04:16:07.635828+0000","last_became_active":"2024-01-19T04:16:05.782405+0000","last_became_peered":"2024-01-19T04:16:05.782405+0000","last_unstale":"2024-01-19T04:16:07.635828+0000","last_undegraded":"2024-01-19T04:16:07.635828+0000","last_fullsized":"2024-01-19T04:16:07.635828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:43:13.226181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085946+0000","last_change":"2024-01-19T04:16:06.653820+0000","last_active":"2024-01-19T04:16:08.085946+0000","last_peered":"2024-01-19T04:16:08.085946+0000","last_clean":"2024-01-19T04:16:08.085946+0000","last_became_active":"2024-01-19T04:16:06.653551+0000","last_became_peered":"2024-01-19T04:16:06.653551+0000","last_unstale":"2024-01-19T04:16:08.085946+0000","last_undegraded":"2024-01-19T04:16:08.085946+0000","last_fullsized":"2024-01-19T04:16:08.085946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:09:44.337728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641404+0000","last_change":"2024-01-19T04:15:48.660184+0000","last_active":"2024-01-19T04:16:06.641404+0000","last_peered":"2024-01-19T04:16:06.641404+0000","last_clean":"2024-01-19T04:16:06.641404+0000","last_became_active":"2024-01-19T04:15:48.659913+0000","last_became_peered":"2024-01-19T04:15:48.659913+0000","last_unstale":"2024-01-19T04:16:06.641404+0000","last_undegraded":"2024-01-19T04:16:06.641404+0000","last_fullsized":"2024-01-19T04:16:06.641404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:06:35.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640926+0000","last_change":"2024-01-19T04:15:49.665456+0000","last_active":"2024-01-19T04:16:06.640926+0000","last_peered":"2024-01-19T04:16:06.640926+0000","last_clean":"2024-01-19T04:16:06.640926+0000","last_became_active":"2024-01-19T04:15:49.665185+0000","last_became_peered":"2024-01-19T04:15:49.665185+0000","last_unstale":"2024-01-19T04:16:06.640926+0000","last_undegraded":"2024-01-19T04:16:06.640926+0000","last_fullsized":"2024-01-19T04:16:06.640926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788462+0000","last_change":"2024-01-19T04:16:05.793856+0000","last_active":"2024-01-19T04:16:06.788462+0000","last_peered":"2024-01-19T04:16:06.788462+0000","last_clean":"2024-01-19T04:16:06.788462+0000","last_became_active":"2024-01-19T04:16:05.793566+0000","last_became_peered":"2024-01-19T04:16:05.793566+0000","last_unstale":"2024-01-19T04:16:06.788462+0000","last_undegraded":"2024-01-19T04:16:06.788462+0000","last_fullsized":"2024-01-19T04:16:06.788462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:21:12.660330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085783+0000","last_change":"2024-01-19T04:16:06.656144+0000","last_active":"2024-01-19T04:16:08.085783+0000","last_peered":"2024-01-19T04:16:08.085783+0000","last_clean":"2024-01-19T04:16:08.085783+0000","last_became_active":"2024-01-19T04:16:06.655863+0000","last_became_peered":"2024-01-19T04:16:06.655863+0000","last_unstale":"2024-01-19T04:16:08.085783+0000","last_undegraded":"2024-01-19T04:16:08.085783+0000","last_fullsized":"2024-01-19T04:16:08.085783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:01:51.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643421+0000","last_change":"2024-01-19T04:15:48.654953+0000","last_active":"2024-01-19T04:16:06.643421+0000","last_peered":"2024-01-19T04:16:06.643421+0000","last_clean":"2024-01-19T04:16:06.643421+0000","last_became_active":"2024-01-19T04:15:48.654630+0000","last_became_peered":"2024-01-19T04:15:48.654630+0000","last_unstale":"2024-01-19T04:16:06.643421+0000","last_undegraded":"2024-01-19T04:16:06.643421+0000","last_fullsized":"2024-01-19T04:16:06.643421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:51.908789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637132+0000","last_change":"2024-01-19T04:15:49.668312+0000","last_active":"2024-01-19T04:16:06.637132+0000","last_peered":"2024-01-19T04:16:06.637132+0000","last_clean":"2024-01-19T04:16:06.637132+0000","last_became_active":"2024-01-19T04:15:49.664719+0000","last_became_peered":"2024-01-19T04:15:49.664719+0000","last_unstale":"2024-01-19T04:16:06.637132+0000","last_undegraded":"2024-01-19T04:16:06.637132+0000","last_fullsized":"2024-01-19T04:16:06.637132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:42:57.089367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.785789+0000","last_change":"2024-01-19T04:16:05.788223+0000","last_active":"2024-01-19T04:16:06.785789+0000","last_peered":"2024-01-19T04:16:06.785789+0000","last_clean":"2024-01-19T04:16:06.785789+0000","last_became_active":"2024-01-19T04:16:05.787780+0000","last_became_peered":"2024-01-19T04:16:05.787780+0000","last_unstale":"2024-01-19T04:16:06.785789+0000","last_undegraded":"2024-01-19T04:16:06.785789+0000","last_fullsized":"2024-01-19T04:16:06.785789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:48.028070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.638484+0000","last_change":"2024-01-19T04:16:06.653246+0000","last_active":"2024-01-19T04:16:07.638484+0000","last_peered":"2024-01-19T04:16:07.638484+0000","last_clean":"2024-01-19T04:16:07.638484+0000","last_became_active":"2024-01-19T04:16:06.652929+0000","last_became_peered":"2024-01-19T04:16:06.652929+0000","last_unstale":"2024-01-19T04:16:07.638484+0000","last_undegraded":"2024-01-19T04:16:07.638484+0000","last_fullsized":"2024-01-19T04:16:07.638484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:16.789672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637322+0000","last_change":"2024-01-19T04:15:48.654258+0000","last_active":"2024-01-19T04:16:06.637322+0000","last_peered":"2024-01-19T04:16:06.637322+0000","last_clean":"2024-01-19T04:16:06.637322+0000","last_became_active":"2024-01-19T04:15:48.653969+0000","last_became_peered":"2024-01-19T04:15:48.653969+0000","last_unstale":"2024-01-19T04:16:06.637322+0000","last_undegraded":"2024-01-19T04:16:06.637322+0000","last_fullsized":"2024-01-19T04:16:06.637322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:26.892276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.643325+0000","last_change":"2024-01-19T04:15:49.671780+0000","last_active":"2024-01-19T04:16:06.643325+0000","last_peered":"2024-01-19T04:16:06.643325+0000","last_clean":"2024-01-19T04:16:06.643325+0000","last_became_active":"2024-01-19T04:15:49.671460+0000","last_became_peered":"2024-01-19T04:15:49.671460+0000","last_unstale":"2024-01-19T04:16:06.643325+0000","last_undegraded":"2024-01-19T04:16:06.643325+0000","last_fullsized":"2024-01-19T04:16:06.643325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:59:46.291843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.050867+0000","last_change":"2024-01-19T04:16:05.799707+0000","last_active":"2024-01-19T04:16:08.050867+0000","last_peered":"2024-01-19T04:16:08.050867+0000","last_clean":"2024-01-19T04:16:08.050867+0000","last_became_active":"2024-01-19T04:16:05.799464+0000","last_became_peered":"2024-01-19T04:16:05.799464+0000","last_unstale":"2024-01-19T04:16:08.050867+0000","last_undegraded":"2024-01-19T04:16:08.050867+0000","last_fullsized":"2024-01-19T04:16:08.050867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:17:34.865737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084773+0000","last_change":"2024-01-19T04:16:06.655577+0000","last_active":"2024-01-19T04:16:08.084773+0000","last_peered":"2024-01-19T04:16:08.084773+0000","last_clean":"2024-01-19T04:16:08.084773+0000","last_became_active":"2024-01-19T04:16:06.653746+0000","last_became_peered":"2024-01-19T04:16:06.653746+0000","last_unstale":"2024-01-19T04:16:08.084773+0000","last_undegraded":"2024-01-19T04:16:08.084773+0000","last_fullsized":"2024-01-19T04:16:08.084773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:10.567880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644439+0000","last_change":"2024-01-19T04:15:48.646387+0000","last_active":"2024-01-19T04:16:06.644439+0000","last_peered":"2024-01-19T04:16:06.644439+0000","last_clean":"2024-01-19T04:16:06.644439+0000","last_became_active":"2024-01-19T04:15:48.646106+0000","last_became_peered":"2024-01-19T04:15:48.646106+0000","last_unstale":"2024-01-19T04:16:06.644439+0000","last_undegraded":"2024-01-19T04:16:06.644439+0000","last_fullsized":"2024-01-19T04:16:06.644439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640299+0000","last_change":"2024-01-19T04:15:49.655893+0000","last_active":"2024-01-19T04:16:06.640299+0000","last_peered":"2024-01-19T04:16:06.640299+0000","last_clean":"2024-01-19T04:16:06.640299+0000","last_became_active":"2024-01-19T04:15:49.655303+0000","last_became_peered":"2024-01-19T04:15:49.655303+0000","last_unstale":"2024-01-19T04:16:06.640299+0000","last_undegraded":"2024-01-19T04:16:06.640299+0000","last_fullsized":"2024-01-19T04:16:06.640299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084277+0000","last_change":"2024-01-19T04:16:05.798704+0000","last_active":"2024-01-19T04:16:08.084277+0000","last_peered":"2024-01-19T04:16:08.084277+0000","last_clean":"2024-01-19T04:16:08.084277+0000","last_became_active":"2024-01-19T04:16:05.798256+0000","last_became_peered":"2024-01-19T04:16:05.798256+0000","last_unstale":"2024-01-19T04:16:08.084277+0000","last_undegraded":"2024-01-19T04:16:08.084277+0000","last_fullsized":"2024-01-19T04:16:08.084277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.003940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084191+0000","last_change":"2024-01-19T04:16:06.661878+0000","last_active":"2024-01-19T04:16:08.084191+0000","last_peered":"2024-01-19T04:16:08.084191+0000","last_clean":"2024-01-19T04:16:08.084191+0000","last_became_active":"2024-01-19T04:16:06.661120+0000","last_became_peered":"2024-01-19T04:16:06.661120+0000","last_unstale":"2024-01-19T04:16:08.084191+0000","last_undegraded":"2024-01-19T04:16:08.084191+0000","last_fullsized":"2024-01-19T04:16:08.084191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:54.194344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644956+0000","last_change":"2024-01-19T04:15:48.646982+0000","last_active":"2024-01-19T04:16:06.644956+0000","last_peered":"2024-01-19T04:16:06.644956+0000","last_clean":"2024-01-19T04:16:06.644956+0000","last_became_active":"2024-01-19T04:15:48.646698+0000","last_became_peered":"2024-01-19T04:15:48.646698+0000","last_unstale":"2024-01-19T04:16:06.644956+0000","last_undegraded":"2024-01-19T04:16:06.644956+0000","last_fullsized":"2024-01-19T04:16:06.644956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:52.615637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642057+0000","last_change":"2024-01-19T04:15:49.665703+0000","last_active":"2024-01-19T04:16:06.642057+0000","last_peered":"2024-01-19T04:16:06.642057+0000","last_clean":"2024-01-19T04:16:06.642057+0000","last_became_active":"2024-01-19T04:15:49.665428+0000","last_became_peered":"2024-01-19T04:15:49.665428+0000","last_unstale":"2024-01-19T04:16:06.642057+0000","last_undegraded":"2024-01-19T04:16:06.642057+0000","last_fullsized":"2024-01-19T04:16:06.642057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:36:56.940737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640162+0000","last_change":"2024-01-19T04:16:05.797656+0000","last_active":"2024-01-19T04:16:06.640162+0000","last_peered":"2024-01-19T04:16:06.640162+0000","last_clean":"2024-01-19T04:16:06.640162+0000","last_became_active":"2024-01-19T04:16:05.797337+0000","last_became_peered":"2024-01-19T04:16:05.797337+0000","last_unstale":"2024-01-19T04:16:06.640162+0000","last_undegraded":"2024-01-19T04:16:06.640162+0000","last_fullsized":"2024-01-19T04:16:06.640162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:31:15.787339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085341+0000","last_change":"2024-01-19T04:16:06.650535+0000","last_active":"2024-01-19T04:16:08.085341+0000","last_peered":"2024-01-19T04:16:08.085341+0000","last_clean":"2024-01-19T04:16:08.085341+0000","last_became_active":"2024-01-19T04:16:06.648542+0000","last_became_peered":"2024-01-19T04:16:06.648542+0000","last_unstale":"2024-01-19T04:16:08.085341+0000","last_undegraded":"2024-01-19T04:16:08.085341+0000","last_fullsized":"2024-01-19T04:16:08.085341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:42.208383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.785181+0000","last_change":"2024-01-19T04:16:05.791457+0000","last_active":"2024-01-19T04:16:06.785181+0000","last_peered":"2024-01-19T04:16:06.785181+0000","last_clean":"2024-01-19T04:16:06.785181+0000","last_became_active":"2024-01-19T04:16:05.791179+0000","last_became_peered":"2024-01-19T04:16:05.791179+0000","last_unstale":"2024-01-19T04:16:06.785181+0000","last_undegraded":"2024-01-19T04:16:06.785181+0000","last_fullsized":"2024-01-19T04:16:06.785181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:43:04.534670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.635048+0000","last_change":"2024-01-19T04:15:48.658684+0000","last_active":"2024-01-19T04:16:06.635048+0000","last_peered":"2024-01-19T04:16:06.635048+0000","last_clean":"2024-01-19T04:16:06.635048+0000","last_became_active":"2024-01-19T04:15:48.658399+0000","last_became_peered":"2024-01-19T04:15:48.658399+0000","last_unstale":"2024-01-19T04:16:06.635048+0000","last_undegraded":"2024-01-19T04:16:06.635048+0000","last_fullsized":"2024-01-19T04:16:06.635048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:22:02.358517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641737+0000","last_change":"2024-01-19T04:15:49.671511+0000","last_active":"2024-01-19T04:16:06.641737+0000","last_peered":"2024-01-19T04:16:06.641737+0000","last_clean":"2024-01-19T04:16:06.641737+0000","last_became_active":"2024-01-19T04:15:49.670975+0000","last_became_peered":"2024-01-19T04:15:49.670975+0000","last_unstale":"2024-01-19T04:16:06.641737+0000","last_undegraded":"2024-01-19T04:16:06.641737+0000","last_fullsized":"2024-01-19T04:16:06.641737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086005+0000","last_change":"2024-01-19T04:16:06.645758+0000","last_active":"2024-01-19T04:16:08.086005+0000","last_peered":"2024-01-19T04:16:08.086005+0000","last_clean":"2024-01-19T04:16:08.086005+0000","last_became_active":"2024-01-19T04:16:06.645496+0000","last_became_peered":"2024-01-19T04:16:06.645496+0000","last_unstale":"2024-01-19T04:16:08.086005+0000","last_undegraded":"2024-01-19T04:16:08.086005+0000","last_fullsized":"2024-01-19T04:16:08.086005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:25.718378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.050951+0000","last_change":"2024-01-19T04:16:05.792100+0000","last_active":"2024-01-19T04:16:08.050951+0000","last_peered":"2024-01-19T04:16:08.050951+0000","last_clean":"2024-01-19T04:16:08.050951+0000","last_became_active":"2024-01-19T04:16:05.791821+0000","last_became_peered":"2024-01-19T04:16:05.791821+0000","last_unstale":"2024-01-19T04:16:08.050951+0000","last_undegraded":"2024-01-19T04:16:08.050951+0000","last_fullsized":"2024-01-19T04:16:08.050951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:12:26.677056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640490+0000","last_change":"2024-01-19T04:15:48.659618+0000","last_active":"2024-01-19T04:16:06.640490+0000","last_peered":"2024-01-19T04:16:06.640490+0000","last_clean":"2024-01-19T04:16:06.640490+0000","last_became_active":"2024-01-19T04:15:48.659239+0000","last_became_peered":"2024-01-19T04:15:48.659239+0000","last_unstale":"2024-01-19T04:16:06.640490+0000","last_undegraded":"2024-01-19T04:16:06.640490+0000","last_fullsized":"2024-01-19T04:16:06.640490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:14:51.849543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645410+0000","last_change":"2024-01-19T04:15:49.677260+0000","last_active":"2024-01-19T04:16:06.645410+0000","last_peered":"2024-01-19T04:16:06.645410+0000","last_clean":"2024-01-19T04:16:06.645410+0000","last_became_active":"2024-01-19T04:15:49.676970+0000","last_became_peered":"2024-01-19T04:15:49.676970+0000","last_unstale":"2024-01-19T04:16:06.645410+0000","last_undegraded":"2024-01-19T04:16:06.645410+0000","last_fullsized":"2024-01-19T04:16:06.645410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084960+0000","last_change":"2024-01-19T04:16:06.653044+0000","last_active":"2024-01-19T04:16:08.084960+0000","last_peered":"2024-01-19T04:16:08.084960+0000","last_clean":"2024-01-19T04:16:08.084960+0000","last_became_active":"2024-01-19T04:16:06.652723+0000","last_became_peered":"2024-01-19T04:16:06.652723+0000","last_unstale":"2024-01-19T04:16:08.084960+0000","last_undegraded":"2024-01-19T04:16:08.084960+0000","last_fullsized":"2024-01-19T04:16:08.084960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:59.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651297+0000","last_change":"2024-01-19T04:15:48.661954+0000","last_active":"2024-01-19T04:16:06.651297+0000","last_peered":"2024-01-19T04:16:06.651297+0000","last_clean":"2024-01-19T04:16:06.651297+0000","last_became_active":"2024-01-19T04:15:48.660529+0000","last_became_peered":"2024-01-19T04:15:48.660529+0000","last_unstale":"2024-01-19T04:16:06.651297+0000","last_undegraded":"2024-01-19T04:16:06.651297+0000","last_fullsized":"2024-01-19T04:16:06.651297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:21:39.082692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637803+0000","last_change":"2024-01-19T04:15:49.668135+0000","last_active":"2024-01-19T04:16:06.637803+0000","last_peered":"2024-01-19T04:16:06.637803+0000","last_clean":"2024-01-19T04:16:06.637803+0000","last_became_active":"2024-01-19T04:15:49.667829+0000","last_became_peered":"2024-01-19T04:15:49.667829+0000","last_unstale":"2024-01-19T04:16:06.637803+0000","last_undegraded":"2024-01-19T04:16:06.637803+0000","last_fullsized":"2024-01-19T04:16:06.637803+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.788125+0000","last_change":"2024-01-19T04:16:05.795506+0000","last_active":"2024-01-19T04:16:06.788125+0000","last_peered":"2024-01-19T04:16:06.788125+0000","last_clean":"2024-01-19T04:16:06.788125+0000","last_became_active":"2024-01-19T04:16:05.795164+0000","last_became_peered":"2024-01-19T04:16:05.795164+0000","last_unstale":"2024-01-19T04:16:06.788125+0000","last_undegraded":"2024-01-19T04:16:06.788125+0000","last_fullsized":"2024-01-19T04:16:06.788125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:47.180361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085421+0000","last_change":"2024-01-19T04:16:06.645494+0000","last_active":"2024-01-19T04:16:08.085421+0000","last_peered":"2024-01-19T04:16:08.085421+0000","last_clean":"2024-01-19T04:16:08.085421+0000","last_became_active":"2024-01-19T04:16:06.645206+0000","last_became_peered":"2024-01-19T04:16:06.645206+0000","last_unstale":"2024-01-19T04:16:08.085421+0000","last_undegraded":"2024-01-19T04:16:08.085421+0000","last_fullsized":"2024-01-19T04:16:08.085421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:09:17.227424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637854+0000","last_change":"2024-01-19T04:15:48.661551+0000","last_active":"2024-01-19T04:16:06.637854+0000","last_peered":"2024-01-19T04:16:06.637854+0000","last_clean":"2024-01-19T04:16:06.637854+0000","last_became_active":"2024-01-19T04:15:48.661232+0000","last_became_peered":"2024-01-19T04:15:48.661232+0000","last_unstale":"2024-01-19T04:16:06.637854+0000","last_undegraded":"2024-01-19T04:16:06.637854+0000","last_fullsized":"2024-01-19T04:16:06.637854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:47.625553+0000","last_clean_scrub_stamp":"2024-01-19T04:15:47.625553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:36:09.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.651043+0000","last_change":"2024-01-19T04:15:49.650645+0000","last_active":"2024-01-19T04:16:06.651043+0000","last_peered":"2024-01-19T04:16:06.651043+0000","last_clean":"2024-01-19T04:16:06.651043+0000","last_became_active":"2024-01-19T04:15:49.650331+0000","last_became_peered":"2024-01-19T04:15:49.650331+0000","last_unstale":"2024-01-19T04:16:06.651043+0000","last_undegraded":"2024-01-19T04:16:06.651043+0000","last_fullsized":"2024-01-19T04:16:06.651043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:22:52.372200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085276+0000","last_change":"2024-01-19T04:16:05.791836+0000","last_active":"2024-01-19T04:16:08.085276+0000","last_peered":"2024-01-19T04:16:08.085276+0000","last_clean":"2024-01-19T04:16:08.085276+0000","last_became_active":"2024-01-19T04:16:05.791582+0000","last_became_peered":"2024-01-19T04:16:05.791582+0000","last_unstale":"2024-01-19T04:16:08.085276+0000","last_undegraded":"2024-01-19T04:16:08.085276+0000","last_fullsized":"2024-01-19T04:16:08.085276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:04.765525+0000","last_clean_scrub_stamp":"2024-01-19T04:16:04.765525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:13.077551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.638594+0000","last_change":"2024-01-19T04:16:06.661306+0000","last_active":"2024-01-19T04:16:07.638594+0000","last_peered":"2024-01-19T04:16:07.638594+0000","last_clean":"2024-01-19T04:16:07.638594+0000","last_became_active":"2024-01-19T04:16:06.661013+0000","last_became_peered":"2024-01-19T04:16:06.661013+0000","last_unstale":"2024-01-19T04:16:07.638594+0000","last_undegraded":"2024-01-19T04:16:07.638594+0000","last_fullsized":"2024-01-19T04:16:07.638594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:45:54.194344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641556+0000","last_change":"2024-01-19T04:15:49.666490+0000","last_active":"2024-01-19T04:16:06.641556+0000","last_peered":"2024-01-19T04:16:06.641556+0000","last_clean":"2024-01-19T04:16:06.641556+0000","last_became_active":"2024-01-19T04:15:49.665711+0000","last_became_peered":"2024-01-19T04:15:49.665711+0000","last_unstale":"2024-01-19T04:16:06.641556+0000","last_undegraded":"2024-01-19T04:16:06.641556+0000","last_fullsized":"2024-01-19T04:16:06.641556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086168+0000","last_change":"2024-01-19T04:16:06.655945+0000","last_active":"2024-01-19T04:16:08.086168+0000","last_peered":"2024-01-19T04:16:08.086168+0000","last_clean":"2024-01-19T04:16:08.086168+0000","last_became_active":"2024-01-19T04:16:06.655680+0000","last_became_peered":"2024-01-19T04:16:06.655680+0000","last_unstale":"2024-01-19T04:16:08.086168+0000","last_undegraded":"2024-01-19T04:16:08.086168+0000","last_fullsized":"2024-01-19T04:16:08.086168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:27.380253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.636913+0000","last_change":"2024-01-19T04:15:49.662592+0000","last_active":"2024-01-19T04:16:06.636913+0000","last_peered":"2024-01-19T04:16:06.636913+0000","last_clean":"2024-01-19T04:16:06.636913+0000","last_became_active":"2024-01-19T04:15:49.659009+0000","last_became_peered":"2024-01-19T04:15:49.659009+0000","last_unstale":"2024-01-19T04:16:06.636913+0000","last_undegraded":"2024-01-19T04:16:06.636913+0000","last_fullsized":"2024-01-19T04:16:06.636913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:48:50.290606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635281+0000","last_change":"2024-01-19T04:16:06.644115+0000","last_active":"2024-01-19T04:16:07.635281+0000","last_peered":"2024-01-19T04:16:07.635281+0000","last_clean":"2024-01-19T04:16:07.635281+0000","last_became_active":"2024-01-19T04:16:06.643807+0000","last_became_peered":"2024-01-19T04:16:06.643807+0000","last_unstale":"2024-01-19T04:16:07.635281+0000","last_undegraded":"2024-01-19T04:16:07.635281+0000","last_fullsized":"2024-01-19T04:16:07.635281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:20.211567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642015+0000","last_change":"2024-01-19T04:15:49.650339+0000","last_active":"2024-01-19T04:16:06.642015+0000","last_peered":"2024-01-19T04:16:06.642015+0000","last_clean":"2024-01-19T04:16:06.642015+0000","last_became_active":"2024-01-19T04:15:49.650001+0000","last_became_peered":"2024-01-19T04:15:49.650001+0000","last_unstale":"2024-01-19T04:16:06.642015+0000","last_undegraded":"2024-01-19T04:16:06.642015+0000","last_fullsized":"2024-01-19T04:16:06.642015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:48.397857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085440+0000","last_change":"2024-01-19T04:16:06.645593+0000","last_active":"2024-01-19T04:16:08.085440+0000","last_peered":"2024-01-19T04:16:08.085440+0000","last_clean":"2024-01-19T04:16:08.085440+0000","last_became_active":"2024-01-19T04:16:06.645250+0000","last_became_peered":"2024-01-19T04:16:06.645250+0000","last_unstale":"2024-01-19T04:16:08.085440+0000","last_undegraded":"2024-01-19T04:16:08.085440+0000","last_fullsized":"2024-01-19T04:16:08.085440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:39:02.330049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644855+0000","last_change":"2024-01-19T04:15:49.677109+0000","last_active":"2024-01-19T04:16:06.644855+0000","last_peered":"2024-01-19T04:16:06.644855+0000","last_clean":"2024-01-19T04:16:06.644855+0000","last_became_active":"2024-01-19T04:15:49.676842+0000","last_became_peered":"2024-01-19T04:15:49.676842+0000","last_unstale":"2024-01-19T04:16:06.644855+0000","last_undegraded":"2024-01-19T04:16:06.644855+0000","last_fullsized":"2024-01-19T04:16:06.644855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:58:10.707226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635962+0000","last_change":"2024-01-19T04:16:06.642681+0000","last_active":"2024-01-19T04:16:07.635962+0000","last_peered":"2024-01-19T04:16:07.635962+0000","last_clean":"2024-01-19T04:16:07.635962+0000","last_became_active":"2024-01-19T04:16:06.642382+0000","last_became_peered":"2024-01-19T04:16:06.642382+0000","last_unstale":"2024-01-19T04:16:07.635962+0000","last_undegraded":"2024-01-19T04:16:07.635962+0000","last_fullsized":"2024-01-19T04:16:07.635962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:47.006272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640658+0000","last_change":"2024-01-19T04:15:49.668399+0000","last_active":"2024-01-19T04:16:06.640658+0000","last_peered":"2024-01-19T04:16:06.640658+0000","last_clean":"2024-01-19T04:16:06.640658+0000","last_became_active":"2024-01-19T04:15:49.668009+0000","last_became_peered":"2024-01-19T04:15:49.668009+0000","last_unstale":"2024-01-19T04:16:06.640658+0000","last_undegraded":"2024-01-19T04:16:06.640658+0000","last_fullsized":"2024-01-19T04:16:06.640658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:08.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086326+0000","last_change":"2024-01-19T04:16:06.644722+0000","last_active":"2024-01-19T04:16:08.086326+0000","last_peered":"2024-01-19T04:16:08.086326+0000","last_clean":"2024-01-19T04:16:08.086326+0000","last_became_active":"2024-01-19T04:16:06.644441+0000","last_became_peered":"2024-01-19T04:16:06.644441+0000","last_unstale":"2024-01-19T04:16:08.086326+0000","last_undegraded":"2024-01-19T04:16:08.086326+0000","last_fullsized":"2024-01-19T04:16:08.086326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:47:19.126540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641820+0000","last_change":"2024-01-19T04:15:49.672729+0000","last_active":"2024-01-19T04:16:06.641820+0000","last_peered":"2024-01-19T04:16:06.641820+0000","last_clean":"2024-01-19T04:16:06.641820+0000","last_became_active":"2024-01-19T04:15:49.672195+0000","last_became_peered":"2024-01-19T04:15:49.672195+0000","last_unstale":"2024-01-19T04:16:06.641820+0000","last_undegraded":"2024-01-19T04:16:06.641820+0000","last_fullsized":"2024-01-19T04:16:06.641820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:04:25.440170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085292+0000","last_change":"2024-01-19T04:16:06.648752+0000","last_active":"2024-01-19T04:16:08.085292+0000","last_peered":"2024-01-19T04:16:08.085292+0000","last_clean":"2024-01-19T04:16:08.085292+0000","last_became_active":"2024-01-19T04:16:06.648366+0000","last_became_peered":"2024-01-19T04:16:06.648366+0000","last_unstale":"2024-01-19T04:16:08.085292+0000","last_undegraded":"2024-01-19T04:16:08.085292+0000","last_fullsized":"2024-01-19T04:16:08.085292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641085+0000","last_change":"2024-01-19T04:15:49.658494+0000","last_active":"2024-01-19T04:16:06.641085+0000","last_peered":"2024-01-19T04:16:06.641085+0000","last_clean":"2024-01-19T04:16:06.641085+0000","last_became_active":"2024-01-19T04:15:49.656738+0000","last_became_peered":"2024-01-19T04:15:49.656738+0000","last_unstale":"2024-01-19T04:16:06.641085+0000","last_undegraded":"2024-01-19T04:16:06.641085+0000","last_fullsized":"2024-01-19T04:16:06.641085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:09.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639099+0000","last_change":"2024-01-19T04:16:06.654563+0000","last_active":"2024-01-19T04:16:07.639099+0000","last_peered":"2024-01-19T04:16:07.639099+0000","last_clean":"2024-01-19T04:16:07.639099+0000","last_became_active":"2024-01-19T04:16:06.654166+0000","last_became_peered":"2024-01-19T04:16:06.654166+0000","last_unstale":"2024-01-19T04:16:07.639099+0000","last_undegraded":"2024-01-19T04:16:07.639099+0000","last_fullsized":"2024-01-19T04:16:07.639099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:26.441618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638035+0000","last_change":"2024-01-19T04:15:49.655156+0000","last_active":"2024-01-19T04:16:06.638035+0000","last_peered":"2024-01-19T04:16:06.638035+0000","last_clean":"2024-01-19T04:16:06.638035+0000","last_became_active":"2024-01-19T04:15:49.651743+0000","last_became_peered":"2024-01-19T04:15:49.651743+0000","last_unstale":"2024-01-19T04:16:06.638035+0000","last_undegraded":"2024-01-19T04:16:06.638035+0000","last_fullsized":"2024-01-19T04:16:06.638035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:56:26.090942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085040+0000","last_change":"2024-01-19T04:16:06.653368+0000","last_active":"2024-01-19T04:16:08.085040+0000","last_peered":"2024-01-19T04:16:08.085040+0000","last_clean":"2024-01-19T04:16:08.085040+0000","last_became_active":"2024-01-19T04:16:06.653083+0000","last_became_peered":"2024-01-19T04:16:06.653083+0000","last_unstale":"2024-01-19T04:16:08.085040+0000","last_undegraded":"2024-01-19T04:16:08.085040+0000","last_fullsized":"2024-01-19T04:16:08.085040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:48.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639730+0000","last_change":"2024-01-19T04:15:49.662136+0000","last_active":"2024-01-19T04:16:06.639730+0000","last_peered":"2024-01-19T04:16:06.639730+0000","last_clean":"2024-01-19T04:16:06.639730+0000","last_became_active":"2024-01-19T04:15:49.661854+0000","last_became_peered":"2024-01-19T04:15:49.661854+0000","last_unstale":"2024-01-19T04:16:06.639730+0000","last_undegraded":"2024-01-19T04:16:06.639730+0000","last_fullsized":"2024-01-19T04:16:06.639730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:31.814141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.087341+0000","last_change":"2024-01-19T04:16:06.655369+0000","last_active":"2024-01-19T04:16:08.087341+0000","last_peered":"2024-01-19T04:16:08.087341+0000","last_clean":"2024-01-19T04:16:08.087341+0000","last_became_active":"2024-01-19T04:16:06.655053+0000","last_became_peered":"2024-01-19T04:16:06.655053+0000","last_unstale":"2024-01-19T04:16:08.087341+0000","last_undegraded":"2024-01-19T04:16:08.087341+0000","last_fullsized":"2024-01-19T04:16:08.087341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:39:35.660335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.649648+0000","last_change":"2024-01-19T04:15:49.645143+0000","last_active":"2024-01-19T04:16:06.649648+0000","last_peered":"2024-01-19T04:16:06.649648+0000","last_clean":"2024-01-19T04:16:06.649648+0000","last_became_active":"2024-01-19T04:15:49.644879+0000","last_became_peered":"2024-01-19T04:15:49.644879+0000","last_unstale":"2024-01-19T04:16:06.649648+0000","last_undegraded":"2024-01-19T04:16:06.649648+0000","last_fullsized":"2024-01-19T04:16:06.649648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084725+0000","last_change":"2024-01-19T04:16:06.653011+0000","last_active":"2024-01-19T04:16:08.084725+0000","last_peered":"2024-01-19T04:16:08.084725+0000","last_clean":"2024-01-19T04:16:08.084725+0000","last_became_active":"2024-01-19T04:16:06.652708+0000","last_became_peered":"2024-01-19T04:16:06.652708+0000","last_unstale":"2024-01-19T04:16:08.084725+0000","last_undegraded":"2024-01-19T04:16:08.084725+0000","last_fullsized":"2024-01-19T04:16:08.084725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:37.218319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644172+0000","last_change":"2024-01-19T04:15:49.674017+0000","last_active":"2024-01-19T04:16:06.644172+0000","last_peered":"2024-01-19T04:16:06.644172+0000","last_clean":"2024-01-19T04:16:06.644172+0000","last_became_active":"2024-01-19T04:15:49.673709+0000","last_became_peered":"2024-01-19T04:15:49.673709+0000","last_unstale":"2024-01-19T04:16:06.644172+0000","last_undegraded":"2024-01-19T04:16:06.644172+0000","last_fullsized":"2024-01-19T04:16:06.644172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085481+0000","last_change":"2024-01-19T04:16:06.653975+0000","last_active":"2024-01-19T04:16:08.085481+0000","last_peered":"2024-01-19T04:16:08.085481+0000","last_clean":"2024-01-19T04:16:08.085481+0000","last_became_active":"2024-01-19T04:16:06.652299+0000","last_became_peered":"2024-01-19T04:16:06.652299+0000","last_unstale":"2024-01-19T04:16:08.085481+0000","last_undegraded":"2024-01-19T04:16:08.085481+0000","last_fullsized":"2024-01-19T04:16:08.085481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:59.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644765+0000","last_change":"2024-01-19T04:15:49.667090+0000","last_active":"2024-01-19T04:16:06.644765+0000","last_peered":"2024-01-19T04:16:06.644765+0000","last_clean":"2024-01-19T04:16:06.644765+0000","last_became_active":"2024-01-19T04:15:49.666833+0000","last_became_peered":"2024-01-19T04:15:49.666833+0000","last_unstale":"2024-01-19T04:16:06.644765+0000","last_undegraded":"2024-01-19T04:16:06.644765+0000","last_fullsized":"2024-01-19T04:16:06.644765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:22:43.946607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639255+0000","last_change":"2024-01-19T04:16:06.659934+0000","last_active":"2024-01-19T04:16:07.639255+0000","last_peered":"2024-01-19T04:16:07.639255+0000","last_clean":"2024-01-19T04:16:07.639255+0000","last_became_active":"2024-01-19T04:16:06.659055+0000","last_became_peered":"2024-01-19T04:16:06.659055+0000","last_unstale":"2024-01-19T04:16:07.639255+0000","last_undegraded":"2024-01-19T04:16:07.639255+0000","last_fullsized":"2024-01-19T04:16:07.639255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:21:48.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.634937+0000","last_change":"2024-01-19T04:15:49.679977+0000","last_active":"2024-01-19T04:16:06.634937+0000","last_peered":"2024-01-19T04:16:06.634937+0000","last_clean":"2024-01-19T04:16:06.634937+0000","last_became_active":"2024-01-19T04:15:49.679706+0000","last_became_peered":"2024-01-19T04:15:49.679706+0000","last_unstale":"2024-01-19T04:16:06.634937+0000","last_undegraded":"2024-01-19T04:16:06.634937+0000","last_fullsized":"2024-01-19T04:16:06.634937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:21:53.618796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639343+0000","last_change":"2024-01-19T04:16:06.655197+0000","last_active":"2024-01-19T04:16:07.639343+0000","last_peered":"2024-01-19T04:16:07.639343+0000","last_clean":"2024-01-19T04:16:07.639343+0000","last_became_active":"2024-01-19T04:16:06.654021+0000","last_became_peered":"2024-01-19T04:16:06.654021+0000","last_unstale":"2024-01-19T04:16:07.639343+0000","last_undegraded":"2024-01-19T04:16:07.639343+0000","last_fullsized":"2024-01-19T04:16:07.639343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:15.679645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639303+0000","last_change":"2024-01-19T04:15:49.658296+0000","last_active":"2024-01-19T04:16:06.639303+0000","last_peered":"2024-01-19T04:16:06.639303+0000","last_clean":"2024-01-19T04:16:06.639303+0000","last_became_active":"2024-01-19T04:15:49.658044+0000","last_became_peered":"2024-01-19T04:15:49.658044+0000","last_unstale":"2024-01-19T04:16:06.639303+0000","last_undegraded":"2024-01-19T04:16:06.639303+0000","last_fullsized":"2024-01-19T04:16:06.639303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:58:55.335241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635814+0000","last_change":"2024-01-19T04:16:06.656508+0000","last_active":"2024-01-19T04:16:07.635814+0000","last_peered":"2024-01-19T04:16:07.635814+0000","last_clean":"2024-01-19T04:16:07.635814+0000","last_became_active":"2024-01-19T04:16:06.656095+0000","last_became_peered":"2024-01-19T04:16:06.656095+0000","last_unstale":"2024-01-19T04:16:07.635814+0000","last_undegraded":"2024-01-19T04:16:07.635814+0000","last_fullsized":"2024-01-19T04:16:07.635814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:49:48.953287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640988+0000","last_change":"2024-01-19T04:15:49.658253+0000","last_active":"2024-01-19T04:16:06.640988+0000","last_peered":"2024-01-19T04:16:06.640988+0000","last_clean":"2024-01-19T04:16:06.640988+0000","last_became_active":"2024-01-19T04:15:49.658025+0000","last_became_peered":"2024-01-19T04:15:49.658025+0000","last_unstale":"2024-01-19T04:16:06.640988+0000","last_undegraded":"2024-01-19T04:16:06.640988+0000","last_fullsized":"2024-01-19T04:16:06.640988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:48:49.079361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085674+0000","last_change":"2024-01-19T04:16:06.659226+0000","last_active":"2024-01-19T04:16:08.085674+0000","last_peered":"2024-01-19T04:16:08.085674+0000","last_clean":"2024-01-19T04:16:08.085674+0000","last_became_active":"2024-01-19T04:16:06.658664+0000","last_became_peered":"2024-01-19T04:16:06.658664+0000","last_unstale":"2024-01-19T04:16:08.085674+0000","last_undegraded":"2024-01-19T04:16:08.085674+0000","last_fullsized":"2024-01-19T04:16:08.085674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:25.718378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644881+0000","last_change":"2024-01-19T04:15:49.654443+0000","last_active":"2024-01-19T04:16:06.644881+0000","last_peered":"2024-01-19T04:16:06.644881+0000","last_clean":"2024-01-19T04:16:06.644881+0000","last_became_active":"2024-01-19T04:15:49.654169+0000","last_became_peered":"2024-01-19T04:15:49.654169+0000","last_unstale":"2024-01-19T04:16:06.644881+0000","last_undegraded":"2024-01-19T04:16:06.644881+0000","last_fullsized":"2024-01-19T04:16:06.644881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:53.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084295+0000","last_change":"2024-01-19T04:16:06.658727+0000","last_active":"2024-01-19T04:16:08.084295+0000","last_peered":"2024-01-19T04:16:08.084295+0000","last_clean":"2024-01-19T04:16:08.084295+0000","last_became_active":"2024-01-19T04:16:06.657947+0000","last_became_peered":"2024-01-19T04:16:06.657947+0000","last_unstale":"2024-01-19T04:16:08.084295+0000","last_undegraded":"2024-01-19T04:16:08.084295+0000","last_fullsized":"2024-01-19T04:16:08.084295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:02:26.441618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.642120+0000","last_change":"2024-01-19T04:15:49.651726+0000","last_active":"2024-01-19T04:16:06.642120+0000","last_peered":"2024-01-19T04:16:06.642120+0000","last_clean":"2024-01-19T04:16:06.642120+0000","last_became_active":"2024-01-19T04:15:49.651447+0000","last_became_peered":"2024-01-19T04:15:49.651447+0000","last_unstale":"2024-01-19T04:16:06.642120+0000","last_undegraded":"2024-01-19T04:16:06.642120+0000","last_fullsized":"2024-01-19T04:16:06.642120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.635326+0000","last_change":"2024-01-19T04:16:06.643237+0000","last_active":"2024-01-19T04:16:07.635326+0000","last_peered":"2024-01-19T04:16:07.635326+0000","last_clean":"2024-01-19T04:16:07.635326+0000","last_became_active":"2024-01-19T04:16:06.642898+0000","last_became_peered":"2024-01-19T04:16:06.642898+0000","last_unstale":"2024-01-19T04:16:07.635326+0000","last_undegraded":"2024-01-19T04:16:07.635326+0000","last_fullsized":"2024-01-19T04:16:07.635326+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:26.134708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.639864+0000","last_change":"2024-01-19T04:15:49.668489+0000","last_active":"2024-01-19T04:16:06.639864+0000","last_peered":"2024-01-19T04:16:06.639864+0000","last_clean":"2024-01-19T04:16:06.639864+0000","last_became_active":"2024-01-19T04:15:49.668171+0000","last_became_peered":"2024-01-19T04:15:49.668171+0000","last_unstale":"2024-01-19T04:16:06.639864+0000","last_undegraded":"2024-01-19T04:16:06.639864+0000","last_fullsized":"2024-01-19T04:16:06.639864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:33:15.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084790+0000","last_change":"2024-01-19T04:16:06.656893+0000","last_active":"2024-01-19T04:16:08.084790+0000","last_peered":"2024-01-19T04:16:08.084790+0000","last_clean":"2024-01-19T04:16:08.084790+0000","last_became_active":"2024-01-19T04:16:06.656606+0000","last_became_peered":"2024-01-19T04:16:06.656606+0000","last_unstale":"2024-01-19T04:16:08.084790+0000","last_undegraded":"2024-01-19T04:16:08.084790+0000","last_fullsized":"2024-01-19T04:16:08.084790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:43:05.537003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638495+0000","last_change":"2024-01-19T04:15:49.661543+0000","last_active":"2024-01-19T04:16:06.638495+0000","last_peered":"2024-01-19T04:16:06.638495+0000","last_clean":"2024-01-19T04:16:06.638495+0000","last_became_active":"2024-01-19T04:15:49.660853+0000","last_became_peered":"2024-01-19T04:15:49.660853+0000","last_unstale":"2024-01-19T04:16:06.638495+0000","last_undegraded":"2024-01-19T04:16:06.638495+0000","last_fullsized":"2024-01-19T04:16:06.638495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:23:42.712580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084905+0000","last_change":"2024-01-19T04:16:06.651408+0000","last_active":"2024-01-19T04:16:08.084905+0000","last_peered":"2024-01-19T04:16:08.084905+0000","last_clean":"2024-01-19T04:16:08.084905+0000","last_became_active":"2024-01-19T04:16:06.651129+0000","last_became_peered":"2024-01-19T04:16:06.651129+0000","last_unstale":"2024-01-19T04:16:08.084905+0000","last_undegraded":"2024-01-19T04:16:08.084905+0000","last_fullsized":"2024-01-19T04:16:08.084905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:35:16.310845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633913+0000","last_change":"2024-01-19T04:15:49.657109+0000","last_active":"2024-01-19T04:16:06.633913+0000","last_peered":"2024-01-19T04:16:06.633913+0000","last_clean":"2024-01-19T04:16:06.633913+0000","last_became_active":"2024-01-19T04:15:49.656836+0000","last_became_peered":"2024-01-19T04:15:49.656836+0000","last_unstale":"2024-01-19T04:16:06.633913+0000","last_undegraded":"2024-01-19T04:16:06.633913+0000","last_fullsized":"2024-01-19T04:16:06.633913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:42:41.496335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086508+0000","last_change":"2024-01-19T04:16:06.660525+0000","last_active":"2024-01-19T04:16:08.086508+0000","last_peered":"2024-01-19T04:16:08.086508+0000","last_clean":"2024-01-19T04:16:08.086508+0000","last_became_active":"2024-01-19T04:16:06.659997+0000","last_became_peered":"2024-01-19T04:16:06.659997+0000","last_unstale":"2024-01-19T04:16:08.086508+0000","last_undegraded":"2024-01-19T04:16:08.086508+0000","last_fullsized":"2024-01-19T04:16:08.086508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:02.077588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640656+0000","last_change":"2024-01-19T04:15:49.662751+0000","last_active":"2024-01-19T04:16:06.640656+0000","last_peered":"2024-01-19T04:16:06.640656+0000","last_clean":"2024-01-19T04:16:06.640656+0000","last_became_active":"2024-01-19T04:15:49.662468+0000","last_became_peered":"2024-01-19T04:15:49.662468+0000","last_unstale":"2024-01-19T04:16:06.640656+0000","last_undegraded":"2024-01-19T04:16:06.640656+0000","last_fullsized":"2024-01-19T04:16:06.640656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:52.657500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085834+0000","last_change":"2024-01-19T04:16:06.658837+0000","last_active":"2024-01-19T04:16:08.085834+0000","last_peered":"2024-01-19T04:16:08.085834+0000","last_clean":"2024-01-19T04:16:08.085834+0000","last_became_active":"2024-01-19T04:16:06.657952+0000","last_became_peered":"2024-01-19T04:16:06.657952+0000","last_unstale":"2024-01-19T04:16:08.085834+0000","last_undegraded":"2024-01-19T04:16:08.085834+0000","last_fullsized":"2024-01-19T04:16:08.085834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:07:30.123335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.644826+0000","last_change":"2024-01-19T04:15:49.662027+0000","last_active":"2024-01-19T04:16:06.644826+0000","last_peered":"2024-01-19T04:16:06.644826+0000","last_clean":"2024-01-19T04:16:06.644826+0000","last_became_active":"2024-01-19T04:15:49.661598+0000","last_became_peered":"2024-01-19T04:15:49.661598+0000","last_unstale":"2024-01-19T04:16:06.644826+0000","last_undegraded":"2024-01-19T04:16:06.644826+0000","last_fullsized":"2024-01-19T04:16:06.644826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:49:20.079173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085376+0000","last_change":"2024-01-19T04:16:06.648708+0000","last_active":"2024-01-19T04:16:08.085376+0000","last_peered":"2024-01-19T04:16:08.085376+0000","last_clean":"2024-01-19T04:16:08.085376+0000","last_became_active":"2024-01-19T04:16:06.648345+0000","last_became_peered":"2024-01-19T04:16:06.648345+0000","last_unstale":"2024-01-19T04:16:08.085376+0000","last_undegraded":"2024-01-19T04:16:08.085376+0000","last_fullsized":"2024-01-19T04:16:08.085376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:02.077588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638192+0000","last_change":"2024-01-19T04:15:49.664498+0000","last_active":"2024-01-19T04:16:06.638192+0000","last_peered":"2024-01-19T04:16:06.638192+0000","last_clean":"2024-01-19T04:16:06.638192+0000","last_became_active":"2024-01-19T04:15:49.664196+0000","last_became_peered":"2024-01-19T04:15:49.664196+0000","last_unstale":"2024-01-19T04:16:06.638192+0000","last_undegraded":"2024-01-19T04:16:06.638192+0000","last_fullsized":"2024-01-19T04:16:06.638192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:35.849755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086252+0000","last_change":"2024-01-19T04:16:06.657128+0000","last_active":"2024-01-19T04:16:08.086252+0000","last_peered":"2024-01-19T04:16:08.086252+0000","last_clean":"2024-01-19T04:16:08.086252+0000","last_became_active":"2024-01-19T04:16:06.656850+0000","last_became_peered":"2024-01-19T04:16:06.656850+0000","last_unstale":"2024-01-19T04:16:08.086252+0000","last_undegraded":"2024-01-19T04:16:08.086252+0000","last_fullsized":"2024-01-19T04:16:08.086252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:24:57.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.645376+0000","last_change":"2024-01-19T04:15:49.674825+0000","last_active":"2024-01-19T04:16:06.645376+0000","last_peered":"2024-01-19T04:16:06.645376+0000","last_clean":"2024-01-19T04:16:06.645376+0000","last_became_active":"2024-01-19T04:15:49.674521+0000","last_became_peered":"2024-01-19T04:15:49.674521+0000","last_unstale":"2024-01-19T04:16:06.645376+0000","last_undegraded":"2024-01-19T04:16:06.645376+0000","last_fullsized":"2024-01-19T04:16:06.645376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:00.918340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.086433+0000","last_change":"2024-01-19T04:16:06.654727+0000","last_active":"2024-01-19T04:16:08.086433+0000","last_peered":"2024-01-19T04:16:08.086433+0000","last_clean":"2024-01-19T04:16:08.086433+0000","last_became_active":"2024-01-19T04:16:06.654482+0000","last_became_peered":"2024-01-19T04:16:06.654482+0000","last_unstale":"2024-01-19T04:16:08.086433+0000","last_undegraded":"2024-01-19T04:16:08.086433+0000","last_fullsized":"2024-01-19T04:16:08.086433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:56.346459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641486+0000","last_change":"2024-01-19T04:15:49.660039+0000","last_active":"2024-01-19T04:16:06.641486+0000","last_peered":"2024-01-19T04:16:06.641486+0000","last_clean":"2024-01-19T04:16:06.641486+0000","last_became_active":"2024-01-19T04:15:49.659734+0000","last_became_peered":"2024-01-19T04:15:49.659734+0000","last_unstale":"2024-01-19T04:16:06.641486+0000","last_undegraded":"2024-01-19T04:16:06.641486+0000","last_fullsized":"2024-01-19T04:16:06.641486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:45:08.995562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.084834+0000","last_change":"2024-01-19T04:16:06.659547+0000","last_active":"2024-01-19T04:16:08.084834+0000","last_peered":"2024-01-19T04:16:08.084834+0000","last_clean":"2024-01-19T04:16:08.084834+0000","last_became_active":"2024-01-19T04:16:06.659251+0000","last_became_peered":"2024-01-19T04:16:06.659251+0000","last_unstale":"2024-01-19T04:16:08.084834+0000","last_undegraded":"2024-01-19T04:16:08.084834+0000","last_fullsized":"2024-01-19T04:16:08.084834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:35:34.310303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.647196+0000","last_change":"2024-01-19T04:15:49.654139+0000","last_active":"2024-01-19T04:16:06.647196+0000","last_peered":"2024-01-19T04:16:06.647196+0000","last_clean":"2024-01-19T04:16:06.647196+0000","last_became_active":"2024-01-19T04:15:49.653726+0000","last_became_peered":"2024-01-19T04:15:49.653726+0000","last_unstale":"2024-01-19T04:16:06.647196+0000","last_undegraded":"2024-01-19T04:16:06.647196+0000","last_fullsized":"2024-01-19T04:16:06.647196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:29.867126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085378+0000","last_change":"2024-01-19T04:16:06.663270+0000","last_active":"2024-01-19T04:16:08.085378+0000","last_peered":"2024-01-19T04:16:08.085378+0000","last_clean":"2024-01-19T04:16:08.085378+0000","last_became_active":"2024-01-19T04:16:06.661491+0000","last_became_peered":"2024-01-19T04:16:06.661491+0000","last_unstale":"2024-01-19T04:16:08.085378+0000","last_undegraded":"2024-01-19T04:16:08.085378+0000","last_fullsized":"2024-01-19T04:16:08.085378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:02:15.679645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638414+0000","last_change":"2024-01-19T04:15:49.662107+0000","last_active":"2024-01-19T04:16:06.638414+0000","last_peered":"2024-01-19T04:16:06.638414+0000","last_clean":"2024-01-19T04:16:06.638414+0000","last_became_active":"2024-01-19T04:15:49.661812+0000","last_became_peered":"2024-01-19T04:15:49.661812+0000","last_unstale":"2024-01-19T04:16:06.638414+0000","last_undegraded":"2024-01-19T04:16:06.638414+0000","last_fullsized":"2024-01-19T04:16:06.638414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:28.389374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080159+0000","last_change":"2024-01-19T04:16:06.658912+0000","last_active":"2024-01-19T04:16:08.080159+0000","last_peered":"2024-01-19T04:16:08.080159+0000","last_clean":"2024-01-19T04:16:08.080159+0000","last_became_active":"2024-01-19T04:16:06.657717+0000","last_became_peered":"2024-01-19T04:16:06.657717+0000","last_unstale":"2024-01-19T04:16:08.080159+0000","last_undegraded":"2024-01-19T04:16:08.080159+0000","last_fullsized":"2024-01-19T04:16:08.080159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:38.339092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.633823+0000","last_change":"2024-01-19T04:15:49.657523+0000","last_active":"2024-01-19T04:16:06.633823+0000","last_peered":"2024-01-19T04:16:06.633823+0000","last_clean":"2024-01-19T04:16:06.633823+0000","last_became_active":"2024-01-19T04:15:49.657239+0000","last_became_peered":"2024-01-19T04:15:49.657239+0000","last_unstale":"2024-01-19T04:16:06.633823+0000","last_undegraded":"2024-01-19T04:16:06.633823+0000","last_fullsized":"2024-01-19T04:16:06.633823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:25:50.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085023+0000","last_change":"2024-01-19T04:16:06.659512+0000","last_active":"2024-01-19T04:16:08.085023+0000","last_peered":"2024-01-19T04:16:08.085023+0000","last_clean":"2024-01-19T04:16:08.085023+0000","last_became_active":"2024-01-19T04:16:06.659270+0000","last_became_peered":"2024-01-19T04:16:06.659270+0000","last_unstale":"2024-01-19T04:16:08.085023+0000","last_undegraded":"2024-01-19T04:16:08.085023+0000","last_fullsized":"2024-01-19T04:16:08.085023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:24:57.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.638676+0000","last_change":"2024-01-19T04:15:49.666858+0000","last_active":"2024-01-19T04:16:06.638676+0000","last_peered":"2024-01-19T04:16:06.638676+0000","last_clean":"2024-01-19T04:16:06.638676+0000","last_became_active":"2024-01-19T04:15:49.665093+0000","last_became_peered":"2024-01-19T04:15:49.665093+0000","last_unstale":"2024-01-19T04:16:06.638676+0000","last_undegraded":"2024-01-19T04:16:06.638676+0000","last_fullsized":"2024-01-19T04:16:06.638676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:51:42.617081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.080530+0000","last_change":"2024-01-19T04:16:06.654831+0000","last_active":"2024-01-19T04:16:08.080530+0000","last_peered":"2024-01-19T04:16:08.080530+0000","last_clean":"2024-01-19T04:16:08.080530+0000","last_became_active":"2024-01-19T04:16:06.654545+0000","last_became_peered":"2024-01-19T04:16:06.654545+0000","last_unstale":"2024-01-19T04:16:08.080530+0000","last_undegraded":"2024-01-19T04:16:08.080530+0000","last_fullsized":"2024-01-19T04:16:08.080530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:10:45.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.640815+0000","last_change":"2024-01-19T04:15:49.659336+0000","last_active":"2024-01-19T04:16:06.640815+0000","last_peered":"2024-01-19T04:16:06.640815+0000","last_clean":"2024-01-19T04:16:06.640815+0000","last_became_active":"2024-01-19T04:15:49.658655+0000","last_became_peered":"2024-01-19T04:15:49.658655+0000","last_unstale":"2024-01-19T04:16:06.640815+0000","last_undegraded":"2024-01-19T04:16:06.640815+0000","last_fullsized":"2024-01-19T04:16:06.640815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:48:31.891256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:08.085694+0000","last_change":"2024-01-19T04:16:06.661023+0000","last_active":"2024-01-19T04:16:08.085694+0000","last_peered":"2024-01-19T04:16:08.085694+0000","last_clean":"2024-01-19T04:16:08.085694+0000","last_became_active":"2024-01-19T04:16:06.660642+0000","last_became_peered":"2024-01-19T04:16:06.660642+0000","last_unstale":"2024-01-19T04:16:08.085694+0000","last_undegraded":"2024-01-19T04:16:08.085694+0000","last_fullsized":"2024-01-19T04:16:08.085694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:00.472323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.641593+0000","last_change":"2024-01-19T04:15:49.655919+0000","last_active":"2024-01-19T04:16:06.641593+0000","last_peered":"2024-01-19T04:16:06.641593+0000","last_clean":"2024-01-19T04:16:06.641593+0000","last_became_active":"2024-01-19T04:15:49.655645+0000","last_became_peered":"2024-01-19T04:15:49.655645+0000","last_unstale":"2024-01-19T04:16:06.641593+0000","last_undegraded":"2024-01-19T04:16:06.641593+0000","last_fullsized":"2024-01-19T04:16:06.641593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:39:10.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-01-19T04:16:07.639131+0000","last_change":"2024-01-19T04:16:06.653710+0000","last_active":"2024-01-19T04:16:07.639131+0000","last_peered":"2024-01-19T04:16:07.639131+0000","last_clean":"2024-01-19T04:16:07.639131+0000","last_became_active":"2024-01-19T04:16:06.653239+0000","last_became_peered":"2024-01-19T04:16:06.653239+0000","last_unstale":"2024-01-19T04:16:07.639131+0000","last_undegraded":"2024-01-19T04:16:07.639131+0000","last_fullsized":"2024-01-19T04:16:07.639131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:05.767857+0000","last_clean_scrub_stamp":"2024-01-19T04:16:05.767857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:38.868186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-19T04:16:06.637755+0000","last_change":"2024-01-19T04:15:49.663514+0000","last_active":"2024-01-19T04:16:06.637755+0000","last_peered":"2024-01-19T04:16:06.637755+0000","last_clean":"2024-01-19T04:16:06.637755+0000","last_became_active":"2024-01-19T04:15:49.663261+0000","last_became_peered":"2024-01-19T04:15:49.663261+0000","last_unstale":"2024-01-19T04:16:06.637755+0000","last_undegraded":"2024-01-19T04:16:06.637755+0000","last_fullsized":"2024-01-19T04:16:06.637755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:15:48.628711+0000","last_clean_scrub_stamp":"2024-01-19T04:15:48.628711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:04:20.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476755,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":767441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.874}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.503},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.56999999999999995}]}]},{"osd":6,"up_from":16,"seq":68719476755,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":178181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.627},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.747},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.434}]}]},{"osd":5,"up_from":16,"seq":68719476754,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":177635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.86199999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476756,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":178609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.91100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":178597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.255},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.80900000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":180092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.032},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.96299999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":767295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.876},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.94299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":180660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.372},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.498},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.625}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:16:15.872 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:16:15.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-19T04:16:16.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.050+0000 7fe623e00640 1 Processor -- start 2024-01-19T04:16:16.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.050+0000 7fe623e00640 1 -- start start 2024-01-19T04:16:16.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe623e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 0x7fe61c0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe623e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c0a4ea0 con 0x7fe61c0c2080 2024-01-19T04:16:16.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe623e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c152a20 con 0x7fe61c0723b0 2024-01-19T04:16:16.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe623e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1524a0 con 0x7fe61c06d440 2024-01-19T04:16:16.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe620a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe61c0c2080 0x7fe61c155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41970/0 (socket says 172.21.15.32:41970) 2024-01-19T04:16:16.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe620a00640 1 -- 172.21.15.32:0/2682126298 learned_addr learned my addr 172.21.15.32:0/2682126298 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:16.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621e00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 0x7fe61c0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816235821 0 0) 0x7fe61c0a4ea0 con 0x7fe61c0c2080 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc003530 con 0x7fe61c0c2080 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418576622 0 0) 0x7fe5fc003530 con 0x7fe61c0c2080 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 msgr2=0x7fe61c0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 0x7fe61c0c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 >> v1:172.21.15.67:6789/0 conn(0x7fe61c0723b0 legacy=0x7fe61c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c0c3430 con 0x7fe61c0c2080 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fe604001680 con 0x7fe61c0c2080 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 >> v1:172.21.15.32:6789/0 conn(0x7fe61c0c2080 legacy=0x7fe61c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe5fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 0x7fe5fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5fc004d10 0x7fe5fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1524a0 con 0x7fe5fc0039b0 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc00bb20 con 0x7fe5fc004d10 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc00bcb0 con 0x7fe61c06d440 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621400640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe5fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621e00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5fc004d10 0x7fe5fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe620a00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 0x7fe5fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621400640 1 -- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 msgr2=0x7fe5fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621400640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c06d440 0x7fe5fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621400640 1 -- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5fc004d10 msgr2=0x7fe5fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621400640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5fc004d10 0x7fe5fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.054+0000 7fe621400640 1 -- 172.21.15.32:0/2682126298 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc003530 con 0x7fe5fc0039b0 2024-01-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe621400640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe5fc003d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe60c001890 tx=0x7fe60c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2773fddfc29c403 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0ac630 con 0x7fe5fc0039b0 2024-01-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c0ac790 con 0x7fe5fc0039b0 2024-01-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe61be00640 1 -- 172.21.15.32:0/2682126298 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0acb40 con 0x7fe5fc0039b0 2024-01-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe623e00640 1 -- 172.21.15.32:0/2682126298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 msgr2=0x7fe5fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe623e00640 1 --2- 172.21.15.32:0/2682126298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe5fc003d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe60c001890 tx=0x7fe60c01c4b0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe621e00640 1 -- 172.21.15.32:0/2682126298 reap_dead start 2024-01-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe623e00640 1 -- 172.21.15.32:0/2682126298 shutdown_connections 2024-01-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe623e00640 1 -- 172.21.15.32:0/2682126298 >> 172.21.15.32:0/2682126298 conn(0x7fe61c0c25a0 msgr2=0x7fe61c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:16.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe623e00640 1 -- 172.21.15.32:0/2682126298 shutdown_connections 2024-01-19T04:16:16.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.058+0000 7fe623e00640 1 -- 172.21.15.32:0/2682126298 wait complete. 2024-01-19T04:16:16.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 Processor -- start 2024-01-19T04:16:16.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 -- start start 2024-01-19T04:16:16.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe61c146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe61c1ee3c0 0x7fe61c1ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c1eed80 0x7fe61c1ec790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1ec370 con 0x7fe5fc0039b0 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1ec060 con 0x7fe61c1ee3c0 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0a9b00 con 0x7fe61c1eed80 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe61c146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe61c146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43432/0 (socket says 172.21.15.32:43432) 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 -- 172.21.15.32:0/1240573005 learned_addr learned my addr 172.21.15.32:0/1240573005 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c1eed80 0x7fe61c1ec790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe620a00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe61c1ee3c0 0x7fe61c1ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 -- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c1eed80 msgr2=0x7fe61c1ec790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c1eed80 0x7fe61c1ec790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 -- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe61c1ee3c0 msgr2=0x7fe61c1ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe61c1ee3c0 0x7fe61c1ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 -- 172.21.15.32:0/1240573005 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c152f50 con 0x7fe5fc0039b0 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c1eed80 0x7fe61c1ec790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe621400640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe61c146d70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe60c01c2e0 tx=0x7fe5fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe619600640 1 -- 172.21.15.32:0/1240573005 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0ac630 con 0x7fe5fc0039b0 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe619600640 1 -- 172.21.15.32:0/1240573005 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c005110 con 0x7fe5fc0039b0 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe619600640 1 -- 172.21.15.32:0/1240573005 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0054a0 con 0x7fe5fc0039b0 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c153230 con 0x7fe5fc0039b0 2024-01-19T04:16:16.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c1eccd0 con 0x7fe5fc0039b0 2024-01-19T04:16:16.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.062+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c0749f0 con 0x7fe5fc0039b0 2024-01-19T04:16:16.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.066+0000 7fe619600640 1 -- 172.21.15.32:0/1240573005 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe60c0b3040 con 0x7fe5fc0039b0 2024-01-19T04:16:16.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.066+0000 7fe619600640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5f4066500 0x7fe5f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.066+0000 7fe619600640 1 -- 172.21.15.32:0/1240573005 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe60c11dea0 con 0x7fe5fc0039b0 2024-01-19T04:16:16.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.066+0000 7fe620a00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5f4066500 0x7fe5f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.066+0000 7fe620a00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5f4066500 0x7fe5f40689c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe604001cc0 tx=0x7fe604007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.070+0000 7fe619600640 1 -- 172.21.15.32:0/1240573005 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe60c0eae80 con 0x7fe5fc0039b0 2024-01-19T04:16:16.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.286+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fe61c1ec5e0 con 0x7fe5fc0039b0 2024-01-19T04:16:16.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe619600640 1 -- 172.21.15.32:0/1240573005 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7fe60c0b10e0 con 0x7fe5fc0039b0 2024-01-19T04:16:16.291 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-01-19T04:16:16.291 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ== 2024-01-19T04:16:16.291 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-01-19T04:16:16.292 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-01-19T04:16:16.292 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-19T04:16:16.292 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.1 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5f4066500 msgr2=0x7fe5f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5f4066500 0x7fe5f40689c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe604001cc0 tx=0x7fe604007040 comp rx=0 tx=0).stop 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 msgr2=0x7fe61c146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe61c146d70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe60c01c2e0 tx=0x7fe5fc005800 comp rx=0 tx=0).stop 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 shutdown_connections 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5f4066500 0x7fe5f40689c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe61c1eed80 0x7fe61c1ec790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe61c1ee3c0 0x7fe61c1ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 --2- 172.21.15.32:0/1240573005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5fc0039b0 0x7fe61c146d70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 >> 172.21.15.32:0/1240573005 conn(0x7fe61c0c25a0 msgr2=0x7fe61c0a57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 shutdown_connections 2024-01-19T04:16:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.290+0000 7fe623e00640 1 -- 172.21.15.32:0/1240573005 wait complete. 2024-01-19T04:16:16.314 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:16.314 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:16.324 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:16.324 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:16.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd716200640 1 Processor -- start 2024-01-19T04:16:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd716200640 1 -- start start 2024-01-19T04:16:16.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd716200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd7100c4690 0x7fd7100c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd716200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100c0c90 con 0x7fd7100c5740 2024-01-19T04:16:16.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd716200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100c4aa0 con 0x7fd7100c42b0 2024-01-19T04:16:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd716200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd710150f90 con 0x7fd7100c4690 2024-01-19T04:16:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd7100c5740 0x7fd710159430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41986/0 (socket says 172.21.15.32:41986) 2024-01-19T04:16:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70ea00640 1 -- 172.21.15.32:0/724614045 learned_addr learned my addr 172.21.15.32:0/724614045 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70fe00640 1 --2- 172.21.15.32:0/724614045 >> v2:172.21.15.67:3300/0 conn(0x7fd7100c4690 0x7fd7100c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849728529 0 0) 0x7fd7100c0c90 con 0x7fd7100c5740 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f0005740 con 0x7fd7100c5740 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1260626002 0 0) 0x7fd6f0005740 con 0x7fd7100c5740 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 >> v2:172.21.15.67:3300/0 conn(0x7fd7100c4690 msgr2=0x7fd7100c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 --2- 172.21.15.32:0/724614045 >> v2:172.21.15.67:3300/0 conn(0x7fd7100c4690 0x7fd7100c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 >> v1:172.21.15.67:6789/0 conn(0x7fd7100c42b0 legacy=0x7fd71006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710150cb0 con 0x7fd7100c5740 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fd6f8001680 con 0x7fd7100c5740 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 >> v1:172.21.15.32:6789/0 conn(0x7fd7100c5740 legacy=0x7fd710159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6f0005be0 0x7fd6f0006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f00069e0 0x7fd6f0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f00073f0 0x7fd6f000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710150f90 con 0x7fd6f0005be0 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f000e340 con 0x7fd6f00073f0 2024-01-19T04:16:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f000e500 con 0x7fd6f00069e0 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70f400640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6f0005be0 0x7fd6f0006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70fe00640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f00073f0 0x7fd6f000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70ea00640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f00069e0 0x7fd6f0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70f400640 1 -- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f00069e0 msgr2=0x7fd6f0006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70f400640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f00069e0 0x7fd6f0006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70f400640 1 -- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f00073f0 msgr2=0x7fd6f000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70f400640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f00073f0 0x7fd6f000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70f400640 1 -- 172.21.15.32:0/724614045 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0005740 con 0x7fd6f0005be0 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70fe00640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6f00073f0 0x7fd6f000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.514+0000 7fd70fe00640 1 -- 172.21.15.32:0/724614045 reap_dead start 2024-01-19T04:16:16.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd70f400640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6f0005be0 0x7fd6f0006000 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd700001750 tx=0x7fd70001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b9694b1e7d9dd7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000052d0 con 0x7fd6f0005be0 2024-01-19T04:16:16.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000a7050 con 0x7fd6f0005be0 2024-01-19T04:16:16.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd70e000640 1 -- 172.21.15.32:0/724614045 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700003600 con 0x7fd6f0005be0 2024-01-19T04:16:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd716200640 1 -- 172.21.15.32:0/724614045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6f0005be0 msgr2=0x7fd6f0006000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd716200640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6f0005be0 0x7fd6f0006000 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd700001750 tx=0x7fd70001c350 comp rx=0 tx=0).stop 2024-01-19T04:16:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd716200640 1 -- 172.21.15.32:0/724614045 shutdown_connections 2024-01-19T04:16:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd716200640 1 --2- 172.21.15.32:0/724614045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6f0005be0 0x7fd6f0006000 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd716200640 1 -- 172.21.15.32:0/724614045 >> 172.21.15.32:0/724614045 conn(0x7fd7100c5b20 msgr2=0x7fd7100c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd716200640 1 -- 172.21.15.32:0/724614045 shutdown_connections 2024-01-19T04:16:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.518+0000 7fd716200640 1 -- 172.21.15.32:0/724614045 wait complete. 2024-01-19T04:16:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 Processor -- start 2024-01-19T04:16:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 -- start start 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f0005be0 0x7fd7101f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7101e2f00 0x7fd71014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7101e09a0 0x7fd7101edf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710153ce0 con 0x7fd7101e09a0 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101ed860 con 0x7fd7101e2f00 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101f1d20 con 0x7fd6f0005be0 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7101e09a0 0x7fd7101edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7101e09a0 0x7fd7101edf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43454/0 (socket says 172.21.15.32:43454) 2024-01-19T04:16:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 -- 172.21.15.32:0/3447122445 learned_addr learned my addr 172.21.15.32:0/3447122445 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70f400640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f0005be0 0x7fd7101f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70ea00640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7101e2f00 0x7fd71014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 -- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f0005be0 msgr2=0x7fd7101f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f0005be0 0x7fd7101f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 -- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7101e2f00 msgr2=0x7fd71014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7101e2f00 0x7fd71014fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 -- 172.21.15.32:0/3447122445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7101551d0 con 0x7fd7101e09a0 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd70fe00640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7101e09a0 0x7fd7101edf90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd7100c67f0 tx=0x7fd708010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd707400640 1 -- 172.21.15.32:0/3447122445 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70800e050 con 0x7fd7101e09a0 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd707400640 1 -- 172.21.15.32:0/3447122445 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70800f040 con 0x7fd7101e09a0 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd707400640 1 -- 172.21.15.32:0/3447122445 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708007e80 con 0x7fd7101e09a0 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7101edb00 con 0x7fd7101e09a0 2024-01-19T04:16:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.522+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd710154930 con 0x7fd7101e09a0 2024-01-19T04:16:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.526+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7101edc90 con 0x7fd7101e09a0 2024-01-19T04:16:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.526+0000 7fd707400640 1 -- 172.21.15.32:0/3447122445 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd708015440 con 0x7fd7101e09a0 2024-01-19T04:16:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.526+0000 7fd707400640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6e8066500 0x7fd6e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.526+0000 7fd707400640 1 -- 172.21.15.32:0/3447122445 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd708084530 con 0x7fd7101e09a0 2024-01-19T04:16:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.526+0000 7fd70f400640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6e8066500 0x7fd6e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.526+0000 7fd70f400640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6e8066500 0x7fd6e80689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006960 tx=0x7fd7000011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.530+0000 7fd707400640 1 -- 172.21.15.32:0/3447122445 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd708051510 con 0x7fd7101e09a0 2024-01-19T04:16:16.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.694+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7100c4eb0 con 0x7fd7101e09a0 2024-01-19T04:16:16.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd707400640 1 -- 172.21.15.32:0/3447122445 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20134 (secure 0 0 0) 0x7fd708054b30 con 0x7fd7101e09a0 2024-01-19T04:16:16.699 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:16.700 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:07.630852+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:16.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6e8066500 msgr2=0x7fd6e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6e8066500 0x7fd6e80689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006960 tx=0x7fd7000011a0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7101e09a0 msgr2=0x7fd7101edf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7101e09a0 0x7fd7101edf90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd7100c67f0 tx=0x7fd708010590 comp rx=0 tx=0).stop 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 shutdown_connections 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6e8066500 0x7fd6e80689c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7101e09a0 0x7fd7101edf90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7101e2f00 0x7fd71014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 --2- 172.21.15.32:0/3447122445 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6f0005be0 0x7fd7101f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 >> 172.21.15.32:0/3447122445 conn(0x7fd7100c5b20 msgr2=0x7fd71006d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 shutdown_connections 2024-01-19T04:16:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.698+0000 7fd716200640 1 -- 172.21.15.32:0/3447122445 wait complete. 2024-01-19T04:16:16.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:15:46.886973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:48.025571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:16:04.715304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:16:05.165871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:16.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:16.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2543400640 1 Processor -- start 2024-01-19T04:16:16.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2543400640 1 -- start start 2024-01-19T04:16:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2543400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 0x7f253c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2543400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0c2d30 con 0x7f253c0c6360 2024-01-19T04:16:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2543400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0c3010 con 0x7f253c151b80 2024-01-19T04:16:16.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2543400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0c34a0 con 0x7f253c155150 2024-01-19T04:16:16.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2541400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f253c0c6360 0x7f253c0c67f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42002/0 (socket says 172.21.15.32:42002) 2024-01-19T04:16:16.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f2541400640 1 -- 172.21.15.32:0/1404660608 learned_addr learned my addr 172.21.15.32:0/1404660608 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253be00640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 0x7f253c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977843887 0 0) 0x7f253c0c2d30 con 0x7f253c0c6360 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c003530 con 0x7f253c0c6360 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809295051 0 0) 0x7f251c003530 con 0x7f253c0c6360 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 msgr2=0x7f253c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 0x7f253c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 >> v1:172.21.15.67:6789/0 conn(0x7f253c151b80 legacy=0x7f253c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0c6f00 con 0x7f253c0c6360 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f2534001a00 con 0x7f253c0c6360 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 >> v1:172.21.15.32:6789/0 conn(0x7f253c0c6360 legacy=0x7f253c0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 0x7f251c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f251c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c004d10 0x7f251c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0c34a0 con 0x7f251c003ef0 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c00b9f0 con 0x7f251c004d10 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.866+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c00bbb0 con 0x7f253c155150 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253be00640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f251c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f2540a00640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 0x7f251c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f2541400640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c004d10 0x7f251c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253be00640 1 -- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 msgr2=0x7f251c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253be00640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c155150 0x7f251c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253be00640 1 -- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c004d10 msgr2=0x7f251c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253be00640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c004d10 0x7f251c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253be00640 1 -- 172.21.15.32:0/1404660608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c003530 con 0x7f251c003ef0 2024-01-19T04:16:16.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253be00640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f251c0047d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2524009ae0 tx=0x7f252401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e4cc0d9491b0b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240a6450 con 0x7f251c003ef0 2024-01-19T04:16:16.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25240a65b0 con 0x7f251c003ef0 2024-01-19T04:16:16.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.870+0000 7f253b400640 1 -- 172.21.15.32:0/1404660608 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240a6960 con 0x7f251c003ef0 2024-01-19T04:16:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- 172.21.15.32:0/1404660608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 msgr2=0x7f251c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 --2- 172.21.15.32:0/1404660608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f251c0047d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2524009ae0 tx=0x7f252401c960 comp rx=0 tx=0).stop 2024-01-19T04:16:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2541400640 1 -- 172.21.15.32:0/1404660608 reap_dead start 2024-01-19T04:16:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- 172.21.15.32:0/1404660608 shutdown_connections 2024-01-19T04:16:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- 172.21.15.32:0/1404660608 >> 172.21.15.32:0/1404660608 conn(0x7f253c0c7d40 msgr2=0x7f253c0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- 172.21.15.32:0/1404660608 shutdown_connections 2024-01-19T04:16:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- 172.21.15.32:0/1404660608 wait complete. 2024-01-19T04:16:16.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 Processor -- start 2024-01-19T04:16:16.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- start start 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f253c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f253c0aabc0 0x7f253c06cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c14f1d0 0x7f253c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c155730 con 0x7f251c003ef0 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c14dd00 con 0x7f253c0aabc0 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2543400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c14ed40 con 0x7f253c14f1d0 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2540a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f253c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2540a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f253c153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43474/0 (socket says 172.21.15.32:43474) 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2540a00640 1 -- 172.21.15.32:0/199910814 learned_addr learned my addr 172.21.15.32:0/199910814 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f253be00640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f253c0aabc0 0x7f253c06cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.874+0000 7f2541400640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c14f1d0 0x7f253c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2540a00640 1 -- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c14f1d0 msgr2=0x7f253c14f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2540a00640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c14f1d0 0x7f253c14f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2540a00640 1 -- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f253c0aabc0 msgr2=0x7f253c06cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2540a00640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f253c0aabc0 0x7f253c06cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2540a00640 1 -- 172.21.15.32:0/199910814 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c154490 con 0x7f251c003ef0 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2540a00640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f253c153f50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f252c00f8a0 tx=0x7f252c00fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2538c00640 1 -- 172.21.15.32:0/199910814 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c001500 con 0x7f251c003ef0 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2538c00640 1 -- 172.21.15.32:0/199910814 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c0052e0 con 0x7f251c003ef0 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2538c00640 1 -- 172.21.15.32:0/199910814 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00d970 con 0x7f251c003ef0 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c0ab130 con 0x7f251c003ef0 2024-01-19T04:16:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c14e6f0 con 0x7f251c003ef0 2024-01-19T04:16:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c0749f0 con 0x7f251c003ef0 2024-01-19T04:16:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2538c00640 1 -- 172.21.15.32:0/199910814 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f252c00dad0 con 0x7f251c003ef0 2024-01-19T04:16:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2538c00640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2514066530 0x7f25140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.878+0000 7f2538c00640 1 -- 172.21.15.32:0/199910814 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f252c0841e0 con 0x7f251c003ef0 2024-01-19T04:16:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.882+0000 7f253be00640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2514066530 0x7f25140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.882+0000 7f253be00640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2514066530 0x7f25140689f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25240ad000 tx=0x7f25240b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:16.886+0000 7f2538c00640 1 -- 172.21.15.32:0/199910814 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f252c051080 con 0x7f251c003ef0 2024-01-19T04:16:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.042+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f253c0c5c40 con 0x7f251c003ef0 2024-01-19T04:16:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.042+0000 7f2538c00640 1 -- 172.21.15.32:0/199910814 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f252c0546a0 con 0x7f251c003ef0 2024-01-19T04:16:17.045 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2514066530 msgr2=0x7f25140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2514066530 0x7f25140689f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25240ad000 tx=0x7f25240b3040 comp rx=0 tx=0).stop 2024-01-19T04:16:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 msgr2=0x7f253c153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f253c153f50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f252c00f8a0 tx=0x7f252c00fca0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 shutdown_connections 2024-01-19T04:16:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2514066530 0x7f25140689f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f253c14f1d0 0x7f253c14f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f253c0aabc0 0x7f253c06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 --2- 172.21.15.32:0/199910814 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f251c003ef0 0x7f253c153f50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 >> 172.21.15.32:0/199910814 conn(0x7f253c0c7d40 msgr2=0x7f253c156560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 shutdown_connections 2024-01-19T04:16:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.046+0000 7f2543400640 1 -- 172.21.15.32:0/199910814 wait complete. 2024-01-19T04:16:17.067 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:16:17.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 Processor -- start 2024-01-19T04:16:17.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 -- start start 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2240723b0 0x7fd224152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2240c2080 0x7fd224155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd22406d440 0x7fd2240c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2241524a0 con 0x7fd22406d440 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2240a4ea0 con 0x7fd2240c2080 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd22b000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd224152a20 con 0x7fd2240723b0 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd22406d440 0x7fd2240c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd22406d440 0x7fd2240c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43486/0 (socket says 172.21.15.32:43486) 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 -- 172.21.15.32:0/2026476276 learned_addr learned my addr 172.21.15.32:0/2026476276 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd223e00640 1 --2- 172.21.15.32:0/2026476276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2240723b0 0x7fd224152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd223400640 1 --2- 172.21.15.32:0/2026476276 >> v2:172.21.15.67:3300/0 conn(0x7fd2240c2080 0x7fd224155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 -- 172.21.15.32:0/2026476276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2240723b0 msgr2=0x7fd224152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:17.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 --2- 172.21.15.32:0/2026476276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2240723b0 0x7fd224152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 -- 172.21.15.32:0/2026476276 >> v2:172.21.15.67:3300/0 conn(0x7fd2240c2080 msgr2=0x7fd224155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:17.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 --2- 172.21.15.32:0/2026476276 >> v2:172.21.15.67:3300/0 conn(0x7fd2240c2080 0x7fd224155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd229000640 1 -- 172.21.15.32:0/2026476276 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2241533f0 con 0x7fd22406d440 2024-01-19T04:16:17.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.210+0000 7fd223400640 1 --2- 172.21.15.32:0/2026476276 >> v2:172.21.15.67:3300/0 conn(0x7fd2240c2080 0x7fd224155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:17.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd229000640 1 --2- 172.21.15.32:0/2026476276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22406d440 0x7fd2240c4e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd2240a8810 tx=0x7fd21c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7bac0142c6dba8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd222a00640 1 -- 172.21.15.32:0/2026476276 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0a5640 con 0x7fd22406d440 2024-01-19T04:16:17.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd222a00640 1 -- 172.21.15.32:0/2026476276 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0a57a0 con 0x7fd22406d440 2024-01-19T04:16:17.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd222a00640 1 -- 172.21.15.32:0/2026476276 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0a5b30 con 0x7fd22406d440 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 -- 172.21.15.32:0/2026476276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22406d440 msgr2=0x7fd2240c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 --2- 172.21.15.32:0/2026476276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22406d440 0x7fd2240c4e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd2240a8810 tx=0x7fd21c01c8b0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 -- 172.21.15.32:0/2026476276 shutdown_connections 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 --2- 172.21.15.32:0/2026476276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22406d440 0x7fd2240c4e50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 --2- 172.21.15.32:0/2026476276 >> v2:172.21.15.67:3300/0 conn(0x7fd2240c2080 0x7fd224155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 --2- 172.21.15.32:0/2026476276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd2240723b0 0x7fd224152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 -- 172.21.15.32:0/2026476276 >> 172.21.15.32:0/2026476276 conn(0x7fd2240c25a0 msgr2=0x7fd2240c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 -- 172.21.15.32:0/2026476276 shutdown_connections 2024-01-19T04:16:17.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.214+0000 7fd22b000640 1 -- 172.21.15.32:0/2026476276 wait complete. 2024-01-19T04:16:17.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 Processor -- start 2024-01-19T04:16:17.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 -- start start 2024-01-19T04:16:17.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22406d440 0x7fd224151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240723b0 0x7fd2241554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2240c2080 0x7fd224155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd224072010 con 0x7fd2240c2080 2024-01-19T04:16:17.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd224071b20 con 0x7fd2240723b0 2024-01-19T04:16:17.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd224155070 con 0x7fd22406d440 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2240c2080 0x7fd224155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2240c2080 0x7fd224155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43500/0 (socket says 172.21.15.32:43500) 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 -- 172.21.15.32:0/2535652303 learned_addr learned my addr 172.21.15.32:0/2535652303 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd223400640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240723b0 0x7fd2241554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd223e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22406d440 0x7fd224151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 -- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22406d440 msgr2=0x7fd224151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22406d440 0x7fd224151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 -- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240723b0 msgr2=0x7fd2241554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240723b0 0x7fd2241554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 -- 172.21.15.32:0/2535652303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c009b30 con 0x7fd2240c2080 2024-01-19T04:16:17.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd229000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2240c2080 0x7fd224155a20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd21c01af60 tx=0x7fd21c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd21be00640 1 -- 172.21.15.32:0/2535652303 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0b8670 con 0x7fd2240c2080 2024-01-19T04:16:17.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd21be00640 1 -- 172.21.15.32:0/2535652303 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0b87d0 con 0x7fd2240c2080 2024-01-19T04:16:17.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd21be00640 1 -- 172.21.15.32:0/2535652303 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0b8b80 con 0x7fd2240c2080 2024-01-19T04:16:17.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2240a6ca0 con 0x7fd2240c2080 2024-01-19T04:16:17.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.218+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd224071d30 con 0x7fd2240c2080 2024-01-19T04:16:17.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.222+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2241551e0 con 0x7fd2240c2080 2024-01-19T04:16:17.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.222+0000 7fd21be00640 1 -- 172.21.15.32:0/2535652303 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd21c0b8ce0 con 0x7fd2240c2080 2024-01-19T04:16:17.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.222+0000 7fd21be00640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd1fc066500 0x7fd1fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.222+0000 7fd21be00640 1 -- 172.21.15.32:0/2535652303 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd21c11f4c0 con 0x7fd2240c2080 2024-01-19T04:16:17.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.222+0000 7fd223e00640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd1fc066500 0x7fd1fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.222+0000 7fd223e00640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd1fc066500 0x7fd1fc0689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd2140079c0 tx=0x7fd214008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.226+0000 7fd21be00640 1 -- 172.21.15.32:0/2535652303 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd21c0ec4c0 con 0x7fd2240c2080 2024-01-19T04:16:17.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2240749f0 con 0x7fd2240c2080 2024-01-19T04:16:17.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd21be00640 1 -- 172.21.15.32:0/2535652303 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd21c009510 con 0x7fd2240c2080 2024-01-19T04:16:17.387 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:17.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd1fc066500 msgr2=0x7fd1fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd1fc066500 0x7fd1fc0689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd2140079c0 tx=0x7fd214008040 comp rx=0 tx=0).stop 2024-01-19T04:16:17.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2240c2080 msgr2=0x7fd224155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2240c2080 0x7fd224155a20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd21c01af60 tx=0x7fd21c019650 comp rx=0 tx=0).stop 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 shutdown_connections 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd1fc066500 0x7fd1fc0689c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2240c2080 0x7fd224155a20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240723b0 0x7fd2241554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 --2- 172.21.15.32:0/2535652303 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd22406d440 0x7fd224151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 >> 172.21.15.32:0/2535652303 conn(0x7fd2240c25a0 msgr2=0x7fd2240beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 shutdown_connections 2024-01-19T04:16:17.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.386+0000 7fd22b000640 1 -- 172.21.15.32:0/2535652303 wait complete. 2024-01-19T04:16:17.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:16:17.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.550+0000 7f50c6800640 1 Processor -- start 2024-01-19T04:16:17.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.550+0000 7f50c6800640 1 -- start start 2024-01-19T04:16:17.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50c6800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f50c0151e10 0x7f50c00c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50c6800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50c0158620 0x7f50c00bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50c6800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c006be30 con 0x7f50c00bfde0 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50c6800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c01547c0 con 0x7f50c0151e10 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50c6800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c0158b20 con 0x7f50c0158620 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f50c0151e10 0x7f50c00c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bfe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f50c00bfde0 0x7f50c0154c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42008/0 (socket says 172.21.15.32:42008) 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f50c0151e10 0x7f50c00c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43502/0 (socket says 172.21.15.32:43502) 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bfe00640 1 -- 172.21.15.32:0/2849524192 learned_addr learned my addr 172.21.15.32:0/2849524192 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bea00640 1 --2- 172.21.15.32:0/2849524192 >> v2:172.21.15.67:3300/0 conn(0x7f50c0158620 0x7f50c00bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bf400640 1 -- 172.21.15.32:0/2849524192 >> v2:172.21.15.67:3300/0 conn(0x7f50c0158620 msgr2=0x7f50c00bf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bf400640 1 --2- 172.21.15.32:0/2849524192 >> v2:172.21.15.67:3300/0 conn(0x7f50c0158620 0x7f50c00bf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bf400640 1 -- 172.21.15.32:0/2849524192 >> v1:172.21.15.32:6789/0 conn(0x7f50c00bfde0 legacy=0x7f50c0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bf400640 1 -- 172.21.15.32:0/2849524192 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c006b870 con 0x7f50c0151e10 2024-01-19T04:16:17.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.554+0000 7f50bea00640 1 --2- 172.21.15.32:0/2849524192 >> v2:172.21.15.67:3300/0 conn(0x7f50c0158620 0x7f50c00bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50bf400640 1 --2- 172.21.15.32:0/2849524192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c0151e10 0x7f50c00c28d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f50c0066b90 tx=0x7f50b001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff95e0bb1356c101 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50be000640 1 -- 172.21.15.32:0/2849524192 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00ab600 con 0x7f50c0151e10 2024-01-19T04:16:17.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50be000640 1 -- 172.21.15.32:0/2849524192 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00a7050 con 0x7f50c0151e10 2024-01-19T04:16:17.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50be000640 1 -- 172.21.15.32:0/2849524192 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00ab980 con 0x7f50c0151e10 2024-01-19T04:16:17.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 -- 172.21.15.32:0/2849524192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c0151e10 msgr2=0x7f50c00c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 --2- 172.21.15.32:0/2849524192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c0151e10 0x7f50c00c28d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f50c0066b90 tx=0x7f50b001c3a0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 -- 172.21.15.32:0/2849524192 shutdown_connections 2024-01-19T04:16:17.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 --2- 172.21.15.32:0/2849524192 >> v2:172.21.15.67:3300/0 conn(0x7f50c0158620 0x7f50c00bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 --2- 172.21.15.32:0/2849524192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c0151e10 0x7f50c00c28d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 -- 172.21.15.32:0/2849524192 >> 172.21.15.32:0/2849524192 conn(0x7f50c00a8220 msgr2=0x7f50c00a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:17.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 -- 172.21.15.32:0/2849524192 shutdown_connections 2024-01-19T04:16:17.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 -- 172.21.15.32:0/2849524192 wait complete. 2024-01-19T04:16:17.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 Processor -- start 2024-01-19T04:16:17.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.558+0000 7f50c6800640 1 -- start start 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c00bfde0 0x7f50c0157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50c0151e10 0x7f50c01f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c0158620 0x7f50c01f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00707e0 con 0x7f50c00bfde0 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00ab730 con 0x7f50c0158620 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c014ded0 con 0x7f50c0151e10 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c00bfde0 0x7f50c0157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c00bfde0 0x7f50c0157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43504/0 (socket says 172.21.15.32:43504) 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 -- 172.21.15.32:0/3623859502 learned_addr learned my addr 172.21.15.32:0/3623859502 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bfe00640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c0158620 0x7f50c01f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bea00640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50c0151e10 0x7f50c01f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 -- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50c0151e10 msgr2=0x7f50c01f0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50c0151e10 0x7f50c01f0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 -- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c0158620 msgr2=0x7f50c01f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c0158620 0x7f50c01f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 -- 172.21.15.32:0/3623859502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009420 con 0x7f50c00bfde0 2024-01-19T04:16:17.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bfe00640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c0158620 0x7f50c01f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:17.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50bf400640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c00bfde0 0x7f50c0157310 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f50b0018fb0 tx=0x7f50b001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50b7400640 1 -- 172.21.15.32:0/3623859502 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00b7650 con 0x7f50c00bfde0 2024-01-19T04:16:17.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50b7400640 1 -- 172.21.15.32:0/3623859502 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00b77b0 con 0x7f50c00bfde0 2024-01-19T04:16:17.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50b7400640 1 -- 172.21.15.32:0/3623859502 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00b7b40 con 0x7f50c00bfde0 2024-01-19T04:16:17.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c0070a30 con 0x7f50c00bfde0 2024-01-19T04:16:17.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c014f810 con 0x7f50c00bfde0 2024-01-19T04:16:17.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.562+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c00749f0 con 0x7f50c00bfde0 2024-01-19T04:16:17.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.566+0000 7f50b7400640 1 -- 172.21.15.32:0/3623859502 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f50b00b7ca0 con 0x7f50c00bfde0 2024-01-19T04:16:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.566+0000 7f50b7400640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5098066500 0x7f50980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.566+0000 7f50b7400640 1 -- 172.21.15.32:0/3623859502 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f50b011ea30 con 0x7f50c00bfde0 2024-01-19T04:16:17.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.566+0000 7f50bea00640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5098066500 0x7f50980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.566+0000 7f50bea00640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5098066500 0x7f50980689c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50c0151710 tx=0x7f50a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.570+0000 7f50b7400640 1 -- 172.21.15.32:0/3623859502 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f50b00eba80 con 0x7f50c00bfde0 2024-01-19T04:16:17.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.726+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50c00ab870 con 0x7f50c00bfde0 2024-01-19T04:16:17.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.726+0000 7f50b7400640 1 -- 172.21.15.32:0/3623859502 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50b00bb0a0 con 0x7f50c00bfde0 2024-01-19T04:16:17.730 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5098066500 msgr2=0x7f50980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5098066500 0x7f50980689c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50c0151710 tx=0x7f50a8008040 comp rx=0 tx=0).stop 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c00bfde0 msgr2=0x7f50c0157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c00bfde0 0x7f50c0157310 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f50b0018fb0 tx=0x7f50b001abe0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 shutdown_connections 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5098066500 0x7f50980689c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c0158620 0x7f50c01f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f50c0151e10 0x7f50c01f0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 --2- 172.21.15.32:0/3623859502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50c00bfde0 0x7f50c0157310 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 >> 172.21.15.32:0/3623859502 conn(0x7f50c00a8220 msgr2=0x7f50c00a8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:17.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 shutdown_connections 2024-01-19T04:16:17.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.730+0000 7f50c6800640 1 -- 172.21.15.32:0/3623859502 wait complete. 2024-01-19T04:16:17.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:16:17.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf8a200640 1 Processor -- start 2024-01-19T04:16:17.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf8a200640 1 -- start start 2024-01-19T04:16:17.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf8a200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84072490 0x7fdf8406c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf8a200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf840bf360 0x7fdf840a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf8a200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf840beed0 con 0x7fdf84155520 2024-01-19T04:16:17.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf8a200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8406e0c0 con 0x7fdf840bf360 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf8a200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840c3a80 con 0x7fdf84072490 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf83e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf840bf360 0x7fdf840a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf83400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdf84155520 0x7fdf8406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58804/0 (socket says 172.21.15.32:58804) 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf83400640 1 -- 172.21.15.32:0/3606091353 learned_addr learned my addr 172.21.15.32:0/3606091353 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.894+0000 7fdf82a00640 1 --2- 172.21.15.32:0/3606091353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84072490 0x7fdf8406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf83e00640 1 -- 172.21.15.32:0/3606091353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84072490 msgr2=0x7fdf8406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf83e00640 1 --2- 172.21.15.32:0/3606091353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84072490 0x7fdf8406c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf83e00640 1 -- 172.21.15.32:0/3606091353 >> v1:172.21.15.32:6789/0 conn(0x7fdf84155520 legacy=0x7fdf8406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf83e00640 1 -- 172.21.15.32:0/3606091353 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf840c3d60 con 0x7fdf840bf360 2024-01-19T04:16:17.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf82a00640 1 --2- 172.21.15.32:0/3606091353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84072490 0x7fdf8406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:17.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf83e00640 1 --2- 172.21.15.32:0/3606091353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf840bf360 0x7fdf840a4d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009d90 tx=0x7fdf7c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903be350d6a487e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf82000640 1 -- 172.21.15.32:0/3606091353 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0a5870 con 0x7fdf840bf360 2024-01-19T04:16:17.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf82000640 1 -- 172.21.15.32:0/3606091353 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0a59d0 con 0x7fdf840bf360 2024-01-19T04:16:17.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf82000640 1 -- 172.21.15.32:0/3606091353 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0a5d60 con 0x7fdf840bf360 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf8a200640 1 -- 172.21.15.32:0/3606091353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf840bf360 msgr2=0x7fdf840a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.898+0000 7fdf8a200640 1 --2- 172.21.15.32:0/3606091353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf840bf360 0x7fdf840a4d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009d90 tx=0x7fdf7c01c8c0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- 172.21.15.32:0/3606091353 shutdown_connections 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 --2- 172.21.15.32:0/3606091353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf840bf360 0x7fdf840a4d10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 --2- 172.21.15.32:0/3606091353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84072490 0x7fdf8406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- 172.21.15.32:0/3606091353 >> 172.21.15.32:0/3606091353 conn(0x7fdf840c25a0 msgr2=0x7fdf840c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- 172.21.15.32:0/3606091353 shutdown_connections 2024-01-19T04:16:17.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- 172.21.15.32:0/3606091353 wait complete. 2024-01-19T04:16:17.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 Processor -- start 2024-01-19T04:16:17.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- start start 2024-01-19T04:16:17.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84072490 0x7fdf841509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf840bf360 0x7fdf84150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84155520 0x7fdf8414da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8414afe0 con 0x7fdf84072490 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84156510 con 0x7fdf840bf360 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf8a200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84151b60 con 0x7fdf84155520 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84072490 0x7fdf841509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84072490 0x7fdf841509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40120/0 (socket says 172.21.15.32:40120) 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 -- 172.21.15.32:0/722906897 learned_addr learned my addr 172.21.15.32:0/722906897 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf82a00640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf840bf360 0x7fdf84150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83e00640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84155520 0x7fdf8414da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 -- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84155520 msgr2=0x7fdf8414da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84155520 0x7fdf8414da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 -- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf840bf360 msgr2=0x7fdf84150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf840bf360 0x7fdf84150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:17.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.902+0000 7fdf83400640 1 -- 172.21.15.32:0/722906897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009a70 con 0x7fdf84072490 2024-01-19T04:16:17.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf83400640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84072490 0x7fdf841509f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c3a0 tx=0x7fdf7400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf7b400640 1 -- 172.21.15.32:0/722906897 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74005cf0 con 0x7fdf84072490 2024-01-19T04:16:17.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf7b400640 1 -- 172.21.15.32:0/722906897 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74005e50 con 0x7fdf84072490 2024-01-19T04:16:17.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf7b400640 1 -- 172.21.15.32:0/722906897 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf740072f0 con 0x7fdf84072490 2024-01-19T04:16:17.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8414bc40 con 0x7fdf84072490 2024-01-19T04:16:17.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8414c200 con 0x7fdf84072490 2024-01-19T04:16:17.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf840749f0 con 0x7fdf84072490 2024-01-19T04:16:17.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf7b400640 1 -- 172.21.15.32:0/722906897 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdf74007450 con 0x7fdf84072490 2024-01-19T04:16:17.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf7b400640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdf5c066530 0x7fdf5c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:17.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf7b400640 1 -- 172.21.15.32:0/722906897 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdf740836e0 con 0x7fdf84072490 2024-01-19T04:16:17.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.906+0000 7fdf82a00640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdf5c066530 0x7fdf5c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:17.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.910+0000 7fdf82a00640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdf5c066530 0x7fdf5c0689f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf840c2090 tx=0x7fdf6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:17.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:17.910+0000 7fdf7b400640 1 -- 172.21.15.32:0/722906897 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdf740506c0 con 0x7fdf84072490 2024-01-19T04:16:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.070+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf840c50e0 con 0x7fdf84072490 2024-01-19T04:16:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.070+0000 7fdf7b400640 1 -- 172.21.15.32:0/722906897 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7fdf74017020 con 0x7fdf84072490 2024-01-19T04:16:18.072 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:18.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdf5c066530 msgr2=0x7fdf5c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdf5c066530 0x7fdf5c0689f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf840c2090 tx=0x7fdf6c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84072490 msgr2=0x7fdf841509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84072490 0x7fdf841509f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c3a0 tx=0x7fdf7400c860 comp rx=0 tx=0).stop 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 shutdown_connections 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdf5c066530 0x7fdf5c0689f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf84155520 0x7fdf8414da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf840bf360 0x7fdf84150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 --2- 172.21.15.32:0/722906897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84072490 0x7fdf841509f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 >> 172.21.15.32:0/722906897 conn(0x7fdf840c25a0 msgr2=0x7fdf840c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 shutdown_connections 2024-01-19T04:16:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.074+0000 7fdf8a200640 1 -- 172.21.15.32:0/722906897 wait complete. 2024-01-19T04:16:18.094 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:16:18.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.234+0000 7fb3e2000640 1 Processor -- start 2024-01-19T04:16:18.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.234+0000 7fb3e2000640 1 -- start start 2024-01-19T04:16:18.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3e2000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 0x7fb3dc152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3e2000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc071510 con 0x7fb3dc152f50 2024-01-19T04:16:18.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3e2000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc06d830 con 0x7fb3dc06e540 2024-01-19T04:16:18.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3e2000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1533d0 con 0x7fb3dc072830 2024-01-19T04:16:18.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3dbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb3dc152f50 0x7fb3dc0719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58810/0 (socket says 172.21.15.32:58810) 2024-01-19T04:16:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3dbe00640 1 -- 172.21.15.32:0/3730410668 learned_addr learned my addr 172.21.15.32:0/3730410668 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3daa00640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 0x7fb3dc152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947768812 0 0) 0x7fb3dc071510 con 0x7fb3dc152f50 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3bc003530 con 0x7fb3dc152f50 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532990036 0 0) 0x7fb3dc06d830 con 0x7fb3dc06e540 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc071510 con 0x7fb3dc06e540 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2752002872 0 0) 0x7fb3bc003530 con 0x7fb3dc152f50 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 msgr2=0x7fb3dc152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 0x7fb3dc152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 >> v1:172.21.15.67:6789/0 conn(0x7fb3dc06e540 legacy=0x7fb3dc156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc06db10 con 0x7fb3dc152f50 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fb3d4001a00 con 0x7fb3dc152f50 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 >> v1:172.21.15.32:6789/0 conn(0x7fb3dc152f50 legacy=0x7fb3dc0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3bc003b40 0x7fb3bc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc0047d0 0x7fb3bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 0x7fb3bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc00ba40 con 0x7fb3bc003b40 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc00bb80 con 0x7fb3bc0047d0 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc00bd10 con 0x7fb3dc072830 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3db400640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3bc003b40 0x7fb3bc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3daa00640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc0047d0 0x7fb3bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3dbe00640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 0x7fb3bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3db400640 1 -- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 msgr2=0x7fb3bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:18.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3db400640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc072830 0x7fb3bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3db400640 1 -- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc0047d0 msgr2=0x7fb3bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3db400640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc0047d0 0x7fb3bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.238+0000 7fb3db400640 1 -- 172.21.15.32:0/3730410668 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc003530 con 0x7fb3bc003b40 2024-01-19T04:16:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3db400640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3bc003b40 0x7fb3bc003f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0018d0 tx=0x7fb3cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f1f51bc85f9d43 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc0052d0 con 0x7fb3bc003b40 2024-01-19T04:16:18.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc005450 con 0x7fb3bc003b40 2024-01-19T04:16:18.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3da000640 1 -- 172.21.15.32:0/3730410668 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc003840 con 0x7fb3bc003b40 2024-01-19T04:16:18.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3e2000640 1 -- 172.21.15.32:0/3730410668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3bc003b40 msgr2=0x7fb3bc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3e2000640 1 --2- 172.21.15.32:0/3730410668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3bc003b40 0x7fb3bc003f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0018d0 tx=0x7fb3cc01c4d0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3dbe00640 1 -- 172.21.15.32:0/3730410668 reap_dead start 2024-01-19T04:16:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3e2000640 1 -- 172.21.15.32:0/3730410668 shutdown_connections 2024-01-19T04:16:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3e2000640 1 -- 172.21.15.32:0/3730410668 >> 172.21.15.32:0/3730410668 conn(0x7fb3dc0a8220 msgr2=0x7fb3dc0a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3e2000640 1 -- 172.21.15.32:0/3730410668 shutdown_connections 2024-01-19T04:16:18.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.242+0000 7fb3e2000640 1 -- 172.21.15.32:0/3730410668 wait complete. 2024-01-19T04:16:18.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 Processor -- start 2024-01-19T04:16:18.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 -- start start 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc003b40 0x7fb3dc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc0c56f0 0x7fb3dc1ee730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc1eec70 0x7fb3dc14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1554d0 con 0x7fb3dc1eec70 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1ef120 con 0x7fb3bc003b40 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc153850 con 0x7fb3dc0c56f0 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc1eec70 0x7fb3dc14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc1eec70 0x7fb3dc14a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40128/0 (socket says 172.21.15.32:40128) 2024-01-19T04:16:18.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 -- 172.21.15.32:0/863869509 learned_addr learned my addr 172.21.15.32:0/863869509 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3daa00640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc0c56f0 0x7fb3dc1ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3db400640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc003b40 0x7fb3dc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 -- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc0c56f0 msgr2=0x7fb3dc1ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc0c56f0 0x7fb3dc1ee730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 -- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc003b40 msgr2=0x7fb3dc154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc003b40 0x7fb3dc154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 -- 172.21.15.32:0/863869509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc153b30 con 0x7fb3dc1eec70 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3dbe00640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc1eec70 0x7fb3dc14a6f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000f90 tx=0x7fb3d400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3d3400640 1 -- 172.21.15.32:0/863869509 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400ac60 con 0x7fb3dc1eec70 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3d3400640 1 -- 172.21.15.32:0/863869509 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400ade0 con 0x7fb3dc1eec70 2024-01-19T04:16:18.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3d3400640 1 -- 172.21.15.32:0/863869509 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4013630 con 0x7fb3dc1eec70 2024-01-19T04:16:18.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc153e10 con 0x7fb3dc1eec70 2024-01-19T04:16:18.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc1ee210 con 0x7fb3dc1eec70 2024-01-19T04:16:18.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.246+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0749f0 con 0x7fb3dc1eec70 2024-01-19T04:16:18.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.250+0000 7fb3d3400640 1 -- 172.21.15.32:0/863869509 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb3d4013790 con 0x7fb3dc1eec70 2024-01-19T04:16:18.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.250+0000 7fb3d3400640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3b4066530 0x7fb3b40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.250+0000 7fb3d3400640 1 -- 172.21.15.32:0/863869509 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb3d4084bc0 con 0x7fb3dc1eec70 2024-01-19T04:16:18.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.250+0000 7fb3db400640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3b4066530 0x7fb3b40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.250+0000 7fb3db400640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3b4066530 0x7fb3b40689f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0ad000 tx=0x7fb3cc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:18.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.254+0000 7fb3d3400640 1 -- 172.21.15.32:0/863869509 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb3d4051af0 con 0x7fb3dc1eec70 2024-01-19T04:16:18.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.410+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb3dc06bc30 con 0x7fb3dc1eec70 2024-01-19T04:16:18.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3d3400640 1 -- 172.21.15.32:0/863869509 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb3d4017070 con 0x7fb3dc1eec70 2024-01-19T04:16:18.414 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:18.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3b4066530 msgr2=0x7fb3b40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3b4066530 0x7fb3b40689f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0ad000 tx=0x7fb3cc0a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:18.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc1eec70 msgr2=0x7fb3dc14a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc1eec70 0x7fb3dc14a6f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000f90 tx=0x7fb3d400a660 comp rx=0 tx=0).stop 2024-01-19T04:16:18.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 shutdown_connections 2024-01-19T04:16:18.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3b4066530 0x7fb3b40689f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3dc1eec70 0x7fb3dc14a6f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3dc0c56f0 0x7fb3dc1ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 --2- 172.21.15.32:0/863869509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3bc003b40 0x7fb3dc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 >> 172.21.15.32:0/863869509 conn(0x7fb3dc0a8220 msgr2=0x7fb3dc156460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:18.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 shutdown_connections 2024-01-19T04:16:18.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.414+0000 7fb3e2000640 1 -- 172.21.15.32:0/863869509 wait complete. 2024-01-19T04:16:18.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:16:18.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f845ec00640 1 Processor -- start 2024-01-19T04:16:18.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f845ec00640 1 -- start start 2024-01-19T04:16:18.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f845ec00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8458147f90 0x7f8458151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f845ec00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f84580c55e0 0x7f84580c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f845ec00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84580c0810 con 0x7f845806beb0 2024-01-19T04:16:18.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f845ec00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84580c1df0 con 0x7f84580c55e0 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f845ec00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84580c0af0 con 0x7f8458147f90 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f84580c55e0 0x7f84580c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f84580c55e0 0x7f84580c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40134/0 (socket says 172.21.15.32:40134) 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457400640 1 -- 172.21.15.32:0/4027921165 learned_addr learned my addr 172.21.15.32:0/4027921165 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457e00640 1 --2- 172.21.15.32:0/4027921165 >> v2:172.21.15.67:3300/0 conn(0x7f8458147f90 0x7f8458151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457400640 1 -- 172.21.15.32:0/4027921165 >> v2:172.21.15.67:3300/0 conn(0x7f8458147f90 msgr2=0x7f8458151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457400640 1 --2- 172.21.15.32:0/4027921165 >> v2:172.21.15.67:3300/0 conn(0x7f8458147f90 0x7f8458151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457400640 1 -- 172.21.15.32:0/4027921165 >> v1:172.21.15.67:6789/0 conn(0x7f845806beb0 legacy=0x7f84580a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.578+0000 7f8457400640 1 -- 172.21.15.32:0/4027921165 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580c0dd0 con 0x7f84580c55e0 2024-01-19T04:16:18.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f8457400640 1 --2- 172.21.15.32:0/4027921165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84580c55e0 0x7f84580c18b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f845806f5f0 tx=0x7f844001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb69ec71c0a030eb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:18.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f8456a00640 1 -- 172.21.15.32:0/4027921165 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400ab640 con 0x7f84580c55e0 2024-01-19T04:16:18.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f8456a00640 1 -- 172.21.15.32:0/4027921165 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84400a7070 con 0x7f84580c55e0 2024-01-19T04:16:18.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f8456a00640 1 -- 172.21.15.32:0/4027921165 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400ab9c0 con 0x7f84580c55e0 2024-01-19T04:16:18.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 -- 172.21.15.32:0/4027921165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84580c55e0 msgr2=0x7f84580c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 --2- 172.21.15.32:0/4027921165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84580c55e0 0x7f84580c18b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f845806f5f0 tx=0x7f844001c440 comp rx=0 tx=0).stop 2024-01-19T04:16:18.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 -- 172.21.15.32:0/4027921165 shutdown_connections 2024-01-19T04:16:18.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 --2- 172.21.15.32:0/4027921165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84580c55e0 0x7f84580c18b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 --2- 172.21.15.32:0/4027921165 >> v2:172.21.15.67:3300/0 conn(0x7f8458147f90 0x7f8458151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 -- 172.21.15.32:0/4027921165 >> 172.21.15.32:0/4027921165 conn(0x7f84580c5b20 msgr2=0x7f84580c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:18.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 -- 172.21.15.32:0/4027921165 shutdown_connections 2024-01-19T04:16:18.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.582+0000 7f845ec00640 1 -- 172.21.15.32:0/4027921165 wait complete. 2024-01-19T04:16:18.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 Processor -- start 2024-01-19T04:16:18.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 -- start start 2024-01-19T04:16:18.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f845806beb0 0x7f84580a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84580c55e0 0x7f84580bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8458147f90 0x7f8458146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84581530c0 con 0x7f845806beb0 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458148940 con 0x7f84580c55e0 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84580a9f70 con 0x7f8458147f90 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f845806beb0 0x7f84580a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f845806beb0 0x7f84580a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40148/0 (socket says 172.21.15.32:40148) 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 -- 172.21.15.32:0/3411824804 learned_addr learned my addr 172.21.15.32:0/3411824804 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845cc00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8458147f90 0x7f8458146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457400640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84580c55e0 0x7f84580bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 -- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8458147f90 msgr2=0x7f8458146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8458147f90 0x7f8458146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 -- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84580c55e0 msgr2=0x7f84580bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84580c55e0 0x7f84580bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 -- 172.21.15.32:0/3411824804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400094d0 con 0x7f845806beb0 2024-01-19T04:16:18.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f8457e00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f845806beb0 0x7f84580a9990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f844800d5f0 tx=0x7f844800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:18.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f844fe00640 1 -- 172.21.15.32:0/3411824804 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84480125f0 con 0x7f845806beb0 2024-01-19T04:16:18.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f844fe00640 1 -- 172.21.15.32:0/3411824804 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448012750 con 0x7f845806beb0 2024-01-19T04:16:18.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f844fe00640 1 -- 172.21.15.32:0/3411824804 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448012b00 con 0x7f845806beb0 2024-01-19T04:16:18.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84580aa250 con 0x7f845806beb0 2024-01-19T04:16:18.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.586+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84580aa810 con 0x7f845806beb0 2024-01-19T04:16:18.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.590+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84580749f0 con 0x7f845806beb0 2024-01-19T04:16:18.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.590+0000 7f844fe00640 1 -- 172.21.15.32:0/3411824804 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8448012c60 con 0x7f845806beb0 2024-01-19T04:16:18.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.590+0000 7f844fe00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8430066500 0x7f84300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:18.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.590+0000 7f844fe00640 1 -- 172.21.15.32:0/3411824804 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f84480845b0 con 0x7f845806beb0 2024-01-19T04:16:18.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.590+0000 7f8457400640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8430066500 0x7f84300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:18.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.590+0000 7f8457400640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8430066500 0x7f84300689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84400af000 tx=0x7f84400b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:18.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.594+0000 7f844fe00640 1 -- 172.21.15.32:0/3411824804 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8448051590 con 0x7f845806beb0 2024-01-19T04:16:18.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f84580c21d0 con 0x7f845806beb0 2024-01-19T04:16:18.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f844fe00640 1 -- 172.21.15.32:0/3411824804 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8448054bb0 con 0x7f845806beb0 2024-01-19T04:16:18.768 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8430066500 msgr2=0x7f84300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8430066500 0x7f84300689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84400af000 tx=0x7f84400b6040 comp rx=0 tx=0).stop 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f845806beb0 msgr2=0x7f84580a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f845806beb0 0x7f84580a9990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f844800d5f0 tx=0x7f844800dab0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 shutdown_connections 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8430066500 0x7f84300689c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8458147f90 0x7f8458146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84580c55e0 0x7f84580bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.766+0000 7f845ec00640 1 --2- 172.21.15.32:0/3411824804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f845806beb0 0x7f84580a9990 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.770+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 >> 172.21.15.32:0/3411824804 conn(0x7f84580c5b20 msgr2=0x7f84580a6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.770+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 shutdown_connections 2024-01-19T04:16:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:18.770+0000 7f845ec00640 1 -- 172.21.15.32:0/3411824804 wait complete. 2024-01-19T04:16:18.790 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-19T04:16:18.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:18.790 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:18.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:16:18.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:18.821 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:16:18.874 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:18.874 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:18.925 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:16:18.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:16:19.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa576400640 1 Processor -- start 2024-01-19T04:16:19.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa576400640 1 -- start start 2024-01-19T04:16:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa576400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5700c55e0 0x7fa570151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa576400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5700c18b0 0x7fa5700a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa576400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5700c1d40 con 0x7fa570147f90 2024-01-19T04:16:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa576400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57006c5c0 con 0x7fa5700c55e0 2024-01-19T04:16:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa576400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700c0810 con 0x7fa5700c18b0 2024-01-19T04:16:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5700c55e0 0x7fa570151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa570147f90 0x7fa57006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58824/0 (socket says 172.21.15.32:58824) 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5700c55e0 0x7fa570151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40152/0 (socket says 172.21.15.32:40152) 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56f400640 1 -- 172.21.15.32:0/81020608 learned_addr learned my addr 172.21.15.32:0/81020608 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56fe00640 1 --2- 172.21.15.32:0/81020608 >> v2:172.21.15.67:3300/0 conn(0x7fa5700c18b0 0x7fa5700a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56ea00640 1 -- 172.21.15.32:0/81020608 >> v2:172.21.15.67:3300/0 conn(0x7fa5700c18b0 msgr2=0x7fa5700a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56ea00640 1 --2- 172.21.15.32:0/81020608 >> v2:172.21.15.67:3300/0 conn(0x7fa5700c18b0 0x7fa5700a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56ea00640 1 -- 172.21.15.32:0/81020608 >> v1:172.21.15.32:6789/0 conn(0x7fa570147f90 legacy=0x7fa57006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56ea00640 1 -- 172.21.15.32:0/81020608 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700c0af0 con 0x7fa5700c55e0 2024-01-19T04:16:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.066+0000 7fa56fe00640 1 --2- 172.21.15.32:0/81020608 >> v2:172.21.15.67:3300/0 conn(0x7fa5700c18b0 0x7fa5700a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:19.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa56ea00640 1 --2- 172.21.15.32:0/81020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c55e0 0x7fa570151350 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa570072ed0 tx=0x7fa55801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e344ec2bf85eec server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:19.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa56e000640 1 -- 172.21.15.32:0/81020608 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580ac600 con 0x7fa5700c55e0 2024-01-19T04:16:19.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa56e000640 1 -- 172.21.15.32:0/81020608 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5580a8050 con 0x7fa5700c55e0 2024-01-19T04:16:19.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa56e000640 1 -- 172.21.15.32:0/81020608 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580ac980 con 0x7fa5700c55e0 2024-01-19T04:16:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 -- 172.21.15.32:0/81020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c55e0 msgr2=0x7fa570151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 --2- 172.21.15.32:0/81020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c55e0 0x7fa570151350 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa570072ed0 tx=0x7fa55801c3a0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 -- 172.21.15.32:0/81020608 shutdown_connections 2024-01-19T04:16:19.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 --2- 172.21.15.32:0/81020608 >> v2:172.21.15.67:3300/0 conn(0x7fa5700c18b0 0x7fa5700a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 --2- 172.21.15.32:0/81020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c55e0 0x7fa570151350 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 -- 172.21.15.32:0/81020608 >> 172.21.15.32:0/81020608 conn(0x7fa5700c5b20 msgr2=0x7fa5700c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:19.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 -- 172.21.15.32:0/81020608 shutdown_connections 2024-01-19T04:16:19.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.070+0000 7fa576400640 1 -- 172.21.15.32:0/81020608 wait complete. 2024-01-19T04:16:19.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 Processor -- start 2024-01-19T04:16:19.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 -- start start 2024-01-19T04:16:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c18b0 0x7fa5701eec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5700c55e0 0x7fa5700aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa570147f90 0x7fa5701eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570153040 con 0x7fa5700c18b0 2024-01-19T04:16:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5701ef1b0 con 0x7fa570147f90 2024-01-19T04:16:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa570148590 con 0x7fa5700c55e0 2024-01-19T04:16:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c18b0 0x7fa5701eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c18b0 0x7fa5701eec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40158/0 (socket says 172.21.15.32:40158) 2024-01-19T04:16:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 -- 172.21.15.32:0/3938008514 learned_addr learned my addr 172.21.15.32:0/3938008514 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56fe00640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa570147f90 0x7fa5701eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56ea00640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5700c55e0 0x7fa5700aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 -- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5700c55e0 msgr2=0x7fa5700aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5700c55e0 0x7fa5700aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 -- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa570147f90 msgr2=0x7fa5701eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa570147f90 0x7fa5701eb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 -- 172.21.15.32:0/3938008514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558009420 con 0x7fa5700c18b0 2024-01-19T04:16:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56fe00640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa570147f90 0x7fa5701eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa56f400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c18b0 0x7fa5701eec70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c3d0 tx=0x7fa56000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa567400640 1 -- 172.21.15.32:0/3938008514 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560005cf0 con 0x7fa5700c18b0 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa567400640 1 -- 172.21.15.32:0/3938008514 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa560005e50 con 0x7fa5700c18b0 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5701527a0 con 0x7fa5700c18b0 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa567400640 1 -- 172.21.15.32:0/3938008514 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600072f0 con 0x7fa5700c18b0 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa570152d60 con 0x7fa5700c18b0 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.074+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5700749f0 con 0x7fa5700c18b0 2024-01-19T04:16:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.078+0000 7fa567400640 1 -- 172.21.15.32:0/3938008514 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa560007450 con 0x7fa5700c18b0 2024-01-19T04:16:19.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.078+0000 7fa567400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa548066500 0x7fa5480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:19.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.078+0000 7fa567400640 1 -- 172.21.15.32:0/3938008514 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5600837c0 con 0x7fa5700c18b0 2024-01-19T04:16:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.078+0000 7fa56ea00640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa548066500 0x7fa5480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.078+0000 7fa56ea00640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa548066500 0x7fa5480689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ae000 tx=0x7fa5580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.082+0000 7fa567400640 1 -- 172.21.15.32:0/3938008514 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa560050660 con 0x7fa5700c18b0 2024-01-19T04:16:19.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.274+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5700c21d0 con 0x7fa5700c18b0 2024-01-19T04:16:19.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.274+0000 7fa567400640 1 -- 172.21.15.32:0/3938008514 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa5600170b0 con 0x7fa5700c18b0 2024-01-19T04:16:19.276 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:16:19.276 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-19T04:16:19.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa548066500 msgr2=0x7fa5480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa548066500 0x7fa5480689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ae000 tx=0x7fa5580a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c18b0 msgr2=0x7fa5701eec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c18b0 0x7fa5701eec70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c3d0 tx=0x7fa56000c890 comp rx=0 tx=0).stop 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 shutdown_connections 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa548066500 0x7fa5480689c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa570147f90 0x7fa5701eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa5700c55e0 0x7fa5700aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 --2- 172.21.15.32:0/3938008514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5700c18b0 0x7fa5701eec70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 >> 172.21.15.32:0/3938008514 conn(0x7fa5700c5b20 msgr2=0x7fa5700a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 shutdown_connections 2024-01-19T04:16:19.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:19.278+0000 7fa576400640 1 -- 172.21.15.32:0/3938008514 wait complete. 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:16:19.298 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:19.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.299 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42387sec preferred_lft 42387sec 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:16:19.310 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:19.311 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:16:19.311 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:19.311 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:16:19.311 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:16:19.311 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:16:19.311 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:19.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.312 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:16:19.373 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:16:19.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.375 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:16:19.427 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:16:19.427 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:16:19.427 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:16:19.427 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:16:19.427 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:16:19.427 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:16:19.428 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:19.428 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:19.428 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:19.428 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:16:19.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.428 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:16:19.428 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:16:19.428 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:16:19.428 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:16:19.428 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:16:19.428 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:16:19.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.523 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:16:19.533 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:16:19.533 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:19.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:16:19.596 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:19.597 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:19.652 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:19.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:19.653 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:19.709 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2024-01-19T04:16:19.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.709 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:19.804 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:19.804 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:19.817 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:19.817 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:19.817 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:16:19.817 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs2=/ 2024-01-19T04:16:19.817 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:16:19.821 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:16:19.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.821 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:19.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:19.843 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:16:19.904 INFO:teuthology.orchestra.run.smithi067.stdout:client5344 2024-01-19T04:16:19.905 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:19.905 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:19.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2024-01-19T04:16:20.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabd0400640 1 Processor -- start 2024-01-19T04:16:20.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabd0400640 1 -- start start 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabd0400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fabc81549a0 0x7fabc8154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabd0400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fabc806c220 0x7fabc80c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabd0400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80c5380 con 0x7fabc80c5750 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabd0400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80c20e0 con 0x7fabc81549a0 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabd0400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc8155930 con 0x7fabc806c220 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcda00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fabc81549a0 0x7fabc8154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcda00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fabc81549a0 0x7fabc8154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40160/0 (socket says 172.21.15.32:40160) 2024-01-19T04:16:20.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcda00640 1 -- 172.21.15.32:0/1737412340 learned_addr learned my addr 172.21.15.32:0/1737412340 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:20.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcd000640 1 --2- 172.21.15.32:0/1737412340 >> v2:172.21.15.67:3300/0 conn(0x7fabc806c220 0x7fabc80c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcda00640 1 -- 172.21.15.32:0/1737412340 >> v2:172.21.15.67:3300/0 conn(0x7fabc806c220 msgr2=0x7fabc80c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:20.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcda00640 1 --2- 172.21.15.32:0/1737412340 >> v2:172.21.15.67:3300/0 conn(0x7fabc806c220 0x7fabc80c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcda00640 1 -- 172.21.15.32:0/1737412340 >> v1:172.21.15.32:6789/0 conn(0x7fabc80c5750 legacy=0x7fabc80c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabc7e00640 1 -- 172.21.15.32:0/1737412340 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415888590 0 0) 0x7fabc80c5380 con 0x7fabc80c5750 2024-01-19T04:16:20.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.106+0000 7fabcda00640 1 -- 172.21.15.32:0/1737412340 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80a4e90 con 0x7fabc81549a0 2024-01-19T04:16:20.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabcda00640 1 --2- 172.21.15.32:0/1737412340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc81549a0 0x7fabc8154d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabc806f790 tx=0x7fabb801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be96c6963f3a0de server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:20.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabc7e00640 1 -- 172.21.15.32:0/1737412340 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80aa5f0 con 0x7fabc81549a0 2024-01-19T04:16:20.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabc7e00640 1 -- 172.21.15.32:0/1737412340 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80aa750 con 0x7fabc81549a0 2024-01-19T04:16:20.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabc7e00640 1 -- 172.21.15.32:0/1737412340 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80aaae0 con 0x7fabc81549a0 2024-01-19T04:16:20.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 -- 172.21.15.32:0/1737412340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc81549a0 msgr2=0x7fabc8154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 --2- 172.21.15.32:0/1737412340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc81549a0 0x7fabc8154d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fabc806f790 tx=0x7fabb801c470 comp rx=0 tx=0).stop 2024-01-19T04:16:20.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 -- 172.21.15.32:0/1737412340 shutdown_connections 2024-01-19T04:16:20.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 --2- 172.21.15.32:0/1737412340 >> v2:172.21.15.67:3300/0 conn(0x7fabc806c220 0x7fabc80c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 --2- 172.21.15.32:0/1737412340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc81549a0 0x7fabc8154d80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 -- 172.21.15.32:0/1737412340 >> 172.21.15.32:0/1737412340 conn(0x7fabc80c5b40 msgr2=0x7fabc80c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:20.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 -- 172.21.15.32:0/1737412340 shutdown_connections 2024-01-19T04:16:20.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.110+0000 7fabd0400640 1 -- 172.21.15.32:0/1737412340 wait complete. 2024-01-19T04:16:20.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 Processor -- start 2024-01-19T04:16:20.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 -- start start 2024-01-19T04:16:20.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabc806c220 0x7fabc8071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81549a0 0x7fabc8143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc80a7400 0x7fabc81441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8154280 con 0x7fabc80a7400 2024-01-19T04:16:20.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc814b6b0 con 0x7fabc81549a0 2024-01-19T04:16:20.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8144720 con 0x7fabc806c220 2024-01-19T04:16:20.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc80a7400 0x7fabc81441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc80a7400 0x7fabc81441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40168/0 (socket says 172.21.15.32:40168) 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 -- 172.21.15.32:0/372158931 learned_addr learned my addr 172.21.15.32:0/372158931 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabcd000640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81549a0 0x7fabc8143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabcda00640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabc806c220 0x7fabc8071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 -- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabc806c220 msgr2=0x7fabc8071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabc806c220 0x7fabc8071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 -- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81549a0 msgr2=0x7fabc8143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81549a0 0x7fabc8143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 -- 172.21.15.32:0/372158931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80094d0 con 0x7fabc80a7400 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabcd000640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81549a0 0x7fabc8143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabce400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc80a7400 0x7fabc81441e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fabc000c780 tx=0x7fabc000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabc5600640 1 -- 172.21.15.32:0/372158931 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0003db0 con 0x7fabc80a7400 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabc5600640 1 -- 172.21.15.32:0/372158931 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc000ce90 con 0x7fabc80a7400 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc814b410 con 0x7fabc80a7400 2024-01-19T04:16:20.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabc5600640 1 -- 172.21.15.32:0/372158931 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00052b0 con 0x7fabc80a7400 2024-01-19T04:16:20.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.114+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc815d130 con 0x7fabc80a7400 2024-01-19T04:16:20.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.118+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc804e980 con 0x7fabc80a7400 2024-01-19T04:16:20.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.118+0000 7fabc5600640 1 -- 172.21.15.32:0/372158931 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fabc0005410 con 0x7fabc80a7400 2024-01-19T04:16:20.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.118+0000 7fabc5600640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faba0066500 0x7faba00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.118+0000 7fabc5600640 1 -- 172.21.15.32:0/372158931 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fabc0083fc0 con 0x7fabc80a7400 2024-01-19T04:16:20.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.118+0000 7fabcda00640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faba0066500 0x7faba00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.118+0000 7fabcda00640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faba0066500 0x7faba00689c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ae000 tx=0x7fabb80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:20.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.122+0000 7fabc5600640 1 -- 172.21.15.32:0/372158931 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fabc00b54d0 con 0x7fabc80a7400 2024-01-19T04:16:20.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.318+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7fabc80a4c70 con 0x7fabc80a7400 2024-01-19T04:16:20.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.318+0000 7fabc5600640 1 -- 172.21.15.32:0/372158931 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7fabc0050f90 con 0x7fabc80a7400 2024-01-19T04:16:20.322 INFO:teuthology.orchestra.run.smithi032.stdout:[client.testuser] 2024-01-19T04:16:20.322 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCU96llK+obExAA1V1N7PpjHeA4khEv+p/tTg== 2024-01-19T04:16:20.322 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow rw fsname=cephfs" 2024-01-19T04:16:20.322 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r fsname=cephfs" 2024-01-19T04:16:20.322 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-19T04:16:20.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faba0066500 msgr2=0x7faba00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faba0066500 0x7faba00689c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ae000 tx=0x7fabb80a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc80a7400 msgr2=0x7fabc81441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc80a7400 0x7fabc81441e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fabc000c780 tx=0x7fabc000cc40 comp rx=0 tx=0).stop 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 shutdown_connections 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faba0066500 0x7faba00689c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabc80a7400 0x7fabc81441e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81549a0 0x7fabc8143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 --2- 172.21.15.32:0/372158931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabc806c220 0x7fabc8071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 >> 172.21.15.32:0/372158931 conn(0x7fabc80c5b40 msgr2=0x7fabc806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 shutdown_connections 2024-01-19T04:16:20.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.322+0000 7fabd0400640 1 -- 172.21.15.32:0/372158931 wait complete. 2024-01-19T04:16:20.344 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-01-19T04:16:20.353 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.sH4SEIJA1p 2024-01-19T04:16:20.353 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:20.353 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/tmp/tmp.sH4SEIJA1p 2024-01-19T04:16:20.401 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:20.401 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:20.454 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:20.454 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:20.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fddc00640 1 Processor -- start 2024-01-19T04:16:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fddc00640 1 -- start start 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fddc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4fd80c04a0 0x7f4fd80c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fddc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4fd80a4ec0 0x7f4fd80c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fddc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd8071e80 con 0x7f4fd814fb50 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fddc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd81535c0 con 0x7f4fd80c04a0 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fddc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80726c0 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4fd80c04a0 0x7f4fd80c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd6a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4fd814fb50 0x7f4fd806fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58846/0 (socket says 172.21.15.32:58846) 2024-01-19T04:16:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd6a00640 1 -- 172.21.15.32:0/1375750835 learned_addr learned my addr 172.21.15.32:0/1375750835 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd7400640 1 --2- 172.21.15.32:0/1375750835 >> v2:172.21.15.67:3300/0 conn(0x7f4fd80a4ec0 0x7f4fd80c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd5600640 1 -- 172.21.15.32:0/1375750835 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594218876 0 0) 0x7f4fd8071e80 con 0x7f4fd814fb50 2024-01-19T04:16:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd5600640 1 -- 172.21.15.32:0/1375750835 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb8003530 con 0x7f4fd814fb50 2024-01-19T04:16:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd6000640 1 -- 172.21.15.32:0/1375750835 >> v2:172.21.15.67:3300/0 conn(0x7f4fd80a4ec0 msgr2=0x7f4fd80c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd6000640 1 --2- 172.21.15.32:0/1375750835 >> v2:172.21.15.67:3300/0 conn(0x7f4fd80a4ec0 0x7f4fd80c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd6000640 1 -- 172.21.15.32:0/1375750835 >> v1:172.21.15.32:6789/0 conn(0x7f4fd814fb50 legacy=0x7f4fd806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd6000640 1 -- 172.21.15.32:0/1375750835 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80c1cb0 con 0x7f4fd80c04a0 2024-01-19T04:16:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.690+0000 7f4fd7400640 1 --2- 172.21.15.32:0/1375750835 >> v2:172.21.15.67:3300/0 conn(0x7f4fd80a4ec0 0x7f4fd80c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fd6000640 1 --2- 172.21.15.32:0/1375750835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80c04a0 0x7f4fd80c1230 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8072ef0 tx=0x7f4fc001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58466c2f8db8f560 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fd5600640 1 -- 172.21.15.32:0/1375750835 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00ab600 con 0x7f4fd80c04a0 2024-01-19T04:16:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fd5600640 1 -- 172.21.15.32:0/1375750835 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc00a7050 con 0x7f4fd80c04a0 2024-01-19T04:16:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fd5600640 1 -- 172.21.15.32:0/1375750835 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00ab980 con 0x7f4fd80c04a0 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 -- 172.21.15.32:0/1375750835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80c04a0 msgr2=0x7f4fd80c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1375750835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80c04a0 0x7f4fd80c1230 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8072ef0 tx=0x7f4fc001c3d0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 -- 172.21.15.32:0/1375750835 shutdown_connections 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1375750835 >> v2:172.21.15.67:3300/0 conn(0x7f4fd80a4ec0 0x7f4fd80c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1375750835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80c04a0 0x7f4fd80c1230 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 -- 172.21.15.32:0/1375750835 >> 172.21.15.32:0/1375750835 conn(0x7f4fd80c5b20 msgr2=0x7f4fd80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 -- 172.21.15.32:0/1375750835 shutdown_connections 2024-01-19T04:16:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.694+0000 7f4fddc00640 1 -- 172.21.15.32:0/1375750835 wait complete. 2024-01-19T04:16:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 Processor -- start 2024-01-19T04:16:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 -- start start 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80a4ec0 0x7f4fd814e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fd80c04a0 0x7f4fd80a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd814fb50 0x7f4fd8154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8156650 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8155e40 con 0x7f4fd814fb50 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8154870 con 0x7f4fd80c04a0 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80a4ec0 0x7f4fd814e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80a4ec0 0x7f4fd814e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40176/0 (socket says 172.21.15.32:40176) 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 -- 172.21.15.32:0/1398062849 learned_addr learned my addr 172.21.15.32:0/1398062849 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6000640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fd80c04a0 0x7f4fd80a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd7400640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd814fb50 0x7f4fd8154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 -- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fd80c04a0 msgr2=0x7f4fd80a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fd80c04a0 0x7f4fd80a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 -- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd814fb50 msgr2=0x7f4fd8154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd814fb50 0x7f4fd8154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 -- 172.21.15.32:0/1398062849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009420 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fd6a00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80a4ec0 0x7f4fd814e490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c3f0 tx=0x7f4fc800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fcea00640 1 -- 172.21.15.32:0/1398062849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8005cf0 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fcea00640 1 -- 172.21.15.32:0/1398062849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc8005e50 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fcea00640 1 -- 172.21.15.32:0/1398062849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80072f0 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd80a93b0 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.698+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd8156370 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.702+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd80749f0 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.702+0000 7f4fcea00640 1 -- 172.21.15.32:0/1398062849 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4fc8007450 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.702+0000 7f4fcea00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fb0066500 0x7f4fb00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:20.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.702+0000 7f4fcea00640 1 -- 172.21.15.32:0/1398062849 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4fc8083730 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.702+0000 7f4fd6000640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fb0066500 0x7f4fb00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:20.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.702+0000 7f4fd6000640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fb0066500 0x7f4fb00689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00ad000 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:20.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.706+0000 7f4fcea00640 1 -- 172.21.15.32:0/1398062849 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4fc8050710 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.866+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fd80c56e0 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fcea00640 1 -- 172.21.15.32:0/1398062849 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20134 (secure 0 0 0) 0x7f4fc8053d30 con 0x7f4fd80a4ec0 2024-01-19T04:16:20.871 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:20.871 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:07.630852+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fb0066500 msgr2=0x7f4fb00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fb0066500 0x7f4fb00689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00ad000 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80a4ec0 msgr2=0x7f4fd814e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80a4ec0 0x7f4fd814e490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c3f0 tx=0x7f4fc800c8b0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 shutdown_connections 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fb0066500 0x7f4fb00689c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd814fb50 0x7f4fd8154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4fd80c04a0 0x7f4fd80a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 --2- 172.21.15.32:0/1398062849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd80a4ec0 0x7f4fd814e490 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:20.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.870+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 >> 172.21.15.32:0/1398062849 conn(0x7f4fd80c5b20 msgr2=0x7f4fd80a6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:20.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.874+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 shutdown_connections 2024-01-19T04:16:20.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:20.874+0000 7f4fddc00640 1 -- 172.21.15.32:0/1398062849 wait complete. 2024-01-19T04:16:20.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:15:46.886973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:48.025571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:16:04.715304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:16:05.165871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:20.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:21.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b13000640 1 Processor -- start 2024-01-19T04:16:21.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b13000640 1 -- start start 2024-01-19T04:16:21.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b13000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9b0c0c7260 0x7f9b0c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b13000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b0c06fdb0 0x7f9b0c070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b13000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0c0a7660 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b13000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c06ecd0 con 0x7f9b0c06fdb0 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b13000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c153490 con 0x7f9b0c0c7260 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b0c06fdb0 0x7f9b0c070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b0c06fdb0 0x7f9b0c070220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40190/0 (socket says 172.21.15.32:40190) 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0b400640 1 -- 172.21.15.32:0/3944826734 learned_addr learned my addr 172.21.15.32:0/3944826734 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0be00640 1 --2- 172.21.15.32:0/3944826734 >> v2:172.21.15.67:3300/0 conn(0x7f9b0c0c7260 0x7f9b0c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0b400640 1 -- 172.21.15.32:0/3944826734 >> v2:172.21.15.67:3300/0 conn(0x7f9b0c0c7260 msgr2=0x7f9b0c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0b400640 1 --2- 172.21.15.32:0/3944826734 >> v2:172.21.15.67:3300/0 conn(0x7f9b0c0c7260 0x7f9b0c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0b400640 1 -- 172.21.15.32:0/3944826734 >> v1:172.21.15.67:6789/0 conn(0x7f9b0c0c27f0 legacy=0x7f9b0c0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.038+0000 7f9b0b400640 1 -- 172.21.15.32:0/3944826734 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c0c4200 con 0x7f9b0c06fdb0 2024-01-19T04:16:21.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b0b400640 1 --2- 172.21.15.32:0/3944826734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c06fdb0 0x7f9b0c070220 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0c5850 tx=0x7f9af401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa01b99b267e0c08 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b0aa00640 1 -- 172.21.15.32:0/3944826734 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40aa5f0 con 0x7f9b0c06fdb0 2024-01-19T04:16:21.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b0aa00640 1 -- 172.21.15.32:0/3944826734 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af40aa750 con 0x7f9b0c06fdb0 2024-01-19T04:16:21.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b0aa00640 1 -- 172.21.15.32:0/3944826734 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40aaae0 con 0x7f9b0c06fdb0 2024-01-19T04:16:21.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 -- 172.21.15.32:0/3944826734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c06fdb0 msgr2=0x7f9b0c070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 --2- 172.21.15.32:0/3944826734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c06fdb0 0x7f9b0c070220 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0c5850 tx=0x7f9af401c490 comp rx=0 tx=0).stop 2024-01-19T04:16:21.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 -- 172.21.15.32:0/3944826734 shutdown_connections 2024-01-19T04:16:21.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 --2- 172.21.15.32:0/3944826734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c06fdb0 0x7f9b0c070220 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 --2- 172.21.15.32:0/3944826734 >> v2:172.21.15.67:3300/0 conn(0x7f9b0c0c7260 0x7f9b0c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 -- 172.21.15.32:0/3944826734 >> 172.21.15.32:0/3944826734 conn(0x7f9b0c0c7d00 msgr2=0x7f9b0c0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:21.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 -- 172.21.15.32:0/3944826734 shutdown_connections 2024-01-19T04:16:21.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.042+0000 7f9b13000640 1 -- 172.21.15.32:0/3944826734 wait complete. 2024-01-19T04:16:21.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 Processor -- start 2024-01-19T04:16:21.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 -- start start 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b0c06fdb0 0x7f9b0c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c0c27f0 0x7f9b0c13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b0c0c7260 0x7f9b0c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c151d30 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c152010 con 0x7f9b0c06fdb0 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c0abba0 con 0x7f9b0c0c7260 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c0c27f0 0x7f9b0c13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c0c27f0 0x7f9b0c13dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40202/0 (socket says 172.21.15.32:40202) 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 -- 172.21.15.32:0/887940376 learned_addr learned my addr 172.21.15.32:0/887940376 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0be00640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b0c06fdb0 0x7f9b0c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b11000640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b0c0c7260 0x7f9b0c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 -- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b0c0c7260 msgr2=0x7f9b0c13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b0c0c7260 0x7f9b0c13e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 -- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b0c06fdb0 msgr2=0x7f9b0c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b0c06fdb0 0x7f9b0c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 -- 172.21.15.32:0/887940376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40094d0 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b0b400640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c0c27f0 0x7f9b0c13dde0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9af401a0c0 tx=0x7f9af401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b03e00640 1 -- 172.21.15.32:0/887940376 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40b3800 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b03e00640 1 -- 172.21.15.32:0/887940376 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af40b3980 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b03e00640 1 -- 172.21.15.32:0/887940376 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40b3d30 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c1524a0 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.046+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c14c1d0 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.050+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0c0749f0 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.050+0000 7f9b03e00640 1 -- 172.21.15.32:0/887940376 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9af40c6390 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.050+0000 7f9b03e00640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ae4066500 0x7f9ae40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.050+0000 7f9b03e00640 1 -- 172.21.15.32:0/887940376 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9af40a7070 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.050+0000 7f9b0be00640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ae4066500 0x7f9ae40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.050+0000 7f9b0be00640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ae4066500 0x7f9ae40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007a60 tx=0x7f9afc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.054+0000 7f9b03e00640 1 -- 172.21.15.32:0/887940376 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9af40ebac0 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.214+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b0c072cf0 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.214+0000 7f9b03e00640 1 -- 172.21.15.32:0/887940376 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9af40ef0e0 con 0x7f9b0c0c27f0 2024-01-19T04:16:21.217 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ae4066500 msgr2=0x7f9ae40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ae4066500 0x7f9ae40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007a60 tx=0x7f9afc008040 comp rx=0 tx=0).stop 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c0c27f0 msgr2=0x7f9b0c13dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c0c27f0 0x7f9b0c13dde0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9af401a0c0 tx=0x7f9af401acd0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 shutdown_connections 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ae4066500 0x7f9ae40689c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b0c0c7260 0x7f9b0c13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b0c0c27f0 0x7f9b0c13dde0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 --2- 172.21.15.32:0/887940376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b0c06fdb0 0x7f9b0c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 >> 172.21.15.32:0/887940376 conn(0x7f9b0c0c7d00 msgr2=0x7f9b0c0c3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:21.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 shutdown_connections 2024-01-19T04:16:21.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.218+0000 7f9b13000640 1 -- 172.21.15.32:0/887940376 wait complete. 2024-01-19T04:16:21.238 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:16:21.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc03200640 1 Processor -- start 2024-01-19T04:16:21.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc03200640 1 -- start start 2024-01-19T04:16:21.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc03200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdbfc0705b0 0x7fdbfc06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc03200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0c0eb0 con 0x7fdbfc06cab0 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc03200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0a5330 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc03200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc06e5c0 con 0x7fdbfc0705b0 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc01200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdbfc0705b0 0x7fdbfc06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdbfbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdbfc06cab0 0x7fdbfc0c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58856/0 (socket says 172.21.15.32:58856) 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc01200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdbfc0705b0 0x7fdbfc06ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40216/0 (socket says 172.21.15.32:40216) 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdbfbe00640 1 -- 172.21.15.32:0/2666791550 learned_addr learned my addr 172.21.15.32:0/2666791550 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc01200640 1 -- 172.21.15.32:0/2666791550 >> v1:172.21.15.67:6789/0 conn(0x7fdbfc0c55d0 legacy=0x7fdbfc1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc01200640 1 -- 172.21.15.32:0/2666791550 >> v1:172.21.15.32:6789/0 conn(0x7fdbfc06cab0 legacy=0x7fdbfc0c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdc01200640 1 -- 172.21.15.32:0/2666791550 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc1516f0 con 0x7fdbfc0705b0 2024-01-19T04:16:21.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.382+0000 7fdbfaa00640 1 -- 172.21.15.32:0/2666791550 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832750023 0 0) 0x7fdbfc0c0eb0 con 0x7fdbfc06cab0 2024-01-19T04:16:21.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc01200640 1 --2- 172.21.15.32:0/2666791550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0705b0 0x7fdbfc06ce90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009d90 tx=0x7fdbf401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bcd8cfa18dcf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdbfaa00640 1 -- 172.21.15.32:0/2666791550 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40a59e0 con 0x7fdbfc0705b0 2024-01-19T04:16:21.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdbfaa00640 1 -- 172.21.15.32:0/2666791550 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf40a5b40 con 0x7fdbfc0705b0 2024-01-19T04:16:21.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdbfaa00640 1 -- 172.21.15.32:0/2666791550 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40ad440 con 0x7fdbfc0705b0 2024-01-19T04:16:21.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc03200640 1 -- 172.21.15.32:0/2666791550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0705b0 msgr2=0x7fdbfc06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc03200640 1 --2- 172.21.15.32:0/2666791550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0705b0 0x7fdbfc06ce90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009d90 tx=0x7fdbf401c920 comp rx=0 tx=0).stop 2024-01-19T04:16:21.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc03200640 1 -- 172.21.15.32:0/2666791550 shutdown_connections 2024-01-19T04:16:21.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc03200640 1 --2- 172.21.15.32:0/2666791550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0705b0 0x7fdbfc06ce90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc03200640 1 -- 172.21.15.32:0/2666791550 >> 172.21.15.32:0/2666791550 conn(0x7fdbfc0c25a0 msgr2=0x7fdbfc0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:21.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc03200640 1 -- 172.21.15.32:0/2666791550 shutdown_connections 2024-01-19T04:16:21.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.386+0000 7fdc03200640 1 -- 172.21.15.32:0/2666791550 wait complete. 2024-01-19T04:16:21.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 Processor -- start 2024-01-19T04:16:21.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 -- start start 2024-01-19T04:16:21.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdbfc06cab0 0x7fdbfc146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbfc0705b0 0x7fdbfc14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0c55d0 0x7fdbfc1ee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc144d30 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc141320 con 0x7fdbfc0705b0 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc141600 con 0x7fdbfc06cab0 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0c55d0 0x7fdbfc1ee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0c55d0 0x7fdbfc1ee7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40222/0 (socket says 172.21.15.32:40222) 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdbfbe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdbfc06cab0 0x7fdbfc146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 -- 172.21.15.32:0/1116572043 learned_addr learned my addr 172.21.15.32:0/1116572043 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdbfb400640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbfc0705b0 0x7fdbfc14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 -- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdbfc06cab0 msgr2=0x7fdbfc146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdbfc06cab0 0x7fdbfc146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 -- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbfc0705b0 msgr2=0x7fdbfc14cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbfc0705b0 0x7fdbfc14cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 -- 172.21.15.32:0/1116572043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009a70 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc01200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0c55d0 0x7fdbfc1ee7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdbf401a550 tx=0x7fdbf40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdbf3e00640 1 -- 172.21.15.32:0/1116572043 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40ade40 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdbf3e00640 1 -- 172.21.15.32:0/1116572043 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf40b9450 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdbf3e00640 1 -- 172.21.15.32:0/1116572043 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40b97e0 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc1418e0 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.390+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc14add0 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.394+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc0a4ea0 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.394+0000 7fdbf3e00640 1 -- 172.21.15.32:0/1116572043 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdbf40b9940 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.394+0000 7fdbf3e00640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdbd4066500 0x7fdbd40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.394+0000 7fdbf3e00640 1 -- 172.21.15.32:0/1116572043 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdbf411fa40 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.394+0000 7fdbfbe00640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdbd4066500 0x7fdbd40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.394+0000 7fdbfbe00640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdbd4066500 0x7fdbd40689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000f70 tx=0x7fdbec007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.398+0000 7fdbf3e00640 1 -- 172.21.15.32:0/1116572043 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdbf40ecae0 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbfc141ad0 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdbf3e00640 1 -- 172.21.15.32:0/1116572043 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbfc141ad0 con 0x7fdbfc0c55d0 2024-01-19T04:16:21.563 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:21.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdbd4066500 msgr2=0x7fdbd40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdbd4066500 0x7fdbd40689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000f70 tx=0x7fdbec007240 comp rx=0 tx=0).stop 2024-01-19T04:16:21.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0c55d0 msgr2=0x7fdbfc1ee7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0c55d0 0x7fdbfc1ee7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdbf401a550 tx=0x7fdbf40196c0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 shutdown_connections 2024-01-19T04:16:21.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdbd4066500 0x7fdbd40689c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbfc0c55d0 0x7fdbfc1ee7a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbfc0705b0 0x7fdbfc14cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 --2- 172.21.15.32:0/1116572043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdbfc06cab0 0x7fdbfc146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 >> 172.21.15.32:0/1116572043 conn(0x7fdbfc0c25a0 msgr2=0x7fdbfc154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:21.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 shutdown_connections 2024-01-19T04:16:21.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.562+0000 7fdc03200640 1 -- 172.21.15.32:0/1116572043 wait complete. 2024-01-19T04:16:21.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:16:21.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb23800640 1 Processor -- start 2024-01-19T04:16:21.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb23800640 1 -- start start 2024-01-19T04:16:21.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb23800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb1c0c2080 0x7ffb1c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb23800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c0a4ea0 con 0x7ffb1c06d440 2024-01-19T04:16:21.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb23800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c152a20 con 0x7ffb1c0723b0 2024-01-19T04:16:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb23800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c1524a0 con 0x7ffb1c0c2080 2024-01-19T04:16:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb21800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ffb1c06d440 0x7ffb1c0c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58862/0 (socket says 172.21.15.32:58862) 2024-01-19T04:16:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb21800640 1 -- 172.21.15.32:0/340086220 learned_addr learned my addr 172.21.15.32:0/340086220 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:21.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1be00640 1 --2- 172.21.15.32:0/340086220 >> v2:172.21.15.67:3300/0 conn(0x7ffb1c0c2080 0x7ffb1c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1b400640 1 -- 172.21.15.32:0/340086220 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267491993 0 0) 0x7ffb1c0a4ea0 con 0x7ffb1c06d440 2024-01-19T04:16:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1b400640 1 -- 172.21.15.32:0/340086220 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffafc003530 con 0x7ffb1c06d440 2024-01-19T04:16:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1b400640 1 -- 172.21.15.32:0/340086220 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133420802 0 0) 0x7ffb1c152a20 con 0x7ffb1c0723b0 2024-01-19T04:16:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1b400640 1 -- 172.21.15.32:0/340086220 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb1c0a4ea0 con 0x7ffb1c0723b0 2024-01-19T04:16:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1be00640 1 -- 172.21.15.32:0/340086220 >> v1:172.21.15.67:6789/0 conn(0x7ffb1c0723b0 legacy=0x7ffb1c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1be00640 1 -- 172.21.15.32:0/340086220 >> v1:172.21.15.32:6789/0 conn(0x7ffb1c06d440 legacy=0x7ffb1c0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.730+0000 7ffb1be00640 1 -- 172.21.15.32:0/340086220 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0c3430 con 0x7ffb1c0c2080 2024-01-19T04:16:21.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb1be00640 1 --2- 172.21.15.32:0/340086220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c155a90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb040097c0 tx=0x7ffb0401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=804092cd9dcbe700 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb1b400640 1 -- 172.21.15.32:0/340086220 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb040ab600 con 0x7ffb1c0c2080 2024-01-19T04:16:21.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb1b400640 1 -- 172.21.15.32:0/340086220 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb040a7050 con 0x7ffb1c0c2080 2024-01-19T04:16:21.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb1b400640 1 -- 172.21.15.32:0/340086220 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb040ab980 con 0x7ffb1c0c2080 2024-01-19T04:16:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb23800640 1 -- 172.21.15.32:0/340086220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0c2080 msgr2=0x7ffb1c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb23800640 1 --2- 172.21.15.32:0/340086220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c155a90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb040097c0 tx=0x7ffb0401c330 comp rx=0 tx=0).stop 2024-01-19T04:16:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb23800640 1 -- 172.21.15.32:0/340086220 shutdown_connections 2024-01-19T04:16:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb23800640 1 --2- 172.21.15.32:0/340086220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c155a90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb23800640 1 -- 172.21.15.32:0/340086220 >> 172.21.15.32:0/340086220 conn(0x7ffb1c0c25a0 msgr2=0x7ffb1c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb23800640 1 -- 172.21.15.32:0/340086220 shutdown_connections 2024-01-19T04:16:21.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.734+0000 7ffb23800640 1 -- 172.21.15.32:0/340086220 wait complete. 2024-01-19T04:16:21.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 Processor -- start 2024-01-19T04:16:21.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 -- start start 2024-01-19T04:16:21.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb1c06d440 0x7ffb1c142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0723b0 0x7ffb1c1f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c1ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c1f0e60 con 0x7ffb1c0c2080 2024-01-19T04:16:21.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c071f20 con 0x7ffb1c0723b0 2024-01-19T04:16:21.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c146560 con 0x7ffb1c06d440 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c1ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c1ed3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40238/0 (socket says 172.21.15.32:40238) 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 -- 172.21.15.32:0/2538275328 learned_addr learned my addr 172.21.15.32:0/2538275328 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb20e00640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb1c06d440 0x7ffb1c142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb1be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0723b0 0x7ffb1c1f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 -- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb1c06d440 msgr2=0x7ffb1c142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb1c06d440 0x7ffb1c142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 -- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0723b0 msgr2=0x7ffb1c1f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0723b0 0x7ffb1c1f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 -- 172.21.15.32:0/2538275328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009420 con 0x7ffb1c0c2080 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb21800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c1ed3e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400cad0 tx=0x7ffb1400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb18c00640 1 -- 172.21.15.32:0/2538275328 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400ac30 con 0x7ffb1c0c2080 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb18c00640 1 -- 172.21.15.32:0/2538275328 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400adb0 con 0x7ffb1c0c2080 2024-01-19T04:16:21.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb18c00640 1 -- 172.21.15.32:0/2538275328 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14012640 con 0x7ffb1c0c2080 2024-01-19T04:16:21.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c1f1830 con 0x7ffb1c0c2080 2024-01-19T04:16:21.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.738+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c071c40 con 0x7ffb1c0c2080 2024-01-19T04:16:21.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.742+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c1f1010 con 0x7ffb1c0c2080 2024-01-19T04:16:21.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.742+0000 7ffb18c00640 1 -- 172.21.15.32:0/2538275328 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ffb14007070 con 0x7ffb1c0c2080 2024-01-19T04:16:21.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.742+0000 7ffb18c00640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffaf4066500 0x7ffaf40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:21.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.742+0000 7ffb18c00640 1 -- 172.21.15.32:0/2538275328 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffb140840b0 con 0x7ffb1c0c2080 2024-01-19T04:16:21.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.742+0000 7ffb20e00640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffaf4066500 0x7ffaf40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:21.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.742+0000 7ffb20e00640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffaf4066500 0x7ffaf40689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c1ee510 tx=0x7ffb0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:21.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.746+0000 7ffb18c00640 1 -- 172.21.15.32:0/2538275328 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ffb1c1f1010 con 0x7ffb1c0c2080 2024-01-19T04:16:21.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb1c1f1010 con 0x7ffb1c0c2080 2024-01-19T04:16:21.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb18c00640 1 -- 172.21.15.32:0/2538275328 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb1c1f1010 con 0x7ffb1c0c2080 2024-01-19T04:16:21.910 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffaf4066500 msgr2=0x7ffaf40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffaf4066500 0x7ffaf40689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c1ee510 tx=0x7ffb0c009040 comp rx=0 tx=0).stop 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c0c2080 msgr2=0x7ffb1c1ed3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c1ed3e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400cad0 tx=0x7ffb1400cf90 comp rx=0 tx=0).stop 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 shutdown_connections 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffaf4066500 0x7ffaf40689c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb1c0c2080 0x7ffb1c1ed3e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb1c0723b0 0x7ffb1c1f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 --2- 172.21.15.32:0/2538275328 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffb1c06d440 0x7ffb1c142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:21.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 >> 172.21.15.32:0/2538275328 conn(0x7ffb1c0c25a0 msgr2=0x7ffb1c14c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:21.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 shutdown_connections 2024-01-19T04:16:21.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:21.910+0000 7ffb23800640 1 -- 172.21.15.32:0/2538275328 wait complete. 2024-01-19T04:16:21.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:16:22.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9532c00640 1 Processor -- start 2024-01-19T04:16:22.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9532c00640 1 -- start start 2024-01-19T04:16:22.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9532c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f952c0723b0 0x7f952c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9532c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c0c2080 0x7f952c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9532c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c0a4ea0 con 0x7f952c06d440 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9532c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c1524a0 con 0x7f952c0723b0 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9532c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c152a20 con 0x7f952c0c2080 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f952be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f952c0723b0 0x7f952c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9530c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f952c06d440 0x7f952c0c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58866/0 (socket says 172.21.15.32:58866) 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f9530c00640 1 -- 172.21.15.32:0/2786347763 learned_addr learned my addr 172.21.15.32:0/2786347763 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f952b400640 1 --2- 172.21.15.32:0/2786347763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c0c2080 0x7f952c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f952be00640 1 -- 172.21.15.32:0/2786347763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c0c2080 msgr2=0x7f952c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f952be00640 1 --2- 172.21.15.32:0/2786347763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c0c2080 0x7f952c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.074+0000 7f952be00640 1 -- 172.21.15.32:0/2786347763 >> v1:172.21.15.32:6789/0 conn(0x7f952c06d440 legacy=0x7f952c0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f952be00640 1 -- 172.21.15.32:0/2786347763 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c1533f0 con 0x7f952c0723b0 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f952aa00640 1 -- 172.21.15.32:0/2786347763 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134008932 0 0) 0x7f952c0a4ea0 con 0x7f952c06d440 2024-01-19T04:16:22.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f952b400640 1 --2- 172.21.15.32:0/2786347763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c0c2080 0x7f952c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f952be00640 1 --2- 172.21.15.32:0/2786347763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c152eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097c0 tx=0x7f951c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc4a352866dceda server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f952aa00640 1 -- 172.21.15.32:0/2786347763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0ad660 con 0x7f952c0723b0 2024-01-19T04:16:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f952aa00640 1 -- 172.21.15.32:0/2786347763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0ad7c0 con 0x7f952c0723b0 2024-01-19T04:16:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f952aa00640 1 -- 172.21.15.32:0/2786347763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0adb50 con 0x7f952c0723b0 2024-01-19T04:16:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f9532c00640 1 -- 172.21.15.32:0/2786347763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 msgr2=0x7f952c152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.078+0000 7f9532c00640 1 --2- 172.21.15.32:0/2786347763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c152eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097c0 tx=0x7f951c01c360 comp rx=0 tx=0).stop 2024-01-19T04:16:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- 172.21.15.32:0/2786347763 shutdown_connections 2024-01-19T04:16:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 --2- 172.21.15.32:0/2786347763 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c0c2080 0x7f952c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 --2- 172.21.15.32:0/2786347763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c152eb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- 172.21.15.32:0/2786347763 >> 172.21.15.32:0/2786347763 conn(0x7f952c0c25a0 msgr2=0x7f952c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- 172.21.15.32:0/2786347763 shutdown_connections 2024-01-19T04:16:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- 172.21.15.32:0/2786347763 wait complete. 2024-01-19T04:16:22.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 Processor -- start 2024-01-19T04:16:22.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- start start 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c06d440 0x7f952c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c0ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f952c0c2080 0x7f952c1eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c14e9c0 con 0x7f952c0723b0 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0aa550 con 0x7f952c0c2080 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9532c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1eaa90 con 0x7f952c06d440 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c0ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c0ab640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40254/0 (socket says 172.21.15.32:40254) 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 -- 172.21.15.32:0/4170862331 learned_addr learned my addr 172.21.15.32:0/4170862331 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952be00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c06d440 0x7f952c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9530c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f952c0c2080 0x7f952c1eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 -- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c06d440 msgr2=0x7f952c14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c06d440 0x7f952c14bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 -- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f952c0c2080 msgr2=0x7f952c1eb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f952c0c2080 0x7f952c1eb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 -- 172.21.15.32:0/4170862331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009420 con 0x7f952c0723b0 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9530c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f952c0c2080 0x7f952c1eb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f952b400640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c0ab640 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f951400e760 tx=0x7f951400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.082+0000 7f9523e00640 1 -- 172.21.15.32:0/4170862331 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400c8d0 con 0x7f952c0723b0 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9523e00640 1 -- 172.21.15.32:0/4170862331 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400ca30 con 0x7f952c0723b0 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9523e00640 1 -- 172.21.15.32:0/4170862331 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400cde0 con 0x7f952c0723b0 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c14e1b0 con 0x7f952c0723b0 2024-01-19T04:16:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c14e6e0 con 0x7f952c0723b0 2024-01-19T04:16:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c0749f0 con 0x7f952c0723b0 2024-01-19T04:16:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9523e00640 1 -- 172.21.15.32:0/4170862331 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9514013410 con 0x7f952c0723b0 2024-01-19T04:16:22.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9523e00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9504066500 0x7f95040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f9523e00640 1 -- 172.21.15.32:0/4170862331 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9514084060 con 0x7f952c0723b0 2024-01-19T04:16:22.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.086+0000 7f952be00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9504066500 0x7f95040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.090+0000 7f952be00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9504066500 0x7f95040689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f951c0af000 tx=0x7f951c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.090+0000 7f9523e00640 1 -- 172.21.15.32:0/4170862331 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9514050f10 con 0x7f952c0723b0 2024-01-19T04:16:22.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.250+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f952c1509d0 con 0x7f952c0723b0 2024-01-19T04:16:22.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.250+0000 7f9523e00640 1 -- 172.21.15.32:0/4170862331 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9514054530 con 0x7f952c0723b0 2024-01-19T04:16:22.253 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:22.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9504066500 msgr2=0x7f95040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9504066500 0x7f95040689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f951c0af000 tx=0x7f951c0a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 msgr2=0x7f952c0ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c0ab640 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f951400e760 tx=0x7f951400ec20 comp rx=0 tx=0).stop 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 shutdown_connections 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9504066500 0x7f95040689c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f952c0c2080 0x7f952c1eb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f952c0723b0 0x7f952c0ab640 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 --2- 172.21.15.32:0/4170862331 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f952c06d440 0x7f952c14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 >> 172.21.15.32:0/4170862331 conn(0x7f952c0c25a0 msgr2=0x7f952c155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 shutdown_connections 2024-01-19T04:16:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.254+0000 7f9532c00640 1 -- 172.21.15.32:0/4170862331 wait complete. 2024-01-19T04:16:22.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:16:22.327 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:16:22.331 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:16:22.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa425000640 1 Processor -- start 2024-01-19T04:16:22.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa425000640 1 -- start start 2024-01-19T04:16:22.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa425000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4200719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa425000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa42006c670 0x7fa420071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa425000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa420072730 con 0x7fa42014eb90 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa425000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa420072a10 con 0x7fa42006c670 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa425000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42014ef70 con 0x7fa4201550e0 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa42006c670 0x7fa420071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa42006c670 0x7fa420071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40268/0 (socket says 172.21.15.32:40268) 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41e800640 1 -- 172.21.15.32:0/1719372698 learned_addr learned my addr 172.21.15.32:0/1719372698 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41d400640 1 --2- 172.21.15.32:0/1719372698 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4200719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41e800640 1 -- 172.21.15.32:0/1719372698 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 msgr2=0x7fa4200719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41e800640 1 --2- 172.21.15.32:0/1719372698 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4200719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41e800640 1 -- 172.21.15.32:0/1719372698 >> v1:172.21.15.67:6789/0 conn(0x7fa42014eb90 legacy=0x7fa4201549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.422+0000 7fa41e800640 1 -- 172.21.15.32:0/1719372698 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420155580 con 0x7fa42006c670 2024-01-19T04:16:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa41e800640 1 --2- 172.21.15.32:0/1719372698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42006c670 0x7fa420071ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa418009e50 tx=0x7fa41801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02f1feb0af8436f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa41ca00640 1 -- 172.21.15.32:0/1719372698 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180a5750 con 0x7fa42006c670 2024-01-19T04:16:22.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa41ca00640 1 -- 172.21.15.32:0/1719372698 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4180a58b0 con 0x7fa42006c670 2024-01-19T04:16:22.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa41ca00640 1 -- 172.21.15.32:0/1719372698 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180a5c40 con 0x7fa42006c670 2024-01-19T04:16:22.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 -- 172.21.15.32:0/1719372698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42006c670 msgr2=0x7fa420071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 --2- 172.21.15.32:0/1719372698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42006c670 0x7fa420071ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa418009e50 tx=0x7fa41801c980 comp rx=0 tx=0).stop 2024-01-19T04:16:22.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 -- 172.21.15.32:0/1719372698 shutdown_connections 2024-01-19T04:16:22.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 --2- 172.21.15.32:0/1719372698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42006c670 0x7fa420071ee0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 --2- 172.21.15.32:0/1719372698 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4200719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 -- 172.21.15.32:0/1719372698 >> 172.21.15.32:0/1719372698 conn(0x7fa4200c25a0 msgr2=0x7fa4200c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:22.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 -- 172.21.15.32:0/1719372698 shutdown_connections 2024-01-19T04:16:22.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.426+0000 7fa425000640 1 -- 172.21.15.32:0/1719372698 wait complete. 2024-01-19T04:16:22.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 Processor -- start 2024-01-19T04:16:22.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 -- start start 2024-01-19T04:16:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa42006c670 0x7fa4201eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42014eb90 0x7fa4200bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4201f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200a6c60 con 0x7fa42014eb90 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200a6450 con 0x7fa42006c670 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200a66a0 con 0x7fa4201550e0 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42014eb90 0x7fa4200bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42014eb90 0x7fa4200bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40274/0 (socket says 172.21.15.32:40274) 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 -- 172.21.15.32:0/2554613874 learned_addr learned my addr 172.21.15.32:0/2554613874 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41de00640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa42006c670 0x7fa4201eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41e800640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4201f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 -- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 msgr2=0x7fa4201f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4201f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 -- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa42006c670 msgr2=0x7fa4201eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa42006c670 0x7fa4201eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 -- 172.21.15.32:0/2554613874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418009b30 con 0x7fa42014eb90 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa41d400640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42014eb90 0x7fa4200bf380 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa40800e870 tx=0x7fa40800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa416000640 1 -- 172.21.15.32:0/2554613874 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408009510 con 0x7fa42014eb90 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa416000640 1 -- 172.21.15.32:0/2554613874 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40800eec0 con 0x7fa42014eb90 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4200a6980 con 0x7fa42014eb90 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa416000640 1 -- 172.21.15.32:0/2554613874 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800cb40 con 0x7fa42014eb90 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.430+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4200bf8c0 con 0x7fa42014eb90 2024-01-19T04:16:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.434+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4201f0940 con 0x7fa42014eb90 2024-01-19T04:16:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.434+0000 7fa416000640 1 -- 172.21.15.32:0/2554613874 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa40800ccc0 con 0x7fa42014eb90 2024-01-19T04:16:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.434+0000 7fa416000640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.434+0000 7fa416000640 1 -- 172.21.15.32:0/2554613874 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa408084290 con 0x7fa42014eb90 2024-01-19T04:16:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.434+0000 7fa41de00640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.434+0000 7fa41de00640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa42014ce60 tx=0x7fa410009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.438+0000 7fa416000640 1 -- 172.21.15.32:0/2554613874 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa4201f0940 con 0x7fa42014eb90 2024-01-19T04:16:22.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa4201f0940 con 0x7fa42014eb90 2024-01-19T04:16:22.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa416000640 1 -- 172.21.15.32:0/2554613874 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa4201f0940 con 0x7fa42014eb90 2024-01-19T04:16:22.604 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 msgr2=0x7fa3f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa42014ce60 tx=0x7fa410009040 comp rx=0 tx=0).stop 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42014eb90 msgr2=0x7fa4200bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42014eb90 0x7fa4200bf380 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa40800e870 tx=0x7fa40800ec70 comp rx=0 tx=0).stop 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 shutdown_connections 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3f8066500 0x7fa3f80689c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa4201550e0 0x7fa4201f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa42014eb90 0x7fa4200bf380 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 --2- 172.21.15.32:0/2554613874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa42006c670 0x7fa4201eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 >> 172.21.15.32:0/2554613874 conn(0x7fa4200c25a0 msgr2=0x7fa420071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 shutdown_connections 2024-01-19T04:16:22.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.602+0000 7fa425000640 1 -- 172.21.15.32:0/2554613874 wait complete. 2024-01-19T04:16:22.626 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:16:22.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73db200640 1 Processor -- start 2024-01-19T04:16:22.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73db200640 1 -- start start 2024-01-19T04:16:22.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73db200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73d40c6e20 0x7f73d40c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73db200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d406fda0 0x7f73d40c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73db200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d41533a0 con 0x7f73d40a6d30 2024-01-19T04:16:22.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73db200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d4156380 con 0x7f73d40c6e20 2024-01-19T04:16:22.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73db200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d414fe40 con 0x7f73d406fda0 2024-01-19T04:16:22.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73d40c6e20 0x7f73d40c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d406fda0 0x7f73d40c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f73d40c6e20 0x7f73d40c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:41940/0 (socket says 172.21.15.32:41940) 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3e00640 1 -- 172.21.15.32:0/4184028605 learned_addr learned my addr 172.21.15.32:0/4184028605 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3400640 1 --1- 172.21.15.32:0/4184028605 >> v1:172.21.15.67:6789/0 conn(0x7f73d40a6d30 0x7f73d4152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:51930/0 (socket says 172.21.15.32:51930) 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3e00640 1 -- 172.21.15.32:0/4184028605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d406fda0 msgr2=0x7f73d40c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3e00640 1 --2- 172.21.15.32:0/4184028605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d406fda0 0x7f73d40c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3e00640 1 -- 172.21.15.32:0/4184028605 >> v1:172.21.15.67:6789/0 conn(0x7f73d40a6d30 legacy=0x7f73d4152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.770+0000 7f73d3e00640 1 -- 172.21.15.32:0/4184028605 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4152800 con 0x7f73d40c6e20 2024-01-19T04:16:22.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73d3e00640 1 --2- 172.21.15.32:0/4184028605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40c6e20 0x7f73d40c7200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009870 tx=0x7f73c401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab3a4512506a4e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73d2a00640 1 -- 172.21.15.32:0/4184028605 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40ac620 con 0x7f73d40c6e20 2024-01-19T04:16:22.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73d2a00640 1 -- 172.21.15.32:0/4184028605 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c40ac780 con 0x7f73d40c6e20 2024-01-19T04:16:22.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73d2a00640 1 -- 172.21.15.32:0/4184028605 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40acb10 con 0x7f73d40c6e20 2024-01-19T04:16:22.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73db200640 1 -- 172.21.15.32:0/4184028605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40c6e20 msgr2=0x7f73d40c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73db200640 1 --2- 172.21.15.32:0/4184028605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40c6e20 0x7f73d40c7200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009870 tx=0x7f73c401c4b0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73db200640 1 -- 172.21.15.32:0/4184028605 shutdown_connections 2024-01-19T04:16:22.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73db200640 1 --2- 172.21.15.32:0/4184028605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d406fda0 0x7f73d40c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73db200640 1 --2- 172.21.15.32:0/4184028605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40c6e20 0x7f73d40c7200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.774+0000 7f73db200640 1 -- 172.21.15.32:0/4184028605 >> 172.21.15.32:0/4184028605 conn(0x7f73d40a9870 msgr2=0x7f73d40a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:22.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 -- 172.21.15.32:0/4184028605 shutdown_connections 2024-01-19T04:16:22.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 -- 172.21.15.32:0/4184028605 wait complete. 2024-01-19T04:16:22.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 Processor -- start 2024-01-19T04:16:22.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 -- start start 2024-01-19T04:16:22.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73d406fda0 0x7f73d414e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40a6d30 0x7f73d406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d40c6e20 0x7f73d41517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41ecc50 con 0x7f73d406fda0 2024-01-19T04:16:22.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41edc20 con 0x7f73d40a6d30 2024-01-19T04:16:22.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41ed790 con 0x7f73d40c6e20 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73d406fda0 0x7f73d414e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73d406fda0 0x7f73d414e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40284/0 (socket says 172.21.15.32:40284) 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 -- 172.21.15.32:0/234973015 learned_addr learned my addr 172.21.15.32:0/234973015 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3400640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40a6d30 0x7f73d406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d9200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d40c6e20 0x7f73d41517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 -- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d40c6e20 msgr2=0x7f73d41517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d40c6e20 0x7f73d41517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 -- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40a6d30 msgr2=0x7f73d406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40a6d30 0x7f73d406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 -- 172.21.15.32:0/234973015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40094d0 con 0x7f73d406fda0 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d9200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d40c6e20 0x7f73d41517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3400640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40a6d30 0x7f73d406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:22.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73d3e00640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73d406fda0 0x7f73d414e540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f73c40af040 tx=0x7f73c401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73cbe00640 1 -- 172.21.15.32:0/234973015 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40b7420 con 0x7f73d406fda0 2024-01-19T04:16:22.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73cbe00640 1 -- 172.21.15.32:0/234973015 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c40b7580 con 0x7f73d406fda0 2024-01-19T04:16:22.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d41ece60 con 0x7f73d406fda0 2024-01-19T04:16:22.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.778+0000 7f73cbe00640 1 -- 172.21.15.32:0/234973015 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40b7930 con 0x7f73d406fda0 2024-01-19T04:16:22.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.782+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d41ed420 con 0x7f73d406fda0 2024-01-19T04:16:22.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.782+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d415c5a0 con 0x7f73d406fda0 2024-01-19T04:16:22.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.782+0000 7f73cbe00640 1 -- 172.21.15.32:0/234973015 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f73c40b3040 con 0x7f73d406fda0 2024-01-19T04:16:22.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.782+0000 7f73cbe00640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73ac066500 0x7f73ac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:22.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.782+0000 7f73cbe00640 1 -- 172.21.15.32:0/234973015 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f73c411e4b0 con 0x7f73d406fda0 2024-01-19T04:16:22.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.782+0000 7f73d3400640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73ac066500 0x7f73ac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:22.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.786+0000 7f73d3400640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73ac066500 0x7f73ac0689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73bc007fd0 tx=0x7f73bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:22.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.786+0000 7f73cbe00640 1 -- 172.21.15.32:0/234973015 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f73c40eb500 con 0x7f73d406fda0 2024-01-19T04:16:22.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.958+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73d40749f0 con 0x7f73d406fda0 2024-01-19T04:16:22.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.958+0000 7f73cbe00640 1 -- 172.21.15.32:0/234973015 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73c40eeb20 con 0x7f73d406fda0 2024-01-19T04:16:22.961 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73ac066500 msgr2=0x7f73ac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73ac066500 0x7f73ac0689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73bc007fd0 tx=0x7f73bc009040 comp rx=0 tx=0).stop 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73d406fda0 msgr2=0x7f73d414e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73d406fda0 0x7f73d414e540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f73c40af040 tx=0x7f73c401acf0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 shutdown_connections 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f73ac066500 0x7f73ac0689c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f73d40c6e20 0x7f73d41517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73d40a6d30 0x7f73d406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 --2- 172.21.15.32:0/234973015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73d406fda0 0x7f73d414e540 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:22.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 >> 172.21.15.32:0/234973015 conn(0x7f73d40a9870 msgr2=0x7f73d40c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:22.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 shutdown_connections 2024-01-19T04:16:22.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:22.962+0000 7f73db200640 1 -- 172.21.15.32:0/234973015 wait complete. 2024-01-19T04:16:22.983 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-19T04:16:22.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:22.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:23.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:16:23.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:23.010 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T04:16:23.066 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:23.066 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:23.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:16:23.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:16:23.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.298+0000 7f76ef800640 1 Processor -- start 2024-01-19T04:16:23.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.298+0000 7f76ef800640 1 -- start start 2024-01-19T04:16:23.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ef800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76e8147f90 0x7f76e8151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:23.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ef800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e80c55e0 0x7f76e80c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:23.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ef800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f76e806beb0 0x7f76e80a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ef800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e80c1df0 con 0x7f76e8147f90 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ef800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e80c0810 con 0x7f76e806beb0 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ef800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80c0af0 con 0x7f76e80c55e0 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76e8147f90 0x7f76e8151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76e8147f90 0x7f76e8151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40300/0 (socket says 172.21.15.32:40300) 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 -- 172.21.15.32:0/2440668201 learned_addr learned my addr 172.21.15.32:0/2440668201 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76e7e00640 1 --2- 172.21.15.32:0/2440668201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e80c55e0 0x7f76e80c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ed800640 1 --2- 172.21.15.32:0/2440668201 >> v2:172.21.15.67:3300/0 conn(0x7f76e806beb0 0x7f76e80a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 -- 172.21.15.32:0/2440668201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e80c55e0 msgr2=0x7f76e80c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 --2- 172.21.15.32:0/2440668201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e80c55e0 0x7f76e80c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 -- 172.21.15.32:0/2440668201 >> v2:172.21.15.67:3300/0 conn(0x7f76e806beb0 msgr2=0x7f76e80a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:23.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 --2- 172.21.15.32:0/2440668201 >> v2:172.21.15.67:3300/0 conn(0x7f76e806beb0 0x7f76e80a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.302+0000 7f76ece00640 1 -- 172.21.15.32:0/2440668201 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80c0dd0 con 0x7f76e8147f90 2024-01-19T04:16:23.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ece00640 1 --2- 172.21.15.32:0/2440668201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e8147f90 0x7f76e8151350 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f76e80c0160 tx=0x7f76d801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719ed0ca9cc1b6d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:23.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76e7400640 1 -- 172.21.15.32:0/2440668201 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80ab600 con 0x7f76e8147f90 2024-01-19T04:16:23.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76e7400640 1 -- 172.21.15.32:0/2440668201 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d80ab760 con 0x7f76e8147f90 2024-01-19T04:16:23.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76e7400640 1 -- 172.21.15.32:0/2440668201 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80abaf0 con 0x7f76e8147f90 2024-01-19T04:16:23.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 -- 172.21.15.32:0/2440668201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e8147f90 msgr2=0x7f76e8151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:23.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 --2- 172.21.15.32:0/2440668201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e8147f90 0x7f76e8151350 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f76e80c0160 tx=0x7f76d801c440 comp rx=0 tx=0).stop 2024-01-19T04:16:23.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 -- 172.21.15.32:0/2440668201 shutdown_connections 2024-01-19T04:16:23.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 --2- 172.21.15.32:0/2440668201 >> v2:172.21.15.67:3300/0 conn(0x7f76e806beb0 0x7f76e80a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 --2- 172.21.15.32:0/2440668201 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e80c55e0 0x7f76e80c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 --2- 172.21.15.32:0/2440668201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e8147f90 0x7f76e8151350 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 -- 172.21.15.32:0/2440668201 >> 172.21.15.32:0/2440668201 conn(0x7f76e80c5b20 msgr2=0x7f76e80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:23.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 -- 172.21.15.32:0/2440668201 shutdown_connections 2024-01-19T04:16:23.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 -- 172.21.15.32:0/2440668201 wait complete. 2024-01-19T04:16:23.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 Processor -- start 2024-01-19T04:16:23.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.306+0000 7f76ef800640 1 -- start start 2024-01-19T04:16:23.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76e806beb0 0x7f76e814d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:23.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e80c55e0 0x7f76e80ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:23.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e8147f90 0x7f76e8150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:23.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e81f12d0 con 0x7f76e80c55e0 2024-01-19T04:16:23.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e81f2280 con 0x7f76e806beb0 2024-01-19T04:16:23.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e81f14c0 con 0x7f76e8147f90 2024-01-19T04:16:23.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e80c55e0 0x7f76e80ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:23.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e80c55e0 0x7f76e80ab580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40316/0 (socket says 172.21.15.32:40316) 2024-01-19T04:16:23.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 -- 172.21.15.32:0/1786113480 learned_addr learned my addr 172.21.15.32:0/1786113480 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:23.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ece00640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76e806beb0 0x7f76e814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:23.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ed800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e8147f90 0x7f76e8150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:23.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 -- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e8147f90 msgr2=0x7f76e8150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e8147f90 0x7f76e8150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 -- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76e806beb0 msgr2=0x7f76e814d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76e806beb0 0x7f76e814d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 -- 172.21.15.32:0/1786113480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80094d0 con 0x7f76e80c55e0 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ed800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e8147f90 0x7f76e8150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e7e00640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e80c55e0 0x7f76e80ab580 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f76d0006e90 tx=0x7f76d000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e4c00640 1 -- 172.21.15.32:0/1786113480 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d000b6c0 con 0x7f76e80c55e0 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e4c00640 1 -- 172.21.15.32:0/1786113480 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d000b840 con 0x7f76e80c55e0 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76e4c00640 1 -- 172.21.15.32:0/1786113480 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d000bbf0 con 0x7f76e80c55e0 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e81f17a0 con 0x7f76e80c55e0 2024-01-19T04:16:23.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e81f1d60 con 0x7f76e80c55e0 2024-01-19T04:16:23.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.310+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e80681a0 con 0x7f76e80c55e0 2024-01-19T04:16:23.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.314+0000 7f76e4c00640 1 -- 172.21.15.32:0/1786113480 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f76d000bd50 con 0x7f76e80c55e0 2024-01-19T04:16:23.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.314+0000 7f76e4c00640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f76c0066500 0x7f76c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:23.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.314+0000 7f76e4c00640 1 -- 172.21.15.32:0/1786113480 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f76d0084630 con 0x7f76e80c55e0 2024-01-19T04:16:23.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.314+0000 7f76ece00640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f76c0066500 0x7f76c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:23.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.314+0000 7f76ece00640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f76c0066500 0x7f76c00689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76d80af000 tx=0x7f76d80b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:23.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.318+0000 7f76e4c00640 1 -- 172.21.15.32:0/1786113480 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f76d0051560 con 0x7f76e80c55e0 2024-01-19T04:16:23.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.510+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76e80c34e0 con 0x7f76e80c55e0 2024-01-19T04:16:23.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76e4c00640 1 -- 172.21.15.32:0/1786113480 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7f76d0054b80 con 0x7f76e80c55e0 2024-01-19T04:16:23.514 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:16:23.514 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-19T04:16:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f76c0066500 msgr2=0x7f76c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:23.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f76c0066500 0x7f76c00689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76d80af000 tx=0x7f76d80b6040 comp rx=0 tx=0).stop 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e80c55e0 msgr2=0x7f76e80ab580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e80c55e0 0x7f76e80ab580 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f76d0006e90 tx=0x7f76d000dc60 comp rx=0 tx=0).stop 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 shutdown_connections 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f76c0066500 0x7f76c00689c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76e8147f90 0x7f76e8150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e80c55e0 0x7f76e80ab580 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 --2- 172.21.15.32:0/1786113480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76e806beb0 0x7f76e814d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 >> 172.21.15.32:0/1786113480 conn(0x7f76e80c5b20 msgr2=0x7f76e80c2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 shutdown_connections 2024-01-19T04:16:23.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:23.514+0000 7f76ef800640 1 -- 172.21.15.32:0/1786113480 wait complete. 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:16:23.536 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.sH4SEIJA1p 2024-01-19T04:16:23.536 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-01-19T04:16:23.545 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.ERNmZY8qVg 2024-01-19T04:16:23.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /tmp/tmp.sH4SEIJA1p /tmp/tmp.ERNmZY8qVg 2024-01-19T04:16:23.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.ERNmZY8qVg 2024-01-19T04:16:23.722 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.ERNmZY8qVg is 185B 2024-01-19T04:16:23.738 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.ERNmZY8qVg 2024-01-19T04:16:23.746 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCU96llK+obExAA1V1N7PpjHeA4khEv+p/tTg== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2024-01-19T04:16:23.747 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:23.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:23.747 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:23.798 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42359sec preferred_lft 42359sec 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:1f:1a:e5:73 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:23.799 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:16:23.800 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:23.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:23.801 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:16:23.860 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-01-19T04:16:23.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:23.862 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-01-19T04:16:23.914 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-01-19T04:16:23.915 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:16:23.915 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-19T04:16:23.915 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:16:23.915 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-19T04:16:23.915 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:16:23.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:23.915 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:16:23.915 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:16:23.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-19T04:16:23.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-19T04:16:23.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-19T04:16:23.916 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:16:24.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:24.008 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:16:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T04:16:24.017 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:24.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:24.017 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-01-19T04:16:24.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:24.078 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:24.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:24.130 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:24.181 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:24.181 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/tmp/tmp.sH4SEIJA1p of=/dev/stdout 2024-01-19T04:16:24.233 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2024-01-19T04:16:24.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:24.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCU96llK+obExAA1V1N7PpjHeA4khEv+p/tTg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:24.330 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,secret=AQCU96llK+obExAA1V1N7PpjHeA4khEv+p/tTg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:24.330 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:24.330 INFO:teuthology.orchestra.run.smithi032.stdout:keyring.get_secret failed 2024-01-19T04:16:24.339 INFO:teuthology.orchestra.run.smithi032.stderr:mount.ceph: kernel BUG! 2024-01-19T04:16:24.340 INFO:teuthology.orchestra.run.smithi032.stderr:mount error: no mds server is up or the cluster is laggy 2024-01-19T04:16:24.340 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,secret=AQCU96llK+obExAA1V1N7PpjHeA4khEv+p/tTg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:24.340 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:24.340 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:16:24.341 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: testuser@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs2=/ 2024-01-19T04:16:24.341 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:16:24.344 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-19T04:16:24.344 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-01-19T04:16:24.345 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T04:16:24.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:16:24.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:16:24.515 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T04:16:24.516 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:24.516 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:24.524 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:16:24.525 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:24.525 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:24.534 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:24.534 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:24.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:24.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.722+0000 7fd1bc000640 1 Processor -- start 2024-01-19T04:16:24.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.722+0000 7fd1bc000640 1 -- start start 2024-01-19T04:16:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1bc000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b40c42b0 0x7fd1b40c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1bc000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd1b40c5740 0x7fd1b40c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1bc000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40c0c90 con 0x7fd1b406beb0 2024-01-19T04:16:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1bc000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b4150f90 con 0x7fd1b40c5740 2024-01-19T04:16:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1bc000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40c1660 con 0x7fd1b40c42b0 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b9600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b40c42b0 0x7fd1b40c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b8c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd1b40c5740 0x7fd1b40c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1ba000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd1b406beb0 0x7fd1b4154110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:51932/0 (socket says 172.21.15.32:51932) 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b9600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b40c42b0 0x7fd1b40c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:51866/0 (socket says 172.21.15.32:51866) 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1ba000640 1 -- 172.21.15.32:0/3518649003 learned_addr learned my addr 172.21.15.32:0/3518649003 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b9600640 1 -- 172.21.15.32:0/3518649003 >> v2:172.21.15.67:3300/0 conn(0x7fd1b40c5740 msgr2=0x7fd1b40c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b3e00640 1 -- 172.21.15.32:0/3518649003 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493094479 0 0) 0x7fd1b40c0c90 con 0x7fd1b406beb0 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b9600640 1 --2- 172.21.15.32:0/3518649003 >> v2:172.21.15.67:3300/0 conn(0x7fd1b40c5740 0x7fd1b40c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b9600640 1 -- 172.21.15.32:0/3518649003 >> v1:172.21.15.67:6789/0 conn(0x7fd1b406beb0 legacy=0x7fd1b4154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.726+0000 7fd1b9600640 1 -- 172.21.15.32:0/3518649003 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4150cb0 con 0x7fd1b40c42b0 2024-01-19T04:16:24.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1b9600640 1 --2- 172.21.15.32:0/3518649003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b40c42b0 0x7fd1b40c4690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40097c0 tx=0x7fd1a401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ee90beeb08f2f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1b3e00640 1 -- 172.21.15.32:0/3518649003 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40ab600 con 0x7fd1b40c42b0 2024-01-19T04:16:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1b3e00640 1 -- 172.21.15.32:0/3518649003 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a40a7050 con 0x7fd1b40c42b0 2024-01-19T04:16:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1b3e00640 1 -- 172.21.15.32:0/3518649003 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40ab980 con 0x7fd1b40c42b0 2024-01-19T04:16:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 -- 172.21.15.32:0/3518649003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b40c42b0 msgr2=0x7fd1b40c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 --2- 172.21.15.32:0/3518649003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b40c42b0 0x7fd1b40c4690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40097c0 tx=0x7fd1a401c3c0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 -- 172.21.15.32:0/3518649003 shutdown_connections 2024-01-19T04:16:24.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 --2- 172.21.15.32:0/3518649003 >> v2:172.21.15.67:3300/0 conn(0x7fd1b40c5740 0x7fd1b40c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 --2- 172.21.15.32:0/3518649003 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b40c42b0 0x7fd1b40c4690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 -- 172.21.15.32:0/3518649003 >> 172.21.15.32:0/3518649003 conn(0x7fd1b40c5b20 msgr2=0x7fd1b40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:24.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 -- 172.21.15.32:0/3518649003 shutdown_connections 2024-01-19T04:16:24.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 -- 172.21.15.32:0/3518649003 wait complete. 2024-01-19T04:16:24.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 Processor -- start 2024-01-19T04:16:24.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.730+0000 7fd1bc000640 1 -- start start 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b406beb0 0x7fd1b40a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1b40c42b0 0x7fd1b40bad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1b40c5740 0x7fd1b40becf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41ee0d0 con 0x7fd1b40c5740 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40aa1f0 con 0x7fd1b40c42b0 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41ee370 con 0x7fd1b406beb0 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1b40c5740 0x7fd1b40becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1b40c5740 0x7fd1b40becf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40328/0 (socket says 172.21.15.32:40328) 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 -- 172.21.15.32:0/2344701668 learned_addr learned my addr 172.21.15.32:0/2344701668 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1b9600640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b406beb0 0x7fd1b40a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1b8c00640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1b40c42b0 0x7fd1b40bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 -- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b406beb0 msgr2=0x7fd1b40a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b406beb0 0x7fd1b40a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 -- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1b40c42b0 msgr2=0x7fd1b40bad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1b40c42b0 0x7fd1b40bad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 -- 172.21.15.32:0/2344701668 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009420 con 0x7fd1b40c5740 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1ba000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1b40c5740 0x7fd1b40becf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c780 tx=0x7fd1ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1b1600640 1 -- 172.21.15.32:0/2344701668 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac004d70 con 0x7fd1b40c5740 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1b1600640 1 -- 172.21.15.32:0/2344701668 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00a640 con 0x7fd1b40c5740 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b41ee650 con 0x7fd1b40c5740 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1b1600640 1 -- 172.21.15.32:0/2344701668 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00aa70 con 0x7fd1b40c5740 2024-01-19T04:16:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b40aa4d0 con 0x7fd1b40c5740 2024-01-19T04:16:24.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.734+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b41ee890 con 0x7fd1b40c5740 2024-01-19T04:16:24.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.738+0000 7fd1b1600640 1 -- 172.21.15.32:0/2344701668 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd1ac00abd0 con 0x7fd1b40c5740 2024-01-19T04:16:24.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.738+0000 7fd1b1600640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd18c066530 0x7fd18c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:24.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.738+0000 7fd1b1600640 1 -- 172.21.15.32:0/2344701668 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd1ac083950 con 0x7fd1b40c5740 2024-01-19T04:16:24.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.738+0000 7fd1b9600640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd18c066530 0x7fd18c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:24.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.738+0000 7fd1b9600640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd18c066530 0x7fd18c0689f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40ad000 tx=0x7fd1a40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:24.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.742+0000 7fd1b1600640 1 -- 172.21.15.32:0/2344701668 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd1b41ee890 con 0x7fd1b40c5740 2024-01-19T04:16:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.902+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b41ee840 con 0x7fd1b40c5740 2024-01-19T04:16:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.902+0000 7fd1b1600640 1 -- 172.21.15.32:0/2344701668 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20134 (secure 0 0 0) 0x7fd1ac018090 con 0x7fd1b40c5740 2024-01-19T04:16:24.905 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:24.905 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:07.630852+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd18c066530 msgr2=0x7fd18c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd18c066530 0x7fd18c0689f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40ad000 tx=0x7fd1a40a6000 comp rx=0 tx=0).stop 2024-01-19T04:16:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1b40c5740 msgr2=0x7fd1b40becf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1b40c5740 0x7fd1b40becf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c780 tx=0x7fd1ac00cc40 comp rx=0 tx=0).stop 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 shutdown_connections 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd18c066530 0x7fd18c0689f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1b40c5740 0x7fd1b40becf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1b40c42b0 0x7fd1b40bad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 --2- 172.21.15.32:0/2344701668 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd1b406beb0 0x7fd1b40a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 >> 172.21.15.32:0/2344701668 conn(0x7fd1b40c5b20 msgr2=0x7fd1b40715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 shutdown_connections 2024-01-19T04:16:24.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:24.906+0000 7fd1bc000640 1 -- 172.21.15.32:0/2344701668 wait complete. 2024-01-19T04:16:24.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:15:46.886973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:48.025571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:16:04.715304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:16:05.165871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:24.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:25.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.070+0000 7f6b54400640 1 Processor -- start 2024-01-19T04:16:25.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.070+0000 7f6b54400640 1 -- start start 2024-01-19T04:16:25.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.070+0000 7f6b54400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b4c0c4360 0x7f6b4c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.070+0000 7f6b54400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.070+0000 7f6b54400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c06c6a0 con 0x7f6b4c151dc0 2024-01-19T04:16:25.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.070+0000 7f6b54400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c1521a0 con 0x7f6b4c0c4360 2024-01-19T04:16:25.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.070+0000 7f6b54400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c154cf0 con 0x7f6b4c070630 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b51000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b4c0c4360 0x7f6b4c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b52400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b52400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:51876/0 (socket says 172.21.15.32:51876) 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b52400640 1 -- 172.21.15.32:0/903351237 learned_addr learned my addr 172.21.15.32:0/903351237 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b51000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6b4c0c4360 0x7f6b4c06cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:41992/0 (socket says 172.21.15.32:41992) 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b51a00640 1 --1- 172.21.15.32:0/903351237 >> v1:172.21.15.67:6789/0 conn(0x7f6b4c151dc0 0x7f6b4c0c1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:51942/0 (socket says 172.21.15.32:51942) 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b4be00640 1 -- 172.21.15.32:0/903351237 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014649888 0 0) 0x7f6b4c06c6a0 con 0x7f6b4c151dc0 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b51000640 1 -- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 msgr2=0x7f6b4c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b51000640 1 --2- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b51000640 1 -- 172.21.15.32:0/903351237 >> v1:172.21.15.67:6789/0 conn(0x7f6b4c151dc0 legacy=0x7f6b4c0c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b51000640 1 -- 172.21.15.32:0/903351237 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c154fd0 con 0x7f6b4c0c4360 2024-01-19T04:16:25.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.074+0000 7f6b52400640 1 --2- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:25.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b51000640 1 --2- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 0x7f6b4c06cb30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097c0 tx=0x7f6b3401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd1a45b4db47389b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b4be00640 1 -- 172.21.15.32:0/903351237 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340ab650 con 0x7f6b4c0c4360 2024-01-19T04:16:25.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b4be00640 1 -- 172.21.15.32:0/903351237 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b340ab7b0 con 0x7f6b4c0c4360 2024-01-19T04:16:25.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b4be00640 1 -- 172.21.15.32:0/903351237 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340abb40 con 0x7f6b4c0c4360 2024-01-19T04:16:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 -- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 msgr2=0x7f6b4c06cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 --2- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 0x7f6b4c06cb30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097c0 tx=0x7f6b3401c450 comp rx=0 tx=0).stop 2024-01-19T04:16:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 -- 172.21.15.32:0/903351237 shutdown_connections 2024-01-19T04:16:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 --2- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 --2- 172.21.15.32:0/903351237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 0x7f6b4c06cb30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 -- 172.21.15.32:0/903351237 >> 172.21.15.32:0/903351237 conn(0x7f6b4c0c7d00 msgr2=0x7f6b4c0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 -- 172.21.15.32:0/903351237 shutdown_connections 2024-01-19T04:16:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 -- 172.21.15.32:0/903351237 wait complete. 2024-01-19T04:16:25.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 Processor -- start 2024-01-19T04:16:25.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.078+0000 7f6b54400640 1 -- start start 2024-01-19T04:16:25.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c1edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 0x7f6b4c14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c151dc0 0x7f6b4c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c156d90 con 0x7f6b4c151dc0 2024-01-19T04:16:25.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c06ed80 con 0x7f6b4c0c4360 2024-01-19T04:16:25.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1ee140 con 0x7f6b4c070630 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c151dc0 0x7f6b4c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c151dc0 0x7f6b4c153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40340/0 (socket says 172.21.15.32:40340) 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 -- 172.21.15.32:0/3625422537 learned_addr learned my addr 172.21.15.32:0/3625422537 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b51000640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 0x7f6b4c14bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b51a00640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c1edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 -- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 msgr2=0x7f6b4c1edc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c1edc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 -- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 msgr2=0x7f6b4c14bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 0x7f6b4c14bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 -- 172.21.15.32:0/3625422537 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44009b30 con 0x7f6b4c151dc0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b52400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c151dc0 0x7f6b4c153520 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400efc0 tx=0x7f6b4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b49600640 1 -- 172.21.15.32:0/3625422537 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44018070 con 0x7f6b4c151dc0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b49600640 1 -- 172.21.15.32:0/3625422537 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4400f040 con 0x7f6b4c151dc0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b49600640 1 -- 172.21.15.32:0/3625422537 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400cda0 con 0x7f6b4c151dc0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b34009420 con 0x7f6b4c151dc0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c0ab290 con 0x7f6b4c151dc0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c06b900 con 0x7f6b4c151dc0 2024-01-19T04:16:25.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.082+0000 7f6b49600640 1 -- 172.21.15.32:0/3625422537 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6b44014480 con 0x7f6b4c151dc0 2024-01-19T04:16:25.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.086+0000 7f6b49600640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b24066500 0x7f6b240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.086+0000 7f6b49600640 1 -- 172.21.15.32:0/3625422537 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6b440843a0 con 0x7f6b4c151dc0 2024-01-19T04:16:25.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.086+0000 7f6b51a00640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b24066500 0x7f6b240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.086+0000 7f6b51a00640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b24066500 0x7f6b240689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000f70 tx=0x7f6b3c007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.090+0000 7f6b49600640 1 -- 172.21.15.32:0/3625422537 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6b44051380 con 0x7f6b4c151dc0 2024-01-19T04:16:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.246+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b4c0c1e90 con 0x7f6b4c151dc0 2024-01-19T04:16:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.246+0000 7f6b49600640 1 -- 172.21.15.32:0/3625422537 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b440549a0 con 0x7f6b4c151dc0 2024-01-19T04:16:25.249 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b24066500 msgr2=0x7f6b240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b24066500 0x7f6b240689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000f70 tx=0x7f6b3c007df0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c151dc0 msgr2=0x7f6b4c153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c151dc0 0x7f6b4c153520 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400efc0 tx=0x7f6b4400c490 comp rx=0 tx=0).stop 2024-01-19T04:16:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 shutdown_connections 2024-01-19T04:16:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6b24066500 0x7f6b240689c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c151dc0 0x7f6b4c153520 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c0c4360 0x7f6b4c14bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 --2- 172.21.15.32:0/3625422537 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6b4c070630 0x7f6b4c1edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 >> 172.21.15.32:0/3625422537 conn(0x7f6b4c0c7d00 msgr2=0x7f6b4c0a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 shutdown_connections 2024-01-19T04:16:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.250+0000 7f6b54400640 1 -- 172.21.15.32:0/3625422537 wait complete. 2024-01-19T04:16:25.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:16:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9260e00640 1 Processor -- start 2024-01-19T04:16:25.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9260e00640 1 -- start start 2024-01-19T04:16:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9260e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c151b80 0x7f925c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9260e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f925c0c6360 0x7f925c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9260e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0c2d30 con 0x7f925c157cc0 2024-01-19T04:16:25.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9260e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c0c34a0 con 0x7f925c0c6360 2024-01-19T04:16:25.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9260e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c155730 con 0x7f925c151b80 2024-01-19T04:16:25.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9259400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f925c157cc0 0x7f925c0c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58876/0 (socket says 172.21.15.32:58876) 2024-01-19T04:16:25.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.414+0000 7f9259400640 1 -- 172.21.15.32:0/3026969208 learned_addr learned my addr 172.21.15.32:0/3026969208 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9259e00640 1 --2- 172.21.15.32:0/3026969208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c151b80 0x7f925c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f925a800640 1 --2- 172.21.15.32:0/3026969208 >> v2:172.21.15.67:3300/0 conn(0x7f925c0c6360 0x7f925c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9258a00640 1 -- 172.21.15.32:0/3026969208 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936721516 0 0) 0x7f925c0c2d30 con 0x7f925c157cc0 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9258a00640 1 -- 172.21.15.32:0/3026969208 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923c003530 con 0x7f925c157cc0 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9258a00640 1 -- 172.21.15.32:0/3026969208 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151554276 0 0) 0x7f923c003530 con 0x7f925c157cc0 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9259e00640 1 -- 172.21.15.32:0/3026969208 >> v2:172.21.15.67:3300/0 conn(0x7f925c0c6360 msgr2=0x7f925c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9259e00640 1 --2- 172.21.15.32:0/3026969208 >> v2:172.21.15.67:3300/0 conn(0x7f925c0c6360 0x7f925c0c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9259e00640 1 -- 172.21.15.32:0/3026969208 >> v1:172.21.15.32:6789/0 conn(0x7f925c157cc0 legacy=0x7f925c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9259e00640 1 -- 172.21.15.32:0/3026969208 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0c3010 con 0x7f925c151b80 2024-01-19T04:16:25.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9259e00640 1 --2- 172.21.15.32:0/3026969208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c151b80 0x7f925c155150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097c0 tx=0x7f924c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c481f1dd4c575af0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9258a00640 1 -- 172.21.15.32:0/3026969208 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244001680 con 0x7f925c151b80 2024-01-19T04:16:25.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9258a00640 1 -- 172.21.15.32:0/3026969208 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c0a7050 con 0x7f925c151b80 2024-01-19T04:16:25.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.418+0000 7f9258a00640 1 -- 172.21.15.32:0/3026969208 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0ab620 con 0x7f925c151b80 2024-01-19T04:16:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- 172.21.15.32:0/3026969208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c151b80 msgr2=0x7f925c155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 --2- 172.21.15.32:0/3026969208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c151b80 0x7f925c155150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097c0 tx=0x7f924c01c370 comp rx=0 tx=0).stop 2024-01-19T04:16:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- 172.21.15.32:0/3026969208 shutdown_connections 2024-01-19T04:16:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 --2- 172.21.15.32:0/3026969208 >> v2:172.21.15.67:3300/0 conn(0x7f925c0c6360 0x7f925c0c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 --2- 172.21.15.32:0/3026969208 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c151b80 0x7f925c155150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- 172.21.15.32:0/3026969208 >> 172.21.15.32:0/3026969208 conn(0x7f925c0c7d40 msgr2=0x7f925c0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:25.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- 172.21.15.32:0/3026969208 shutdown_connections 2024-01-19T04:16:25.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- 172.21.15.32:0/3026969208 wait complete. 2024-01-19T04:16:25.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 Processor -- start 2024-01-19T04:16:25.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- start start 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c0c6360 0x7f925c150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f925c151b80 0x7f925c14f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c157cc0 0x7f925c147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0ac510 con 0x7f925c151b80 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c150540 con 0x7f925c157cc0 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9260e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0ad410 con 0x7f925c0c6360 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9259400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f925c151b80 0x7f925c14f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9259400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f925c151b80 0x7f925c14f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40352/0 (socket says 172.21.15.32:40352) 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.422+0000 7f9259400640 1 -- 172.21.15.32:0/373820870 learned_addr learned my addr 172.21.15.32:0/373820870 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9259e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c0c6360 0x7f925c150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f925a800640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c157cc0 0x7f925c147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9259400640 1 -- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c0c6360 msgr2=0x7f925c150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9259400640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c0c6360 0x7f925c150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9259400640 1 -- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c157cc0 msgr2=0x7f925c147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9259400640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c157cc0 0x7f925c147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9259400640 1 -- 172.21.15.32:0/373820870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c009420 con 0x7f925c151b80 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f925a800640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c157cc0 0x7f925c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9259400640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f925c151b80 0x7f925c14f630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f924400c750 tx=0x7f924400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9252000640 1 -- 172.21.15.32:0/373820870 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244005ae0 con 0x7f925c151b80 2024-01-19T04:16:25.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9252000640 1 -- 172.21.15.32:0/373820870 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9244005c40 con 0x7f925c151b80 2024-01-19T04:16:25.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9252000640 1 -- 172.21.15.32:0/373820870 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244007070 con 0x7f925c151b80 2024-01-19T04:16:25.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c0ad6f0 con 0x7f925c151b80 2024-01-19T04:16:25.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c0aaf90 con 0x7f925c151b80 2024-01-19T04:16:25.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c0ab1b0 con 0x7f925c151b80 2024-01-19T04:16:25.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.426+0000 7f9252000640 1 -- 172.21.15.32:0/373820870 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f92440071d0 con 0x7f925c151b80 2024-01-19T04:16:25.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.430+0000 7f9252000640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9234066530 0x7f92340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.430+0000 7f9252000640 1 -- 172.21.15.32:0/373820870 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f92440848d0 con 0x7f925c151b80 2024-01-19T04:16:25.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.430+0000 7f9259e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9234066530 0x7f92340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.430+0000 7f9259e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9234066530 0x7f92340689f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097c0 tx=0x7f924c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.430+0000 7f9252000640 1 -- 172.21.15.32:0/373820870 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9244051880 con 0x7f925c151b80 2024-01-19T04:16:25.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f925c0749f0 con 0x7f925c151b80 2024-01-19T04:16:25.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9252000640 1 -- 172.21.15.32:0/373820870 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9244054ea0 con 0x7f925c151b80 2024-01-19T04:16:25.591 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9234066530 msgr2=0x7f92340689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9234066530 0x7f92340689f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097c0 tx=0x7f924c0a6000 comp rx=0 tx=0).stop 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f925c151b80 msgr2=0x7f925c14f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f925c151b80 0x7f925c14f630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f924400c750 tx=0x7f924400cc10 comp rx=0 tx=0).stop 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 shutdown_connections 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9234066530 0x7f92340689f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c157cc0 0x7f925c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f925c151b80 0x7f925c14f630 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 --2- 172.21.15.32:0/373820870 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f925c0c6360 0x7f925c150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 >> 172.21.15.32:0/373820870 conn(0x7f925c0c7d40 msgr2=0x7f925c15f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:25.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 shutdown_connections 2024-01-19T04:16:25.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.590+0000 7f9260e00640 1 -- 172.21.15.32:0/373820870 wait complete. 2024-01-19T04:16:25.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:16:25.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.754+0000 7f2e73400640 1 Processor -- start 2024-01-19T04:16:25.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.754+0000 7f2e73400640 1 -- start start 2024-01-19T04:16:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e73400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e6c14eb90 0x7f2e6c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e73400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c072730 con 0x7f2e6c06c670 2024-01-19T04:16:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e73400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c155580 con 0x7f2e6c0720b0 2024-01-19T04:16:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e73400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c072a10 con 0x7f2e6c14eb90 2024-01-19T04:16:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e6be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2e6c06c670 0x7f2e6c0719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58892/0 (socket says 172.21.15.32:58892) 2024-01-19T04:16:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e6be00640 1 -- 172.21.15.32:0/194500132 learned_addr learned my addr 172.21.15.32:0/194500132 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e70a00640 1 --2- 172.21.15.32:0/194500132 >> v2:172.21.15.32:3300/0 conn(0x7f2e6c14eb90 0x7f2e6c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e70a00640 1 -- 172.21.15.32:0/194500132 >> v1:172.21.15.67:6789/0 conn(0x7f2e6c0720b0 legacy=0x7f2e6c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e70a00640 1 -- 172.21.15.32:0/194500132 >> v1:172.21.15.32:6789/0 conn(0x7f2e6c06c670 legacy=0x7f2e6c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e6b400640 1 -- 172.21.15.32:0/194500132 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371702039 0 0) 0x7f2e6c072730 con 0x7f2e6c06c670 2024-01-19T04:16:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.758+0000 7f2e70a00640 1 -- 172.21.15.32:0/194500132 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c155860 con 0x7f2e6c14eb90 2024-01-19T04:16:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e70a00640 1 --2- 172.21.15.32:0/194500132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c14eb90 0x7f2e6c1549d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd93391d62cc0ecc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e6b400640 1 -- 172.21.15.32:0/194500132 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ab600 con 0x7f2e6c14eb90 2024-01-19T04:16:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e6b400640 1 -- 172.21.15.32:0/194500132 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0a7050 con 0x7f2e6c14eb90 2024-01-19T04:16:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e6b400640 1 -- 172.21.15.32:0/194500132 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ab980 con 0x7f2e6c14eb90 2024-01-19T04:16:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 -- 172.21.15.32:0/194500132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c14eb90 msgr2=0x7f2e6c1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 --2- 172.21.15.32:0/194500132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c14eb90 0x7f2e6c1549d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c3b0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 -- 172.21.15.32:0/194500132 shutdown_connections 2024-01-19T04:16:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 --2- 172.21.15.32:0/194500132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c14eb90 0x7f2e6c1549d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 -- 172.21.15.32:0/194500132 >> 172.21.15.32:0/194500132 conn(0x7f2e6c0c25a0 msgr2=0x7f2e6c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 -- 172.21.15.32:0/194500132 shutdown_connections 2024-01-19T04:16:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 -- 172.21.15.32:0/194500132 wait complete. 2024-01-19T04:16:25.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 Processor -- start 2024-01-19T04:16:25.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.762+0000 7f2e73400640 1 -- start start 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c06c670 0x7f2e6c14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e6c0720b0 0x7f2e6c0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e6c14eb90 0x7f2e6c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c14d2a0 con 0x7f2e6c06c670 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c06d230 con 0x7f2e6c0720b0 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c150240 con 0x7f2e6c14eb90 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c06c670 0x7f2e6c14cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c06c670 0x7f2e6c14cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40362/0 (socket says 172.21.15.32:40362) 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 -- 172.21.15.32:0/849600040 learned_addr learned my addr 172.21.15.32:0/849600040 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e6be00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e6c0720b0 0x7f2e6c0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e71400640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e6c14eb90 0x7f2e6c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 -- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e6c14eb90 msgr2=0x7f2e6c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e6c14eb90 0x7f2e6c14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 -- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e6c0720b0 msgr2=0x7f2e6c0bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e6c0720b0 0x7f2e6c0bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 -- 172.21.15.32:0/849600040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009420 con 0x7f2e6c06c670 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e6be00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e6c0720b0 0x7f2e6c0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e70a00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c06c670 0x7f2e6c14cd60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0ae040 tx=0x7f2e5c01abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e68c00640 1 -- 172.21.15.32:0/849600040 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0b7650 con 0x7f2e6c06c670 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e68c00640 1 -- 172.21.15.32:0/849600040 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0b77b0 con 0x7f2e6c06c670 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c14f370 con 0x7f2e6c06c670 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e68c00640 1 -- 172.21.15.32:0/849600040 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0b7b60 con 0x7f2e6c06c670 2024-01-19T04:16:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c14f930 con 0x7f2e6c06c670 2024-01-19T04:16:25.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c0749f0 con 0x7f2e6c06c670 2024-01-19T04:16:25.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.766+0000 7f2e68c00640 1 -- 172.21.15.32:0/849600040 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2e5c0b7cc0 con 0x7f2e6c06c670 2024-01-19T04:16:25.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.770+0000 7f2e68c00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e44066500 0x7f2e440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:25.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.770+0000 7f2e68c00640 1 -- 172.21.15.32:0/849600040 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2e5c0a4e40 con 0x7f2e6c06c670 2024-01-19T04:16:25.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.770+0000 7f2e6be00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e44066500 0x7f2e440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:25.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.770+0000 7f2e6be00640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e44066500 0x7f2e440689c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0bf970 tx=0x7f2e54007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:25.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.774+0000 7f2e68c00640 1 -- 172.21.15.32:0/849600040 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2e5c0ebb30 con 0x7f2e6c06c670 2024-01-19T04:16:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.934+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e6c0c54d0 con 0x7f2e6c06c670 2024-01-19T04:16:25.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.934+0000 7f2e68c00640 1 -- 172.21.15.32:0/849600040 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e5c0ef150 con 0x7f2e6c06c670 2024-01-19T04:16:25.936 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e44066500 msgr2=0x7f2e440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e44066500 0x7f2e440689c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0bf970 tx=0x7f2e54007cb0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c06c670 msgr2=0x7f2e6c14cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c06c670 0x7f2e6c14cd60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0ae040 tx=0x7f2e5c01abf0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 shutdown_connections 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e44066500 0x7f2e440689c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2e6c14eb90 0x7f2e6c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e6c0720b0 0x7f2e6c0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 --2- 172.21.15.32:0/849600040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e6c06c670 0x7f2e6c14cd60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 >> 172.21.15.32:0/849600040 conn(0x7f2e6c0c25a0 msgr2=0x7f2e6c0a6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 shutdown_connections 2024-01-19T04:16:25.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:25.938+0000 7f2e73400640 1 -- 172.21.15.32:0/849600040 wait complete. 2024-01-19T04:16:25.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:16:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c8400640 1 Processor -- start 2024-01-19T04:16:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c8400640 1 -- start start 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c8400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0c00c3230 0x7fe0c00c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c8400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe0c006eeb0 0x7fe0c006f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c8400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00c6470 con 0x7fe0c01565d0 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c8400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00c6ff0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c8400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00c88a0 con 0x7fe0c00c3230 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c6400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe0c006eeb0 0x7fe0c006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c6400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe0c006eeb0 0x7fe0c006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40368/0 (socket says 172.21.15.32:40368) 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c6400640 1 -- 172.21.15.32:0/2342316011 learned_addr learned my addr 172.21.15.32:0/2342316011 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c5000640 1 --2- 172.21.15.32:0/2342316011 >> v2:172.21.15.67:3300/0 conn(0x7fe0c00c3230 0x7fe0c00c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c6400640 1 -- 172.21.15.32:0/2342316011 >> v2:172.21.15.67:3300/0 conn(0x7fe0c00c3230 msgr2=0x7fe0c00c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:26.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c6400640 1 --2- 172.21.15.32:0/2342316011 >> v2:172.21.15.67:3300/0 conn(0x7fe0c00c3230 0x7fe0c00c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c6400640 1 -- 172.21.15.32:0/2342316011 >> v1:172.21.15.67:6789/0 conn(0x7fe0c01565d0 legacy=0x7fe0c00c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.102+0000 7fe0c6400640 1 -- 172.21.15.32:0/2342316011 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00c66c0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c6400640 1 --2- 172.21.15.32:0/2342316011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c006f360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0067390 tx=0x7fe0b801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aff5b2199b0b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0bfe00640 1 -- 172.21.15.32:0/2342316011 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80a5710 con 0x7fe0c006eeb0 2024-01-19T04:16:26.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0bfe00640 1 -- 172.21.15.32:0/2342316011 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b80a5870 con 0x7fe0c006eeb0 2024-01-19T04:16:26.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0bfe00640 1 -- 172.21.15.32:0/2342316011 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80a5c00 con 0x7fe0c006eeb0 2024-01-19T04:16:26.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 -- 172.21.15.32:0/2342316011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 msgr2=0x7fe0c006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 --2- 172.21.15.32:0/2342316011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c006f360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0067390 tx=0x7fe0b801c940 comp rx=0 tx=0).stop 2024-01-19T04:16:26.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 -- 172.21.15.32:0/2342316011 shutdown_connections 2024-01-19T04:16:26.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 --2- 172.21.15.32:0/2342316011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c006f360 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 --2- 172.21.15.32:0/2342316011 >> v2:172.21.15.67:3300/0 conn(0x7fe0c00c3230 0x7fe0c00c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 -- 172.21.15.32:0/2342316011 >> 172.21.15.32:0/2342316011 conn(0x7fe0c00726d0 msgr2=0x7fe0c00663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:26.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 -- 172.21.15.32:0/2342316011 shutdown_connections 2024-01-19T04:16:26.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.106+0000 7fe0c8400640 1 -- 172.21.15.32:0/2342316011 wait complete. 2024-01-19T04:16:26.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 Processor -- start 2024-01-19T04:16:26.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 -- start start 2024-01-19T04:16:26.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0c00c3230 0x7fe0c0154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0c01565d0 0x7fe0c0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01ee210 con 0x7fe0c006eeb0 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c006b8e0 con 0x7fe0c01565d0 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0155010 con 0x7fe0c00c3230 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c015b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40382/0 (socket says 172.21.15.32:40382) 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 -- 172.21.15.32:0/3426880292 learned_addr learned my addr 172.21.15.32:0/3426880292 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5000640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0c00c3230 0x7fe0c0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c6400640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0c01565d0 0x7fe0c0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 -- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0c00c3230 msgr2=0x7fe0c0154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0c00c3230 0x7fe0c0154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 -- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0c01565d0 msgr2=0x7fe0c0154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0c01565d0 0x7fe0c0154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 -- 172.21.15.32:0/3426880292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8009b30 con 0x7fe0c006eeb0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c5a00640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c015b4f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c450 tx=0x7fe0b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0bd600640 1 -- 172.21.15.32:0/3426880292 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00052d0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0bd600640 1 -- 172.21.15.32:0/3426880292 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0005430 con 0x7fe0c006eeb0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c006cfc0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0bd600640 1 -- 172.21.15.32:0/3426880292 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0007260 con 0x7fe0c006eeb0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.110+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c006d580 con 0x7fe0c006eeb0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.114+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c00749f0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.114+0000 7fe0bd600640 1 -- 172.21.15.32:0/3426880292 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe0b00073c0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.114+0000 7fe0bd600640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe098066530 0x7fe0980689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.114+0000 7fe0bd600640 1 -- 172.21.15.32:0/3426880292 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe0b0083ad0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.114+0000 7fe0c5000640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe098066530 0x7fe0980689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.114+0000 7fe0c5000640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe098066530 0x7fe0980689f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0152f60 tx=0x7fe0a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.118+0000 7fe0bd600640 1 -- 172.21.15.32:0/3426880292 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe0b0050ab0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0c0155de0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0bd600640 1 -- 172.21.15.32:0/3426880292 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe0b00540d0 con 0x7fe0c006eeb0 2024-01-19T04:16:26.280 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe098066530 msgr2=0x7fe0980689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe098066530 0x7fe0980689f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0152f60 tx=0x7fe0a8008040 comp rx=0 tx=0).stop 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 msgr2=0x7fe0c015b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c015b4f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c450 tx=0x7fe0b000c910 comp rx=0 tx=0).stop 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 shutdown_connections 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe098066530 0x7fe0980689f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0c01565d0 0x7fe0c0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0c00c3230 0x7fe0c0154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 --2- 172.21.15.32:0/3426880292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0c006eeb0 0x7fe0c015b4f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.278+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 >> 172.21.15.32:0/3426880292 conn(0x7fe0c00726d0 msgr2=0x7fe0c00a90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.282+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 shutdown_connections 2024-01-19T04:16:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.282+0000 7fe0c8400640 1 -- 172.21.15.32:0/3426880292 wait complete. 2024-01-19T04:16:26.302 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:16:26.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3089600640 1 Processor -- start 2024-01-19T04:16:26.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3089600640 1 -- start start 2024-01-19T04:16:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3089600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30840c55d0 0x7f308406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3089600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f30840705b0 0x7f308415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3089600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30840c0eb0 con 0x7f308406cab0 2024-01-19T04:16:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3089600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308406e5c0 con 0x7f30840c55d0 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3089600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30840a5330 con 0x7f30840705b0 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3082000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30840c55d0 0x7f308406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3082a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f308406cab0 0x7f30840c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58896/0 (socket says 172.21.15.32:58896) 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3082a00640 1 -- 172.21.15.32:0/2243454241 learned_addr learned my addr 172.21.15.32:0/2243454241 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3083400640 1 --2- 172.21.15.32:0/2243454241 >> v2:172.21.15.67:3300/0 conn(0x7f30840705b0 0x7f308415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3082000640 1 -- 172.21.15.32:0/2243454241 >> v2:172.21.15.67:3300/0 conn(0x7f30840705b0 msgr2=0x7f308415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3082000640 1 --2- 172.21.15.32:0/2243454241 >> v2:172.21.15.67:3300/0 conn(0x7f30840705b0 0x7f308415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3082000640 1 -- 172.21.15.32:0/2243454241 >> v1:172.21.15.32:6789/0 conn(0x7f308406cab0 legacy=0x7f30840c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3082000640 1 -- 172.21.15.32:0/2243454241 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30841516f0 con 0x7f30840c55d0 2024-01-19T04:16:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.446+0000 7f3081600640 1 -- 172.21.15.32:0/2243454241 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412428818 0 0) 0x7f30840c0eb0 con 0x7f308406cab0 2024-01-19T04:16:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3082000640 1 --2- 172.21.15.32:0/2243454241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840c55d0 0x7f308406ce90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f30840c3660 tx=0x7f306c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e90fbea070682a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3081600640 1 -- 172.21.15.32:0/2243454241 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0ab600 con 0x7f30840c55d0 2024-01-19T04:16:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3081600640 1 -- 172.21.15.32:0/2243454241 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c0a7050 con 0x7f30840c55d0 2024-01-19T04:16:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3081600640 1 -- 172.21.15.32:0/2243454241 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0ab980 con 0x7f30840c55d0 2024-01-19T04:16:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 -- 172.21.15.32:0/2243454241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840c55d0 msgr2=0x7f308406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 --2- 172.21.15.32:0/2243454241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840c55d0 0x7f308406ce90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f30840c3660 tx=0x7f306c01c410 comp rx=0 tx=0).stop 2024-01-19T04:16:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 -- 172.21.15.32:0/2243454241 shutdown_connections 2024-01-19T04:16:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 --2- 172.21.15.32:0/2243454241 >> v2:172.21.15.67:3300/0 conn(0x7f30840705b0 0x7f308415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 --2- 172.21.15.32:0/2243454241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840c55d0 0x7f308406ce90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 -- 172.21.15.32:0/2243454241 >> 172.21.15.32:0/2243454241 conn(0x7f30840c25a0 msgr2=0x7f30840c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 -- 172.21.15.32:0/2243454241 shutdown_connections 2024-01-19T04:16:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.450+0000 7f3089600640 1 -- 172.21.15.32:0/2243454241 wait complete. 2024-01-19T04:16:26.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 Processor -- start 2024-01-19T04:16:26.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 -- start start 2024-01-19T04:16:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f308406cab0 0x7f30840a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840705b0 0x7f3084145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30840c55d0 0x7f30841462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30840a9940 con 0x7f30840705b0 2024-01-19T04:16:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30840ab7e0 con 0x7f308406cab0 2024-01-19T04:16:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308414af40 con 0x7f30840c55d0 2024-01-19T04:16:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840705b0 0x7f3084145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840705b0 0x7f3084145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40402/0 (socket says 172.21.15.32:40402) 2024-01-19T04:16:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 -- 172.21.15.32:0/572387912 learned_addr learned my addr 172.21.15.32:0/572387912 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3083400640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30840c55d0 0x7f30841462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082a00640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f308406cab0 0x7f30840a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 -- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30840c55d0 msgr2=0x7f30841462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30840c55d0 0x7f30841462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 -- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f308406cab0 msgr2=0x7f30840a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f308406cab0 0x7f30840a6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 -- 172.21.15.32:0/572387912 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c009420 con 0x7f30840705b0 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082a00640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f308406cab0 0x7f30840a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3082000640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840705b0 0x7f3084145d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f306c019020 tx=0x7f306c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f307aa00640 1 -- 172.21.15.32:0/572387912 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0b4840 con 0x7f30840705b0 2024-01-19T04:16:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f307aa00640 1 -- 172.21.15.32:0/572387912 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c0b49c0 con 0x7f30840705b0 2024-01-19T04:16:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f307aa00640 1 -- 172.21.15.32:0/572387912 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0b4d70 con 0x7f30840705b0 2024-01-19T04:16:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3084148b60 con 0x7f30840705b0 2024-01-19T04:16:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30840aad00 con 0x7f30840705b0 2024-01-19T04:16:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.454+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30840749f0 con 0x7f30840705b0 2024-01-19T04:16:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.458+0000 7f307aa00640 1 -- 172.21.15.32:0/572387912 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f306c0b2040 con 0x7f30840705b0 2024-01-19T04:16:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.458+0000 7f307aa00640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f305c066500 0x7f305c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.458+0000 7f307aa00640 1 -- 172.21.15.32:0/572387912 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f306c11e440 con 0x7f30840705b0 2024-01-19T04:16:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.458+0000 7f3082a00640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f305c066500 0x7f305c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.458+0000 7f3082a00640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f305c066500 0x7f305c0689c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3074000f70 tx=0x7f3074007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.462+0000 7f307aa00640 1 -- 172.21.15.32:0/572387912 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f306c0eb370 con 0x7f30840705b0 2024-01-19T04:16:26.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f308406d590 con 0x7f30840705b0 2024-01-19T04:16:26.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f307aa00640 1 -- 172.21.15.32:0/572387912 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7f306c0ee990 con 0x7f30840705b0 2024-01-19T04:16:26.627 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:26.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f305c066500 msgr2=0x7f305c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f305c066500 0x7f305c0689c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3074000f70 tx=0x7f3074007c40 comp rx=0 tx=0).stop 2024-01-19T04:16:26.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840705b0 msgr2=0x7f3084145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840705b0 0x7f3084145d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f306c019020 tx=0x7f306c0191b0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 shutdown_connections 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f305c066500 0x7f305c0689c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f30840c55d0 0x7f30841462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30840705b0 0x7f3084145d80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 --2- 172.21.15.32:0/572387912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f308406cab0 0x7f30840a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 >> 172.21.15.32:0/572387912 conn(0x7f30840c25a0 msgr2=0x7f30841491e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 shutdown_connections 2024-01-19T04:16:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.626+0000 7f3089600640 1 -- 172.21.15.32:0/572387912 wait complete. 2024-01-19T04:16:26.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:16:26.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.790+0000 7f7075200640 1 Processor -- start 2024-01-19T04:16:26.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.790+0000 7f7075200640 1 -- start start 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f7075200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7070151f30 0x7f70700c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f7075200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f70700c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f7075200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70700c5b40 con 0x7f707006eb70 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f7075200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70701551e0 con 0x7f7070151f30 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f7075200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7070155710 con 0x7f707006fda0 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7070151f30 0x7f70700c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7070151f30 0x7f70700c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40416/0 (socket says 172.21.15.32:40416) 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 -- 172.21.15.32:0/1875973386 learned_addr learned my addr 172.21.15.32:0/1875973386 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706d400640 1 --2- 172.21.15.32:0/1875973386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f70700c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 -- 172.21.15.32:0/1875973386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 msgr2=0x7f70700c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 --2- 172.21.15.32:0/1875973386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f70700c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 -- 172.21.15.32:0/1875973386 >> v1:172.21.15.67:6789/0 conn(0x7f707006eb70 legacy=0x7f707006f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 -- 172.21.15.32:0/1875973386 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700c3fa0 con 0x7f7070151f30 2024-01-19T04:16:26.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.794+0000 7f706de00640 1 --2- 172.21.15.32:0/1875973386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070151f30 0x7f70700c4430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7060009870 tx=0x7f706001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b012ad95f43cb128 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f706ca00640 1 -- 172.21.15.32:0/1875973386 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70600ac620 con 0x7f7070151f30 2024-01-19T04:16:26.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f706ca00640 1 -- 172.21.15.32:0/1875973386 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70600ac780 con 0x7f7070151f30 2024-01-19T04:16:26.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f706ca00640 1 -- 172.21.15.32:0/1875973386 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70600acb10 con 0x7f7070151f30 2024-01-19T04:16:26.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- 172.21.15.32:0/1875973386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070151f30 msgr2=0x7f70700c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 --2- 172.21.15.32:0/1875973386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070151f30 0x7f70700c4430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7060009870 tx=0x7f706001c4b0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- 172.21.15.32:0/1875973386 shutdown_connections 2024-01-19T04:16:26.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 --2- 172.21.15.32:0/1875973386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f70700c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 --2- 172.21.15.32:0/1875973386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7070151f30 0x7f70700c4430 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- 172.21.15.32:0/1875973386 >> 172.21.15.32:0/1875973386 conn(0x7f70700a9870 msgr2=0x7f70700a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:26.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- 172.21.15.32:0/1875973386 shutdown_connections 2024-01-19T04:16:26.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- 172.21.15.32:0/1875973386 wait complete. 2024-01-19T04:16:26.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 Processor -- start 2024-01-19T04:16:26.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- start start 2024-01-19T04:16:26.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707006eb70 0x7f70701506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f7070147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7070151f30 0x7f7070147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707006d6c0 con 0x7f707006eb70 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7070148c30 con 0x7f7070151f30 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.798+0000 7f7075200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70700be610 con 0x7f707006fda0 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707006eb70 0x7f70701506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707006eb70 0x7f70701506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40424/0 (socket says 172.21.15.32:40424) 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 -- 172.21.15.32:0/3057496176 learned_addr learned my addr 172.21.15.32:0/3057496176 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706d400640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f7070147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706e800640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7070151f30 0x7f7070147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 -- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 msgr2=0x7f7070147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f7070147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 -- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7070151f30 msgr2=0x7f7070147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7070151f30 0x7f7070147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 -- 172.21.15.32:0/3057496176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600094d0 con 0x7f707006eb70 2024-01-19T04:16:26.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f706de00640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707006eb70 0x7f70701506d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f70600af040 tx=0x7f706001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f7066000640 1 -- 172.21.15.32:0/3057496176 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70600b7420 con 0x7f707006eb70 2024-01-19T04:16:26.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f7066000640 1 -- 172.21.15.32:0/3057496176 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70600b75a0 con 0x7f707006eb70 2024-01-19T04:16:26.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70700be8f0 con 0x7f707006eb70 2024-01-19T04:16:26.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f7066000640 1 -- 172.21.15.32:0/3057496176 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70600b7950 con 0x7f707006eb70 2024-01-19T04:16:26.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7070150c10 con 0x7f707006eb70 2024-01-19T04:16:26.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707006d000 con 0x7f707006eb70 2024-01-19T04:16:26.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.802+0000 7f7066000640 1 -- 172.21.15.32:0/3057496176 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f70600b3040 con 0x7f707006eb70 2024-01-19T04:16:26.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.806+0000 7f7066000640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7048066500 0x7f70480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:26.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.806+0000 7f7066000640 1 -- 172.21.15.32:0/3057496176 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f706011e8b0 con 0x7f707006eb70 2024-01-19T04:16:26.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.806+0000 7f706d400640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7048066500 0x7f70480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:26.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.806+0000 7f706d400640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7048066500 0x7f70480689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f707014f100 tx=0x7f7058008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:26.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.810+0000 7f7066000640 1 -- 172.21.15.32:0/3057496176 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f707006d000 con 0x7f707006eb70 2024-01-19T04:16:26.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.982+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f707006d000 con 0x7f707006eb70 2024-01-19T04:16:26.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.982+0000 7f7066000640 1 -- 172.21.15.32:0/3057496176 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f707006d000 con 0x7f707006eb70 2024-01-19T04:16:26.984 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:16:26.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7048066500 msgr2=0x7f70480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7048066500 0x7f70480689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f707014f100 tx=0x7f7058008040 comp rx=0 tx=0).stop 2024-01-19T04:16:26.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707006eb70 msgr2=0x7f70701506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707006eb70 0x7f70701506d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f70600af040 tx=0x7f706001acf0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 shutdown_connections 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7048066500 0x7f70480689c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7070151f30 0x7f7070147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f707006fda0 0x7f7070147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 --2- 172.21.15.32:0/3057496176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707006eb70 0x7f70701506d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 >> 172.21.15.32:0/3057496176 conn(0x7f70700a9870 msgr2=0x7f707015e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 shutdown_connections 2024-01-19T04:16:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:26.986+0000 7f7075200640 1 -- 172.21.15.32:0/3057496176 wait complete. 2024-01-19T04:16:27.006 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-19T04:16:27.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:27.006 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:27.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:16:27.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:27.037 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:16:27.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.226+0000 7f456a600640 1 Processor -- start 2024-01-19T04:16:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f456a600640 1 -- start start 2024-01-19T04:16:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f456a600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f456406bf00 0x7f45640a6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f456a600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640c6580 con 0x7f45640c2160 2024-01-19T04:16:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f456a600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640c6860 con 0x7f45640a5cc0 2024-01-19T04:16:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f456a600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45640c4b10 con 0x7f456406bf00 2024-01-19T04:16:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4563e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f45640c2160 0x7f4564155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58912/0 (socket says 172.21.15.32:58912) 2024-01-19T04:16:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4563e00640 1 -- 172.21.15.32:0/2835803487 learned_addr learned my addr 172.21.15.32:0/2835803487 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4563400640 1 --2- 172.21.15.32:0/2835803487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f456406bf00 0x7f45640a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4562000640 1 -- 172.21.15.32:0/2835803487 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325680613 0 0) 0x7f45640c6580 con 0x7f45640c2160 2024-01-19T04:16:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4562000640 1 -- 172.21.15.32:0/2835803487 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4544003530 con 0x7f45640c2160 2024-01-19T04:16:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4562000640 1 -- 172.21.15.32:0/2835803487 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230212804 0 0) 0x7f45640c6860 con 0x7f45640a5cc0 2024-01-19T04:16:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4562000640 1 -- 172.21.15.32:0/2835803487 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45640c6580 con 0x7f45640a5cc0 2024-01-19T04:16:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4563400640 1 -- 172.21.15.32:0/2835803487 >> v1:172.21.15.67:6789/0 conn(0x7f45640a5cc0 legacy=0x7f45640bbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4563400640 1 -- 172.21.15.32:0/2835803487 >> v1:172.21.15.32:6789/0 conn(0x7f45640c2160 legacy=0x7f4564155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.230+0000 7f4563400640 1 -- 172.21.15.32:0/2835803487 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45640c4d20 con 0x7f456406bf00 2024-01-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f4563400640 1 --2- 172.21.15.32:0/2835803487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f456406bf00 0x7f45640a6210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45540097f0 tx=0x7f455401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85951c676aa580fc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f4562000640 1 -- 172.21.15.32:0/2835803487 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540ac630 con 0x7f456406bf00 2024-01-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f4562000640 1 -- 172.21.15.32:0/2835803487 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45540ac790 con 0x7f456406bf00 2024-01-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f4562000640 1 -- 172.21.15.32:0/2835803487 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540acb00 con 0x7f456406bf00 2024-01-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f456a600640 1 -- 172.21.15.32:0/2835803487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f456406bf00 msgr2=0x7f45640a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f456a600640 1 --2- 172.21.15.32:0/2835803487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f456406bf00 0x7f45640a6210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45540097f0 tx=0x7f455401c4c0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f456a600640 1 -- 172.21.15.32:0/2835803487 shutdown_connections 2024-01-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f456a600640 1 --2- 172.21.15.32:0/2835803487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f456406bf00 0x7f45640a6210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f456a600640 1 -- 172.21.15.32:0/2835803487 >> 172.21.15.32:0/2835803487 conn(0x7f45640c7040 msgr2=0x7f45640c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f456a600640 1 -- 172.21.15.32:0/2835803487 shutdown_connections 2024-01-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.234+0000 7f456a600640 1 -- 172.21.15.32:0/2835803487 wait complete. 2024-01-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 Processor -- start 2024-01-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 -- start start 2024-01-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f456406bf00 0x7f456414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45640a5cc0 0x7f456414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45640c2160 0x7f4564154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45640bd6e0 con 0x7f45640c2160 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45641ede60 con 0x7f456406bf00 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456414f450 con 0x7f45640a5cc0 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45640c2160 0x7f4564154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45640c2160 0x7f4564154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40436/0 (socket says 172.21.15.32:40436) 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 -- 172.21.15.32:0/2453186306 learned_addr learned my addr 172.21.15.32:0/2453186306 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563400640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f456406bf00 0x7f456414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4562a00640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45640a5cc0 0x7f456414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 -- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45640a5cc0 msgr2=0x7f456414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45640a5cc0 0x7f456414ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 -- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f456406bf00 msgr2=0x7f456414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f456406bf00 0x7f456414d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 -- 172.21.15.32:0/2453186306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554009420 con 0x7f45640c2160 2024-01-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f4563e00640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45640c2160 0x7f4564154000 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f455c00cba0 tx=0x7f455c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f455b400640 1 -- 172.21.15.32:0/2453186306 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c00ace0 con 0x7f45640c2160 2024-01-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f455b400640 1 -- 172.21.15.32:0/2453186306 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c00ae40 con 0x7f45640c2160 2024-01-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45641ed0a0 con 0x7f45640c2160 2024-01-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f455b400640 1 -- 172.21.15.32:0/2453186306 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c012620 con 0x7f45640c2160 2024-01-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45641ed660 con 0x7f45640c2160 2024-01-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.238+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45640749f0 con 0x7f45640c2160 2024-01-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.242+0000 7f455b400640 1 -- 172.21.15.32:0/2453186306 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f455c007070 con 0x7f45640c2160 2024-01-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.242+0000 7f455b400640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f453c066530 0x7f453c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.242+0000 7f455b400640 1 -- 172.21.15.32:0/2453186306 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f455c084150 con 0x7f45640c2160 2024-01-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.242+0000 7f4563400640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f453c066530 0x7f453c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.242+0000 7f4563400640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f453c066530 0x7f453c0689f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45540ae000 tx=0x7f45540a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.246+0000 7f455b400640 1 -- 172.21.15.32:0/2453186306 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f455c051130 con 0x7f45640c2160 2024-01-19T04:16:27.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45640bcbe0 con 0x7f45640c2160 2024-01-19T04:16:27.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f455b400640 1 -- 172.21.15.32:0/2453186306 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6177 (secure 0 0 0) 0x7f455c054750 con 0x7f45640c2160 2024-01-19T04:16:27.443 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:27.443 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:49.039759+0000","modified":"2024-01-19T04:15:52.052125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6835/884465323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":884465323},{"type":"v1","addr":"172.21.15.32:6835","nonce":884465323}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:27.443 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 21 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f453c066530 msgr2=0x7f453c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f453c066530 0x7f453c0689f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45540ae000 tx=0x7f45540a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45640c2160 msgr2=0x7f4564154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45640c2160 0x7f4564154000 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f455c00cba0 tx=0x7f455c00a430 comp rx=0 tx=0).stop 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 shutdown_connections 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f453c066530 0x7f453c0689f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45640c2160 0x7f4564154000 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f45640a5cc0 0x7f456414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 --2- 172.21.15.32:0/2453186306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f456406bf00 0x7f456414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 >> 172.21.15.32:0/2453186306 conn(0x7f45640c7040 msgr2=0x7f45640c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 shutdown_connections 2024-01-19T04:16:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.442+0000 7f456a600640 1 -- 172.21.15.32:0/2453186306 wait complete. 2024-01-19T04:16:27.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.602+0000 7f1c82000640 1 Processor -- start 2024-01-19T04:16:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.602+0000 7f1c82000640 1 -- start start 2024-01-19T04:16:27.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c82000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1c7c151f10 0x7f1c7c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c82000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c06f550 0x7f1c7c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c82000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c7c1546b0 0x7f1c7c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c82000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c0c3450 con 0x7f1c7c1546b0 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c82000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c072d40 con 0x7f1c7c151f10 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c82000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c072a60 con 0x7f1c7c06f550 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c7c1546b0 0x7f1c7c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c7c1546b0 0x7f1c7c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40440/0 (socket says 172.21.15.32:40440) 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 -- 172.21.15.32:0/3777234015 learned_addr learned my addr 172.21.15.32:0/3777234015 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7b400640 1 --2- 172.21.15.32:0/3777234015 >> v2:172.21.15.67:3300/0 conn(0x7f1c7c151f10 0x7f1c7c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7aa00640 1 --2- 172.21.15.32:0/3777234015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c06f550 0x7f1c7c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 -- 172.21.15.32:0/3777234015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c06f550 msgr2=0x7f1c7c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 --2- 172.21.15.32:0/3777234015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c06f550 0x7f1c7c0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 -- 172.21.15.32:0/3777234015 >> v2:172.21.15.67:3300/0 conn(0x7f1c7c151f10 msgr2=0x7f1c7c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 --2- 172.21.15.32:0/3777234015 >> v2:172.21.15.67:3300/0 conn(0x7f1c7c151f10 0x7f1c7c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.606+0000 7f1c7be00640 1 -- 172.21.15.32:0/3777234015 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c157dd0 con 0x7f1c7c1546b0 2024-01-19T04:16:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c7be00640 1 --2- 172.21.15.32:0/3777234015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c1546b0 0x7f1c7c154b40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c06b6b0 tx=0x7f1c7401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506af338f961d290 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c7a000640 1 -- 172.21.15.32:0/3777234015 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740090d0 con 0x7f1c7c1546b0 2024-01-19T04:16:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c7a000640 1 -- 172.21.15.32:0/3777234015 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74009230 con 0x7f1c7c1546b0 2024-01-19T04:16:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c7a000640 1 -- 172.21.15.32:0/3777234015 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740a5920 con 0x7f1c7c1546b0 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 -- 172.21.15.32:0/3777234015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c1546b0 msgr2=0x7f1c7c154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 --2- 172.21.15.32:0/3777234015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c1546b0 0x7f1c7c154b40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c06b6b0 tx=0x7f1c7401c880 comp rx=0 tx=0).stop 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 -- 172.21.15.32:0/3777234015 shutdown_connections 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 --2- 172.21.15.32:0/3777234015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c1546b0 0x7f1c7c154b40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 --2- 172.21.15.32:0/3777234015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c06f550 0x7f1c7c0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 --2- 172.21.15.32:0/3777234015 >> v2:172.21.15.67:3300/0 conn(0x7f1c7c151f10 0x7f1c7c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 -- 172.21.15.32:0/3777234015 >> 172.21.15.32:0/3777234015 conn(0x7f1c7c0c7040 msgr2=0x7f1c7c0c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 -- 172.21.15.32:0/3777234015 shutdown_connections 2024-01-19T04:16:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 -- 172.21.15.32:0/3777234015 wait complete. 2024-01-19T04:16:27.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 Processor -- start 2024-01-19T04:16:27.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.610+0000 7f1c82000640 1 -- start start 2024-01-19T04:16:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7c06f550 0x7f1c7c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c151f10 0x7f1c7c0a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c1546b0 0x7f1c7c0a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c06e570 con 0x7f1c7c151f10 2024-01-19T04:16:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c06eaf0 con 0x7f1c7c06f550 2024-01-19T04:16:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c06e810 con 0x7f1c7c1546b0 2024-01-19T04:16:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c151f10 0x7f1c7c0a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c151f10 0x7f1c7c0a6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40448/0 (socket says 172.21.15.32:40448) 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 -- 172.21.15.32:0/2942882700 learned_addr learned my addr 172.21.15.32:0/2942882700 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7b400640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7c06f550 0x7f1c7c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7be00640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c1546b0 0x7f1c7c0a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 -- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c1546b0 msgr2=0x7f1c7c0a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c1546b0 0x7f1c7c0a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 -- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7c06f550 msgr2=0x7f1c7c150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7c06f550 0x7f1c7c150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 -- 172.21.15.32:0/2942882700 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009b30 con 0x7f1c7c151f10 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7be00640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c1546b0 0x7f1c7c0a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:27.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c7aa00640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c151f10 0x7f1c7c0a6800 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e870 tx=0x7f1c6400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c73400640 1 -- 172.21.15.32:0/2942882700 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640095d0 con 0x7f1c7c151f10 2024-01-19T04:16:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c73400640 1 -- 172.21.15.32:0/2942882700 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6400c940 con 0x7f1c7c151f10 2024-01-19T04:16:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c73400640 1 -- 172.21.15.32:0/2942882700 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400ccd0 con 0x7f1c7c151f10 2024-01-19T04:16:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c0a8050 con 0x7f1c7c151f10 2024-01-19T04:16:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c0bd790 con 0x7f1c7c151f10 2024-01-19T04:16:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.614+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c0a8570 con 0x7f1c7c151f10 2024-01-19T04:16:27.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.618+0000 7f1c73400640 1 -- 172.21.15.32:0/2942882700 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1c64013470 con 0x7f1c7c151f10 2024-01-19T04:16:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.618+0000 7f1c73400640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c54066500 0x7f1c540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.618+0000 7f1c73400640 1 -- 172.21.15.32:0/2942882700 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1c640842d0 con 0x7f1c7c151f10 2024-01-19T04:16:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.618+0000 7f1c7b400640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c54066500 0x7f1c540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.618+0000 7f1c7b400640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c54066500 0x7f1c540689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0c10a0 tx=0x7f1c6c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.622+0000 7f1c73400640 1 -- 172.21.15.32:0/2942882700 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1c7c0a8570 con 0x7f1c7c151f10 2024-01-19T04:16:27.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.782+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c7c067340 con 0x7f1c7c151f10 2024-01-19T04:16:27.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c73400640 1 -- 172.21.15.32:0/2942882700 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20134 (secure 0 0 0) 0x7f1c64054de0 con 0x7f1c7c151f10 2024-01-19T04:16:27.787 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:27.787 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:07.630852+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:27.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c54066500 msgr2=0x7f1c540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c54066500 0x7f1c540689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0c10a0 tx=0x7f1c6c009190 comp rx=0 tx=0).stop 2024-01-19T04:16:27.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c151f10 msgr2=0x7f1c7c0a6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c151f10 0x7f1c7c0a6800 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e870 tx=0x7f1c6400ed30 comp rx=0 tx=0).stop 2024-01-19T04:16:27.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 shutdown_connections 2024-01-19T04:16:27.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c54066500 0x7f1c540689c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c7c1546b0 0x7f1c7c0a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c7c151f10 0x7f1c7c0a6800 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 --2- 172.21.15.32:0/2942882700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c7c06f550 0x7f1c7c150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 >> 172.21.15.32:0/2942882700 conn(0x7f1c7c0c7040 msgr2=0x7f1c7c0c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:27.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 shutdown_connections 2024-01-19T04:16:27.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.786+0000 7f1c82000640 1 -- 172.21.15.32:0/2942882700 wait complete. 2024-01-19T04:16:27.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:15:46.886973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:15:48.025571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:16:04.715304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:16:05.165871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:27.810 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:27.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0ee000640 1 Processor -- start 2024-01-19T04:16:27.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0ee000640 1 -- start start 2024-01-19T04:16:27.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0ee000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0e80723b0 0x7ff0e8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0ee000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806d440 0x7ff0e80c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0ee000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80a4ea0 con 0x7ff0e80c2080 2024-01-19T04:16:27.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0ee000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e81524a0 con 0x7ff0e80723b0 2024-01-19T04:16:27.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0ee000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e8152a20 con 0x7ff0e806d440 2024-01-19T04:16:27.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0e80723b0 0x7ff0e8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e6a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff0e80c2080 0x7ff0e8155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:57268/0 (socket says 172.21.15.32:57268) 2024-01-19T04:16:27.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0e80723b0 0x7ff0e8152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:38006/0 (socket says 172.21.15.32:38006) 2024-01-19T04:16:27.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806d440 0x7ff0e80c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e6a00640 1 -- 172.21.15.32:0/780326999 learned_addr learned my addr 172.21.15.32:0/780326999 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:27.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7e00640 1 -- 172.21.15.32:0/780326999 >> v2:172.21.15.67:3300/0 conn(0x7ff0e80723b0 msgr2=0x7ff0e8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:27.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7e00640 1 --2- 172.21.15.32:0/780326999 >> v2:172.21.15.67:3300/0 conn(0x7ff0e80723b0 0x7ff0e8152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7e00640 1 -- 172.21.15.32:0/780326999 >> v1:172.21.15.67:6789/0 conn(0x7ff0e80c2080 legacy=0x7ff0e8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7e00640 1 -- 172.21.15.32:0/780326999 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e81533f0 con 0x7ff0e806d440 2024-01-19T04:16:27.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.954+0000 7ff0e7400640 1 --2- 172.21.15.32:0/780326999 >> v2:172.21.15.67:3300/0 conn(0x7ff0e80723b0 0x7ff0e8152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:27.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0e7e00640 1 --2- 172.21.15.32:0/780326999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806d440 0x7ff0e80c4e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009d90 tx=0x7ff0e001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efe77c67cd96f648 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0e6000640 1 -- 172.21.15.32:0/780326999 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00a5800 con 0x7ff0e806d440 2024-01-19T04:16:27.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0e6000640 1 -- 172.21.15.32:0/780326999 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e00a5960 con 0x7ff0e806d440 2024-01-19T04:16:27.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0e6000640 1 -- 172.21.15.32:0/780326999 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00a5cf0 con 0x7ff0e806d440 2024-01-19T04:16:27.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 -- 172.21.15.32:0/780326999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806d440 msgr2=0x7ff0e80c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 --2- 172.21.15.32:0/780326999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806d440 0x7ff0e80c4e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009d90 tx=0x7ff0e001c830 comp rx=0 tx=0).stop 2024-01-19T04:16:27.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 -- 172.21.15.32:0/780326999 shutdown_connections 2024-01-19T04:16:27.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 --2- 172.21.15.32:0/780326999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e806d440 0x7ff0e80c4e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 --2- 172.21.15.32:0/780326999 >> v2:172.21.15.67:3300/0 conn(0x7ff0e80723b0 0x7ff0e8152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 -- 172.21.15.32:0/780326999 >> 172.21.15.32:0/780326999 conn(0x7ff0e80c25a0 msgr2=0x7ff0e80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:27.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 -- 172.21.15.32:0/780326999 shutdown_connections 2024-01-19T04:16:27.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.958+0000 7ff0ee000640 1 -- 172.21.15.32:0/780326999 wait complete. 2024-01-19T04:16:27.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 Processor -- start 2024-01-19T04:16:27.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 -- start start 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e806d440 0x7ff0e8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e80723b0 0x7ff0e81ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0e80c2080 0x7ff0e81ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81ecfe0 con 0x7ff0e80c2080 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81f09c0 con 0x7ff0e806d440 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81f0ca0 con 0x7ff0e80723b0 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0e80c2080 0x7ff0e81ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0e80c2080 0x7ff0e81ed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45486/0 (socket says 172.21.15.32:45486) 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7400640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e806d440 0x7ff0e8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e6a00640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e80723b0 0x7ff0e81ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7e00640 1 -- 172.21.15.32:0/4264188979 learned_addr learned my addr 172.21.15.32:0/4264188979 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7400640 1 -- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e80723b0 msgr2=0x7ff0e81ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7400640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e80723b0 0x7ff0e81ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7400640 1 -- 172.21.15.32:0/4264188979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0e80c2080 msgr2=0x7ff0e81ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7400640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0e80c2080 0x7ff0e81ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7400640 1 -- 172.21.15.32:0/4264188979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009420 con 0x7ff0e806d440 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e6a00640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e80723b0 0x7ff0e81ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7e00640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0e80c2080 0x7ff0e81ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0e7400640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e806d440 0x7ff0e8070f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800e8e0 tx=0x7ff0d800eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0df400640 1 -- 172.21.15.32:0/4264188979 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800c8e0 con 0x7ff0e806d440 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0df400640 1 -- 172.21.15.32:0/4264188979 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d800ca40 con 0x7ff0e806d440 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0df400640 1 -- 172.21.15.32:0/4264188979 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800cdf0 con 0x7ff0e806d440 2024-01-19T04:16:27.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0009a70 con 0x7ff0e806d440 2024-01-19T04:16:27.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.962+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e81f1260 con 0x7ff0e806d440 2024-01-19T04:16:27.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.966+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e80749f0 con 0x7ff0e806d440 2024-01-19T04:16:27.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.966+0000 7ff0df400640 1 -- 172.21.15.32:0/4264188979 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff0d8013470 con 0x7ff0e806d440 2024-01-19T04:16:27.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.966+0000 7ff0df400640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff0c0066500 0x7ff0c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:27.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.966+0000 7ff0df400640 1 -- 172.21.15.32:0/4264188979 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff0d8084420 con 0x7ff0e806d440 2024-01-19T04:16:27.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.966+0000 7ff0e6a00640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff0c0066500 0x7ff0c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:27.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.966+0000 7ff0e6a00640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff0c0066500 0x7ff0c00689c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0e81545b0 tx=0x7ff0d0007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:27.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:27.970+0000 7ff0df400640 1 -- 172.21.15.32:0/4264188979 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff0d8051400 con 0x7ff0e806d440 2024-01-19T04:16:28.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.130+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0e806d870 con 0x7ff0e806d440 2024-01-19T04:16:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0df400640 1 -- 172.21.15.32:0/4264188979 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0d8054a20 con 0x7ff0e806d440 2024-01-19T04:16:28.134 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:28.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff0c0066500 msgr2=0x7ff0c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff0c0066500 0x7ff0c00689c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0e81545b0 tx=0x7ff0d0007e90 comp rx=0 tx=0).stop 2024-01-19T04:16:28.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e806d440 msgr2=0x7ff0e8070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e806d440 0x7ff0e8070f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800e8e0 tx=0x7ff0d800eda0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 shutdown_connections 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff0c0066500 0x7ff0c00689c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0e80c2080 0x7ff0e81ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0e80723b0 0x7ff0e81ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 --2- 172.21.15.32:0/4264188979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0e806d440 0x7ff0e8070f90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 >> 172.21.15.32:0/4264188979 conn(0x7ff0e80c25a0 msgr2=0x7ff0e814b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 shutdown_connections 2024-01-19T04:16:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.134+0000 7ff0ee000640 1 -- 172.21.15.32:0/4264188979 wait complete. 2024-01-19T04:16:28.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:16:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.298+0000 7f5851200640 1 Processor -- start 2024-01-19T04:16:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.298+0000 7f5851200640 1 -- start start 2024-01-19T04:16:28.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.298+0000 7f5851200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f584c14eb90 0x7f584c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.298+0000 7f5851200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c072730 con 0x7f584c0720b0 2024-01-19T04:16:28.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.298+0000 7f5851200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c155580 con 0x7f584c06c670 2024-01-19T04:16:28.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.298+0000 7f5851200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c072a10 con 0x7f584c14eb90 2024-01-19T04:16:28.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f584a800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f584c0720b0 0x7f584c15bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48174/0 (socket says 172.21.15.32:48174) 2024-01-19T04:16:28.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f584a800640 1 -- 172.21.15.32:0/1152610561 learned_addr learned my addr 172.21.15.32:0/1152610561 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:28.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5849e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f584c14eb90 0x7f584c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5848a00640 1 -- 172.21.15.32:0/1152610561 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908651527 0 0) 0x7f584c072730 con 0x7f584c0720b0 2024-01-19T04:16:28.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5848a00640 1 -- 172.21.15.32:0/1152610561 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f582c003530 con 0x7f584c0720b0 2024-01-19T04:16:28.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5849e00640 1 -- 172.21.15.32:0/1152610561 >> v1:172.21.15.67:6789/0 conn(0x7f584c06c670 legacy=0x7f584c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5849e00640 1 -- 172.21.15.32:0/1152610561 >> v1:172.21.15.32:6789/0 conn(0x7f584c0720b0 legacy=0x7f584c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5849e00640 1 -- 172.21.15.32:0/1152610561 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c155860 con 0x7f584c14eb90 2024-01-19T04:16:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5849e00640 1 --2- 172.21.15.32:0/1152610561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c14eb90 0x7f584c1549d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f583c0097c0 tx=0x7f583c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18855411508f9c5d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5848a00640 1 -- 172.21.15.32:0/1152610561 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0ab600 con 0x7f584c14eb90 2024-01-19T04:16:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5848a00640 1 -- 172.21.15.32:0/1152610561 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0a7050 con 0x7f584c14eb90 2024-01-19T04:16:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.302+0000 7f5848a00640 1 -- 172.21.15.32:0/1152610561 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0ab980 con 0x7f584c14eb90 2024-01-19T04:16:28.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- 172.21.15.32:0/1152610561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c14eb90 msgr2=0x7f584c1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 --2- 172.21.15.32:0/1152610561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c14eb90 0x7f584c1549d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f583c0097c0 tx=0x7f583c01c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- 172.21.15.32:0/1152610561 shutdown_connections 2024-01-19T04:16:28.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 --2- 172.21.15.32:0/1152610561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c14eb90 0x7f584c1549d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- 172.21.15.32:0/1152610561 >> 172.21.15.32:0/1152610561 conn(0x7f584c0c25a0 msgr2=0x7f584c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:28.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- 172.21.15.32:0/1152610561 shutdown_connections 2024-01-19T04:16:28.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- 172.21.15.32:0/1152610561 wait complete. 2024-01-19T04:16:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 Processor -- start 2024-01-19T04:16:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- start start 2024-01-19T04:16:28.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f584c06c670 0x7f584c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c0720b0 0x7f584c150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c14eb90 0x7f584c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0abbb0 con 0x7f584c0720b0 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c150400 con 0x7f584c14eb90 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5851200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0abe00 con 0x7f584c06c670 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5849400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c0720b0 0x7f584c150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5849400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c0720b0 0x7f584c150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45502/0 (socket says 172.21.15.32:45502) 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5849400640 1 -- 172.21.15.32:0/709799350 learned_addr learned my addr 172.21.15.32:0/709799350 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f584a800640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c14eb90 0x7f584c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.306+0000 7f5849e00640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f584c06c670 0x7f584c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5849400640 1 -- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f584c06c670 msgr2=0x7f584c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5849400640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f584c06c670 0x7f584c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5849400640 1 -- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c14eb90 msgr2=0x7f584c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5849400640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c14eb90 0x7f584c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5849400640 1 -- 172.21.15.32:0/709799350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c009420 con 0x7f584c0720b0 2024-01-19T04:16:28.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5849400640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c0720b0 0x7f584c150890 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f583400c370 tx=0x7f583400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5842000640 1 -- 172.21.15.32:0/709799350 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340052d0 con 0x7f584c0720b0 2024-01-19T04:16:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5842000640 1 -- 172.21.15.32:0/709799350 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834005430 con 0x7f584c0720b0 2024-01-19T04:16:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5842000640 1 -- 172.21.15.32:0/709799350 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834007260 con 0x7f584c0720b0 2024-01-19T04:16:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c150150 con 0x7f584c0720b0 2024-01-19T04:16:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c0a8c60 con 0x7f584c0720b0 2024-01-19T04:16:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c0749f0 con 0x7f584c0720b0 2024-01-19T04:16:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5842000640 1 -- 172.21.15.32:0/709799350 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f58340073c0 con 0x7f584c0720b0 2024-01-19T04:16:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5842000640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5824066500 0x7f58240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.310+0000 7f5842000640 1 -- 172.21.15.32:0/709799350 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f58340834f0 con 0x7f584c0720b0 2024-01-19T04:16:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.314+0000 7f5849e00640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5824066500 0x7f58240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.314+0000 7f5849e00640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5824066500 0x7f58240689c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f583c0ad000 tx=0x7f583c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.314+0000 7f5842000640 1 -- 172.21.15.32:0/709799350 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f58340504d0 con 0x7f584c0720b0 2024-01-19T04:16:28.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.474+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f584c150540 con 0x7f584c0720b0 2024-01-19T04:16:28.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.474+0000 7f5842000640 1 -- 172.21.15.32:0/709799350 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5834053af0 con 0x7f584c0720b0 2024-01-19T04:16:28.476 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:28.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5824066500 msgr2=0x7f58240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5824066500 0x7f58240689c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f583c0ad000 tx=0x7f583c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c0720b0 msgr2=0x7f584c150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c0720b0 0x7f584c150890 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f583400c370 tx=0x7f583400c830 comp rx=0 tx=0).stop 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 shutdown_connections 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5824066500 0x7f58240689c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f584c14eb90 0x7f584c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f584c0720b0 0x7f584c150890 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 --2- 172.21.15.32:0/709799350 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f584c06c670 0x7f584c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 >> 172.21.15.32:0/709799350 conn(0x7f584c0c25a0 msgr2=0x7f584c0c11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 shutdown_connections 2024-01-19T04:16:28.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.478+0000 7f5851200640 1 -- 172.21.15.32:0/709799350 wait complete. 2024-01-19T04:16:28.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:16:28.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f14a2200640 1 Processor -- start 2024-01-19T04:16:28.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f14a2200640 1 -- start start 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f14a2200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f149c14eb90 0x7f149c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f14a2200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f149c06c670 0x7f149c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f14a2200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c072730 con 0x7f149c06dbc0 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f14a2200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c072a10 con 0x7f149c06c670 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f14a2200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c14ef70 con 0x7f149c14eb90 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f149c06c670 0x7f149c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f149c06c670 0x7f149c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45506/0 (socket says 172.21.15.32:45506) 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149aa00640 1 -- 172.21.15.32:0/3035260658 learned_addr learned my addr 172.21.15.32:0/3035260658 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:28.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149b400640 1 --2- 172.21.15.32:0/3035260658 >> v2:172.21.15.67:3300/0 conn(0x7f149c14eb90 0x7f149c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149aa00640 1 -- 172.21.15.32:0/3035260658 >> v2:172.21.15.67:3300/0 conn(0x7f149c14eb90 msgr2=0x7f149c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:28.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149aa00640 1 --2- 172.21.15.32:0/3035260658 >> v2:172.21.15.67:3300/0 conn(0x7f149c14eb90 0x7f149c1549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149aa00640 1 -- 172.21.15.32:0/3035260658 >> v1:172.21.15.67:6789/0 conn(0x7f149c06dbc0 legacy=0x7f149c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:28.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.642+0000 7f149aa00640 1 -- 172.21.15.32:0/3035260658 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c155580 con 0x7f149c06c670 2024-01-19T04:16:28.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f149aa00640 1 --2- 172.21.15.32:0/3035260658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06c670 0x7f149c154f10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f149c06fa90 tx=0x7f148401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeedc69e3d620ae3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f149a000640 1 -- 172.21.15.32:0/3035260658 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ab600 con 0x7f149c06c670 2024-01-19T04:16:28.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f149a000640 1 -- 172.21.15.32:0/3035260658 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840a7050 con 0x7f149c06c670 2024-01-19T04:16:28.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f149a000640 1 -- 172.21.15.32:0/3035260658 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ab980 con 0x7f149c06c670 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 -- 172.21.15.32:0/3035260658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06c670 msgr2=0x7f149c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 --2- 172.21.15.32:0/3035260658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06c670 0x7f149c154f10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f149c06fa90 tx=0x7f148401c3a0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 -- 172.21.15.32:0/3035260658 shutdown_connections 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 --2- 172.21.15.32:0/3035260658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06c670 0x7f149c154f10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 --2- 172.21.15.32:0/3035260658 >> v2:172.21.15.67:3300/0 conn(0x7f149c14eb90 0x7f149c1549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 -- 172.21.15.32:0/3035260658 >> 172.21.15.32:0/3035260658 conn(0x7f149c0c25a0 msgr2=0x7f149c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 -- 172.21.15.32:0/3035260658 shutdown_connections 2024-01-19T04:16:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 -- 172.21.15.32:0/3035260658 wait complete. 2024-01-19T04:16:28.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.646+0000 7f14a2200640 1 Processor -- start 2024-01-19T04:16:28.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 -- start start 2024-01-19T04:16:28.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c06c670 0x7f149c1eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06dbc0 0x7f149c1495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c14eb90 0x7f149c149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0a8d20 con 0x7f149c06dbc0 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0a9920 con 0x7f149c14eb90 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0a8a80 con 0x7f149c06c670 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06dbc0 0x7f149c1495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06dbc0 0x7f149c1495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45522/0 (socket says 172.21.15.32:45522) 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 -- 172.21.15.32:0/1282035723 learned_addr learned my addr 172.21.15.32:0/1282035723 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149b400640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c06c670 0x7f149c1eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149be00640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c14eb90 0x7f149c149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 -- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c06c670 msgr2=0x7f149c1eeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c06c670 0x7f149c1eeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 -- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c14eb90 msgr2=0x7f149c149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c14eb90 0x7f149c149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 -- 172.21.15.32:0/1282035723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840094d0 con 0x7f149c06dbc0 2024-01-19T04:16:28.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149be00640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c14eb90 0x7f149c149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:28.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149b400640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c06c670 0x7f149c1eeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:28.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f149aa00640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06dbc0 0x7f149c1495a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f14840ae040 tx=0x7f1484019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f1493400640 1 -- 172.21.15.32:0/1282035723 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840b4640 con 0x7f149c06dbc0 2024-01-19T04:16:28.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f1493400640 1 -- 172.21.15.32:0/1282035723 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840b47c0 con 0x7f149c06dbc0 2024-01-19T04:16:28.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f1493400640 1 -- 172.21.15.32:0/1282035723 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840b4b70 con 0x7f149c06dbc0 2024-01-19T04:16:28.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c1ef580 con 0x7f149c06dbc0 2024-01-19T04:16:28.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c0c4bb0 con 0x7f149c06dbc0 2024-01-19T04:16:28.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.650+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c0a9a90 con 0x7f149c06dbc0 2024-01-19T04:16:28.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.654+0000 7f1493400640 1 -- 172.21.15.32:0/1282035723 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f14840b2070 con 0x7f149c06dbc0 2024-01-19T04:16:28.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.654+0000 7f1493400640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.654+0000 7f1493400640 1 -- 172.21.15.32:0/1282035723 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f148411e0a0 con 0x7f149c06dbc0 2024-01-19T04:16:28.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.654+0000 7f149b400640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.654+0000 7f149b400640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f149c0c1430 tx=0x7f148c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.658+0000 7f1493400640 1 -- 172.21.15.32:0/1282035723 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f14840eafd0 con 0x7f149c06dbc0 2024-01-19T04:16:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.818+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f149c0a54c0 con 0x7f149c06dbc0 2024-01-19T04:16:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.818+0000 7f1493400640 1 -- 172.21.15.32:0/1282035723 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14840ee5f0 con 0x7f149c06dbc0 2024-01-19T04:16:28.820 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 msgr2=0x7f14740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f149c0c1430 tx=0x7f148c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06dbc0 msgr2=0x7f149c1495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06dbc0 0x7f149c1495a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f14840ae040 tx=0x7f1484019140 comp rx=0 tx=0).stop 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 shutdown_connections 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1474066500 0x7f14740689c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f149c14eb90 0x7f149c149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149c06dbc0 0x7f149c1495a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 --2- 172.21.15.32:0/1282035723 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f149c06c670 0x7f149c1eeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 >> 172.21.15.32:0/1282035723 conn(0x7f149c0c25a0 msgr2=0x7f149c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 shutdown_connections 2024-01-19T04:16:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.822+0000 7f14a2200640 1 -- 172.21.15.32:0/1282035723 wait complete. 2024-01-19T04:16:28.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:16:28.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6c000640 1 Processor -- start 2024-01-19T04:16:28.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6c000640 1 -- start start 2024-01-19T04:16:28.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6c000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcf6414eb90 0x7fcf641549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6c000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf64072730 con 0x7fcf640720b0 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6c000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf64155580 con 0x7fcf6406c670 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6c000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf64072a10 con 0x7fcf6414eb90 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf69600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcf6414eb90 0x7fcf641549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6a000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcf640720b0 0x7fcf6415bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48186/0 (socket says 172.21.15.32:48186) 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf6a000640 1 -- 172.21.15.32:0/3172452100 learned_addr learned my addr 172.21.15.32:0/3172452100 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf69600640 1 -- 172.21.15.32:0/3172452100 >> v1:172.21.15.67:6789/0 conn(0x7fcf6406c670 legacy=0x7fcf640719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf69600640 1 -- 172.21.15.32:0/3172452100 >> v1:172.21.15.32:6789/0 conn(0x7fcf640720b0 legacy=0x7fcf6415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.986+0000 7fcf69600640 1 -- 172.21.15.32:0/3172452100 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64155860 con 0x7fcf6414eb90 2024-01-19T04:16:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf69600640 1 --2- 172.21.15.32:0/3172452100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf641549d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcf540097c0 tx=0x7fcf5401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65308fc6199d9146 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf63e00640 1 -- 172.21.15.32:0/3172452100 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540ab600 con 0x7fcf6414eb90 2024-01-19T04:16:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf63e00640 1 -- 172.21.15.32:0/3172452100 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540a7050 con 0x7fcf6414eb90 2024-01-19T04:16:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf63e00640 1 -- 172.21.15.32:0/3172452100 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540ab980 con 0x7fcf6414eb90 2024-01-19T04:16:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf6c000640 1 -- 172.21.15.32:0/3172452100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 msgr2=0x7fcf641549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf6c000640 1 --2- 172.21.15.32:0/3172452100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf641549d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcf540097c0 tx=0x7fcf5401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf6c000640 1 -- 172.21.15.32:0/3172452100 shutdown_connections 2024-01-19T04:16:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf6c000640 1 --2- 172.21.15.32:0/3172452100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf641549d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf6c000640 1 -- 172.21.15.32:0/3172452100 >> 172.21.15.32:0/3172452100 conn(0x7fcf640c25a0 msgr2=0x7fcf640c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:28.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf6c000640 1 -- 172.21.15.32:0/3172452100 shutdown_connections 2024-01-19T04:16:28.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.990+0000 7fcf6c000640 1 -- 172.21.15.32:0/3172452100 wait complete. 2024-01-19T04:16:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 Processor -- start 2024-01-19T04:16:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 -- start start 2024-01-19T04:16:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf6406c670 0x7fcf6414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf640720b0 0x7fcf640a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf640ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6414a340 con 0x7fcf6414eb90 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640aac00 con 0x7fcf6406c670 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6414c920 con 0x7fcf640720b0 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf640ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf640ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45540/0 (socket says 172.21.15.32:45540) 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 -- 172.21.15.32:0/1792568899 learned_addr learned my addr 172.21.15.32:0/1792568899 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf68c00640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf640720b0 0x7fcf640a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf69600640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf6406c670 0x7fcf6414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 -- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf640720b0 msgr2=0x7fcf640a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf640720b0 0x7fcf640a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 -- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf6406c670 msgr2=0x7fcf6414c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf6406c670 0x7fcf6414c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 -- 172.21.15.32:0/1792568899 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009420 con 0x7fcf6414eb90 2024-01-19T04:16:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6a000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf640ab090 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00cb40 tx=0x7fcf5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf61600640 1 -- 172.21.15.32:0/1792568899 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00aca0 con 0x7fcf6414eb90 2024-01-19T04:16:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf61600640 1 -- 172.21.15.32:0/1792568899 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00ae00 con 0x7fcf6414eb90 2024-01-19T04:16:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf61600640 1 -- 172.21.15.32:0/1792568899 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c012600 con 0x7fcf6414eb90 2024-01-19T04:16:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6414a060 con 0x7fcf6414eb90 2024-01-19T04:16:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.994+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf640aa890 con 0x7fcf6414eb90 2024-01-19T04:16:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.998+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf640aad70 con 0x7fcf6414eb90 2024-01-19T04:16:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.998+0000 7fcf61600640 1 -- 172.21.15.32:0/1792568899 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcf5c007070 con 0x7fcf6414eb90 2024-01-19T04:16:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.998+0000 7fcf61600640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcf3c066530 0x7fcf3c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.998+0000 7fcf61600640 1 -- 172.21.15.32:0/1792568899 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcf5c083f10 con 0x7fcf6414eb90 2024-01-19T04:16:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.998+0000 7fcf69600640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcf3c066530 0x7fcf3c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:28.998+0000 7fcf69600640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcf3c066530 0x7fcf3c0689f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf540ad000 tx=0x7fcf54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:29.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.002+0000 7fcf61600640 1 -- 172.21.15.32:0/1792568899 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcf5c050f90 con 0x7fcf6414eb90 2024-01-19T04:16:29.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf640aa410 con 0x7fcf6414eb90 2024-01-19T04:16:29.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf61600640 1 -- 172.21.15.32:0/1792568899 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7fcf640aa410 con 0x7fcf6414eb90 2024-01-19T04:16:29.167 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:29.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcf3c066530 msgr2=0x7fcf3c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcf3c066530 0x7fcf3c0689f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf540ad000 tx=0x7fcf54008040 comp rx=0 tx=0).stop 2024-01-19T04:16:29.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 msgr2=0x7fcf640ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf640ab090 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00cb40 tx=0x7fcf5c00a060 comp rx=0 tx=0).stop 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 shutdown_connections 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcf3c066530 0x7fcf3c0689f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf6414eb90 0x7fcf640ab090 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcf640720b0 0x7fcf640a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 --2- 172.21.15.32:0/1792568899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf6406c670 0x7fcf6414c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 >> 172.21.15.32:0/1792568899 conn(0x7fcf640c25a0 msgr2=0x7fcf64154590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 shutdown_connections 2024-01-19T04:16:29.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.166+0000 7fcf6c000640 1 -- 172.21.15.32:0/1792568899 wait complete. 2024-01-19T04:16:29.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:16:29.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.330+0000 7f4ff7600640 1 Processor -- start 2024-01-19T04:16:29.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.330+0000 7f4ff7600640 1 -- start start 2024-01-19T04:16:29.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff7600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4ff00c55d0 0x7f4ff006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff7600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4ff00705b0 0x7f4ff015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff7600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00c0eb0 con 0x7f4ff006cab0 2024-01-19T04:16:29.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff7600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff006e5c0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff7600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00a5330 con 0x7f4ff00705b0 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4fefe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4ff00c55d0 0x7f4ff006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff4c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4ff006cab0 0x7f4ff00c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48202/0 (socket says 172.21.15.32:48202) 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff4c00640 1 -- 172.21.15.32:0/649984200 learned_addr learned my addr 172.21.15.32:0/649984200 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff5600640 1 --2- 172.21.15.32:0/649984200 >> v2:172.21.15.67:3300/0 conn(0x7f4ff00705b0 0x7f4ff015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4fefe00640 1 -- 172.21.15.32:0/649984200 >> v2:172.21.15.67:3300/0 conn(0x7f4ff00705b0 msgr2=0x7f4ff015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4fefe00640 1 --2- 172.21.15.32:0/649984200 >> v2:172.21.15.67:3300/0 conn(0x7f4ff00705b0 0x7f4ff015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4fefe00640 1 -- 172.21.15.32:0/649984200 >> v1:172.21.15.32:6789/0 conn(0x7f4ff006cab0 legacy=0x7f4ff00c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4fefe00640 1 -- 172.21.15.32:0/649984200 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff01516f0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4ff5600640 1 --2- 172.21.15.32:0/649984200 >> v2:172.21.15.67:3300/0 conn(0x7f4ff00705b0 0x7f4ff015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:29.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4fefe00640 1 --2- 172.21.15.32:0/649984200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff006ce90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00c3660 tx=0x7f4fd801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6544b35eeda72695 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:29.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.334+0000 7f4fef400640 1 -- 172.21.15.32:0/649984200 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80a7070 con 0x7f4ff00c55d0 2024-01-19T04:16:29.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4fef400640 1 -- 172.21.15.32:0/649984200 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd80ab430 con 0x7f4ff00c55d0 2024-01-19T04:16:29.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4fef400640 1 -- 172.21.15.32:0/649984200 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80ab7c0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- 172.21.15.32:0/649984200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 msgr2=0x7f4ff006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 --2- 172.21.15.32:0/649984200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff006ce90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00c3660 tx=0x7f4fd801c430 comp rx=0 tx=0).stop 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- 172.21.15.32:0/649984200 shutdown_connections 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 --2- 172.21.15.32:0/649984200 >> v2:172.21.15.67:3300/0 conn(0x7f4ff00705b0 0x7f4ff015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 --2- 172.21.15.32:0/649984200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff006ce90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- 172.21.15.32:0/649984200 >> 172.21.15.32:0/649984200 conn(0x7f4ff00c25a0 msgr2=0x7f4ff00c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- 172.21.15.32:0/649984200 shutdown_connections 2024-01-19T04:16:29.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- 172.21.15.32:0/649984200 wait complete. 2024-01-19T04:16:29.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 Processor -- start 2024-01-19T04:16:29.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- start start 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ff006cab0 0x7f4ff01ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ff00705b0 0x7f4ff01eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff01f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff01eea30 con 0x7f4ff00c55d0 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff01edfc0 con 0x7f4ff006cab0 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.338+0000 7f4ff7600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00a8ca0 con 0x7f4ff00705b0 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff01f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff01f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45564/0 (socket says 172.21.15.32:45564) 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 -- 172.21.15.32:0/658477960 learned_addr learned my addr 172.21.15.32:0/658477960 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff4c00640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ff006cab0 0x7f4ff01ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4fefe00640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ff00705b0 0x7f4ff01eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 -- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ff00705b0 msgr2=0x7f4ff01eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ff00705b0 0x7f4ff01eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 -- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ff006cab0 msgr2=0x7f4ff01ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ff006cab0 0x7f4ff01ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 -- 172.21.15.32:0/658477960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8009420 con 0x7f4ff00c55d0 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff4c00640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ff006cab0 0x7f4ff01ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4fefe00640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ff00705b0 0x7f4ff01eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff5600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff01f0f90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8007ef0 tx=0x7f4fe800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4fecc00640 1 -- 172.21.15.32:0/658477960 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8003ba0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4fecc00640 1 -- 172.21.15.32:0/658477960 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe800f040 con 0x7f4ff00c55d0 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4fecc00640 1 -- 172.21.15.32:0/658477960 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe800de80 con 0x7f4ff00c55d0 2024-01-19T04:16:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff00a8f80 con 0x7f4ff00c55d0 2024-01-19T04:16:29.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff01f0a70 con 0x7f4ff00c55d0 2024-01-19T04:16:29.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff01f05f0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.342+0000 7f4fecc00640 1 -- 172.21.15.32:0/658477960 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4fe8004030 con 0x7f4ff00c55d0 2024-01-19T04:16:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.346+0000 7f4fecc00640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fc8066500 0x7f4fc80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.346+0000 7f4fecc00640 1 -- 172.21.15.32:0/658477960 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4fe80843d0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.346+0000 7f4ff4c00640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fc8066500 0x7f4fc80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.346+0000 7f4ff4c00640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fc8066500 0x7f4fc80689c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000f70 tx=0x7f4fe0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:29.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.350+0000 7f4fecc00640 1 -- 172.21.15.32:0/658477960 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4ff01f05f0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.514+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f4ff01f05f0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.514+0000 7f4fecc00640 1 -- 172.21.15.32:0/658477960 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7f4ff01f05f0 con 0x7f4ff00c55d0 2024-01-19T04:16:29.517 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fc8066500 msgr2=0x7f4fc80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fc8066500 0x7f4fc80689c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000f70 tx=0x7f4fe0009040 comp rx=0 tx=0).stop 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 msgr2=0x7f4ff01f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff01f0f90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8007ef0 tx=0x7f4fe800d4a0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 shutdown_connections 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4fc8066500 0x7f4fc80689c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ff00c55d0 0x7f4ff01f0f90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ff00705b0 0x7f4ff01eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 --2- 172.21.15.32:0/658477960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ff006cab0 0x7f4ff01ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 >> 172.21.15.32:0/658477960 conn(0x7f4ff00c25a0 msgr2=0x7f4ff00c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 shutdown_connections 2024-01-19T04:16:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.518+0000 7f4ff7600640 1 -- 172.21.15.32:0/658477960 wait complete. 2024-01-19T04:16:29.538 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:29.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.678+0000 7fd095000640 1 Processor -- start 2024-01-19T04:16:29.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.678+0000 7fd095000640 1 -- start start 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd095000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd09006fda0 0x7fd0900c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd095000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd09006eb70 0x7fd09006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd095000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0900c5b40 con 0x7fd090151f30 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd095000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0901551e0 con 0x7fd09006eb70 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd095000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd090155710 con 0x7fd09006fda0 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd090151f30 0x7fd0900c4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48210/0 (socket says 172.21.15.32:48210) 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08de00640 1 -- 172.21.15.32:0/2166007863 learned_addr learned my addr 172.21.15.32:0/2166007863 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08e800640 1 --2- 172.21.15.32:0/2166007863 >> v2:172.21.15.32:3300/0 conn(0x7fd09006eb70 0x7fd09006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08d400640 1 --2- 172.21.15.32:0/2166007863 >> v2:172.21.15.67:3300/0 conn(0x7fd09006fda0 0x7fd0900c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08ca00640 1 -- 172.21.15.32:0/2166007863 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770732197 0 0) 0x7fd0900c5b40 con 0x7fd090151f30 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08ca00640 1 -- 172.21.15.32:0/2166007863 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd070003530 con 0x7fd090151f30 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08e800640 1 -- 172.21.15.32:0/2166007863 >> v2:172.21.15.67:3300/0 conn(0x7fd09006fda0 msgr2=0x7fd0900c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:29.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08e800640 1 --2- 172.21.15.32:0/2166007863 >> v2:172.21.15.67:3300/0 conn(0x7fd09006fda0 0x7fd0900c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08e800640 1 -- 172.21.15.32:0/2166007863 >> v1:172.21.15.32:6789/0 conn(0x7fd090151f30 legacy=0x7fd0900c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.682+0000 7fd08e800640 1 -- 172.21.15.32:0/2166007863 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900c3fa0 con 0x7fd09006eb70 2024-01-19T04:16:29.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd08e800640 1 --2- 172.21.15.32:0/2166007863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd09006eb70 0x7fd09006efc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd09006da70 tx=0x7fd08801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824f1b7da5f17bfc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:29.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd08ca00640 1 -- 172.21.15.32:0/2166007863 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880a5850 con 0x7fd09006eb70 2024-01-19T04:16:29.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd08ca00640 1 -- 172.21.15.32:0/2166007863 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0880a59b0 con 0x7fd09006eb70 2024-01-19T04:16:29.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd08ca00640 1 -- 172.21.15.32:0/2166007863 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880a5d40 con 0x7fd09006eb70 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 -- 172.21.15.32:0/2166007863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd09006eb70 msgr2=0x7fd09006efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 --2- 172.21.15.32:0/2166007863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd09006eb70 0x7fd09006efc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd09006da70 tx=0x7fd08801c880 comp rx=0 tx=0).stop 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 -- 172.21.15.32:0/2166007863 shutdown_connections 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 --2- 172.21.15.32:0/2166007863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd09006eb70 0x7fd09006efc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 --2- 172.21.15.32:0/2166007863 >> v2:172.21.15.67:3300/0 conn(0x7fd09006fda0 0x7fd0900c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 -- 172.21.15.32:0/2166007863 >> 172.21.15.32:0/2166007863 conn(0x7fd0900a9870 msgr2=0x7fd0900a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 -- 172.21.15.32:0/2166007863 shutdown_connections 2024-01-19T04:16:29.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 -- 172.21.15.32:0/2166007863 wait complete. 2024-01-19T04:16:29.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 Processor -- start 2024-01-19T04:16:29.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.686+0000 7fd095000640 1 -- start start 2024-01-19T04:16:29.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd09006eb70 0x7fd0901f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd09006fda0 0x7fd0901f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090151f30 0x7fd0901581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090156050 con 0x7fd090151f30 2024-01-19T04:16:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901f14f0 con 0x7fd09006fda0 2024-01-19T04:16:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09014e910 con 0x7fd09006eb70 2024-01-19T04:16:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090151f30 0x7fd0901581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090151f30 0x7fd0901581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45590/0 (socket says 172.21.15.32:45590) 2024-01-19T04:16:29.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 -- 172.21.15.32:0/1857596035 learned_addr learned my addr 172.21.15.32:0/1857596035 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 -- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd09006eb70 msgr2=0x7fd0901f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd09006eb70 0x7fd0901f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 -- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd09006fda0 msgr2=0x7fd0901f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08d400640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd09006fda0 0x7fd0901f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd09006fda0 0x7fd0901f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 -- 172.21.15.32:0/1857596035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009a70 con 0x7fd090151f30 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08d400640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd09006fda0 0x7fd0901f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd08e800640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090151f30 0x7fd0901581e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd08801a4b0 tx=0x7fd088019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd086000640 1 -- 172.21.15.32:0/1857596035 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880b9650 con 0x7fd090151f30 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd086000640 1 -- 172.21.15.32:0/1857596035 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0880b97b0 con 0x7fd090151f30 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd086000640 1 -- 172.21.15.32:0/1857596035 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880b9b20 con 0x7fd090151f30 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09014dd00 con 0x7fd090151f30 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09014e2c0 con 0x7fd090151f30 2024-01-19T04:16:29.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.690+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0900749f0 con 0x7fd090151f30 2024-01-19T04:16:29.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.694+0000 7fd086000640 1 -- 172.21.15.32:0/1857596035 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd0880b9c80 con 0x7fd090151f30 2024-01-19T04:16:29.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.694+0000 7fd086000640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd068066500 0x7fd0680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:29.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.694+0000 7fd086000640 1 -- 172.21.15.32:0/1857596035 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd08811f2f0 con 0x7fd090151f30 2024-01-19T04:16:29.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.694+0000 7fd08de00640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd068066500 0x7fd0680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:29.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.694+0000 7fd08de00640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd068066500 0x7fd0680689c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd080007fd0 tx=0x7fd080007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:29.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.698+0000 7fd086000640 1 -- 172.21.15.32:0/1857596035 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd0880ec220 con 0x7fd090151f30 2024-01-19T04:16:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.894+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd090067b80 con 0x7fd090151f30 2024-01-19T04:16:29.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.894+0000 7fd086000640 1 -- 172.21.15.32:0/1857596035 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6177 (secure 0 0 0) 0x7fd0880ef840 con 0x7fd090151f30 2024-01-19T04:16:29.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:29.898 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:49.039759+0000","modified":"2024-01-19T04:15:52.052125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6835/884465323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":884465323},{"type":"v1","addr":"172.21.15.32:6835","nonce":884465323}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:29.898 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 21 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd068066500 msgr2=0x7fd0680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd068066500 0x7fd0680689c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd080007fd0 tx=0x7fd080007900 comp rx=0 tx=0).stop 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090151f30 msgr2=0x7fd0901581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090151f30 0x7fd0901581e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd08801a4b0 tx=0x7fd088019620 comp rx=0 tx=0).stop 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 shutdown_connections 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd068066500 0x7fd0680689c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090151f30 0x7fd0901581e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd09006fda0 0x7fd0901f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 --2- 172.21.15.32:0/1857596035 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd09006eb70 0x7fd0901f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 >> 172.21.15.32:0/1857596035 conn(0x7fd0900a9870 msgr2=0x7fd090151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 shutdown_connections 2024-01-19T04:16:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:29.898+0000 7fd095000640 1 -- 172.21.15.32:0/1857596035 wait complete. 2024-01-19T04:16:29.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:30.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.058+0000 7f6c60400640 1 Processor -- start 2024-01-19T04:16:30.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.058+0000 7f6c60400640 1 -- start start 2024-01-19T04:16:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c60400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6c580c55e0 0x7f6c58151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c60400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580c1d40 con 0x7f6c58147f90 2024-01-19T04:16:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c60400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580c0810 con 0x7f6c580c18b0 2024-01-19T04:16:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c60400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5806c5c0 con 0x7f6c580c55e0 2024-01-19T04:16:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5da00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6c58147f90 0x7f6c5806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48226/0 (socket says 172.21.15.32:48226) 2024-01-19T04:16:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5da00640 1 -- 172.21.15.32:0/3398919317 learned_addr learned my addr 172.21.15.32:0/3398919317 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5d000640 1 --2- 172.21.15.32:0/3398919317 >> v2:172.21.15.67:3300/0 conn(0x7f6c580c55e0 0x7f6c58151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148198956 0 0) 0x7f6c580c1d40 con 0x7f6c58147f90 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c38003530 con 0x7f6c58147f90 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3966675376 0 0) 0x7f6c38003530 con 0x7f6c58147f90 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 >> v2:172.21.15.67:3300/0 conn(0x7f6c580c55e0 msgr2=0x7f6c58151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 --2- 172.21.15.32:0/3398919317 >> v2:172.21.15.67:3300/0 conn(0x7f6c580c55e0 0x7f6c58151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 >> v1:172.21.15.67:6789/0 conn(0x7f6c580c18b0 legacy=0x7f6c580a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580c0af0 con 0x7f6c58147f90 2024-01-19T04:16:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f6c48001680 con 0x7f6c58147f90 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 >> v1:172.21.15.32:6789/0 conn(0x7f6c58147f90 legacy=0x7f6c5806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c38003980 0x7f6c38003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c38004380 0x7f6c38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c380050f0 0x7f6c3800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5806c5c0 con 0x7f6c380050f0 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3800e240 con 0x7f6c38003980 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3800e400 con 0x7f6c38004380 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5e400640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c380050f0 0x7f6c3800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5da00640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c38003980 0x7f6c38003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5d000640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c38004380 0x7f6c38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5e400640 1 -- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c38004380 msgr2=0x7f6c38004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5e400640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c38004380 0x7f6c38004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5e400640 1 -- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c38003980 msgr2=0x7f6c38003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5e400640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c38003980 0x7f6c38003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.062+0000 7f6c5e400640 1 -- 172.21.15.32:0/3398919317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38003530 con 0x7f6c380050f0 2024-01-19T04:16:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c5e400640 1 -- 172.21.15.32:0/3398919317 reap_dead start 2024-01-19T04:16:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c5e400640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c380050f0 0x7f6c3800dba0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6c50002010 tx=0x7f6c5001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c130e0f5db66a9e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50003b80 con 0x7f6c380050f0 2024-01-19T04:16:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50003d00 con 0x7f6c380050f0 2024-01-19T04:16:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c57e00640 1 -- 172.21.15.32:0/3398919317 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50005310 con 0x7f6c380050f0 2024-01-19T04:16:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c60400640 1 -- 172.21.15.32:0/3398919317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c380050f0 msgr2=0x7f6c3800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c60400640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c380050f0 0x7f6c3800dba0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6c50002010 tx=0x7f6c5001c890 comp rx=0 tx=0).stop 2024-01-19T04:16:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c60400640 1 -- 172.21.15.32:0/3398919317 shutdown_connections 2024-01-19T04:16:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c60400640 1 --2- 172.21.15.32:0/3398919317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c380050f0 0x7f6c3800dba0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c60400640 1 -- 172.21.15.32:0/3398919317 >> 172.21.15.32:0/3398919317 conn(0x7f6c580c5b20 msgr2=0x7f6c580c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c60400640 1 -- 172.21.15.32:0/3398919317 shutdown_connections 2024-01-19T04:16:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.066+0000 7f6c60400640 1 -- 172.21.15.32:0/3398919317 wait complete. 2024-01-19T04:16:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 Processor -- start 2024-01-19T04:16:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 -- start start 2024-01-19T04:16:30.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c380050f0 0x7f6c580a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c580bb5e0 0x7f6c580bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c581541a0 0x7f6c581448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580aa290 con 0x7f6c580bb5e0 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58152eb0 con 0x7f6c380050f0 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c58153d10 con 0x7f6c581541a0 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c580bb5e0 0x7f6c580bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c580bb5e0 0x7f6c580bf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45604/0 (socket says 172.21.15.32:45604) 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 -- 172.21.15.32:0/1174721068 learned_addr learned my addr 172.21.15.32:0/1174721068 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5da00640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c380050f0 0x7f6c580a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5e400640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c581541a0 0x7f6c581448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 -- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c581541a0 msgr2=0x7f6c581448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c581541a0 0x7f6c581448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 -- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c380050f0 msgr2=0x7f6c580a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c380050f0 0x7f6c580a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 -- 172.21.15.32:0/1174721068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c58153100 con 0x7f6c580bb5e0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c5d000640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c580bb5e0 0x7f6c580bf320 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c40011990 tx=0x7f6c40011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c55600640 1 -- 172.21.15.32:0/1174721068 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40004240 con 0x7f6c580bb5e0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c55600640 1 -- 172.21.15.32:0/1174721068 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c400043a0 con 0x7f6c580bb5e0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c55600640 1 -- 172.21.15.32:0/1174721068 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000fa40 con 0x7f6c580bb5e0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c581533e0 con 0x7f6c580bb5e0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c581539a0 con 0x7f6c580bb5e0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.070+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58153ea0 con 0x7f6c580bb5e0 2024-01-19T04:16:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.074+0000 7f6c55600640 1 -- 172.21.15.32:0/1174721068 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6c4000fba0 con 0x7f6c580bb5e0 2024-01-19T04:16:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.074+0000 7f6c55600640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c30066500 0x7f6c300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.074+0000 7f6c55600640 1 -- 172.21.15.32:0/1174721068 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6c400847d0 con 0x7f6c580bb5e0 2024-01-19T04:16:30.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.074+0000 7f6c5da00640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c30066500 0x7f6c300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.074+0000 7f6c5da00640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c30066500 0x7f6c300689c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6c48000c10 tx=0x7f6c48001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.078+0000 7f6c55600640 1 -- 172.21.15.32:0/1174721068 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6c400517e0 con 0x7f6c580bb5e0 2024-01-19T04:16:30.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.242+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c58153b30 con 0x7f6c580bb5e0 2024-01-19T04:16:30.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.242+0000 7f6c55600640 1 -- 172.21.15.32:0/1174721068 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20134 (secure 0 0 0) 0x7f6c40054e00 con 0x7f6c580bb5e0 2024-01-19T04:16:30.245 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:30.245 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:07.630852+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:30.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c30066500 msgr2=0x7f6c300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c30066500 0x7f6c300689c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6c48000c10 tx=0x7f6c48001440 comp rx=0 tx=0).stop 2024-01-19T04:16:30.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c580bb5e0 msgr2=0x7f6c580bf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c580bb5e0 0x7f6c580bf320 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c40011990 tx=0x7f6c40011d90 comp rx=0 tx=0).stop 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 shutdown_connections 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6c30066500 0x7f6c300689c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6c581541a0 0x7f6c581448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c580bb5e0 0x7f6c580bf320 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 --2- 172.21.15.32:0/1174721068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c380050f0 0x7f6c580a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 >> 172.21.15.32:0/1174721068 conn(0x7f6c580c5b20 msgr2=0x7f6c580c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 shutdown_connections 2024-01-19T04:16:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.246+0000 7f6c60400640 1 -- 172.21.15.32:0/1174721068 wait complete. 2024-01-19T04:16:30.266 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T04:16:30.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:30.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7752c00640 1 Processor -- start 2024-01-19T04:16:30.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7752c00640 1 -- start start 2024-01-19T04:16:30.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7752c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f774c0c4b40 0x7f774c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7752c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c0c5b40 con 0x7f774c06fda0 2024-01-19T04:16:30.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7752c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c0c3fa0 con 0x7f774c151f30 2024-01-19T04:16:30.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7752c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774c1551e0 con 0x7f774c0c4b40 2024-01-19T04:16:30.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7750c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f774c0c4b40 0x7f774c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f774b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f774c06fda0 0x7f774c06eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48230/0 (socket says 172.21.15.32:48230) 2024-01-19T04:16:30.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f774b400640 1 -- 172.21.15.32:0/1975009460 learned_addr learned my addr 172.21.15.32:0/1975009460 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:30.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7750c00640 1 -- 172.21.15.32:0/1975009460 >> v1:172.21.15.67:6789/0 conn(0x7f774c151f30 legacy=0x7f774c0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:30.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7750c00640 1 -- 172.21.15.32:0/1975009460 >> v1:172.21.15.32:6789/0 conn(0x7f774c06fda0 legacy=0x7f774c06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f7750c00640 1 -- 172.21.15.32:0/1975009460 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c0c4f90 con 0x7f774c0c4b40 2024-01-19T04:16:30.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.406+0000 7f774aa00640 1 -- 172.21.15.32:0/1975009460 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500232278 0 0) 0x7f774c0c5b40 con 0x7f774c06fda0 2024-01-19T04:16:30.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7750c00640 1 --2- 172.21.15.32:0/1975009460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c0c4b40 0x7f774c06f280 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7744009d90 tx=0x7f774401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84e4d5a583a75e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f774aa00640 1 -- 172.21.15.32:0/1975009460 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440a5850 con 0x7f774c0c4b40 2024-01-19T04:16:30.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f774aa00640 1 -- 172.21.15.32:0/1975009460 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440a59b0 con 0x7f774c0c4b40 2024-01-19T04:16:30.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f774aa00640 1 -- 172.21.15.32:0/1975009460 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440a5d40 con 0x7f774c0c4b40 2024-01-19T04:16:30.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7752c00640 1 -- 172.21.15.32:0/1975009460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c0c4b40 msgr2=0x7f774c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7752c00640 1 --2- 172.21.15.32:0/1975009460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c0c4b40 0x7f774c06f280 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7744009d90 tx=0x7f774401c880 comp rx=0 tx=0).stop 2024-01-19T04:16:30.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7752c00640 1 -- 172.21.15.32:0/1975009460 shutdown_connections 2024-01-19T04:16:30.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7752c00640 1 --2- 172.21.15.32:0/1975009460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c0c4b40 0x7f774c06f280 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7752c00640 1 -- 172.21.15.32:0/1975009460 >> 172.21.15.32:0/1975009460 conn(0x7f774c0a9870 msgr2=0x7f774c0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:30.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7752c00640 1 -- 172.21.15.32:0/1975009460 shutdown_connections 2024-01-19T04:16:30.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.410+0000 7f7752c00640 1 -- 172.21.15.32:0/1975009460 wait complete. 2024-01-19T04:16:30.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 Processor -- start 2024-01-19T04:16:30.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 -- start start 2024-01-19T04:16:30.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f774c06fda0 0x7f774c14b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f774c0c4b40 0x7f774c0a8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c151f30 0x7f774c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c14bd20 con 0x7f774c151f30 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c14d7c0 con 0x7f774c0c4b40 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774c14c720 con 0x7f774c06fda0 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c151f30 0x7f774c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c151f30 0x7f774c155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45622/0 (socket says 172.21.15.32:45622) 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 -- 172.21.15.32:0/1681617304 learned_addr learned my addr 172.21.15.32:0/1681617304 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f774b400640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f774c0c4b40 0x7f774c0a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f774be00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f774c06fda0 0x7f774c14b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 -- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f774c06fda0 msgr2=0x7f774c14b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f774c06fda0 0x7f774c14b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 -- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f774c0c4b40 msgr2=0x7f774c0a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f774c0c4b40 0x7f774c0a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 -- 172.21.15.32:0/1681617304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7744009a70 con 0x7f774c151f30 2024-01-19T04:16:30.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f774b400640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f774c0c4b40 0x7f774c0a8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:30.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f774be00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f774c06fda0 0x7f774c14b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7750c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c151f30 0x7f774c155a40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f77440b0040 tx=0x7f7744019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7743e00640 1 -- 172.21.15.32:0/1681617304 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440ad850 con 0x7f774c151f30 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7743e00640 1 -- 172.21.15.32:0/1681617304 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440ad9b0 con 0x7f774c151f30 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7743e00640 1 -- 172.21.15.32:0/1681617304 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440add60 con 0x7f774c151f30 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774c14ca00 con 0x7f774c151f30 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.414+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774c14cfc0 con 0x7f774c151f30 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.418+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c0749f0 con 0x7f774c151f30 2024-01-19T04:16:30.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.418+0000 7f7743e00640 1 -- 172.21.15.32:0/1681617304 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f77440b4050 con 0x7f774c151f30 2024-01-19T04:16:30.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.418+0000 7f7743e00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7724066500 0x7f77240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.418+0000 7f7743e00640 1 -- 172.21.15.32:0/1681617304 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f774411f1b0 con 0x7f774c151f30 2024-01-19T04:16:30.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.418+0000 7f774be00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7724066500 0x7f77240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.418+0000 7f774be00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7724066500 0x7f77240689c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f773c00a850 tx=0x7f773c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.422+0000 7f7743e00640 1 -- 172.21.15.32:0/1681617304 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f77440ec110 con 0x7f774c151f30 2024-01-19T04:16:30.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.614+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f774c067b80 con 0x7f774c151f30 2024-01-19T04:16:30.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.614+0000 7f7743e00640 1 -- 172.21.15.32:0/1681617304 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6177 (secure 0 0 0) 0x7f77440ef730 con 0x7f774c151f30 2024-01-19T04:16:30.617 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:30.617 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:49.039759+0000","modified":"2024-01-19T04:15:52.052125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6835/884465323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":884465323},{"type":"v1","addr":"172.21.15.32:6835","nonce":884465323}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:30.618 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 21 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7724066500 msgr2=0x7f77240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7724066500 0x7f77240689c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f773c00a850 tx=0x7f773c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c151f30 msgr2=0x7f774c155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c151f30 0x7f774c155a40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f77440b0040 tx=0x7f7744019620 comp rx=0 tx=0).stop 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 shutdown_connections 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7724066500 0x7f77240689c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c151f30 0x7f774c155a40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f774c0c4b40 0x7f774c0a8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 --2- 172.21.15.32:0/1681617304 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f774c06fda0 0x7f774c14b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 >> 172.21.15.32:0/1681617304 conn(0x7f774c0a9870 msgr2=0x7f774c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 shutdown_connections 2024-01-19T04:16:30.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.618+0000 7f7752c00640 1 -- 172.21.15.32:0/1681617304 wait complete. 2024-01-19T04:16:30.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:30.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c20600640 1 Processor -- start 2024-01-19T04:16:30.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c20600640 1 -- start start 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c20600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5c1814fb50 0x7f5c1806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c20600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180a4ec0 0x7f5c1815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c20600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c18071e80 con 0x7f5c180c04a0 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c20600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c181535c0 con 0x7f5c1814fb50 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c20600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c180726c0 con 0x7f5c180a4ec0 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1d200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5c180c04a0 0x7f5c180c1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48232/0 (socket says 172.21.15.32:48232) 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5c1814fb50 0x7f5c1806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1d200640 1 -- 172.21.15.32:0/3515435244 learned_addr learned my addr 172.21.15.32:0/3515435244 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:30.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1e600640 1 --2- 172.21.15.32:0/3515435244 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180a4ec0 0x7f5c1815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1dc00640 1 -- 172.21.15.32:0/3515435244 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180a4ec0 msgr2=0x7f5c1815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:30.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1dc00640 1 --2- 172.21.15.32:0/3515435244 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180a4ec0 0x7f5c1815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1dc00640 1 -- 172.21.15.32:0/3515435244 >> v1:172.21.15.32:6789/0 conn(0x7f5c180c04a0 legacy=0x7f5c180c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c1dc00640 1 -- 172.21.15.32:0/3515435244 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c180c0a20 con 0x7f5c1814fb50 2024-01-19T04:16:30.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.782+0000 7f5c17e00640 1 -- 172.21.15.32:0/3515435244 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198948580 0 0) 0x7f5c18071e80 con 0x7f5c180c04a0 2024-01-19T04:16:30.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c1dc00640 1 --2- 172.21.15.32:0/3515435244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c1814fb50 0x7f5c1806fec0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097c0 tx=0x7f5c0801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c929723a5b82fe7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c17e00640 1 -- 172.21.15.32:0/3515435244 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080ab600 con 0x7f5c1814fb50 2024-01-19T04:16:30.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c17e00640 1 -- 172.21.15.32:0/3515435244 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080a7050 con 0x7f5c1814fb50 2024-01-19T04:16:30.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c17e00640 1 -- 172.21.15.32:0/3515435244 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080ab980 con 0x7f5c1814fb50 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 -- 172.21.15.32:0/3515435244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c1814fb50 msgr2=0x7f5c1806fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 --2- 172.21.15.32:0/3515435244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c1814fb50 0x7f5c1806fec0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097c0 tx=0x7f5c0801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 -- 172.21.15.32:0/3515435244 shutdown_connections 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 --2- 172.21.15.32:0/3515435244 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180a4ec0 0x7f5c1815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 --2- 172.21.15.32:0/3515435244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c1814fb50 0x7f5c1806fec0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 -- 172.21.15.32:0/3515435244 >> 172.21.15.32:0/3515435244 conn(0x7f5c180c5b20 msgr2=0x7f5c180c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 -- 172.21.15.32:0/3515435244 shutdown_connections 2024-01-19T04:16:30.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.786+0000 7f5c20600640 1 -- 172.21.15.32:0/3515435244 wait complete. 2024-01-19T04:16:30.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 Processor -- start 2024-01-19T04:16:30.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 -- start start 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c180a4ec0 0x7f5c181566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180c04a0 0x7f5c18142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c1814fb50 0x7f5c181ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18149640 con 0x7f5c180a4ec0 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18149e50 con 0x7f5c1814fb50 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c181efaf0 con 0x7f5c180c04a0 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c180a4ec0 0x7f5c181566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c180a4ec0 0x7f5c181566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45630/0 (socket says 172.21.15.32:45630) 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 -- 172.21.15.32:0/1331269649 learned_addr learned my addr 172.21.15.32:0/1331269649 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1d200640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180c04a0 0x7f5c18142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1e600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c1814fb50 0x7f5c181ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 -- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180c04a0 msgr2=0x7f5c18142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180c04a0 0x7f5c18142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 -- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c1814fb50 msgr2=0x7f5c181ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c1814fb50 0x7f5c181ecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 -- 172.21.15.32:0/1331269649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009420 con 0x7f5c180a4ec0 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1e600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c1814fb50 0x7f5c181ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c1dc00640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c180a4ec0 0x7f5c181566c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097c0 tx=0x7f5c0801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c15600640 1 -- 172.21.15.32:0/1331269649 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08006e20 con 0x7f5c180a4ec0 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c15600640 1 -- 172.21.15.32:0/1331269649 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c08004030 con 0x7f5c180a4ec0 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c18149890 con 0x7f5c180a4ec0 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c15600640 1 -- 172.21.15.32:0/1331269649 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080043a0 con 0x7f5c180a4ec0 2024-01-19T04:16:30.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.790+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c181ed490 con 0x7f5c180a4ec0 2024-01-19T04:16:30.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.794+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c181ecc70 con 0x7f5c180a4ec0 2024-01-19T04:16:30.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.794+0000 7f5c15600640 1 -- 172.21.15.32:0/1331269649 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5c080b2050 con 0x7f5c180a4ec0 2024-01-19T04:16:30.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.794+0000 7f5c15600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bf0066500 0x7f5bf00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:30.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.794+0000 7f5c15600640 1 -- 172.21.15.32:0/1331269649 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5c0811e320 con 0x7f5c180a4ec0 2024-01-19T04:16:30.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.794+0000 7f5c1d200640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bf0066500 0x7f5bf00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:30.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.794+0000 7f5c1d200640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bf0066500 0x7f5bf00689c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c180abf10 tx=0x7f5c00007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:30.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.798+0000 7f5c15600640 1 -- 172.21.15.32:0/1331269649 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5c181ecc70 con 0x7f5c180a4ec0 2024-01-19T04:16:30.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.990+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c181ecc70 con 0x7f5c180a4ec0 2024-01-19T04:16:30.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.990+0000 7f5c15600640 1 -- 172.21.15.32:0/1331269649 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6177 (secure 0 0 0) 0x7f5c181ecc70 con 0x7f5c180a4ec0 2024-01-19T04:16:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:30.994 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:15:49.039759+0000","modified":"2024-01-19T04:15:52.052125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5031},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5031":{"gid":5031,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6835/884465323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":884465323},{"type":"v1","addr":"172.21.15.32:6835","nonce":884465323}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:30.994 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 21 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bf0066500 msgr2=0x7f5bf00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bf0066500 0x7f5bf00689c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c180abf10 tx=0x7f5c00007b60 comp rx=0 tx=0).stop 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c180a4ec0 msgr2=0x7f5c181566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c180a4ec0 0x7f5c181566c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097c0 tx=0x7f5c0801ac30 comp rx=0 tx=0).stop 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 shutdown_connections 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bf0066500 0x7f5bf00689c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c1814fb50 0x7f5c181ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5c180c04a0 0x7f5c18142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 --2- 172.21.15.32:0/1331269649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c180a4ec0 0x7f5c181566c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 >> 172.21.15.32:0/1331269649 conn(0x7f5c180c5b20 msgr2=0x7f5c180a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:30.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 shutdown_connections 2024-01-19T04:16:30.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:30.994+0000 7f5c20600640 1 -- 172.21.15.32:0/1331269649 wait complete. 2024-01-19T04:16:31.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.154+0000 7f13c7000640 1 Processor -- start 2024-01-19T04:16:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.154+0000 7f13c7000640 1 -- start start 2024-01-19T04:16:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13c7000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f13c0151de0 0x7f13c00c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13c7000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f13c00a7200 0x7f13c00c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13c7000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c00c41f0 0x7f13c0154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13c7000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c01521c0 con 0x7f13c0151de0 2024-01-19T04:16:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13c7000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c01547e0 con 0x7f13c00a7200 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13c7000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00c1db0 con 0x7f13c00c41f0 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f13c0151de0 0x7f13c00c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f13c0151de0 0x7f13c00c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45640/0 (socket says 172.21.15.32:45640) 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 -- 172.21.15.32:0/1505707624 learned_addr learned my addr 172.21.15.32:0/1505707624 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13c5000640 1 --2- 172.21.15.32:0/1505707624 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c00c41f0 0x7f13c0154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bf400640 1 --2- 172.21.15.32:0/1505707624 >> v2:172.21.15.67:3300/0 conn(0x7f13c00a7200 0x7f13c00c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 -- 172.21.15.32:0/1505707624 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c00c41f0 msgr2=0x7f13c0154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 --2- 172.21.15.32:0/1505707624 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c00c41f0 0x7f13c0154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 -- 172.21.15.32:0/1505707624 >> v2:172.21.15.67:3300/0 conn(0x7f13c00a7200 msgr2=0x7f13c00c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 --2- 172.21.15.32:0/1505707624 >> v2:172.21.15.67:3300/0 conn(0x7f13c00a7200 0x7f13c00c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bfe00640 1 -- 172.21.15.32:0/1505707624 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c006f820 con 0x7f13c0151de0 2024-01-19T04:16:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.158+0000 7f13bf400640 1 --2- 172.21.15.32:0/1505707624 >> v2:172.21.15.67:3300/0 conn(0x7f13c00a7200 0x7f13c00c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13bfe00640 1 --2- 172.21.15.32:0/1505707624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c0151de0 0x7f13c00c1870 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f13c006e870 tx=0x7f13b001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e477d6c55d8ea06e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13bea00640 1 -- 172.21.15.32:0/1505707624 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00ac640 con 0x7f13c0151de0 2024-01-19T04:16:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13bea00640 1 -- 172.21.15.32:0/1505707624 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b00ac7a0 con 0x7f13c0151de0 2024-01-19T04:16:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13bea00640 1 -- 172.21.15.32:0/1505707624 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00acb30 con 0x7f13c0151de0 2024-01-19T04:16:31.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 -- 172.21.15.32:0/1505707624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c0151de0 msgr2=0x7f13c00c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 --2- 172.21.15.32:0/1505707624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c0151de0 0x7f13c00c1870 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f13c006e870 tx=0x7f13b001c440 comp rx=0 tx=0).stop 2024-01-19T04:16:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 -- 172.21.15.32:0/1505707624 shutdown_connections 2024-01-19T04:16:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 --2- 172.21.15.32:0/1505707624 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c00c41f0 0x7f13c0154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 --2- 172.21.15.32:0/1505707624 >> v2:172.21.15.67:3300/0 conn(0x7f13c00a7200 0x7f13c00c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 --2- 172.21.15.32:0/1505707624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c0151de0 0x7f13c00c1870 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 -- 172.21.15.32:0/1505707624 >> 172.21.15.32:0/1505707624 conn(0x7f13c00726d0 msgr2=0x7f13c00663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 -- 172.21.15.32:0/1505707624 shutdown_connections 2024-01-19T04:16:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 -- 172.21.15.32:0/1505707624 wait complete. 2024-01-19T04:16:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 Processor -- start 2024-01-19T04:16:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.162+0000 7f13c7000640 1 -- start start 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c00a7200 0x7f13c0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13c00c41f0 0x7f13c0156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c0151de0 0x7f13c015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c01ed9b0 con 0x7f13c00a7200 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c01edee0 con 0x7f13c00c41f0 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c015b440 con 0x7f13c0151de0 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c00a7200 0x7f13c0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c00a7200 0x7f13c0150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45654/0 (socket says 172.21.15.32:45654) 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 -- 172.21.15.32:0/1783283337 learned_addr learned my addr 172.21.15.32:0/1783283337 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 -- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c0151de0 msgr2=0x7f13c015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c0151de0 0x7f13c015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 -- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13c00c41f0 msgr2=0x7f13c0156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13c00c41f0 0x7f13c0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 -- 172.21.15.32:0/1783283337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00094d0 con 0x7f13c00a7200 2024-01-19T04:16:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13bfe00640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c00a7200 0x7f13c0150340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f13b001aaf0 tx=0x7f13b00191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13b7e00640 1 -- 172.21.15.32:0/1783283337 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00b5640 con 0x7f13c00a7200 2024-01-19T04:16:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13b7e00640 1 -- 172.21.15.32:0/1783283337 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b00b57a0 con 0x7f13c00a7200 2024-01-19T04:16:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13b7e00640 1 -- 172.21.15.32:0/1783283337 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00b5b50 con 0x7f13c00a7200 2024-01-19T04:16:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c01edc00 con 0x7f13c00a7200 2024-01-19T04:16:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c0150900 con 0x7f13c00a7200 2024-01-19T04:16:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c00749f0 con 0x7f13c00a7200 2024-01-19T04:16:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.166+0000 7f13b7e00640 1 -- 172.21.15.32:0/1783283337 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f13b00b3070 con 0x7f13c00a7200 2024-01-19T04:16:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.170+0000 7f13b7e00640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1398066500 0x7f13980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.170+0000 7f13b7e00640 1 -- 172.21.15.32:0/1783283337 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f13b011e690 con 0x7f13c00a7200 2024-01-19T04:16:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.170+0000 7f13bf400640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1398066500 0x7f13980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.170+0000 7f13bf400640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1398066500 0x7f13980689c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f13c006db70 tx=0x7f13a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.174+0000 7f13b7e00640 1 -- 172.21.15.32:0/1783283337 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f13b00eb540 con 0x7f13c00a7200 2024-01-19T04:16:31.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13c00c1650 con 0x7f13c00a7200 2024-01-19T04:16:31.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13b7e00640 1 -- 172.21.15.32:0/1783283337 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20134 (secure 0 0 0) 0x7f13b00eeb60 con 0x7f13c00a7200 2024-01-19T04:16:31.335 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:31.336 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":39,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:07.630852+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:15:46.886973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T04:15:48.025571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1398066500 msgr2=0x7f13980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1398066500 0x7f13980689c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f13c006db70 tx=0x7f13a8008040 comp rx=0 tx=0).stop 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c00a7200 msgr2=0x7f13c0150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c00a7200 0x7f13c0150340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f13b001aaf0 tx=0x7f13b00191e0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 shutdown_connections 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1398066500 0x7f13980689c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f13c0151de0 0x7f13c015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13c00c41f0 0x7f13c0156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 --2- 172.21.15.32:0/1783283337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13c00a7200 0x7f13c0150340 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 >> 172.21.15.32:0/1783283337 conn(0x7f13c00726d0 msgr2=0x7f13c006d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 shutdown_connections 2024-01-19T04:16:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.334+0000 7f13c7000640 1 -- 172.21.15.32:0/1783283337 wait complete. 2024-01-19T04:16:31.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-19T04:16:31.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8887c00640 1 Processor -- start 2024-01-19T04:16:31.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8887c00640 1 -- start start 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8887c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88800c42b0 0x7f88800c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8887c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88800c5740 0x7f88800c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8887c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88800c0c90 con 0x7f888006beb0 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8887c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8880150f90 con 0x7f88800c42b0 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8887c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88800c1660 con 0x7f88800c5740 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8885200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88800c42b0 0x7f88800c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8885c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f888006beb0 0x7f8880154110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48236/0 (socket says 172.21.15.32:48236) 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8885c00640 1 -- 172.21.15.32:0/4021495997 learned_addr learned my addr 172.21.15.32:0/4021495997 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f887fe00640 1 --2- 172.21.15.32:0/4021495997 >> v2:172.21.15.67:3300/0 conn(0x7f88800c5740 0x7f88800c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8885200640 1 -- 172.21.15.32:0/4021495997 >> v2:172.21.15.67:3300/0 conn(0x7f88800c5740 msgr2=0x7f88800c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8885200640 1 --2- 172.21.15.32:0/4021495997 >> v2:172.21.15.67:3300/0 conn(0x7f88800c5740 0x7f88800c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8885200640 1 -- 172.21.15.32:0/4021495997 >> v1:172.21.15.32:6789/0 conn(0x7f888006beb0 legacy=0x7f8880154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.498+0000 7f8885200640 1 -- 172.21.15.32:0/4021495997 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8880150cb0 con 0x7f88800c42b0 2024-01-19T04:16:31.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f8885200640 1 --2- 172.21.15.32:0/4021495997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c42b0 0x7f88800c4690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8880070270 tx=0x7f887001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea1d7836c115a0e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f887f400640 1 -- 172.21.15.32:0/4021495997 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700ab600 con 0x7f88800c42b0 2024-01-19T04:16:31.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f887f400640 1 -- 172.21.15.32:0/4021495997 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88700a7050 con 0x7f88800c42b0 2024-01-19T04:16:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f887f400640 1 -- 172.21.15.32:0/4021495997 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700ab980 con 0x7f88800c42b0 2024-01-19T04:16:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f8887c00640 1 -- 172.21.15.32:0/4021495997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c42b0 msgr2=0x7f88800c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f8887c00640 1 --2- 172.21.15.32:0/4021495997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c42b0 0x7f88800c4690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8880070270 tx=0x7f887001c380 comp rx=0 tx=0).stop 2024-01-19T04:16:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f8887c00640 1 -- 172.21.15.32:0/4021495997 shutdown_connections 2024-01-19T04:16:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f8887c00640 1 --2- 172.21.15.32:0/4021495997 >> v2:172.21.15.67:3300/0 conn(0x7f88800c5740 0x7f88800c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f8887c00640 1 --2- 172.21.15.32:0/4021495997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c42b0 0x7f88800c4690 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.502+0000 7f8887c00640 1 -- 172.21.15.32:0/4021495997 >> 172.21.15.32:0/4021495997 conn(0x7f88800c5b20 msgr2=0x7f88800c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 -- 172.21.15.32:0/4021495997 shutdown_connections 2024-01-19T04:16:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 -- 172.21.15.32:0/4021495997 wait complete. 2024-01-19T04:16:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 Processor -- start 2024-01-19T04:16:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 -- start start 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f888006beb0 0x7f8880143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88800c42b0 0x7f8880142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c5740 0x7f88801432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8880145780 con 0x7f88800c5740 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801edb20 con 0x7f88800c42b0 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8887c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888014f390 con 0x7f888006beb0 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c5740 0x7f88801432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c5740 0x7f88801432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45670/0 (socket says 172.21.15.32:45670) 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 -- 172.21.15.32:0/445737799 learned_addr learned my addr 172.21.15.32:0/445737799 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f887fe00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88800c42b0 0x7f8880142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885200640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f888006beb0 0x7f8880143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 -- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f888006beb0 msgr2=0x7f8880143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f888006beb0 0x7f8880143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 -- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88800c42b0 msgr2=0x7f8880142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88800c42b0 0x7f8880142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 -- 172.21.15.32:0/445737799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870009420 con 0x7f88800c5740 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f8885c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c5740 0x7f88801432b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f887800caa0 tx=0x7f887800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f887cc00640 1 -- 172.21.15.32:0/445737799 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800ab40 con 0x7f88800c5740 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f887cc00640 1 -- 172.21.15.32:0/445737799 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800aca0 con 0x7f88800c5740 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.506+0000 7f887cc00640 1 -- 172.21.15.32:0/445737799 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878012600 con 0x7f88800c5740 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.510+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888014f670 con 0x7f88800c5740 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.510+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8880144160 con 0x7f88800c5740 2024-01-19T04:16:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.510+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88801458c0 con 0x7f88800c5740 2024-01-19T04:16:31.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.510+0000 7f887cc00640 1 -- 172.21.15.32:0/445737799 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8878007070 con 0x7f88800c5740 2024-01-19T04:16:31.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.510+0000 7f887cc00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8858066500 0x7f88580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.510+0000 7f887cc00640 1 -- 172.21.15.32:0/445737799 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8878083f30 con 0x7f88800c5740 2024-01-19T04:16:31.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.510+0000 7f8885200640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8858066500 0x7f88580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.514+0000 7f8885200640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8858066500 0x7f88580689c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f88700ad000 tx=0x7f8870008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.514+0000 7f887cc00640 1 -- 172.21.15.32:0/445737799 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8878050f10 con 0x7f88800c5740 2024-01-19T04:16:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.714+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88800749f0 con 0x7f88800c5740 2024-01-19T04:16:31.717 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-01-19T04:16:31.714+0000 7f2af4c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T04:16:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.718+0000 7f887cc00640 1 -- 172.21.15.32:0/445737799 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8878017020 con 0x7f88800c5740 2024-01-19T04:16:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T04:16:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.718+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8858066500 msgr2=0x7f88580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.718+0000 7f8887c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8858066500 0x7f88580689c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f88700ad000 tx=0x7f8870008040 comp rx=0 tx=0).stop 2024-01-19T04:16:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.718+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c5740 msgr2=0x7f88801432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.718+0000 7f8887c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c5740 0x7f88801432b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f887800caa0 tx=0x7f887800cf60 comp rx=0 tx=0).stop 2024-01-19T04:16:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 shutdown_connections 2024-01-19T04:16:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8858066500 0x7f88580689c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88800c5740 0x7f88801432b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88800c42b0 0x7f8880142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 --2- 172.21.15.32:0/445737799 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f888006beb0 0x7f8880143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 >> 172.21.15.32:0/445737799 conn(0x7f88800c5b20 msgr2=0x7f88800beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 shutdown_connections 2024-01-19T04:16:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.722+0000 7f8887c00640 1 -- 172.21.15.32:0/445737799 wait complete. 2024-01-19T04:16:31.729 INFO:tasks.ceph.mds.a.smithi032.stderr: -3087> 2024-01-19T04:15:52.186+0000 7f3ac1e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:16:31.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-19T04:16:31.776 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-01-19T04:16:31.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 Processor -- start 2024-01-19T04:16:31.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 -- start start 2024-01-19T04:16:31.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff4414eb90 0x7eff441549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff4406c670 0x7eff44154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4406dbc0 0x7eff440719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff44072a10 con 0x7eff4406c670 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4414ef70 con 0x7eff4414eb90 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff48c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff440a4e40 con 0x7eff4406dbc0 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff41400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff4406c670 0x7eff44154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff41400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff4406c670 0x7eff44154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45700/0 (socket says 172.21.15.32:45700) 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.886+0000 7eff41400640 1 -- 172.21.15.32:0/4210157466 learned_addr learned my addr 172.21.15.32:0/4210157466 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff41e00640 1 --2- 172.21.15.32:0/4210157466 >> v2:172.21.15.67:3300/0 conn(0x7eff4414eb90 0x7eff441549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff42800640 1 --2- 172.21.15.32:0/4210157466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4406dbc0 0x7eff440719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff41400640 1 -- 172.21.15.32:0/4210157466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4406dbc0 msgr2=0x7eff440719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:31.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff41400640 1 --2- 172.21.15.32:0/4210157466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4406dbc0 0x7eff440719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff41400640 1 -- 172.21.15.32:0/4210157466 >> v2:172.21.15.67:3300/0 conn(0x7eff4414eb90 msgr2=0x7eff441549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:31.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff41400640 1 --2- 172.21.15.32:0/4210157466 >> v2:172.21.15.67:3300/0 conn(0x7eff4414eb90 0x7eff441549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff41400640 1 -- 172.21.15.32:0/4210157466 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44072730 con 0x7eff4406c670 2024-01-19T04:16:31.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff41400640 1 --2- 172.21.15.32:0/4210157466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406c670 0x7eff44154f10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7eff4406fa90 tx=0x7eff2c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437fd71fee0a9970 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff40a00640 1 -- 172.21.15.32:0/4210157466 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0ab600 con 0x7eff4406c670 2024-01-19T04:16:31.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff40a00640 1 -- 172.21.15.32:0/4210157466 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0a7050 con 0x7eff4406c670 2024-01-19T04:16:31.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.890+0000 7eff40a00640 1 -- 172.21.15.32:0/4210157466 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0ab980 con 0x7eff4406c670 2024-01-19T04:16:31.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- 172.21.15.32:0/4210157466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406c670 msgr2=0x7eff44154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 --2- 172.21.15.32:0/4210157466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406c670 0x7eff44154f10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7eff4406fa90 tx=0x7eff2c01c3b0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- 172.21.15.32:0/4210157466 shutdown_connections 2024-01-19T04:16:31.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 --2- 172.21.15.32:0/4210157466 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4406dbc0 0x7eff440719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 --2- 172.21.15.32:0/4210157466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406c670 0x7eff44154f10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 --2- 172.21.15.32:0/4210157466 >> v2:172.21.15.67:3300/0 conn(0x7eff4414eb90 0x7eff441549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- 172.21.15.32:0/4210157466 >> 172.21.15.32:0/4210157466 conn(0x7eff440c25a0 msgr2=0x7eff440c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:31.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- 172.21.15.32:0/4210157466 shutdown_connections 2024-01-19T04:16:31.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- 172.21.15.32:0/4210157466 wait complete. 2024-01-19T04:16:31.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 Processor -- start 2024-01-19T04:16:31.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- start start 2024-01-19T04:16:31.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4406c670 0x7eff4415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406dbc0 0x7eff441ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4414eb90 0x7eff441eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff44148f60 con 0x7eff4406dbc0 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff44149cd0 con 0x7eff4406c670 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff48c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff44148630 con 0x7eff4414eb90 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406dbc0 0x7eff441ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406dbc0 0x7eff441ee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45712/0 (socket says 172.21.15.32:45712) 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 -- 172.21.15.32:0/1071743583 learned_addr learned my addr 172.21.15.32:0/1071743583 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff42800640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4414eb90 0x7eff441eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41e00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4406c670 0x7eff4415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 -- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4414eb90 msgr2=0x7eff441eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4414eb90 0x7eff441eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 -- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4406c670 msgr2=0x7eff4415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4406c670 0x7eff4415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41400640 1 -- 172.21.15.32:0/1071743583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0094d0 con 0x7eff4406dbc0 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.894+0000 7eff41e00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4406c670 0x7eff4415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:31.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff41400640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406dbc0 0x7eff441ee580 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0ae040 tx=0x7eff44152470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff3a000640 1 -- 172.21.15.32:0/1071743583 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0b4440 con 0x7eff4406dbc0 2024-01-19T04:16:31.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff3a000640 1 -- 172.21.15.32:0/1071743583 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0b45c0 con 0x7eff4406dbc0 2024-01-19T04:16:31.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff3a000640 1 -- 172.21.15.32:0/1071743583 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0b4970 con 0x7eff4406dbc0 2024-01-19T04:16:31.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44148910 con 0x7eff4406dbc0 2024-01-19T04:16:31.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4415a880 con 0x7eff4406dbc0 2024-01-19T04:16:31.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff440749f0 con 0x7eff4406dbc0 2024-01-19T04:16:31.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff3a000640 1 -- 172.21.15.32:0/1071743583 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7eff2c0b2070 con 0x7eff4406dbc0 2024-01-19T04:16:31.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff3a000640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff1c066500 0x7eff1c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:31.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.898+0000 7eff3a000640 1 -- 172.21.15.32:0/1071743583 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6651+0+0 (secure 0 0 0) 0x7eff2c11dfb0 con 0x7eff4406dbc0 2024-01-19T04:16:31.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.902+0000 7eff41e00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff1c066500 0x7eff1c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:31.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.902+0000 7eff41e00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff1c066500 0x7eff1c0689c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7eff34009b30 tx=0x7eff34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:31.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:31.902+0000 7eff3a000640 1 -- 172.21.15.32:0/1071743583 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7eff2c0eae00 con 0x7eff4406dbc0 2024-01-19T04:16:32.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.098+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff440a4b90 con 0x7eff4406dbc0 2024-01-19T04:16:32.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.718+0000 7eff3a000640 1 -- 172.21.15.32:0/1071743583 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7eff2c0ee420 con 0x7eff4406dbc0 2024-01-19T04:16:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff1c066500 msgr2=0x7eff1c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff1c066500 0x7eff1c0689c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7eff34009b30 tx=0x7eff34008040 comp rx=0 tx=0).stop 2024-01-19T04:16:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406dbc0 msgr2=0x7eff441ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406dbc0 0x7eff441ee580 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0ae040 tx=0x7eff44152470 comp rx=0 tx=0).stop 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 shutdown_connections 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff1c066500 0x7eff1c0689c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff4414eb90 0x7eff441eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff4406dbc0 0x7eff441ee580 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 --2- 172.21.15.32:0/1071743583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4406c670 0x7eff4415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 >> 172.21.15.32:0/1071743583 conn(0x7eff440c25a0 msgr2=0x7eff44073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 shutdown_connections 2024-01-19T04:16:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.722+0000 7eff48c00640 1 -- 172.21.15.32:0/1071743583 wait complete. 2024-01-19T04:16:32.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-19T04:16:32.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.938+0000 7fbab9000640 1 Processor -- start 2024-01-19T04:16:32.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.938+0000 7fbab9000640 1 -- start start 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbab414f9a0 0x7fbab40720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab9000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab4072620 0x7fbab406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab9000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab4153140 con 0x7fbab40c20d0 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab9000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab4152530 con 0x7fbab414f9a0 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab9000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4152810 con 0x7fbab4072620 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab1400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbab40c20d0 0x7fbab406c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48244/0 (socket says 172.21.15.32:48244) 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab1400640 1 -- 172.21.15.32:0/2694351878 learned_addr learned my addr 172.21.15.32:0/2694351878 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:32.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab1e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbab414f9a0 0x7fbab40720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:32.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab2800640 1 --2- 172.21.15.32:0/2694351878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab4072620 0x7fbab406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:32.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab0a00640 1 -- 172.21.15.32:0/2694351878 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608141832 0 0) 0x7fbab4153140 con 0x7fbab40c20d0 2024-01-19T04:16:32.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab0a00640 1 -- 172.21.15.32:0/2694351878 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba94003530 con 0x7fbab40c20d0 2024-01-19T04:16:32.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab1e00640 1 -- 172.21.15.32:0/2694351878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab4072620 msgr2=0x7fbab406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:32.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab1e00640 1 --2- 172.21.15.32:0/2694351878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab4072620 0x7fbab406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab1e00640 1 -- 172.21.15.32:0/2694351878 >> v1:172.21.15.32:6789/0 conn(0x7fbab40c20d0 legacy=0x7fbab406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:32.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.942+0000 7fbab1e00640 1 -- 172.21.15.32:0/2694351878 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4152af0 con 0x7fbab414f9a0 2024-01-19T04:16:32.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab1e00640 1 --2- 172.21.15.32:0/2694351878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab414f9a0 0x7fbab40720e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40097c0 tx=0x7fbaa401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3c0426097c07fe server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:32.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab0a00640 1 -- 172.21.15.32:0/2694351878 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40ab600 con 0x7fbab414f9a0 2024-01-19T04:16:32.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab0a00640 1 -- 172.21.15.32:0/2694351878 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa40a7050 con 0x7fbab414f9a0 2024-01-19T04:16:32.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab0a00640 1 -- 172.21.15.32:0/2694351878 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40ab980 con 0x7fbab414f9a0 2024-01-19T04:16:32.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 -- 172.21.15.32:0/2694351878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab414f9a0 msgr2=0x7fbab40720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:32.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 --2- 172.21.15.32:0/2694351878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab414f9a0 0x7fbab40720e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40097c0 tx=0x7fbaa401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 -- 172.21.15.32:0/2694351878 shutdown_connections 2024-01-19T04:16:32.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 --2- 172.21.15.32:0/2694351878 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab4072620 0x7fbab406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 --2- 172.21.15.32:0/2694351878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab414f9a0 0x7fbab40720e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 -- 172.21.15.32:0/2694351878 >> 172.21.15.32:0/2694351878 conn(0x7fbab40c5b40 msgr2=0x7fbab40c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:32.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 -- 172.21.15.32:0/2694351878 shutdown_connections 2024-01-19T04:16:32.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 -- 172.21.15.32:0/2694351878 wait complete. 2024-01-19T04:16:32.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 Processor -- start 2024-01-19T04:16:32.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.946+0000 7fbab9000640 1 -- start start 2024-01-19T04:16:32.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab4072620 0x7fbab40aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:32.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab40c20d0 0x7fbab4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:32.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbab414f9a0 0x7fbab41ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:32.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4153950 con 0x7fbab4072620 2024-01-19T04:16:32.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4072230 con 0x7fbab414f9a0 2024-01-19T04:16:32.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41ecd40 con 0x7fbab40c20d0 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab4072620 0x7fbab40aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab4072620 0x7fbab40aa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45742/0 (socket says 172.21.15.32:45742) 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 -- 172.21.15.32:0/1226909630 learned_addr learned my addr 172.21.15.32:0/1226909630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1400640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab40c20d0 0x7fbab4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab2800640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbab414f9a0 0x7fbab41ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 -- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab40c20d0 msgr2=0x7fbab4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab40c20d0 0x7fbab4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 -- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbab414f9a0 msgr2=0x7fbab41ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbab414f9a0 0x7fbab41ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 -- 172.21.15.32:0/1226909630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4009420 con 0x7fbab4072620 2024-01-19T04:16:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab1e00640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab4072620 0x7fbab40aa2c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ae040 tx=0x7fbaa401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:32.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbaaa000640 1 -- 172.21.15.32:0/1226909630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40b7450 con 0x7fbab4072620 2024-01-19T04:16:32.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbaaa000640 1 -- 172.21.15.32:0/1226909630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa40b75b0 con 0x7fbab4072620 2024-01-19T04:16:32.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab40a9650 con 0x7fbab4072620 2024-01-19T04:16:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbaaa000640 1 -- 172.21.15.32:0/1226909630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40b7960 con 0x7fbab4072620 2024-01-19T04:16:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41ecfe0 con 0x7fbab4072620 2024-01-19T04:16:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab404e980 con 0x7fbab4072620 2024-01-19T04:16:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.950+0000 7fbaaa000640 1 -- 172.21.15.32:0/1226909630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbaa40b7ac0 con 0x7fbab4072620 2024-01-19T04:16:32.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.954+0000 7fbaaa000640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fba8c066500 0x7fba8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:32.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.954+0000 7fbaaa000640 1 -- 172.21.15.32:0/1226909630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fbaa411e880 con 0x7fbab4072620 2024-01-19T04:16:32.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.954+0000 7fbab1400640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fba8c066500 0x7fba8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:32.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.954+0000 7fbab1400640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fba8c066500 0x7fba8c0689c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007fd0 tx=0x7fba9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:32.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:32.958+0000 7fbaaa000640 1 -- 172.21.15.32:0/1226909630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbaa40eb810 con 0x7fbab4072620 2024-01-19T04:16:33.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.118+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbab40c6a30 con 0x7fbab4072620 2024-01-19T04:16:33.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.874+0000 7fbaaa000640 1 -- 172.21.15.32:0/1226909630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbaa40eee30 con 0x7fbab4072620 2024-01-19T04:16:33.879 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-01-19T04:16:33.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fba8c066500 msgr2=0x7fba8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fba8c066500 0x7fba8c0689c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007fd0 tx=0x7fba9c009040 comp rx=0 tx=0).stop 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab4072620 msgr2=0x7fbab40aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab4072620 0x7fbab40aa2c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ae040 tx=0x7fbaa401ac30 comp rx=0 tx=0).stop 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 shutdown_connections 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fba8c066500 0x7fba8c0689c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbab414f9a0 0x7fbab41ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbab40c20d0 0x7fbab4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 --2- 172.21.15.32:0/1226909630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbab4072620 0x7fbab40aa2c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:33.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 >> 172.21.15.32:0/1226909630 conn(0x7fbab40c5b40 msgr2=0x7fbab4150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:33.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.878+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 shutdown_connections 2024-01-19T04:16:33.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:33.882+0000 7fbab9000640 1 -- 172.21.15.32:0/1226909630 wait complete. 2024-01-19T04:16:33.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-19T04:16:34.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.054+0000 7faa55800640 1 Processor -- start 2024-01-19T04:16:34.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.054+0000 7faa55800640 1 -- start start 2024-01-19T04:16:34.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa55800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faa500ad030 0x7faa500c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:34.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa55800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa50153020 con 0x7faa500c7230 2024-01-19T04:16:34.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa55800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa501526f0 con 0x7faa500a6d30 2024-01-19T04:16:34.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa55800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa501524e0 con 0x7faa500ad030 2024-01-19T04:16:34.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa4e000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faa500c7230 0x7faa5015ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48250/0 (socket says 172.21.15.32:48250) 2024-01-19T04:16:34.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa4e000640 1 -- 172.21.15.32:0/4226333580 learned_addr learned my addr 172.21.15.32:0/4226333580 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:34.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa4f400640 1 --2- 172.21.15.32:0/4226333580 >> v2:172.21.15.32:3300/0 conn(0x7faa500ad030 0x7faa500c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:34.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa4d600640 1 -- 172.21.15.32:0/4226333580 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247655914 0 0) 0x7faa50153020 con 0x7faa500c7230 2024-01-19T04:16:34.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa4f400640 1 -- 172.21.15.32:0/4226333580 >> v1:172.21.15.67:6789/0 conn(0x7faa500a6d30 legacy=0x7faa500c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:34.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa4f400640 1 -- 172.21.15.32:0/4226333580 >> v1:172.21.15.32:6789/0 conn(0x7faa500c7230 legacy=0x7faa5015ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:34.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.058+0000 7faa4f400640 1 -- 172.21.15.32:0/4226333580 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa501529d0 con 0x7faa500ad030 2024-01-19T04:16:34.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa4f400640 1 --2- 172.21.15.32:0/4226333580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500ad030 0x7faa500c63d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7faa48009d90 tx=0x7faa4801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a318400e8df14ff server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:34.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa4d600640 1 -- 172.21.15.32:0/4226333580 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a5810 con 0x7faa500ad030 2024-01-19T04:16:34.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa4d600640 1 -- 172.21.15.32:0/4226333580 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480a5970 con 0x7faa500ad030 2024-01-19T04:16:34.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa4d600640 1 -- 172.21.15.32:0/4226333580 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a5d00 con 0x7faa500ad030 2024-01-19T04:16:34.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 -- 172.21.15.32:0/4226333580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500ad030 msgr2=0x7faa500c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:34.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 --2- 172.21.15.32:0/4226333580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500ad030 0x7faa500c63d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7faa48009d90 tx=0x7faa4801c950 comp rx=0 tx=0).stop 2024-01-19T04:16:34.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 -- 172.21.15.32:0/4226333580 shutdown_connections 2024-01-19T04:16:34.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 --2- 172.21.15.32:0/4226333580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500ad030 0x7faa500c63d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 -- 172.21.15.32:0/4226333580 >> 172.21.15.32:0/4226333580 conn(0x7faa500a9af0 msgr2=0x7faa500a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:34.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 -- 172.21.15.32:0/4226333580 shutdown_connections 2024-01-19T04:16:34.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 -- 172.21.15.32:0/4226333580 wait complete. 2024-01-19T04:16:34.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 Processor -- start 2024-01-19T04:16:34.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.062+0000 7faa55800640 1 -- start start 2024-01-19T04:16:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500a6d30 0x7faa501ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa500ad030 0x7faa5006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa500c7230 0x7faa50147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5006ec30 con 0x7faa500a6d30 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501ed9c0 con 0x7faa500c7230 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa501514a0 con 0x7faa500ad030 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500a6d30 0x7faa501ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500a6d30 0x7faa501ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45770/0 (socket says 172.21.15.32:45770) 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 -- 172.21.15.32:0/2427410259 learned_addr learned my addr 172.21.15.32:0/2427410259 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4f400640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa500c7230 0x7faa50147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4e000640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa500ad030 0x7faa5006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 -- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa500ad030 msgr2=0x7faa5006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:34.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa500ad030 0x7faa5006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 -- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa500c7230 msgr2=0x7faa50147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa500c7230 0x7faa50147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 -- 172.21.15.32:0/2427410259 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009a70 con 0x7faa500a6d30 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4f400640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa500c7230 0x7faa50147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa4ea00640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500a6d30 0x7faa501ed480 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7faa4000c530 tx=0x7faa4000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa46a00640 1 -- 172.21.15.32:0/2427410259 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40005220 con 0x7faa500a6d30 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa46a00640 1 -- 172.21.15.32:0/2427410259 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa40005380 con 0x7faa500a6d30 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa500a93f0 con 0x7faa500a6d30 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa46a00640 1 -- 172.21.15.32:0/2427410259 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40007270 con 0x7faa500a6d30 2024-01-19T04:16:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa501eded0 con 0x7faa500a6d30 2024-01-19T04:16:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.066+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50068290 con 0x7faa500a6d30 2024-01-19T04:16:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.070+0000 7faa46a00640 1 -- 172.21.15.32:0/2427410259 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faa400073d0 con 0x7faa500a6d30 2024-01-19T04:16:34.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.070+0000 7faa46a00640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa28066500 0x7faa280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:34.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.070+0000 7faa46a00640 1 -- 172.21.15.32:0/2427410259 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6213+0+0 (secure 0 0 0) 0x7faa400839c0 con 0x7faa500a6d30 2024-01-19T04:16:34.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.070+0000 7faa4e000640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa28066500 0x7faa280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.070+0000 7faa4e000640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa28066500 0x7faa280689c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa5014bdd0 tx=0x7faa38007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:34.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.074+0000 7faa46a00640 1 -- 172.21.15.32:0/2427410259 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faa40050a50 con 0x7faa500a6d30 2024-01-19T04:16:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.234+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa5004e980 con 0x7faa500a6d30 2024-01-19T04:16:34.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.886+0000 7faa46a00640 1 -- 172.21.15.32:0/2427410259 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7faa40054070 con 0x7faa500a6d30 2024-01-19T04:16:34.888 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-01-19T04:16:34.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa28066500 msgr2=0x7faa280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:34.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa28066500 0x7faa280689c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa5014bdd0 tx=0x7faa38007d10 comp rx=0 tx=0).stop 2024-01-19T04:16:34.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500a6d30 msgr2=0x7faa501ed480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:34.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500a6d30 0x7faa501ed480 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7faa4000c530 tx=0x7faa4000c9f0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 shutdown_connections 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa28066500 0x7faa280689c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa500c7230 0x7faa50147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa500ad030 0x7faa5006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 --2- 172.21.15.32:0/2427410259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa500a6d30 0x7faa501ed480 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 >> 172.21.15.32:0/2427410259 conn(0x7faa500a9af0 msgr2=0x7faa500c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 shutdown_connections 2024-01-19T04:16:34.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:34.890+0000 7faa55800640 1 -- 172.21.15.32:0/2427410259 wait complete. 2024-01-19T04:16:34.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:35.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.058+0000 7f6026000640 1 Processor -- start 2024-01-19T04:16:35.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.058+0000 7f6026000640 1 -- start start 2024-01-19T04:16:35.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f6026000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f602014fb50 0x7f602006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f6026000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60200c04a0 0x7f60200c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f6026000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020071e80 con 0x7f60200a4ec0 2024-01-19T04:16:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f6026000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60201535c0 con 0x7f60200c04a0 2024-01-19T04:16:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f6026000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200726c0 con 0x7f602014fb50 2024-01-19T04:16:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60200c04a0 0x7f60200c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f60200a4ec0 0x7f6020155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48266/0 (socket says 172.21.15.32:48266) 2024-01-19T04:16:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601fe00640 1 -- 172.21.15.32:0/2426210367 learned_addr learned my addr 172.21.15.32:0/2426210367 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601f400640 1 --2- 172.21.15.32:0/2426210367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f602014fb50 0x7f602006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601ea00640 1 -- 172.21.15.32:0/2426210367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f602014fb50 msgr2=0x7f602006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601ea00640 1 --2- 172.21.15.32:0/2426210367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f602014fb50 0x7f602006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601ea00640 1 -- 172.21.15.32:0/2426210367 >> v1:172.21.15.32:6789/0 conn(0x7f60200a4ec0 legacy=0x7f6020155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.062+0000 7f601ea00640 1 -- 172.21.15.32:0/2426210367 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200c0a20 con 0x7f60200c04a0 2024-01-19T04:16:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f601ea00640 1 --2- 172.21.15.32:0/2426210367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200c1230 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f60080097f0 tx=0x7f600801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556450850434b3a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f601e000640 1 -- 172.21.15.32:0/2426210367 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080ab600 con 0x7f60200c04a0 2024-01-19T04:16:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f601e000640 1 -- 172.21.15.32:0/2426210367 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080a7050 con 0x7f60200c04a0 2024-01-19T04:16:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f601e000640 1 -- 172.21.15.32:0/2426210367 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080ab980 con 0x7f60200c04a0 2024-01-19T04:16:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 -- 172.21.15.32:0/2426210367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 msgr2=0x7f60200c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 --2- 172.21.15.32:0/2426210367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200c1230 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f60080097f0 tx=0x7f600801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 -- 172.21.15.32:0/2426210367 shutdown_connections 2024-01-19T04:16:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 --2- 172.21.15.32:0/2426210367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200c1230 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 --2- 172.21.15.32:0/2426210367 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f602014fb50 0x7f602006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 -- 172.21.15.32:0/2426210367 >> 172.21.15.32:0/2426210367 conn(0x7f60200c5b20 msgr2=0x7f60200c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 -- 172.21.15.32:0/2426210367 shutdown_connections 2024-01-19T04:16:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.066+0000 7f6026000640 1 -- 172.21.15.32:0/2426210367 wait complete. 2024-01-19T04:16:35.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 Processor -- start 2024-01-19T04:16:35.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 -- start start 2024-01-19T04:16:35.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60200a4ec0 0x7f602014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f602014fb50 0x7f60200aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602014eac0 con 0x7f60200c04a0 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201ee5f0 con 0x7f602014fb50 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6020154ae0 con 0x7f60200a4ec0 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200a9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45788/0 (socket says 172.21.15.32:45788) 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 -- 172.21.15.32:0/1724749025 learned_addr learned my addr 172.21.15.32:0/1724749025 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601f400640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60200a4ec0 0x7f602014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601fe00640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f602014fb50 0x7f60200aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 -- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60200a4ec0 msgr2=0x7f602014de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60200a4ec0 0x7f602014de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 -- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f602014fb50 msgr2=0x7f60200aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f602014fb50 0x7f60200aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 -- 172.21.15.32:0/1724749025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008009420 con 0x7f60200c04a0 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601fe00640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f602014fb50 0x7f60200aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f601ea00640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200a9e10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f600801a020 tx=0x7f6008019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6017400640 1 -- 172.21.15.32:0/1724749025 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080b4410 con 0x7f60200c04a0 2024-01-19T04:16:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6017400640 1 -- 172.21.15.32:0/1724749025 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080b4570 con 0x7f60200c04a0 2024-01-19T04:16:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6017400640 1 -- 172.21.15.32:0/1724749025 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080b4920 con 0x7f60200c04a0 2024-01-19T04:16:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6020154dc0 con 0x7f60200c04a0 2024-01-19T04:16:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602014e350 con 0x7f60200c04a0 2024-01-19T04:16:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.070+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60200749f0 con 0x7f60200c04a0 2024-01-19T04:16:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.074+0000 7f6017400640 1 -- 172.21.15.32:0/1724749025 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f60080b2040 con 0x7f60200c04a0 2024-01-19T04:16:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.074+0000 7f6017400640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ff8066500 0x7f5ff80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.074+0000 7f6017400640 1 -- 172.21.15.32:0/1724749025 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f600811e0c0 con 0x7f60200c04a0 2024-01-19T04:16:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.074+0000 7f601f400640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ff8066500 0x7f5ff80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.074+0000 7f601f400640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ff8066500 0x7f5ff80689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6010009a50 tx=0x7f6010008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.078+0000 7f6017400640 1 -- 172.21.15.32:0/1724749025 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f60080eb1e0 con 0x7f60200c04a0 2024-01-19T04:16:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.238+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60200a7630 con 0x7f60200c04a0 2024-01-19T04:16:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.238+0000 7f6017400640 1 -- 172.21.15.32:0/1724749025 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f60080ee800 con 0x7f60200c04a0 2024-01-19T04:16:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:35.241 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":42,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:34.883767+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6835/884465323":"2024-01-20T04:16:31.717910+0000","172.21.15.32:6833/884465323":"2024-01-20T04:16:31.717910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ff8066500 msgr2=0x7f5ff80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ff8066500 0x7f5ff80689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6010009a50 tx=0x7f6010008040 comp rx=0 tx=0).stop 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 msgr2=0x7f60200a9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200a9e10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f600801a020 tx=0x7f6008019190 comp rx=0 tx=0).stop 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 shutdown_connections 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5ff8066500 0x7f5ff80689c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f602014fb50 0x7f60200aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60200c04a0 0x7f60200a9e10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 --2- 172.21.15.32:0/1724749025 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60200a4ec0 0x7f602014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 >> 172.21.15.32:0/1724749025 conn(0x7f60200c5b20 msgr2=0x7f6020151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 shutdown_connections 2024-01-19T04:16:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.242+0000 7f6026000640 1 -- 172.21.15.32:0/1724749025 wait complete. 2024-01-19T04:16:35.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:16:04.715304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:16:05.165871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:35.263 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:35.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 Processor -- start 2024-01-19T04:16:35.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 -- start start 2024-01-19T04:16:35.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40d81565d0 0x7f40d80c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40d80c82f0 0x7f40d80c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c3770 0x7f40d806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80c6470 con 0x7f40d81565d0 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80c6ff0 con 0x7f40d80c82f0 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40df400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80c88a0 con 0x7f40d80c3770 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40d81565d0 0x7f40d80c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40d81565d0 0x7f40d80c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45800/0 (socket says 172.21.15.32:45800) 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 -- 172.21.15.32:0/2459258086 learned_addr learned my addr 172.21.15.32:0/2459258086 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dd400640 1 --2- 172.21.15.32:0/2459258086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c3770 0x7f40d806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40d7e00640 1 --2- 172.21.15.32:0/2459258086 >> v2:172.21.15.67:3300/0 conn(0x7f40d80c82f0 0x7f40d80c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 -- 172.21.15.32:0/2459258086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c3770 msgr2=0x7f40d806eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:35.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 --2- 172.21.15.32:0/2459258086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c3770 0x7f40d806eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 -- 172.21.15.32:0/2459258086 >> v2:172.21.15.67:3300/0 conn(0x7f40d80c82f0 msgr2=0x7f40d80c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:35.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 --2- 172.21.15.32:0/2459258086 >> v2:172.21.15.67:3300/0 conn(0x7f40d80c82f0 0x7f40d80c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.406+0000 7f40dca00640 1 -- 172.21.15.32:0/2459258086 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80c66c0 con 0x7f40d81565d0 2024-01-19T04:16:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40dca00640 1 --2- 172.21.15.32:0/2459258086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d80c7db0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f40d8067390 tx=0x7f40c801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5903bc9324955f0b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40d7400640 1 -- 172.21.15.32:0/2459258086 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d806fc00 con 0x7f40d81565d0 2024-01-19T04:16:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40d7400640 1 -- 172.21.15.32:0/2459258086 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c80a7050 con 0x7f40d81565d0 2024-01-19T04:16:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40d7400640 1 -- 172.21.15.32:0/2459258086 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80ab820 con 0x7f40d81565d0 2024-01-19T04:16:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 -- 172.21.15.32:0/2459258086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 msgr2=0x7f40d80c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 --2- 172.21.15.32:0/2459258086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d80c7db0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f40d8067390 tx=0x7f40c801c470 comp rx=0 tx=0).stop 2024-01-19T04:16:35.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 -- 172.21.15.32:0/2459258086 shutdown_connections 2024-01-19T04:16:35.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 --2- 172.21.15.32:0/2459258086 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c3770 0x7f40d806eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 --2- 172.21.15.32:0/2459258086 >> v2:172.21.15.67:3300/0 conn(0x7f40d80c82f0 0x7f40d80c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 --2- 172.21.15.32:0/2459258086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d80c7db0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 -- 172.21.15.32:0/2459258086 >> 172.21.15.32:0/2459258086 conn(0x7f40d80726d0 msgr2=0x7f40d80663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:35.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 -- 172.21.15.32:0/2459258086 shutdown_connections 2024-01-19T04:16:35.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.410+0000 7f40df400640 1 -- 172.21.15.32:0/2459258086 wait complete. 2024-01-19T04:16:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 Processor -- start 2024-01-19T04:16:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 -- start start 2024-01-19T04:16:35.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d80c3770 0x7f40d815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c82f0 0x7f40d81f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d81f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d81f0610 con 0x7f40d81565d0 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8153230 con 0x7f40d80c3770 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d81537d0 con 0x7f40d80c82f0 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d81f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d81f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45812/0 (socket says 172.21.15.32:45812) 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 -- 172.21.15.32:0/1882736521 learned_addr learned my addr 172.21.15.32:0/1882736521 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dca00640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d80c3770 0x7f40d815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40d7e00640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c82f0 0x7f40d81f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 -- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c82f0 msgr2=0x7f40d81f0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c82f0 0x7f40d81f0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 -- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d80c3770 msgr2=0x7f40d815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d80c3770 0x7f40d815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 -- 172.21.15.32:0/1882736521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80094d0 con 0x7f40d81565d0 2024-01-19T04:16:35.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40dd400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d81f0fe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f40d0007e60 tx=0x7f40d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40d4c00640 1 -- 172.21.15.32:0/1882736521 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0014620 con 0x7f40d81565d0 2024-01-19T04:16:35.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40d4c00640 1 -- 172.21.15.32:0/1882736521 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000ee90 con 0x7f40d81565d0 2024-01-19T04:16:35.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d80ad2b0 con 0x7f40d81565d0 2024-01-19T04:16:35.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40d4c00640 1 -- 172.21.15.32:0/1882736521 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00149e0 con 0x7f40d81565d0 2024-01-19T04:16:35.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.414+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d806cc80 con 0x7f40d81565d0 2024-01-19T04:16:35.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.418+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d80c2590 con 0x7f40d81565d0 2024-01-19T04:16:35.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.418+0000 7f40d4c00640 1 -- 172.21.15.32:0/1882736521 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f40d0014b40 con 0x7f40d81565d0 2024-01-19T04:16:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.418+0000 7f40d4c00640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40b0066500 0x7f40b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.418+0000 7f40d4c00640 1 -- 172.21.15.32:0/1882736521 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f40d00846d0 con 0x7f40d81565d0 2024-01-19T04:16:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.418+0000 7f40dca00640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40b0066500 0x7f40b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.418+0000 7f40dca00640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40b0066500 0x7f40b00689c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f40d80c4610 tx=0x7f40c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.422+0000 7f40d4c00640 1 -- 172.21.15.32:0/1882736521 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f40d00519c0 con 0x7f40d81565d0 2024-01-19T04:16:35.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.586+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40d80749f0 con 0x7f40d81565d0 2024-01-19T04:16:35.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.586+0000 7f40d4c00640 1 -- 172.21.15.32:0/1882736521 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40d0054fe0 con 0x7f40d81565d0 2024-01-19T04:16:35.588 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40b0066500 msgr2=0x7f40b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40b0066500 0x7f40b00689c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f40d80c4610 tx=0x7f40c8009040 comp rx=0 tx=0).stop 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 msgr2=0x7f40d81f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d81f0fe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f40d0007e60 tx=0x7f40d000e4b0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 shutdown_connections 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40b0066500 0x7f40b00689c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40d81565d0 0x7f40d81f0fe0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f40d80c82f0 0x7f40d81f0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 --2- 172.21.15.32:0/1882736521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40d80c3770 0x7f40d815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 >> 172.21.15.32:0/1882736521 conn(0x7f40d80726d0 msgr2=0x7f40d80c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:35.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 shutdown_connections 2024-01-19T04:16:35.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.590+0000 7f40df400640 1 -- 172.21.15.32:0/1882736521 wait complete. 2024-01-19T04:16:35.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:16:35.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5268800640 1 Processor -- start 2024-01-19T04:16:35.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5268800640 1 -- start start 2024-01-19T04:16:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5268800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52600c2080 0x7f5260155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5268800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f526006d440 0x7f52600c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5268800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600a4ea0 con 0x7f52600723b0 2024-01-19T04:16:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5268800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52601524a0 con 0x7f52600c2080 2024-01-19T04:16:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5268800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5260152a20 con 0x7f526006d440 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5265400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52600c2080 0x7f5260155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5265400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52600c2080 0x7f5260155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45818/0 (socket says 172.21.15.32:45818) 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5265400640 1 -- 172.21.15.32:0/2357793877 learned_addr learned my addr 172.21.15.32:0/2357793877 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5266800640 1 --2- 172.21.15.32:0/2357793877 >> v2:172.21.15.67:3300/0 conn(0x7f526006d440 0x7f52600c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5265400640 1 -- 172.21.15.32:0/2357793877 >> v2:172.21.15.67:3300/0 conn(0x7f526006d440 msgr2=0x7f52600c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5265400640 1 --2- 172.21.15.32:0/2357793877 >> v2:172.21.15.67:3300/0 conn(0x7f526006d440 0x7f52600c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5265400640 1 -- 172.21.15.32:0/2357793877 >> v1:172.21.15.67:6789/0 conn(0x7f52600723b0 legacy=0x7f5260152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.758+0000 7f5265400640 1 -- 172.21.15.32:0/2357793877 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600c3430 con 0x7f52600c2080 2024-01-19T04:16:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5265400640 1 --2- 172.21.15.32:0/2357793877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f5260155a90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5260072d10 tx=0x7f524801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66310534a00ef72 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5264a00640 1 -- 172.21.15.32:0/2357793877 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480ab600 con 0x7f52600c2080 2024-01-19T04:16:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5264a00640 1 -- 172.21.15.32:0/2357793877 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52480a7050 con 0x7f52600c2080 2024-01-19T04:16:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5264a00640 1 -- 172.21.15.32:0/2357793877 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480ab980 con 0x7f52600c2080 2024-01-19T04:16:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 -- 172.21.15.32:0/2357793877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 msgr2=0x7f5260155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 --2- 172.21.15.32:0/2357793877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f5260155a90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5260072d10 tx=0x7f524801c370 comp rx=0 tx=0).stop 2024-01-19T04:16:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 -- 172.21.15.32:0/2357793877 shutdown_connections 2024-01-19T04:16:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 --2- 172.21.15.32:0/2357793877 >> v2:172.21.15.67:3300/0 conn(0x7f526006d440 0x7f52600c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 --2- 172.21.15.32:0/2357793877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f5260155a90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 -- 172.21.15.32:0/2357793877 >> 172.21.15.32:0/2357793877 conn(0x7f52600c25a0 msgr2=0x7f52600c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 -- 172.21.15.32:0/2357793877 shutdown_connections 2024-01-19T04:16:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.762+0000 7f5268800640 1 -- 172.21.15.32:0/2357793877 wait complete. 2024-01-19T04:16:35.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 Processor -- start 2024-01-19T04:16:35.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 -- start start 2024-01-19T04:16:35.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f526006d440 0x7f52600bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52600723b0 0x7f5260070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f526014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526014ddb0 con 0x7f52600c2080 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526014d7d0 con 0x7f52600723b0 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5260071920 con 0x7f526006d440 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f526014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f526014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45826/0 (socket says 172.21.15.32:45826) 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 -- 172.21.15.32:0/3315732623 learned_addr learned my addr 172.21.15.32:0/3315732623 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5265400640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52600723b0 0x7f5260070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5265e00640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f526006d440 0x7f52600bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 -- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f526006d440 msgr2=0x7f52600bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f526006d440 0x7f52600bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 -- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52600723b0 msgr2=0x7f5260070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52600723b0 0x7f5260070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 -- 172.21.15.32:0/3315732623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480094d0 con 0x7f52600c2080 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5265e00640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f526006d440 0x7f52600bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5266800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f526014e240 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5258007e90 tx=0x7f525800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f525e000640 1 -- 172.21.15.32:0/3315732623 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258014420 con 0x7f52600c2080 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f525e000640 1 -- 172.21.15.32:0/3315732623 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5258014580 con 0x7f52600c2080 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5260071c00 con 0x7f52600c2080 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f525e000640 1 -- 172.21.15.32:0/3315732623 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258014930 con 0x7f52600c2080 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.766+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52600bf670 con 0x7f52600c2080 2024-01-19T04:16:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.770+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526014ef40 con 0x7f52600c2080 2024-01-19T04:16:35.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.770+0000 7f525e000640 1 -- 172.21.15.32:0/3315732623 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5258014a90 con 0x7f52600c2080 2024-01-19T04:16:35.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.770+0000 7f525e000640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5238066500 0x7f52380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:35.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.770+0000 7f525e000640 1 -- 172.21.15.32:0/3315732623 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5258084910 con 0x7f52600c2080 2024-01-19T04:16:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.770+0000 7f5265e00640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5238066500 0x7f52380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.770+0000 7f5265e00640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5238066500 0x7f52380689c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f525000a850 tx=0x7f5250008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:35.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.774+0000 7f525e000640 1 -- 172.21.15.32:0/3315732623 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5258051a30 con 0x7f52600c2080 2024-01-19T04:16:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.934+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52600749f0 con 0x7f52600c2080 2024-01-19T04:16:35.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.934+0000 7f525e000640 1 -- 172.21.15.32:0/3315732623 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5258055050 con 0x7f52600c2080 2024-01-19T04:16:35.945 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:16:35.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5238066500 msgr2=0x7f52380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5238066500 0x7f52380689c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f525000a850 tx=0x7f5250008040 comp rx=0 tx=0).stop 2024-01-19T04:16:35.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 msgr2=0x7f526014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f526014e240 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5258007e90 tx=0x7f525800e4b0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 shutdown_connections 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5238066500 0x7f52380689c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52600c2080 0x7f526014e240 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52600723b0 0x7f5260070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 --2- 172.21.15.32:0/3315732623 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f526006d440 0x7f52600bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 >> 172.21.15.32:0/3315732623 conn(0x7f52600c25a0 msgr2=0x7f52600a57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 shutdown_connections 2024-01-19T04:16:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:35.938+0000 7f5268800640 1 -- 172.21.15.32:0/3315732623 wait complete. 2024-01-19T04:16:35.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:16:36.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae6e400640 1 Processor -- start 2024-01-19T04:16:36.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae6e400640 1 -- start start 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae6e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae680720b0 0x7fae6815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae6e400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae68072730 con 0x7fae681550e0 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae6e400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae68155580 con 0x7fae6814eb90 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae6e400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae68072a10 con 0x7fae680720b0 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae66a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fae681550e0 0x7fae680719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48268/0 (socket says 172.21.15.32:48268) 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae66a00640 1 -- 172.21.15.32:0/1938957994 learned_addr learned my addr 172.21.15.32:0/1938957994 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae67e00640 1 --2- 172.21.15.32:0/1938957994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae680720b0 0x7fae6815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699045075 0 0) 0x7fae68072730 con 0x7fae681550e0 2024-01-19T04:16:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae48003530 con 0x7fae681550e0 2024-01-19T04:16:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925956296 0 0) 0x7fae68155580 con 0x7fae6814eb90 2024-01-19T04:16:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae68072730 con 0x7fae6814eb90 2024-01-19T04:16:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae67e00640 1 -- 172.21.15.32:0/1938957994 >> v1:172.21.15.67:6789/0 conn(0x7fae6814eb90 legacy=0x7fae681549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae67e00640 1 -- 172.21.15.32:0/1938957994 >> v1:172.21.15.32:6789/0 conn(0x7fae681550e0 legacy=0x7fae680719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853243377 0 0) 0x7fae48003530 con 0x7fae681550e0 2024-01-19T04:16:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.102+0000 7fae67e00640 1 -- 172.21.15.32:0/1938957994 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68155860 con 0x7fae680720b0 2024-01-19T04:16:36.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae67e00640 1 --2- 172.21.15.32:0/1938957994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae680720b0 0x7fae6815cd10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae60009dc0 tx=0x7fae6001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6586808cacaabe7f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500016a0 con 0x7fae680720b0 2024-01-19T04:16:36.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae600a6450 con 0x7fae680720b0 2024-01-19T04:16:36.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae66000640 1 -- 172.21.15.32:0/1938957994 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600a67e0 con 0x7fae680720b0 2024-01-19T04:16:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae6e400640 1 -- 172.21.15.32:0/1938957994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae680720b0 msgr2=0x7fae6815cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae6e400640 1 --2- 172.21.15.32:0/1938957994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae680720b0 0x7fae6815cd10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae60009dc0 tx=0x7fae6001c800 comp rx=0 tx=0).stop 2024-01-19T04:16:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae6e400640 1 -- 172.21.15.32:0/1938957994 shutdown_connections 2024-01-19T04:16:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae6e400640 1 --2- 172.21.15.32:0/1938957994 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae680720b0 0x7fae6815cd10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae6e400640 1 -- 172.21.15.32:0/1938957994 >> 172.21.15.32:0/1938957994 conn(0x7fae680c25a0 msgr2=0x7fae680c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae6e400640 1 -- 172.21.15.32:0/1938957994 shutdown_connections 2024-01-19T04:16:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.106+0000 7fae6e400640 1 -- 172.21.15.32:0/1938957994 wait complete. 2024-01-19T04:16:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 Processor -- start 2024-01-19T04:16:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 -- start start 2024-01-19T04:16:36.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae680720b0 0x7fae680a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae6814eb90 0x7fae6814bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae681550e0 0x7fae6814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6814c940 con 0x7fae680720b0 2024-01-19T04:16:36.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae681f19f0 con 0x7fae681550e0 2024-01-19T04:16:36.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae6e400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6814b100 con 0x7fae6814eb90 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae680720b0 0x7fae680a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae680720b0 0x7fae680a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45840/0 (socket says 172.21.15.32:45840) 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 -- 172.21.15.32:0/2701073143 learned_addr learned my addr 172.21.15.32:0/2701073143 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67e00640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae681550e0 0x7fae6814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae66a00640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae6814eb90 0x7fae6814bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 -- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae6814eb90 msgr2=0x7fae6814bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae6814eb90 0x7fae6814bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 -- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae681550e0 msgr2=0x7fae6814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae681550e0 0x7fae6814c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 -- 172.21.15.32:0/2701073143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009a70 con 0x7fae680720b0 2024-01-19T04:16:36.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae67400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae680720b0 0x7fae680a8b60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c490 tx=0x7fae5800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.110+0000 7fae5f400640 1 -- 172.21.15.32:0/2701073143 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae580052d0 con 0x7fae680720b0 2024-01-19T04:16:36.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae5f400640 1 -- 172.21.15.32:0/2701073143 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae58005430 con 0x7fae680720b0 2024-01-19T04:16:36.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae5f400640 1 -- 172.21.15.32:0/2701073143 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58012870 con 0x7fae680720b0 2024-01-19T04:16:36.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6814b3e0 con 0x7fae680720b0 2024-01-19T04:16:36.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6814b9a0 con 0x7fae680720b0 2024-01-19T04:16:36.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae680749f0 con 0x7fae680720b0 2024-01-19T04:16:36.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae5f400640 1 -- 172.21.15.32:0/2701073143 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fae580129d0 con 0x7fae680720b0 2024-01-19T04:16:36.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae5f400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae40066500 0x7fae400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae5f400640 1 -- 172.21.15.32:0/2701073143 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fae58083960 con 0x7fae680720b0 2024-01-19T04:16:36.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.114+0000 7fae66a00640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae40066500 0x7fae400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.118+0000 7fae66a00640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae40066500 0x7fae400689c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fae680c1ee0 tx=0x7fae50001a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.118+0000 7fae5f400640 1 -- 172.21.15.32:0/2701073143 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fae580546e0 con 0x7fae680720b0 2024-01-19T04:16:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fae680c12d0 con 0x7fae680720b0 2024-01-19T04:16:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae5f400640 1 -- 172.21.15.32:0/2701073143 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v42) v1 ==== 101+0+11 (secure 0 0 0) 0x7fae58054270 con 0x7fae680720b0 2024-01-19T04:16:36.283 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:16:36.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae40066500 msgr2=0x7fae400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae40066500 0x7fae400689c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fae680c1ee0 tx=0x7fae50001a70 comp rx=0 tx=0).stop 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae680720b0 msgr2=0x7fae680a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae680720b0 0x7fae680a8b60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c490 tx=0x7fae5800c950 comp rx=0 tx=0).stop 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 shutdown_connections 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae40066500 0x7fae400689c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae681550e0 0x7fae6814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae6814eb90 0x7fae6814bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 --2- 172.21.15.32:0/2701073143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae680720b0 0x7fae680a8b60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 >> 172.21.15.32:0/2701073143 conn(0x7fae680c25a0 msgr2=0x7fae680c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 shutdown_connections 2024-01-19T04:16:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.282+0000 7fae6e400640 1 -- 172.21.15.32:0/2701073143 wait complete. 2024-01-19T04:16:36.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:36.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fcc800640 1 Processor -- start 2024-01-19T04:16:36.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fcc800640 1 -- start start 2024-01-19T04:16:36.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fcc800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc4158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fcc800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5fc40c5fd0 0x7f5fc40c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fcc800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40c7470 con 0x7f5fc406fee0 2024-01-19T04:16:36.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fcc800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc40c2d60 con 0x7f5fc40c5fd0 2024-01-19T04:16:36.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fcc800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40c3040 con 0x7f5fc4158030 2024-01-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fca800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5fc40c5fd0 0x7f5fc40c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fca800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5fc40c5fd0 0x7f5fc40c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45842/0 (socket says 172.21.15.32:45842) 2024-01-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fca800640 1 -- 172.21.15.32:0/2459519572 learned_addr learned my addr 172.21.15.32:0/2459519572 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fc9e00640 1 --2- 172.21.15.32:0/2459519572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc4158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fca800640 1 -- 172.21.15.32:0/2459519572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 msgr2=0x7f5fc4158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fca800640 1 --2- 172.21.15.32:0/2459519572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc4158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fca800640 1 -- 172.21.15.32:0/2459519572 >> v1:172.21.15.67:6789/0 conn(0x7f5fc406fee0 legacy=0x7f5fc40c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.446+0000 7f5fca800640 1 -- 172.21.15.32:0/2459519572 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40c76c0 con 0x7f5fc40c5fd0 2024-01-19T04:16:36.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fca800640 1 --2- 172.21.15.32:0/2459519572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc40c5fd0 0x7f5fc40c6460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009e50 tx=0x7f5fbc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b9b751787e0e19 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fc8a00640 1 -- 172.21.15.32:0/2459519572 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0a57e0 con 0x7f5fc40c5fd0 2024-01-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fc8a00640 1 -- 172.21.15.32:0/2459519572 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc0a5940 con 0x7f5fc40c5fd0 2024-01-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fc8a00640 1 -- 172.21.15.32:0/2459519572 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0a5cd0 con 0x7f5fc40c5fd0 2024-01-19T04:16:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 -- 172.21.15.32:0/2459519572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc40c5fd0 msgr2=0x7f5fc40c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 --2- 172.21.15.32:0/2459519572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc40c5fd0 0x7f5fc40c6460 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009e50 tx=0x7f5fbc01c940 comp rx=0 tx=0).stop 2024-01-19T04:16:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 -- 172.21.15.32:0/2459519572 shutdown_connections 2024-01-19T04:16:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 --2- 172.21.15.32:0/2459519572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc40c5fd0 0x7f5fc40c6460 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 --2- 172.21.15.32:0/2459519572 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc4158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 -- 172.21.15.32:0/2459519572 >> 172.21.15.32:0/2459519572 conn(0x7f5fc40a99f0 msgr2=0x7f5fc40a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 -- 172.21.15.32:0/2459519572 shutdown_connections 2024-01-19T04:16:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 -- 172.21.15.32:0/2459519572 wait complete. 2024-01-19T04:16:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.450+0000 7f5fcc800640 1 Processor -- start 2024-01-19T04:16:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 -- start start 2024-01-19T04:16:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc406fee0 0x7f5fc4150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fc40c5fd0 0x7f5fc4148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4151ef0 con 0x7f5fc406fee0 2024-01-19T04:16:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40ab0a0 con 0x7f5fc40c5fd0 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40aaae0 con 0x7f5fc4158030 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc406fee0 0x7f5fc4150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc406fee0 0x7f5fc4150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45856/0 (socket says 172.21.15.32:45856) 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 -- 172.21.15.32:0/145117740 learned_addr learned my addr 172.21.15.32:0/145117740 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9400640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fc40c5fd0 0x7f5fc4148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fca800640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 -- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 msgr2=0x7f5fc40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc40a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 -- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fc40c5fd0 msgr2=0x7f5fc4148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fc40c5fd0 0x7f5fc4148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 -- 172.21.15.32:0/145117740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc009b30 con 0x7f5fc406fee0 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc9e00640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc406fee0 0x7f5fc4150fc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400d5f0 tx=0x7f5fb400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc2000640 1 -- 172.21.15.32:0/145117740 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb40125f0 con 0x7f5fc406fee0 2024-01-19T04:16:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc2000640 1 -- 172.21.15.32:0/145117740 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4012750 con 0x7f5fc406fee0 2024-01-19T04:16:36.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fc2000640 1 -- 172.21.15.32:0/145117740 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4012b00 con 0x7f5fc406fee0 2024-01-19T04:16:36.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc4158b60 con 0x7f5fc406fee0 2024-01-19T04:16:36.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc41518a0 con 0x7f5fc406fee0 2024-01-19T04:16:36.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.454+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc40749f0 con 0x7f5fc406fee0 2024-01-19T04:16:36.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.458+0000 7f5fc2000640 1 -- 172.21.15.32:0/145117740 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5fb4012c60 con 0x7f5fc406fee0 2024-01-19T04:16:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.458+0000 7f5fc2000640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5f9c066500 0x7f5f9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.458+0000 7f5fc2000640 1 -- 172.21.15.32:0/145117740 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5fb40842d0 con 0x7f5fc406fee0 2024-01-19T04:16:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.458+0000 7f5fc9400640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5f9c066500 0x7f5f9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.458+0000 7f5fc9400640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5f9c066500 0x7f5f9c0689c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5fc41ee570 tx=0x7f5fac007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.462+0000 7f5fc2000640 1 -- 172.21.15.32:0/145117740 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5fb40515b0 con 0x7f5fc406fee0 2024-01-19T04:16:36.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.654+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fc40c5c00 con 0x7f5fc406fee0 2024-01-19T04:16:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.654+0000 7f5fc2000640 1 -- 172.21.15.32:0/145117740 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f5fb4054bd0 con 0x7f5fc406fee0 2024-01-19T04:16:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:36.656 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1016675671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":1016675671},{"type":"v1","addr":"172.21.15.32:6835","nonce":1016675671}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 23 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5f9c066500 msgr2=0x7f5f9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5f9c066500 0x7f5f9c0689c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5fc41ee570 tx=0x7f5fac007e40 comp rx=0 tx=0).stop 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc406fee0 msgr2=0x7f5fc4150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc406fee0 0x7f5fc4150fc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400d5f0 tx=0x7f5fb400dab0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 shutdown_connections 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5f9c066500 0x7f5f9c0689c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5fc4158030 0x7f5fc40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fc40c5fd0 0x7f5fc4148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 --2- 172.21.15.32:0/145117740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fc406fee0 0x7f5fc4150fc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 >> 172.21.15.32:0/145117740 conn(0x7f5fc40a99f0 msgr2=0x7f5fc40a7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:36.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 shutdown_connections 2024-01-19T04:16:36.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.658+0000 7f5fcc800640 1 -- 172.21.15.32:0/145117740 wait complete. 2024-01-19T04:16:36.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:36.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81c400640 1 Processor -- start 2024-01-19T04:16:36.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81c400640 1 -- start start 2024-01-19T04:16:36.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81c400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8140c54b0 0x7ff81406cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff81406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81c400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8140c44f0 con 0x7ff814155320 2024-01-19T04:16:36.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81c400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140c4980 con 0x7ff8140c54b0 2024-01-19T04:16:36.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140c3bc0 con 0x7ff814072310 2024-01-19T04:16:36.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81a400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff81406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff819000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff8140c54b0 0x7ff81406cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81a400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff81406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:54648/0 (socket says 172.21.15.32:54648) 2024-01-19T04:16:36.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81a400640 1 -- 172.21.15.32:0/299533372 learned_addr learned my addr 172.21.15.32:0/299533372 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:36.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81a400640 1 -- 172.21.15.32:0/299533372 >> v2:172.21.15.67:3300/0 conn(0x7ff8140c54b0 msgr2=0x7ff81406cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:36.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81a400640 1 --2- 172.21.15.32:0/299533372 >> v2:172.21.15.67:3300/0 conn(0x7ff8140c54b0 0x7ff81406cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81a400640 1 -- 172.21.15.32:0/299533372 >> v1:172.21.15.67:6789/0 conn(0x7ff814155320 legacy=0x7ff8140a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.818+0000 7ff81a400640 1 -- 172.21.15.32:0/299533372 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140c3ea0 con 0x7ff814072310 2024-01-19T04:16:36.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81a400640 1 --2- 172.21.15.32:0/299533372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff81406d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e50 tx=0x7ff80c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d06a6650311fe965 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff813e00640 1 -- 172.21.15.32:0/299533372 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0a5850 con 0x7ff814072310 2024-01-19T04:16:36.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff813e00640 1 -- 172.21.15.32:0/299533372 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c0a59b0 con 0x7ff814072310 2024-01-19T04:16:36.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff813e00640 1 -- 172.21.15.32:0/299533372 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0a5d40 con 0x7ff814072310 2024-01-19T04:16:36.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 -- 172.21.15.32:0/299533372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 msgr2=0x7ff81406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 --2- 172.21.15.32:0/299533372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff81406d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e50 tx=0x7ff80c01c9e0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 -- 172.21.15.32:0/299533372 shutdown_connections 2024-01-19T04:16:36.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 --2- 172.21.15.32:0/299533372 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff81406d1c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 --2- 172.21.15.32:0/299533372 >> v2:172.21.15.67:3300/0 conn(0x7ff8140c54b0 0x7ff81406cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 -- 172.21.15.32:0/299533372 >> 172.21.15.32:0/299533372 conn(0x7ff8140c5b20 msgr2=0x7ff8140c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:36.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 -- 172.21.15.32:0/299533372 shutdown_connections 2024-01-19T04:16:36.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.822+0000 7ff81c400640 1 -- 172.21.15.32:0/299533372 wait complete. 2024-01-19T04:16:36.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 Processor -- start 2024-01-19T04:16:36.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 -- start start 2024-01-19T04:16:36.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff8140ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8140c54b0 0x7ff8141ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff814155320 0x7ff81414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140aa420 con 0x7ff814155320 2024-01-19T04:16:36.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141ece00 con 0x7ff8140c54b0 2024-01-19T04:16:36.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140aa670 con 0x7ff814072310 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff814155320 0x7ff81414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff814155320 0x7ff81414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45864/0 (socket says 172.21.15.32:45864) 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 -- 172.21.15.32:0/3274038145 learned_addr learned my addr 172.21.15.32:0/3274038145 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff819000640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8140c54b0 0x7ff8141ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff819a00640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff8140ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 -- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 msgr2=0x7ff8140ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff8140ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 -- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8140c54b0 msgr2=0x7ff8141ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8140c54b0 0x7ff8141ec8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 -- 172.21.15.32:0/3274038145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c009b30 con 0x7ff814155320 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff819000640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8140c54b0 0x7ff8141ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:36.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff81a400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff814155320 0x7ff81414ef50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff80c01a610 tx=0x7ff80c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.826+0000 7ff811600640 1 -- 172.21.15.32:0/3274038145 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0b8670 con 0x7ff814155320 2024-01-19T04:16:36.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff811600640 1 -- 172.21.15.32:0/3274038145 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c0b87d0 con 0x7ff814155320 2024-01-19T04:16:36.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff811600640 1 -- 172.21.15.32:0/3274038145 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0b8b40 con 0x7ff814155320 2024-01-19T04:16:36.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8140a5630 con 0x7ff814155320 2024-01-19T04:16:36.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8141eff60 con 0x7ff814155320 2024-01-19T04:16:36.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8140749f0 con 0x7ff814155320 2024-01-19T04:16:36.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff811600640 1 -- 172.21.15.32:0/3274038145 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff80c0b8ca0 con 0x7ff814155320 2024-01-19T04:16:36.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff811600640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff7ec066530 0x7ff7ec0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:36.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff811600640 1 -- 172.21.15.32:0/3274038145 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff80c11f410 con 0x7ff814155320 2024-01-19T04:16:36.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.830+0000 7ff819a00640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff7ec066530 0x7ff7ec0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:36.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.834+0000 7ff819a00640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff7ec066530 0x7ff7ec0689f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff8140aa3b0 tx=0x7ff804009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:36.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:36.834+0000 7ff811600640 1 -- 172.21.15.32:0/3274038145 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff80c0ec6f0 con 0x7ff814155320 2024-01-19T04:16:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8140bfb80 con 0x7ff814155320 2024-01-19T04:16:37.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff811600640 1 -- 172.21.15.32:0/3274038145 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16549 (secure 0 0 0) 0x7ff80c009510 con 0x7ff814155320 2024-01-19T04:16:37.003 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:37.003 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":42,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:34.883767+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6835/884465323":"2024-01-20T04:16:31.717910+0000","172.21.15.32:6833/884465323":"2024-01-20T04:16:31.717910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:37.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff7ec066530 msgr2=0x7ff7ec0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff7ec066530 0x7ff7ec0689f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff8140aa3b0 tx=0x7ff804009040 comp rx=0 tx=0).stop 2024-01-19T04:16:37.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff814155320 msgr2=0x7ff81414ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff814155320 0x7ff81414ef50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff80c01a610 tx=0x7ff80c019780 comp rx=0 tx=0).stop 2024-01-19T04:16:37.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 shutdown_connections 2024-01-19T04:16:37.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff7ec066530 0x7ff7ec0689f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff814155320 0x7ff81414ef50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8140c54b0 0x7ff8141ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 --2- 172.21.15.32:0/3274038145 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff814072310 0x7ff8140ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 >> 172.21.15.32:0/3274038145 conn(0x7ff8140c5b20 msgr2=0x7ff8140c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 shutdown_connections 2024-01-19T04:16:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.002+0000 7ff81c400640 1 -- 172.21.15.32:0/3274038145 wait complete. 2024-01-19T04:16:37.026 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-19T04:16:37.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:37.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bdb600640 1 Processor -- start 2024-01-19T04:16:37.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bdb600640 1 -- start start 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bdb600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5bd40c42b0 0x7f5bd40c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bdb600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5bd40c5740 0x7f5bd40c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bdb600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd40c0c90 con 0x7f5bd406beb0 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bdb600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd4150f90 con 0x7f5bd40c5740 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bdb600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd40c1660 con 0x7f5bd40c42b0 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5bd40c5740 0x7f5bd40c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd9600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5bd406beb0 0x7f5bd4154110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48272/0 (socket says 172.21.15.32:48272) 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd9600640 1 -- 172.21.15.32:0/237238169 learned_addr learned my addr 172.21.15.32:0/237238169 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd8c00640 1 --2- 172.21.15.32:0/237238169 >> v2:172.21.15.67:3300/0 conn(0x7f5bd40c42b0 0x7f5bd40c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd3400640 1 -- 172.21.15.32:0/237238169 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944837363 0 0) 0x7f5bd40c0c90 con 0x7f5bd406beb0 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd3400640 1 -- 172.21.15.32:0/237238169 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb4003450 con 0x7f5bd406beb0 2024-01-19T04:16:37.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd3e00640 1 -- 172.21.15.32:0/237238169 >> v2:172.21.15.67:3300/0 conn(0x7f5bd40c42b0 msgr2=0x7f5bd40c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:37.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd3e00640 1 --2- 172.21.15.32:0/237238169 >> v2:172.21.15.67:3300/0 conn(0x7f5bd40c42b0 0x7f5bd40c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd3e00640 1 -- 172.21.15.32:0/237238169 >> v1:172.21.15.32:6789/0 conn(0x7f5bd406beb0 legacy=0x7f5bd4154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd3e00640 1 -- 172.21.15.32:0/237238169 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4150cb0 con 0x7f5bd40c5740 2024-01-19T04:16:37.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.166+0000 7f5bd8c00640 1 --2- 172.21.15.32:0/237238169 >> v2:172.21.15.67:3300/0 conn(0x7f5bd40c42b0 0x7f5bd40c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:37.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bd3e00640 1 --2- 172.21.15.32:0/237238169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd40c1120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4073eb0 tx=0x7f5bbc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dfd3e948251aa1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bd3400640 1 -- 172.21.15.32:0/237238169 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0ab600 con 0x7f5bd40c5740 2024-01-19T04:16:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bd3400640 1 -- 172.21.15.32:0/237238169 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0a7050 con 0x7f5bd40c5740 2024-01-19T04:16:37.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bd3400640 1 -- 172.21.15.32:0/237238169 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0ab980 con 0x7f5bd40c5740 2024-01-19T04:16:37.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 -- 172.21.15.32:0/237238169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 msgr2=0x7f5bd40c1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 --2- 172.21.15.32:0/237238169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd40c1120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4073eb0 tx=0x7f5bbc01c380 comp rx=0 tx=0).stop 2024-01-19T04:16:37.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 -- 172.21.15.32:0/237238169 shutdown_connections 2024-01-19T04:16:37.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 --2- 172.21.15.32:0/237238169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd40c1120 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 --2- 172.21.15.32:0/237238169 >> v2:172.21.15.67:3300/0 conn(0x7f5bd40c42b0 0x7f5bd40c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 -- 172.21.15.32:0/237238169 >> 172.21.15.32:0/237238169 conn(0x7f5bd40c5b20 msgr2=0x7f5bd40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 -- 172.21.15.32:0/237238169 shutdown_connections 2024-01-19T04:16:37.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.170+0000 7f5bdb600640 1 -- 172.21.15.32:0/237238169 wait complete. 2024-01-19T04:16:37.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 Processor -- start 2024-01-19T04:16:37.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 -- start start 2024-01-19T04:16:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bd406beb0 0x7f5bd41ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bd40c42b0 0x7f5bd414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd41ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41ed340 con 0x7f5bd40c5740 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41ecca0 con 0x7f5bd406beb0 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41f0cc0 con 0x7f5bd40c42b0 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd41ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd41ee110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45878/0 (socket says 172.21.15.32:45878) 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 -- 172.21.15.32:0/3415729108 learned_addr learned my addr 172.21.15.32:0/3415729108 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd8c00640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bd406beb0 0x7f5bd41ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd3e00640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bd40c42b0 0x7f5bd414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 -- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bd40c42b0 msgr2=0x7f5bd414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bd40c42b0 0x7f5bd414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 -- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bd406beb0 msgr2=0x7f5bd41ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bd406beb0 0x7f5bd41ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 -- 172.21.15.32:0/3415729108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc009420 con 0x7f5bd40c5740 2024-01-19T04:16:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd9600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd41ee110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00c9f0 tx=0x7f5bcc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd0c00640 1 -- 172.21.15.32:0/3415729108 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc00ab70 con 0x7f5bd40c5740 2024-01-19T04:16:37.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd0c00640 1 -- 172.21.15.32:0/3415729108 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc00acd0 con 0x7f5bd40c5740 2024-01-19T04:16:37.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bd0c00640 1 -- 172.21.15.32:0/3415729108 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc012600 con 0x7f5bd40c5740 2024-01-19T04:16:37.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd41f0fa0 con 0x7f5bd40c5740 2024-01-19T04:16:37.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.174+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd414f640 con 0x7f5bd40c5740 2024-01-19T04:16:37.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.178+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd41ed480 con 0x7f5bd40c5740 2024-01-19T04:16:37.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.178+0000 7f5bd0c00640 1 -- 172.21.15.32:0/3415729108 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5bcc007070 con 0x7f5bd40c5740 2024-01-19T04:16:37.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.178+0000 7f5bd0c00640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bac066500 0x7f5bac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.178+0000 7f5bd0c00640 1 -- 172.21.15.32:0/3415729108 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5bcc083bd0 con 0x7f5bd40c5740 2024-01-19T04:16:37.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.178+0000 7f5bd8c00640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bac066500 0x7f5bac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.178+0000 7f5bd8c00640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bac066500 0x7f5bac0689c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c900 tx=0x7f5bc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.182+0000 7f5bd0c00640 1 -- 172.21.15.32:0/3415729108 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5bd41ed480 con 0x7f5bd40c5740 2024-01-19T04:16:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bd41ed480 con 0x7f5bd40c5740 2024-01-19T04:16:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bd0c00640 1 -- 172.21.15.32:0/3415729108 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f5bd41ed480 con 0x7f5bd40c5740 2024-01-19T04:16:37.379 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:37.379 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1016675671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":1016675671},{"type":"v1","addr":"172.21.15.32:6835","nonce":1016675671}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:37.379 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 23 2024-01-19T04:16:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bac066500 msgr2=0x7f5bac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bac066500 0x7f5bac0689c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c900 tx=0x7f5bc4008040 comp rx=0 tx=0).stop 2024-01-19T04:16:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 msgr2=0x7f5bd41ee110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd41ee110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00c9f0 tx=0x7f5bcc00ceb0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 shutdown_connections 2024-01-19T04:16:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bac066500 0x7f5bac0689c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bd40c5740 0x7f5bd41ee110 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bd40c42b0 0x7f5bd414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 --2- 172.21.15.32:0/3415729108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bd406beb0 0x7f5bd41ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 >> 172.21.15.32:0/3415729108 conn(0x7f5bd40c5b20 msgr2=0x7f5bd4070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 shutdown_connections 2024-01-19T04:16:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.378+0000 7f5bdb600640 1 -- 172.21.15.32:0/3415729108 wait complete. 2024-01-19T04:16:37.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:37.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd88d600640 1 Processor -- start 2024-01-19T04:16:37.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd88d600640 1 -- start start 2024-01-19T04:16:37.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd88d600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd88814fb50 0x7fd88806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd88d600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd88d600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd888071e80 con 0x7fd8880a4ec0 2024-01-19T04:16:37.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd88d600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8881535c0 con 0x7fd88814fb50 2024-01-19T04:16:37.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd88d600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880726c0 con 0x7fd8880c04a0 2024-01-19T04:16:37.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:54664/0 (socket says 172.21.15.32:54664) 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd88814fb50 0x7fd88806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886000640 1 -- 172.21.15.32:0/3907663276 learned_addr learned my addr 172.21.15.32:0/3907663276 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd887400640 1 --1- 172.21.15.32:0/3907663276 >> v1:172.21.15.67:6789/0 conn(0x7fd8880a4ec0 0x7fd888155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:57378/0 (socket says 172.21.15.32:57378) 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd885600640 1 -- 172.21.15.32:0/3907663276 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604854606 0 0) 0x7fd888071e80 con 0x7fd8880a4ec0 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886000640 1 -- 172.21.15.32:0/3907663276 >> v2:172.21.15.67:3300/0 conn(0x7fd88814fb50 msgr2=0x7fd88806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886000640 1 --2- 172.21.15.32:0/3907663276 >> v2:172.21.15.67:3300/0 conn(0x7fd88814fb50 0x7fd88806fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886000640 1 -- 172.21.15.32:0/3907663276 >> v1:172.21.15.67:6789/0 conn(0x7fd8880a4ec0 legacy=0x7fd888155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886000640 1 -- 172.21.15.32:0/3907663276 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880c0a20 con 0x7fd8880c04a0 2024-01-19T04:16:37.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.542+0000 7fd886a00640 1 --2- 172.21.15.32:0/3907663276 >> v2:172.21.15.67:3300/0 conn(0x7fd88814fb50 0x7fd88806fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:37.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd886000640 1 --2- 172.21.15.32:0/3907663276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880c1230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd8700098a0 tx=0x7fd87001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1442d42e0de535bb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd885600640 1 -- 172.21.15.32:0/3907663276 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8700ab600 con 0x7fd8880c04a0 2024-01-19T04:16:37.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd885600640 1 -- 172.21.15.32:0/3907663276 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8700a7050 con 0x7fd8880c04a0 2024-01-19T04:16:37.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd885600640 1 -- 172.21.15.32:0/3907663276 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8700ab980 con 0x7fd8880c04a0 2024-01-19T04:16:37.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 -- 172.21.15.32:0/3907663276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 msgr2=0x7fd8880c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 --2- 172.21.15.32:0/3907663276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880c1230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd8700098a0 tx=0x7fd87001c490 comp rx=0 tx=0).stop 2024-01-19T04:16:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 -- 172.21.15.32:0/3907663276 shutdown_connections 2024-01-19T04:16:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 --2- 172.21.15.32:0/3907663276 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880c1230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 --2- 172.21.15.32:0/3907663276 >> v2:172.21.15.67:3300/0 conn(0x7fd88814fb50 0x7fd88806fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 -- 172.21.15.32:0/3907663276 >> 172.21.15.32:0/3907663276 conn(0x7fd8880c5b20 msgr2=0x7fd8880c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 -- 172.21.15.32:0/3907663276 shutdown_connections 2024-01-19T04:16:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.546+0000 7fd88d600640 1 -- 172.21.15.32:0/3907663276 wait complete. 2024-01-19T04:16:37.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 Processor -- start 2024-01-19T04:16:37.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 -- start start 2024-01-19T04:16:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8880a4ec0 0x7fd8880aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88814fb50 0x7fd8880aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880c2c30 con 0x7fd8880a4ec0 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880a9990 con 0x7fd88814fb50 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880baac0 con 0x7fd8880c04a0 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8880a4ec0 0x7fd8880aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8880a4ec0 0x7fd8880aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45894/0 (socket says 172.21.15.32:45894) 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 -- 172.21.15.32:0/3354662124 learned_addr learned my addr 172.21.15.32:0/3354662124 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886000640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd887400640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88814fb50 0x7fd8880aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 -- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 msgr2=0x7fd8880a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 -- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88814fb50 msgr2=0x7fd8880aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88814fb50 0x7fd8880aa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 -- 172.21.15.32:0/3354662124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878009420 con 0x7fd8880a4ec0 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd886a00640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8880a4ec0 0x7fd8880aad90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd87800e9b0 tx=0x7fd87800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd87ea00640 1 -- 172.21.15.32:0/3354662124 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87800ca00 con 0x7fd8880a4ec0 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd87ea00640 1 -- 172.21.15.32:0/3354662124 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87800cb60 con 0x7fd8880a4ec0 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd87ea00640 1 -- 172.21.15.32:0/3354662124 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878013470 con 0x7fd8880a4ec0 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8700094d0 con 0x7fd8880a4ec0 2024-01-19T04:16:37.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8881eb680 con 0x7fd8880a4ec0 2024-01-19T04:16:37.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.550+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888155cf0 con 0x7fd8880a4ec0 2024-01-19T04:16:37.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.554+0000 7fd87ea00640 1 -- 172.21.15.32:0/3354662124 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd8780135d0 con 0x7fd8880a4ec0 2024-01-19T04:16:37.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.554+0000 7fd87ea00640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd860066500 0x7fd8600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.554+0000 7fd87ea00640 1 -- 172.21.15.32:0/3354662124 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd8780840f0 con 0x7fd8880a4ec0 2024-01-19T04:16:37.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.554+0000 7fd886000640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd860066500 0x7fd8600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.554+0000 7fd886000640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd860066500 0x7fd8600689c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8700ad000 tx=0x7fd870008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.558+0000 7fd87ea00640 1 -- 172.21.15.32:0/3354662124 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd8780513d0 con 0x7fd8880a4ec0 2024-01-19T04:16:37.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8880749f0 con 0x7fd8880a4ec0 2024-01-19T04:16:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd87ea00640 1 -- 172.21.15.32:0/3354662124 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4940 (secure 0 0 0) 0x7fd8780549f0 con 0x7fd8880a4ec0 2024-01-19T04:16:37.755 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:37.755 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1016675671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":1016675671},{"type":"v1","addr":"172.21.15.32:6835","nonce":1016675671}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:06.177350+0000","modified":"2024-01-19T04:16:09.179461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6834/3465366661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3465366661},{"type":"v1","addr":"172.21.15.32:6834","nonce":3465366661}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-19T04:16:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 23 2024-01-19T04:16:37.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd860066500 msgr2=0x7fd8600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd860066500 0x7fd8600689c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8700ad000 tx=0x7fd870008040 comp rx=0 tx=0).stop 2024-01-19T04:16:37.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8880a4ec0 msgr2=0x7fd8880aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8880a4ec0 0x7fd8880aad90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd87800e9b0 tx=0x7fd87800ee70 comp rx=0 tx=0).stop 2024-01-19T04:16:37.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 shutdown_connections 2024-01-19T04:16:37.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd860066500 0x7fd8600689c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd88814fb50 0x7fd8880aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd8880c04a0 0x7fd8880a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 --2- 172.21.15.32:0/3354662124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8880a4ec0 0x7fd8880aad90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 >> 172.21.15.32:0/3354662124 conn(0x7fd8880c5b20 msgr2=0x7fd8880c0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:37.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 shutdown_connections 2024-01-19T04:16:37.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.754+0000 7fd88d600640 1 -- 172.21.15.32:0/3354662124 wait complete. 2024-01-19T04:16:37.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:37.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 Processor -- start 2024-01-19T04:16:37.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 -- start start 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f708c151f10 0x7f708c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c06f550 0x7f708c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f708c1546b0 0x7f708c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0c3450 con 0x7f708c1546b0 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c072d40 con 0x7f708c151f10 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7093000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c072a60 con 0x7f708c06f550 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f708c1546b0 0x7f708c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f708c1546b0 0x7f708c154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56442/0 (socket says 172.21.15.32:56442) 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 -- 172.21.15.32:0/2544355123 learned_addr learned my addr 172.21.15.32:0/2544355123 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f708b400640 1 --2- 172.21.15.32:0/2544355123 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c06f550 0x7f708c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f708be00640 1 --2- 172.21.15.32:0/2544355123 >> v2:172.21.15.67:3300/0 conn(0x7f708c151f10 0x7f708c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 -- 172.21.15.32:0/2544355123 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c06f550 msgr2=0x7f708c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:37.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 --2- 172.21.15.32:0/2544355123 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c06f550 0x7f708c0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 -- 172.21.15.32:0/2544355123 >> v2:172.21.15.67:3300/0 conn(0x7f708c151f10 msgr2=0x7f708c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:37.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 --2- 172.21.15.32:0/2544355123 >> v2:172.21.15.67:3300/0 conn(0x7f708c151f10 0x7f708c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.922+0000 7f7091000640 1 -- 172.21.15.32:0/2544355123 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c157dd0 con 0x7f708c1546b0 2024-01-19T04:16:37.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7091000640 1 --2- 172.21.15.32:0/2544355123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c1546b0 0x7f708c154b40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f708c06b6b0 tx=0x7f708401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1429164eda7cb46 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f708aa00640 1 -- 172.21.15.32:0/2544355123 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840090d0 con 0x7f708c1546b0 2024-01-19T04:16:37.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f708aa00640 1 -- 172.21.15.32:0/2544355123 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084009230 con 0x7f708c1546b0 2024-01-19T04:16:37.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f708aa00640 1 -- 172.21.15.32:0/2544355123 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840a5920 con 0x7f708c1546b0 2024-01-19T04:16:37.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 -- 172.21.15.32:0/2544355123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c1546b0 msgr2=0x7f708c154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 --2- 172.21.15.32:0/2544355123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c1546b0 0x7f708c154b40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f708c06b6b0 tx=0x7f708401c880 comp rx=0 tx=0).stop 2024-01-19T04:16:37.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 -- 172.21.15.32:0/2544355123 shutdown_connections 2024-01-19T04:16:37.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 --2- 172.21.15.32:0/2544355123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c1546b0 0x7f708c154b40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 --2- 172.21.15.32:0/2544355123 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c06f550 0x7f708c0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 --2- 172.21.15.32:0/2544355123 >> v2:172.21.15.67:3300/0 conn(0x7f708c151f10 0x7f708c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 -- 172.21.15.32:0/2544355123 >> 172.21.15.32:0/2544355123 conn(0x7f708c0c7040 msgr2=0x7f708c0c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:37.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 -- 172.21.15.32:0/2544355123 shutdown_connections 2024-01-19T04:16:37.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 -- 172.21.15.32:0/2544355123 wait complete. 2024-01-19T04:16:37.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.926+0000 7f7093000640 1 Processor -- start 2024-01-19T04:16:37.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 -- start start 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c06f550 0x7f708c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f708c151f10 0x7f708c0a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c1546b0 0x7f708c0a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c06e570 con 0x7f708c06f550 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c06eaf0 con 0x7f708c151f10 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c06e810 con 0x7f708c1546b0 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c06f550 0x7f708c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c06f550 0x7f708c150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56450/0 (socket says 172.21.15.32:56450) 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 -- 172.21.15.32:0/2488758674 learned_addr learned my addr 172.21.15.32:0/2488758674 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7091000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c1546b0 0x7f708c0a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708b400640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f708c151f10 0x7f708c0a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 -- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c1546b0 msgr2=0x7f708c0a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c1546b0 0x7f708c0a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 -- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f708c151f10 msgr2=0x7f708c0a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f708c151f10 0x7f708c0a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 -- 172.21.15.32:0/2488758674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084009b30 con 0x7f708c06f550 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7091000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c1546b0 0x7f708c0a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f708be00640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c06f550 0x7f708c150fb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f707c00d800 tx=0x7f707c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7083e00640 1 -- 172.21.15.32:0/2488758674 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c00b6c0 con 0x7f708c06f550 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7083e00640 1 -- 172.21.15.32:0/2488758674 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c00b820 con 0x7f708c06f550 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c0a8050 con 0x7f708c06f550 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7083e00640 1 -- 172.21.15.32:0/2488758674 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c00bb90 con 0x7f708c06f550 2024-01-19T04:16:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c0bd790 con 0x7f708c06f550 2024-01-19T04:16:37.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.930+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c067340 con 0x7f708c06f550 2024-01-19T04:16:37.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.934+0000 7f7083e00640 1 -- 172.21.15.32:0/2488758674 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f707c00bcf0 con 0x7f708c06f550 2024-01-19T04:16:37.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.934+0000 7f7083e00640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7064066500 0x7f70640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:37.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.934+0000 7f7083e00640 1 -- 172.21.15.32:0/2488758674 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f707c084330 con 0x7f708c06f550 2024-01-19T04:16:37.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.934+0000 7f708b400640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7064066500 0x7f70640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:37.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.934+0000 7f708b400640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7064066500 0x7f70640689c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f708c0c40a0 tx=0x7f7074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:37.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:37.938+0000 7f7083e00640 1 -- 172.21.15.32:0/2488758674 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f707c051600 con 0x7f708c06f550 2024-01-19T04:16:38.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.098+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f708c0749f0 con 0x7f708c06f550 2024-01-19T04:16:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7083e00640 1 -- 172.21.15.32:0/2488758674 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16549 (secure 0 0 0) 0x7f707c054c20 con 0x7f708c06f550 2024-01-19T04:16:38.102 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:38.102 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":42,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:34.883767+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:16:04.715304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:16:05.165871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6835/884465323":"2024-01-20T04:16:31.717910+0000","172.21.15.32:6833/884465323":"2024-01-20T04:16:31.717910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:38.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7064066500 msgr2=0x7f70640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7064066500 0x7f70640689c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f708c0c40a0 tx=0x7f7074008040 comp rx=0 tx=0).stop 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c06f550 msgr2=0x7f708c150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c06f550 0x7f708c150fb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f707c00d800 tx=0x7f707c00dcc0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 shutdown_connections 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7064066500 0x7f70640689c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f708c1546b0 0x7f708c0a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f708c151f10 0x7f708c0a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 --2- 172.21.15.32:0/2488758674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f708c06f550 0x7f708c150fb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 >> 172.21.15.32:0/2488758674 conn(0x7f708c0c7040 msgr2=0x7f708c0c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 shutdown_connections 2024-01-19T04:16:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.102+0000 7f7093000640 1 -- 172.21.15.32:0/2488758674 wait complete. 2024-01-19T04:16:38.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-19T04:16:38.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b76600640 1 Processor -- start 2024-01-19T04:16:38.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b76600640 1 -- start start 2024-01-19T04:16:38.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b76600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b70151de0 0x7f2b700c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b76600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b70155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b76600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b701547e0 con 0x7f2b700a7200 2024-01-19T04:16:38.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b76600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b701521c0 con 0x7f2b70151de0 2024-01-19T04:16:38.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b76600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70155640 con 0x7f2b70154c70 2024-01-19T04:16:38.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2b700a7200 0x7f2b700c3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60850/0 (socket says 172.21.15.32:60850) 2024-01-19T04:16:38.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6ea00640 1 -- 172.21.15.32:0/3941703567 learned_addr learned my addr 172.21.15.32:0/3941703567 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:38.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6fe00640 1 --2- 172.21.15.32:0/3941703567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b70155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6f400640 1 --2- 172.21.15.32:0/3941703567 >> v2:172.21.15.67:3300/0 conn(0x7f2b70151de0 0x7f2b700c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6e000640 1 -- 172.21.15.32:0/3941703567 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272898317 0 0) 0x7f2b701547e0 con 0x7f2b700a7200 2024-01-19T04:16:38.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6e000640 1 -- 172.21.15.32:0/3941703567 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b50003530 con 0x7f2b700a7200 2024-01-19T04:16:38.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6fe00640 1 -- 172.21.15.32:0/3941703567 >> v2:172.21.15.67:3300/0 conn(0x7f2b70151de0 msgr2=0x7f2b700c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:38.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6fe00640 1 --2- 172.21.15.32:0/3941703567 >> v2:172.21.15.67:3300/0 conn(0x7f2b70151de0 0x7f2b700c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6fe00640 1 -- 172.21.15.32:0/3941703567 >> v1:172.21.15.32:6789/0 conn(0x7f2b700a7200 legacy=0x7f2b700c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.266+0000 7f2b6fe00640 1 -- 172.21.15.32:0/3941703567 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700c1db0 con 0x7f2b70154c70 2024-01-19T04:16:38.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b6fe00640 1 --2- 172.21.15.32:0/3941703567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b70155100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d90 tx=0x7f2b6801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=915f8b886a078f9e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:38.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b6e000640 1 -- 172.21.15.32:0/3941703567 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680a5860 con 0x7f2b70154c70 2024-01-19T04:16:38.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b6e000640 1 -- 172.21.15.32:0/3941703567 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b680a59c0 con 0x7f2b70154c70 2024-01-19T04:16:38.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b6e000640 1 -- 172.21.15.32:0/3941703567 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680a5d50 con 0x7f2b70154c70 2024-01-19T04:16:38.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 -- 172.21.15.32:0/3941703567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 msgr2=0x7f2b70155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 --2- 172.21.15.32:0/3941703567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b70155100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d90 tx=0x7f2b6801c890 comp rx=0 tx=0).stop 2024-01-19T04:16:38.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 -- 172.21.15.32:0/3941703567 shutdown_connections 2024-01-19T04:16:38.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 --2- 172.21.15.32:0/3941703567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b70155100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 --2- 172.21.15.32:0/3941703567 >> v2:172.21.15.67:3300/0 conn(0x7f2b70151de0 0x7f2b700c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 -- 172.21.15.32:0/3941703567 >> 172.21.15.32:0/3941703567 conn(0x7f2b700726d0 msgr2=0x7f2b700663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:38.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 -- 172.21.15.32:0/3941703567 shutdown_connections 2024-01-19T04:16:38.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.270+0000 7f2b76600640 1 -- 172.21.15.32:0/3941703567 wait complete. 2024-01-19T04:16:38.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 Processor -- start 2024-01-19T04:16:38.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 -- start start 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b700a7200 0x7f2b7014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b70151de0 0x7f2b701ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b701ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701ed9d0 con 0x7f2b700a7200 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700a9370 con 0x7f2b70151de0 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700a9650 con 0x7f2b70154c70 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b700a7200 0x7f2b7014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b700a7200 0x7f2b7014eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56464/0 (socket says 172.21.15.32:56464) 2024-01-19T04:16:38.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 -- 172.21.15.32:0/968750254 learned_addr learned my addr 172.21.15.32:0/968750254 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6ea00640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b70151de0 0x7f2b701ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6fe00640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b701ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 -- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 msgr2=0x7f2b701ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b701ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 -- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b70151de0 msgr2=0x7f2b701ecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b70151de0 0x7f2b701ecc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 -- 172.21.15.32:0/968750254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68009a70 con 0x7f2b700a7200 2024-01-19T04:16:38.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b6f400640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b700a7200 0x7f2b7014eb50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e930 tx=0x7f2b6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:38.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b67400640 1 -- 172.21.15.32:0/968750254 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60009690 con 0x7f2b700a7200 2024-01-19T04:16:38.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b67400640 1 -- 172.21.15.32:0/968750254 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6000ca00 con 0x7f2b700a7200 2024-01-19T04:16:38.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b67400640 1 -- 172.21.15.32:0/968750254 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000cd70 con 0x7f2b700a7200 2024-01-19T04:16:38.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b700a9930 con 0x7f2b700a7200 2024-01-19T04:16:38.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.274+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b70153af0 con 0x7f2b700a7200 2024-01-19T04:16:38.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.278+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b700749f0 con 0x7f2b700a7200 2024-01-19T04:16:38.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.278+0000 7f2b67400640 1 -- 172.21.15.32:0/968750254 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2b60013470 con 0x7f2b700a7200 2024-01-19T04:16:38.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.278+0000 7f2b67400640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b48066530 0x7f2b480689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.278+0000 7f2b67400640 1 -- 172.21.15.32:0/968750254 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2b60084140 con 0x7f2b700a7200 2024-01-19T04:16:38.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.278+0000 7f2b6ea00640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b48066530 0x7f2b480689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.278+0000 7f2b6ea00640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b48066530 0x7f2b480689f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b701eaa40 tx=0x7f2b58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:38.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.282+0000 7f2b67400640 1 -- 172.21.15.32:0/968750254 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2b60051430 con 0x7f2b700a7200 2024-01-19T04:16:38.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.478+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f2b700c6dc0 con 0x7f2b700a7200 2024-01-19T04:16:38.480 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-01-19T04:16:38.478+0000 7f2af4c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T04:16:38.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b67400640 1 -- 172.21.15.32:0/968750254 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2b60054a50 con 0x7f2b700a7200 2024-01-19T04:16:38.482 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b48066530 msgr2=0x7f2b480689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b48066530 0x7f2b480689f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b701eaa40 tx=0x7f2b58009040 comp rx=0 tx=0).stop 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b700a7200 msgr2=0x7f2b7014eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b700a7200 0x7f2b7014eb50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e930 tx=0x7f2b6000edf0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 shutdown_connections 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b48066530 0x7f2b480689f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b70154c70 0x7f2b701ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b70151de0 0x7f2b701ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 --2- 172.21.15.32:0/968750254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b700a7200 0x7f2b7014eb50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.482+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 >> 172.21.15.32:0/968750254 conn(0x7f2b700726d0 msgr2=0x7f2b700c37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.486+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 shutdown_connections 2024-01-19T04:16:38.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.486+0000 7f2b76600640 1 -- 172.21.15.32:0/968750254 wait complete. 2024-01-19T04:16:38.491 INFO:tasks.ceph.mds.c.smithi032.stderr: -2070> 2024-01-19T04:16:12.190+0000 7f7060e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:16:38.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-19T04:16:38.537 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-01-19T04:16:38.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 Processor -- start 2024-01-19T04:16:38.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 -- start start 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a800c2520 0x7f3a80152340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3a8006a6a0 0x7f3a800c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800a8540 0x7f3a800a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a800aa6a0 con 0x7f3a8006a6a0 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8006b790 con 0x7f3a800c2520 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a88a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8006ab80 con 0x7f3a800a8540 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a85600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3a8006a6a0 0x7f3a800c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a800c2520 0x7f3a80152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3a800c2520 0x7f3a80152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:59504/0 (socket says 172.21.15.32:59504) 2024-01-19T04:16:38.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 -- 172.21.15.32:0/3867267825 learned_addr learned my addr 172.21.15.32:0/3867267825 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:38.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a87400640 1 --2- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800a8540 0x7f3a800a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 -- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800a8540 msgr2=0x7f3a800a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:38.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 --2- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800a8540 0x7f3a800a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 -- 172.21.15.32:0/3867267825 >> v2:172.21.15.32:3300/0 conn(0x7f3a8006a6a0 msgr2=0x7f3a800c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:38.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 --2- 172.21.15.32:0/3867267825 >> v2:172.21.15.32:3300/0 conn(0x7f3a8006a6a0 0x7f3a800c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.654+0000 7f3a86000640 1 -- 172.21.15.32:0/3867267825 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8006ae60 con 0x7f3a800c2520 2024-01-19T04:16:38.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.658+0000 7f3a86000640 1 --2- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a800c2520 0x7f3a80152340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a80070920 tx=0x7f3a7001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=801807edd3032216 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:38.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.658+0000 7f3a84c00640 1 -- 172.21.15.32:0/3867267825 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700ab600 con 0x7f3a800c2520 2024-01-19T04:16:38.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.658+0000 7f3a84c00640 1 -- 172.21.15.32:0/3867267825 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a700ab760 con 0x7f3a800c2520 2024-01-19T04:16:38.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.658+0000 7f3a84c00640 1 -- 172.21.15.32:0/3867267825 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700abaf0 con 0x7f3a800c2520 2024-01-19T04:16:38.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a800c2520 msgr2=0x7f3a80152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a800c2520 0x7f3a80152340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a80070920 tx=0x7f3a7001c440 comp rx=0 tx=0).stop 2024-01-19T04:16:38.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- 172.21.15.32:0/3867267825 shutdown_connections 2024-01-19T04:16:38.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800a8540 0x7f3a800a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3867267825 >> v2:172.21.15.32:3300/0 conn(0x7f3a8006a6a0 0x7f3a800c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3867267825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a800c2520 0x7f3a80152340 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- 172.21.15.32:0/3867267825 >> 172.21.15.32:0/3867267825 conn(0x7f3a800c7390 msgr2=0x7f3a800c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:38.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- 172.21.15.32:0/3867267825 shutdown_connections 2024-01-19T04:16:38.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- 172.21.15.32:0/3867267825 wait complete. 2024-01-19T04:16:38.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 Processor -- start 2024-01-19T04:16:38.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- start start 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a8006a6a0 0x7f3a80148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800a8540 0x7f3a80149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800c2520 0x7f3a801ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800accc0 con 0x7f3a800a8540 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80150620 con 0x7f3a8006a6a0 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a88a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80150900 con 0x7f3a800c2520 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a85600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800a8540 0x7f3a80149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a85600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800a8540 0x7f3a80149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56482/0 (socket says 172.21.15.32:56482) 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a85600640 1 -- 172.21.15.32:0/3431203587 learned_addr learned my addr 172.21.15.32:0/3431203587 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a86000640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a8006a6a0 0x7f3a80148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.662+0000 7f3a87400640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800c2520 0x7f3a801ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a85600640 1 -- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800c2520 msgr2=0x7f3a801ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a85600640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800c2520 0x7f3a801ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a85600640 1 -- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a8006a6a0 msgr2=0x7f3a80148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a85600640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a8006a6a0 0x7f3a80148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a85600640 1 -- 172.21.15.32:0/3431203587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700094d0 con 0x7f3a800a8540 2024-01-19T04:16:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a85600640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800a8540 0x7f3a80149900 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800e900 tx=0x7f3a6800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a7e000640 1 -- 172.21.15.32:0/3431203587 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68009690 con 0x7f3a800a8540 2024-01-19T04:16:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a7e000640 1 -- 172.21.15.32:0/3431203587 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6800ca00 con 0x7f3a800a8540 2024-01-19T04:16:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a7e000640 1 -- 172.21.15.32:0/3431203587 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800cdb0 con 0x7f3a800a8540 2024-01-19T04:16:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a80150be0 con 0x7f3a800a8540 2024-01-19T04:16:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a800c6f30 con 0x7f3a800a8540 2024-01-19T04:16:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a800728d0 con 0x7f3a800a8540 2024-01-19T04:16:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a7e000640 1 -- 172.21.15.32:0/3431203587 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3a68013470 con 0x7f3a800a8540 2024-01-19T04:16:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.666+0000 7f3a7e000640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a58066500 0x7f3a580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:38.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.670+0000 7f3a7e000640 1 -- 172.21.15.32:0/3431203587 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f3a68084860 con 0x7f3a800a8540 2024-01-19T04:16:38.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.670+0000 7f3a86000640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a58066500 0x7f3a580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:38.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.670+0000 7f3a86000640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a58066500 0x7f3a580689c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a700af000 tx=0x7f3a700b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.670+0000 7f3a7e000640 1 -- 172.21.15.32:0/3431203587 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3a68051af0 con 0x7f3a800a8540 2024-01-19T04:16:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:38.866+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3a8004e980 con 0x7f3a800a8540 2024-01-19T04:16:39.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.482+0000 7f3a7e000640 1 -- 172.21.15.32:0/3431203587 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3a680170b0 con 0x7f3a800a8540 2024-01-19T04:16:39.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a58066500 msgr2=0x7f3a580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:39.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a58066500 0x7f3a580689c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a700af000 tx=0x7f3a700b6040 comp rx=0 tx=0).stop 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800a8540 msgr2=0x7f3a80149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800a8540 0x7f3a80149900 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800e900 tx=0x7f3a6800edc0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 shutdown_connections 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a58066500 0x7f3a580689c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3a800c2520 0x7f3a801ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800a8540 0x7f3a80149900 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 --2- 172.21.15.32:0/3431203587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a8006a6a0 0x7f3a80148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 >> 172.21.15.32:0/3431203587 conn(0x7f3a800c7390 msgr2=0x7f3a8014cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 shutdown_connections 2024-01-19T04:16:39.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.486+0000 7f3a88a00640 1 -- 172.21.15.32:0/3431203587 wait complete. 2024-01-19T04:16:39.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-19T04:16:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6c2600640 1 Processor -- start 2024-01-19T04:16:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6c2600640 1 -- start start 2024-01-19T04:16:39.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6c2600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff6bc14f9a0 0x7ff6bc0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:39.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6c2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc0c20d0 0x7ff6bc06c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:39.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6c2600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc153140 con 0x7ff6bc072620 2024-01-19T04:16:39.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6c2600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc152530 con 0x7ff6bc14f9a0 2024-01-19T04:16:39.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6c2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc152810 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6bbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff6bc072620 0x7ff6bc06c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60864/0 (socket says 172.21.15.32:60864) 2024-01-19T04:16:39.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6bbe00640 1 -- 172.21.15.32:0/1005402353 learned_addr learned my addr 172.21.15.32:0/1005402353 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6baa00640 1 --2- 172.21.15.32:0/1005402353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc0c20d0 0x7ff6bc06c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6bb400640 1 --2- 172.21.15.32:0/1005402353 >> v2:172.21.15.67:3300/0 conn(0x7ff6bc14f9a0 0x7ff6bc0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.702+0000 7ff6ba000640 1 -- 172.21.15.32:0/1005402353 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657058428 0 0) 0x7ff6bc153140 con 0x7ff6bc072620 2024-01-19T04:16:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6ba000640 1 -- 172.21.15.32:0/1005402353 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c003530 con 0x7ff6bc072620 2024-01-19T04:16:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6baa00640 1 -- 172.21.15.32:0/1005402353 >> v2:172.21.15.67:3300/0 conn(0x7ff6bc14f9a0 msgr2=0x7ff6bc0720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6baa00640 1 --2- 172.21.15.32:0/1005402353 >> v2:172.21.15.67:3300/0 conn(0x7ff6bc14f9a0 0x7ff6bc0720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6baa00640 1 -- 172.21.15.32:0/1005402353 >> v1:172.21.15.32:6789/0 conn(0x7ff6bc072620 legacy=0x7ff6bc06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6baa00640 1 -- 172.21.15.32:0/1005402353 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc152af0 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6baa00640 1 --2- 172.21.15.32:0/1005402353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc0c20d0 0x7ff6bc06c220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40097c0 tx=0x7ff6a401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7acb1213692c5e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6ba000640 1 -- 172.21.15.32:0/1005402353 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40ab600 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6ba000640 1 -- 172.21.15.32:0/1005402353 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a40a7050 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6ba000640 1 -- 172.21.15.32:0/1005402353 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40ab980 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6c2600640 1 -- 172.21.15.32:0/1005402353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc0c20d0 msgr2=0x7ff6bc06c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.706+0000 7ff6c2600640 1 --2- 172.21.15.32:0/1005402353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc0c20d0 0x7ff6bc06c220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40097c0 tx=0x7ff6a401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- 172.21.15.32:0/1005402353 shutdown_connections 2024-01-19T04:16:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 --2- 172.21.15.32:0/1005402353 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc0c20d0 0x7ff6bc06c220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 --2- 172.21.15.32:0/1005402353 >> v2:172.21.15.67:3300/0 conn(0x7ff6bc14f9a0 0x7ff6bc0720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- 172.21.15.32:0/1005402353 >> 172.21.15.32:0/1005402353 conn(0x7ff6bc0c5b40 msgr2=0x7ff6bc0c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- 172.21.15.32:0/1005402353 shutdown_connections 2024-01-19T04:16:39.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- 172.21.15.32:0/1005402353 wait complete. 2024-01-19T04:16:39.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 Processor -- start 2024-01-19T04:16:39.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- start start 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6bc072620 0x7ff6bc14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6bc0c20d0 0x7ff6bc148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc14f9a0 0x7ff6bc1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc149900 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc071030 con 0x7ff6bc072620 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6c2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc1f0140 con 0x7ff6bc14f9a0 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6bc0c20d0 0x7ff6bc148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6bc0c20d0 0x7ff6bc148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56498/0 (socket says 172.21.15.32:56498) 2024-01-19T04:16:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 -- 172.21.15.32:0/364063937 learned_addr learned my addr 172.21.15.32:0/364063937 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:39.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6bbe00640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc14f9a0 0x7ff6bc1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 -- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc14f9a0 msgr2=0x7ff6bc1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6bb400640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6bc072620 0x7ff6bc14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc14f9a0 0x7ff6bc1493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 -- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6bc072620 msgr2=0x7ff6bc14d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6bc072620 0x7ff6bc14d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6baa00640 1 -- 172.21.15.32:0/364063937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009420 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6bb400640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6bc072620 0x7ff6bc14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.710+0000 7ff6bbe00640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc14f9a0 0x7ff6bc1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6baa00640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6bc0c20d0 0x7ff6bc148e80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40ae040 tx=0x7ff6a4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6b3400640 1 -- 172.21.15.32:0/364063937 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40b4430 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6b3400640 1 -- 172.21.15.32:0/364063937 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a40b45b0 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6b3400640 1 -- 172.21.15.32:0/364063937 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40b4960 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc1f03e0 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc070cc0 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc04e980 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6b3400640 1 -- 172.21.15.32:0/364063937 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff6a40b2040 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6b3400640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff694066500 0x7ff6940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:39.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6b3400640 1 -- 172.21.15.32:0/364063937 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5885+0+0 (secure 0 0 0) 0x7ff6a411dd40 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.714+0000 7ff6bb400640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff694066500 0x7ff6940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:39.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.718+0000 7ff6bb400640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff694066500 0x7ff6940689c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009a40 tx=0x7ff6ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:39.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.718+0000 7ff6b3400640 1 -- 172.21.15.32:0/364063937 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff6a40eafc0 con 0x7ff6bc0c20d0 2024-01-19T04:16:39.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:39.882+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6bc0c0180 con 0x7ff6bc0c20d0 2024-01-19T04:16:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6b3400640 1 -- 172.21.15.32:0/364063937 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff6a40ee5e0 con 0x7ff6bc0c20d0 2024-01-19T04:16:40.487 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_metadata' removed 2024-01-19T04:16:40.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff694066500 msgr2=0x7ff6940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff694066500 0x7ff6940689c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009a40 tx=0x7ff6ac008040 comp rx=0 tx=0).stop 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6bc0c20d0 msgr2=0x7ff6bc148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6bc0c20d0 0x7ff6bc148e80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40ae040 tx=0x7ff6a4019190 comp rx=0 tx=0).stop 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 shutdown_connections 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff694066500 0x7ff6940689c0 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009a40 tx=0x7ff6ac008040 comp rx=0 tx=0).stop 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6bc14f9a0 0x7ff6bc1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6bc0c20d0 0x7ff6bc148e80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 --2- 172.21.15.32:0/364063937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6bc072620 0x7ff6bc14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.485+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 >> 172.21.15.32:0/364063937 conn(0x7ff6bc0c5b40 msgr2=0x7ff6bc06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:40.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.489+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 shutdown_connections 2024-01-19T04:16:40.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.489+0000 7ff6c2600640 1 -- 172.21.15.32:0/364063937 wait complete. 2024-01-19T04:16:40.515 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-19T04:16:40.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.661+0000 7f6203a00640 1 Processor -- start 2024-01-19T04:16:40.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.661+0000 7f6203a00640 1 -- start start 2024-01-19T04:16:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.661+0000 7f6203a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61fc06dd00 0x7f61fc0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f6203a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61fc070a20 con 0x7f61fc0c5550 2024-01-19T04:16:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f6203a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61fc154100 con 0x7f61fc072a00 2024-01-19T04:16:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f6203a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61fc0c22f0 con 0x7f61fc06dd00 2024-01-19T04:16:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f6201000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f61fc0c5550 0x7f61fc0c1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60872/0 (socket says 172.21.15.32:60872) 2024-01-19T04:16:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f6201000640 1 -- 172.21.15.32:0/3835428654 learned_addr learned my addr 172.21.15.32:0/3835428654 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:40.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fbe00640 1 --2- 172.21.15.32:0/3835428654 >> v2:172.21.15.67:3300/0 conn(0x7f61fc06dd00 0x7f61fc0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fb400640 1 -- 172.21.15.32:0/3835428654 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475955699 0 0) 0x7f61fc070a20 con 0x7f61fc0c5550 2024-01-19T04:16:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fb400640 1 -- 172.21.15.32:0/3835428654 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61dc003530 con 0x7f61fc0c5550 2024-01-19T04:16:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fb400640 1 -- 172.21.15.32:0/3835428654 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314632688 0 0) 0x7f61fc154100 con 0x7f61fc072a00 2024-01-19T04:16:40.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fb400640 1 -- 172.21.15.32:0/3835428654 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61fc070a20 con 0x7f61fc072a00 2024-01-19T04:16:40.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fbe00640 1 -- 172.21.15.32:0/3835428654 >> v1:172.21.15.67:6789/0 conn(0x7f61fc072a00 legacy=0x7f61fc06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:40.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fbe00640 1 -- 172.21.15.32:0/3835428654 >> v1:172.21.15.32:6789/0 conn(0x7f61fc0c5550 legacy=0x7f61fc0c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:40.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fbe00640 1 -- 172.21.15.32:0/3835428654 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc0c0560 con 0x7f61fc06dd00 2024-01-19T04:16:40.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.665+0000 7f61fbe00640 1 --2- 172.21.15.32:0/3835428654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc06dd00 0x7f61fc0704e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f61e40097c0 tx=0x7f61e401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eaa16a326c2c4f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:40.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f61fb400640 1 -- 172.21.15.32:0/3835428654 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40ab600 con 0x7f61fc06dd00 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f61fb400640 1 -- 172.21.15.32:0/3835428654 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e40a7050 con 0x7f61fc06dd00 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f61fb400640 1 -- 172.21.15.32:0/3835428654 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40ab980 con 0x7f61fc06dd00 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- 172.21.15.32:0/3835428654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc06dd00 msgr2=0x7f61fc0704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 --2- 172.21.15.32:0/3835428654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc06dd00 0x7f61fc0704e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f61e40097c0 tx=0x7f61e401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- 172.21.15.32:0/3835428654 shutdown_connections 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 --2- 172.21.15.32:0/3835428654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc06dd00 0x7f61fc0704e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- 172.21.15.32:0/3835428654 >> 172.21.15.32:0/3835428654 conn(0x7f61fc0c5b40 msgr2=0x7f61fc0c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- 172.21.15.32:0/3835428654 shutdown_connections 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- 172.21.15.32:0/3835428654 wait complete. 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 Processor -- start 2024-01-19T04:16:40.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- start start 2024-01-19T04:16:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61fc06dd00 0x7f61fc0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc072a00 0x7f61fc0ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61fc0c5550 0x7f61fc14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc1f0f60 con 0x7f61fc06dd00 2024-01-19T04:16:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc1f01a0 con 0x7f61fc072a00 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.669+0000 7f6203a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc1f0480 con 0x7f61fc0c5550 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61fc06dd00 0x7f61fc0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61fc06dd00 0x7f61fc0bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56502/0 (socket says 172.21.15.32:56502) 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 -- 172.21.15.32:0/1802407364 learned_addr learned my addr 172.21.15.32:0/1802407364 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f61fbe00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc072a00 0x7f61fc0ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201a00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61fc0c5550 0x7f61fc14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 -- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61fc0c5550 msgr2=0x7f61fc14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61fc0c5550 0x7f61fc14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 -- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc072a00 msgr2=0x7f61fc0ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc072a00 0x7f61fc0ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 -- 172.21.15.32:0/1802407364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4009420 con 0x7f61fc06dd00 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f61fbe00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc072a00 0x7f61fc0ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6201000640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61fc06dd00 0x7f61fc0bf130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c430 tx=0x7f61ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f61f8c00640 1 -- 172.21.15.32:0/1802407364 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec005cf0 con 0x7f61fc06dd00 2024-01-19T04:16:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f61f8c00640 1 -- 172.21.15.32:0/1802407364 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec005e50 con 0x7f61fc06dd00 2024-01-19T04:16:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f61f8c00640 1 -- 172.21.15.32:0/1802407364 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec007310 con 0x7f61fc06dd00 2024-01-19T04:16:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc1f0760 con 0x7f61fc06dd00 2024-01-19T04:16:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc0a9a80 con 0x7f61fc06dd00 2024-01-19T04:16:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61fc04e980 con 0x7f61fc06dd00 2024-01-19T04:16:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.673+0000 7f61f8c00640 1 -- 172.21.15.32:0/1802407364 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f61ec007470 con 0x7f61fc06dd00 2024-01-19T04:16:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.677+0000 7f61f8c00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61d4066500 0x7f61d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.677+0000 7f61f8c00640 1 -- 172.21.15.32:0/1802407364 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f61ec083440 con 0x7f61fc06dd00 2024-01-19T04:16:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.677+0000 7f61fbe00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61d4066500 0x7f61d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.677+0000 7f61fbe00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61d4066500 0x7f61d40689c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f61e40ad000 tx=0x7f61e40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:40.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.681+0000 7f61f8c00640 1 -- 172.21.15.32:0/1802407364 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f61ec050740 con 0x7f61fc06dd00 2024-01-19T04:16:40.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:40.841+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61fc067940 con 0x7f61fc06dd00 2024-01-19T04:16:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.485+0000 7f61f8c00640 1 -- 172.21.15.32:0/1802407364 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v45) v1 ==== 172+0+0 (secure 0 0 0) 0x7f61ec053d60 con 0x7f61fc06dd00 2024-01-19T04:16:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_data' removed 2024-01-19T04:16:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61d4066500 msgr2=0x7f61d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61d4066500 0x7f61d40689c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f61e40ad000 tx=0x7f61e40a6000 comp rx=0 tx=0).stop 2024-01-19T04:16:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61fc06dd00 msgr2=0x7f61fc0bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61fc06dd00 0x7f61fc0bf130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c430 tx=0x7f61ec00c8f0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 shutdown_connections 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61d4066500 0x7f61d40689c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61fc0c5550 0x7f61fc14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61fc072a00 0x7f61fc0ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 --2- 172.21.15.32:0/1802407364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61fc06dd00 0x7f61fc0bf130 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 >> 172.21.15.32:0/1802407364 conn(0x7f61fc0c5b40 msgr2=0x7f61fc15b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 shutdown_connections 2024-01-19T04:16:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.489+0000 7f6203a00640 1 -- 172.21.15.32:0/1802407364 wait complete. 2024-01-19T04:16:41.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-19T04:16:41.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f5921600640 1 Processor -- start 2024-01-19T04:16:41.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f5921600640 1 -- start start 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f5921600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c14eb90 0x7f591c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f5921600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f591c06c670 0x7f591c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f5921600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c072730 con 0x7f591c06dbc0 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f5921600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c072a10 con 0x7f591c06c670 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f5921600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c14ef70 con 0x7f591c14eb90 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591a000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f591c06c670 0x7f591c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591a000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f591c06c670 0x7f591c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56512/0 (socket says 172.21.15.32:56512) 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591a000640 1 -- 172.21.15.32:0/1398411691 learned_addr learned my addr 172.21.15.32:0/1398411691 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591aa00640 1 --2- 172.21.15.32:0/1398411691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c14eb90 0x7f591c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:41.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591a000640 1 -- 172.21.15.32:0/1398411691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c14eb90 msgr2=0x7f591c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:41.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591a000640 1 --2- 172.21.15.32:0/1398411691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c14eb90 0x7f591c1549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591a000640 1 -- 172.21.15.32:0/1398411691 >> v1:172.21.15.67:6789/0 conn(0x7f591c06dbc0 legacy=0x7f591c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.665+0000 7f591a000640 1 -- 172.21.15.32:0/1398411691 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c155580 con 0x7f591c06c670 2024-01-19T04:16:41.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f591a000640 1 --2- 172.21.15.32:0/1398411691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c06c670 0x7f591c154f10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5904009870 tx=0x7f590401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e4cae5e5fc26c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:41.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5919600640 1 -- 172.21.15.32:0/1398411691 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59040ab600 con 0x7f591c06c670 2024-01-19T04:16:41.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5919600640 1 -- 172.21.15.32:0/1398411691 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59040a7050 con 0x7f591c06c670 2024-01-19T04:16:41.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5919600640 1 -- 172.21.15.32:0/1398411691 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59040ab980 con 0x7f591c06c670 2024-01-19T04:16:41.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 -- 172.21.15.32:0/1398411691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c06c670 msgr2=0x7f591c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 --2- 172.21.15.32:0/1398411691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c06c670 0x7f591c154f10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5904009870 tx=0x7f590401c420 comp rx=0 tx=0).stop 2024-01-19T04:16:41.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 -- 172.21.15.32:0/1398411691 shutdown_connections 2024-01-19T04:16:41.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 --2- 172.21.15.32:0/1398411691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c06c670 0x7f591c154f10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 --2- 172.21.15.32:0/1398411691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c14eb90 0x7f591c1549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 -- 172.21.15.32:0/1398411691 >> 172.21.15.32:0/1398411691 conn(0x7f591c0c25a0 msgr2=0x7f591c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:41.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 -- 172.21.15.32:0/1398411691 shutdown_connections 2024-01-19T04:16:41.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.669+0000 7f5921600640 1 -- 172.21.15.32:0/1398411691 wait complete. 2024-01-19T04:16:41.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 Processor -- start 2024-01-19T04:16:41.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 -- start start 2024-01-19T04:16:41.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f591c06c670 0x7f591c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:41.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c06dbc0 0x7f591c1ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:41.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c14eb90 0x7f591c1edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:41.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c151bd0 con 0x7f591c14eb90 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c147230 con 0x7f591c06c670 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c147710 con 0x7f591c06dbc0 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c14eb90 0x7f591c1edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c06dbc0 0x7f591c1ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f591c06c670 0x7f591c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c14eb90 0x7f591c1edca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56524/0 (socket says 172.21.15.32:56524) 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f591c06c670 0x7f591c06ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:59564/0 (socket says 172.21.15.32:59564) 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c06dbc0 0x7f591c1ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:44230/0 (socket says 172.21.15.32:44230) 2024-01-19T04:16:41.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 -- 172.21.15.32:0/59480378 learned_addr learned my addr 172.21.15.32:0/59480378 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:41.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 -- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c06dbc0 msgr2=0x7f591c1ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c06dbc0 0x7f591c1ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 -- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f591c06c670 msgr2=0x7f591c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f591c06c670 0x7f591c06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 -- 172.21.15.32:0/59480378 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59040094d0 con 0x7f591c14eb90 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f591b400640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c14eb90 0x7f591c1edca0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f591400c7a0 tx=0x7f591400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5912a00640 1 -- 172.21.15.32:0/59480378 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914003b80 con 0x7f591c14eb90 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5912a00640 1 -- 172.21.15.32:0/59480378 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914003ce0 con 0x7f591c14eb90 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c148e30 con 0x7f591c14eb90 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5912a00640 1 -- 172.21.15.32:0/59480378 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400aa30 con 0x7f591c14eb90 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.673+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c1493f0 con 0x7f591c14eb90 2024-01-19T04:16:41.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.677+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c0749f0 con 0x7f591c14eb90 2024-01-19T04:16:41.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.677+0000 7f5912a00640 1 -- 172.21.15.32:0/59480378 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f591400ab90 con 0x7f591c14eb90 2024-01-19T04:16:41.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.677+0000 7f5912a00640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58f4066500 0x7f58f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:41.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.677+0000 7f5912a00640 1 -- 172.21.15.32:0/59480378 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f59140838f0 con 0x7f591c14eb90 2024-01-19T04:16:41.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.677+0000 7f591aa00640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58f4066500 0x7f58f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:41.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.677+0000 7f591aa00640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58f4066500 0x7f58f40689c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f590c006aa0 tx=0x7f590c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:41.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.681+0000 7f5912a00640 1 -- 172.21.15.32:0/59480378 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5914050ed0 con 0x7f591c14eb90 2024-01-19T04:16:41.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.845+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f591c147850 con 0x7f591c14eb90 2024-01-19T04:16:41.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.849+0000 7f5912a00640 1 -- 172.21.15.32:0/59480378 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f59140544f0 con 0x7f591c14eb90 2024-01-19T04:16:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58f4066500 msgr2=0x7f58f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58f4066500 0x7f58f40689c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f590c006aa0 tx=0x7f590c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c14eb90 msgr2=0x7f591c1edca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c14eb90 0x7f591c1edca0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f591400c7a0 tx=0x7f591400cc60 comp rx=0 tx=0).stop 2024-01-19T04:16:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 shutdown_connections 2024-01-19T04:16:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f58f4066500 0x7f58f40689c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f591c14eb90 0x7f591c1edca0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f591c06dbc0 0x7f591c1ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 --2- 172.21.15.32:0/59480378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f591c06c670 0x7f591c06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 >> 172.21.15.32:0/59480378 conn(0x7f591c0c25a0 msgr2=0x7f591c0c14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 shutdown_connections 2024-01-19T04:16:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:41.853+0000 7f5921600640 1 -- 172.21.15.32:0/59480378 wait complete. 2024-01-19T04:16:41.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-19T04:16:42.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7e6400640 1 Processor -- start 2024-01-19T04:16:42.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7e6400640 1 -- start start 2024-01-19T04:16:42.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7e6400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd7e00a6d30 0x7fd7e00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7e6400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e01533a0 con 0x7fd7e00c6e20 2024-01-19T04:16:42.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7e6400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e0152800 con 0x7fd7e006fda0 2024-01-19T04:16:42.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7e6400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e0156380 con 0x7fd7e00a6d30 2024-01-19T04:16:42.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7df400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd7e00c6e20 0x7fd7e0152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60882/0 (socket says 172.21.15.32:60882) 2024-01-19T04:16:42.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7df400640 1 -- 172.21.15.32:0/840958655 learned_addr learned my addr 172.21.15.32:0/840958655 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:42.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7dea00640 1 --2- 172.21.15.32:0/840958655 >> v2:172.21.15.67:3300/0 conn(0x7fd7e00a6d30 0x7fd7e00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757947670 0 0) 0x7fd7d0001120 con 0x7fd7e00c6e20 2024-01-19T04:16:42.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c0003530 con 0x7fd7e00c6e20 2024-01-19T04:16:42.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1109724308 0 0) 0x7fd7c0003530 con 0x7fd7e00c6e20 2024-01-19T04:16:42.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 >> v2:172.21.15.67:3300/0 conn(0x7fd7e00a6d30 msgr2=0x7fd7e00c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:42.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 --2- 172.21.15.32:0/840958655 >> v2:172.21.15.67:3300/0 conn(0x7fd7e00a6d30 0x7fd7e00c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 >> v1:172.21.15.67:6789/0 conn(0x7fd7e006fda0 legacy=0x7fd7e015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0156590 con 0x7fd7e00c6e20 2024-01-19T04:16:42.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fd7d0001810 con 0x7fd7e00c6e20 2024-01-19T04:16:42.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 >> v1:172.21.15.32:6789/0 conn(0x7fd7e00c6e20 legacy=0x7fd7e0152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c0003980 0x7fd7c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7c00047d0 0x7fd7c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0005190 0x7fd7c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e0156380 con 0x7fd7c0003980 2024-01-19T04:16:42.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c000c130 con 0x7fd7c00047d0 2024-01-19T04:16:42.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c000c2f0 con 0x7fd7c0005190 2024-01-19T04:16:42.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7df400640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c0003980 0x7fd7c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7dea00640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7c00047d0 0x7fd7c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7dfe00640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0005190 0x7fd7c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7df400640 1 -- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0005190 msgr2=0x7fd7c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:42.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7df400640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0005190 0x7fd7c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7df400640 1 -- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7c00047d0 msgr2=0x7fd7c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:42.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.021+0000 7fd7df400640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7c00047d0 0x7fd7c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7df400640 1 -- 172.21.15.32:0/840958655 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0003530 con 0x7fd7c0003980 2024-01-19T04:16:42.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7dea00640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7c00047d0 0x7fd7c0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:42.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7dfe00640 1 -- 172.21.15.32:0/840958655 reap_dead start 2024-01-19T04:16:42.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7df400640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c0003980 0x7fd7c0003da0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c190 tx=0x7fd7d001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643835b5bbbd161 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:42.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0005ae0 con 0x7fd7c0003980 2024-01-19T04:16:42.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0005c60 con 0x7fd7c0003980 2024-01-19T04:16:42.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7de000640 1 -- 172.21.15.32:0/840958655 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00072b0 con 0x7fd7c0003980 2024-01-19T04:16:42.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7e6400640 1 -- 172.21.15.32:0/840958655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c0003980 msgr2=0x7fd7c0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7e6400640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c0003980 0x7fd7c0003da0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c190 tx=0x7fd7d001cc20 comp rx=0 tx=0).stop 2024-01-19T04:16:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7e6400640 1 -- 172.21.15.32:0/840958655 shutdown_connections 2024-01-19T04:16:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7e6400640 1 --2- 172.21.15.32:0/840958655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c0003980 0x7fd7c0003da0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.025+0000 7fd7e6400640 1 -- 172.21.15.32:0/840958655 >> 172.21.15.32:0/840958655 conn(0x7fd7e00a9870 msgr2=0x7fd7e00a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 -- 172.21.15.32:0/840958655 shutdown_connections 2024-01-19T04:16:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 -- 172.21.15.32:0/840958655 wait complete. 2024-01-19T04:16:42.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 Processor -- start 2024-01-19T04:16:42.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 -- start start 2024-01-19T04:16:42.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0003980 0x7fd7e014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7e006d3d0 0x7fd7e006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e01f2100 0x7fd7e01edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e01f1ce0 con 0x7fd7e01f2100 2024-01-19T04:16:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00c0940 con 0x7fd7e006d3d0 2024-01-19T04:16:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e01f1640 con 0x7fd7c0003980 2024-01-19T04:16:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e01f2100 0x7fd7e01edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e01f2100 0x7fd7e01edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56536/0 (socket says 172.21.15.32:56536) 2024-01-19T04:16:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 -- 172.21.15.32:0/4145384029 learned_addr learned my addr 172.21.15.32:0/4145384029 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7df400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0003980 0x7fd7e014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dea00640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7e006d3d0 0x7fd7e006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 -- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0003980 msgr2=0x7fd7e014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0003980 0x7fd7e014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 -- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7e006d3d0 msgr2=0x7fd7e006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7e006d3d0 0x7fd7e006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 -- 172.21.15.32:0/4145384029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e014bf50 con 0x7fd7e01f2100 2024-01-19T04:16:42.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dea00640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7e006d3d0 0x7fd7e006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:42.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7df400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0003980 0x7fd7e014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:42.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7dfe00640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e01f2100 0x7fd7e01edf50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00683b0 tx=0x7fd7d800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:42.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7d7400640 1 -- 172.21.15.32:0/4145384029 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800eed0 con 0x7fd7e01f2100 2024-01-19T04:16:42.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7d7400640 1 -- 172.21.15.32:0/4145384029 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8003980 con 0x7fd7e01f2100 2024-01-19T04:16:42.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7d7400640 1 -- 172.21.15.32:0/4145384029 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8003d50 con 0x7fd7e01f2100 2024-01-19T04:16:42.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.029+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e01f1900 con 0x7fd7e01f2100 2024-01-19T04:16:42.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.033+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e0155310 con 0x7fd7e01f2100 2024-01-19T04:16:42.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.033+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e01f1e20 con 0x7fd7e01f2100 2024-01-19T04:16:42.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.033+0000 7fd7d7400640 1 -- 172.21.15.32:0/4145384029 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd7d80050d0 con 0x7fd7e01f2100 2024-01-19T04:16:42.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.033+0000 7fd7d7400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd7b8066530 0x7fd7b80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.033+0000 7fd7d7400640 1 -- 172.21.15.32:0/4145384029 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd7d8083820 con 0x7fd7e01f2100 2024-01-19T04:16:42.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.033+0000 7fd7df400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd7b8066530 0x7fd7b80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.033+0000 7fd7df400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd7b8066530 0x7fd7b80689f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ab000 tx=0x7fd7d00b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:42.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.037+0000 7fd7d7400640 1 -- 172.21.15.32:0/4145384029 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd7e01f1e20 con 0x7fd7e01f2100 2024-01-19T04:16:42.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.261+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fd7e01f1e20 con 0x7fd7e01f2100 2024-01-19T04:16:42.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.493+0000 7fd7d7400640 1 -- 172.21.15.32:0/4145384029 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v118) v1 ==== 159+0+0 (secure 0 0 0) 0x7fd7e01f1e20 con 0x7fd7e01f2100 2024-01-19T04:16:42.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd7b8066530 msgr2=0x7fd7b80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd7b8066530 0x7fd7b80689f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00ab000 tx=0x7fd7d00b1040 comp rx=0 tx=0).stop 2024-01-19T04:16:42.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e01f2100 msgr2=0x7fd7e01edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e01f2100 0x7fd7e01edf50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00683b0 tx=0x7fd7d800eb90 comp rx=0 tx=0).stop 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 shutdown_connections 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd7b8066530 0x7fd7b80689f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e01f2100 0x7fd7e01edf50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7e006d3d0 0x7fd7e006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 --2- 172.21.15.32:0/4145384029 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7c0003980 0x7fd7e014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 >> 172.21.15.32:0/4145384029 conn(0x7fd7e00a9870 msgr2=0x7fd7e00a9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 shutdown_connections 2024-01-19T04:16:42.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.497+0000 7fd7e6400640 1 -- 172.21.15.32:0/4145384029 wait complete. 2024-01-19T04:16:42.518 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2024-01-19T04:16:42.519 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-19T04:16:42.519 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:42.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4128a00640 1 Processor -- start 2024-01-19T04:16:42.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4128a00640 1 -- start start 2024-01-19T04:16:42.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4128a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f41200c55e0 0x7f4120151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4128a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41200c1d40 con 0x7f4120147f90 2024-01-19T04:16:42.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4128a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41200c0810 con 0x7f41200c18b0 2024-01-19T04:16:42.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4128a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412006c5c0 con 0x7f41200c55e0 2024-01-19T04:16:42.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4126000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4120147f90 0x7f412006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60892/0 (socket says 172.21.15.32:60892) 2024-01-19T04:16:42.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4126000640 1 -- 172.21.15.32:0/846715214 learned_addr learned my addr 172.21.15.32:0/846715214 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:42.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4125600640 1 --2- 172.21.15.32:0/846715214 >> v2:172.21.15.67:3300/0 conn(0x7f41200c55e0 0x7f4120151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287490280 0 0) 0x7f41200c1d40 con 0x7f4120147f90 2024-01-19T04:16:42.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.657+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4100003530 con 0x7f4120147f90 2024-01-19T04:16:42.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736118265 0 0) 0x7f4100003530 con 0x7f4120147f90 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 >> v2:172.21.15.67:3300/0 conn(0x7f41200c55e0 msgr2=0x7f4120151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 --2- 172.21.15.32:0/846715214 >> v2:172.21.15.67:3300/0 conn(0x7f41200c55e0 0x7f4120151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 >> v1:172.21.15.67:6789/0 conn(0x7f41200c18b0 legacy=0x7f41200a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200c0af0 con 0x7f4120147f90 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f4110001680 con 0x7f4120147f90 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 >> v1:172.21.15.32:6789/0 conn(0x7f4120147f90 legacy=0x7f412006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4100003980 0x7f4100003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f4100004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f41000050f0 0x7f410000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412006c5c0 con 0x7f4100004380 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410000c030 con 0x7f4100003980 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410000c1f0 con 0x7f41000050f0 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4125600640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f4100004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4126000640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4100003980 0x7f4100003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4126a00640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f41000050f0 0x7f410000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4125600640 1 -- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f41000050f0 msgr2=0x7f410000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4125600640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f41000050f0 0x7f410000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4125600640 1 -- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4100003980 msgr2=0x7f4100003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4125600640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4100003980 0x7f4100003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4125600640 1 -- 172.21.15.32:0/846715214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4100003530 con 0x7f4100004380 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4126a00640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f41000050f0 0x7f410000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.661+0000 7f4126a00640 1 -- 172.21.15.32:0/846715214 reap_dead start 2024-01-19T04:16:42.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4125600640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f4100004850 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4108009ab0 tx=0x7f410801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668cd74ab6e30c78 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:42.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080a64f0 con 0x7f4100004380 2024-01-19T04:16:42.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41080a6650 con 0x7f4100004380 2024-01-19T04:16:42.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4124c00640 1 -- 172.21.15.32:0/846715214 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080a6a00 con 0x7f4100004380 2024-01-19T04:16:42.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 -- 172.21.15.32:0/846715214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 msgr2=0x7f4100004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f4100004850 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4108009ab0 tx=0x7f410801ca00 comp rx=0 tx=0).stop 2024-01-19T04:16:42.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 -- 172.21.15.32:0/846715214 shutdown_connections 2024-01-19T04:16:42.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 --2- 172.21.15.32:0/846715214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f4100004850 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 -- 172.21.15.32:0/846715214 >> 172.21.15.32:0/846715214 conn(0x7f41200c5b20 msgr2=0x7f41200c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:42.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 -- 172.21.15.32:0/846715214 shutdown_connections 2024-01-19T04:16:42.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 -- 172.21.15.32:0/846715214 wait complete. 2024-01-19T04:16:42.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 Processor -- start 2024-01-19T04:16:42.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 -- start start 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.665+0000 7f4128a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f41201e3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4120147450 0x7f41201ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f412014f880 0x7f412014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41200a8da0 con 0x7f4100004380 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412014f3f0 con 0x7f4120147450 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41201edf10 con 0x7f412014f880 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f41201e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f41201e3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56550/0 (socket says 172.21.15.32:56550) 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 -- 172.21.15.32:0/1081111988 learned_addr learned my addr 172.21.15.32:0/1081111988 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126a00640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f412014f880 0x7f412014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4125600640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4120147450 0x7f41201ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 -- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f412014f880 msgr2=0x7f412014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f412014f880 0x7f412014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 -- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4120147450 msgr2=0x7f41201ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4120147450 0x7f41201ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 -- 172.21.15.32:0/1081111988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41201ee1f0 con 0x7f4100004380 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4126000640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f41201e3170 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4110008400 tx=0x7f4110008800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f411e000640 1 -- 172.21.15.32:0/1081111988 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000f9b0 con 0x7f4100004380 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f411e000640 1 -- 172.21.15.32:0/1081111988 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000fb10 con 0x7f4100004380 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f411e000640 1 -- 172.21.15.32:0/1081111988 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000fe80 con 0x7f4100004380 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412014f080 con 0x7f4100004380 2024-01-19T04:16:42.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41201ee4d0 con 0x7f4100004380 2024-01-19T04:16:42.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41200749f0 con 0x7f4100004380 2024-01-19T04:16:42.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.669+0000 7f411e000640 1 -- 172.21.15.32:0/1081111988 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f41100153e0 con 0x7f4100004380 2024-01-19T04:16:42.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.673+0000 7f411e000640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40f8066530 0x7f40f80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:42.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.673+0000 7f411e000640 1 -- 172.21.15.32:0/1081111988 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4110083f20 con 0x7f4100004380 2024-01-19T04:16:42.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.673+0000 7f4125600640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40f8066530 0x7f40f80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:42.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.673+0000 7f4125600640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40f8066530 0x7f40f80689f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41080af000 tx=0x7f4108008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:42.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.677+0000 7f411e000640 1 -- 172.21.15.32:0/1081111988 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f41100513c0 con 0x7f4100004380 2024-01-19T04:16:42.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.837+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41200c21d0 con 0x7f4100004380 2024-01-19T04:16:42.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.837+0000 7f411e000640 1 -- 172.21.15.32:0/1081111988 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13019 (secure 0 0 0) 0x7f41100549e0 con 0x7f4100004380 2024-01-19T04:16:42.842 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:42.842 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":45,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:41.487493+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6834/3465366661":"2024-01-20T04:16:38.481668+0000","172.21.15.32:6832/3465366661":"2024-01-20T04:16:38.481668+0000","172.21.15.32:6835/884465323":"2024-01-20T04:16:31.717910+0000","172.21.15.32:6833/884465323":"2024-01-20T04:16:31.717910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:42.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40f8066530 msgr2=0x7f40f80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40f8066530 0x7f40f80689f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41080af000 tx=0x7f4108008040 comp rx=0 tx=0).stop 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 msgr2=0x7f41201e3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f41201e3170 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4110008400 tx=0x7f4110008800 comp rx=0 tx=0).stop 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 shutdown_connections 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f40f8066530 0x7f40f80689f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f412014f880 0x7f412014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4120147450 0x7f41201ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 --2- 172.21.15.32:0/1081111988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4100004380 0x7f41201e3170 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 >> 172.21.15.32:0/1081111988 conn(0x7f41200c5b20 msgr2=0x7f412006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 shutdown_connections 2024-01-19T04:16:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:42.841+0000 7f4128a00640 1 -- 172.21.15.32:0/1081111988 wait complete. 2024-01-19T04:16:42.866 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:42.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:43.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.009+0000 7fa0bc800640 1 Processor -- start 2024-01-19T04:16:43.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.009+0000 7fa0bc800640 1 -- start start 2024-01-19T04:16:43.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.009+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4151b80 0x7fa0b4155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.009+0000 7fa0bc800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6360 0x7fa0b40c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.009+0000 7fa0bc800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b40c2d30 con 0x7fa0b4157cc0 2024-01-19T04:16:43.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.009+0000 7fa0bc800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b40c34a0 con 0x7fa0b40c6360 2024-01-19T04:16:43.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.009+0000 7fa0bc800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4155730 con 0x7fa0b4151b80 2024-01-19T04:16:43.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4151b80 0x7fa0b4155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0ba800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0b40c6360 0x7fa0b40c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b9400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa0b4157cc0 0x7fa0b40c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:40864/0 (socket says 172.21.15.32:40864) 2024-01-19T04:16:43.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b9400640 1 -- 172.21.15.32:0/2499779815 learned_addr learned my addr 172.21.15.32:0/2499779815 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:43.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b8a00640 1 -- 172.21.15.32:0/2499779815 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966700976 0 0) 0x7fa0b40c2d30 con 0x7fa0b4157cc0 2024-01-19T04:16:43.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b8a00640 1 -- 172.21.15.32:0/2499779815 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa094003530 con 0x7fa0b4157cc0 2024-01-19T04:16:43.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0ba800640 1 -- 172.21.15.32:0/2499779815 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4151b80 msgr2=0x7fa0b4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:43.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0ba800640 1 --2- 172.21.15.32:0/2499779815 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4151b80 0x7fa0b4155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0ba800640 1 -- 172.21.15.32:0/2499779815 >> v1:172.21.15.67:6789/0 conn(0x7fa0b4157cc0 legacy=0x7fa0b40c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0ba800640 1 -- 172.21.15.32:0/2499779815 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40c3010 con 0x7fa0b40c6360 2024-01-19T04:16:43.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0ba800640 1 --2- 172.21.15.32:0/2499779815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6360 0x7fa0b40c67d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009dc0 tx=0x7fa0ac01c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ddd5e67e95e95 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:43.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b8a00640 1 -- 172.21.15.32:0/2499779815 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0a58d0 con 0x7fa0b40c6360 2024-01-19T04:16:43.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b8a00640 1 -- 172.21.15.32:0/2499779815 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0a5a30 con 0x7fa0b40c6360 2024-01-19T04:16:43.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.013+0000 7fa0b8a00640 1 -- 172.21.15.32:0/2499779815 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0a5dc0 con 0x7fa0b40c6360 2024-01-19T04:16:43.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- 172.21.15.32:0/2499779815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6360 msgr2=0x7fa0b40c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 --2- 172.21.15.32:0/2499779815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6360 0x7fa0b40c67d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009dc0 tx=0x7fa0ac01c900 comp rx=0 tx=0).stop 2024-01-19T04:16:43.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- 172.21.15.32:0/2499779815 shutdown_connections 2024-01-19T04:16:43.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 --2- 172.21.15.32:0/2499779815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b40c6360 0x7fa0b40c67d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 --2- 172.21.15.32:0/2499779815 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4151b80 0x7fa0b4155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- 172.21.15.32:0/2499779815 >> 172.21.15.32:0/2499779815 conn(0x7fa0b40c7d40 msgr2=0x7fa0b40c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:43.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- 172.21.15.32:0/2499779815 shutdown_connections 2024-01-19T04:16:43.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- 172.21.15.32:0/2499779815 wait complete. 2024-01-19T04:16:43.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 Processor -- start 2024-01-19T04:16:43.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- start start 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0b40c6360 0x7fa0b406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b4151b80 0x7fa0b4147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4157cc0 0x7fa0b4147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b414d950 con 0x7fa0b40c6360 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4148050 con 0x7fa0b4151b80 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0bc800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b414cb90 con 0x7fa0b4157cc0 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0b9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0b40c6360 0x7fa0b406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0b9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0b40c6360 0x7fa0b406c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56556/0 (socket says 172.21.15.32:56556) 2024-01-19T04:16:43.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0b9e00640 1 -- 172.21.15.32:0/1089406146 learned_addr learned my addr 172.21.15.32:0/1089406146 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0b9400640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b4151b80 0x7fa0b4147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.017+0000 7fa0ba800640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4157cc0 0x7fa0b4147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b9e00640 1 -- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4157cc0 msgr2=0x7fa0b4147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b9e00640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4157cc0 0x7fa0b4147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b9e00640 1 -- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b4151b80 msgr2=0x7fa0b4147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b9e00640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b4151b80 0x7fa0b4147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b9e00640 1 -- 172.21.15.32:0/1089406146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac009a70 con 0x7fa0b40c6360 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b9e00640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0b40c6360 0x7fa0b406c9f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400e930 tx=0x7fa0a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b2000640 1 -- 172.21.15.32:0/1089406146 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4009690 con 0x7fa0b40c6360 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b2000640 1 -- 172.21.15.32:0/1089406146 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a400ca00 con 0x7fa0b40c6360 2024-01-19T04:16:43.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b2000640 1 -- 172.21.15.32:0/1089406146 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a400cd70 con 0x7fa0b40c6360 2024-01-19T04:16:43.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b414ce70 con 0x7fa0b40c6360 2024-01-19T04:16:43.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b4156f20 con 0x7fa0b40c6360 2024-01-19T04:16:43.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b40749f0 con 0x7fa0b40c6360 2024-01-19T04:16:43.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b2000640 1 -- 172.21.15.32:0/1089406146 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa0a4013470 con 0x7fa0b40c6360 2024-01-19T04:16:43.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b2000640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa08c066500 0x7fa08c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b2000640 1 -- 172.21.15.32:0/1089406146 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa0a4083db0 con 0x7fa0b40c6360 2024-01-19T04:16:43.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.021+0000 7fa0b9400640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa08c066500 0x7fa08c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.025+0000 7fa0b9400640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa08c066500 0x7fa08c0689c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa09c007fd0 tx=0x7fa09c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:43.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.025+0000 7fa0b2000640 1 -- 172.21.15.32:0/1089406146 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa0a4088070 con 0x7fa0b40c6360 2024-01-19T04:16:43.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.185+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0b40c3b60 con 0x7fa0b40c6360 2024-01-19T04:16:43.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0b2000640 1 -- 172.21.15.32:0/1089406146 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0a4051450 con 0x7fa0b40c6360 2024-01-19T04:16:43.190 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:43.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa08c066500 msgr2=0x7fa08c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa08c066500 0x7fa08c0689c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa09c007fd0 tx=0x7fa09c009040 comp rx=0 tx=0).stop 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0b40c6360 msgr2=0x7fa0b406c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0b40c6360 0x7fa0b406c9f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400e930 tx=0x7fa0a400edf0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 shutdown_connections 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa08c066500 0x7fa08c0689c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa0b4157cc0 0x7fa0b4147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0b4151b80 0x7fa0b4147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 --2- 172.21.15.32:0/1089406146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0b40c6360 0x7fa0b406c9f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 >> 172.21.15.32:0/1089406146 conn(0x7fa0b40c7d40 msgr2=0x7fa0b41581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:43.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 shutdown_connections 2024-01-19T04:16:43.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.189+0000 7fa0bc800640 1 -- 172.21.15.32:0/1089406146 wait complete. 2024-01-19T04:16:43.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2024-01-19T04:16:43.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb19a600640 1 Processor -- start 2024-01-19T04:16:43.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb19a600640 1 -- start start 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb19a600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1940c5740 0x7fb1940c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb19a600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1940c1120 0x7fb19415b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb19a600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940c0c90 con 0x7fb1940c42b0 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb19a600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb194150f90 con 0x7fb1940c1120 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb19a600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb194150cb0 con 0x7fb1940c5740 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb193e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1940c1120 0x7fb19415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb193e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1940c1120 0x7fb19415b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56558/0 (socket says 172.21.15.32:56558) 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb193e00640 1 -- 172.21.15.32:0/946929770 learned_addr learned my addr 172.21.15.32:0/946929770 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb193e00640 1 -- 172.21.15.32:0/946929770 >> v2:172.21.15.67:3300/0 conn(0x7fb1940c5740 msgr2=0x7fb1940c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb192a00640 1 --2- 172.21.15.32:0/946929770 >> v2:172.21.15.67:3300/0 conn(0x7fb1940c5740 0x7fb1940c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb193e00640 1 --2- 172.21.15.32:0/946929770 >> v2:172.21.15.67:3300/0 conn(0x7fb1940c5740 0x7fb1940c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb193e00640 1 -- 172.21.15.32:0/946929770 >> v1:172.21.15.67:6789/0 conn(0x7fb1940c42b0 legacy=0x7fb19406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb193e00640 1 -- 172.21.15.32:0/946929770 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940c0640 con 0x7fb1940c1120 2024-01-19T04:16:43.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.353+0000 7fb192a00640 1 --2- 172.21.15.32:0/946929770 >> v2:172.21.15.67:3300/0 conn(0x7fb1940c5740 0x7fb1940c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:43.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb193e00640 1 --2- 172.21.15.32:0/946929770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb19415b440 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb194070270 tx=0x7fb18c01f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec59c18440172dd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:43.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb192000640 1 -- 172.21.15.32:0/946929770 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00b2d0 con 0x7fb1940c1120 2024-01-19T04:16:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb192000640 1 -- 172.21.15.32:0/946929770 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00b430 con 0x7fb1940c1120 2024-01-19T04:16:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb192000640 1 -- 172.21.15.32:0/946929770 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0a7b60 con 0x7fb1940c1120 2024-01-19T04:16:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 -- 172.21.15.32:0/946929770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 msgr2=0x7fb19415b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 --2- 172.21.15.32:0/946929770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb19415b440 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb194070270 tx=0x7fb18c01f530 comp rx=0 tx=0).stop 2024-01-19T04:16:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 -- 172.21.15.32:0/946929770 shutdown_connections 2024-01-19T04:16:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 --2- 172.21.15.32:0/946929770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb19415b440 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 --2- 172.21.15.32:0/946929770 >> v2:172.21.15.67:3300/0 conn(0x7fb1940c5740 0x7fb1940c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 -- 172.21.15.32:0/946929770 >> 172.21.15.32:0/946929770 conn(0x7fb1940c5b20 msgr2=0x7fb1940c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 -- 172.21.15.32:0/946929770 shutdown_connections 2024-01-19T04:16:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.357+0000 7fb19a600640 1 -- 172.21.15.32:0/946929770 wait complete. 2024-01-19T04:16:43.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 Processor -- start 2024-01-19T04:16:43.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 -- start start 2024-01-19T04:16:43.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb1940bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1940c42b0 0x7fb194146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1940c5740 0x7fb194147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb194148560 con 0x7fb1940c1120 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941ee220 con 0x7fb1940c42b0 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19414a430 con 0x7fb1940c5740 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb1940bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb1940bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56572/0 (socket says 172.21.15.32:56572) 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 -- 172.21.15.32:0/287869158 learned_addr learned my addr 172.21.15.32:0/287869158 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb192a00640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1940c42b0 0x7fb194146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193e00640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1940c5740 0x7fb194147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 -- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1940c5740 msgr2=0x7fb194147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1940c5740 0x7fb194147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 -- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1940c42b0 msgr2=0x7fb194146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:43.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1940c42b0 0x7fb194146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 -- 172.21.15.32:0/287869158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c00bd40 con 0x7fb1940c1120 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb192a00640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1940c42b0 0x7fb194146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb193400640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb1940bf130 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb18400b440 tx=0x7fb18400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb18b400640 1 -- 172.21.15.32:0/287869158 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184011890 con 0x7fb1940c1120 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb18b400640 1 -- 172.21.15.32:0/287869158 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840119f0 con 0x7fb1940c1120 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb18b400640 1 -- 172.21.15.32:0/287869158 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184011da0 con 0x7fb1940c1120 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1941475a0 con 0x7fb1940c1120 2024-01-19T04:16:43.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb194147cc0 con 0x7fb1940c1120 2024-01-19T04:16:43.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.361+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1940749f0 con 0x7fb1940c1120 2024-01-19T04:16:43.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.365+0000 7fb18b400640 1 -- 172.21.15.32:0/287869158 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb18401a400 con 0x7fb1940c1120 2024-01-19T04:16:43.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.365+0000 7fb18b400640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb16c066500 0x7fb16c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:43.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.365+0000 7fb18b400640 1 -- 172.21.15.32:0/287869158 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb184083b90 con 0x7fb1940c1120 2024-01-19T04:16:43.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.365+0000 7fb192a00640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb16c066500 0x7fb16c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:43.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.365+0000 7fb192a00640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb16c066500 0x7fb16c0689c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb17c006fd0 tx=0x7fb17c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:43.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.369+0000 7fb18b400640 1 -- 172.21.15.32:0/287869158 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb1840510d0 con 0x7fb1940c1120 2024-01-19T04:16:43.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:43.585+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fb194070900 con 0x7fb1940c1120 2024-01-19T04:16:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.501+0000 7fb18b400640 1 -- 172.21.15.32:0/287869158 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v120) v1 ==== 187+0+0 (secure 0 0 0) 0x7fb1840546f0 con 0x7fb1940c1120 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb16c066500 msgr2=0x7fb16c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb16c066500 0x7fb16c0689c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb17c006fd0 tx=0x7fb17c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 msgr2=0x7fb1940bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb1940bf130 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb18400b440 tx=0x7fb18400b900 comp rx=0 tx=0).stop 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 shutdown_connections 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb16c066500 0x7fb16c0689c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1940c5740 0x7fb194147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1940c42b0 0x7fb194146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 --2- 172.21.15.32:0/287869158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1940c1120 0x7fb1940bf130 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 >> 172.21.15.32:0/287869158 conn(0x7fb1940c5b20 msgr2=0x7fb1941e2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 shutdown_connections 2024-01-19T04:16:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.505+0000 7fb19a600640 1 -- 172.21.15.32:0/287869158 wait complete. 2024-01-19T04:16:44.532 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-19T04:16:44.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.677+0000 7f3500600640 1 Processor -- start 2024-01-19T04:16:44.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.677+0000 7f3500600640 1 -- start start 2024-01-19T04:16:44.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f3500600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34f81550e0 0x7f34f80719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f3500600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34f806c670 0x7f34f8071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f3500600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f8072730 con 0x7f34f814eb90 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f3500600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f8072a10 con 0x7f34f806c670 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f3500600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f814ef70 con 0x7f34f81550e0 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fe600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34f806c670 0x7f34f8071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fe600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34f806c670 0x7f34f8071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56574/0 (socket says 172.21.15.32:56574) 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fe600640 1 -- 172.21.15.32:0/2667925989 learned_addr learned my addr 172.21.15.32:0/2667925989 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fd200640 1 --2- 172.21.15.32:0/2667925989 >> v2:172.21.15.67:3300/0 conn(0x7f34f81550e0 0x7f34f80719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fe600640 1 -- 172.21.15.32:0/2667925989 >> v2:172.21.15.67:3300/0 conn(0x7f34f81550e0 msgr2=0x7f34f80719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fe600640 1 --2- 172.21.15.32:0/2667925989 >> v2:172.21.15.67:3300/0 conn(0x7f34f81550e0 0x7f34f80719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fe600640 1 -- 172.21.15.32:0/2667925989 >> v1:172.21.15.67:6789/0 conn(0x7f34f814eb90 legacy=0x7f34f81549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.681+0000 7f34fe600640 1 -- 172.21.15.32:0/2667925989 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8155580 con 0x7f34f806c670 2024-01-19T04:16:44.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f34fe600640 1 --2- 172.21.15.32:0/2667925989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f806c670 0x7f34f8071ee0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f34f8066fd0 tx=0x7f34f001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a329fca9a688536 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:44.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f34f7e00640 1 -- 172.21.15.32:0/2667925989 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5710 con 0x7f34f806c670 2024-01-19T04:16:44.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f34f7e00640 1 -- 172.21.15.32:0/2667925989 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f00a5870 con 0x7f34f806c670 2024-01-19T04:16:44.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f34f7e00640 1 -- 172.21.15.32:0/2667925989 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5c00 con 0x7f34f806c670 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 -- 172.21.15.32:0/2667925989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f806c670 msgr2=0x7f34f8071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 --2- 172.21.15.32:0/2667925989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f806c670 0x7f34f8071ee0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f34f8066fd0 tx=0x7f34f001c940 comp rx=0 tx=0).stop 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 -- 172.21.15.32:0/2667925989 shutdown_connections 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 --2- 172.21.15.32:0/2667925989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f806c670 0x7f34f8071ee0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 --2- 172.21.15.32:0/2667925989 >> v2:172.21.15.67:3300/0 conn(0x7f34f81550e0 0x7f34f80719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 -- 172.21.15.32:0/2667925989 >> 172.21.15.32:0/2667925989 conn(0x7f34f80c25a0 msgr2=0x7f34f80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 -- 172.21.15.32:0/2667925989 shutdown_connections 2024-01-19T04:16:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 -- 172.21.15.32:0/2667925989 wait complete. 2024-01-19T04:16:44.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 Processor -- start 2024-01-19T04:16:44.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.685+0000 7f3500600640 1 -- start start 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f806c670 0x7f34f81edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f814eb90 0x7f34f81eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f81550e0 0x7f34f815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f81f0b30 con 0x7f34f814eb90 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8150f10 con 0x7f34f806c670 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f81f07c0 con 0x7f34f81550e0 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f814eb90 0x7f34f81eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f814eb90 0x7f34f81eb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56580/0 (socket says 172.21.15.32:56580) 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 -- 172.21.15.32:0/2671537754 learned_addr learned my addr 172.21.15.32:0/2671537754 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fdc00640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f806c670 0x7f34f81edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:44.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fe600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f81550e0 0x7f34f815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 -- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f81550e0 msgr2=0x7f34f815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f81550e0 0x7f34f815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 -- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f806c670 msgr2=0x7f34f81edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f806c670 0x7f34f81edb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 -- 172.21.15.32:0/2671537754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009b30 con 0x7f34f814eb90 2024-01-19T04:16:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34fd200640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f814eb90 0x7f34f81eb0e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f34e000e9b0 tx=0x7f34e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:44.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34f5600640 1 -- 172.21.15.32:0/2671537754 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00096b0 con 0x7f34f814eb90 2024-01-19T04:16:44.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34f5600640 1 -- 172.21.15.32:0/2671537754 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000c9a0 con 0x7f34f814eb90 2024-01-19T04:16:44.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34f5600640 1 -- 172.21.15.32:0/2671537754 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000cd30 con 0x7f34f814eb90 2024-01-19T04:16:44.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f814e6b0 con 0x7f34f814eb90 2024-01-19T04:16:44.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f81511f0 con 0x7f34f814eb90 2024-01-19T04:16:44.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f81f0ca0 con 0x7f34f814eb90 2024-01-19T04:16:44.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.689+0000 7f34f5600640 1 -- 172.21.15.32:0/2671537754 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f34e0013470 con 0x7f34f814eb90 2024-01-19T04:16:44.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.693+0000 7f34f5600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34d0066530 0x7f34d00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:44.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.693+0000 7f34f5600640 1 -- 172.21.15.32:0/2671537754 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f34e0083e90 con 0x7f34f814eb90 2024-01-19T04:16:44.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.693+0000 7f34fdc00640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34d0066530 0x7f34d00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:44.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.693+0000 7f34fdc00640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34d0066530 0x7f34d00689f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34e8001810 tx=0x7f34e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:44.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.697+0000 7f34f5600640 1 -- 172.21.15.32:0/2671537754 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f34e00513e0 con 0x7f34f814eb90 2024-01-19T04:16:44.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.857+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f34f80749f0 con 0x7f34f814eb90 2024-01-19T04:16:44.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f34f5600640 1 -- 172.21.15.32:0/2671537754 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f34e0054a00 con 0x7f34f814eb90 2024-01-19T04:16:44.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34d0066530 msgr2=0x7f34d00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34d0066530 0x7f34d00689f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34e8001810 tx=0x7f34e8009040 comp rx=0 tx=0).stop 2024-01-19T04:16:44.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f814eb90 msgr2=0x7f34f81eb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f814eb90 0x7f34f81eb0e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f34e000e9b0 tx=0x7f34e000ee70 comp rx=0 tx=0).stop 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 shutdown_connections 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f34d0066530 0x7f34d00689f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f34f81550e0 0x7f34f815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34f814eb90 0x7f34f81eb0e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 --2- 172.21.15.32:0/2671537754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34f806c670 0x7f34f81edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 >> 172.21.15.32:0/2671537754 conn(0x7f34f80c25a0 msgr2=0x7f34f815b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 shutdown_connections 2024-01-19T04:16:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:44.861+0000 7f3500600640 1 -- 172.21.15.32:0/2671537754 wait complete. 2024-01-19T04:16:44.885 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T04:16:44.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:16:44.968 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:16:45.055 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T04:16:45.055 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:45.055 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:45.064 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:16:45.064 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:45.065 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:45.074 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:16:45.074 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-19T04:16:45.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:45.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca6e00640 1 Processor -- start 2024-01-19T04:16:45.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca6e00640 1 -- start start 2024-01-19T04:16:45.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca6e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 0x7fdca00c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca6e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00c5b40 con 0x7fdca006eb70 2024-01-19T04:16:45.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca6e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00c3fa0 con 0x7fdca006fda0 2024-01-19T04:16:45.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca6e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01551e0 con 0x7fdca0151f30 2024-01-19T04:16:45.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca4e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdca006eb70 0x7fdca006f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60906/0 (socket says 172.21.15.32:60906) 2024-01-19T04:16:45.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca4e00640 1 -- 172.21.15.32:0/1222308963 learned_addr learned my addr 172.21.15.32:0/1222308963 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9fe00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 0x7fdca00c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263624323 0 0) 0x7fdca00c5b40 con 0x7fdca006eb70 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc80003530 con 0x7fdca006eb70 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1900384745 0 0) 0x7fdc80003530 con 0x7fdca006eb70 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 msgr2=0x7fdca00c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 0x7fdca00c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 >> v1:172.21.15.67:6789/0 conn(0x7fdca006fda0 legacy=0x7fdca00c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0155710 con 0x7fdca006eb70 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fdc98001a00 con 0x7fdca006eb70 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 >> v1:172.21.15.32:6789/0 conn(0x7fdca006eb70 legacy=0x7fdca006f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 0x7fdc800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc80003f30 0x7fdc800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdc80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01551e0 con 0x7fdc80004d10 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8000bb20 con 0x7fdc80003f30 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8000bce0 con 0x7fdca0151f30 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdca4e00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdc80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9f400640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc80003f30 0x7fdc800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.245+0000 7fdc9fe00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 0x7fdc800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca4e00640 1 -- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 msgr2=0x7fdc800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca4e00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 0x7fdc800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca4e00640 1 -- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc80003f30 msgr2=0x7fdc800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca4e00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc80003f30 0x7fdc800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca4e00640 1 -- 172.21.15.32:0/1222308963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80003530 con 0x7fdc80004d10 2024-01-19T04:16:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdc9fe00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca0151f30 0x7fdc800039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca4e00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdc80005190 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800a820 tx=0x7fdc9801fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4163e26703e708b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980aa6b0 con 0x7fdc80004d10 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980aa810 con 0x7fdc80004d10 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdc9ea00640 1 -- 172.21.15.32:0/1222308963 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980aac00 con 0x7fdc80004d10 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca6e00640 1 -- 172.21.15.32:0/1222308963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 msgr2=0x7fdc80005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca6e00640 1 --2- 172.21.15.32:0/1222308963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdc80005190 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800a820 tx=0x7fdc9801fa80 comp rx=0 tx=0).stop 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca4e00640 1 -- 172.21.15.32:0/1222308963 reap_dead start 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca6e00640 1 -- 172.21.15.32:0/1222308963 shutdown_connections 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.249+0000 7fdca6e00640 1 -- 172.21.15.32:0/1222308963 >> 172.21.15.32:0/1222308963 conn(0x7fdca00a9870 msgr2=0x7fdca00a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 -- 172.21.15.32:0/1222308963 shutdown_connections 2024-01-19T04:16:45.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 -- 172.21.15.32:0/1222308963 wait complete. 2024-01-19T04:16:45.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 Processor -- start 2024-01-19T04:16:45.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 -- start start 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdca00a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca01ea5c0 0x7fdca0150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdca0156ea0 0x7fdca0157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00a88d0 con 0x7fdc80004d10 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00bf520 con 0x7fdca0156ea0 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca6e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00bf260 con 0x7fdca01ea5c0 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdca00a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdca00a8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56592/0 (socket says 172.21.15.32:56592) 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 -- 172.21.15.32:0/592404880 learned_addr learned my addr 172.21.15.32:0/592404880 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdca4e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdca0156ea0 0x7fdca0157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9f400640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca01ea5c0 0x7fdca0150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 -- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca01ea5c0 msgr2=0x7fdca0150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca01ea5c0 0x7fdca0150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 -- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdca0156ea0 msgr2=0x7fdca0157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdca0156ea0 0x7fdca0157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 -- 172.21.15.32:0/592404880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00a8280 con 0x7fdc80004d10 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc9fe00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdca00a8d60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc90011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.253+0000 7fdc97e00640 1 -- 172.21.15.32:0/592404880 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90004220 con 0x7fdc80004d10 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdc97e00640 1 -- 172.21.15.32:0/592404880 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90004380 con 0x7fdc80004d10 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca00a8560 con 0x7fdc80004d10 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdc97e00640 1 -- 172.21.15.32:0/592404880 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000f9e0 con 0x7fdc80004d10 2024-01-19T04:16:45.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca0150870 con 0x7fdc80004d10 2024-01-19T04:16:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca00749f0 con 0x7fdc80004d10 2024-01-19T04:16:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdc97e00640 1 -- 172.21.15.32:0/592404880 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdc9000fb40 con 0x7fdc80004d10 2024-01-19T04:16:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdc97e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdc78066530 0x7fdc780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdc97e00640 1 -- 172.21.15.32:0/592404880 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdc90084130 con 0x7fdc80004d10 2024-01-19T04:16:45.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdc9f400640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdc78066530 0x7fdc780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.257+0000 7fdc9f400640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdc78066530 0x7fdc780689f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdca01e7980 tx=0x7fdc88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:45.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.261+0000 7fdc97e00640 1 -- 172.21.15.32:0/592404880 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdc90051710 con 0x7fdc80004d10 2024-01-19T04:16:45.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdca0067b80 con 0x7fdc80004d10 2024-01-19T04:16:45.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdc97e00640 1 -- 172.21.15.32:0/592404880 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3696 (secure 0 0 0) 0x7fdc90054d30 con 0x7fdc80004d10 2024-01-19T04:16:45.468 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:45.468 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4105583353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4105583353},{"type":"v1","addr":"172.21.15.67:6837","nonce":4105583353}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4951,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1321010014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1321010014},{"type":"v1","addr":"172.21.15.67:6836","nonce":1321010014}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1016675671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":1016675671},{"type":"v1","addr":"172.21.15.32:6835","nonce":1016675671}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5760,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/350177432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":350177432},{"type":"v1","addr":"172.21.15.32:6834","nonce":350177432}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2024-01-19T04:16:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 25 2024-01-19T04:16:45.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdc78066530 msgr2=0x7fdc780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdc78066530 0x7fdc780689f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdca01e7980 tx=0x7fdc88009040 comp rx=0 tx=0).stop 2024-01-19T04:16:45.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 msgr2=0x7fdca00a8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdca00a8d60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc90011b30 comp rx=0 tx=0).stop 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 shutdown_connections 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdc78066530 0x7fdc780689f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdca0156ea0 0x7fdca0157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdca01ea5c0 0x7fdca0150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.465+0000 7fdca6e00640 1 --2- 172.21.15.32:0/592404880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc80004d10 0x7fdca00a8d60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.469+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 >> 172.21.15.32:0/592404880 conn(0x7fdca00a9870 msgr2=0x7fdca0153050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.469+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 shutdown_connections 2024-01-19T04:16:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.469+0000 7fdca6e00640 1 -- 172.21.15.32:0/592404880 wait complete. 2024-01-19T04:16:45.490 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-19T04:16:45.490 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-19T04:16:45.491 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-19T04:16:45.491 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:16:45.491 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-19T04:16:45.491 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-19T04:16:45.491 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-19T04:16:45.491 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:16:45.491 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-19T04:16:45.491 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-19T04:16:45.492 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-19T04:16:45.492 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:16:45.492 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-19T04:16:45.492 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-19T04:16:45.492 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-19T04:16:45.492 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:16:45.507 INFO:tasks.ceph.mds.c:Stopped 2024-01-19T04:16:45.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-19T04:16:45.507 INFO:tasks.ceph.mds.a:Stopped 2024-01-19T04:16:45.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-19T04:16:45.509 INFO:tasks.ceph.mds.b:Stopped 2024-01-19T04:16:45.509 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-19T04:16:45.509 INFO:tasks.ceph.mds.d:Stopped 2024-01-19T04:16:45.510 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-19T04:16:45.552 INFO:tasks.ceph.mds.c:Started 2024-01-19T04:16:45.553 DEBUG:teuthology.parallel:result is None 2024-01-19T04:16:45.554 INFO:tasks.ceph.mds.a:Started 2024-01-19T04:16:45.554 DEBUG:teuthology.parallel:result is None 2024-01-19T04:16:45.556 INFO:tasks.ceph.mds.b:Started 2024-01-19T04:16:45.556 DEBUG:teuthology.parallel:result is None 2024-01-19T04:16:45.557 INFO:tasks.ceph.mds.d:Started 2024-01-19T04:16:45.557 DEBUG:teuthology.parallel:result is None 2024-01-19T04:16:45.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-19T04:16:45.641 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-01-19T04:16:45.642 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-01-19T04:16:45.646 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2024-01-19T04:16:45.647 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2024-01-19T04:16:45.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.701+0000 7fa3d8a00640 1 Processor -- start 2024-01-19T04:16:45.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.701+0000 7fa3d8a00640 1 -- start start 2024-01-19T04:16:45.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3d0151f10 0x7fa3d01588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d8a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d0072d40 con 0x7fa3d01546b0 2024-01-19T04:16:45.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d8a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d0072800 con 0x7fa3d006f550 2024-01-19T04:16:45.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d8a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d00c3450 con 0x7fa3d0151f10 2024-01-19T04:16:45.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d6a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa3d01546b0 0x7fa3d006bbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60924/0 (socket says 172.21.15.32:60924) 2024-01-19T04:16:45.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d6a00640 1 -- 172.21.15.32:0/3722560132 learned_addr learned my addr 172.21.15.32:0/3722560132 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:45.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d6000640 1 --2- 172.21.15.32:0/3722560132 >> v2:172.21.15.67:3300/0 conn(0x7fa3d0151f10 0x7fa3d01588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d4c00640 1 -- 172.21.15.32:0/3722560132 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621219555 0 0) 0x7fa3d0072d40 con 0x7fa3d01546b0 2024-01-19T04:16:45.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d4c00640 1 -- 172.21.15.32:0/3722560132 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b0003530 con 0x7fa3d01546b0 2024-01-19T04:16:45.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d6000640 1 -- 172.21.15.32:0/3722560132 >> v1:172.21.15.67:6789/0 conn(0x7fa3d006f550 legacy=0x7fa3d00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d6000640 1 -- 172.21.15.32:0/3722560132 >> v1:172.21.15.32:6789/0 conn(0x7fa3d01546b0 legacy=0x7fa3d006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.705+0000 7fa3d6000640 1 -- 172.21.15.32:0/3722560132 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0072a60 con 0x7fa3d0151f10 2024-01-19T04:16:45.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d6000640 1 --2- 172.21.15.32:0/3722560132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d0151f10 0x7fa3d01588b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00097c0 tx=0x7fa3c001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb77d2b261886c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:45.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d4c00640 1 -- 172.21.15.32:0/3722560132 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00ab600 con 0x7fa3d0151f10 2024-01-19T04:16:45.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d4c00640 1 -- 172.21.15.32:0/3722560132 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c00a7050 con 0x7fa3d0151f10 2024-01-19T04:16:45.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d4c00640 1 -- 172.21.15.32:0/3722560132 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00ab980 con 0x7fa3d0151f10 2024-01-19T04:16:45.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 -- 172.21.15.32:0/3722560132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d0151f10 msgr2=0x7fa3d01588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/3722560132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d0151f10 0x7fa3d01588b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00097c0 tx=0x7fa3c001c330 comp rx=0 tx=0).stop 2024-01-19T04:16:45.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 -- 172.21.15.32:0/3722560132 shutdown_connections 2024-01-19T04:16:45.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/3722560132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d0151f10 0x7fa3d01588b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 -- 172.21.15.32:0/3722560132 >> 172.21.15.32:0/3722560132 conn(0x7fa3d00c7040 msgr2=0x7fa3d00c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:45.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 -- 172.21.15.32:0/3722560132 shutdown_connections 2024-01-19T04:16:45.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 -- 172.21.15.32:0/3722560132 wait complete. 2024-01-19T04:16:45.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 Processor -- start 2024-01-19T04:16:45.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.709+0000 7fa3d8a00640 1 -- start start 2024-01-19T04:16:45.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3d006f550 0x7fa3d0151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d0151f10 0x7fa3d0160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d01546b0 0x7fa3d01ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00befa0 con 0x7fa3d006f550 2024-01-19T04:16:45.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d01f1250 con 0x7fa3d01546b0 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d01f05d0 con 0x7fa3d0151f10 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3d006f550 0x7fa3d0151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3d006f550 0x7fa3d0151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56620/0 (socket says 172.21.15.32:56620) 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 -- 172.21.15.32:0/1328405213 learned_addr learned my addr 172.21.15.32:0/1328405213 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6a00640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d01546b0 0x7fa3d01ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d5600640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d0151f10 0x7fa3d0160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 -- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d0151f10 msgr2=0x7fa3d0160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d0151f10 0x7fa3d0160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 -- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d01546b0 msgr2=0x7fa3d01ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d01546b0 0x7fa3d01ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 -- 172.21.15.32:0/1328405213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c0009420 con 0x7fa3d006f550 2024-01-19T04:16:45.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d6000640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3d006f550 0x7fa3d0151380 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0018f40 tx=0x7fa3c001ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:45.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3ce000640 1 -- 172.21.15.32:0/1328405213 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00b7450 con 0x7fa3d006f550 2024-01-19T04:16:45.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3ce000640 1 -- 172.21.15.32:0/1328405213 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c00b75b0 con 0x7fa3d006f550 2024-01-19T04:16:45.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3ce000640 1 -- 172.21.15.32:0/1328405213 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00b7960 con 0x7fa3d006f550 2024-01-19T04:16:45.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d01f08b0 con 0x7fa3d006f550 2024-01-19T04:16:45.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d01f0e70 con 0x7fa3d006f550 2024-01-19T04:16:45.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.713+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d0067340 con 0x7fa3d006f550 2024-01-19T04:16:45.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.717+0000 7fa3ce000640 1 -- 172.21.15.32:0/1328405213 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa3c00b7ac0 con 0x7fa3d006f550 2024-01-19T04:16:45.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.717+0000 7fa3ce000640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3a8066500 0x7fa3a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:45.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.717+0000 7fa3ce000640 1 -- 172.21.15.32:0/1328405213 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa3c011e270 con 0x7fa3d006f550 2024-01-19T04:16:45.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.717+0000 7fa3d5600640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3a8066500 0x7fa3a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:45.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.717+0000 7fa3d5600640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3a8066500 0x7fa3a80689c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00a7cc0 tx=0x7fa3b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:45.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.721+0000 7fa3ce000640 1 -- 172.21.15.32:0/1328405213 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa3c00eba10 con 0x7fa3d006f550 2024-01-19T04:16:45.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:45.889+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa3d00749f0 con 0x7fa3d006f550 2024-01-19T04:16:46.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.517+0000 7fa3ce000640 1 -- 172.21.15.32:0/1328405213 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa3c011ce60 con 0x7fa3d006f550 2024-01-19T04:16:46.520 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3a8066500 msgr2=0x7fa3a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3a8066500 0x7fa3a80689c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00a7cc0 tx=0x7fa3b8009040 comp rx=0 tx=0).stop 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3d006f550 msgr2=0x7fa3d0151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3d006f550 0x7fa3d0151380 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0018f40 tx=0x7fa3c001ab70 comp rx=0 tx=0).stop 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 shutdown_connections 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa3a8066500 0x7fa3a80689c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3d01546b0 0x7fa3d01ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3d0151f10 0x7fa3d0160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 --2- 172.21.15.32:0/1328405213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3d006f550 0x7fa3d0151380 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 >> 172.21.15.32:0/1328405213 conn(0x7fa3d00c7040 msgr2=0x7fa3d00c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 shutdown_connections 2024-01-19T04:16:46.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.521+0000 7fa3d8a00640 1 -- 172.21.15.32:0/1328405213 wait complete. 2024-01-19T04:16:46.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-19T04:16:46.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 Processor -- start 2024-01-19T04:16:46.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 -- start start 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd6414fb50 0x7fcd6406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd640c04a0 0x7fcd640c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcd640a4ec0 0x7fcd640c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd641535c0 con 0x7fcd640c04a0 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd64071e80 con 0x7fcd640a4ec0 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.693+0000 7fcd69400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640726c0 con 0x7fcd6414fb50 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd640c04a0 0x7fcd640c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd640c04a0 0x7fcd640c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56636/0 (socket says 172.21.15.32:56636) 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 -- 172.21.15.32:0/3957729704 learned_addr learned my addr 172.21.15.32:0/3957729704 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:46.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd63200640 1 --2- 172.21.15.32:0/3957729704 >> v2:172.21.15.67:3300/0 conn(0x7fcd640a4ec0 0x7fcd640c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:46.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd62800640 1 --2- 172.21.15.32:0/3957729704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd6414fb50 0x7fcd6406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:46.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 -- 172.21.15.32:0/3957729704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd6414fb50 msgr2=0x7fcd6406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:46.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 --2- 172.21.15.32:0/3957729704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd6414fb50 0x7fcd6406fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 -- 172.21.15.32:0/3957729704 >> v2:172.21.15.67:3300/0 conn(0x7fcd640a4ec0 msgr2=0x7fcd640c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:46.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 --2- 172.21.15.32:0/3957729704 >> v2:172.21.15.67:3300/0 conn(0x7fcd640a4ec0 0x7fcd640c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 -- 172.21.15.32:0/3957729704 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd640c1cb0 con 0x7fcd640c04a0 2024-01-19T04:16:46.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61e00640 1 --2- 172.21.15.32:0/3957729704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640c04a0 0x7fcd640c1230 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0098a0 tx=0x7fcd4c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acb481564a685e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:46.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61400640 1 -- 172.21.15.32:0/3957729704 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0a4ea0 con 0x7fcd640c04a0 2024-01-19T04:16:46.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61400640 1 -- 172.21.15.32:0/3957729704 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c0a7050 con 0x7fcd640c04a0 2024-01-19T04:16:46.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.697+0000 7fcd61400640 1 -- 172.21.15.32:0/3957729704 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0ab820 con 0x7fcd640c04a0 2024-01-19T04:16:46.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- 172.21.15.32:0/3957729704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640c04a0 msgr2=0x7fcd640c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:46.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 --2- 172.21.15.32:0/3957729704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640c04a0 0x7fcd640c1230 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0098a0 tx=0x7fcd4c01c450 comp rx=0 tx=0).stop 2024-01-19T04:16:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- 172.21.15.32:0/3957729704 shutdown_connections 2024-01-19T04:16:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 --2- 172.21.15.32:0/3957729704 >> v2:172.21.15.67:3300/0 conn(0x7fcd640a4ec0 0x7fcd640c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 --2- 172.21.15.32:0/3957729704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640c04a0 0x7fcd640c1230 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 --2- 172.21.15.32:0/3957729704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd6414fb50 0x7fcd6406fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- 172.21.15.32:0/3957729704 >> 172.21.15.32:0/3957729704 conn(0x7fcd640c5b20 msgr2=0x7fcd640c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- 172.21.15.32:0/3957729704 shutdown_connections 2024-01-19T04:16:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- 172.21.15.32:0/3957729704 wait complete. 2024-01-19T04:16:46.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 Processor -- start 2024-01-19T04:16:46.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- start start 2024-01-19T04:16:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640a4ec0 0x7fcd641f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd640c04a0 0x7fcd640c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd6414fb50 0x7fcd641ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640a9c80 con 0x7fcd640a4ec0 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640a93e0 con 0x7fcd6414fb50 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd69400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640a96c0 con 0x7fcd640c04a0 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd62800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640a4ec0 0x7fcd641f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd62800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640a4ec0 0x7fcd641f12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56646/0 (socket says 172.21.15.32:56646) 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.701+0000 7fcd62800640 1 -- 172.21.15.32:0/4047915457 learned_addr learned my addr 172.21.15.32:0/4047915457 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd61e00640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd640c04a0 0x7fcd640c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd63200640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd6414fb50 0x7fcd641ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd62800640 1 -- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd640c04a0 msgr2=0x7fcd640c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd62800640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd640c04a0 0x7fcd640c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd62800640 1 -- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd6414fb50 msgr2=0x7fcd641ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd62800640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd6414fb50 0x7fcd641ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd62800640 1 -- 172.21.15.32:0/4047915457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0094d0 con 0x7fcd640a4ec0 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd62800640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640a4ec0 0x7fcd641f12a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400e870 tx=0x7fcd5400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd5aa00640 1 -- 172.21.15.32:0/4047915457 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54009530 con 0x7fcd640a4ec0 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd5aa00640 1 -- 172.21.15.32:0/4047915457 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5400c940 con 0x7fcd640a4ec0 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd5aa00640 1 -- 172.21.15.32:0/4047915457 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400ccd0 con 0x7fcd640a4ec0 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd640a99a0 con 0x7fcd640a4ec0 2024-01-19T04:16:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd640bab30 con 0x7fcd640a4ec0 2024-01-19T04:16:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd640749f0 con 0x7fcd640a4ec0 2024-01-19T04:16:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd5aa00640 1 -- 172.21.15.32:0/4047915457 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcd54013470 con 0x7fcd640a4ec0 2024-01-19T04:16:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd5aa00640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd3c066500 0x7fcd3c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.705+0000 7fcd5aa00640 1 -- 172.21.15.32:0/4047915457 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd54083bd0 con 0x7fcd640a4ec0 2024-01-19T04:16:46.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.709+0000 7fcd61e00640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd3c066500 0x7fcd3c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:46.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.709+0000 7fcd61e00640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd3c066500 0x7fcd3c0689c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0ad000 tx=0x7fcd4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:46.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.713+0000 7fcd5aa00640 1 -- 172.21.15.32:0/4047915457 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcd54051260 con 0x7fcd640a4ec0 2024-01-19T04:16:46.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcd641512d0 con 0x7fcd640a4ec0 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd5aa00640 1 -- 172.21.15.32:0/4047915457 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fcd54054880 con 0x7fcd640a4ec0 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llsgveIhAArI1FfqpAbZbP5H/QNDKrQQ==", 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:16:46.927 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llsvlALxAADpa3U031IE67W85H0Rma6w==", 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll/F8cKhAAq6nC5ppnbAIpyfxBqU9v+w==", 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll61LHNhAAOWD4NF6ea4C6MYxR8v55lw==", 2024-01-19T04:16:46.929 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAE96llXf/LDxAA6FgZ7EGq0C9TUTaB/CiGAw==", 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAH96llm63KFRAAyoUf8Z0jVpxh86JaeudxpA==", 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAK96ll4IdoGhAAkyqz5g83r8gpFWdpV+JHAw==", 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.931 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAN96ll0o3YHhAAXaXcV6Ew3ARVzOeheB2Qdg==", 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.932 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAT96lluolMKhAAhtGB4RrqfaeFoh0Cw+FWcw==", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAW96llGp39MBAArcnkxmH6H79g0uLV/tbMYg==", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAZ96ll5MxcNhAAt6AgzeQup4/mAyqV/A4/ug==", 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAd96ll193uABAA/uFXx3ffBrEgBS+jU7LwYA==", 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.934 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q==", 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow r", 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2024-01-19T04:16:46.935 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ==", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow r", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rw pool=cephfs2_data" 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llHuQFBBAAAEiDpbymhxmIcRRV//whZA==", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:16:46.936 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.testuser", 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCU96llK+obExAA1V1N7PpjHeA4khEv+p/tTg==", 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow rw fsname=cephfs", 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow r fsname=cephfs", 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll838IHBAAatsDTMrKtOZVb2U6Jkhyvg==", 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.937 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llu+oOGBAAAeqd9zD1YxEG+kXxhgkPUA==", 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-01-19T04:16:46.938 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:16:46.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd3c066500 msgr2=0x7fcd3c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:46.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd3c066500 0x7fcd3c0689c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0ad000 tx=0x7fcd4c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:46.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640a4ec0 msgr2=0x7fcd641f12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640a4ec0 0x7fcd641f12a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400e870 tx=0x7fcd5400ed30 comp rx=0 tx=0).stop 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 shutdown_connections 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd3c066500 0x7fcd3c0689c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd6414fb50 0x7fcd641ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcd640c04a0 0x7fcd640c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 --2- 172.21.15.32:0/4047915457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd640a4ec0 0x7fcd641f12a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 >> 172.21.15.32:0/4047915457 conn(0x7fcd640c5b20 msgr2=0x7fcd640c14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 shutdown_connections 2024-01-19T04:16:46.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:46.925+0000 7fcd69400640 1 -- 172.21.15.32:0/4047915457 wait complete. 2024-01-19T04:16:46.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2024-01-19T04:16:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa34400640 1 Processor -- start 2024-01-19T04:16:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa34400640 1 -- start start 2024-01-19T04:16:47.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa34400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faa2c151de0 0x7faa2c0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa34400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faa2c154c70 0x7faa2c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa34400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c1547e0 con 0x7faa2c0a7200 2024-01-19T04:16:47.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa34400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c1521c0 con 0x7faa2c154c70 2024-01-19T04:16:47.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa34400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c155600 con 0x7faa2c151de0 2024-01-19T04:16:47.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa31000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faa2c0a7200 0x7faa2c0c3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60928/0 (socket says 172.21.15.32:60928) 2024-01-19T04:16:47.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa31000640 1 -- 172.21.15.32:0/913664504 learned_addr learned my addr 172.21.15.32:0/913664504 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:47.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa32400640 1 --2- 172.21.15.32:0/913664504 >> v2:172.21.15.32:3300/0 conn(0x7faa2c154c70 0x7faa2c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa31a00640 1 --2- 172.21.15.32:0/913664504 >> v2:172.21.15.67:3300/0 conn(0x7faa2c151de0 0x7faa2c0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa32400640 1 -- 172.21.15.32:0/913664504 >> v2:172.21.15.67:3300/0 conn(0x7faa2c151de0 msgr2=0x7faa2c0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:47.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa32400640 1 --2- 172.21.15.32:0/913664504 >> v2:172.21.15.67:3300/0 conn(0x7faa2c151de0 0x7faa2c0c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa32400640 1 -- 172.21.15.32:0/913664504 >> v1:172.21.15.32:6789/0 conn(0x7faa2c0a7200 legacy=0x7faa2c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa32400640 1 -- 172.21.15.32:0/913664504 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0c1db0 con 0x7faa2c154c70 2024-01-19T04:16:47.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.089+0000 7faa2be00640 1 -- 172.21.15.32:0/913664504 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984497005 0 0) 0x7faa2c1547e0 con 0x7faa2c0a7200 2024-01-19T04:16:47.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa32400640 1 --2- 172.21.15.32:0/913664504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c154c70 0x7faa2c1550c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0c8db0 tx=0x7faa2401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834a872916b75f11 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa2be00640 1 -- 172.21.15.32:0/913664504 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa240a5910 con 0x7faa2c154c70 2024-01-19T04:16:47.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa2be00640 1 -- 172.21.15.32:0/913664504 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa240a5a70 con 0x7faa2c154c70 2024-01-19T04:16:47.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa2be00640 1 -- 172.21.15.32:0/913664504 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa240a5e00 con 0x7faa2c154c70 2024-01-19T04:16:47.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 -- 172.21.15.32:0/913664504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c154c70 msgr2=0x7faa2c1550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 --2- 172.21.15.32:0/913664504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c154c70 0x7faa2c1550c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0c8db0 tx=0x7faa2401c850 comp rx=0 tx=0).stop 2024-01-19T04:16:47.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 -- 172.21.15.32:0/913664504 shutdown_connections 2024-01-19T04:16:47.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 --2- 172.21.15.32:0/913664504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c154c70 0x7faa2c1550c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 --2- 172.21.15.32:0/913664504 >> v2:172.21.15.67:3300/0 conn(0x7faa2c151de0 0x7faa2c0c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 -- 172.21.15.32:0/913664504 >> 172.21.15.32:0/913664504 conn(0x7faa2c0726d0 msgr2=0x7faa2c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:47.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 -- 172.21.15.32:0/913664504 shutdown_connections 2024-01-19T04:16:47.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.093+0000 7faa34400640 1 -- 172.21.15.32:0/913664504 wait complete. 2024-01-19T04:16:47.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 Processor -- start 2024-01-19T04:16:47.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 -- start start 2024-01-19T04:16:47.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c0a7200 0x7faa2c1f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa2c151de0 0x7faa2c06b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c154c70 0x7faa2c1ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c0aa530 con 0x7faa2c0a7200 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c1ecb00 con 0x7faa2c154c70 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c1f0fc0 con 0x7faa2c151de0 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c0a7200 0x7faa2c1f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c0a7200 0x7faa2c1f0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56654/0 (socket says 172.21.15.32:56654) 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 -- 172.21.15.32:0/1400385611 learned_addr learned my addr 172.21.15.32:0/1400385611 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa32400640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c154c70 0x7faa2c1ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31000640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa2c151de0 0x7faa2c06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 -- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa2c151de0 msgr2=0x7faa2c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa2c151de0 0x7faa2c06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 -- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c154c70 msgr2=0x7faa2c1ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c154c70 0x7faa2c1ed230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 -- 172.21.15.32:0/1400385611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa24009a70 con 0x7faa2c0a7200 2024-01-19T04:16:47.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31000640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa2c151de0 0x7faa2c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:47.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa31a00640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c0a7200 0x7faa2c1f0a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00e930 tx=0x7faa1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa29600640 1 -- 172.21.15.32:0/1400385611 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c009690 con 0x7faa2c0a7200 2024-01-19T04:16:47.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa29600640 1 -- 172.21.15.32:0/1400385611 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c00ca00 con 0x7faa2c0a7200 2024-01-19T04:16:47.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c1ecda0 con 0x7faa2c0a7200 2024-01-19T04:16:47.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa29600640 1 -- 172.21.15.32:0/1400385611 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00cd70 con 0x7faa2c0a7200 2024-01-19T04:16:47.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.097+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c0a9a60 con 0x7faa2c0a7200 2024-01-19T04:16:47.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.101+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c0749f0 con 0x7faa2c0a7200 2024-01-19T04:16:47.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.101+0000 7faa29600640 1 -- 172.21.15.32:0/1400385611 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faa1c013470 con 0x7faa2c0a7200 2024-01-19T04:16:47.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.101+0000 7faa29600640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa04066500 0x7faa040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.101+0000 7faa29600640 1 -- 172.21.15.32:0/1400385611 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa1c083d50 con 0x7faa2c0a7200 2024-01-19T04:16:47.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.101+0000 7faa31000640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa04066500 0x7faa040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.101+0000 7faa31000640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa04066500 0x7faa040689c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa2c152d00 tx=0x7faa14007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.105+0000 7faa29600640 1 -- 172.21.15.32:0/1400385611 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faa1c0514a0 con 0x7faa2c0a7200 2024-01-19T04:16:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.321+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7faa2c0a6fe0 con 0x7faa2c0a7200 2024-01-19T04:16:47.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.325+0000 7faa29600640 1 -- 172.21.15.32:0/1400385611 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7faa1c054ac0 con 0x7faa2c0a7200 2024-01-19T04:16:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.325+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa04066500 msgr2=0x7faa040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.325+0000 7faa34400640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa04066500 0x7faa040689c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa2c152d00 tx=0x7faa14007cb0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.325+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c0a7200 msgr2=0x7faa2c1f0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.325+0000 7faa34400640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c0a7200 0x7faa2c1f0a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00e930 tx=0x7faa1c00edf0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 shutdown_connections 2024-01-19T04:16:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa04066500 0x7faa040689c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c154c70 0x7faa2c1ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa2c151de0 0x7faa2c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 --2- 172.21.15.32:0/1400385611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa2c0a7200 0x7faa2c1f0a80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 >> 172.21.15.32:0/1400385611 conn(0x7faa2c0726d0 msgr2=0x7faa2c153e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 shutdown_connections 2024-01-19T04:16:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.329+0000 7faa34400640 1 -- 172.21.15.32:0/1400385611 wait complete. 2024-01-19T04:16:47.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa75ac00640 1 Processor -- start 2024-01-19T04:16:47.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa75ac00640 1 -- start start 2024-01-19T04:16:47.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa75ac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75414ee40 0x7fa7541520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa75ac00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540c21c0 con 0x7fa7540c1620 2024-01-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa75ac00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa754151c10 con 0x7fa7540c56d0 2024-01-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa75ac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa754071650 con 0x7fa75414ee40 2024-01-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa758c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa7540c1620 0x7fa75415be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60944/0 (socket says 172.21.15.32:60944) 2024-01-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa758c00640 1 -- 172.21.15.32:0/3137924421 learned_addr learned my addr 172.21.15.32:0/3137924421 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa753e00640 1 --2- 172.21.15.32:0/3137924421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75414ee40 0x7fa7541520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa752a00640 1 -- 172.21.15.32:0/3137924421 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202934702 0 0) 0x7fa7540c21c0 con 0x7fa7540c1620 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa752a00640 1 -- 172.21.15.32:0/3137924421 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa734003530 con 0x7fa7540c1620 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa752a00640 1 -- 172.21.15.32:0/3137924421 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263662494 0 0) 0x7fa754151c10 con 0x7fa7540c56d0 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa752a00640 1 -- 172.21.15.32:0/3137924421 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7540c21c0 con 0x7fa7540c56d0 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa753e00640 1 -- 172.21.15.32:0/3137924421 >> v1:172.21.15.67:6789/0 conn(0x7fa7540c56d0 legacy=0x7fa754070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa753e00640 1 -- 172.21.15.32:0/3137924421 >> v1:172.21.15.32:6789/0 conn(0x7fa7540c1620 legacy=0x7fa75415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.489+0000 7fa753e00640 1 -- 172.21.15.32:0/3137924421 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540c66a0 con 0x7fa75414ee40 2024-01-19T04:16:47.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa753e00640 1 --2- 172.21.15.32:0/3137924421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75414ee40 0x7fa7541520a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0097f0 tx=0x7fa73c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3be9196b999c456 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa752a00640 1 -- 172.21.15.32:0/3137924421 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ac640 con 0x7fa75414ee40 2024-01-19T04:16:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa752a00640 1 -- 172.21.15.32:0/3137924421 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0ac7a0 con 0x7fa75414ee40 2024-01-19T04:16:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa752a00640 1 -- 172.21.15.32:0/3137924421 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0acb30 con 0x7fa75414ee40 2024-01-19T04:16:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa75ac00640 1 -- 172.21.15.32:0/3137924421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75414ee40 msgr2=0x7fa7541520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa75ac00640 1 --2- 172.21.15.32:0/3137924421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75414ee40 0x7fa7541520a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0097f0 tx=0x7fa73c01c400 comp rx=0 tx=0).stop 2024-01-19T04:16:47.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa75ac00640 1 -- 172.21.15.32:0/3137924421 shutdown_connections 2024-01-19T04:16:47.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa75ac00640 1 --2- 172.21.15.32:0/3137924421 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa75414ee40 0x7fa7541520a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.493+0000 7fa75ac00640 1 -- 172.21.15.32:0/3137924421 >> 172.21.15.32:0/3137924421 conn(0x7fa7540c6ca0 msgr2=0x7fa7540c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:47.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 -- 172.21.15.32:0/3137924421 shutdown_connections 2024-01-19T04:16:47.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 -- 172.21.15.32:0/3137924421 wait complete. 2024-01-19T04:16:47.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 Processor -- start 2024-01-19T04:16:47.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 -- start start 2024-01-19T04:16:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7540c1620 0x7fa7541ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7540c56d0 0x7fa754158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa75414ee40 0x7fa754158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754157410 con 0x7fa75414ee40 2024-01-19T04:16:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754156b70 con 0x7fa7540c56d0 2024-01-19T04:16:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa75ac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa754156e50 con 0x7fa7540c1620 2024-01-19T04:16:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa75414ee40 0x7fa754158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa75414ee40 0x7fa754158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56662/0 (socket says 172.21.15.32:56662) 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 -- 172.21.15.32:0/1903856194 learned_addr learned my addr 172.21.15.32:0/1903856194 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa753e00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7540c1620 0x7fa7541ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 -- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7540c1620 msgr2=0x7fa7541ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7540c1620 0x7fa7541ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 -- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7540c56d0 msgr2=0x7fa754158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa753400640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7540c56d0 0x7fa754158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7540c56d0 0x7fa754158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 -- 172.21.15.32:0/1903856194 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c009420 con 0x7fa75414ee40 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa753e00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7540c1620 0x7fa7541ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa753400640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7540c56d0 0x7fa754158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.497+0000 7fa758c00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa75414ee40 0x7fa754158d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00cbc0 tx=0x7fa74c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa74be00640 1 -- 172.21.15.32:0/1903856194 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00ace0 con 0x7fa75414ee40 2024-01-19T04:16:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa74be00640 1 -- 172.21.15.32:0/1903856194 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c00ae40 con 0x7fa75414ee40 2024-01-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa74be00640 1 -- 172.21.15.32:0/1903856194 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c012600 con 0x7fa75414ee40 2024-01-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa754157130 con 0x7fa75414ee40 2024-01-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7540bb620 con 0x7fa75414ee40 2024-01-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7540bbc80 con 0x7fa75414ee40 2024-01-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa74be00640 1 -- 172.21.15.32:0/1903856194 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa74c012760 con 0x7fa75414ee40 2024-01-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa74be00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa72c066500 0x7fa72c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa74be00640 1 -- 172.21.15.32:0/1903856194 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa74c0839e0 con 0x7fa75414ee40 2024-01-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.501+0000 7fa753e00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa72c066500 0x7fa72c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.505+0000 7fa753e00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa72c066500 0x7fa72c0689c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ae000 tx=0x7fa73c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.505+0000 7fa74be00640 1 -- 172.21.15.32:0/1903856194 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa7540bbc80 con 0x7fa75414ee40 2024-01-19T04:16:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.673+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7540bbc80 con 0x7fa75414ee40 2024-01-19T04:16:47.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.673+0000 7fa74be00640 1 -- 172.21.15.32:0/1903856194 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+12762 (secure 0 0 0) 0x7fa7540bbc80 con 0x7fa75414ee40 2024-01-19T04:16:47.676 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:47.676 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":49,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:46.528308+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.673+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa72c066500 msgr2=0x7fa72c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.673+0000 7fa75ac00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa72c066500 0x7fa72c0689c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ae000 tx=0x7fa73c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.673+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa75414ee40 msgr2=0x7fa754158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.673+0000 7fa75ac00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa75414ee40 0x7fa754158d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00cbc0 tx=0x7fa74c00a430 comp rx=0 tx=0).stop 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 shutdown_connections 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa72c066500 0x7fa72c0689c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa75414ee40 0x7fa754158d80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7540c56d0 0x7fa754158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 --2- 172.21.15.32:0/1903856194 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa7540c1620 0x7fa7541ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 >> 172.21.15.32:0/1903856194 conn(0x7fa7540c6ca0 msgr2=0x7fa75406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:47.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 shutdown_connections 2024-01-19T04:16:47.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.677+0000 7fa75ac00640 1 -- 172.21.15.32:0/1903856194 wait complete. 2024-01-19T04:16:47.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:16:47.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:16:47.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6617800640 1 Processor -- start 2024-01-19T04:16:47.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6617800640 1 -- start start 2024-01-19T04:16:47.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6617800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66100c55d0 0x7f661006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6617800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f66100705b0 0x7f661015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6617800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100c0eb0 con 0x7f661006cab0 2024-01-19T04:16:47.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6617800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661006e5c0 con 0x7f66100c55d0 2024-01-19T04:16:47.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6617800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66100a5330 con 0x7f66100705b0 2024-01-19T04:16:47.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f660fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66100c55d0 0x7f661006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f660fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66100c55d0 0x7f661006ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46314/0 (socket says 172.21.15.32:46314) 2024-01-19T04:16:47.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f660fe00640 1 -- 172.21.15.32:0/4058050653 learned_addr learned my addr 172.21.15.32:0/4058050653 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:47.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6615800640 1 --2- 172.21.15.32:0/4058050653 >> v2:172.21.15.67:3300/0 conn(0x7f66100705b0 0x7f661015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f660fe00640 1 -- 172.21.15.32:0/4058050653 >> v2:172.21.15.67:3300/0 conn(0x7f66100705b0 msgr2=0x7f661015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:47.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f660fe00640 1 --2- 172.21.15.32:0/4058050653 >> v2:172.21.15.67:3300/0 conn(0x7f66100705b0 0x7f661015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f660fe00640 1 -- 172.21.15.32:0/4058050653 >> v1:172.21.15.67:6789/0 conn(0x7f661006cab0 legacy=0x7f66100c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f660fe00640 1 -- 172.21.15.32:0/4058050653 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66101516f0 con 0x7f66100c55d0 2024-01-19T04:16:47.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.841+0000 7f6615800640 1 --2- 172.21.15.32:0/4058050653 >> v2:172.21.15.67:3300/0 conn(0x7f66100705b0 0x7f661015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:47.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f660fe00640 1 --2- 172.21.15.32:0/4058050653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661006ce90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f66100c3660 tx=0x7f65f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccee47ef2c0aac server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f660f400640 1 -- 172.21.15.32:0/4058050653 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f80aa430 con 0x7f66100c55d0 2024-01-19T04:16:47.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f660f400640 1 -- 172.21.15.32:0/4058050653 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f80aa590 con 0x7f66100c55d0 2024-01-19T04:16:47.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f660f400640 1 -- 172.21.15.32:0/4058050653 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f80aa920 con 0x7f66100c55d0 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 -- 172.21.15.32:0/4058050653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 msgr2=0x7f661006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 --2- 172.21.15.32:0/4058050653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661006ce90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f66100c3660 tx=0x7f65f801c4d0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 -- 172.21.15.32:0/4058050653 shutdown_connections 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 --2- 172.21.15.32:0/4058050653 >> v2:172.21.15.67:3300/0 conn(0x7f66100705b0 0x7f661015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 --2- 172.21.15.32:0/4058050653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661006ce90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 -- 172.21.15.32:0/4058050653 >> 172.21.15.32:0/4058050653 conn(0x7f66100c25a0 msgr2=0x7f66100c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 -- 172.21.15.32:0/4058050653 shutdown_connections 2024-01-19T04:16:47.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 -- 172.21.15.32:0/4058050653 wait complete. 2024-01-19T04:16:47.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.845+0000 7f6617800640 1 Processor -- start 2024-01-19T04:16:47.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 -- start start 2024-01-19T04:16:47.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f661006cab0 0x7f66100a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66100705b0 0x7f661014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661014a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6610152310 con 0x7f66100c55d0 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661014bad0 con 0x7f66100705b0 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66100aa3e0 con 0x7f661006cab0 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661014a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f660fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66100705b0 0x7f661014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661014a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46324/0 (socket says 172.21.15.32:46324) 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 -- 172.21.15.32:0/1738925215 learned_addr learned my addr 172.21.15.32:0/1738925215 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6614e00640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f661006cab0 0x7f66100a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 -- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f661006cab0 msgr2=0x7f66100a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f661006cab0 0x7f66100a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 -- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66100705b0 msgr2=0x7f661014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66100705b0 0x7f661014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 -- 172.21.15.32:0/1738925215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80094d0 con 0x7f66100c55d0 2024-01-19T04:16:47.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6615800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661014a060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6608007f50 tx=0x7f660800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f660cc00640 1 -- 172.21.15.32:0/1738925215 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608003ba0 con 0x7f66100c55d0 2024-01-19T04:16:47.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f660cc00640 1 -- 172.21.15.32:0/1738925215 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800f040 con 0x7f66100c55d0 2024-01-19T04:16:47.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f660cc00640 1 -- 172.21.15.32:0/1738925215 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800dec0 con 0x7f66100c55d0 2024-01-19T04:16:47.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6610152b20 con 0x7f66100c55d0 2024-01-19T04:16:47.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6610152840 con 0x7f66100c55d0 2024-01-19T04:16:47.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.849+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66100749f0 con 0x7f66100c55d0 2024-01-19T04:16:47.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.853+0000 7f660cc00640 1 -- 172.21.15.32:0/1738925215 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6608004030 con 0x7f66100c55d0 2024-01-19T04:16:47.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.853+0000 7f660cc00640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65e8066500 0x7f65e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:47.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.853+0000 7f660cc00640 1 -- 172.21.15.32:0/1738925215 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6608083e00 con 0x7f66100c55d0 2024-01-19T04:16:47.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.853+0000 7f6614e00640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65e8066500 0x7f65e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:47.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.853+0000 7f6614e00640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65e8066500 0x7f65e80689c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6600001810 tx=0x7f6600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:47.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:47.857+0000 7f660cc00640 1 -- 172.21.15.32:0/1738925215 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6608051490 con 0x7f66100c55d0 2024-01-19T04:16:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.017+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f661014bc10 con 0x7f66100c55d0 2024-01-19T04:16:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.017+0000 7f660cc00640 1 -- 172.21.15.32:0/1738925215 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f660801a020 con 0x7f66100c55d0 2024-01-19T04:16:48.021 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:16:48.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65e8066500 msgr2=0x7f65e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65e8066500 0x7f65e80689c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6600001810 tx=0x7f6600009040 comp rx=0 tx=0).stop 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 msgr2=0x7f661014a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661014a060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6608007f50 tx=0x7f660800d560 comp rx=0 tx=0).stop 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 shutdown_connections 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65e8066500 0x7f65e80689c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66100c55d0 0x7f661014a060 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66100705b0 0x7f661014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 --2- 172.21.15.32:0/1738925215 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f661006cab0 0x7f66100a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 >> 172.21.15.32:0/1738925215 conn(0x7f66100c25a0 msgr2=0x7f6610150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 shutdown_connections 2024-01-19T04:16:48.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.021+0000 7f6617800640 1 -- 172.21.15.32:0/1738925215 wait complete. 2024-01-19T04:16:48.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:16:48.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75f2600640 1 Processor -- start 2024-01-19T04:16:48.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75f2600640 1 -- start start 2024-01-19T04:16:48.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75f2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 0x7f75ec1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75f2600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec072d40 con 0x7f75ec06f550 2024-01-19T04:16:48.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75f2600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec072800 con 0x7f75ec1546b0 2024-01-19T04:16:48.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75f2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0c3450 con 0x7f75ec151f10 2024-01-19T04:16:48.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75eaa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f75ec06f550 0x7f75ec0720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43806/0 (socket says 172.21.15.32:43806) 2024-01-19T04:16:48.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.181+0000 7f75eaa00640 1 -- 172.21.15.32:0/734956652 learned_addr learned my addr 172.21.15.32:0/734956652 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75eb400640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 0x7f75ec1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149381786 0 0) 0x7f75ec072d40 con 0x7f75ec06f550 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75cc003530 con 0x7f75ec06f550 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507894877 0 0) 0x7f75ec072800 con 0x7f75ec1546b0 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ec072d40 con 0x7f75ec1546b0 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2931894261 0 0) 0x7f75cc003530 con 0x7f75ec06f550 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 msgr2=0x7f75ec1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 0x7f75ec1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 >> v1:172.21.15.67:6789/0 conn(0x7f75ec1546b0 legacy=0x7f75ec06bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec072a60 con 0x7f75ec06f550 2024-01-19T04:16:48.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f75d4001680 con 0x7f75ec06f550 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 >> v1:172.21.15.32:6789/0 conn(0x7f75ec06f550 legacy=0x7f75ec0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 0x7f75cc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc0040a0 0x7f75cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75cc004d10 0x7f75cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc00bb70 con 0x7f75cc004d10 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc00bce0 con 0x7f75cc0040a0 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc00bea0 con 0x7f75ec151f10 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ebe00640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75cc004d10 0x7f75cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75eb400640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 0x7f75cc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75eaa00640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc0040a0 0x7f75cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ebe00640 1 -- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 msgr2=0x7f75cc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ebe00640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ec151f10 0x7f75cc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ebe00640 1 -- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc0040a0 msgr2=0x7f75cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ebe00640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75cc0040a0 0x7f75cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.185+0000 7f75ebe00640 1 -- 172.21.15.32:0/734956652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc003530 con 0x7f75cc004d10 2024-01-19T04:16:48.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75ebe00640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75cc004d10 0x7f75cc005190 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001fd0 tx=0x7f75e401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1a6e419a10ba25 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:48.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4003b80 con 0x7f75cc004d10 2024-01-19T04:16:48.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4003d00 con 0x7f75cc004d10 2024-01-19T04:16:48.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75ea000640 1 -- 172.21.15.32:0/734956652 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4005310 con 0x7f75cc004d10 2024-01-19T04:16:48.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 -- 172.21.15.32:0/734956652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75cc004d10 msgr2=0x7f75cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 --2- 172.21.15.32:0/734956652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75cc004d10 0x7f75cc005190 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001fd0 tx=0x7f75e401c8b0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75ebe00640 1 -- 172.21.15.32:0/734956652 reap_dead start 2024-01-19T04:16:48.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 -- 172.21.15.32:0/734956652 shutdown_connections 2024-01-19T04:16:48.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 -- 172.21.15.32:0/734956652 >> 172.21.15.32:0/734956652 conn(0x7f75ec0c7040 msgr2=0x7f75ec0c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:48.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 -- 172.21.15.32:0/734956652 shutdown_connections 2024-01-19T04:16:48.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 -- 172.21.15.32:0/734956652 wait complete. 2024-01-19T04:16:48.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 Processor -- start 2024-01-19T04:16:48.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.189+0000 7f75f2600640 1 -- start start 2024-01-19T04:16:48.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75cc004d10 0x7f75ec150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec06ec50 0x7f75ec156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0a99f0 0x7f75ec0a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0be3a0 con 0x7f75ec0a99f0 2024-01-19T04:16:48.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec151450 con 0x7f75ec06ec50 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec06cba0 con 0x7f75cc004d10 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0a99f0 0x7f75ec0a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0a99f0 0x7f75ec0a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46344/0 (socket says 172.21.15.32:46344) 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 -- 172.21.15.32:0/2171049544 learned_addr learned my addr 172.21.15.32:0/2171049544 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75eaa00640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec06ec50 0x7f75ec156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75eb400640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75cc004d10 0x7f75ec150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 -- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75cc004d10 msgr2=0x7f75ec150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75cc004d10 0x7f75ec150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 -- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec06ec50 msgr2=0x7f75ec156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec06ec50 0x7f75ec156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 -- 172.21.15.32:0/2171049544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec06ce60 con 0x7f75ec0a99f0 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75ebe00640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0a99f0 0x7f75ec0a9e70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001fd0 tx=0x7f75cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75e3400640 1 -- 172.21.15.32:0/2171049544 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4003e70 con 0x7f75ec0a99f0 2024-01-19T04:16:48.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75e3400640 1 -- 172.21.15.32:0/2171049544 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e40057d0 con 0x7f75ec0a99f0 2024-01-19T04:16:48.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec06d140 con 0x7f75ec0a99f0 2024-01-19T04:16:48.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75e3400640 1 -- 172.21.15.32:0/2171049544 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4006b60 con 0x7f75ec0a99f0 2024-01-19T04:16:48.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec06d700 con 0x7f75ec0a99f0 2024-01-19T04:16:48.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec067340 con 0x7f75ec0a99f0 2024-01-19T04:16:48.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.193+0000 7f75e3400640 1 -- 172.21.15.32:0/2171049544 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f75e4006cc0 con 0x7f75ec0a99f0 2024-01-19T04:16:48.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.197+0000 7f75e3400640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75c4066530 0x7f75c40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.197+0000 7f75e3400640 1 -- 172.21.15.32:0/2171049544 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f75e411de10 con 0x7f75ec0a99f0 2024-01-19T04:16:48.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.197+0000 7f75eb400640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75c4066530 0x7f75c40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.197+0000 7f75eb400640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75c4066530 0x7f75c40689f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009be0 tx=0x7f75dc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:48.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.201+0000 7f75e3400640 1 -- 172.21.15.32:0/2171049544 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f75e4121030 con 0x7f75ec0a99f0 2024-01-19T04:16:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.361+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f75ec06d8f0 con 0x7f75ec0a99f0 2024-01-19T04:16:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.361+0000 7f75e3400640 1 -- 172.21.15.32:0/2171049544 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+65 (secure 0 0 0) 0x7f75e40eb3f0 con 0x7f75ec0a99f0 2024-01-19T04:16:48.365 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:48.365 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-01-19T04:16:48.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:16:48.366 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-01-19T04:16:48.366 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-01-19T04:16:48.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:16:48.366 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75c4066530 msgr2=0x7f75c40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75c4066530 0x7f75c40689f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009be0 tx=0x7f75dc009190 comp rx=0 tx=0).stop 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0a99f0 msgr2=0x7f75ec0a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0a99f0 0x7f75ec0a9e70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001fd0 tx=0x7f75cc005800 comp rx=0 tx=0).stop 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 shutdown_connections 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f75c4066530 0x7f75c40689f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ec0a99f0 0x7f75ec0a9e70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ec06ec50 0x7f75ec156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 --2- 172.21.15.32:0/2171049544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75cc004d10 0x7f75ec150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 >> 172.21.15.32:0/2171049544 conn(0x7f75ec0c7040 msgr2=0x7f75ec06a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 shutdown_connections 2024-01-19T04:16:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.365+0000 7f75f2600640 1 -- 172.21.15.32:0/2171049544 wait complete. 2024-01-19T04:16:48.387 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-19T04:16:48.387 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-19T04:16:48.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.529+0000 7f08c2e00640 1 Processor -- start 2024-01-19T04:16:48.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.529+0000 7f08c2e00640 1 -- start start 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.529+0000 7f08c2e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc06b820 0x7f08bc1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.529+0000 7f08c2e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f08bc0c2d60 0x7f08bc0a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.529+0000 7f08c2e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0c7bb0 con 0x7f08bc0c4a10 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c2e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0c5790 con 0x7f08bc0c2d60 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c2e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc158c20 con 0x7f08bc06b820 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08bbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f08bc0c4a10 0x7f08bc0c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43812/0 (socket says 172.21.15.32:43812) 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c0e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f08bc0c2d60 0x7f08bc0a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08bbe00640 1 -- 172.21.15.32:0/2416092662 learned_addr learned my addr 172.21.15.32:0/2416092662 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:48.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08bb400640 1 --2- 172.21.15.32:0/2416092662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc06b820 0x7f08bc1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08baa00640 1 -- 172.21.15.32:0/2416092662 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485471714 0 0) 0x7f08bc0c7bb0 con 0x7f08bc0c4a10 2024-01-19T04:16:48.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c0e00640 1 -- 172.21.15.32:0/2416092662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc06b820 msgr2=0x7f08bc1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:48.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c0e00640 1 --2- 172.21.15.32:0/2416092662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc06b820 0x7f08bc1586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c0e00640 1 -- 172.21.15.32:0/2416092662 >> v1:172.21.15.32:6789/0 conn(0x7f08bc0c4a10 legacy=0x7f08bc0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c0e00640 1 -- 172.21.15.32:0/2416092662 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0c5f60 con 0x7f08bc0c2d60 2024-01-19T04:16:48.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08c0e00640 1 --2- 172.21.15.32:0/2416092662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c2d60 0x7f08bc0a6de0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ddb86bd1795bfc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:48.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08baa00640 1 -- 172.21.15.32:0/2416092662 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40a5950 con 0x7f08bc0c2d60 2024-01-19T04:16:48.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08baa00640 1 -- 172.21.15.32:0/2416092662 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b40a5ab0 con 0x7f08bc0c2d60 2024-01-19T04:16:48.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.533+0000 7f08baa00640 1 -- 172.21.15.32:0/2416092662 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40a5e40 con 0x7f08bc0c2d60 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- 172.21.15.32:0/2416092662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c2d60 msgr2=0x7f08bc0a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 --2- 172.21.15.32:0/2416092662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c2d60 0x7f08bc0a6de0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b401c890 comp rx=0 tx=0).stop 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- 172.21.15.32:0/2416092662 shutdown_connections 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 --2- 172.21.15.32:0/2416092662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c2d60 0x7f08bc0a6de0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 --2- 172.21.15.32:0/2416092662 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc06b820 0x7f08bc1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- 172.21.15.32:0/2416092662 >> 172.21.15.32:0/2416092662 conn(0x7f08bc0a99f0 msgr2=0x7f08bc0a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- 172.21.15.32:0/2416092662 shutdown_connections 2024-01-19T04:16:48.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- 172.21.15.32:0/2416092662 wait complete. 2024-01-19T04:16:48.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 Processor -- start 2024-01-19T04:16:48.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- start start 2024-01-19T04:16:48.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08bc06b820 0x7f08bc0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc0c2d60 0x7f08bc157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c4a10 0x7f08bc145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc14a900 con 0x7f08bc0c4a10 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0ab230 con 0x7f08bc06b820 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.537+0000 7f08c2e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc14adf0 con 0x7f08bc0c2d60 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c4a10 0x7f08bc145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c4a10 0x7f08bc145b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46354/0 (socket says 172.21.15.32:46354) 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 -- 172.21.15.32:0/1744518811 learned_addr learned my addr 172.21.15.32:0/1744518811 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08bb400640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc0c2d60 0x7f08bc157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08bbe00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08bc06b820 0x7f08bc0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 -- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc0c2d60 msgr2=0x7f08bc157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc0c2d60 0x7f08bc157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 -- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08bc06b820 msgr2=0x7f08bc0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08bc06b820 0x7f08bc0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 -- 172.21.15.32:0/1744518811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4009a70 con 0x7f08bc0c4a10 2024-01-19T04:16:48.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c0e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c4a10 0x7f08bc145b40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:48.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08b3e00640 1 -- 172.21.15.32:0/1744518811 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40add70 con 0x7f08bc0c4a10 2024-01-19T04:16:48.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08b3e00640 1 -- 172.21.15.32:0/1744518811 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4009450 con 0x7f08bc0c4a10 2024-01-19T04:16:48.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08b3e00640 1 -- 172.21.15.32:0/1744518811 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003bc0 con 0x7f08bc0c4a10 2024-01-19T04:16:48.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc0aceb0 con 0x7f08bc0c4a10 2024-01-19T04:16:48.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc0ac860 con 0x7f08bc0c4a10 2024-01-19T04:16:48.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc067c10 con 0x7f08bc0c4a10 2024-01-19T04:16:48.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.541+0000 7f08b3e00640 1 -- 172.21.15.32:0/1744518811 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f08b4003d20 con 0x7f08bc0c4a10 2024-01-19T04:16:48.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.545+0000 7f08b3e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0894066530 0x7f08940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:48.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.545+0000 7f08b3e00640 1 -- 172.21.15.32:0/1744518811 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f08b411ee50 con 0x7f08bc0c4a10 2024-01-19T04:16:48.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.545+0000 7f08bbe00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0894066530 0x7f08940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:48.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.545+0000 7f08bbe00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0894066530 0x7f08940689f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f08ac000f70 tx=0x7f08ac007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.549+0000 7f08b3e00640 1 -- 172.21.15.32:0/1744518811 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f08b40ec6a0 con 0x7f08bc0c4a10 2024-01-19T04:16:48.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:48.705+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f08bc0ac6c0 con 0x7f08bc0c4a10 2024-01-19T04:16:49.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.537+0000 7f08b3e00640 1 -- 172.21.15.32:0/1744518811 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7f08bc0ac6c0 con 0x7f08bc0c4a10 2024-01-19T04:16:49.539 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-01-19T04:16:49.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0894066530 msgr2=0x7f08940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:49.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0894066530 0x7f08940689f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f08ac000f70 tx=0x7f08ac007df0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c4a10 msgr2=0x7f08bc145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:49.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c4a10 0x7f08bc145b40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009d90 tx=0x7f08b4019630 comp rx=0 tx=0).stop 2024-01-19T04:16:49.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 shutdown_connections 2024-01-19T04:16:49.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0894066530 0x7f08940689f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08bc0c4a10 0x7f08bc145b40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f08bc0c2d60 0x7f08bc157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 --2- 172.21.15.32:0/1744518811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08bc06b820 0x7f08bc0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 >> 172.21.15.32:0/1744518811 conn(0x7f08bc0a99f0 msgr2=0x7f08bc0a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:49.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 shutdown_connections 2024-01-19T04:16:49.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.541+0000 7f08c2e00640 1 -- 172.21.15.32:0/1744518811 wait complete. 2024-01-19T04:16:49.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:16:49.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c50c00640 1 Processor -- start 2024-01-19T04:16:49.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c50c00640 1 -- start start 2024-01-19T04:16:49.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c50c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c06cab0 0x7f1c4c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:49.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c50c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c4c0c55d0 0x7f1c4c0c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:49.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c50c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0c0eb0 con 0x7f1c4c0705b0 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c50c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c06e5c0 con 0x7f1c4c0c55d0 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c50c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0a5330 con 0x7f1c4c06cab0 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c49400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c4c0c55d0 0x7f1c4c0c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c49400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c4c0c55d0 0x7f1c4c0c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46358/0 (socket says 172.21.15.32:46358) 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c49400640 1 -- 172.21.15.32:0/3370574699 learned_addr learned my addr 172.21.15.32:0/3370574699 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.721+0000 7f1c49e00640 1 --2- 172.21.15.32:0/3370574699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c06cab0 0x7f1c4c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c49400640 1 -- 172.21.15.32:0/3370574699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c06cab0 msgr2=0x7f1c4c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c49400640 1 --2- 172.21.15.32:0/3370574699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c06cab0 0x7f1c4c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c49400640 1 -- 172.21.15.32:0/3370574699 >> v1:172.21.15.67:6789/0 conn(0x7f1c4c0705b0 legacy=0x7f1c4c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:49.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c49400640 1 -- 172.21.15.32:0/3370574699 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c1516f0 con 0x7f1c4c0c55d0 2024-01-19T04:16:49.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c49400640 1 --2- 172.21.15.32:0/3370574699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c0c55d0 0x7f1c4c0c04a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400aa10 tx=0x7f1c3401d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55ac805409c1dd7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:49.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c48a00640 1 -- 172.21.15.32:0/3370574699 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c340a6990 con 0x7f1c4c0c55d0 2024-01-19T04:16:49.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c48a00640 1 -- 172.21.15.32:0/3370574699 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c340a6af0 con 0x7f1c4c0c55d0 2024-01-19T04:16:49.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.725+0000 7f1c48a00640 1 -- 172.21.15.32:0/3370574699 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c340a6e80 con 0x7f1c4c0c55d0 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- 172.21.15.32:0/3370574699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c0c55d0 msgr2=0x7f1c4c0c04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 --2- 172.21.15.32:0/3370574699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c0c55d0 0x7f1c4c0c04a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400aa10 tx=0x7f1c3401d8e0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- 172.21.15.32:0/3370574699 shutdown_connections 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 --2- 172.21.15.32:0/3370574699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c0c55d0 0x7f1c4c0c04a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 --2- 172.21.15.32:0/3370574699 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c06cab0 0x7f1c4c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- 172.21.15.32:0/3370574699 >> 172.21.15.32:0/3370574699 conn(0x7f1c4c0c25a0 msgr2=0x7f1c4c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- 172.21.15.32:0/3370574699 shutdown_connections 2024-01-19T04:16:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- 172.21.15.32:0/3370574699 wait complete. 2024-01-19T04:16:49.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 Processor -- start 2024-01-19T04:16:49.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- start start 2024-01-19T04:16:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c06cab0 0x7f1c4c144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c4c0705b0 0x7f1c4c1f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c0c55d0 0x7f1c4c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0abe60 con 0x7f1c4c06cab0 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c1edbd0 con 0x7f1c4c0705b0 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c50c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c1f1be0 con 0x7f1c4c0c55d0 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c06cab0 0x7f1c4c144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c06cab0 0x7f1c4c144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46372/0 (socket says 172.21.15.32:46372) 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 -- 172.21.15.32:0/281502654 learned_addr learned my addr 172.21.15.32:0/281502654 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49400640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c4c0705b0 0x7f1c4c1f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c4a800640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c0c55d0 0x7f1c4c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 -- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c0c55d0 msgr2=0x7f1c4c14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c0c55d0 0x7f1c4c14f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 -- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c4c0705b0 msgr2=0x7f1c4c1f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c4c0705b0 0x7f1c4c1f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.729+0000 7f1c49e00640 1 -- 172.21.15.32:0/281502654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3400a670 con 0x7f1c4c06cab0 2024-01-19T04:16:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c49e00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c06cab0 0x7f1c4c144080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00ea10 tx=0x7f1c3c00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c42000640 1 -- 172.21.15.32:0/281502654 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0096b0 con 0x7f1c4c06cab0 2024-01-19T04:16:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c42000640 1 -- 172.21.15.32:0/281502654 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c00ca00 con 0x7f1c4c06cab0 2024-01-19T04:16:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c42000640 1 -- 172.21.15.32:0/281502654 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00cd90 con 0x7f1c4c06cab0 2024-01-19T04:16:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c1497c0 con 0x7f1c4c06cab0 2024-01-19T04:16:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c149d80 con 0x7f1c4c06cab0 2024-01-19T04:16:49.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c0749f0 con 0x7f1c4c06cab0 2024-01-19T04:16:49.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.733+0000 7f1c42000640 1 -- 172.21.15.32:0/281502654 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1c3c013470 con 0x7f1c4c06cab0 2024-01-19T04:16:49.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.737+0000 7f1c42000640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c24066500 0x7f1c240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:49.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.737+0000 7f1c42000640 1 -- 172.21.15.32:0/281502654 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1c3c083f10 con 0x7f1c4c06cab0 2024-01-19T04:16:49.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.737+0000 7f1c49400640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c24066500 0x7f1c240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.737+0000 7f1c49400640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c24066500 0x7f1c240689c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c340b0000 tx=0x7f1c34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:49.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.741+0000 7f1c42000640 1 -- 172.21.15.32:0/281502654 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1c3c051430 con 0x7f1c4c06cab0 2024-01-19T04:16:49.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:49.901+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1c4c1514d0 con 0x7f1c4c06cab0 2024-01-19T04:16:50.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.541+0000 7f1c42000640 1 -- 172.21.15.32:0/281502654 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v51) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1c3c054a50 con 0x7f1c4c06cab0 2024-01-19T04:16:50.545 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-01-19T04:16:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c24066500 msgr2=0x7f1c240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c24066500 0x7f1c240689c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1c340b0000 tx=0x7f1c34008040 comp rx=0 tx=0).stop 2024-01-19T04:16:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c06cab0 msgr2=0x7f1c4c144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c06cab0 0x7f1c4c144080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00ea10 tx=0x7f1c3c00eed0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 shutdown_connections 2024-01-19T04:16:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1c24066500 0x7f1c240689c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1c4c0c55d0 0x7f1c4c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c4c0705b0 0x7f1c4c1f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 --2- 172.21.15.32:0/281502654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c4c06cab0 0x7f1c4c144080 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 >> 172.21.15.32:0/281502654 conn(0x7f1c4c0c25a0 msgr2=0x7f1c4c0c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:50.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.545+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 shutdown_connections 2024-01-19T04:16:50.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.549+0000 7f1c50c00640 1 -- 172.21.15.32:0/281502654 wait complete. 2024-01-19T04:16:50.589 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-19T04:16:50.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c43a00640 1 Processor -- start 2024-01-19T04:16:50.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c43a00640 1 -- start start 2024-01-19T04:16:50.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c43a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7c3c06cab0 0x7f7c3c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:50.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c43a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c0c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:50.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c43a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0c0eb0 con 0x7f7c3c0705b0 2024-01-19T04:16:50.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c43a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c06e5c0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c43a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0a5330 con 0x7f7c3c0c55d0 2024-01-19T04:16:50.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c41000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7c3c06cab0 0x7f7c3c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c3be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c0c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c41000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7c3c06cab0 0x7f7c3c06ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:49986/0 (socket says 172.21.15.32:49986) 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c3be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c0c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:58996/0 (socket says 172.21.15.32:58996) 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c41000640 1 -- 172.21.15.32:0/25539247 learned_addr learned my addr 172.21.15.32:0/25539247 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c3be00640 1 -- 172.21.15.32:0/25539247 >> v2:172.21.15.67:3300/0 conn(0x7f7c3c06cab0 msgr2=0x7f7c3c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c3be00640 1 --2- 172.21.15.32:0/25539247 >> v2:172.21.15.67:3300/0 conn(0x7f7c3c06cab0 0x7f7c3c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c3be00640 1 -- 172.21.15.32:0/25539247 >> v1:172.21.15.67:6789/0 conn(0x7f7c3c0705b0 legacy=0x7f7c3c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c3be00640 1 -- 172.21.15.32:0/25539247 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c1516f0 con 0x7f7c3c0c55d0 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c3b400640 1 -- 172.21.15.32:0/25539247 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132792866 0 0) 0x7f7c3c0c0eb0 con 0x7f7c3c0705b0 2024-01-19T04:16:50.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.733+0000 7f7c41000640 1 --2- 172.21.15.32:0/25539247 >> v2:172.21.15.67:3300/0 conn(0x7f7c3c06cab0 0x7f7c3c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:50.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c3be00640 1 --2- 172.21.15.32:0/25539247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c0c04a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400a960 tx=0x7f7c2401d820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68201ea808fa879d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:50.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c3b400640 1 -- 172.21.15.32:0/25539247 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240a68d0 con 0x7f7c3c0c55d0 2024-01-19T04:16:50.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c3b400640 1 -- 172.21.15.32:0/25539247 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c240a6a30 con 0x7f7c3c0c55d0 2024-01-19T04:16:50.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c3b400640 1 -- 172.21.15.32:0/25539247 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240a6dc0 con 0x7f7c3c0c55d0 2024-01-19T04:16:50.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c43a00640 1 -- 172.21.15.32:0/25539247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 msgr2=0x7f7c3c0c04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:50.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c43a00640 1 --2- 172.21.15.32:0/25539247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c0c04a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400a960 tx=0x7f7c2401d820 comp rx=0 tx=0).stop 2024-01-19T04:16:50.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c43a00640 1 -- 172.21.15.32:0/25539247 shutdown_connections 2024-01-19T04:16:50.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c43a00640 1 --2- 172.21.15.32:0/25539247 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c0c04a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c43a00640 1 --2- 172.21.15.32:0/25539247 >> v2:172.21.15.67:3300/0 conn(0x7f7c3c06cab0 0x7f7c3c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.737+0000 7f7c43a00640 1 -- 172.21.15.32:0/25539247 >> 172.21.15.32:0/25539247 conn(0x7f7c3c0c25a0 msgr2=0x7f7c3c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:50.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 -- 172.21.15.32:0/25539247 shutdown_connections 2024-01-19T04:16:50.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 -- 172.21.15.32:0/25539247 wait complete. 2024-01-19T04:16:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 Processor -- start 2024-01-19T04:16:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 -- start start 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c3c06cab0 0x7f7c3c14e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c0705b0 0x7f7c3c1edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c1ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c1ee800 con 0x7f7c3c06cab0 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0ab230 con 0x7f7c3c0705b0 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c43a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0ab510 con 0x7f7c3c0c55d0 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c3c06cab0 0x7f7c3c14e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c3c06cab0 0x7f7c3c14e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46388/0 (socket says 172.21.15.32:46388) 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 -- 172.21.15.32:0/2534088527 learned_addr learned my addr 172.21.15.32:0/2534088527 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c3be00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c0705b0 0x7f7c3c1edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41a00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c1ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 -- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 msgr2=0x7f7c3c1ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c1ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 -- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c0705b0 msgr2=0x7f7c3c1edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c0705b0 0x7f7c3c1edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 -- 172.21.15.32:0/2534088527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0094d0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c41000640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c3c06cab0 0x7f7c3c14e4a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e9d0 tx=0x7f7c2c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.741+0000 7f7c38c00640 1 -- 172.21.15.32:0/2534088527 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00ca60 con 0x7f7c3c06cab0 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c38c00640 1 -- 172.21.15.32:0/2534088527 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00cbc0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2400a5c0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c38c00640 1 -- 172.21.15.32:0/2534088527 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c013470 con 0x7f7c3c06cab0 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c0abad0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c0749f0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c38c00640 1 -- 172.21.15.32:0/2534088527 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7c2c0135d0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c38c00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7c14066500 0x7f7c140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:50.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c38c00640 1 -- 172.21.15.32:0/2534088527 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7c2c084110 con 0x7f7c3c06cab0 2024-01-19T04:16:50.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.745+0000 7f7c3be00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7c14066500 0x7f7c140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:50.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.749+0000 7f7c3be00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7c14066500 0x7f7c140689c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7c240b0000 tx=0x7f7c24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:50.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.749+0000 7f7c38c00640 1 -- 172.21.15.32:0/2534088527 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7c2c0514b0 con 0x7f7c3c06cab0 2024-01-19T04:16:50.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:50.945+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7c3c06d590 con 0x7f7c3c06cab0 2024-01-19T04:16:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.545+0000 7f7c38c00640 1 -- 172.21.15.32:0/2534088527 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7c2c054ad0 con 0x7f7c3c06cab0 2024-01-19T04:16:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 8 and data pool 9 2024-01-19T04:16:51.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7c14066500 msgr2=0x7f7c140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:51.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7c14066500 0x7f7c140689c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7c240b0000 tx=0x7f7c24008040 comp rx=0 tx=0).stop 2024-01-19T04:16:51.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c3c06cab0 msgr2=0x7f7c3c14e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:51.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c3c06cab0 0x7f7c3c14e4a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e9d0 tx=0x7f7c2c00ee90 comp rx=0 tx=0).stop 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 shutdown_connections 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7c14066500 0x7f7c140689c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7c3c0c55d0 0x7f7c3c1ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c0705b0 0x7f7c3c1edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 --2- 172.21.15.32:0/2534088527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c3c06cab0 0x7f7c3c14e4a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.549+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 >> 172.21.15.32:0/2534088527 conn(0x7f7c3c0c25a0 msgr2=0x7f7c3c0c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.553+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 shutdown_connections 2024-01-19T04:16:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.553+0000 7f7c43a00640 1 -- 172.21.15.32:0/2534088527 wait complete. 2024-01-19T04:16:51.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:51.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7faceba00640 1 Processor -- start 2024-01-19T04:16:51.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7faceba00640 1 -- start start 2024-01-19T04:16:51.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7faceba00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7face40c6e20 0x7face40c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:51.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7faceba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40a6d30 0x7face40c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:51.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7faceba00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face41533a0 con 0x7face406fda0 2024-01-19T04:16:51.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7faceba00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face4156380 con 0x7face40c6e20 2024-01-19T04:16:51.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7faceba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face414fe40 con 0x7face40a6d30 2024-01-19T04:16:51.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7face40c6e20 0x7face40c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:51.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7face40c6e20 0x7face40c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46394/0 (socket says 172.21.15.32:46394) 2024-01-19T04:16:51.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face9000640 1 -- 172.21.15.32:0/1941511120 learned_addr learned my addr 172.21.15.32:0/1941511120 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:51.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face9000640 1 -- 172.21.15.32:0/1941511120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40a6d30 msgr2=0x7face40c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:51.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face3e00640 1 --2- 172.21.15.32:0/1941511120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40a6d30 0x7face40c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:51.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face9000640 1 --2- 172.21.15.32:0/1941511120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40a6d30 0x7face40c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face9000640 1 -- 172.21.15.32:0/1941511120 >> v1:172.21.15.67:6789/0 conn(0x7face406fda0 legacy=0x7face4152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:51.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face9000640 1 -- 172.21.15.32:0/1941511120 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4152800 con 0x7face40c6e20 2024-01-19T04:16:51.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.745+0000 7face3e00640 1 --2- 172.21.15.32:0/1941511120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40a6d30 0x7face40c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:51.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7face9000640 1 --2- 172.21.15.32:0/1941511120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40c6e20 0x7face40c7200 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aaac44117ec77 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:51.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7face3400640 1 -- 172.21.15.32:0/1941511120 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40ab620 con 0x7face40c6e20 2024-01-19T04:16:51.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7face3400640 1 -- 172.21.15.32:0/1941511120 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40ab780 con 0x7face40c6e20 2024-01-19T04:16:51.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7face3400640 1 -- 172.21.15.32:0/1941511120 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40abb10 con 0x7face40c6e20 2024-01-19T04:16:51.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 -- 172.21.15.32:0/1941511120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40c6e20 msgr2=0x7face40c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:51.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 --2- 172.21.15.32:0/1941511120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40c6e20 0x7face40c7200 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7facd4009870 tx=0x7facd401c420 comp rx=0 tx=0).stop 2024-01-19T04:16:51.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 -- 172.21.15.32:0/1941511120 shutdown_connections 2024-01-19T04:16:51.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 --2- 172.21.15.32:0/1941511120 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40a6d30 0x7face40c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 --2- 172.21.15.32:0/1941511120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40c6e20 0x7face40c7200 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 -- 172.21.15.32:0/1941511120 >> 172.21.15.32:0/1941511120 conn(0x7face40a9870 msgr2=0x7face40a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:51.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 -- 172.21.15.32:0/1941511120 shutdown_connections 2024-01-19T04:16:51.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.749+0000 7faceba00640 1 -- 172.21.15.32:0/1941511120 wait complete. 2024-01-19T04:16:51.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 Processor -- start 2024-01-19T04:16:51.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 -- start start 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face406fda0 0x7face4155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face40a6d30 0x7face41f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40c6e20 0x7face41ed4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4154380 con 0x7face406fda0 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face41ecb00 con 0x7face40a6d30 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face41f0610 con 0x7face40c6e20 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face406fda0 0x7face4155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face406fda0 0x7face4155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46396/0 (socket says 172.21.15.32:46396) 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 -- 172.21.15.32:0/2327018797 learned_addr learned my addr 172.21.15.32:0/2327018797 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9a00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40c6e20 0x7face41ed4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face3e00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face40a6d30 0x7face41f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:51.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 -- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40c6e20 msgr2=0x7face41ed4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40c6e20 0x7face41ed4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 -- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face40a6d30 msgr2=0x7face41f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face40a6d30 0x7face41f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 -- 172.21.15.32:0/2327018797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40094d0 con 0x7face406fda0 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face3e00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face40a6d30 0x7face41f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face9000640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face406fda0 0x7face4155400 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7facd40ad040 tx=0x7facd401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face0c00640 1 -- 172.21.15.32:0/2327018797 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40be3f0 con 0x7face406fda0 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face0c00640 1 -- 172.21.15.32:0/2327018797 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40be550 con 0x7face406fda0 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7face0c00640 1 -- 172.21.15.32:0/2327018797 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40be900 con 0x7face406fda0 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40bdba0 con 0x7face406fda0 2024-01-19T04:16:51.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.753+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40bde40 con 0x7face406fda0 2024-01-19T04:16:51.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.757+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face40749f0 con 0x7face406fda0 2024-01-19T04:16:51.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.757+0000 7face0c00640 1 -- 172.21.15.32:0/2327018797 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7facd40b43f0 con 0x7face406fda0 2024-01-19T04:16:51.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.757+0000 7face0c00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facbc066500 0x7facbc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:51.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.757+0000 7face0c00640 1 -- 172.21.15.32:0/2327018797 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facd411e760 con 0x7face406fda0 2024-01-19T04:16:51.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.757+0000 7face3e00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facbc066500 0x7facbc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:51.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.757+0000 7face3e00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facbc066500 0x7facbc0689c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faccc006fd0 tx=0x7faccc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:51.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.761+0000 7face0c00640 1 -- 172.21.15.32:0/2327018797 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7facd40ebaa0 con 0x7face406fda0 2024-01-19T04:16:51.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.921+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7face4067be0 con 0x7face406fda0 2024-01-19T04:16:51.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7face0c00640 1 -- 172.21.15.32:0/2327018797 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16483 (secure 0 0 0) 0x7facd40ef0c0 con 0x7face406fda0 2024-01-19T04:16:51.927 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:51.927 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":52,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:50.950016+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facbc066500 msgr2=0x7facbc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facbc066500 0x7facbc0689c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faccc006fd0 tx=0x7faccc008040 comp rx=0 tx=0).stop 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face406fda0 msgr2=0x7face4155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face406fda0 0x7face4155400 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7facd40ad040 tx=0x7facd401ac60 comp rx=0 tx=0).stop 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 shutdown_connections 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7facbc066500 0x7facbc0689c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7face40c6e20 0x7face41ed4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face40a6d30 0x7face41f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 --2- 172.21.15.32:0/2327018797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face406fda0 0x7face4155400 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 >> 172.21.15.32:0/2327018797 conn(0x7face40a9870 msgr2=0x7face40c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 shutdown_connections 2024-01-19T04:16:51.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:51.925+0000 7faceba00640 1 -- 172.21.15.32:0/2327018797 wait complete. 2024-01-19T04:16:51.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:52.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f059b200640 1 Processor -- start 2024-01-19T04:16:52.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f059b200640 1 -- start start 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f059b200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f059406fda0 0x7f05940c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f059b200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f059406eb70 0x7f059406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f059b200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05940c5b40 con 0x7f0594151f30 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f059b200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05941551e0 con 0x7f059406eb70 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f059b200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0594155710 con 0x7f059406fda0 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0593e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0594151f30 0x7f05940c4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43822/0 (socket says 172.21.15.32:43822) 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0593e00640 1 -- 172.21.15.32:0/3611067733 learned_addr learned my addr 172.21.15.32:0/3611067733 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0599200640 1 --2- 172.21.15.32:0/3611067733 >> v2:172.21.15.32:3300/0 conn(0x7f059406eb70 0x7f059406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0593400640 1 --2- 172.21.15.32:0/3611067733 >> v2:172.21.15.67:3300/0 conn(0x7f059406fda0 0x7f05940c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0592a00640 1 -- 172.21.15.32:0/3611067733 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722857653 0 0) 0x7f05940c5b40 con 0x7f0594151f30 2024-01-19T04:16:52.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0599200640 1 -- 172.21.15.32:0/3611067733 >> v2:172.21.15.67:3300/0 conn(0x7f059406fda0 msgr2=0x7f05940c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:52.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0599200640 1 --2- 172.21.15.32:0/3611067733 >> v2:172.21.15.67:3300/0 conn(0x7f059406fda0 0x7f05940c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0599200640 1 -- 172.21.15.32:0/3611067733 >> v1:172.21.15.32:6789/0 conn(0x7f0594151f30 legacy=0x7f05940c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.089+0000 7f0599200640 1 -- 172.21.15.32:0/3611067733 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940c3fa0 con 0x7f059406eb70 2024-01-19T04:16:52.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f0599200640 1 --2- 172.21.15.32:0/3611067733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f059406efc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f059406da70 tx=0x7f058c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379ed9e8dd6df4b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:52.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f0592a00640 1 -- 172.21.15.32:0/3611067733 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0a5850 con 0x7f059406eb70 2024-01-19T04:16:52.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f0592a00640 1 -- 172.21.15.32:0/3611067733 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c0a59b0 con 0x7f059406eb70 2024-01-19T04:16:52.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f0592a00640 1 -- 172.21.15.32:0/3611067733 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0a5d40 con 0x7f059406eb70 2024-01-19T04:16:52.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 -- 172.21.15.32:0/3611067733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 msgr2=0x7f059406efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 --2- 172.21.15.32:0/3611067733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f059406efc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f059406da70 tx=0x7f058c01c880 comp rx=0 tx=0).stop 2024-01-19T04:16:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 -- 172.21.15.32:0/3611067733 shutdown_connections 2024-01-19T04:16:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 --2- 172.21.15.32:0/3611067733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f059406efc0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 --2- 172.21.15.32:0/3611067733 >> v2:172.21.15.67:3300/0 conn(0x7f059406fda0 0x7f05940c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 -- 172.21.15.32:0/3611067733 >> 172.21.15.32:0/3611067733 conn(0x7f05940a9870 msgr2=0x7f05940a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 -- 172.21.15.32:0/3611067733 shutdown_connections 2024-01-19T04:16:52.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.093+0000 7f059b200640 1 -- 172.21.15.32:0/3611067733 wait complete. 2024-01-19T04:16:52.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 Processor -- start 2024-01-19T04:16:52.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 -- start start 2024-01-19T04:16:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f0594154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059406fda0 0x7f05941eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0594151f30 0x7f05940c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05940ad410 con 0x7f059406eb70 2024-01-19T04:16:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05941edc90 con 0x7f059406fda0 2024-01-19T04:16:52.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05941ed6d0 con 0x7f0594151f30 2024-01-19T04:16:52.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f0594154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f0594154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46416/0 (socket says 172.21.15.32:46416) 2024-01-19T04:16:52.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 -- 172.21.15.32:0/4201544876 learned_addr learned my addr 172.21.15.32:0/4201544876 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593400640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059406fda0 0x7f05941eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0599200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0594151f30 0x7f05940c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 -- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0594151f30 msgr2=0x7f05940c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0594151f30 0x7f05940c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 -- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059406fda0 msgr2=0x7f05941eccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059406fda0 0x7f05941eccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 -- 172.21.15.32:0/4201544876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c009a70 con 0x7f059406eb70 2024-01-19T04:16:52.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593400640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059406fda0 0x7f05941eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0599200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0594151f30 0x7f05940c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f0593e00640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f0594154240 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f058400c480 tx=0x7f058400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f058be00640 1 -- 172.21.15.32:0/4201544876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840074e0 con 0x7f059406eb70 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f058be00640 1 -- 172.21.15.32:0/4201544876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584007660 con 0x7f059406eb70 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05941ed9b0 con 0x7f059406eb70 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f058be00640 1 -- 172.21.15.32:0/4201544876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584004a30 con 0x7f059406eb70 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05941529e0 con 0x7f059406eb70 2024-01-19T04:16:52.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.097+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05940749f0 con 0x7f059406eb70 2024-01-19T04:16:52.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.101+0000 7f058be00640 1 -- 172.21.15.32:0/4201544876 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0584004b90 con 0x7f059406eb70 2024-01-19T04:16:52.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.101+0000 7f058be00640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f056c066530 0x7f056c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.101+0000 7f058be00640 1 -- 172.21.15.32:0/4201544876 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05840830a0 con 0x7f059406eb70 2024-01-19T04:16:52.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.101+0000 7f0593400640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f056c066530 0x7f056c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.101+0000 7f0593400640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f056c066530 0x7f056c0689f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f059406c620 tx=0x7f057c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:52.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.105+0000 7f058be00640 1 -- 172.21.15.32:0/4201544876 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0584053d40 con 0x7f059406eb70 2024-01-19T04:16:52.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.265+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0594067b80 con 0x7f059406eb70 2024-01-19T04:16:52.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f058be00640 1 -- 172.21.15.32:0/4201544876 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16483 (secure 0 0 0) 0x7f05840538d0 con 0x7f059406eb70 2024-01-19T04:16:52.271 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:52.271 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":52,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:50.950016+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:52.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f056c066530 msgr2=0x7f056c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f056c066530 0x7f056c0689f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f059406c620 tx=0x7f057c008040 comp rx=0 tx=0).stop 2024-01-19T04:16:52.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 msgr2=0x7f0594154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f0594154240 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f058400c480 tx=0x7f058400c940 comp rx=0 tx=0).stop 2024-01-19T04:16:52.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 shutdown_connections 2024-01-19T04:16:52.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f056c066530 0x7f056c0689f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0594151f30 0x7f05940c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059406fda0 0x7f05941eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 --2- 172.21.15.32:0/4201544876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f059406eb70 0x7f0594154240 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 >> 172.21.15.32:0/4201544876 conn(0x7f05940a9870 msgr2=0x7f059406bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:52.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 shutdown_connections 2024-01-19T04:16:52.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.269+0000 7f059b200640 1 -- 172.21.15.32:0/4201544876 wait complete. 2024-01-19T04:16:52.293 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-19T04:16:52.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:16:52.389 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:16:52.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.433+0000 7ff0b6400640 1 Processor -- start 2024-01-19T04:16:52.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.433+0000 7ff0b6400640 1 -- start start 2024-01-19T04:16:52.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0b6400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0b0151e60 0x7ff0b00c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0b6400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff0b00c4fc0 0x7ff0b0155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0b6400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b00c36c0 con 0x7ff0b00c1f60 2024-01-19T04:16:52.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0b6400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b00c30e0 con 0x7ff0b0151e60 2024-01-19T04:16:52.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0b6400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b00c2b70 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0b0151e60 0x7ff0b00c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff0b0151e60 0x7ff0b00c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46428/0 (socket says 172.21.15.32:46428) 2024-01-19T04:16:52.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 -- 172.21.15.32:0/3567311720 learned_addr learned my addr 172.21.15.32:0/3567311720 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:52.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0afe00640 1 --2- 172.21.15.32:0/3567311720 >> v2:172.21.15.67:3300/0 conn(0x7ff0b00c4fc0 0x7ff0b0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 -- 172.21.15.32:0/3567311720 >> v2:172.21.15.67:3300/0 conn(0x7ff0b00c4fc0 msgr2=0x7ff0b0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:52.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 --2- 172.21.15.32:0/3567311720 >> v2:172.21.15.67:3300/0 conn(0x7ff0b00c4fc0 0x7ff0b0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 -- 172.21.15.32:0/3567311720 >> v1:172.21.15.67:6789/0 conn(0x7ff0b00c1f60 legacy=0x7ff0b00c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:52.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 -- 172.21.15.32:0/3567311720 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00c55a0 con 0x7ff0b0151e60 2024-01-19T04:16:52.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.437+0000 7ff0af400640 1 --2- 172.21.15.32:0/3567311720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b0151e60 0x7ff0b00c4240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0071f70 tx=0x7ff0a001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb9efdd118186fa server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:52.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0ae000640 1 -- 172.21.15.32:0/3567311720 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00ab600 con 0x7ff0b0151e60 2024-01-19T04:16:52.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0ae000640 1 -- 172.21.15.32:0/3567311720 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a00a7050 con 0x7ff0b0151e60 2024-01-19T04:16:52.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0ae000640 1 -- 172.21.15.32:0/3567311720 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00ab980 con 0x7ff0b0151e60 2024-01-19T04:16:52.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- 172.21.15.32:0/3567311720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b0151e60 msgr2=0x7ff0b00c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 --2- 172.21.15.32:0/3567311720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b0151e60 0x7ff0b00c4240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0071f70 tx=0x7ff0a001c3d0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- 172.21.15.32:0/3567311720 shutdown_connections 2024-01-19T04:16:52.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 --2- 172.21.15.32:0/3567311720 >> v2:172.21.15.67:3300/0 conn(0x7ff0b00c4fc0 0x7ff0b0155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 --2- 172.21.15.32:0/3567311720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b0151e60 0x7ff0b00c4240 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- 172.21.15.32:0/3567311720 >> 172.21.15.32:0/3567311720 conn(0x7ff0b00663f0 msgr2=0x7ff0b0066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:52.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- 172.21.15.32:0/3567311720 shutdown_connections 2024-01-19T04:16:52.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- 172.21.15.32:0/3567311720 wait complete. 2024-01-19T04:16:52.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 Processor -- start 2024-01-19T04:16:52.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- start start 2024-01-19T04:16:52.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b00c1f60 0x7ff0b006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b00c4fc0 0x7ff0b006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b0151e60 0x7ff0b006c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b01ed740 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b01ec870 con 0x7ff0b0151e60 2024-01-19T04:16:52.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0b6400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b01ecb30 con 0x7ff0b00c1f60 2024-01-19T04:16:52.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.441+0000 7ff0aea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b00c4fc0 0x7ff0b006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b00c4fc0 0x7ff0b006f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46432/0 (socket says 172.21.15.32:46432) 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 -- 172.21.15.32:0/2205650884 learned_addr learned my addr 172.21.15.32:0/2205650884 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0afe00640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b0151e60 0x7ff0b006c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0af400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b00c1f60 0x7ff0b006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 -- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b00c1f60 msgr2=0x7ff0b006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b00c1f60 0x7ff0b006eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 -- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b0151e60 msgr2=0x7ff0b006c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b0151e60 0x7ff0b006c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:52.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 -- 172.21.15.32:0/2205650884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00094d0 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0aea00640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b00c4fc0 0x7ff0b006f090 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c410 tx=0x7ff09800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:52.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0a7400640 1 -- 172.21.15.32:0/2205650884 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098011790 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0a7400640 1 -- 172.21.15.32:0/2205650884 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0980118f0 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0a7400640 1 -- 172.21.15.32:0/2205650884 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098011ce0 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b01ece10 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b01ed3d0 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b00749f0 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.445+0000 7ff0a7400640 1 -- 172.21.15.32:0/2205650884 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff09801c460 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.449+0000 7ff0a7400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff088066500 0x7ff0880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:52.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.449+0000 7ff0a7400640 1 -- 172.21.15.32:0/2205650884 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff098083a90 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.449+0000 7ff0af400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff088066500 0x7ff0880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:52.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.449+0000 7ff0af400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff088066500 0x7ff0880689c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00ad000 tx=0x7ff0a00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:52.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.453+0000 7ff0a7400640 1 -- 172.21.15.32:0/2205650884 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff098050dd0 con 0x7ff0b00c4fc0 2024-01-19T04:16:52.524 INFO:tasks.ceph.mds.d.smithi067.stderr:2024-01-19T04:16:52.521+0000 7fc52e800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:16:52.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:52.649+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0b00c1d40 con 0x7ff0b00c4fc0 2024-01-19T04:16:53.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0a7400640 1 -- 172.21.15.32:0/2205650884 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0980543f0 con 0x7ff0b00c4fc0 2024-01-19T04:16:53.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff088066500 msgr2=0x7ff0880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:53.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff088066500 0x7ff0880689c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00ad000 tx=0x7ff0a00a6000 comp rx=0 tx=0).stop 2024-01-19T04:16:53.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b00c4fc0 msgr2=0x7ff0b006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:53.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b00c4fc0 0x7ff0b006f090 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c410 tx=0x7ff09800c8d0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 shutdown_connections 2024-01-19T04:16:53.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff088066500 0x7ff0880689c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0b0151e60 0x7ff0b006c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0b00c4fc0 0x7ff0b006f090 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 --2- 172.21.15.32:0/2205650884 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff0b00c1f60 0x7ff0b006eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 >> 172.21.15.32:0/2205650884 conn(0x7ff0b00663f0 msgr2=0x7ff0b00736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:53.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 shutdown_connections 2024-01-19T04:16:53.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.645+0000 7ff0b6400640 1 -- 172.21.15.32:0/2205650884 wait complete. 2024-01-19T04:16:53.674 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T04:16:53.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-19T04:16:53.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339c200640 1 Processor -- start 2024-01-19T04:16:53.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339c200640 1 -- start start 2024-01-19T04:16:53.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339c200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3394158370 0x7f3394160000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339c200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940c35b0 con 0x7f339406f8d0 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339c200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940aa010 con 0x7f3394151fc0 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339c200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33941523a0 con 0x7f3394158370 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f3398e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f339406f8d0 0x7f3394157c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43832/0 (socket says 172.21.15.32:43832) 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f3398e00640 1 -- 172.21.15.32:0/91520113 learned_addr learned my addr 172.21.15.32:0/91520113 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339ac00640 1 --2- 172.21.15.32:0/91520113 >> v2:172.21.15.67:3300/0 conn(0x7f3394158370 0x7f3394160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f3393e00640 1 -- 172.21.15.32:0/91520113 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389191185 0 0) 0x7f33940c35b0 con 0x7f339406f8d0 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f3393e00640 1 -- 172.21.15.32:0/91520113 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003530 con 0x7f339406f8d0 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f3393e00640 1 -- 172.21.15.32:0/91520113 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402955512 0 0) 0x7f33940aa010 con 0x7f3394151fc0 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f3393e00640 1 -- 172.21.15.32:0/91520113 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33940c35b0 con 0x7f3394151fc0 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339ac00640 1 -- 172.21.15.32:0/91520113 >> v1:172.21.15.67:6789/0 conn(0x7f3394151fc0 legacy=0x7f33940a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339ac00640 1 -- 172.21.15.32:0/91520113 >> v1:172.21.15.32:6789/0 conn(0x7f339406f8d0 legacy=0x7f3394157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:53.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.865+0000 7f339ac00640 1 -- 172.21.15.32:0/91520113 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940a9520 con 0x7f3394158370 2024-01-19T04:16:53.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.869+0000 7f339ac00640 1 --2- 172.21.15.32:0/91520113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3394158370 0x7f3394160000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b953012f0bb5517 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:53.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.869+0000 7f3393e00640 1 -- 172.21.15.32:0/91520113 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0a58c0 con 0x7f3394158370 2024-01-19T04:16:53.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.869+0000 7f3393e00640 1 -- 172.21.15.32:0/91520113 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c0a5a20 con 0x7f3394158370 2024-01-19T04:16:53.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.869+0000 7f3393e00640 1 -- 172.21.15.32:0/91520113 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0a5db0 con 0x7f3394158370 2024-01-19T04:16:53.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- 172.21.15.32:0/91520113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3394158370 msgr2=0x7f3394160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:53.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 --2- 172.21.15.32:0/91520113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3394158370 0x7f3394160000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c01c800 comp rx=0 tx=0).stop 2024-01-19T04:16:53.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- 172.21.15.32:0/91520113 shutdown_connections 2024-01-19T04:16:53.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 --2- 172.21.15.32:0/91520113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3394158370 0x7f3394160000 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- 172.21.15.32:0/91520113 >> 172.21.15.32:0/91520113 conn(0x7f33940c7390 msgr2=0x7f33940c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:53.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- 172.21.15.32:0/91520113 shutdown_connections 2024-01-19T04:16:53.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- 172.21.15.32:0/91520113 wait complete. 2024-01-19T04:16:53.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 Processor -- start 2024-01-19T04:16:53.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- start start 2024-01-19T04:16:53.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f339406f8d0 0x7f33941f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3394151fc0 0x7f3394150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3394158370 0x7f3394146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941f0ff0 con 0x7f3394151fc0 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941532e0 con 0x7f339406f8d0 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339c200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3394147d30 con 0x7f3394158370 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3394151fc0 0x7f3394150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3394151fc0 0x7f3394150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46438/0 (socket says 172.21.15.32:46438) 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 -- 172.21.15.32:0/4111652997 learned_addr learned my addr 172.21.15.32:0/4111652997 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3399800640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f339406f8d0 0x7f33941f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339ac00640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3394158370 0x7f3394146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 -- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3394158370 msgr2=0x7f3394146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3394158370 0x7f3394146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 -- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f339406f8d0 msgr2=0x7f33941f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f339406f8d0 0x7f33941f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f3398e00640 1 -- 172.21.15.32:0/4111652997 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c009a70 con 0x7f3394151fc0 2024-01-19T04:16:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.873+0000 7f339ac00640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3394158370 0x7f3394146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3398e00640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3394151fc0 0x7f3394150e00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c4d0 tx=0x7f337c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:53.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3391600640 1 -- 172.21.15.32:0/4111652997 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c005cf0 con 0x7f3394151fc0 2024-01-19T04:16:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3391600640 1 -- 172.21.15.32:0/4111652997 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c005e50 con 0x7f3394151fc0 2024-01-19T04:16:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3394148010 con 0x7f3394151fc0 2024-01-19T04:16:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3391600640 1 -- 172.21.15.32:0/4111652997 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0072b0 con 0x7f3394151fc0 2024-01-19T04:16:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394153ba0 con 0x7f3394151fc0 2024-01-19T04:16:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3394148530 con 0x7f3394151fc0 2024-01-19T04:16:53.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3391600640 1 -- 172.21.15.32:0/4111652997 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f337c007410 con 0x7f3394151fc0 2024-01-19T04:16:53.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3391600640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f336c066530 0x7f336c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:53.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3391600640 1 -- 172.21.15.32:0/4111652997 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f337c083400 con 0x7f3394151fc0 2024-01-19T04:16:53.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.877+0000 7f3399800640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f336c066530 0x7f336c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:53.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.881+0000 7f3399800640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f336c066530 0x7f336c0689f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33840011f0 tx=0x7f3384009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:53.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:53.881+0000 7f3391600640 1 -- 172.21.15.32:0/4111652997 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3394148530 con 0x7f3394151fc0 2024-01-19T04:16:54.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.077+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3394148530 con 0x7f3394151fc0 2024-01-19T04:16:54.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.649+0000 7f3391600640 1 -- 172.21.15.32:0/4111652997 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3394148530 con 0x7f3394151fc0 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.649+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f336c066530 msgr2=0x7f336c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.649+0000 7f339c200640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f336c066530 0x7f336c0689f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33840011f0 tx=0x7f3384009040 comp rx=0 tx=0).stop 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.649+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3394151fc0 msgr2=0x7f3394150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.649+0000 7f339c200640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3394151fc0 0x7f3394150e00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f337c00c4d0 tx=0x7f337c00c990 comp rx=0 tx=0).stop 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 shutdown_connections 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f336c066530 0x7f336c0689f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3394158370 0x7f3394146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3394151fc0 0x7f3394150e00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 --2- 172.21.15.32:0/4111652997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f339406f8d0 0x7f33941f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 >> 172.21.15.32:0/4111652997 conn(0x7f33940c7390 msgr2=0x7f33940715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:54.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 shutdown_connections 2024-01-19T04:16:54.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.653+0000 7f339c200640 1 -- 172.21.15.32:0/4111652997 wait complete. 2024-01-19T04:16:54.676 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-19T04:16:54.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:54.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 Processor -- start 2024-01-19T04:16:54.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 -- start start 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54c0151f30 0x7f54c00c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54c006fda0 0x7f54c00c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c006f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00c5b40 con 0x7f54c0151f30 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00c3fa0 con 0x7f54c006fda0 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54c6000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c01551e0 con 0x7f54c006eb70 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54c0151f30 0x7f54c00c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54c0151f30 0x7f54c00c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46440/0 (socket says 172.21.15.32:46440) 2024-01-19T04:16:54.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 -- 172.21.15.32:0/156399855 learned_addr learned my addr 172.21.15.32:0/156399855 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bea00640 1 --2- 172.21.15.32:0/156399855 >> v2:172.21.15.67:3300/0 conn(0x7f54c006fda0 0x7f54c00c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bfe00640 1 --2- 172.21.15.32:0/156399855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 -- 172.21.15.32:0/156399855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 msgr2=0x7f54c006f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 --2- 172.21.15.32:0/156399855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c006f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 -- 172.21.15.32:0/156399855 >> v2:172.21.15.67:3300/0 conn(0x7f54c006fda0 msgr2=0x7f54c00c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 --2- 172.21.15.32:0/156399855 >> v2:172.21.15.67:3300/0 conn(0x7f54c006fda0 0x7f54c00c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bf400640 1 -- 172.21.15.32:0/156399855 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0155710 con 0x7f54c0151f30 2024-01-19T04:16:54.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bea00640 1 --2- 172.21.15.32:0/156399855 >> v2:172.21.15.67:3300/0 conn(0x7f54c006fda0 0x7f54c00c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:54.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.817+0000 7f54bfe00640 1 --2- 172.21.15.32:0/156399855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c006f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:16:54.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54bf400640 1 --2- 172.21.15.32:0/156399855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c00c4430 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f54c006da70 tx=0x7f54b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d043003dfc813209 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:54.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54be000640 1 -- 172.21.15.32:0/156399855 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00ab600 con 0x7f54c0151f30 2024-01-19T04:16:54.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54be000640 1 -- 172.21.15.32:0/156399855 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b00a7050 con 0x7f54c0151f30 2024-01-19T04:16:54.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54be000640 1 -- 172.21.15.32:0/156399855 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00ab980 con 0x7f54c0151f30 2024-01-19T04:16:54.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 -- 172.21.15.32:0/156399855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 msgr2=0x7f54c00c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:54.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 --2- 172.21.15.32:0/156399855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c00c4430 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f54c006da70 tx=0x7f54b001c470 comp rx=0 tx=0).stop 2024-01-19T04:16:54.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 -- 172.21.15.32:0/156399855 shutdown_connections 2024-01-19T04:16:54.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 --2- 172.21.15.32:0/156399855 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c006f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 --2- 172.21.15.32:0/156399855 >> v2:172.21.15.67:3300/0 conn(0x7f54c006fda0 0x7f54c00c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 --2- 172.21.15.32:0/156399855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c00c4430 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 -- 172.21.15.32:0/156399855 >> 172.21.15.32:0/156399855 conn(0x7f54c00a9870 msgr2=0x7f54c00a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:54.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 -- 172.21.15.32:0/156399855 shutdown_connections 2024-01-19T04:16:54.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.821+0000 7f54c6000640 1 -- 172.21.15.32:0/156399855 wait complete. 2024-01-19T04:16:54.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 Processor -- start 2024-01-19T04:16:54.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 -- start start 2024-01-19T04:16:54.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c01532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:54.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54c006fda0 0x7f54c0146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:54.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c0147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:54.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c014ca10 con 0x7f54c0151f30 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c014b800 con 0x7f54c006fda0 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c014bae0 con 0x7f54c006eb70 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c0147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c0147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46452/0 (socket says 172.21.15.32:46452) 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 -- 172.21.15.32:0/2207792679 learned_addr learned my addr 172.21.15.32:0/2207792679 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bf400640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c01532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bea00640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54c006fda0 0x7f54c0146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 -- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 msgr2=0x7f54c01532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c01532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 -- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54c006fda0 msgr2=0x7f54c0146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54c006fda0 0x7f54c0146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 -- 172.21.15.32:0/2207792679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00094d0 con 0x7f54c0151f30 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54bfe00640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c0147480 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f54b800cef0 tx=0x7f54b800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:54.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54b7400640 1 -- 172.21.15.32:0/2207792679 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800d840 con 0x7f54c0151f30 2024-01-19T04:16:54.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54b7400640 1 -- 172.21.15.32:0/2207792679 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b800d9a0 con 0x7f54c0151f30 2024-01-19T04:16:54.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c014bdc0 con 0x7f54c0151f30 2024-01-19T04:16:54.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54b7400640 1 -- 172.21.15.32:0/2207792679 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800dd50 con 0x7f54c0151f30 2024-01-19T04:16:54.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c014c6a0 con 0x7f54c0151f30 2024-01-19T04:16:54.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.825+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c014cb80 con 0x7f54c0151f30 2024-01-19T04:16:54.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.829+0000 7f54b7400640 1 -- 172.21.15.32:0/2207792679 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f54b801e3b0 con 0x7f54c0151f30 2024-01-19T04:16:54.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.829+0000 7f54b7400640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5498066500 0x7f54980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:54.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.829+0000 7f54b7400640 1 -- 172.21.15.32:0/2207792679 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54b80848f0 con 0x7f54c0151f30 2024-01-19T04:16:54.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.829+0000 7f54bf400640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5498066500 0x7f54980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:54.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.829+0000 7f54bf400640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5498066500 0x7f54980689c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f54c0071b80 tx=0x7f54b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:54.833+0000 7f54b7400640 1 -- 172.21.15.32:0/2207792679 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f54b8051b20 con 0x7f54c0151f30 2024-01-19T04:16:55.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.029+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54c00749f0 con 0x7f54c0151f30 2024-01-19T04:16:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.029+0000 7f54b7400640 1 -- 172.21.15.32:0/2207792679 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f54b801a090 con 0x7f54c0151f30 2024-01-19T04:16:55.032 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:55.032 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5835,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:50.950328+0000","modified":"2024-01-19T04:16:54.081170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/246892917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":246892917},{"type":"v1","addr":"172.21.15.67:6837","nonce":246892917}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-01-19T04:16:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 31 2024-01-19T04:16:55.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.029+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5498066500 msgr2=0x7f54980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.029+0000 7f54c6000640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5498066500 0x7f54980689c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f54c0071b80 tx=0x7f54b0009040 comp rx=0 tx=0).stop 2024-01-19T04:16:55.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.029+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 msgr2=0x7f54c0147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.029+0000 7f54c6000640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c0147480 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f54b800cef0 tx=0x7f54b800a710 comp rx=0 tx=0).stop 2024-01-19T04:16:55.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 shutdown_connections 2024-01-19T04:16:55.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5498066500 0x7f54980689c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54c0151f30 0x7f54c0147480 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54c006fda0 0x7f54c0146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 --2- 172.21.15.32:0/2207792679 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54c006eb70 0x7f54c01532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 >> 172.21.15.32:0/2207792679 conn(0x7f54c00a9870 msgr2=0x7f54c00c4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:55.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 shutdown_connections 2024-01-19T04:16:55.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.033+0000 7f54c6000640 1 -- 172.21.15.32:0/2207792679 wait complete. 2024-01-19T04:16:55.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:16:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af9800640 1 Processor -- start 2024-01-19T04:16:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af9800640 1 -- start start 2024-01-19T04:16:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af9800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af40c6d70 0x7f0af40c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af9800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0af40c3900 0x7f0af40c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af9800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af406ed70 con 0x7f0af4155500 2024-01-19T04:16:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af9800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af406e400 con 0x7f0af40c3900 2024-01-19T04:16:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af9800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40c7340 con 0x7f0af40c6d70 2024-01-19T04:16:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0af40c3900 0x7f0af40c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0af40c3900 0x7f0af40c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46454/0 (socket says 172.21.15.32:46454) 2024-01-19T04:16:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.193+0000 7f0af3400640 1 -- 172.21.15.32:0/1898711015 learned_addr learned my addr 172.21.15.32:0/1898711015 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af2000640 1 --2- 172.21.15.32:0/1898711015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af40c6d70 0x7f0af40c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af3400640 1 -- 172.21.15.32:0/1898711015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af40c6d70 msgr2=0x7f0af40c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:55.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af3400640 1 --2- 172.21.15.32:0/1898711015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af40c6d70 0x7f0af40c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af3400640 1 -- 172.21.15.32:0/1898711015 >> v1:172.21.15.67:6789/0 conn(0x7f0af4155500 legacy=0x7f0af40c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af3400640 1 -- 172.21.15.32:0/1898711015 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af406efc0 con 0x7f0af40c3900 2024-01-19T04:16:55.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af3400640 1 --2- 172.21.15.32:0/1898711015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c3900 0x7f0af40c46f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009e50 tx=0x7f0aec01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75cf687730be31 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af1600640 1 -- 172.21.15.32:0/1898711015 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0a5810 con 0x7f0af40c3900 2024-01-19T04:16:55.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af1600640 1 -- 172.21.15.32:0/1898711015 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec0a5970 con 0x7f0af40c3900 2024-01-19T04:16:55.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.197+0000 7f0af1600640 1 -- 172.21.15.32:0/1898711015 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0a5d00 con 0x7f0af40c3900 2024-01-19T04:16:55.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- 172.21.15.32:0/1898711015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c3900 msgr2=0x7f0af40c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 --2- 172.21.15.32:0/1898711015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c3900 0x7f0af40c46f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009e50 tx=0x7f0aec01c950 comp rx=0 tx=0).stop 2024-01-19T04:16:55.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- 172.21.15.32:0/1898711015 shutdown_connections 2024-01-19T04:16:55.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 --2- 172.21.15.32:0/1898711015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c3900 0x7f0af40c46f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 --2- 172.21.15.32:0/1898711015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af40c6d70 0x7f0af40c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- 172.21.15.32:0/1898711015 >> 172.21.15.32:0/1898711015 conn(0x7f0af40726d0 msgr2=0x7f0af40663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:55.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- 172.21.15.32:0/1898711015 shutdown_connections 2024-01-19T04:16:55.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- 172.21.15.32:0/1898711015 wait complete. 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 Processor -- start 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- start start 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af40c3900 0x7f0af4148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c6d70 0x7f0af40a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af4155500 0x7f0af41f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af41ee090 con 0x7f0af40c6d70 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af41494c0 con 0x7f0af40c3900 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af9800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af41edb40 con 0x7f0af4155500 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c6d70 0x7f0af40a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c6d70 0x7f0af40a8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46456/0 (socket says 172.21.15.32:46456) 2024-01-19T04:16:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af2000640 1 -- 172.21.15.32:0/1526220146 learned_addr learned my addr 172.21.15.32:0/1526220146 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af3400640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af4155500 0x7f0af41f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af2a00640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af40c3900 0x7f0af4148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.201+0000 7f0af2000640 1 -- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af4155500 msgr2=0x7f0af41f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af2000640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af4155500 0x7f0af41f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af2000640 1 -- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af40c3900 msgr2=0x7f0af4148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af2000640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af40c3900 0x7f0af4148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af2000640 1 -- 172.21.15.32:0/1526220146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec009b30 con 0x7f0af40c6d70 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af2000640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c6d70 0x7f0af40a8ac0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00e840 tx=0x7f0adc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0aeaa00640 1 -- 172.21.15.32:0/1526220146 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc009510 con 0x7f0af40c6d70 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0aeaa00640 1 -- 172.21.15.32:0/1526220146 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00ee90 con 0x7f0af40c6d70 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af4151be0 con 0x7f0af40c6d70 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0aeaa00640 1 -- 172.21.15.32:0/1526220146 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00cb60 con 0x7f0af40c6d70 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af4151620 con 0x7f0af40c6d70 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af4151480 con 0x7f0af40c6d70 2024-01-19T04:16:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0aeaa00640 1 -- 172.21.15.32:0/1526220146 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0adc00ccc0 con 0x7f0af40c6d70 2024-01-19T04:16:55.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.205+0000 7f0aeaa00640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0acc066500 0x7f0acc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.209+0000 7f0aeaa00640 1 -- 172.21.15.32:0/1526220146 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0adc083f40 con 0x7f0af40c6d70 2024-01-19T04:16:55.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.209+0000 7f0af2a00640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0acc066500 0x7f0acc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.209+0000 7f0af2a00640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0acc066500 0x7f0acc0689c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0af40c21f0 tx=0x7f0ae4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.209+0000 7f0aeaa00640 1 -- 172.21.15.32:0/1526220146 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0af4151480 con 0x7f0af40c6d70 2024-01-19T04:16:55.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.373+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af4151480 con 0x7f0af40c6d70 2024-01-19T04:16:55.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0aeaa00640 1 -- 172.21.15.32:0/1526220146 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f0af4151480 con 0x7f0af40c6d70 2024-01-19T04:16:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:55.379 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":53,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:52.561549+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:16:55.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0acc066500 msgr2=0x7f0acc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0acc066500 0x7f0acc0689c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0af40c21f0 tx=0x7f0ae4009040 comp rx=0 tx=0).stop 2024-01-19T04:16:55.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c6d70 msgr2=0x7f0af40a8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c6d70 0x7f0af40a8ac0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00e840 tx=0x7f0adc00ec40 comp rx=0 tx=0).stop 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 shutdown_connections 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0acc066500 0x7f0acc0689c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0af4155500 0x7f0af41f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0af40c6d70 0x7f0af40a8ac0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 --2- 172.21.15.32:0/1526220146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0af40c3900 0x7f0af4148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 >> 172.21.15.32:0/1526220146 conn(0x7f0af40726d0 msgr2=0x7f0af4154710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 shutdown_connections 2024-01-19T04:16:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.377+0000 7f0af9800640 1 -- 172.21.15.32:0/1526220146 wait complete. 2024-01-19T04:16:55.402 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:16:55.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:16:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d2de00640 1 Processor -- start 2024-01-19T04:16:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d2de00640 1 -- start start 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d2de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6d280c04a0 0x7f6d280c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d2de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d280a4ec0 0x7f6d280c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d2de00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d28071e80 con 0x7f6d2814fb50 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d2de00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d281535c0 con 0x7f6d280a4ec0 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d2de00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280726c0 con 0x7f6d280c04a0 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d27400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d280a4ec0 0x7f6d280c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d27400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d280a4ec0 0x7f6d280c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46472/0 (socket says 172.21.15.32:46472) 2024-01-19T04:16:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d27400640 1 -- 172.21.15.32:0/1035423270 learned_addr learned my addr 172.21.15.32:0/1035423270 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d26000640 1 --2- 172.21.15.32:0/1035423270 >> v2:172.21.15.67:3300/0 conn(0x7f6d280c04a0 0x7f6d280c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d27400640 1 -- 172.21.15.32:0/1035423270 >> v2:172.21.15.67:3300/0 conn(0x7f6d280c04a0 msgr2=0x7f6d280c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d27400640 1 --2- 172.21.15.32:0/1035423270 >> v2:172.21.15.67:3300/0 conn(0x7f6d280c04a0 0x7f6d280c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d27400640 1 -- 172.21.15.32:0/1035423270 >> v1:172.21.15.67:6789/0 conn(0x7f6d2814fb50 legacy=0x7f6d2806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.541+0000 7f6d27400640 1 -- 172.21.15.32:0/1035423270 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280c1cb0 con 0x7f6d280a4ec0 2024-01-19T04:16:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d27400640 1 --2- 172.21.15.32:0/1035423270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280c1770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6d28066fd0 tx=0x7f6d2001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b9da9e20995cde server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d25600640 1 -- 172.21.15.32:0/1035423270 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200a5600 con 0x7f6d280a4ec0 2024-01-19T04:16:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d25600640 1 -- 172.21.15.32:0/1035423270 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d200a5760 con 0x7f6d280a4ec0 2024-01-19T04:16:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d25600640 1 -- 172.21.15.32:0/1035423270 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200a5af0 con 0x7f6d280a4ec0 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d2de00640 1 -- 172.21.15.32:0/1035423270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 msgr2=0x7f6d280c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d2de00640 1 --2- 172.21.15.32:0/1035423270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280c1770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6d28066fd0 tx=0x7f6d2001c940 comp rx=0 tx=0).stop 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d2de00640 1 -- 172.21.15.32:0/1035423270 shutdown_connections 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d2de00640 1 --2- 172.21.15.32:0/1035423270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280c1770 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d2de00640 1 --2- 172.21.15.32:0/1035423270 >> v2:172.21.15.67:3300/0 conn(0x7f6d280c04a0 0x7f6d280c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.545+0000 7f6d2de00640 1 -- 172.21.15.32:0/1035423270 >> 172.21.15.32:0/1035423270 conn(0x7f6d280c5b20 msgr2=0x7f6d280c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 -- 172.21.15.32:0/1035423270 shutdown_connections 2024-01-19T04:16:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 -- 172.21.15.32:0/1035423270 wait complete. 2024-01-19T04:16:55.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 Processor -- start 2024-01-19T04:16:55.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 -- start start 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d280c04a0 0x7f6d28149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2814fb50 0x7f6d2814a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2814a660 con 0x7f6d280a4ec0 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28153aa0 con 0x7f6d2814fb50 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d2de00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d281ed680 con 0x7f6d280c04a0 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280a5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46476/0 (socket says 172.21.15.32:46476) 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 -- 172.21.15.32:0/2105675708 learned_addr learned my addr 172.21.15.32:0/2105675708 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d27400640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2814fb50 0x7f6d2814a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26000640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d280c04a0 0x7f6d28149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 -- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d280c04a0 msgr2=0x7f6d28149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d280c04a0 0x7f6d28149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 -- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2814fb50 msgr2=0x7f6d2814a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2814fb50 0x7f6d2814a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 -- 172.21.15.32:0/2105675708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20009b30 con 0x7f6d280a4ec0 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.549+0000 7f6d26a00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280a5920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800c420 tx=0x7f6d1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d1f400640 1 -- 172.21.15.32:0/2105675708 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180052d0 con 0x7f6d280a4ec0 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d1f400640 1 -- 172.21.15.32:0/2105675708 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d18005430 con 0x7f6d280a4ec0 2024-01-19T04:16:55.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d281ed960 con 0x7f6d280a4ec0 2024-01-19T04:16:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d1f400640 1 -- 172.21.15.32:0/2105675708 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18007260 con 0x7f6d280a4ec0 2024-01-19T04:16:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d28154040 con 0x7f6d280a4ec0 2024-01-19T04:16:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d280749f0 con 0x7f6d280a4ec0 2024-01-19T04:16:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d1f400640 1 -- 172.21.15.32:0/2105675708 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6d180073c0 con 0x7f6d280a4ec0 2024-01-19T04:16:55.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d1f400640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d00066500 0x7f6d000689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d1f400640 1 -- 172.21.15.32:0/2105675708 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d18083200 con 0x7f6d280a4ec0 2024-01-19T04:16:55.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d26000640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d00066500 0x7f6d000689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.553+0000 7f6d26000640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d00066500 0x7f6d000689c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6d10006aa0 tx=0x7f6d10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.557+0000 7f6d1f400640 1 -- 172.21.15.32:0/2105675708 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6d18050540 con 0x7f6d280a4ec0 2024-01-19T04:16:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.725+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d2815cd60 con 0x7f6d00066500 2024-01-19T04:16:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.733+0000 7f6d1f400640 1 -- 172.21.15.32:0/2105675708 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278545 (secure 0 0 0) 0x7f6d2815cd60 con 0x7f6d00066500 2024-01-19T04:16:55.740 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:55.741 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:16:55.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d00066500 msgr2=0x7f6d000689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d00066500 0x7f6d000689c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6d10006aa0 tx=0x7f6d10008040 comp rx=0 tx=0).stop 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 msgr2=0x7f6d280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280a5920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800c420 tx=0x7f6d1800c8e0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 shutdown_connections 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d00066500 0x7f6d000689c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d2814fb50 0x7f6d2814a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6d280c04a0 0x7f6d28149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 --2- 172.21.15.32:0/2105675708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d280a4ec0 0x7f6d280a5920 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 >> 172.21.15.32:0/2105675708 conn(0x7f6d280c5b20 msgr2=0x7f6d28150820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 shutdown_connections 2024-01-19T04:16:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.737+0000 7f6d2de00640 1 -- 172.21.15.32:0/2105675708 wait complete. 2024-01-19T04:16:55.760 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-01-19T04:16:54.054943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238536,"kb_used_data":5696,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736184,"statfs":{"total":773094113280,"available":772849852416,"internally_reserved":0,"allocated":5832704,"data_stored":3090004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.514066"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.584861+0000","last_change":"2024-01-19T04:16:51.580129+0000","last_active":"2024-01-19T04:16:51.584861+0000","last_peered":"2024-01-19T04:16:51.584861+0000","last_clean":"2024-01-19T04:16:51.584861+0000","last_became_active":"2024-01-19T04:16:51.579840+0000","last_became_peered":"2024-01-19T04:16:51.579840+0000","last_unstale":"2024-01-19T04:16:51.584861+0000","last_undegraded":"2024-01-19T04:16:51.584861+0000","last_fullsized":"2024-01-19T04:16:51.584861+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:45.186341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.584283+0000","last_change":"2024-01-19T04:16:51.572672+0000","last_active":"2024-01-19T04:16:51.584283+0000","last_peered":"2024-01-19T04:16:51.584283+0000","last_clean":"2024-01-19T04:16:51.584283+0000","last_became_active":"2024-01-19T04:16:51.572209+0000","last_became_peered":"2024-01-19T04:16:51.572209+0000","last_unstale":"2024-01-19T04:16:51.584283+0000","last_undegraded":"2024-01-19T04:16:51.584283+0000","last_fullsized":"2024-01-19T04:16:51.584283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:35:30.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.591161+0000","last_change":"2024-01-19T04:16:51.589385+0000","last_active":"2024-01-19T04:16:51.591161+0000","last_peered":"2024-01-19T04:16:51.591161+0000","last_clean":"2024-01-19T04:16:51.591161+0000","last_became_active":"2024-01-19T04:16:51.586748+0000","last_became_peered":"2024-01-19T04:16:51.586748+0000","last_unstale":"2024-01-19T04:16:51.591161+0000","last_undegraded":"2024-01-19T04:16:51.591161+0000","last_fullsized":"2024-01-19T04:16:51.591161+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:17:29.735345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.588280+0000","last_change":"2024-01-19T04:16:51.584822+0000","last_active":"2024-01-19T04:16:51.588280+0000","last_peered":"2024-01-19T04:16:51.588280+0000","last_clean":"2024-01-19T04:16:51.588280+0000","last_became_active":"2024-01-19T04:16:51.584562+0000","last_became_peered":"2024-01-19T04:16:51.584562+0000","last_unstale":"2024-01-19T04:16:51.588280+0000","last_undegraded":"2024-01-19T04:16:51.588280+0000","last_fullsized":"2024-01-19T04:16:51.588280+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:00.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.581242+0000","last_change":"2024-01-19T04:16:51.576501+0000","last_active":"2024-01-19T04:16:51.581242+0000","last_peered":"2024-01-19T04:16:51.581242+0000","last_clean":"2024-01-19T04:16:51.581242+0000","last_became_active":"2024-01-19T04:16:51.570654+0000","last_became_peered":"2024-01-19T04:16:51.570654+0000","last_unstale":"2024-01-19T04:16:51.581242+0000","last_undegraded":"2024-01-19T04:16:51.581242+0000","last_fullsized":"2024-01-19T04:16:51.581242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:27.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.585066+0000","last_change":"2024-01-19T04:16:51.583324+0000","last_active":"2024-01-19T04:16:51.585066+0000","last_peered":"2024-01-19T04:16:51.585066+0000","last_clean":"2024-01-19T04:16:51.585066+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:16:51.585066+0000","last_undegraded":"2024-01-19T04:16:51.585066+0000","last_fullsized":"2024-01-19T04:16:51.585066+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:54:37.629314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.579586+0000","last_change":"2024-01-19T04:16:50.567145+0000","last_active":"2024-01-19T04:16:51.579586+0000","last_peered":"2024-01-19T04:16:51.579586+0000","last_clean":"2024-01-19T04:16:51.579586+0000","last_became_active":"2024-01-19T04:16:50.566844+0000","last_became_peered":"2024-01-19T04:16:50.566844+0000","last_unstale":"2024-01-19T04:16:51.579586+0000","last_undegraded":"2024-01-19T04:16:51.579586+0000","last_fullsized":"2024-01-19T04:16:51.579586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:07.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.550120+0000","last_change":"2024-01-19T04:16:49.550120+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.550120+0000","last_undegraded":"2024-01-19T04:16:49.550120+0000","last_fullsized":"2024-01-19T04:16:49.550120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.581220+0000","last_change":"2024-01-19T04:16:51.573659+0000","last_active":"2024-01-19T04:16:51.581220+0000","last_peered":"2024-01-19T04:16:51.581220+0000","last_clean":"2024-01-19T04:16:51.581220+0000","last_became_active":"2024-01-19T04:16:51.570362+0000","last_became_peered":"2024-01-19T04:16:51.570362+0000","last_unstale":"2024-01-19T04:16:51.581220+0000","last_undegraded":"2024-01-19T04:16:51.581220+0000","last_fullsized":"2024-01-19T04:16:51.581220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:32:09.906437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.543507+0000","last_change":"2024-01-19T04:16:49.543507+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.543507+0000","last_undegraded":"2024-01-19T04:16:49.543507+0000","last_fullsized":"2024-01-19T04:16:49.543507+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.585004+0000","last_change":"2024-01-19T04:16:51.582274+0000","last_active":"2024-01-19T04:16:51.585004+0000","last_peered":"2024-01-19T04:16:51.585004+0000","last_clean":"2024-01-19T04:16:51.585004+0000","last_became_active":"2024-01-19T04:16:51.581164+0000","last_became_peered":"2024-01-19T04:16:51.581164+0000","last_unstale":"2024-01-19T04:16:51.585004+0000","last_undegraded":"2024-01-19T04:16:51.585004+0000","last_fullsized":"2024-01-19T04:16:51.585004+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:41:00.709588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.550091+0000","last_change":"2024-01-19T04:16:49.550091+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.550091+0000","last_undegraded":"2024-01-19T04:16:49.550091+0000","last_fullsized":"2024-01-19T04:16:49.550091+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.588819+0000","last_change":"2024-01-19T04:16:51.585817+0000","last_active":"2024-01-19T04:16:51.588819+0000","last_peered":"2024-01-19T04:16:51.588819+0000","last_clean":"2024-01-19T04:16:51.588819+0000","last_became_active":"2024-01-19T04:16:51.585142+0000","last_became_peered":"2024-01-19T04:16:51.585142+0000","last_unstale":"2024-01-19T04:16:51.588819+0000","last_undegraded":"2024-01-19T04:16:51.588819+0000","last_fullsized":"2024-01-19T04:16:51.588819+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:09.550045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.543445+0000","last_change":"2024-01-19T04:16:49.543445+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.543445+0000","last_undegraded":"2024-01-19T04:16:49.543445+0000","last_fullsized":"2024-01-19T04:16:49.543445+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.553653+0000","last_change":"2024-01-19T04:16:49.553653+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.553653+0000","last_undegraded":"2024-01-19T04:16:49.553653+0000","last_fullsized":"2024-01-19T04:16:49.553653+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.559803+0000","last_change":"2024-01-19T04:16:50.568671+0000","last_active":"2024-01-19T04:16:51.559803+0000","last_peered":"2024-01-19T04:16:51.559803+0000","last_clean":"2024-01-19T04:16:51.559803+0000","last_became_active":"2024-01-19T04:16:50.568385+0000","last_became_peered":"2024-01-19T04:16:50.568385+0000","last_unstale":"2024-01-19T04:16:51.559803+0000","last_undegraded":"2024-01-19T04:16:51.559803+0000","last_fullsized":"2024-01-19T04:16:51.559803+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:51.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.553626+0000","last_change":"2024-01-19T04:16:49.553626+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.553626+0000","last_undegraded":"2024-01-19T04:16:49.553626+0000","last_fullsized":"2024-01-19T04:16:49.553626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.543134+0000","last_change":"2024-01-19T04:16:49.543134+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.543134+0000","last_undegraded":"2024-01-19T04:16:49.543134+0000","last_fullsized":"2024-01-19T04:16:49.543134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.582093+0000","last_change":"2024-01-19T04:16:50.565530+0000","last_active":"2024-01-19T04:16:51.582093+0000","last_peered":"2024-01-19T04:16:51.582093+0000","last_clean":"2024-01-19T04:16:51.582093+0000","last_became_active":"2024-01-19T04:16:50.565191+0000","last_became_peered":"2024-01-19T04:16:50.565191+0000","last_unstale":"2024-01-19T04:16:51.582093+0000","last_undegraded":"2024-01-19T04:16:51.582093+0000","last_fullsized":"2024-01-19T04:16:51.582093+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:14.286352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.547707+0000","last_change":"2024-01-19T04:16:49.547707+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.547707+0000","last_undegraded":"2024-01-19T04:16:49.547707+0000","last_fullsized":"2024-01-19T04:16:49.547707+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.549561+0000","last_change":"2024-01-19T04:16:49.549561+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.549561+0000","last_undegraded":"2024-01-19T04:16:49.549561+0000","last_fullsized":"2024-01-19T04:16:49.549561+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.553510+0000","last_change":"2024-01-19T04:16:49.553510+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.553510+0000","last_undegraded":"2024-01-19T04:16:49.553510+0000","last_fullsized":"2024-01-19T04:16:49.553510+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.577294+0000","last_change":"2024-01-19T04:16:50.569273+0000","last_active":"2024-01-19T04:16:51.577294+0000","last_peered":"2024-01-19T04:16:51.577294+0000","last_clean":"2024-01-19T04:16:51.577294+0000","last_became_active":"2024-01-19T04:16:50.569009+0000","last_became_peered":"2024-01-19T04:16:50.569009+0000","last_unstale":"2024-01-19T04:16:51.577294+0000","last_undegraded":"2024-01-19T04:16:51.577294+0000","last_fullsized":"2024-01-19T04:16:51.577294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:59:10.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.585008+0000","last_change":"2024-01-19T04:16:51.575079+0000","last_active":"2024-01-19T04:16:51.585008+0000","last_peered":"2024-01-19T04:16:51.585008+0000","last_clean":"2024-01-19T04:16:51.585008+0000","last_became_active":"2024-01-19T04:16:51.574248+0000","last_became_peered":"2024-01-19T04:16:51.574248+0000","last_unstale":"2024-01-19T04:16:51.585008+0000","last_undegraded":"2024-01-19T04:16:51.585008+0000","last_fullsized":"2024-01-19T04:16:51.585008+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:37.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.549628+0000","last_change":"2024-01-19T04:16:49.549628+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.549628+0000","last_undegraded":"2024-01-19T04:16:49.549628+0000","last_fullsized":"2024-01-19T04:16:49.549628+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.583148+0000","last_change":"2024-01-19T04:16:50.563572+0000","last_active":"2024-01-19T04:16:51.583148+0000","last_peered":"2024-01-19T04:16:51.583148+0000","last_clean":"2024-01-19T04:16:51.583148+0000","last_became_active":"2024-01-19T04:16:50.561160+0000","last_became_peered":"2024-01-19T04:16:50.561160+0000","last_unstale":"2024-01-19T04:16:51.583148+0000","last_undegraded":"2024-01-19T04:16:51.583148+0000","last_fullsized":"2024-01-19T04:16:51.583148+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:40:18.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.549507+0000","last_change":"2024-01-19T04:16:49.549507+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.549507+0000","last_undegraded":"2024-01-19T04:16:49.549507+0000","last_fullsized":"2024-01-19T04:16:49.549507+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.547702+0000","last_change":"2024-01-19T04:16:49.547702+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.547702+0000","last_undegraded":"2024-01-19T04:16:49.547702+0000","last_fullsized":"2024-01-19T04:16:49.547702+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.549574+0000","last_change":"2024-01-19T04:16:49.549574+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.549574+0000","last_undegraded":"2024-01-19T04:16:49.549574+0000","last_fullsized":"2024-01-19T04:16:49.549574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.581263+0000","last_change":"2024-01-19T04:16:51.578118+0000","last_active":"2024-01-19T04:16:51.581263+0000","last_peered":"2024-01-19T04:16:51.581263+0000","last_clean":"2024-01-19T04:16:51.581263+0000","last_became_active":"2024-01-19T04:16:51.577861+0000","last_became_peered":"2024-01-19T04:16:51.577861+0000","last_unstale":"2024-01-19T04:16:51.581263+0000","last_undegraded":"2024-01-19T04:16:51.581263+0000","last_fullsized":"2024-01-19T04:16:51.581263+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:22.863624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.543121+0000","last_change":"2024-01-19T04:16:49.543121+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.543121+0000","last_undegraded":"2024-01-19T04:16:49.543121+0000","last_fullsized":"2024-01-19T04:16:49.543121+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:50.540176+0000","last_change":"2024-01-19T04:16:50.540176+0000","last_active":"2024-01-19T04:16:50.540176+0000","last_peered":"2024-01-19T04:16:50.540176+0000","last_clean":"2024-01-19T04:16:50.540176+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:50.540176+0000","last_undegraded":"2024-01-19T04:16:50.540176+0000","last_fullsized":"2024-01-19T04:16:50.540176+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:16:49.532903+0000","last_change":"2024-01-19T04:16:49.532903+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.532903+0000","last_undegraded":"2024-01-19T04:16:49.532903+0000","last_fullsized":"2024-01-19T04:16:49.532903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.588841+0000","last_change":"2024-01-19T04:16:51.586087+0000","last_active":"2024-01-19T04:16:51.588841+0000","last_peered":"2024-01-19T04:16:51.588841+0000","last_clean":"2024-01-19T04:16:51.588841+0000","last_became_active":"2024-01-19T04:16:51.585533+0000","last_became_peered":"2024-01-19T04:16:51.585533+0000","last_unstale":"2024-01-19T04:16:51.588841+0000","last_undegraded":"2024-01-19T04:16:51.588841+0000","last_fullsized":"2024-01-19T04:16:51.588841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:25:01.242688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.558885+0000","last_change":"2024-01-19T04:16:50.570854+0000","last_active":"2024-01-19T04:16:51.558885+0000","last_peered":"2024-01-19T04:16:51.558885+0000","last_clean":"2024-01-19T04:16:51.558885+0000","last_became_active":"2024-01-19T04:16:50.570594+0000","last_became_peered":"2024-01-19T04:16:50.570594+0000","last_unstale":"2024-01-19T04:16:51.558885+0000","last_undegraded":"2024-01-19T04:16:51.558885+0000","last_fullsized":"2024-01-19T04:16:51.558885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:51:58.259661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.584305+0000","last_change":"2024-01-19T04:16:51.574512+0000","last_active":"2024-01-19T04:16:51.584305+0000","last_peered":"2024-01-19T04:16:51.584305+0000","last_clean":"2024-01-19T04:16:51.584305+0000","last_became_active":"2024-01-19T04:16:51.574197+0000","last_became_peered":"2024-01-19T04:16:51.574197+0000","last_unstale":"2024-01-19T04:16:51.584305+0000","last_undegraded":"2024-01-19T04:16:51.584305+0000","last_fullsized":"2024-01-19T04:16:51.584305+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:52.971167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-01-19T04:16:49.547734+0000","last_change":"2024-01-19T04:16:49.547734+0000","last_active":"2024-01-19T04:16:49.532903+0000","last_peered":"2024-01-19T04:16:49.532903+0000","last_clean":"2024-01-19T04:16:49.532903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:16:49.547734+0000","last_undegraded":"2024-01-19T04:16:49.547734+0000","last_fullsized":"2024-01-19T04:16:49.547734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-19T04:16:47.356387+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:16:47.356387+0000","last_peered":"2024-01-19T04:16:47.356387+0000","last_clean":"2024-01-19T04:16:47.356387+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:16:47.356387+0000","last_undegraded":"2024-01-19T04:16:47.356387+0000","last_fullsized":"2024-01-19T04:16:47.356387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":44,"acting":44,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1167360,"data_stored":825935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.85299999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":241384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0169999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77100000000000002}]}]},{"osd":5,"up_from":16,"seq":68719476762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":235567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73099999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.874}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":1.0569999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.0820000000000001}]}]},{"osd":4,"up_from":16,"seq":68719476764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":235567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.753}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.871}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.61799999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":235567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.046}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.84299999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":235567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.71199999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1167360,"data_stored":825935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.439}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.66200000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":618496,"data_stored":254482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.505},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.84899999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.748}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.89100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:16:55.765 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:16:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bdda00640 1 Processor -- start 2024-01-19T04:16:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bdda00640 1 -- start start 2024-01-19T04:16:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bdda00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c5740 0x7f3bd80c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bdda00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80c0c90 con 0x7f3bd80c42b0 2024-01-19T04:16:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bdda00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd8150cb0 con 0x7f3bd80c1120 2024-01-19T04:16:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bdda00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8150f90 con 0x7f3bd80c5740 2024-01-19T04:16:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd6a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3bd80c42b0 0x7f3bd806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43846/0 (socket says 172.21.15.32:43846) 2024-01-19T04:16:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd6a00640 1 -- 172.21.15.32:0/1820424031 learned_addr learned my addr 172.21.15.32:0/1820424031 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd6000640 1 --2- 172.21.15.32:0/1820424031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c5740 0x7f3bd80c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423714401 0 0) 0x7f3bd80c0c90 con 0x7f3bd80c42b0 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb8003450 con 0x7f3bd80c42b0 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029649710 0 0) 0x7f3bd8150cb0 con 0x7f3bd80c1120 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd80c0c90 con 0x7f3bd80c1120 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4288533248 0 0) 0x7f3bb8003450 con 0x7f3bd80c42b0 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd6000640 1 -- 172.21.15.32:0/1820424031 >> v1:172.21.15.67:6789/0 conn(0x7f3bd80c1120 legacy=0x7f3bd815b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd6000640 1 -- 172.21.15.32:0/1820424031 >> v1:172.21.15.32:6789/0 conn(0x7f3bd80c42b0 legacy=0x7f3bd806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.941+0000 7f3bd6000640 1 -- 172.21.15.32:0/1820424031 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80c0640 con 0x7f3bd80c5740 2024-01-19T04:16:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bd6000640 1 --2- 172.21.15.32:0/1820424031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c5740 0x7f3bd80c4690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00097f0 tx=0x7f3bc001cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a24356fbdcfc8ad4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8001680 con 0x7f3bd80c5740 2024-01-19T04:16:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00a7050 con 0x7f3bd80c5740 2024-01-19T04:16:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bd5600640 1 -- 172.21.15.32:0/1820424031 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00ab620 con 0x7f3bd80c5740 2024-01-19T04:16:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bdda00640 1 -- 172.21.15.32:0/1820424031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c5740 msgr2=0x7f3bd80c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1820424031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c5740 0x7f3bd80c4690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00097f0 tx=0x7f3bc001cd80 comp rx=0 tx=0).stop 2024-01-19T04:16:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bdda00640 1 -- 172.21.15.32:0/1820424031 shutdown_connections 2024-01-19T04:16:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1820424031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c5740 0x7f3bd80c4690 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bdda00640 1 -- 172.21.15.32:0/1820424031 >> 172.21.15.32:0/1820424031 conn(0x7f3bd80c5b20 msgr2=0x7f3bd80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bdda00640 1 -- 172.21.15.32:0/1820424031 shutdown_connections 2024-01-19T04:16:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.945+0000 7f3bdda00640 1 -- 172.21.15.32:0/1820424031 wait complete. 2024-01-19T04:16:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 Processor -- start 2024-01-19T04:16:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 -- start start 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c1120 0x7f3bd814df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd80c42b0 0x7f3bd80a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80c5740 0x7f3bd80a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80a93d0 con 0x7f3bd80c42b0 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80ab0d0 con 0x7f3bd80c5740 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80aab10 con 0x7f3bd80c1120 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd80c42b0 0x7f3bd80a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd80c42b0 0x7f3bd80a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46482/0 (socket says 172.21.15.32:46482) 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 -- 172.21.15.32:0/1974145076 learned_addr learned my addr 172.21.15.32:0/1974145076 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd7400640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80c5740 0x7f3bd80a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6a00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c1120 0x7f3bd814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 -- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c1120 msgr2=0x7f3bd814df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c1120 0x7f3bd814df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 -- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80c5740 msgr2=0x7f3bd80a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80c5740 0x7f3bd80a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 -- 172.21.15.32:0/1974145076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0009420 con 0x7f3bd80c42b0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd7400640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80c5740 0x7f3bd80a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bd6000640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd80c42b0 0x7f3bd80a9860 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009740 tx=0x7f3bc001ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bcea00640 1 -- 172.21.15.32:0/1974145076 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00abcf0 con 0x7f3bd80c42b0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bcea00640 1 -- 172.21.15.32:0/1974145076 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00abe50 con 0x7f3bd80c42b0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bcea00640 1 -- 172.21.15.32:0/1974145076 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0004220 con 0x7f3bd80c42b0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd80aadf0 con 0x7f3bd80c42b0 2024-01-19T04:16:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.949+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd8148d00 con 0x7f3bd80c42b0 2024-01-19T04:16:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.953+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd80c4eb0 con 0x7f3bd80c42b0 2024-01-19T04:16:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.953+0000 7f3bcea00640 1 -- 172.21.15.32:0/1974145076 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3bc0004380 con 0x7f3bd80c42b0 2024-01-19T04:16:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.953+0000 7f3bcea00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bb0066500 0x7f3bb00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.953+0000 7f3bcea00640 1 -- 172.21.15.32:0/1974145076 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bc011e450 con 0x7f3bd80c42b0 2024-01-19T04:16:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.953+0000 7f3bd6a00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bb0066500 0x7f3bb00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:55.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.953+0000 7f3bd6a00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bb0066500 0x7f3bb00689c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80011f0 tx=0x7f3bc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:55.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:55.957+0000 7f3bcea00640 1 -- 172.21.15.32:0/1974145076 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3bc00eb8a0 con 0x7f3bd80c42b0 2024-01-19T04:16:56.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.113+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bd80a51f0 con 0x7f3bb0066500 2024-01-19T04:16:56.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.121+0000 7f3bcea00640 1 -- 172.21.15.32:0/1974145076 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289080 (secure 0 0 0) 0x7f3bc8001c70 con 0x7f3bb0066500 2024-01-19T04:16:56.126 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:56.128 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:16:56.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bb0066500 msgr2=0x7f3bb00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bb0066500 0x7f3bb00689c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80011f0 tx=0x7f3bc8009040 comp rx=0 tx=0).stop 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd80c42b0 msgr2=0x7f3bd80a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd80c42b0 0x7f3bd80a9860 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009740 tx=0x7f3bc001ab60 comp rx=0 tx=0).stop 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 shutdown_connections 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bb0066500 0x7f3bb00689c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bd80c5740 0x7f3bd80a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd80c42b0 0x7f3bd80a9860 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 --2- 172.21.15.32:0/1974145076 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bd80c1120 0x7f3bd814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 >> 172.21.15.32:0/1974145076 conn(0x7f3bd80c5b20 msgr2=0x7f3bd80c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 shutdown_connections 2024-01-19T04:16:56.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.125+0000 7f3bdda00640 1 -- 172.21.15.32:0/1974145076 wait complete. 2024-01-19T04:16:56.147 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-01-19T04:16:56.055564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238920,"kb_used_data":6076,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735800,"statfs":{"total":773094113280,"available":772849459200,"internally_reserved":0,"allocated":6221824,"data_stored":3265064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001343"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.991811+0000","last_change":"2024-01-19T04:16:51.581477+0000","last_active":"2024-01-19T04:16:52.991811+0000","last_peered":"2024-01-19T04:16:52.991811+0000","last_clean":"2024-01-19T04:16:52.991811+0000","last_became_active":"2024-01-19T04:16:51.580890+0000","last_became_peered":"2024-01-19T04:16:51.580890+0000","last_unstale":"2024-01-19T04:16:52.991811+0000","last_undegraded":"2024-01-19T04:16:52.991811+0000","last_fullsized":"2024-01-19T04:16:52.991811+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.849907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.584861+0000","last_change":"2024-01-19T04:16:51.580129+0000","last_active":"2024-01-19T04:16:51.584861+0000","last_peered":"2024-01-19T04:16:51.584861+0000","last_clean":"2024-01-19T04:16:51.584861+0000","last_became_active":"2024-01-19T04:16:51.579840+0000","last_became_peered":"2024-01-19T04:16:51.579840+0000","last_unstale":"2024-01-19T04:16:51.584861+0000","last_undegraded":"2024-01-19T04:16:51.584861+0000","last_fullsized":"2024-01-19T04:16:51.584861+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:09:45.186341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256930+0000","last_change":"2024-01-19T04:16:51.574027+0000","last_active":"2024-01-19T04:16:53.256930+0000","last_peered":"2024-01-19T04:16:53.256930+0000","last_clean":"2024-01-19T04:16:53.256930+0000","last_became_active":"2024-01-19T04:16:51.573756+0000","last_became_peered":"2024-01-19T04:16:51.573756+0000","last_unstale":"2024-01-19T04:16:53.256930+0000","last_undegraded":"2024-01-19T04:16:53.256930+0000","last_fullsized":"2024-01-19T04:16:53.256930+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570254+0000","last_change":"2024-01-19T04:16:51.563134+0000","last_active":"2024-01-19T04:16:52.570254+0000","last_peered":"2024-01-19T04:16:52.570254+0000","last_clean":"2024-01-19T04:16:52.570254+0000","last_became_active":"2024-01-19T04:16:51.562243+0000","last_became_peered":"2024-01-19T04:16:51.562243+0000","last_unstale":"2024-01-19T04:16:52.570254+0000","last_undegraded":"2024-01-19T04:16:52.570254+0000","last_fullsized":"2024-01-19T04:16:52.570254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.991629+0000","last_change":"2024-01-19T04:16:51.568590+0000","last_active":"2024-01-19T04:16:52.991629+0000","last_peered":"2024-01-19T04:16:52.991629+0000","last_clean":"2024-01-19T04:16:52.991629+0000","last_became_active":"2024-01-19T04:16:51.567062+0000","last_became_peered":"2024-01-19T04:16:51.567062+0000","last_unstale":"2024-01-19T04:16:52.991629+0000","last_undegraded":"2024-01-19T04:16:52.991629+0000","last_fullsized":"2024-01-19T04:16:52.991629+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:05.611512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.255823+0000","last_change":"2024-01-19T04:16:51.567447+0000","last_active":"2024-01-19T04:16:53.255823+0000","last_peered":"2024-01-19T04:16:53.255823+0000","last_clean":"2024-01-19T04:16:53.255823+0000","last_became_active":"2024-01-19T04:16:51.567187+0000","last_became_peered":"2024-01-19T04:16:51.567187+0000","last_unstale":"2024-01-19T04:16:53.255823+0000","last_undegraded":"2024-01-19T04:16:53.255823+0000","last_fullsized":"2024-01-19T04:16:53.255823+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.711898+0000","last_change":"2024-01-19T04:16:51.568350+0000","last_active":"2024-01-19T04:16:52.711898+0000","last_peered":"2024-01-19T04:16:52.711898+0000","last_clean":"2024-01-19T04:16:52.711898+0000","last_became_active":"2024-01-19T04:16:51.568051+0000","last_became_peered":"2024-01-19T04:16:51.568051+0000","last_unstale":"2024-01-19T04:16:52.711898+0000","last_undegraded":"2024-01-19T04:16:52.711898+0000","last_fullsized":"2024-01-19T04:16:52.711898+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:31.896945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.584283+0000","last_change":"2024-01-19T04:16:51.572672+0000","last_active":"2024-01-19T04:16:51.584283+0000","last_peered":"2024-01-19T04:16:51.584283+0000","last_clean":"2024-01-19T04:16:51.584283+0000","last_became_active":"2024-01-19T04:16:51.572209+0000","last_became_peered":"2024-01-19T04:16:51.572209+0000","last_unstale":"2024-01-19T04:16:51.584283+0000","last_undegraded":"2024-01-19T04:16:51.584283+0000","last_fullsized":"2024-01-19T04:16:51.584283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:35:30.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.712313+0000","last_change":"2024-01-19T04:16:51.569401+0000","last_active":"2024-01-19T04:16:52.712313+0000","last_peered":"2024-01-19T04:16:52.712313+0000","last_clean":"2024-01-19T04:16:52.712313+0000","last_became_active":"2024-01-19T04:16:51.569130+0000","last_became_peered":"2024-01-19T04:16:51.569130+0000","last_unstale":"2024-01-19T04:16:52.712313+0000","last_undegraded":"2024-01-19T04:16:52.712313+0000","last_fullsized":"2024-01-19T04:16:52.712313+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:46.968261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.569311+0000","last_change":"2024-01-19T04:16:51.583971+0000","last_active":"2024-01-19T04:16:52.569311+0000","last_peered":"2024-01-19T04:16:52.569311+0000","last_clean":"2024-01-19T04:16:52.569311+0000","last_became_active":"2024-01-19T04:16:51.583688+0000","last_became_peered":"2024-01-19T04:16:51.583688+0000","last_unstale":"2024-01-19T04:16:52.569311+0000","last_undegraded":"2024-01-19T04:16:52.569311+0000","last_fullsized":"2024-01-19T04:16:52.569311+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:51.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.569331+0000","last_change":"2024-01-19T04:16:51.581824+0000","last_active":"2024-01-19T04:16:52.569331+0000","last_peered":"2024-01-19T04:16:52.569331+0000","last_clean":"2024-01-19T04:16:52.569331+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:16:52.569331+0000","last_undegraded":"2024-01-19T04:16:52.569331+0000","last_fullsized":"2024-01-19T04:16:52.569331+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:26.385285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570424+0000","last_change":"2024-01-19T04:16:51.575108+0000","last_active":"2024-01-19T04:16:52.570424+0000","last_peered":"2024-01-19T04:16:52.570424+0000","last_clean":"2024-01-19T04:16:52.570424+0000","last_became_active":"2024-01-19T04:16:51.574596+0000","last_became_peered":"2024-01-19T04:16:51.574596+0000","last_unstale":"2024-01-19T04:16:52.570424+0000","last_undegraded":"2024-01-19T04:16:52.570424+0000","last_fullsized":"2024-01-19T04:16:52.570424+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256231+0000","last_change":"2024-01-19T04:16:51.579903+0000","last_active":"2024-01-19T04:16:53.256231+0000","last_peered":"2024-01-19T04:16:53.256231+0000","last_clean":"2024-01-19T04:16:53.256231+0000","last_became_active":"2024-01-19T04:16:51.579415+0000","last_became_peered":"2024-01-19T04:16:51.579415+0000","last_unstale":"2024-01-19T04:16:53.256231+0000","last_undegraded":"2024-01-19T04:16:53.256231+0000","last_fullsized":"2024-01-19T04:16:53.256231+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:31.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.712040+0000","last_change":"2024-01-19T04:16:51.568949+0000","last_active":"2024-01-19T04:16:52.712040+0000","last_peered":"2024-01-19T04:16:52.712040+0000","last_clean":"2024-01-19T04:16:52.712040+0000","last_became_active":"2024-01-19T04:16:51.568682+0000","last_became_peered":"2024-01-19T04:16:51.568682+0000","last_unstale":"2024-01-19T04:16:52.712040+0000","last_undegraded":"2024-01-19T04:16:52.712040+0000","last_fullsized":"2024-01-19T04:16:52.712040+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:23.038136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.711972+0000","last_change":"2024-01-19T04:16:51.588950+0000","last_active":"2024-01-19T04:16:52.711972+0000","last_peered":"2024-01-19T04:16:52.711972+0000","last_clean":"2024-01-19T04:16:52.711972+0000","last_became_active":"2024-01-19T04:16:51.577721+0000","last_became_peered":"2024-01-19T04:16:51.577721+0000","last_unstale":"2024-01-19T04:16:52.711972+0000","last_undegraded":"2024-01-19T04:16:52.711972+0000","last_fullsized":"2024-01-19T04:16:52.711972+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:30.735073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.255775+0000","last_change":"2024-01-19T04:16:51.581861+0000","last_active":"2024-01-19T04:16:53.255775+0000","last_peered":"2024-01-19T04:16:53.255775+0000","last_clean":"2024-01-19T04:16:53.255775+0000","last_became_active":"2024-01-19T04:16:51.581465+0000","last_became_peered":"2024-01-19T04:16:51.581465+0000","last_unstale":"2024-01-19T04:16:53.255775+0000","last_undegraded":"2024-01-19T04:16:53.255775+0000","last_fullsized":"2024-01-19T04:16:53.255775+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.591161+0000","last_change":"2024-01-19T04:16:51.589385+0000","last_active":"2024-01-19T04:16:51.591161+0000","last_peered":"2024-01-19T04:16:51.591161+0000","last_clean":"2024-01-19T04:16:51.591161+0000","last_became_active":"2024-01-19T04:16:51.586748+0000","last_became_peered":"2024-01-19T04:16:51.586748+0000","last_unstale":"2024-01-19T04:16:51.591161+0000","last_undegraded":"2024-01-19T04:16:51.591161+0000","last_fullsized":"2024-01-19T04:16:51.591161+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:17:29.735345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256975+0000","last_change":"2024-01-19T04:16:51.576164+0000","last_active":"2024-01-19T04:16:53.256975+0000","last_peered":"2024-01-19T04:16:53.256975+0000","last_clean":"2024-01-19T04:16:53.256975+0000","last_became_active":"2024-01-19T04:16:51.575615+0000","last_became_peered":"2024-01-19T04:16:51.575615+0000","last_unstale":"2024-01-19T04:16:53.256975+0000","last_undegraded":"2024-01-19T04:16:53.256975+0000","last_fullsized":"2024-01-19T04:16:53.256975+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.991700+0000","last_change":"2024-01-19T04:16:51.587440+0000","last_active":"2024-01-19T04:16:52.991700+0000","last_peered":"2024-01-19T04:16:52.991700+0000","last_clean":"2024-01-19T04:16:52.991700+0000","last_became_active":"2024-01-19T04:16:51.584713+0000","last_became_peered":"2024-01-19T04:16:51.584713+0000","last_unstale":"2024-01-19T04:16:52.991700+0000","last_undegraded":"2024-01-19T04:16:52.991700+0000","last_fullsized":"2024-01-19T04:16:52.991700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:19.082622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.588280+0000","last_change":"2024-01-19T04:16:51.584822+0000","last_active":"2024-01-19T04:16:51.588280+0000","last_peered":"2024-01-19T04:16:51.588280+0000","last_clean":"2024-01-19T04:16:51.588280+0000","last_became_active":"2024-01-19T04:16:51.584562+0000","last_became_peered":"2024-01-19T04:16:51.584562+0000","last_unstale":"2024-01-19T04:16:51.588280+0000","last_undegraded":"2024-01-19T04:16:51.588280+0000","last_fullsized":"2024-01-19T04:16:51.588280+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:22:00.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256637+0000","last_change":"2024-01-19T04:16:51.577212+0000","last_active":"2024-01-19T04:16:53.256637+0000","last_peered":"2024-01-19T04:16:53.256637+0000","last_clean":"2024-01-19T04:16:53.256637+0000","last_became_active":"2024-01-19T04:16:51.576909+0000","last_became_peered":"2024-01-19T04:16:51.576909+0000","last_unstale":"2024-01-19T04:16:53.256637+0000","last_undegraded":"2024-01-19T04:16:53.256637+0000","last_fullsized":"2024-01-19T04:16:53.256637+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.581242+0000","last_change":"2024-01-19T04:16:51.576501+0000","last_active":"2024-01-19T04:16:51.581242+0000","last_peered":"2024-01-19T04:16:51.581242+0000","last_clean":"2024-01-19T04:16:51.581242+0000","last_became_active":"2024-01-19T04:16:51.570654+0000","last_became_peered":"2024-01-19T04:16:51.570654+0000","last_unstale":"2024-01-19T04:16:51.581242+0000","last_undegraded":"2024-01-19T04:16:51.581242+0000","last_fullsized":"2024-01-19T04:16:51.581242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:35:27.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256586+0000","last_change":"2024-01-19T04:16:51.581241+0000","last_active":"2024-01-19T04:16:53.256586+0000","last_peered":"2024-01-19T04:16:53.256586+0000","last_clean":"2024-01-19T04:16:53.256586+0000","last_became_active":"2024-01-19T04:16:51.580556+0000","last_became_peered":"2024-01-19T04:16:51.580556+0000","last_unstale":"2024-01-19T04:16:53.256586+0000","last_undegraded":"2024-01-19T04:16:53.256586+0000","last_fullsized":"2024-01-19T04:16:53.256586+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:08.881391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256112+0000","last_change":"2024-01-19T04:16:51.579937+0000","last_active":"2024-01-19T04:16:53.256112+0000","last_peered":"2024-01-19T04:16:53.256112+0000","last_clean":"2024-01-19T04:16:53.256112+0000","last_became_active":"2024-01-19T04:16:51.579649+0000","last_became_peered":"2024-01-19T04:16:51.579649+0000","last_unstale":"2024-01-19T04:16:53.256112+0000","last_undegraded":"2024-01-19T04:16:53.256112+0000","last_fullsized":"2024-01-19T04:16:53.256112+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:34.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.991886+0000","last_change":"2024-01-19T04:16:51.578912+0000","last_active":"2024-01-19T04:16:52.991886+0000","last_peered":"2024-01-19T04:16:52.991886+0000","last_clean":"2024-01-19T04:16:52.991886+0000","last_became_active":"2024-01-19T04:16:51.578643+0000","last_became_peered":"2024-01-19T04:16:51.578643+0000","last_unstale":"2024-01-19T04:16:52.991886+0000","last_undegraded":"2024-01-19T04:16:52.991886+0000","last_fullsized":"2024-01-19T04:16:52.991886+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:23.111411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570254+0000","last_change":"2024-01-19T04:16:51.573193+0000","last_active":"2024-01-19T04:16:52.570254+0000","last_peered":"2024-01-19T04:16:52.570254+0000","last_clean":"2024-01-19T04:16:52.570254+0000","last_became_active":"2024-01-19T04:16:51.572674+0000","last_became_peered":"2024-01-19T04:16:51.572674+0000","last_unstale":"2024-01-19T04:16:52.570254+0000","last_undegraded":"2024-01-19T04:16:52.570254+0000","last_fullsized":"2024-01-19T04:16:52.570254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256409+0000","last_change":"2024-01-19T04:16:51.586794+0000","last_active":"2024-01-19T04:16:53.256409+0000","last_peered":"2024-01-19T04:16:53.256409+0000","last_clean":"2024-01-19T04:16:53.256409+0000","last_became_active":"2024-01-19T04:16:51.582729+0000","last_became_peered":"2024-01-19T04:16:51.582729+0000","last_unstale":"2024-01-19T04:16:53.256409+0000","last_undegraded":"2024-01-19T04:16:53.256409+0000","last_fullsized":"2024-01-19T04:16:53.256409+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.991709+0000","last_change":"2024-01-19T04:16:51.568656+0000","last_active":"2024-01-19T04:16:52.991709+0000","last_peered":"2024-01-19T04:16:52.991709+0000","last_clean":"2024-01-19T04:16:52.991709+0000","last_became_active":"2024-01-19T04:16:51.568371+0000","last_became_peered":"2024-01-19T04:16:51.568371+0000","last_unstale":"2024-01-19T04:16:52.991709+0000","last_undegraded":"2024-01-19T04:16:52.991709+0000","last_fullsized":"2024-01-19T04:16:52.991709+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:42.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.585066+0000","last_change":"2024-01-19T04:16:51.583324+0000","last_active":"2024-01-19T04:16:51.585066+0000","last_peered":"2024-01-19T04:16:51.585066+0000","last_clean":"2024-01-19T04:16:51.585066+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:16:51.585066+0000","last_undegraded":"2024-01-19T04:16:51.585066+0000","last_fullsized":"2024-01-19T04:16:51.585066+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:54:37.629314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256653+0000","last_change":"2024-01-19T04:16:51.577511+0000","last_active":"2024-01-19T04:16:53.256653+0000","last_peered":"2024-01-19T04:16:53.256653+0000","last_clean":"2024-01-19T04:16:53.256653+0000","last_became_active":"2024-01-19T04:16:51.577076+0000","last_became_peered":"2024-01-19T04:16:51.577076+0000","last_unstale":"2024-01-19T04:16:53.256653+0000","last_undegraded":"2024-01-19T04:16:53.256653+0000","last_fullsized":"2024-01-19T04:16:53.256653+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.991494+0000","last_change":"2024-01-19T04:16:51.578248+0000","last_active":"2024-01-19T04:16:52.991494+0000","last_peered":"2024-01-19T04:16:52.991494+0000","last_clean":"2024-01-19T04:16:52.991494+0000","last_became_active":"2024-01-19T04:16:51.577983+0000","last_became_peered":"2024-01-19T04:16:51.577983+0000","last_unstale":"2024-01-19T04:16:52.991494+0000","last_undegraded":"2024-01-19T04:16:52.991494+0000","last_fullsized":"2024-01-19T04:16:52.991494+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:14.895654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.255916+0000","last_change":"2024-01-19T04:16:51.586614+0000","last_active":"2024-01-19T04:16:53.255916+0000","last_peered":"2024-01-19T04:16:53.255916+0000","last_clean":"2024-01-19T04:16:53.255916+0000","last_became_active":"2024-01-19T04:16:51.586104+0000","last_became_peered":"2024-01-19T04:16:51.586104+0000","last_unstale":"2024-01-19T04:16:53.255916+0000","last_undegraded":"2024-01-19T04:16:53.255916+0000","last_fullsized":"2024-01-19T04:16:53.255916+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.257200+0000","last_change":"2024-01-19T04:16:51.575044+0000","last_active":"2024-01-19T04:16:53.257200+0000","last_peered":"2024-01-19T04:16:53.257200+0000","last_clean":"2024-01-19T04:16:53.257200+0000","last_became_active":"2024-01-19T04:16:51.574674+0000","last_became_peered":"2024-01-19T04:16:51.574674+0000","last_unstale":"2024-01-19T04:16:53.257200+0000","last_undegraded":"2024-01-19T04:16:53.257200+0000","last_fullsized":"2024-01-19T04:16:53.257200+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256868+0000","last_change":"2024-01-19T04:16:50.572149+0000","last_active":"2024-01-19T04:16:53.256868+0000","last_peered":"2024-01-19T04:16:53.256868+0000","last_clean":"2024-01-19T04:16:53.256868+0000","last_became_active":"2024-01-19T04:16:50.571648+0000","last_became_peered":"2024-01-19T04:16:50.571648+0000","last_unstale":"2024-01-19T04:16:53.256868+0000","last_undegraded":"2024-01-19T04:16:53.256868+0000","last_fullsized":"2024-01-19T04:16:53.256868+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.569444+0000","last_change":"2024-01-19T04:16:51.590705+0000","last_active":"2024-01-19T04:16:52.569444+0000","last_peered":"2024-01-19T04:16:52.569444+0000","last_clean":"2024-01-19T04:16:52.569444+0000","last_became_active":"2024-01-19T04:16:51.590304+0000","last_became_peered":"2024-01-19T04:16:51.590304+0000","last_unstale":"2024-01-19T04:16:52.569444+0000","last_undegraded":"2024-01-19T04:16:52.569444+0000","last_fullsized":"2024-01-19T04:16:52.569444+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:51.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.579586+0000","last_change":"2024-01-19T04:16:50.567145+0000","last_active":"2024-01-19T04:16:51.579586+0000","last_peered":"2024-01-19T04:16:51.579586+0000","last_clean":"2024-01-19T04:16:51.579586+0000","last_became_active":"2024-01-19T04:16:50.566844+0000","last_became_peered":"2024-01-19T04:16:50.566844+0000","last_unstale":"2024-01-19T04:16:51.579586+0000","last_undegraded":"2024-01-19T04:16:51.579586+0000","last_fullsized":"2024-01-19T04:16:51.579586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:07.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256248+0000","last_change":"2024-01-19T04:16:51.573140+0000","last_active":"2024-01-19T04:16:53.256248+0000","last_peered":"2024-01-19T04:16:53.256248+0000","last_clean":"2024-01-19T04:16:53.256248+0000","last_became_active":"2024-01-19T04:16:51.572831+0000","last_became_peered":"2024-01-19T04:16:51.572831+0000","last_unstale":"2024-01-19T04:16:53.256248+0000","last_undegraded":"2024-01-19T04:16:53.256248+0000","last_fullsized":"2024-01-19T04:16:53.256248+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256569+0000","last_change":"2024-01-19T04:16:50.563884+0000","last_active":"2024-01-19T04:16:53.256569+0000","last_peered":"2024-01-19T04:16:53.256569+0000","last_clean":"2024-01-19T04:16:53.256569+0000","last_became_active":"2024-01-19T04:16:50.563631+0000","last_became_peered":"2024-01-19T04:16:50.563631+0000","last_unstale":"2024-01-19T04:16:53.256569+0000","last_undegraded":"2024-01-19T04:16:53.256569+0000","last_fullsized":"2024-01-19T04:16:53.256569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256299+0000","last_change":"2024-01-19T04:16:51.574394+0000","last_active":"2024-01-19T04:16:53.256299+0000","last_peered":"2024-01-19T04:16:53.256299+0000","last_clean":"2024-01-19T04:16:53.256299+0000","last_became_active":"2024-01-19T04:16:51.573866+0000","last_became_peered":"2024-01-19T04:16:51.573866+0000","last_unstale":"2024-01-19T04:16:53.256299+0000","last_undegraded":"2024-01-19T04:16:53.256299+0000","last_fullsized":"2024-01-19T04:16:53.256299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.579408+0000","last_change":"2024-01-19T04:16:50.571503+0000","last_active":"2024-01-19T04:16:51.579408+0000","last_peered":"2024-01-19T04:16:51.579408+0000","last_clean":"2024-01-19T04:16:51.579408+0000","last_became_active":"2024-01-19T04:16:50.571066+0000","last_became_peered":"2024-01-19T04:16:50.571066+0000","last_unstale":"2024-01-19T04:16:51.579408+0000","last_undegraded":"2024-01-19T04:16:51.579408+0000","last_fullsized":"2024-01-19T04:16:51.579408+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.581220+0000","last_change":"2024-01-19T04:16:51.573659+0000","last_active":"2024-01-19T04:16:51.581220+0000","last_peered":"2024-01-19T04:16:51.581220+0000","last_clean":"2024-01-19T04:16:51.581220+0000","last_became_active":"2024-01-19T04:16:51.570362+0000","last_became_peered":"2024-01-19T04:16:51.570362+0000","last_unstale":"2024-01-19T04:16:51.581220+0000","last_undegraded":"2024-01-19T04:16:51.581220+0000","last_fullsized":"2024-01-19T04:16:51.581220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:32:09.906437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.592523+0000","last_change":"2024-01-19T04:16:50.562830+0000","last_active":"2024-01-19T04:16:51.592523+0000","last_peered":"2024-01-19T04:16:51.592523+0000","last_clean":"2024-01-19T04:16:51.592523+0000","last_became_active":"2024-01-19T04:16:50.562528+0000","last_became_peered":"2024-01-19T04:16:50.562528+0000","last_unstale":"2024-01-19T04:16:51.592523+0000","last_undegraded":"2024-01-19T04:16:51.592523+0000","last_fullsized":"2024-01-19T04:16:51.592523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:03.641474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.585004+0000","last_change":"2024-01-19T04:16:51.582274+0000","last_active":"2024-01-19T04:16:51.585004+0000","last_peered":"2024-01-19T04:16:51.585004+0000","last_clean":"2024-01-19T04:16:51.585004+0000","last_became_active":"2024-01-19T04:16:51.581164+0000","last_became_peered":"2024-01-19T04:16:51.581164+0000","last_unstale":"2024-01-19T04:16:51.585004+0000","last_undegraded":"2024-01-19T04:16:51.585004+0000","last_fullsized":"2024-01-19T04:16:51.585004+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:41:00.709588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.255986+0000","last_change":"2024-01-19T04:16:50.566550+0000","last_active":"2024-01-19T04:16:53.255986+0000","last_peered":"2024-01-19T04:16:53.255986+0000","last_clean":"2024-01-19T04:16:53.255986+0000","last_became_active":"2024-01-19T04:16:50.566278+0000","last_became_peered":"2024-01-19T04:16:50.566278+0000","last_unstale":"2024-01-19T04:16:53.255986+0000","last_undegraded":"2024-01-19T04:16:53.255986+0000","last_fullsized":"2024-01-19T04:16:53.255986+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256272+0000","last_change":"2024-01-19T04:16:51.579590+0000","last_active":"2024-01-19T04:16:53.256272+0000","last_peered":"2024-01-19T04:16:53.256272+0000","last_clean":"2024-01-19T04:16:53.256272+0000","last_became_active":"2024-01-19T04:16:51.579242+0000","last_became_peered":"2024-01-19T04:16:51.579242+0000","last_unstale":"2024-01-19T04:16:53.256272+0000","last_undegraded":"2024-01-19T04:16:53.256272+0000","last_fullsized":"2024-01-19T04:16:53.256272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:09.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.555545+0000","last_change":"2024-01-19T04:16:50.568633+0000","last_active":"2024-01-19T04:16:51.555545+0000","last_peered":"2024-01-19T04:16:51.555545+0000","last_clean":"2024-01-19T04:16:51.555545+0000","last_became_active":"2024-01-19T04:16:50.568334+0000","last_became_peered":"2024-01-19T04:16:50.568334+0000","last_unstale":"2024-01-19T04:16:51.555545+0000","last_undegraded":"2024-01-19T04:16:51.555545+0000","last_fullsized":"2024-01-19T04:16:51.555545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.588819+0000","last_change":"2024-01-19T04:16:51.585817+0000","last_active":"2024-01-19T04:16:51.588819+0000","last_peered":"2024-01-19T04:16:51.588819+0000","last_clean":"2024-01-19T04:16:51.588819+0000","last_became_active":"2024-01-19T04:16:51.585142+0000","last_became_peered":"2024-01-19T04:16:51.585142+0000","last_unstale":"2024-01-19T04:16:51.588819+0000","last_undegraded":"2024-01-19T04:16:51.588819+0000","last_fullsized":"2024-01-19T04:16:51.588819+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:09.550045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.560615+0000","last_change":"2024-01-19T04:16:50.569683+0000","last_active":"2024-01-19T04:16:51.560615+0000","last_peered":"2024-01-19T04:16:51.560615+0000","last_clean":"2024-01-19T04:16:51.560615+0000","last_became_active":"2024-01-19T04:16:50.567925+0000","last_became_peered":"2024-01-19T04:16:50.567925+0000","last_unstale":"2024-01-19T04:16:51.560615+0000","last_undegraded":"2024-01-19T04:16:51.560615+0000","last_fullsized":"2024-01-19T04:16:51.560615+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:25.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.712343+0000","last_change":"2024-01-19T04:16:51.587058+0000","last_active":"2024-01-19T04:16:52.712343+0000","last_peered":"2024-01-19T04:16:52.712343+0000","last_clean":"2024-01-19T04:16:52.712343+0000","last_became_active":"2024-01-19T04:16:51.577162+0000","last_became_peered":"2024-01-19T04:16:51.577162+0000","last_unstale":"2024-01-19T04:16:52.712343+0000","last_undegraded":"2024-01-19T04:16:52.712343+0000","last_fullsized":"2024-01-19T04:16:52.712343+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:59.277518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.570630+0000","last_change":"2024-01-19T04:16:50.568525+0000","last_active":"2024-01-19T04:16:51.570630+0000","last_peered":"2024-01-19T04:16:51.570630+0000","last_clean":"2024-01-19T04:16:51.570630+0000","last_became_active":"2024-01-19T04:16:50.568256+0000","last_became_peered":"2024-01-19T04:16:50.568256+0000","last_unstale":"2024-01-19T04:16:51.570630+0000","last_undegraded":"2024-01-19T04:16:51.570630+0000","last_fullsized":"2024-01-19T04:16:51.570630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.257156+0000","last_change":"2024-01-19T04:16:51.583117+0000","last_active":"2024-01-19T04:16:53.257156+0000","last_peered":"2024-01-19T04:16:53.257156+0000","last_clean":"2024-01-19T04:16:53.257156+0000","last_became_active":"2024-01-19T04:16:51.582850+0000","last_became_peered":"2024-01-19T04:16:51.582850+0000","last_unstale":"2024-01-19T04:16:53.257156+0000","last_undegraded":"2024-01-19T04:16:53.257156+0000","last_fullsized":"2024-01-19T04:16:53.257156+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:19.273356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.559803+0000","last_change":"2024-01-19T04:16:50.568671+0000","last_active":"2024-01-19T04:16:51.559803+0000","last_peered":"2024-01-19T04:16:51.559803+0000","last_clean":"2024-01-19T04:16:51.559803+0000","last_became_active":"2024-01-19T04:16:50.568385+0000","last_became_peered":"2024-01-19T04:16:50.568385+0000","last_unstale":"2024-01-19T04:16:51.559803+0000","last_undegraded":"2024-01-19T04:16:51.559803+0000","last_fullsized":"2024-01-19T04:16:51.559803+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:51.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.569146+0000","last_change":"2024-01-19T04:16:51.580811+0000","last_active":"2024-01-19T04:16:52.569146+0000","last_peered":"2024-01-19T04:16:52.569146+0000","last_clean":"2024-01-19T04:16:52.569146+0000","last_became_active":"2024-01-19T04:16:51.579990+0000","last_became_peered":"2024-01-19T04:16:51.579990+0000","last_unstale":"2024-01-19T04:16:52.569146+0000","last_undegraded":"2024-01-19T04:16:52.569146+0000","last_fullsized":"2024-01-19T04:16:52.569146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:43:24.773146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.593775+0000","last_change":"2024-01-19T04:16:50.569777+0000","last_active":"2024-01-19T04:16:51.593775+0000","last_peered":"2024-01-19T04:16:51.593775+0000","last_clean":"2024-01-19T04:16:51.593775+0000","last_became_active":"2024-01-19T04:16:50.569507+0000","last_became_peered":"2024-01-19T04:16:50.569507+0000","last_unstale":"2024-01-19T04:16:51.593775+0000","last_undegraded":"2024-01-19T04:16:51.593775+0000","last_fullsized":"2024-01-19T04:16:51.593775+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.257064+0000","last_change":"2024-01-19T04:16:51.582425+0000","last_active":"2024-01-19T04:16:53.257064+0000","last_peered":"2024-01-19T04:16:53.257064+0000","last_clean":"2024-01-19T04:16:53.257064+0000","last_became_active":"2024-01-19T04:16:51.582136+0000","last_became_peered":"2024-01-19T04:16:51.582136+0000","last_unstale":"2024-01-19T04:16:53.257064+0000","last_undegraded":"2024-01-19T04:16:53.257064+0000","last_fullsized":"2024-01-19T04:16:53.257064+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.597561+0000","last_change":"2024-01-19T04:16:50.563850+0000","last_active":"2024-01-19T04:16:51.597561+0000","last_peered":"2024-01-19T04:16:51.597561+0000","last_clean":"2024-01-19T04:16:51.597561+0000","last_became_active":"2024-01-19T04:16:50.563492+0000","last_became_peered":"2024-01-19T04:16:50.563492+0000","last_unstale":"2024-01-19T04:16:51.597561+0000","last_undegraded":"2024-01-19T04:16:51.597561+0000","last_fullsized":"2024-01-19T04:16:51.597561+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:50.446354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570553+0000","last_change":"2024-01-19T04:16:51.579099+0000","last_active":"2024-01-19T04:16:52.570553+0000","last_peered":"2024-01-19T04:16:52.570553+0000","last_clean":"2024-01-19T04:16:52.570553+0000","last_became_active":"2024-01-19T04:16:51.578809+0000","last_became_peered":"2024-01-19T04:16:51.578809+0000","last_unstale":"2024-01-19T04:16:52.570553+0000","last_undegraded":"2024-01-19T04:16:52.570553+0000","last_fullsized":"2024-01-19T04:16:52.570553+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.582093+0000","last_change":"2024-01-19T04:16:50.565530+0000","last_active":"2024-01-19T04:16:51.582093+0000","last_peered":"2024-01-19T04:16:51.582093+0000","last_clean":"2024-01-19T04:16:51.582093+0000","last_became_active":"2024-01-19T04:16:50.565191+0000","last_became_peered":"2024-01-19T04:16:50.565191+0000","last_unstale":"2024-01-19T04:16:51.582093+0000","last_undegraded":"2024-01-19T04:16:51.582093+0000","last_fullsized":"2024-01-19T04:16:51.582093+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:14.286352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256612+0000","last_change":"2024-01-19T04:16:51.587155+0000","last_active":"2024-01-19T04:16:53.256612+0000","last_peered":"2024-01-19T04:16:53.256612+0000","last_clean":"2024-01-19T04:16:53.256612+0000","last_became_active":"2024-01-19T04:16:51.584989+0000","last_became_peered":"2024-01-19T04:16:51.584989+0000","last_unstale":"2024-01-19T04:16:53.256612+0000","last_undegraded":"2024-01-19T04:16:53.256612+0000","last_fullsized":"2024-01-19T04:16:53.256612+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.569503+0000","last_change":"2024-01-19T04:16:50.566824+0000","last_active":"2024-01-19T04:16:51.569503+0000","last_peered":"2024-01-19T04:16:51.569503+0000","last_clean":"2024-01-19T04:16:51.569503+0000","last_became_active":"2024-01-19T04:16:50.566530+0000","last_became_peered":"2024-01-19T04:16:50.566530+0000","last_unstale":"2024-01-19T04:16:51.569503+0000","last_undegraded":"2024-01-19T04:16:51.569503+0000","last_fullsized":"2024-01-19T04:16:51.569503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.711818+0000","last_change":"2024-01-19T04:16:51.576072+0000","last_active":"2024-01-19T04:16:52.711818+0000","last_peered":"2024-01-19T04:16:52.711818+0000","last_clean":"2024-01-19T04:16:52.711818+0000","last_became_active":"2024-01-19T04:16:51.575754+0000","last_became_peered":"2024-01-19T04:16:51.575754+0000","last_unstale":"2024-01-19T04:16:52.711818+0000","last_undegraded":"2024-01-19T04:16:52.711818+0000","last_fullsized":"2024-01-19T04:16:52.711818+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:58.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.555716+0000","last_change":"2024-01-19T04:16:50.571102+0000","last_active":"2024-01-19T04:16:51.555716+0000","last_peered":"2024-01-19T04:16:51.555716+0000","last_clean":"2024-01-19T04:16:51.555716+0000","last_became_active":"2024-01-19T04:16:50.570597+0000","last_became_peered":"2024-01-19T04:16:50.570597+0000","last_unstale":"2024-01-19T04:16:51.555716+0000","last_undegraded":"2024-01-19T04:16:51.555716+0000","last_fullsized":"2024-01-19T04:16:51.555716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256720+0000","last_change":"2024-01-19T04:16:51.581476+0000","last_active":"2024-01-19T04:16:53.256720+0000","last_peered":"2024-01-19T04:16:53.256720+0000","last_clean":"2024-01-19T04:16:53.256720+0000","last_became_active":"2024-01-19T04:16:51.580937+0000","last_became_peered":"2024-01-19T04:16:51.580937+0000","last_unstale":"2024-01-19T04:16:53.256720+0000","last_undegraded":"2024-01-19T04:16:53.256720+0000","last_fullsized":"2024-01-19T04:16:53.256720+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.596019+0000","last_change":"2024-01-19T04:16:50.572829+0000","last_active":"2024-01-19T04:16:51.596019+0000","last_peered":"2024-01-19T04:16:51.596019+0000","last_clean":"2024-01-19T04:16:51.596019+0000","last_became_active":"2024-01-19T04:16:50.572538+0000","last_became_peered":"2024-01-19T04:16:50.572538+0000","last_unstale":"2024-01-19T04:16:51.596019+0000","last_undegraded":"2024-01-19T04:16:51.596019+0000","last_fullsized":"2024-01-19T04:16:51.596019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.257067+0000","last_change":"2024-01-19T04:16:51.588191+0000","last_active":"2024-01-19T04:16:53.257067+0000","last_peered":"2024-01-19T04:16:53.257067+0000","last_clean":"2024-01-19T04:16:53.257067+0000","last_became_active":"2024-01-19T04:16:51.587927+0000","last_became_peered":"2024-01-19T04:16:51.587927+0000","last_unstale":"2024-01-19T04:16:53.257067+0000","last_undegraded":"2024-01-19T04:16:53.257067+0000","last_fullsized":"2024-01-19T04:16:53.257067+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.577294+0000","last_change":"2024-01-19T04:16:50.569273+0000","last_active":"2024-01-19T04:16:51.577294+0000","last_peered":"2024-01-19T04:16:51.577294+0000","last_clean":"2024-01-19T04:16:51.577294+0000","last_became_active":"2024-01-19T04:16:50.569009+0000","last_became_peered":"2024-01-19T04:16:50.569009+0000","last_unstale":"2024-01-19T04:16:51.577294+0000","last_undegraded":"2024-01-19T04:16:51.577294+0000","last_fullsized":"2024-01-19T04:16:51.577294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:59:10.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570724+0000","last_change":"2024-01-19T04:16:51.578342+0000","last_active":"2024-01-19T04:16:52.570724+0000","last_peered":"2024-01-19T04:16:52.570724+0000","last_clean":"2024-01-19T04:16:52.570724+0000","last_became_active":"2024-01-19T04:16:51.575581+0000","last_became_peered":"2024-01-19T04:16:51.575581+0000","last_unstale":"2024-01-19T04:16:52.570724+0000","last_undegraded":"2024-01-19T04:16:52.570724+0000","last_fullsized":"2024-01-19T04:16:52.570724+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256570+0000","last_change":"2024-01-19T04:16:50.572020+0000","last_active":"2024-01-19T04:16:53.256570+0000","last_peered":"2024-01-19T04:16:53.256570+0000","last_clean":"2024-01-19T04:16:53.256570+0000","last_became_active":"2024-01-19T04:16:50.571617+0000","last_became_peered":"2024-01-19T04:16:50.571617+0000","last_unstale":"2024-01-19T04:16:53.256570+0000","last_undegraded":"2024-01-19T04:16:53.256570+0000","last_fullsized":"2024-01-19T04:16:53.256570+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.585008+0000","last_change":"2024-01-19T04:16:51.575079+0000","last_active":"2024-01-19T04:16:51.585008+0000","last_peered":"2024-01-19T04:16:51.585008+0000","last_clean":"2024-01-19T04:16:51.585008+0000","last_became_active":"2024-01-19T04:16:51.574248+0000","last_became_peered":"2024-01-19T04:16:51.574248+0000","last_unstale":"2024-01-19T04:16:51.585008+0000","last_undegraded":"2024-01-19T04:16:51.585008+0000","last_fullsized":"2024-01-19T04:16:51.585008+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:37.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.579883+0000","last_change":"2024-01-19T04:16:50.571109+0000","last_active":"2024-01-19T04:16:51.579883+0000","last_peered":"2024-01-19T04:16:51.579883+0000","last_clean":"2024-01-19T04:16:51.579883+0000","last_became_active":"2024-01-19T04:16:50.570839+0000","last_became_peered":"2024-01-19T04:16:50.570839+0000","last_unstale":"2024-01-19T04:16:51.579883+0000","last_undegraded":"2024-01-19T04:16:51.579883+0000","last_fullsized":"2024-01-19T04:16:51.579883+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:22.030862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.257140+0000","last_change":"2024-01-19T04:16:51.582601+0000","last_active":"2024-01-19T04:16:53.257140+0000","last_peered":"2024-01-19T04:16:53.257140+0000","last_clean":"2024-01-19T04:16:53.257140+0000","last_became_active":"2024-01-19T04:16:51.582294+0000","last_became_peered":"2024-01-19T04:16:51.582294+0000","last_unstale":"2024-01-19T04:16:53.257140+0000","last_undegraded":"2024-01-19T04:16:53.257140+0000","last_fullsized":"2024-01-19T04:16:53.257140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256257+0000","last_change":"2024-01-19T04:16:50.568331+0000","last_active":"2024-01-19T04:16:53.256257+0000","last_peered":"2024-01-19T04:16:53.256257+0000","last_clean":"2024-01-19T04:16:53.256257+0000","last_became_active":"2024-01-19T04:16:50.567695+0000","last_became_peered":"2024-01-19T04:16:50.567695+0000","last_unstale":"2024-01-19T04:16:53.256257+0000","last_undegraded":"2024-01-19T04:16:53.256257+0000","last_fullsized":"2024-01-19T04:16:53.256257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570433+0000","last_change":"2024-01-19T04:16:51.579139+0000","last_active":"2024-01-19T04:16:52.570433+0000","last_peered":"2024-01-19T04:16:52.570433+0000","last_clean":"2024-01-19T04:16:52.570433+0000","last_became_active":"2024-01-19T04:16:51.578820+0000","last_became_peered":"2024-01-19T04:16:51.578820+0000","last_unstale":"2024-01-19T04:16:52.570433+0000","last_undegraded":"2024-01-19T04:16:52.570433+0000","last_fullsized":"2024-01-19T04:16:52.570433+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.583148+0000","last_change":"2024-01-19T04:16:50.563572+0000","last_active":"2024-01-19T04:16:51.583148+0000","last_peered":"2024-01-19T04:16:51.583148+0000","last_clean":"2024-01-19T04:16:51.583148+0000","last_became_active":"2024-01-19T04:16:50.561160+0000","last_became_peered":"2024-01-19T04:16:50.561160+0000","last_unstale":"2024-01-19T04:16:51.583148+0000","last_undegraded":"2024-01-19T04:16:51.583148+0000","last_fullsized":"2024-01-19T04:16:51.583148+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:40:18.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256039+0000","last_change":"2024-01-19T04:16:51.581877+0000","last_active":"2024-01-19T04:16:53.256039+0000","last_peered":"2024-01-19T04:16:53.256039+0000","last_clean":"2024-01-19T04:16:53.256039+0000","last_became_active":"2024-01-19T04:16:51.580713+0000","last_became_peered":"2024-01-19T04:16:51.580713+0000","last_unstale":"2024-01-19T04:16:53.256039+0000","last_undegraded":"2024-01-19T04:16:53.256039+0000","last_fullsized":"2024-01-19T04:16:53.256039+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.569005+0000","last_change":"2024-01-19T04:16:50.572947+0000","last_active":"2024-01-19T04:16:52.569005+0000","last_peered":"2024-01-19T04:16:52.569005+0000","last_clean":"2024-01-19T04:16:52.569005+0000","last_became_active":"2024-01-19T04:16:50.572679+0000","last_became_peered":"2024-01-19T04:16:50.572679+0000","last_unstale":"2024-01-19T04:16:52.569005+0000","last_undegraded":"2024-01-19T04:16:52.569005+0000","last_fullsized":"2024-01-19T04:16:52.569005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:41.006603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.255812+0000","last_change":"2024-01-19T04:16:51.575958+0000","last_active":"2024-01-19T04:16:53.255812+0000","last_peered":"2024-01-19T04:16:53.255812+0000","last_clean":"2024-01-19T04:16:53.255812+0000","last_became_active":"2024-01-19T04:16:51.575635+0000","last_became_peered":"2024-01-19T04:16:51.575635+0000","last_unstale":"2024-01-19T04:16:53.255812+0000","last_undegraded":"2024-01-19T04:16:53.255812+0000","last_fullsized":"2024-01-19T04:16:53.255812+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.557045+0000","last_change":"2024-01-19T04:16:50.568547+0000","last_active":"2024-01-19T04:16:51.557045+0000","last_peered":"2024-01-19T04:16:51.557045+0000","last_clean":"2024-01-19T04:16:51.557045+0000","last_became_active":"2024-01-19T04:16:50.568248+0000","last_became_peered":"2024-01-19T04:16:50.568248+0000","last_unstale":"2024-01-19T04:16:51.557045+0000","last_undegraded":"2024-01-19T04:16:51.557045+0000","last_fullsized":"2024-01-19T04:16:51.557045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:45.960987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570438+0000","last_change":"2024-01-19T04:16:51.562371+0000","last_active":"2024-01-19T04:16:52.570438+0000","last_peered":"2024-01-19T04:16:52.570438+0000","last_clean":"2024-01-19T04:16:52.570438+0000","last_became_active":"2024-01-19T04:16:51.562057+0000","last_became_peered":"2024-01-19T04:16:51.562057+0000","last_unstale":"2024-01-19T04:16:52.570438+0000","last_undegraded":"2024-01-19T04:16:52.570438+0000","last_fullsized":"2024-01-19T04:16:52.570438+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.569472+0000","last_change":"2024-01-19T04:16:50.575311+0000","last_active":"2024-01-19T04:16:52.569472+0000","last_peered":"2024-01-19T04:16:52.569472+0000","last_clean":"2024-01-19T04:16:52.569472+0000","last_became_active":"2024-01-19T04:16:50.574897+0000","last_became_peered":"2024-01-19T04:16:50.574897+0000","last_unstale":"2024-01-19T04:16:52.569472+0000","last_undegraded":"2024-01-19T04:16:52.569472+0000","last_fullsized":"2024-01-19T04:16:52.569472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.570745+0000","last_change":"2024-01-19T04:16:51.585936+0000","last_active":"2024-01-19T04:16:52.570745+0000","last_peered":"2024-01-19T04:16:52.570745+0000","last_clean":"2024-01-19T04:16:52.570745+0000","last_became_active":"2024-01-19T04:16:51.585682+0000","last_became_peered":"2024-01-19T04:16:51.585682+0000","last_unstale":"2024-01-19T04:16:52.570745+0000","last_undegraded":"2024-01-19T04:16:52.570745+0000","last_fullsized":"2024-01-19T04:16:52.570745+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256667+0000","last_change":"2024-01-19T04:16:50.567862+0000","last_active":"2024-01-19T04:16:53.256667+0000","last_peered":"2024-01-19T04:16:53.256667+0000","last_clean":"2024-01-19T04:16:53.256667+0000","last_became_active":"2024-01-19T04:16:50.567482+0000","last_became_peered":"2024-01-19T04:16:50.567482+0000","last_unstale":"2024-01-19T04:16:53.256667+0000","last_undegraded":"2024-01-19T04:16:53.256667+0000","last_fullsized":"2024-01-19T04:16:53.256667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.569223+0000","last_change":"2024-01-19T04:16:51.581054+0000","last_active":"2024-01-19T04:16:52.569223+0000","last_peered":"2024-01-19T04:16:52.569223+0000","last_clean":"2024-01-19T04:16:52.569223+0000","last_became_active":"2024-01-19T04:16:51.580564+0000","last_became_peered":"2024-01-19T04:16:51.580564+0000","last_unstale":"2024-01-19T04:16:52.569223+0000","last_undegraded":"2024-01-19T04:16:52.569223+0000","last_fullsized":"2024-01-19T04:16:52.569223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.841231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.569390+0000","last_change":"2024-01-19T04:16:50.565555+0000","last_active":"2024-01-19T04:16:51.569390+0000","last_peered":"2024-01-19T04:16:51.569390+0000","last_clean":"2024-01-19T04:16:51.569390+0000","last_became_active":"2024-01-19T04:16:50.565273+0000","last_became_peered":"2024-01-19T04:16:50.565273+0000","last_unstale":"2024-01-19T04:16:51.569390+0000","last_undegraded":"2024-01-19T04:16:51.569390+0000","last_fullsized":"2024-01-19T04:16:51.569390+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256452+0000","last_change":"2024-01-19T04:16:51.574116+0000","last_active":"2024-01-19T04:16:53.256452+0000","last_peered":"2024-01-19T04:16:53.256452+0000","last_clean":"2024-01-19T04:16:53.256452+0000","last_became_active":"2024-01-19T04:16:51.573543+0000","last_became_peered":"2024-01-19T04:16:51.573543+0000","last_unstale":"2024-01-19T04:16:53.256452+0000","last_undegraded":"2024-01-19T04:16:53.256452+0000","last_fullsized":"2024-01-19T04:16:53.256452+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.556851+0000","last_change":"2024-01-19T04:16:50.571359+0000","last_active":"2024-01-19T04:16:51.556851+0000","last_peered":"2024-01-19T04:16:51.556851+0000","last_clean":"2024-01-19T04:16:51.556851+0000","last_became_active":"2024-01-19T04:16:50.570715+0000","last_became_peered":"2024-01-19T04:16:50.570715+0000","last_unstale":"2024-01-19T04:16:51.556851+0000","last_undegraded":"2024-01-19T04:16:51.556851+0000","last_fullsized":"2024-01-19T04:16:51.556851+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.581263+0000","last_change":"2024-01-19T04:16:51.578118+0000","last_active":"2024-01-19T04:16:51.581263+0000","last_peered":"2024-01-19T04:16:51.581263+0000","last_clean":"2024-01-19T04:16:51.581263+0000","last_became_active":"2024-01-19T04:16:51.577861+0000","last_became_peered":"2024-01-19T04:16:51.577861+0000","last_unstale":"2024-01-19T04:16:51.581263+0000","last_undegraded":"2024-01-19T04:16:51.581263+0000","last_fullsized":"2024-01-19T04:16:51.581263+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:22.863624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.568981+0000","last_change":"2024-01-19T04:16:50.572873+0000","last_active":"2024-01-19T04:16:52.568981+0000","last_peered":"2024-01-19T04:16:52.568981+0000","last_clean":"2024-01-19T04:16:52.568981+0000","last_became_active":"2024-01-19T04:16:50.571172+0000","last_became_peered":"2024-01-19T04:16:50.571172+0000","last_unstale":"2024-01-19T04:16:52.568981+0000","last_undegraded":"2024-01-19T04:16:52.568981+0000","last_fullsized":"2024-01-19T04:16:52.568981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256769+0000","last_change":"2024-01-19T04:16:51.590515+0000","last_active":"2024-01-19T04:16:53.256769+0000","last_peered":"2024-01-19T04:16:53.256769+0000","last_clean":"2024-01-19T04:16:53.256769+0000","last_became_active":"2024-01-19T04:16:51.590319+0000","last_became_peered":"2024-01-19T04:16:51.590319+0000","last_unstale":"2024-01-19T04:16:53.256769+0000","last_undegraded":"2024-01-19T04:16:53.256769+0000","last_fullsized":"2024-01-19T04:16:53.256769+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.561254+0000","last_change":"2024-01-19T04:16:50.567937+0000","last_active":"2024-01-19T04:16:51.561254+0000","last_peered":"2024-01-19T04:16:51.561254+0000","last_clean":"2024-01-19T04:16:51.561254+0000","last_became_active":"2024-01-19T04:16:50.567687+0000","last_became_peered":"2024-01-19T04:16:50.567687+0000","last_unstale":"2024-01-19T04:16:51.561254+0000","last_undegraded":"2024-01-19T04:16:51.561254+0000","last_fullsized":"2024-01-19T04:16:51.561254+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:05.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.568924+0000","last_change":"2024-01-19T04:16:51.583555+0000","last_active":"2024-01-19T04:16:52.568924+0000","last_peered":"2024-01-19T04:16:52.568924+0000","last_clean":"2024-01-19T04:16:52.568924+0000","last_became_active":"2024-01-19T04:16:51.583278+0000","last_became_peered":"2024-01-19T04:16:51.583278+0000","last_unstale":"2024-01-19T04:16:52.568924+0000","last_undegraded":"2024-01-19T04:16:52.568924+0000","last_fullsized":"2024-01-19T04:16:52.568924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:10.004835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:52.568961+0000","last_change":"2024-01-19T04:16:50.570692+0000","last_active":"2024-01-19T04:16:52.568961+0000","last_peered":"2024-01-19T04:16:52.568961+0000","last_clean":"2024-01-19T04:16:52.568961+0000","last_became_active":"2024-01-19T04:16:50.570414+0000","last_became_peered":"2024-01-19T04:16:50.570414+0000","last_unstale":"2024-01-19T04:16:52.568961+0000","last_undegraded":"2024-01-19T04:16:52.568961+0000","last_fullsized":"2024-01-19T04:16:52.568961+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:18.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.588841+0000","last_change":"2024-01-19T04:16:51.586087+0000","last_active":"2024-01-19T04:16:51.588841+0000","last_peered":"2024-01-19T04:16:51.588841+0000","last_clean":"2024-01-19T04:16:51.588841+0000","last_became_active":"2024-01-19T04:16:51.585533+0000","last_became_peered":"2024-01-19T04:16:51.585533+0000","last_unstale":"2024-01-19T04:16:51.588841+0000","last_undegraded":"2024-01-19T04:16:51.588841+0000","last_fullsized":"2024-01-19T04:16:51.588841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:25:01.242688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.558885+0000","last_change":"2024-01-19T04:16:50.570854+0000","last_active":"2024-01-19T04:16:51.558885+0000","last_peered":"2024-01-19T04:16:51.558885+0000","last_clean":"2024-01-19T04:16:51.558885+0000","last_became_active":"2024-01-19T04:16:50.570594+0000","last_became_peered":"2024-01-19T04:16:50.570594+0000","last_unstale":"2024-01-19T04:16:51.558885+0000","last_undegraded":"2024-01-19T04:16:51.558885+0000","last_fullsized":"2024-01-19T04:16:51.558885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:51:58.259661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.584305+0000","last_change":"2024-01-19T04:16:51.574512+0000","last_active":"2024-01-19T04:16:51.584305+0000","last_peered":"2024-01-19T04:16:51.584305+0000","last_clean":"2024-01-19T04:16:51.584305+0000","last_became_active":"2024-01-19T04:16:51.574197+0000","last_became_peered":"2024-01-19T04:16:51.574197+0000","last_unstale":"2024-01-19T04:16:51.584305+0000","last_undegraded":"2024-01-19T04:16:51.584305+0000","last_fullsized":"2024-01-19T04:16:51.584305+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:22:52.971167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-19T04:16:51.569840+0000","last_change":"2024-01-19T04:16:50.574052+0000","last_active":"2024-01-19T04:16:51.569840+0000","last_peered":"2024-01-19T04:16:51.569840+0000","last_clean":"2024-01-19T04:16:51.569840+0000","last_became_active":"2024-01-19T04:16:50.572944+0000","last_became_peered":"2024-01-19T04:16:50.572944+0000","last_unstale":"2024-01-19T04:16:51.569840+0000","last_undegraded":"2024-01-19T04:16:51.569840+0000","last_fullsized":"2024-01-19T04:16:51.569840+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:10:00.992470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-01-19T04:16:53.256429+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:16:53.256429+0000","last_peered":"2024-01-19T04:16:53.256429+0000","last_clean":"2024-01-19T04:16:53.256429+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:16:53.256429+0000","last_undegraded":"2024-01-19T04:16:53.256429+0000","last_fullsized":"2024-01-19T04:16:53.256429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476764,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1224704,"data_stored":851254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.753}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.874},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.84999999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476764,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":622592,"data_stored":260726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.755}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.86799999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476763,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":261378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.94199999999999995}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.96699999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.99199999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0209999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.70799999999999996}]}]},{"osd":4,"up_from":16,"seq":68719476765,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":634880,"data_stored":262338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.623}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.83599999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":260782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.497}]},{"osd":1,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.376}]},{"osd":3,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.92800000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.72799999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":260816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.964,"15min":1.964},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":2.827,"15min":2.827},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60299999999999998,"5min":2.343,"15min":2.343},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.665,"15min":1.665},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.032,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.745},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.94199999999999995,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.002,"5min":1.198,"15min":1.198},"last":1.002},{"interface":"front","average":{"1min":0.754,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.67500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.04,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.90100000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1232896,"data_stored":853288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.439}]},{"osd":3,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5629999999999997,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":4.1600000000000001,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.6470000000000002,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.66200000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":618496,"data_stored":254482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.5469999999999997,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.226,"5min":5.226,"15min":5.226},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.319,"5min":5.319,"15min":5.319},"last":0.505},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.84899999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.9020000000000001,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.748}]},{"osd":7,"last update":"Fri Jan 19 04:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":5.423,"5min":5.423,"15min":5.423},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":7.4660000000000002,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.89100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:16:56.152 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:16:56.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-19T04:16:56.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.337+0000 7f2eb7e00640 1 Processor -- start 2024-01-19T04:16:56.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.337+0000 7f2eb7e00640 1 -- start start 2024-01-19T04:16:56.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2eb006cab0 0x7f2eb006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb7e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00c0eb0 con 0x7f2eb00c55d0 2024-01-19T04:16:56.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb7e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00a5330 con 0x7f2eb00705b0 2024-01-19T04:16:56.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb7e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb006e5c0 con 0x7f2eb006cab0 2024-01-19T04:16:56.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2eb006cab0 0x7f2eb006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb4a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2eb00c55d0 0x7f2eb00c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43856/0 (socket says 172.21.15.32:43856) 2024-01-19T04:16:56.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb4a00640 1 -- 172.21.15.32:0/3220053172 learned_addr learned my addr 172.21.15.32:0/3220053172 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:56.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb5400640 1 -- 172.21.15.32:0/3220053172 >> v1:172.21.15.67:6789/0 conn(0x7f2eb00705b0 legacy=0x7f2eb015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb5400640 1 -- 172.21.15.32:0/3220053172 >> v1:172.21.15.32:6789/0 conn(0x7f2eb00c55d0 legacy=0x7f2eb00c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb5400640 1 -- 172.21.15.32:0/3220053172 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb01516f0 con 0x7f2eb006cab0 2024-01-19T04:16:56.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eafe00640 1 -- 172.21.15.32:0/3220053172 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077516078 0 0) 0x7f2eb00c0eb0 con 0x7f2eb00c55d0 2024-01-19T04:16:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.341+0000 7f2eb5400640 1 --2- 172.21.15.32:0/3220053172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb006cab0 0x7f2eb006ce90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00097c0 tx=0x7f2ea001e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc9f72f61e2342b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eafe00640 1 -- 172.21.15.32:0/3220053172 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00a8630 con 0x7f2eb006cab0 2024-01-19T04:16:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eafe00640 1 -- 172.21.15.32:0/3220053172 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea00a8790 con 0x7f2eb006cab0 2024-01-19T04:16:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eafe00640 1 -- 172.21.15.32:0/3220053172 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00a8b20 con 0x7f2eb006cab0 2024-01-19T04:16:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3220053172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb006cab0 msgr2=0x7f2eb006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3220053172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb006cab0 0x7f2eb006ce90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00097c0 tx=0x7f2ea001e660 comp rx=0 tx=0).stop 2024-01-19T04:16:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3220053172 shutdown_connections 2024-01-19T04:16:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3220053172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb006cab0 0x7f2eb006ce90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3220053172 >> 172.21.15.32:0/3220053172 conn(0x7f2eb00c25a0 msgr2=0x7f2eb00c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3220053172 shutdown_connections 2024-01-19T04:16:56.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3220053172 wait complete. 2024-01-19T04:16:56.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 Processor -- start 2024-01-19T04:16:56.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- start start 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2eb006cab0 0x7f2eb014d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb00705b0 0x7f2eb0148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2eb00c55d0 0x7f2eb014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0149800 con 0x7f2eb00705b0 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb014b060 con 0x7f2eb00c55d0 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.345+0000 7f2eb7e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00a9090 con 0x7f2eb006cab0 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb00705b0 0x7f2eb0148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb00705b0 0x7f2eb0148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46500/0 (socket says 172.21.15.32:46500) 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 -- 172.21.15.32:0/3090358254 learned_addr learned my addr 172.21.15.32:0/3090358254 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:56.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb5400640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2eb006cab0 0x7f2eb014d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb5e00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2eb00c55d0 0x7f2eb014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 -- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2eb006cab0 msgr2=0x7f2eb014d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2eb006cab0 0x7f2eb014d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 -- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2eb00c55d0 msgr2=0x7f2eb014b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2eb00c55d0 0x7f2eb014b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 -- 172.21.15.32:0/3090358254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0009420 con 0x7f2eb00705b0 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb5400640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2eb006cab0 0x7f2eb014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb4a00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb00705b0 0x7f2eb0148d20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c410 tx=0x7f2e9800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2ead600640 1 -- 172.21.15.32:0/3090358254 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980074e0 con 0x7f2eb00705b0 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2ead600640 1 -- 172.21.15.32:0/3090358254 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e98007640 con 0x7f2eb00705b0 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2ead600640 1 -- 172.21.15.32:0/3090358254 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98004a30 con 0x7f2eb00705b0 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb00a9300 con 0x7f2eb00705b0 2024-01-19T04:16:56.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb01f19d0 con 0x7f2eb00705b0 2024-01-19T04:16:56.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb00749f0 con 0x7f2eb00705b0 2024-01-19T04:16:56.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.349+0000 7f2ead600640 1 -- 172.21.15.32:0/3090358254 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2e98004b90 con 0x7f2eb00705b0 2024-01-19T04:16:56.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.353+0000 7f2ead600640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e88066530 0x7f2e880689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.353+0000 7f2ead600640 1 -- 172.21.15.32:0/3090358254 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e98083af0 con 0x7f2eb00705b0 2024-01-19T04:16:56.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.353+0000 7f2eb5400640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e88066530 0x7f2e880689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.353+0000 7f2eb5400640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e88066530 0x7f2e880689f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00b1000 tx=0x7f2ea00b4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:56.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.357+0000 7f2ead600640 1 -- 172.21.15.32:0/3090358254 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2e98050e20 con 0x7f2eb00705b0 2024-01-19T04:16:56.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.569+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2eb006d590 con 0x7f2eb00705b0 2024-01-19T04:16:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2ead600640 1 -- 172.21.15.32:0/3090358254 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2e98054440 con 0x7f2eb00705b0 2024-01-19T04:16:56.575 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-01-19T04:16:56.575 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q== 2024-01-19T04:16:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-01-19T04:16:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-01-19T04:16:56.576 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-19T04:16:56.576 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e88066530 msgr2=0x7f2e880689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e88066530 0x7f2e880689f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00b1000 tx=0x7f2ea00b4040 comp rx=0 tx=0).stop 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb00705b0 msgr2=0x7f2eb0148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb00705b0 0x7f2eb0148d20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c410 tx=0x7f2e9800c8d0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 shutdown_connections 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2e88066530 0x7f2e880689f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2eb00c55d0 0x7f2eb014b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2eb00705b0 0x7f2eb0148d20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 --2- 172.21.15.32:0/3090358254 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2eb006cab0 0x7f2eb014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.573+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 >> 172.21.15.32:0/3090358254 conn(0x7f2eb00c25a0 msgr2=0x7f2eb0150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.577+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 shutdown_connections 2024-01-19T04:16:56.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.577+0000 7f2eb7e00640 1 -- 172.21.15.32:0/3090358254 wait complete. 2024-01-19T04:16:56.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:16:56.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.737+0000 7f65d3200640 1 Processor -- start 2024-01-19T04:16:56.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.737+0000 7f65d3200640 1 -- start start 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f65cc0c78d0 0x7f65cc0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d3200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc155060 0x7f65cc0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d3200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65cc06fa50 0x7f65cc0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d3200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0c6570 con 0x7f65cc06fa50 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d3200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0c81f0 con 0x7f65cc0c78d0 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d3200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc155560 con 0x7f65cc155060 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65cc06fa50 0x7f65cc0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65cc06fa50 0x7f65cc0c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46506/0 (socket says 172.21.15.32:46506) 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 -- 172.21.15.32:0/4087966914 learned_addr learned my addr 172.21.15.32:0/4087966914 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65cb400640 1 --2- 172.21.15.32:0/4087966914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc155060 0x7f65cc0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65cbe00640 1 --2- 172.21.15.32:0/4087966914 >> v2:172.21.15.67:3300/0 conn(0x7f65cc0c78d0 0x7f65cc0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 -- 172.21.15.32:0/4087966914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc155060 msgr2=0x7f65cc0c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:56.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 --2- 172.21.15.32:0/4087966914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc155060 0x7f65cc0c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 -- 172.21.15.32:0/4087966914 >> v2:172.21.15.67:3300/0 conn(0x7f65cc0c78d0 msgr2=0x7f65cc0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:56.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 --2- 172.21.15.32:0/4087966914 >> v2:172.21.15.67:3300/0 conn(0x7f65cc0c78d0 0x7f65cc0c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.741+0000 7f65d1200640 1 -- 172.21.15.32:0/4087966914 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0c5c40 con 0x7f65cc06fa50 2024-01-19T04:16:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d1200640 1 --2- 172.21.15.32:0/4087966914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc0c6f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0c5760 tx=0x7f65c401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256b4329b460502d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65caa00640 1 -- 172.21.15.32:0/4087966914 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40a5790 con 0x7f65cc06fa50 2024-01-19T04:16:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65caa00640 1 -- 172.21.15.32:0/4087966914 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c40a58f0 con 0x7f65cc06fa50 2024-01-19T04:16:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65caa00640 1 -- 172.21.15.32:0/4087966914 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40a5c80 con 0x7f65cc06fa50 2024-01-19T04:16:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 -- 172.21.15.32:0/4087966914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 msgr2=0x7f65cc0c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 --2- 172.21.15.32:0/4087966914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc0c6f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0c5760 tx=0x7f65c401c910 comp rx=0 tx=0).stop 2024-01-19T04:16:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 -- 172.21.15.32:0/4087966914 shutdown_connections 2024-01-19T04:16:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 --2- 172.21.15.32:0/4087966914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc0c6f40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 --2- 172.21.15.32:0/4087966914 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc155060 0x7f65cc0c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 --2- 172.21.15.32:0/4087966914 >> v2:172.21.15.67:3300/0 conn(0x7f65cc0c78d0 0x7f65cc0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 -- 172.21.15.32:0/4087966914 >> 172.21.15.32:0/4087966914 conn(0x7f65cc06ddb0 msgr2=0x7f65cc06e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 -- 172.21.15.32:0/4087966914 shutdown_connections 2024-01-19T04:16:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 -- 172.21.15.32:0/4087966914 wait complete. 2024-01-19T04:16:56.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 Processor -- start 2024-01-19T04:16:56.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.745+0000 7f65d3200640 1 -- start start 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc1edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc0c78d0 0x7f65cc151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65cc155060 0x7f65cc0a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc1ee030 con 0x7f65cc06fa50 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15fd30 con 0x7f65cc155060 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15fa50 con 0x7f65cc0c78d0 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc1edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc1edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46510/0 (socket says 172.21.15.32:46510) 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 -- 172.21.15.32:0/4050945369 learned_addr learned my addr 172.21.15.32:0/4050945369 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d1200640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65cc155060 0x7f65cc0a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cb400640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc0c78d0 0x7f65cc151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 -- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc0c78d0 msgr2=0x7f65cc151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc0c78d0 0x7f65cc151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 -- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65cc155060 msgr2=0x7f65cc0a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65cc155060 0x7f65cc0a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 -- 172.21.15.32:0/4050945369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4009b30 con 0x7f65cc06fa50 2024-01-19T04:16:56.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cb400640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc0c78d0 0x7f65cc151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:56.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65cbe00640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc1edaf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00e8b0 tx=0x7f65bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:56.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65c3e00640 1 -- 172.21.15.32:0/4050945369 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00c940 con 0x7f65cc06fa50 2024-01-19T04:16:56.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65c3e00640 1 -- 172.21.15.32:0/4050945369 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc00caa0 con 0x7f65cc06fa50 2024-01-19T04:16:56.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65c3e00640 1 -- 172.21.15.32:0/4050945369 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00ce30 con 0x7f65cc06fa50 2024-01-19T04:16:56.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc14eda0 con 0x7f65cc06fa50 2024-01-19T04:16:56.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc14f360 con 0x7f65cc06fa50 2024-01-19T04:16:56.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc14f520 con 0x7f65cc06fa50 2024-01-19T04:16:56.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.749+0000 7f65c3e00640 1 -- 172.21.15.32:0/4050945369 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f65bc013470 con 0x7f65cc06fa50 2024-01-19T04:16:56.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.753+0000 7f65c3e00640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65a4066500 0x7f65a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:56.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.753+0000 7f65c3e00640 1 -- 172.21.15.32:0/4050945369 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65bc083f80 con 0x7f65cc06fa50 2024-01-19T04:16:56.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.753+0000 7f65cb400640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65a4066500 0x7f65a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:56.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.753+0000 7f65cb400640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65a4066500 0x7f65a40689c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0be960 tx=0x7f65b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:56.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.757+0000 7f65c3e00640 1 -- 172.21.15.32:0/4050945369 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f65bc0512c0 con 0x7f65cc06fa50 2024-01-19T04:16:56.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.945+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65cc0749f0 con 0x7f65cc06fa50 2024-01-19T04:16:56.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65c3e00640 1 -- 172.21.15.32:0/4050945369 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f65bc0548e0 con 0x7f65cc06fa50 2024-01-19T04:16:56.950 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:16:56.951 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5835,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:50.950328+0000","modified":"2024-01-19T04:16:54.081170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/246892917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":246892917},{"type":"v1","addr":"172.21.15.67:6837","nonce":246892917}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-01-19T04:16:56.951 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 31 2024-01-19T04:16:56.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65a4066500 msgr2=0x7f65a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65a4066500 0x7f65a40689c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0be960 tx=0x7f65b4008040 comp rx=0 tx=0).stop 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 msgr2=0x7f65cc1edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc1edaf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00e8b0 tx=0x7f65bc00ed70 comp rx=0 tx=0).stop 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 shutdown_connections 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f65a4066500 0x7f65a40689c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65cc155060 0x7f65cc0a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f65cc0c78d0 0x7f65cc151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 --2- 172.21.15.32:0/4050945369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65cc06fa50 0x7f65cc1edaf0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 >> 172.21.15.32:0/4050945369 conn(0x7f65cc06ddb0 msgr2=0x7f65cc153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 shutdown_connections 2024-01-19T04:16:56.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:56.949+0000 7f65d3200640 1 -- 172.21.15.32:0/4050945369 wait complete. 2024-01-19T04:16:57.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T04:16:50.950328+0000', 'modified': '2024-01-19T04:16:54.081170+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5841}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5841': {'gid': 5841, 'name': 'd', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6837/246892917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6835', 'nonce': 246892917}, {'type': 'v1', 'addr': '172.21.15.67:6837', 'nonce': 246892917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-19T04:16:57.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-19T04:16:57.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-19T04:16:57.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.517+0000 7fd9a9a00640 1 Processor -- start 2024-01-19T04:16:57.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.517+0000 7fd9a9a00640 1 -- start start 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a9a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd9a4147f90 0x7fd9a4151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a9a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a40c18b0 0x7fd9a40a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a9a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40c1d40 con 0x7fd9a40c55e0 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a9a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a406c5c0 con 0x7fd9a4147f90 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a9a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40c0810 con 0x7fd9a40c18b0 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a2000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd9a40c55e0 0x7fd9a406beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43866/0 (socket says 172.21.15.32:43866) 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd9a4147f90 0x7fd9a4151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a2000640 1 -- 172.21.15.32:0/3475808832 learned_addr learned my addr 172.21.15.32:0/3475808832 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:57.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a3400640 1 --2- 172.21.15.32:0/3475808832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a40c18b0 0x7fd9a40a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a2a00640 1 -- 172.21.15.32:0/3475808832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a40c18b0 msgr2=0x7fd9a40a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/3475808832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a40c18b0 0x7fd9a40a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a2a00640 1 -- 172.21.15.32:0/3475808832 >> v1:172.21.15.32:6789/0 conn(0x7fd9a40c55e0 legacy=0x7fd9a406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a2a00640 1 -- 172.21.15.32:0/3475808832 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40c0af0 con 0x7fd9a4147f90 2024-01-19T04:16:57.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.521+0000 7fd9a1600640 1 -- 172.21.15.32:0/3475808832 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519420008 0 0) 0x7fd9a40c1d40 con 0x7fd9a40c55e0 2024-01-19T04:16:57.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/3475808832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4147f90 0x7fd9a4151350 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097c0 tx=0x7fd99401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7edc7a457f2f57 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a1600640 1 -- 172.21.15.32:0/3475808832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940ac620 con 0x7fd9a4147f90 2024-01-19T04:16:57.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a1600640 1 -- 172.21.15.32:0/3475808832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9940ac780 con 0x7fd9a4147f90 2024-01-19T04:16:57.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a1600640 1 -- 172.21.15.32:0/3475808832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940acb10 con 0x7fd9a4147f90 2024-01-19T04:16:57.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 -- 172.21.15.32:0/3475808832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4147f90 msgr2=0x7fd9a4151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/3475808832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4147f90 0x7fd9a4151350 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097c0 tx=0x7fd99401c3c0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 -- 172.21.15.32:0/3475808832 shutdown_connections 2024-01-19T04:16:57.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/3475808832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a40c18b0 0x7fd9a40a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/3475808832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4147f90 0x7fd9a4151350 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 -- 172.21.15.32:0/3475808832 >> 172.21.15.32:0/3475808832 conn(0x7fd9a40c5b20 msgr2=0x7fd9a40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 -- 172.21.15.32:0/3475808832 shutdown_connections 2024-01-19T04:16:57.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 -- 172.21.15.32:0/3475808832 wait complete. 2024-01-19T04:16:57.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 Processor -- start 2024-01-19T04:16:57.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.525+0000 7fd9a9a00640 1 -- start start 2024-01-19T04:16:57.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a40c18b0 0x7fd9a41468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a40c55e0 0x7fd9a414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4147f90 0x7fd9a4154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4147800 con 0x7fd9a40c55e0 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41f1530 con 0x7fd9a40c18b0 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41f1250 con 0x7fd9a4147f90 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a40c55e0 0x7fd9a414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a40c55e0 0x7fd9a414e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46534/0 (socket says 172.21.15.32:46534) 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 -- 172.21.15.32:0/2319375922 learned_addr learned my addr 172.21.15.32:0/2319375922 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a40c18b0 0x7fd9a41468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a3400640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4147f90 0x7fd9a4154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 -- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4147f90 msgr2=0x7fd9a4154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4147f90 0x7fd9a4154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 -- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a40c18b0 msgr2=0x7fd9a41468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a40c18b0 0x7fd9a41468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 -- 172.21.15.32:0/2319375922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994009420 con 0x7fd9a40c55e0 2024-01-19T04:16:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a2000640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a40c55e0 0x7fd9a414e1c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd98c00c4b0 tx=0x7fd98c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd99aa00640 1 -- 172.21.15.32:0/2319375922 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0074e0 con 0x7fd9a40c55e0 2024-01-19T04:16:57.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd99aa00640 1 -- 172.21.15.32:0/2319375922 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c007660 con 0x7fd9a40c55e0 2024-01-19T04:16:57.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a40a8a70 con 0x7fd9a40c55e0 2024-01-19T04:16:57.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd99aa00640 1 -- 172.21.15.32:0/2319375922 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c004a30 con 0x7fd9a40c55e0 2024-01-19T04:16:57.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.529+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a41f0f60 con 0x7fd9a40c55e0 2024-01-19T04:16:57.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd99aa00640 1 -- 172.21.15.32:0/2319375922 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd98c004b90 con 0x7fd9a40c55e0 2024-01-19T04:16:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd99aa00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd97c066500 0x7fd97c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd99aa00640 1 -- 172.21.15.32:0/2319375922 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd98c0833b0 con 0x7fd9a40c55e0 2024-01-19T04:16:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 Processor -- start 2024-01-19T04:16:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd97c066500 0x7fd97c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 -- start start 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd97c066500 0x7fd97c0689c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd9940ae000 tx=0x7fd9940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a49a0 0x5557117a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a52c0 0x5557117ee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555711602d70 con 0x5557117a4080 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557115feba0 con 0x5557117a52c0 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557115fc0d0 con 0x5557117a49a0 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46542/0 (socket says 172.21.15.32:46542) 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9a2a00640 1 -- 172.21.15.32:0/1089871552 learned_addr learned my addr 172.21.15.32:0/1089871552 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9a3400640 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a52c0 0x5557117ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.533+0000 7fd9a2000640 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a49a0 0x5557117a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 -- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a49a0 msgr2=0x5557117a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a49a0 0x5557117a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 -- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a52c0 msgr2=0x5557117ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a52c0 0x5557117ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 -- 172.21.15.32:0/1089871552 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557112ee890 con 0x5557117a4080 2024-01-19T04:16:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a3400640 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a52c0 0x5557117ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a4460 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097c0 tx=0x7fd994004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0abf3b86f81ca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd993400640 1 -- 172.21.15.32:0/1089871552 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940b7b40 con 0x5557117a4080 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd993400640 1 -- 172.21.15.32:0/1089871552 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9940b7ca0 con 0x5557117a4080 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd993400640 1 -- 172.21.15.32:0/1089871552 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940cc660 con 0x5557117a4080 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- 172.21.15.32:0/1089871552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 msgr2=0x5557117a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a4460 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097c0 tx=0x7fd994004740 comp rx=0 tx=0).stop 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- 172.21.15.32:0/1089871552 shutdown_connections 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a52c0 0x5557117ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a49a0 0x5557117a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 --2- 172.21.15.32:0/1089871552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a4460 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- 172.21.15.32:0/1089871552 >> 172.21.15.32:0/1089871552 conn(0x5557117acd20 msgr2=0x5557117e4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- 172.21.15.32:0/1089871552 shutdown_connections 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- 172.21.15.32:0/1089871552 wait complete. 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- start start 2024-01-19T04:16:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 Processor -- start 2024-01-19T04:16:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117a9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557117a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557115f79c0 con 0x5557117a4080 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557115af040 con 0x5557117a49a0 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557115b4ee0 con 0x5557117a52c0 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9acf68000 10 client.0 _ll_register_callbacks cb 0x5557115b21b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46548/0 (socket says 172.21.15.32:46548) 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.537+0000 7fd9a3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557117a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2000640 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2a00640 1 -- 172.21.15.32:0/906526514 learned_addr learned my addr 172.21.15.32:0/906526514 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2a00640 1 -- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 msgr2=0x5557117a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557117a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2a00640 1 -- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 msgr2=0x5557117a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117a9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2a00640 1 -- 172.21.15.32:0/906526514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a40c0af0 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2000640 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a8e30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd9940af040 tx=0x7fd99401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af86bf3f30d34672 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 1 -- 172.21.15.32:0/906526514 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940cc660 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 1 -- 172.21.15.32:0/906526514 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9940cc7c0 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55571157de30 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 1 -- 172.21.15.32:0/906526514 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9940cc980 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 10 client.5979 fetch_fsmap learned FSMap version 31 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5557115b75e0 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 1 -- 172.21.15.32:0/906526514 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55571157de30 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 1 -- 172.21.15.32:0/906526514 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd9940bf070 con 0x5557117a4080 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 10 client.5979 fetch_fsmap finished waiting for FSMap version 31 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 10 client.5979 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-19T04:16:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 20 client.5979 populate_metadata read hostname 'smithi032' 2024-01-19T04:16:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x5557117f6b70 0x5557117f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 4 client.5979 mds_command: new command op to 5841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:16:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 --> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557115b4870 con 0x5557117f6b70 2024-01-19T04:16:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2000640 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x5557117f6b70 0x5557117f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9a2000640 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x5557117f6b70 0x5557117f8f60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec079d981fdc1a2e server_cookie=b70121b07a93d76d in_seq=0 out_seq=0 2024-01-19T04:16:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 10 client.5979 ms_handle_connect on v2:172.21.15.67:6835/246892917 2024-01-19T04:16:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 1 -- 172.21.15.32:0/906526514 <== mds.0 v2:172.21.15.67:6835/246892917 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5557115b4870 con 0x5557117f6b70 2024-01-19T04:16:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd98be00640 10 client.5979 handle_command_reply: tid=0 2024-01-19T04:16:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.541+0000 7fd9acf68000 1 client.5979 shutdown 2024-01-19T04:16:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 msgr2=0x5557117a8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a8e30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd9940af040 tx=0x7fd99401ac00 comp rx=0 tx=0).stop 2024-01-19T04:16:57.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 shutdown_connections 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x5557117f6b70 0x5557117f8f60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557117a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 --2- 172.21.15.32:0/906526514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x5557117a8e30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd98be00640 0 client.5979 ms_handle_reset on v2:172.21.15.67:6835/246892917 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 >> 172.21.15.32:0/906526514 conn(0x5557117acd20 msgr2=0x5557117a3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 shutdown_connections 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 1 -- 172.21.15.32:0/906526514 wait complete. 2024-01-19T04:16:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.545+0000 7fd9acf68000 20 client.5979 trim_cache size 0 max 16384 2024-01-19T04:16:57.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 Processor -- start 2024-01-19T04:16:57.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- start start 2024-01-19T04:16:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a4080 0x5557117fab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a52c0 0x5557117f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557112af940 con 0x5557117a52c0 2024-01-19T04:16:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x555711591cf0 con 0x5557117a49a0 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557115cc6b0 con 0x5557117a4080 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a52c0 0x5557117f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a52c0 0x5557117f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46556/0 (socket says 172.21.15.32:46556) 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 -- 172.21.15.32:0/2433651052 learned_addr learned my addr 172.21.15.32:0/2433651052 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a4080 0x5557117fab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a2000640 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 -- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a4080 msgr2=0x5557117fab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a4080 0x5557117fab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 -- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 msgr2=0x5557117f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 -- 172.21.15.32:0/2433651052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55571159d8e0 con 0x5557117a52c0 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a2000640 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9a3400640 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a52c0 0x5557117f94a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd99c007220 tx=0x7fd99c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424ccd3777380326 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd992a00640 1 -- 172.21.15.32:0/2433651052 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00e040 con 0x5557117a52c0 2024-01-19T04:16:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd992a00640 1 -- 172.21.15.32:0/2433651052 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c00f040 con 0x5557117a52c0 2024-01-19T04:16:57.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd992a00640 1 -- 172.21.15.32:0/2433651052 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0206b0 con 0x5557117a52c0 2024-01-19T04:16:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- 172.21.15.32:0/2433651052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a52c0 msgr2=0x5557117f94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a52c0 0x5557117f94a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd99c007220 tx=0x7fd99c009750 comp rx=0 tx=0).stop 2024-01-19T04:16:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- 172.21.15.32:0/2433651052 shutdown_connections 2024-01-19T04:16:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a52c0 0x5557117f94a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x5557117f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 --2- 172.21.15.32:0/2433651052 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a4080 0x5557117fab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- 172.21.15.32:0/2433651052 >> 172.21.15.32:0/2433651052 conn(0x5557117acd20 msgr2=0x5557117df780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- 172.21.15.32:0/2433651052 shutdown_connections 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- 172.21.15.32:0/2433651052 wait complete. 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.561+0000 7fd9acf68000 1 -- start start 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 Processor -- start 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x555711845770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x555711845cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557118465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557115beeb0 con 0x5557117a4080 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557115f4dc0 con 0x5557117a49a0 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557116003f0 con 0x5557117a52c0 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 10 client.0 _ll_register_callbacks cb 0x5557115b80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x555711845770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x555711845770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46560/0 (socket says 172.21.15.32:46560) 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 -- 172.21.15.32:0/3160209039 learned_addr learned my addr 172.21.15.32:0/3160209039 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2000640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x555711845cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a3400640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557118465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 -- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 msgr2=0x5557118465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557118465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 -- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 msgr2=0x555711845cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x555711845cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 -- 172.21.15.32:0/3160209039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99c003ae0 con 0x5557117a4080 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2000640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x555711845cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2a00640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x555711845770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097c0 tx=0x7fd994009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8255865a707b353f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd98be00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd98be00640 1 -- 172.21.15.32:0/3160209039 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940ac420 con 0x5557117a4080 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd98be00640 1 -- 172.21.15.32:0/3160209039 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9940cc870 con 0x5557117a4080 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557117a3800 con 0x5557117a4080 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd98be00640 1 -- 172.21.15.32:0/3160209039 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9940b77c0 con 0x5557117a4080 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 10 client.5985 fetch_fsmap learned FSMap version 31 2024-01-19T04:16:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5557112eecc0 con 0x5557117a4080 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd98be00640 1 -- 172.21.15.32:0/3160209039 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557117a3800 con 0x5557117a4080 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd98be00640 1 -- 172.21.15.32:0/3160209039 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd9940bf040 con 0x5557117a4080 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 10 client.5985 fetch_fsmap finished waiting for FSMap version 31 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 10 client.5985 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 20 client.5985 populate_metadata read hostname 'smithi032' 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x555711846f60 0x555711847340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 4 client.5985 mds_command: new command op to 5841 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 --> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557115a94f0 con 0x555711846f60 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2000640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x555711846f60 0x555711847340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd9a2000640 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x555711846f60 0x555711847340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a904fd9e6a8b6 server_cookie=74e9cc036efc83ae in_seq=0 out_seq=0 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.565+0000 7fd98be00640 10 client.5985 ms_handle_connect on v2:172.21.15.67:6835/246892917 2024-01-19T04:16:57.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd98be00640 1 -- 172.21.15.32:0/3160209039 <== mds.0 v2:172.21.15.67:6835/246892917 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5557115a94f0 con 0x555711846f60 2024-01-19T04:16:57.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd98be00640 10 client.5985 handle_command_reply: tid=0 2024-01-19T04:16:57.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 client.5985 shutdown 2024-01-19T04:16:57.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 msgr2=0x555711845770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x555711845770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097c0 tx=0x7fd994009190 comp rx=0 tx=0).stop 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 shutdown_connections 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:6835/246892917,v1:172.21.15.67:6837/246892917] conn(0x555711846f60 0x555711847340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x5557117a52c0 0x5557118465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557117a49a0 0x555711845cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 --2- 172.21.15.32:0/3160209039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557117a4080 0x555711845770 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd98be00640 0 client.5985 ms_handle_reset on v2:172.21.15.67:6835/246892917 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 >> 172.21.15.32:0/3160209039 conn(0x5557117acd20 msgr2=0x5557117e0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 shutdown_connections 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 1 -- 172.21.15.32:0/3160209039 wait complete. 2024-01-19T04:16:57.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9acf68000 20 client.5985 trim_cache size 0 max 16384 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "d7445317-ddd8-4205-bf5b-c51cd46cffd9", 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5841, 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 6.0207812699999996, 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 31, 2024-01-19T04:16:57.576 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 53, 2024-01-19T04:16:57.577 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 53, 2024-01-19T04:16:57.577 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 11.919333228999999 2024-01-19T04:16:57.577 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd97c066500 msgr2=0x7fd97c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd97c066500 0x7fd97c0689c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd9940ae000 tx=0x7fd9940a7000 comp rx=0 tx=0).stop 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a40c55e0 msgr2=0x7fd9a414e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a40c55e0 0x7fd9a414e1c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd98c00c4b0 tx=0x7fd98c00c970 comp rx=0 tx=0).stop 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 shutdown_connections 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd97c066500 0x7fd97c0689c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9a4147f90 0x7fd9a4154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a40c55e0 0x7fd9a414e1c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 --2- 172.21.15.32:0/2319375922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a40c18b0 0x7fd9a41468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 >> 172.21.15.32:0/2319375922 conn(0x7fd9a40c5b20 msgr2=0x7fd9a40c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 shutdown_connections 2024-01-19T04:16:57.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.569+0000 7fd9a9a00640 1 -- 172.21.15.32:0/2319375922 wait complete. 2024-01-19T04:16:57.592 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:16:57.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.729+0000 7f6fddc00640 1 Processor -- start 2024-01-19T04:16:57.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.729+0000 7f6fddc00640 1 -- start start 2024-01-19T04:16:57.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.729+0000 7f6fddc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6fd8149180 0x7f6fd806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.729+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd806abe0 0x7f6fd8155a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.729+0000 7f6fddc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80ab660 con 0x7f6fd8155fc0 2024-01-19T04:16:57.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fddc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80aa600 con 0x7f6fd8149180 2024-01-19T04:16:57.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fddc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80abb90 con 0x7f6fd806abe0 2024-01-19T04:16:57.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd7400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6fd8155fc0 0x7f6fd8152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43880/0 (socket says 172.21.15.32:43880) 2024-01-19T04:16:57.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd7400640 1 -- 172.21.15.32:0/3178881178 learned_addr learned my addr 172.21.15.32:0/3178881178 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd6a00640 1 --2- 172.21.15.32:0/3178881178 >> v2:172.21.15.67:3300/0 conn(0x7f6fd8149180 0x7f6fd806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd6000640 1 --2- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd806abe0 0x7f6fd8155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd5600640 1 -- 172.21.15.32:0/3178881178 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931904818 0 0) 0x7f6fd80ab660 con 0x7f6fd8155fc0 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd5600640 1 -- 172.21.15.32:0/3178881178 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb8003530 con 0x7f6fd8155fc0 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd6a00640 1 -- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd806abe0 msgr2=0x7f6fd8155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd6a00640 1 --2- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd806abe0 0x7f6fd8155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd6a00640 1 -- 172.21.15.32:0/3178881178 >> v1:172.21.15.32:6789/0 conn(0x7f6fd8155fc0 legacy=0x7f6fd8152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd5600640 1 -- 172.21.15.32:0/3178881178 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795043812 0 0) 0x7f6fb8003530 con 0x7f6fd8155fc0 2024-01-19T04:16:57.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd6a00640 1 -- 172.21.15.32:0/3178881178 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd806b020 con 0x7f6fd8149180 2024-01-19T04:16:57.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.733+0000 7f6fd6a00640 1 --2- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd8149180 0x7f6fd806a6a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097a0 tx=0x7f6fc801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c298595e35ecb16 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fd5600640 1 -- 172.21.15.32:0/3178881178 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0001a00 con 0x7f6fd8149180 2024-01-19T04:16:57.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fd5600640 1 -- 172.21.15.32:0/3178881178 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc80a7050 con 0x7f6fd8149180 2024-01-19T04:16:57.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fd5600640 1 -- 172.21.15.32:0/3178881178 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80ab600 con 0x7f6fd8149180 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd8149180 msgr2=0x7f6fd806a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 --2- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd8149180 0x7f6fd806a6a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097a0 tx=0x7f6fc801c380 comp rx=0 tx=0).stop 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- 172.21.15.32:0/3178881178 shutdown_connections 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 --2- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd806abe0 0x7f6fd8155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 --2- 172.21.15.32:0/3178881178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd8149180 0x7f6fd806a6a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- 172.21.15.32:0/3178881178 >> 172.21.15.32:0/3178881178 conn(0x7f6fd80c2f00 msgr2=0x7f6fd80c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- 172.21.15.32:0/3178881178 shutdown_connections 2024-01-19T04:16:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- 172.21.15.32:0/3178881178 wait complete. 2024-01-19T04:16:57.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 Processor -- start 2024-01-19T04:16:57.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- start start 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd806abe0 0x7f6fd8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fd8149180 0x7f6fd8140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd8155fc0 0x7f6fd81411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8151370 con 0x7f6fd8149180 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81454e0 con 0x7f6fd806abe0 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.737+0000 7f6fddc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8150db0 con 0x7f6fd8155fc0 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fd8149180 0x7f6fd8140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd8155fc0 0x7f6fd81411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd806abe0 0x7f6fd8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fd8149180 0x7f6fd8140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46564/0 (socket says 172.21.15.32:46564) 2024-01-19T04:16:57.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 -- 172.21.15.32:0/930245940 learned_addr learned my addr 172.21.15.32:0/930245940 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:57.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 -- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd8155fc0 msgr2=0x7f6fd81411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd8155fc0 0x7f6fd81411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 -- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd806abe0 msgr2=0x7f6fd8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd806abe0 0x7f6fd8154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 -- 172.21.15.32:0/930245940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80093b0 con 0x7f6fd8149180 2024-01-19T04:16:57.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd7400640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd8155fc0 0x7f6fd81411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:57.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fd6000640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fd8149180 0x7f6fd8140c70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000e930 tx=0x7f6fc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fcea00640 1 -- 172.21.15.32:0/930245940 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0009690 con 0x7f6fd8149180 2024-01-19T04:16:57.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fcea00640 1 -- 172.21.15.32:0/930245940 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000ca00 con 0x7f6fd8149180 2024-01-19T04:16:57.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fcea00640 1 -- 172.21.15.32:0/930245940 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000cd70 con 0x7f6fd8149180 2024-01-19T04:16:57.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd8151090 con 0x7f6fd8149180 2024-01-19T04:16:57.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd81527b0 con 0x7f6fd8149180 2024-01-19T04:16:57.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd80749f0 con 0x7f6fd8149180 2024-01-19T04:16:57.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.741+0000 7f6fcea00640 1 -- 172.21.15.32:0/930245940 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6fc0013470 con 0x7f6fd8149180 2024-01-19T04:16:57.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.745+0000 7f6fcea00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6fb0066530 0x7f6fb00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:57.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.745+0000 7f6fcea00640 1 -- 172.21.15.32:0/930245940 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fc0083fa0 con 0x7f6fd8149180 2024-01-19T04:16:57.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.745+0000 7f6fd6a00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6fb0066530 0x7f6fb00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:57.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.745+0000 7f6fd6a00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6fb0066530 0x7f6fb00689f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80ad000 tx=0x7f6fc80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:57.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.749+0000 7f6fcea00640 1 -- 172.21.15.32:0/930245940 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6fc00b54d0 con 0x7f6fd8149180 2024-01-19T04:16:57.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6fd8072a50 con 0x7f6fd8149180 2024-01-19T04:16:57.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fcea00640 1 -- 172.21.15.32:0/930245940 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6fc00513b0 con 0x7f6fd8149180 2024-01-19T04:16:57.946 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6fb0066530 msgr2=0x7f6fb00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6fb0066530 0x7f6fb00689f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80ad000 tx=0x7f6fc80a6000 comp rx=0 tx=0).stop 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fd8149180 msgr2=0x7f6fd8140c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fd8149180 0x7f6fd8140c70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000e930 tx=0x7f6fc000edf0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 shutdown_connections 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6fb0066530 0x7f6fb00689f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6fd8155fc0 0x7f6fd81411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fd8149180 0x7f6fd8140c70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 --2- 172.21.15.32:0/930245940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fd806abe0 0x7f6fd8154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:57.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 >> 172.21.15.32:0/930245940 conn(0x7f6fd80c2f00 msgr2=0x7f6fd806b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:57.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 shutdown_connections 2024-01-19T04:16:57.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:57.945+0000 7f6fddc00640 1 -- 172.21.15.32:0/930245940 wait complete. 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:16:57.969 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:57.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:57.970 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:57.979 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42325sec preferred_lft 42325sec 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:1f:1a:e5:73 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:57.980 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:16:57.981 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:57.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:57.982 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:16:58.043 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-01-19T04:16:58.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:58.046 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-01-19T04:16:58.099 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-01-19T04:16:58.099 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:16:58.099 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-19T04:16:58.099 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:16:58.099 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-19T04:16:58.099 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:16:58.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:58.099 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:16:58.100 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:16:58.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-19T04:16:58.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-19T04:16:58.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-19T04:16:58.100 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:16:58.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:58.196 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:16:58.205 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T04:16:58.205 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:16:58.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:58.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-01-19T04:16:58.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:58.269 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:58.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:58.322 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:58.374 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-19T04:16:58.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:58.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:58.480 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:58.480 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:58.480 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:16:58.481 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:16:58.481 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:16:58.484 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:16:58.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:58.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:16:58.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:58.505 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:16:58.570 INFO:teuthology.orchestra.run.smithi032.stdout:client5994 2024-01-19T04:16:58.570 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:16:58.571 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:58.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:16:58.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b9200640 1 Processor -- start 2024-01-19T04:16:58.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b9200640 1 -- start start 2024-01-19T04:16:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b9200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f94b40c04a0 0x7f94b40c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b9200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b4071e80 con 0x7f94b414fb50 2024-01-19T04:16:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b9200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b40726c0 con 0x7f94b40a4ec0 2024-01-19T04:16:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b9200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b41535c0 con 0x7f94b40c04a0 2024-01-19T04:16:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f94b414fb50 0x7f94b406fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36288/0 (socket says 172.21.15.32:36288) 2024-01-19T04:16:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1e00640 1 -- 172.21.15.32:0/1246382919 learned_addr learned my addr 172.21.15.32:0/1246382919 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:58.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1400640 1 --2- 172.21.15.32:0/1246382919 >> v2:172.21.15.67:3300/0 conn(0x7f94b40c04a0 0x7f94b40c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148336901 0 0) 0x7f94b4071e80 con 0x7f94b414fb50 2024-01-19T04:16:58.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9494003530 con 0x7f94b414fb50 2024-01-19T04:16:58.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676577961 0 0) 0x7f9494003530 con 0x7f94b414fb50 2024-01-19T04:16:58.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 >> v2:172.21.15.67:3300/0 conn(0x7f94b40c04a0 msgr2=0x7f94b40c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:58.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 --2- 172.21.15.32:0/1246382919 >> v2:172.21.15.67:3300/0 conn(0x7f94b40c04a0 0x7f94b40c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:58.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 >> v1:172.21.15.67:6789/0 conn(0x7f94b40a4ec0 legacy=0x7f94b415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40c0a20 con 0x7f94b414fb50 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f94a4001680 con 0x7f94b414fb50 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 >> v1:172.21.15.32:6789/0 conn(0x7f94b414fb50 legacy=0x7f94b406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9494003980 0x7f9494003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494004380 0x7f9494004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94940050f0 0x7f949400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41535c0 con 0x7f9494003980 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949400c030 con 0x7f9494004380 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949400c1f0 con 0x7f94940050f0 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1400640 1 --2- 172.21.15.32:0/1246382919 >> v2:172.21.15.67:3300/0 conn(0x7f94b40c04a0 0x7f94b40c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1e00640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9494003980 0x7f9494003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b2800640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94940050f0 0x7f949400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1400640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494004380 0x7f9494004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1e00640 1 -- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94940050f0 msgr2=0x7f949400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:58.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1e00640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94940050f0 0x7f949400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:58.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1e00640 1 -- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494004380 msgr2=0x7f9494004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:16:58.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.805+0000 7f94b1e00640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494004380 0x7f9494004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:58.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b1e00640 1 -- 172.21.15.32:0/1246382919 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494003530 con 0x7f9494003980 2024-01-19T04:16:58.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b2800640 1 -- 172.21.15.32:0/1246382919 reap_dead start 2024-01-19T04:16:58.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b1e00640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9494003980 0x7f9494003d60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c210 tx=0x7f94a401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398d9b5c197144e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:58.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a40058e0 con 0x7f9494003980 2024-01-19T04:16:58.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4005a60 con 0x7f9494003980 2024-01-19T04:16:58.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b0a00640 1 -- 172.21.15.32:0/1246382919 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4005e50 con 0x7f9494003980 2024-01-19T04:16:58.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b9200640 1 -- 172.21.15.32:0/1246382919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9494003980 msgr2=0x7f9494003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b9200640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9494003980 0x7f9494003d60 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c210 tx=0x7f94a401cc60 comp rx=0 tx=0).stop 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b9200640 1 -- 172.21.15.32:0/1246382919 shutdown_connections 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b9200640 1 --2- 172.21.15.32:0/1246382919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9494003980 0x7f9494003d60 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.809+0000 7f94b9200640 1 -- 172.21.15.32:0/1246382919 >> 172.21.15.32:0/1246382919 conn(0x7f94b40c5b20 msgr2=0x7f94b40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 -- 172.21.15.32:0/1246382919 shutdown_connections 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 -- 172.21.15.32:0/1246382919 wait complete. 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 Processor -- start 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 -- start start 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494003980 0x7f94b414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b41e0620 0x7f94b414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94b41e0aa0 0x7f94b414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41e1080 con 0x7f94b41e0620 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41550c0 con 0x7f9494003980 2024-01-19T04:16:58.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41e12d0 con 0x7f94b41e0aa0 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b41e0620 0x7f94b414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b41e0620 0x7f94b414cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35290/0 (socket says 172.21.15.32:35290) 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 -- 172.21.15.32:0/1097163343 learned_addr learned my addr 172.21.15.32:0/1097163343 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1e00640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494003980 0x7f94b414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b2800640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94b41e0aa0 0x7f94b414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 -- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94b41e0aa0 msgr2=0x7f94b414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94b41e0aa0 0x7f94b414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 -- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494003980 msgr2=0x7f94b414f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494003980 0x7f94b414f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 -- 172.21.15.32:0/1097163343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b41e15b0 con 0x7f94b41e0620 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b1400640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b41e0620 0x7f94b414cb80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f949c011930 tx=0x7f949c011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94aa000640 1 -- 172.21.15.32:0/1097163343 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c009740 con 0x7f94b41e0620 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94aa000640 1 -- 172.21.15.32:0/1097163343 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c00fb50 con 0x7f94b41e0620 2024-01-19T04:16:58.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94aa000640 1 -- 172.21.15.32:0/1097163343 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00fec0 con 0x7f94b41e0620 2024-01-19T04:16:58.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.813+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b41e1890 con 0x7f94b41e0620 2024-01-19T04:16:58.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.817+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b414f5b0 con 0x7f94b41e0620 2024-01-19T04:16:58.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.817+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b40749f0 con 0x7f94b41e0620 2024-01-19T04:16:58.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.817+0000 7f94aa000640 1 -- 172.21.15.32:0/1097163343 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f949c015460 con 0x7f94b41e0620 2024-01-19T04:16:58.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.817+0000 7f94aa000640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f948c066500 0x7f948c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:58.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.817+0000 7f94aa000640 1 -- 172.21.15.32:0/1097163343 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f949c0846f0 con 0x7f94b41e0620 2024-01-19T04:16:58.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.817+0000 7f94b1e00640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f948c066500 0x7f948c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:58.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.821+0000 7f94b1e00640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f948c066500 0x7f948c0689c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f94a40ab000 tx=0x7f94a40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:58.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:58.821+0000 7f94aa000640 1 -- 172.21.15.32:0/1097163343 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f949c051a30 con 0x7f94b41e0620 2024-01-19T04:16:59.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.025+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94b40c56e0 con 0x7f94b41e0620 2024-01-19T04:16:59.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.025+0000 7f94aa000640 1 -- 172.21.15.32:0/1097163343 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f949c055050 con 0x7f94b41e0620 2024-01-19T04:16:59.028 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:16:59.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.025+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f948c066500 msgr2=0x7f948c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:59.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.025+0000 7f94b9200640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f948c066500 0x7f948c0689c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f94a40ab000 tx=0x7f94a40a7070 comp rx=0 tx=0).stop 2024-01-19T04:16:59.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.025+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b41e0620 msgr2=0x7f94b414cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:59.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.025+0000 7f94b9200640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b41e0620 0x7f94b414cb80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f949c011930 tx=0x7f949c011df0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 shutdown_connections 2024-01-19T04:16:59.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f948c066500 0x7f948c0689c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94b41e0aa0 0x7f94b414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b41e0620 0x7f94b414cb80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 --2- 172.21.15.32:0/1097163343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9494003980 0x7f94b414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 >> 172.21.15.32:0/1097163343 conn(0x7f94b40c5b20 msgr2=0x7f94b40a5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:59.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 shutdown_connections 2024-01-19T04:16:59.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.029+0000 7f94b9200640 1 -- 172.21.15.32:0/1097163343 wait complete. 2024-01-19T04:16:59.049 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:16:59.050 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:59.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.051 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:59.062 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42347sec preferred_lft 42347sec 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:59.063 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:16:59.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.065 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:16:59.124 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:16:59.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.127 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:16:59.180 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:16:59.180 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:16:59.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.181 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:16:59.182 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:16:59.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:16:59.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:16:59.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:16:59.182 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:16:59.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.278 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:16:59.287 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:16:59.287 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:59.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.288 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:16:59.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:59.353 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:59.404 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:16:59.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:16:59.405 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:59.456 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-19T04:16:59.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.456 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:59.547 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:59.547 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:59.560 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:16:59.560 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:16:59.560 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:16:59.560 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:16:59.560 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:16:59.564 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:16:59.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.564 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:16:59.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:16:59.586 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:16:59.639 INFO:teuthology.orchestra.run.smithi067.stdout:client5378 2024-01-19T04:16:59.639 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:16:59.639 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:16:59.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-19T04:16:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab97400640 1 Processor -- start 2024-01-19T04:16:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab97400640 1 -- start start 2024-01-19T04:16:59.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab97400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab90147f90 0x7fab90151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:59.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab97400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900c1d10 con 0x7fab900c18b0 2024-01-19T04:16:59.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab97400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900c0810 con 0x7fab900c55e0 2024-01-19T04:16:59.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab97400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9006c5c0 con 0x7fab90147f90 2024-01-19T04:16:59.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab95400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fab900c18b0 0x7fab900a4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36292/0 (socket says 172.21.15.32:36292) 2024-01-19T04:16:59.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab95400640 1 -- 172.21.15.32:0/2704682366 learned_addr learned my addr 172.21.15.32:0/2704682366 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:16:59.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.833+0000 7fab94a00640 1 --2- 172.21.15.32:0/2704682366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab90147f90 0x7fab90151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:59.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab8f400640 1 -- 172.21.15.32:0/2704682366 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608305739 0 0) 0x7fab900c0810 con 0x7fab900c55e0 2024-01-19T04:16:59.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab8f400640 1 -- 172.21.15.32:0/2704682366 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab70003530 con 0x7fab900c55e0 2024-01-19T04:16:59.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab8f400640 1 -- 172.21.15.32:0/2704682366 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758591864 0 0) 0x7fab900c1d10 con 0x7fab900c18b0 2024-01-19T04:16:59.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab8f400640 1 -- 172.21.15.32:0/2704682366 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab900c0810 con 0x7fab900c18b0 2024-01-19T04:16:59.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab94a00640 1 -- 172.21.15.32:0/2704682366 >> v1:172.21.15.67:6789/0 conn(0x7fab900c55e0 legacy=0x7fab9006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:59.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab94a00640 1 -- 172.21.15.32:0/2704682366 >> v1:172.21.15.32:6789/0 conn(0x7fab900c18b0 legacy=0x7fab900a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:59.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab94a00640 1 -- 172.21.15.32:0/2704682366 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900c0af0 con 0x7fab90147f90 2024-01-19T04:16:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab94a00640 1 --2- 172.21.15.32:0/2704682366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab90147f90 0x7fab90151350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab800097f0 tx=0x7fab8001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f74479eb04324eb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab8f400640 1 -- 172.21.15.32:0/2704682366 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800ab600 con 0x7fab90147f90 2024-01-19T04:16:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab8f400640 1 -- 172.21.15.32:0/2704682366 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab800ab760 con 0x7fab90147f90 2024-01-19T04:16:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.837+0000 7fab8f400640 1 -- 172.21.15.32:0/2704682366 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800abaf0 con 0x7fab90147f90 2024-01-19T04:16:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- 172.21.15.32:0/2704682366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab90147f90 msgr2=0x7fab90151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 --2- 172.21.15.32:0/2704682366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab90147f90 0x7fab90151350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab800097f0 tx=0x7fab8001c400 comp rx=0 tx=0).stop 2024-01-19T04:16:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- 172.21.15.32:0/2704682366 shutdown_connections 2024-01-19T04:16:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 --2- 172.21.15.32:0/2704682366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab90147f90 0x7fab90151350 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- 172.21.15.32:0/2704682366 >> 172.21.15.32:0/2704682366 conn(0x7fab900c5b20 msgr2=0x7fab900c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:16:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- 172.21.15.32:0/2704682366 shutdown_connections 2024-01-19T04:16:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- 172.21.15.32:0/2704682366 wait complete. 2024-01-19T04:16:59.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 Processor -- start 2024-01-19T04:16:59.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- start start 2024-01-19T04:16:59.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab900c18b0 0x7fab90153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:59.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab900c55e0 0x7fab9015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:59.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab90147f90 0x7fab901ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:59.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab901f16d0 con 0x7fab90147f90 2024-01-19T04:16:59.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90153180 con 0x7fab900c55e0 2024-01-19T04:16:59.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab97400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab901ed1e0 con 0x7fab900c18b0 2024-01-19T04:16:59.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab90147f90 0x7fab901ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:59.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab8fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab900c55e0 0x7fab9015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:59.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab94a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab900c18b0 0x7fab90153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:59.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab90147f90 0x7fab901ed6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35296/0 (socket says 172.21.15.32:35296) 2024-01-19T04:16:59.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 -- 172.21.15.32:0/801156412 learned_addr learned my addr 172.21.15.32:0/801156412 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 -- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab900c18b0 msgr2=0x7fab90153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab900c18b0 0x7fab90153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 -- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab900c55e0 msgr2=0x7fab9015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab900c55e0 0x7fab9015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.841+0000 7fab95400640 1 -- 172.21.15.32:0/801156412 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80009420 con 0x7fab90147f90 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab95400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab90147f90 0x7fab901ed6e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fab8800ca20 tx=0x7fab8800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab8cc00640 1 -- 172.21.15.32:0/801156412 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8800abd0 con 0x7fab90147f90 2024-01-19T04:16:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab8cc00640 1 -- 172.21.15.32:0/801156412 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8800ad30 con 0x7fab90147f90 2024-01-19T04:16:59.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab8cc00640 1 -- 172.21.15.32:0/801156412 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8800aea0 con 0x7fab90147f90 2024-01-19T04:16:59.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab901528e0 con 0x7fab90147f90 2024-01-19T04:16:59.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90152ea0 con 0x7fab90147f90 2024-01-19T04:16:59.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab901ed400 con 0x7fab90147f90 2024-01-19T04:16:59.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab8cc00640 1 -- 172.21.15.32:0/801156412 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fab88007070 con 0x7fab90147f90 2024-01-19T04:16:59.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab8cc00640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab68066500 0x7fab680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:16:59.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab8cc00640 1 -- 172.21.15.32:0/801156412 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab88083c40 con 0x7fab90147f90 2024-01-19T04:16:59.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.845+0000 7fab94a00640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab68066500 0x7fab680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:16:59.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.849+0000 7fab94a00640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab68066500 0x7fab680689c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab800af000 tx=0x7fab800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:16:59.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:16:59.849+0000 7fab8cc00640 1 -- 172.21.15.32:0/801156412 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fab901ed400 con 0x7fab90147f90 2024-01-19T04:17:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.065+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fab901ed400 con 0x7fab90147f90 2024-01-19T04:17:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.065+0000 7fab8cc00640 1 -- 172.21.15.32:0/801156412 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7fab901ed400 con 0x7fab90147f90 2024-01-19T04:17:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab68066500 msgr2=0x7fab680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab68066500 0x7fab680689c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab800af000 tx=0x7fab800a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab90147f90 msgr2=0x7fab901ed6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab90147f90 0x7fab901ed6e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fab8800ca20 tx=0x7fab8800cee0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 shutdown_connections 2024-01-19T04:17:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab68066500 0x7fab680689c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab90147f90 0x7fab901ed6e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab900c55e0 0x7fab9015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 --2- 172.21.15.32:0/801156412 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab900c18b0 0x7fab90153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 >> 172.21.15.32:0/801156412 conn(0x7fab900c5b20 msgr2=0x7fab900c2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 shutdown_connections 2024-01-19T04:17:00.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.069+0000 7fab97400640 1 -- 172.21.15.32:0/801156412 wait complete. 2024-01-19T04:17:00.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:00.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2c000640 1 Processor -- start 2024-01-19T04:17:00.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2c000640 1 -- start start 2024-01-19T04:17:00.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2c000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf240a6d30 0x7faf240c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2c000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf2406fda0 0x7faf240c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2c000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf241533a0 con 0x7faf240c6e20 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2c000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf24156380 con 0x7faf240a6d30 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2c000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2414fe40 con 0x7faf2406fda0 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf28c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf240a6d30 0x7faf240c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf28c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf240a6d30 0x7faf240c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35310/0 (socket says 172.21.15.32:35310) 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf28c00640 1 -- 172.21.15.32:0/3635571634 learned_addr learned my addr 172.21.15.32:0/3635571634 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf2a000640 1 --2- 172.21.15.32:0/3635571634 >> v2:172.21.15.67:3300/0 conn(0x7faf2406fda0 0x7faf240c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf28c00640 1 -- 172.21.15.32:0/3635571634 >> v2:172.21.15.67:3300/0 conn(0x7faf2406fda0 msgr2=0x7faf240c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf28c00640 1 --2- 172.21.15.32:0/3635571634 >> v2:172.21.15.67:3300/0 conn(0x7faf2406fda0 0x7faf240c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf28c00640 1 -- 172.21.15.32:0/3635571634 >> v1:172.21.15.67:6789/0 conn(0x7faf240c6e20 legacy=0x7faf24152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.233+0000 7faf28c00640 1 -- 172.21.15.32:0/3635571634 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24152800 con 0x7faf240a6d30 2024-01-19T04:17:00.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf28c00640 1 --2- 172.21.15.32:0/3635571634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240a6d30 0x7faf240c7200 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faf2406da10 tx=0x7faf0c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb8d30d3f6d4c98 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf23e00640 1 -- 172.21.15.32:0/3635571634 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0ad680 con 0x7faf240a6d30 2024-01-19T04:17:00.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf23e00640 1 -- 172.21.15.32:0/3635571634 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0ad7e0 con 0x7faf240a6d30 2024-01-19T04:17:00.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf23e00640 1 -- 172.21.15.32:0/3635571634 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0adb70 con 0x7faf240a6d30 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 -- 172.21.15.32:0/3635571634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240a6d30 msgr2=0x7faf240c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 --2- 172.21.15.32:0/3635571634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240a6d30 0x7faf240c7200 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faf2406da10 tx=0x7faf0c01c470 comp rx=0 tx=0).stop 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 -- 172.21.15.32:0/3635571634 shutdown_connections 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 --2- 172.21.15.32:0/3635571634 >> v2:172.21.15.67:3300/0 conn(0x7faf2406fda0 0x7faf240c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 --2- 172.21.15.32:0/3635571634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240a6d30 0x7faf240c7200 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 -- 172.21.15.32:0/3635571634 >> 172.21.15.32:0/3635571634 conn(0x7faf240a9870 msgr2=0x7faf240a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 -- 172.21.15.32:0/3635571634 shutdown_connections 2024-01-19T04:17:00.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.237+0000 7faf2c000640 1 -- 172.21.15.32:0/3635571634 wait complete. 2024-01-19T04:17:00.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 Processor -- start 2024-01-19T04:17:00.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 -- start start 2024-01-19T04:17:00.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf2406fda0 0x7faf240ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf240a6d30 0x7faf240acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240c6e20 0x7faf24154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240ab550 con 0x7faf240c6e20 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240aaa70 con 0x7faf240a6d30 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240aae90 con 0x7faf2406fda0 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240c6e20 0x7faf24154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240c6e20 0x7faf24154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35312/0 (socket says 172.21.15.32:35312) 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 -- 172.21.15.32:0/1202665731 learned_addr learned my addr 172.21.15.32:0/1202665731 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf28c00640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf240a6d30 0x7faf240acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf29600640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf2406fda0 0x7faf240ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 -- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf2406fda0 msgr2=0x7faf240ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf2406fda0 0x7faf240ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 -- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf240a6d30 msgr2=0x7faf240acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf240a6d30 0x7faf240acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 -- 172.21.15.32:0/1202665731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0094d0 con 0x7faf240c6e20 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf28c00640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf240a6d30 0x7faf240acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2a000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240c6e20 0x7faf24154a30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00efc0 tx=0x7faf1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf21600640 1 -- 172.21.15.32:0/1202665731 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c014480 con 0x7faf240c6e20 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf21600640 1 -- 172.21.15.32:0/1202665731 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00f040 con 0x7faf240c6e20 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf21600640 1 -- 172.21.15.32:0/1202665731 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c014820 con 0x7faf240c6e20 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf240ad0c0 con 0x7faf240c6e20 2024-01-19T04:17:00.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf241edd80 con 0x7faf240c6e20 2024-01-19T04:17:00.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.241+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240aabb0 con 0x7faf240c6e20 2024-01-19T04:17:00.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.245+0000 7faf21600640 1 -- 172.21.15.32:0/1202665731 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faf1c014980 con 0x7faf240c6e20 2024-01-19T04:17:00.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.245+0000 7faf21600640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faefc066500 0x7faefc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.245+0000 7faf21600640 1 -- 172.21.15.32:0/1202665731 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf1c0848b0 con 0x7faf240c6e20 2024-01-19T04:17:00.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.245+0000 7faf29600640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faefc066500 0x7faefc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.245+0000 7faf29600640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faefc066500 0x7faefc0689c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faf240c2190 tx=0x7faf14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.249+0000 7faf21600640 1 -- 172.21.15.32:0/1202665731 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faf240aabb0 con 0x7faf240c6e20 2024-01-19T04:17:00.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.409+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf240aabb0 con 0x7faf240c6e20 2024-01-19T04:17:00.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf21600640 1 -- 172.21.15.32:0/1202665731 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16470 (secure 0 0 0) 0x7faf240aabb0 con 0x7faf240c6e20 2024-01-19T04:17:00.415 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:00.415 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":53,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:16:52.561549+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faefc066500 msgr2=0x7faefc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faefc066500 0x7faefc0689c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faf240c2190 tx=0x7faf14009040 comp rx=0 tx=0).stop 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240c6e20 msgr2=0x7faf24154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240c6e20 0x7faf24154a30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00efc0 tx=0x7faf1c00c490 comp rx=0 tx=0).stop 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 shutdown_connections 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faefc066500 0x7faefc0689c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240c6e20 0x7faf24154a30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf240a6d30 0x7faf240acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 --2- 172.21.15.32:0/1202665731 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf2406fda0 0x7faf240ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 >> 172.21.15.32:0/1202665731 conn(0x7faf240a9870 msgr2=0x7faf240a8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:00.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 shutdown_connections 2024-01-19T04:17:00.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.413+0000 7faf2c000640 1 -- 172.21.15.32:0/1202665731 wait complete. 2024-01-19T04:17:00.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:16:48.753748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:16:49.947198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:00.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:00.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.577+0000 7f0b1d000640 1 Processor -- start 2024-01-19T04:17:00.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.577+0000 7f0b1d000640 1 -- start start 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b1d000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b180c4e50 0x7f0b180c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b1d000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b180c6120 0x7f0b180c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b1d000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b18152bc0 con 0x7f0b18152620 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b1d000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1806ea00 con 0x7f0b180c4e50 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b1d000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18152ea0 con 0x7f0b180c6120 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b15400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0b18152620 0x7f0b1806f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36298/0 (socket says 172.21.15.32:36298) 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b15400640 1 -- 172.21.15.32:0/1256182460 learned_addr learned my addr 172.21.15.32:0/1256182460 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b15e00640 1 --2- 172.21.15.32:0/1256182460 >> v2:172.21.15.67:3300/0 conn(0x7f0b180c4e50 0x7f0b180c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b16800640 1 --2- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b180c6120 0x7f0b180c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b14a00640 1 -- 172.21.15.32:0/1256182460 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264725726 0 0) 0x7f0b18152bc0 con 0x7f0b18152620 2024-01-19T04:17:00.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b14a00640 1 -- 172.21.15.32:0/1256182460 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af8003530 con 0x7f0b18152620 2024-01-19T04:17:00.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b15e00640 1 -- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b180c6120 msgr2=0x7f0b180c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:00.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b15e00640 1 --2- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b180c6120 0x7f0b180c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b15e00640 1 -- 172.21.15.32:0/1256182460 >> v1:172.21.15.32:6789/0 conn(0x7f0b18152620 legacy=0x7f0b1806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b15e00640 1 -- 172.21.15.32:0/1256182460 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18153180 con 0x7f0b180c4e50 2024-01-19T04:17:00.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.581+0000 7f0b16800640 1 --2- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b180c6120 0x7f0b180c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:00.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b15e00640 1 --2- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180c75a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0b080097c0 tx=0x7f0b0801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10abf0014d8477b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b14a00640 1 -- 172.21.15.32:0/1256182460 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080a8970 con 0x7f0b180c4e50 2024-01-19T04:17:00.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b14a00640 1 -- 172.21.15.32:0/1256182460 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b080a8ad0 con 0x7f0b180c4e50 2024-01-19T04:17:00.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b14a00640 1 -- 172.21.15.32:0/1256182460 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080a8e40 con 0x7f0b180c4e50 2024-01-19T04:17:00.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 -- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 msgr2=0x7f0b180c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 --2- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180c75a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0b080097c0 tx=0x7f0b0801ec70 comp rx=0 tx=0).stop 2024-01-19T04:17:00.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 -- 172.21.15.32:0/1256182460 shutdown_connections 2024-01-19T04:17:00.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 --2- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b180c6120 0x7f0b180c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 --2- 172.21.15.32:0/1256182460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180c75a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 -- 172.21.15.32:0/1256182460 >> 172.21.15.32:0/1256182460 conn(0x7f0b180c7d40 msgr2=0x7f0b180c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:00.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 -- 172.21.15.32:0/1256182460 shutdown_connections 2024-01-19T04:17:00.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 -- 172.21.15.32:0/1256182460 wait complete. 2024-01-19T04:17:00.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 Processor -- start 2024-01-19T04:17:00.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.585+0000 7f0b1d000640 1 -- start start 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180bea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b180c6120 0x7f0b1814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b18152620 0x7f0b181e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180bf300 con 0x7f0b180c6120 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180bef70 con 0x7f0b180c4e50 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1814ccc0 con 0x7f0b18152620 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b180c6120 0x7f0b1814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b180c6120 0x7f0b1814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35324/0 (socket says 172.21.15.32:35324) 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15400640 1 -- 172.21.15.32:0/3534807113 learned_addr learned my addr 172.21.15.32:0/3534807113 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15e00640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180bea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b16800640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b18152620 0x7f0b181e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15e00640 1 -- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b18152620 msgr2=0x7f0b181e7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15e00640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b18152620 0x7f0b181e7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15e00640 1 -- 172.21.15.32:0/3534807113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b180c6120 msgr2=0x7f0b1814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15e00640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b180c6120 0x7f0b1814dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15e00640 1 -- 172.21.15.32:0/3534807113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10009a70 con 0x7f0b180c4e50 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15400640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b180c6120 0x7f0b1814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b15e00640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180bea30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0b080af000 tx=0x7f0b0801ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b0e000640 1 -- 172.21.15.32:0/3534807113 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080b0da0 con 0x7f0b180c4e50 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b0e000640 1 -- 172.21.15.32:0/3534807113 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b08006e20 con 0x7f0b180c4e50 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b0e000640 1 -- 172.21.15.32:0/3534807113 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080b9670 con 0x7f0b180c4e50 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b08009420 con 0x7f0b180c4e50 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b180c3a00 con 0x7f0b180c4e50 2024-01-19T04:17:00.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b180749f0 con 0x7f0b180c4e50 2024-01-19T04:17:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.589+0000 7f0b0e000640 1 -- 172.21.15.32:0/3534807113 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0b080b7040 con 0x7f0b180c4e50 2024-01-19T04:17:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.593+0000 7f0b0e000640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0af0066500 0x7f0af00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.593+0000 7f0b0e000640 1 -- 172.21.15.32:0/3534807113 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b08121740 con 0x7f0b180c4e50 2024-01-19T04:17:00.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.593+0000 7f0b15400640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0af0066500 0x7f0af00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.593+0000 7f0b15400640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0af0066500 0x7f0af00689c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b180c5d40 tx=0x7f0b00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.597+0000 7f0b0e000640 1 -- 172.21.15.32:0/3534807113 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0b080ee9d0 con 0x7f0b180c4e50 2024-01-19T04:17:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b180c6d90 con 0x7f0b180c4e50 2024-01-19T04:17:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b0e000640 1 -- 172.21.15.32:0/3534807113 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b080f1ff0 con 0x7f0b180c4e50 2024-01-19T04:17:00.759 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0af0066500 msgr2=0x7f0af00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0af0066500 0x7f0af00689c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b180c5d40 tx=0x7f0b00009040 comp rx=0 tx=0).stop 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 msgr2=0x7f0b180bea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180bea30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0b080af000 tx=0x7f0b0801ba10 comp rx=0 tx=0).stop 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 shutdown_connections 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0af0066500 0x7f0af00689c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0b18152620 0x7f0b181e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b180c6120 0x7f0b1814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 --2- 172.21.15.32:0/3534807113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b180c4e50 0x7f0b180bea30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.757+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 >> 172.21.15.32:0/3534807113 conn(0x7f0b180c7d40 msgr2=0x7f0b180c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.761+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 shutdown_connections 2024-01-19T04:17:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.761+0000 7f0b1d000640 1 -- 172.21.15.32:0/3534807113 wait complete. 2024-01-19T04:17:00.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:17:00.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.921+0000 7f9ccc000640 1 Processor -- start 2024-01-19T04:17:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.921+0000 7f9ccc000640 1 -- start start 2024-01-19T04:17:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9ccc000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9cc4151dc0 0x7f9cc40c1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9ccc000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9cc40c4360 0x7f9cc406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9ccc000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc406c6a0 con 0x7f9cc40c15b0 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9ccc000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc41521a0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9ccc000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc4154cf0 con 0x7f9cc40c4360 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc9600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9cc4151dc0 0x7f9cc40c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc9600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9cc4151dc0 0x7f9cc40c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35336/0 (socket says 172.21.15.32:35336) 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc9600640 1 -- 172.21.15.32:0/1174420421 learned_addr learned my addr 172.21.15.32:0/1174420421 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc8c00640 1 --2- 172.21.15.32:0/1174420421 >> v2:172.21.15.67:3300/0 conn(0x7f9cc40c4360 0x7f9cc406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc9600640 1 -- 172.21.15.32:0/1174420421 >> v2:172.21.15.67:3300/0 conn(0x7f9cc40c4360 msgr2=0x7f9cc406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc9600640 1 --2- 172.21.15.32:0/1174420421 >> v2:172.21.15.67:3300/0 conn(0x7f9cc40c4360 0x7f9cc406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc9600640 1 -- 172.21.15.32:0/1174420421 >> v1:172.21.15.67:6789/0 conn(0x7f9cc40c15b0 legacy=0x7f9cc406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.925+0000 7f9cc9600640 1 -- 172.21.15.32:0/1174420421 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4154fd0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9cc9600640 1 --2- 172.21.15.32:0/1174420421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc40c1070 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40c22e0 tx=0x7f9cb401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb45c459d5a79d4d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9cc3e00640 1 -- 172.21.15.32:0/1174420421 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40aa430 con 0x7f9cc4151dc0 2024-01-19T04:17:00.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9cc3e00640 1 -- 172.21.15.32:0/1174420421 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40aa590 con 0x7f9cc4151dc0 2024-01-19T04:17:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9cc3e00640 1 -- 172.21.15.32:0/1174420421 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40aa920 con 0x7f9cc4151dc0 2024-01-19T04:17:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 -- 172.21.15.32:0/1174420421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 msgr2=0x7f9cc40c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 --2- 172.21.15.32:0/1174420421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc40c1070 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40c22e0 tx=0x7f9cb401c4d0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 -- 172.21.15.32:0/1174420421 shutdown_connections 2024-01-19T04:17:00.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 --2- 172.21.15.32:0/1174420421 >> v2:172.21.15.67:3300/0 conn(0x7f9cc40c4360 0x7f9cc406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 --2- 172.21.15.32:0/1174420421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc40c1070 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 -- 172.21.15.32:0/1174420421 >> 172.21.15.32:0/1174420421 conn(0x7f9cc40c7d00 msgr2=0x7f9cc40c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:00.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 -- 172.21.15.32:0/1174420421 shutdown_connections 2024-01-19T04:17:00.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 -- 172.21.15.32:0/1174420421 wait complete. 2024-01-19T04:17:00.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 Processor -- start 2024-01-19T04:17:00.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.929+0000 7f9ccc000640 1 -- start start 2024-01-19T04:17:00.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cc40c15b0 0x7f9cc414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cc40c4360 0x7f9cc406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc4157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41ee1a0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41edc40 con 0x7f9cc40c15b0 2024-01-19T04:17:00.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41edec0 con 0x7f9cc40c4360 2024-01-19T04:17:00.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc8c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cc40c4360 0x7f9cc406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cca000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc4157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cc40c15b0 0x7f9cc414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc8c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cc40c4360 0x7f9cc406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:49910/0 (socket says 172.21.15.32:49910) 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cc40c15b0 0x7f9cc414bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:39850/0 (socket says 172.21.15.32:39850) 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc9600640 1 -- 172.21.15.32:0/3701917121 learned_addr learned my addr 172.21.15.32:0/3701917121 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cca000640 1 -- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cc40c4360 msgr2=0x7f9cc406ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cca000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cc40c4360 0x7f9cc406ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cca000640 1 -- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cc40c15b0 msgr2=0x7f9cc414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cca000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cc40c15b0 0x7f9cc414bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cca000640 1 -- 172.21.15.32:0/3701917121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40094d0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cca000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc4157b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c730 tx=0x7f9cbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc1600640 1 -- 172.21.15.32:0/3701917121 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc003b80 con 0x7f9cc4151dc0 2024-01-19T04:17:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc1600640 1 -- 172.21.15.32:0/3701917121 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc003ce0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc1600640 1 -- 172.21.15.32:0/3701917121 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00aa30 con 0x7f9cc4151dc0 2024-01-19T04:17:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc40aaaf0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc40ab0b0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc406b900 con 0x7f9cc4151dc0 2024-01-19T04:17:00.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.933+0000 7f9cc1600640 1 -- 172.21.15.32:0/3701917121 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9cbc00ab90 con 0x7f9cc4151dc0 2024-01-19T04:17:00.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.937+0000 7f9cc1600640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9c9c066500 0x7f9c9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:00.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.937+0000 7f9cc1600640 1 -- 172.21.15.32:0/3701917121 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cbc083ad0 con 0x7f9cc4151dc0 2024-01-19T04:17:00.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.937+0000 7f9cc9600640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9c9c066500 0x7f9c9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:00.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.937+0000 7f9cc9600640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9c9c066500 0x7f9c9c0689c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cb401c510 tx=0x7f9cb40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:00.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:00.941+0000 7f9cc1600640 1 -- 172.21.15.32:0/3701917121 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9cbc050e10 con 0x7f9cc4151dc0 2024-01-19T04:17:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cc41578c0 con 0x7f9cc4151dc0 2024-01-19T04:17:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9cc1600640 1 -- 172.21.15.32:0/3701917121 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cbc054430 con 0x7f9cc4151dc0 2024-01-19T04:17:01.103 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9c9c066500 msgr2=0x7f9c9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9c9c066500 0x7f9c9c0689c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cb401c510 tx=0x7f9cb40b5040 comp rx=0 tx=0).stop 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 msgr2=0x7f9cc4157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc4157b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c730 tx=0x7f9cbc00cbf0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 shutdown_connections 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9c9c066500 0x7f9c9c0689c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cc4151dc0 0x7f9cc4157b60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cc40c4360 0x7f9cc406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 --2- 172.21.15.32:0/3701917121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cc40c15b0 0x7f9cc414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 >> 172.21.15.32:0/3701917121 conn(0x7f9cc40c7d00 msgr2=0x7f9cc4151290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 shutdown_connections 2024-01-19T04:17:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.101+0000 7f9ccc000640 1 -- 172.21.15.32:0/3701917121 wait complete. 2024-01-19T04:17:01.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:17:01.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.265+0000 7fae7e400640 1 Processor -- start 2024-01-19T04:17:01.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.265+0000 7fae7e400640 1 -- start start 2024-01-19T04:17:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae7e400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fae78152620 0x7fae780c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae7e400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae78152bc0 con 0x7fae780c4e50 2024-01-19T04:17:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae7e400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae78152ea0 con 0x7fae780c6120 2024-01-19T04:17:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae7e400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7806ea00 con 0x7fae78152620 2024-01-19T04:17:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae77400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fae780c4e50 0x7fae7806f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36302/0 (socket says 172.21.15.32:36302) 2024-01-19T04:17:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae77400640 1 -- 172.21.15.32:0/1400978754 learned_addr learned my addr 172.21.15.32:0/1400978754 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:01.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae76a00640 1 --2- 172.21.15.32:0/1400978754 >> v2:172.21.15.67:3300/0 conn(0x7fae78152620 0x7fae780c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae76000640 1 -- 172.21.15.32:0/1400978754 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322896297 0 0) 0x7fae78152bc0 con 0x7fae780c4e50 2024-01-19T04:17:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae76000640 1 -- 172.21.15.32:0/1400978754 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae58003530 con 0x7fae780c4e50 2024-01-19T04:17:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae76a00640 1 -- 172.21.15.32:0/1400978754 >> v1:172.21.15.67:6789/0 conn(0x7fae780c6120 legacy=0x7fae780c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae76000640 1 -- 172.21.15.32:0/1400978754 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058763948 0 0) 0x7fae58003530 con 0x7fae780c4e50 2024-01-19T04:17:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae76a00640 1 -- 172.21.15.32:0/1400978754 >> v1:172.21.15.32:6789/0 conn(0x7fae780c4e50 legacy=0x7fae7806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.269+0000 7fae76a00640 1 -- 172.21.15.32:0/1400978754 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78153180 con 0x7fae78152620 2024-01-19T04:17:01.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae76a00640 1 --2- 172.21.15.32:0/1400978754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c75a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae600097c0 tx=0x7fae6001c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d544688fa74cded server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae76000640 1 -- 172.21.15.32:0/1400978754 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68001680 con 0x7fae78152620 2024-01-19T04:17:01.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae76000640 1 -- 172.21.15.32:0/1400978754 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae600a7050 con 0x7fae78152620 2024-01-19T04:17:01.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae76000640 1 -- 172.21.15.32:0/1400978754 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600ab620 con 0x7fae78152620 2024-01-19T04:17:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 -- 172.21.15.32:0/1400978754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 msgr2=0x7fae780c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 --2- 172.21.15.32:0/1400978754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c75a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae600097c0 tx=0x7fae6001c2e0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 -- 172.21.15.32:0/1400978754 shutdown_connections 2024-01-19T04:17:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 --2- 172.21.15.32:0/1400978754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c75a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 -- 172.21.15.32:0/1400978754 >> 172.21.15.32:0/1400978754 conn(0x7fae780c7d40 msgr2=0x7fae780c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 -- 172.21.15.32:0/1400978754 shutdown_connections 2024-01-19T04:17:01.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 -- 172.21.15.32:0/1400978754 wait complete. 2024-01-19T04:17:01.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 Processor -- start 2024-01-19T04:17:01.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.273+0000 7fae7e400640 1 -- start start 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae780c4e50 0x7fae7814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae780c6120 0x7fae780c0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7814f040 con 0x7fae780c6120 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c0a60 con 0x7fae78152620 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c0d20 con 0x7fae780c4e50 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae780c6120 0x7fae780c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae780c6120 0x7fae780c0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35356/0 (socket says 172.21.15.32:35356) 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 -- 172.21.15.32:0/721839713 learned_addr learned my addr 172.21.15.32:0/721839713 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae77e00640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae77400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae780c4e50 0x7fae7814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 -- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae780c4e50 msgr2=0x7fae7814cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae780c4e50 0x7fae7814cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 -- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 msgr2=0x7fae780c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 -- 172.21.15.32:0/721839713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009420 con 0x7fae780c6120 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae77e00640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae76a00640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae780c6120 0x7fae780c0520 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae600ae040 tx=0x7fae6001ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae6f400640 1 -- 172.21.15.32:0/721839713 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60004220 con 0x7fae780c6120 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae6f400640 1 -- 172.21.15.32:0/721839713 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae60004380 con 0x7fae780c6120 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae780c1000 con 0x7fae780c6120 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae6f400640 1 -- 172.21.15.32:0/721839713 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600b7860 con 0x7fae780c6120 2024-01-19T04:17:01.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae781e7800 con 0x7fae780c6120 2024-01-19T04:17:01.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.277+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae78153a90 con 0x7fae780c6120 2024-01-19T04:17:01.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.281+0000 7fae6f400640 1 -- 172.21.15.32:0/721839713 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fae600b79c0 con 0x7fae780c6120 2024-01-19T04:17:01.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.281+0000 7fae6f400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae50066500 0x7fae500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.281+0000 7fae6f400640 1 -- 172.21.15.32:0/721839713 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae6011db10 con 0x7fae780c6120 2024-01-19T04:17:01.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.281+0000 7fae77400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae50066500 0x7fae500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.281+0000 7fae77400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae50066500 0x7fae500689c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae680011f0 tx=0x7fae68000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.285+0000 7fae6f400640 1 -- 172.21.15.32:0/721839713 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fae600eadd0 con 0x7fae780c6120 2024-01-19T04:17:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae780c6d90 con 0x7fae780c6120 2024-01-19T04:17:01.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae6f400640 1 -- 172.21.15.32:0/721839713 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae60006e20 con 0x7fae780c6120 2024-01-19T04:17:01.447 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae50066500 msgr2=0x7fae500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae50066500 0x7fae500689c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae680011f0 tx=0x7fae68000ee0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae780c6120 msgr2=0x7fae780c0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae780c6120 0x7fae780c0520 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae600ae040 tx=0x7fae6001ab20 comp rx=0 tx=0).stop 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 shutdown_connections 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fae50066500 0x7fae500689c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae78152620 0x7fae780c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae780c6120 0x7fae780c0520 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 --2- 172.21.15.32:0/721839713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fae780c4e50 0x7fae7814cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 >> 172.21.15.32:0/721839713 conn(0x7fae780c7d40 msgr2=0x7fae780a92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 shutdown_connections 2024-01-19T04:17:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.445+0000 7fae7e400640 1 -- 172.21.15.32:0/721839713 wait complete. 2024-01-19T04:17:01.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:17:01.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee56400640 1 Processor -- start 2024-01-19T04:17:01.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee56400640 1 -- start start 2024-01-19T04:17:01.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee56400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fee500c7050 0x7fee50070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee56400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee501530d0 con 0x7fee500c7430 2024-01-19T04:17:01.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee56400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500c78a0 con 0x7fee500acee0 2024-01-19T04:17:01.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee56400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee501524c0 con 0x7fee500c7050 2024-01-19T04:17:01.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee4f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fee500c7050 0x7fee50070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee4fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fee500c7430 0x7fee500c63a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36306/0 (socket says 172.21.15.32:36306) 2024-01-19T04:17:01.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee4fe00640 1 -- 172.21.15.32:0/557176124 learned_addr learned my addr 172.21.15.32:0/557176124 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:01.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee4f400640 1 -- 172.21.15.32:0/557176124 >> v1:172.21.15.67:6789/0 conn(0x7fee500acee0 legacy=0x7fee500c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:01.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee4f400640 1 -- 172.21.15.32:0/557176124 >> v1:172.21.15.32:6789/0 conn(0x7fee500c7430 legacy=0x7fee500c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.609+0000 7fee4f400640 1 -- 172.21.15.32:0/557176124 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee501527a0 con 0x7fee500c7050 2024-01-19T04:17:01.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee4f400640 1 --2- 172.21.15.32:0/557176124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7050 0x7fee50070230 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fee400097c0 tx=0x7fee4001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9605593a1a6e83f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee4e000640 1 -- 172.21.15.32:0/557176124 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee400ab600 con 0x7fee500c7050 2024-01-19T04:17:01.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee4e000640 1 -- 172.21.15.32:0/557176124 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee400a7050 con 0x7fee500c7050 2024-01-19T04:17:01.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee4e000640 1 -- 172.21.15.32:0/557176124 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee400ab980 con 0x7fee500c7050 2024-01-19T04:17:01.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 -- 172.21.15.32:0/557176124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7050 msgr2=0x7fee50070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 --2- 172.21.15.32:0/557176124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7050 0x7fee50070230 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fee400097c0 tx=0x7fee4001c3b0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 -- 172.21.15.32:0/557176124 shutdown_connections 2024-01-19T04:17:01.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 --2- 172.21.15.32:0/557176124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7050 0x7fee50070230 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 -- 172.21.15.32:0/557176124 >> 172.21.15.32:0/557176124 conn(0x7fee500a99f0 msgr2=0x7fee500a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:01.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 -- 172.21.15.32:0/557176124 shutdown_connections 2024-01-19T04:17:01.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 -- 172.21.15.32:0/557176124 wait complete. 2024-01-19T04:17:01.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 Processor -- start 2024-01-19T04:17:01.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.613+0000 7fee56400640 1 -- start start 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee500acee0 0x7fee501ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee500c7050 0x7fee500c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7430 0x7fee50147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50149ed0 con 0x7fee500c7430 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500c3fd0 con 0x7fee500c7050 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee501edb20 con 0x7fee500acee0 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7430 0x7fee50147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7430 0x7fee50147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35386/0 (socket says 172.21.15.32:35386) 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 -- 172.21.15.32:0/4019081360 learned_addr learned my addr 172.21.15.32:0/4019081360 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:01.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4f400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee500acee0 0x7fee501ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4ea00640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee500c7050 0x7fee500c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 -- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee500acee0 msgr2=0x7fee501ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee500acee0 0x7fee501ed5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 -- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee500c7050 msgr2=0x7fee500c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee500c7050 0x7fee500c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 -- 172.21.15.32:0/4019081360 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee40009420 con 0x7fee500c7430 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4f400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee500acee0 0x7fee501ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee4fe00640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7430 0x7fee50147c60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fee4800cab0 tx=0x7fee4800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee47400640 1 -- 172.21.15.32:0/4019081360 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800ab70 con 0x7fee500c7430 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5014a750 con 0x7fee500c7430 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee47400640 1 -- 172.21.15.32:0/4019081360 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800acd0 con 0x7fee500c7430 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee47400640 1 -- 172.21.15.32:0/4019081360 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48012600 con 0x7fee500c7430 2024-01-19T04:17:01.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee500c3cf0 con 0x7fee500c7430 2024-01-19T04:17:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.617+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5014a8e0 con 0x7fee500c7430 2024-01-19T04:17:01.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.621+0000 7fee47400640 1 -- 172.21.15.32:0/4019081360 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fee48012760 con 0x7fee500c7430 2024-01-19T04:17:01.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.621+0000 7fee47400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee28066530 0x7fee280689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.621+0000 7fee47400640 1 -- 172.21.15.32:0/4019081360 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee48083c70 con 0x7fee500c7430 2024-01-19T04:17:01.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.621+0000 7fee4f400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee28066530 0x7fee280689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.621+0000 7fee4f400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee28066530 0x7fee280689f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee400ad000 tx=0x7fee400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.625+0000 7fee47400640 1 -- 172.21.15.32:0/4019081360 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fee48050f20 con 0x7fee500c7430 2024-01-19T04:17:01.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fee500749f0 con 0x7fee500c7430 2024-01-19T04:17:01.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee47400640 1 -- 172.21.15.32:0/4019081360 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+207 (secure 0 0 0) 0x7fee48017090 con 0x7fee500c7430 2024-01-19T04:17:01.790 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 8, 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "cephfs_metadata" 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 9, 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "cephfs_data" 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:01.791 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee28066530 msgr2=0x7fee280689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee28066530 0x7fee280689f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee400ad000 tx=0x7fee400a6000 comp rx=0 tx=0).stop 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7430 msgr2=0x7fee50147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7430 0x7fee50147c60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fee4800cab0 tx=0x7fee4800cf70 comp rx=0 tx=0).stop 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 shutdown_connections 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee28066530 0x7fee280689f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee500c7430 0x7fee50147c60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee500c7050 0x7fee500c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 --2- 172.21.15.32:0/4019081360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee500acee0 0x7fee501ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 >> 172.21.15.32:0/4019081360 conn(0x7fee500a99f0 msgr2=0x7fee5014f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 shutdown_connections 2024-01-19T04:17:01.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.789+0000 7fee56400640 1 -- 172.21.15.32:0/4019081360 wait complete. 2024-01-19T04:17:01.813 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-19T04:17:01.813 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-19T04:17:01.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.953+0000 7f79c5c00640 1 Processor -- start 2024-01-19T04:17:01.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79c5c00640 1 -- start start 2024-01-19T04:17:01.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79c5c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79c00a74f0 0x7f79c01586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79c5c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00c7bb0 con 0x7f79c00c4a10 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79c5c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00c5f60 con 0x7f79c006b820 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79c5c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00c5790 con 0x7f79c00a74f0 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f79c00c4a10 0x7f79c00c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36316/0 (socket says 172.21.15.32:36316) 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bea00640 1 -- 172.21.15.32:0/2823044906 learned_addr learned my addr 172.21.15.32:0/2823044906 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bf400640 1 --2- 172.21.15.32:0/2823044906 >> v2:172.21.15.67:3300/0 conn(0x7f79c00a74f0 0x7f79c01586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bd600640 1 -- 172.21.15.32:0/2823044906 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195586294 0 0) 0x7f79c00c7bb0 con 0x7f79c00c4a10 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bd600640 1 -- 172.21.15.32:0/2823044906 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a0003530 con 0x7f79c00c4a10 2024-01-19T04:17:01.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bf400640 1 -- 172.21.15.32:0/2823044906 >> v1:172.21.15.67:6789/0 conn(0x7f79c006b820 legacy=0x7f79c00a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bf400640 1 -- 172.21.15.32:0/2823044906 >> v1:172.21.15.32:6789/0 conn(0x7f79c00c4a10 legacy=0x7f79c00c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.957+0000 7f79bf400640 1 -- 172.21.15.32:0/2823044906 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00c75f0 con 0x7f79c00a74f0 2024-01-19T04:17:01.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79bf400640 1 --2- 172.21.15.32:0/2823044906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00a74f0 0x7f79c01586e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009d90 tx=0x7f79b801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17c8543362ff0b6f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79bd600640 1 -- 172.21.15.32:0/2823044906 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80a5870 con 0x7f79c00a74f0 2024-01-19T04:17:01.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79bd600640 1 -- 172.21.15.32:0/2823044906 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b80a59d0 con 0x7f79c00a74f0 2024-01-19T04:17:01.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79bd600640 1 -- 172.21.15.32:0/2823044906 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80a5d60 con 0x7f79c00a74f0 2024-01-19T04:17:01.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 -- 172.21.15.32:0/2823044906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00a74f0 msgr2=0x7f79c01586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 --2- 172.21.15.32:0/2823044906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00a74f0 0x7f79c01586e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009d90 tx=0x7f79b801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 -- 172.21.15.32:0/2823044906 shutdown_connections 2024-01-19T04:17:01.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 --2- 172.21.15.32:0/2823044906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00a74f0 0x7f79c01586e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 -- 172.21.15.32:0/2823044906 >> 172.21.15.32:0/2823044906 conn(0x7f79c00a99f0 msgr2=0x7f79c00a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:01.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 -- 172.21.15.32:0/2823044906 shutdown_connections 2024-01-19T04:17:01.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 -- 172.21.15.32:0/2823044906 wait complete. 2024-01-19T04:17:01.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 Processor -- start 2024-01-19T04:17:01.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.961+0000 7f79c5c00640 1 -- start start 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79c006b820 0x7f79c006bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c00a74f0 0x7f79c01496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00c4a10 0x7f79c0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01536e0 con 0x7f79c006b820 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01545d0 con 0x7f79c00c4a10 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01542f0 con 0x7f79c00a74f0 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79c006b820 0x7f79c006bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79c006b820 0x7f79c006bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35390/0 (socket says 172.21.15.32:35390) 2024-01-19T04:17:01.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 -- 172.21.15.32:0/3178147031 learned_addr learned my addr 172.21.15.32:0/3178147031 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bf400640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00c4a10 0x7f79c0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79be000640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c00a74f0 0x7f79c01496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 -- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c00a74f0 msgr2=0x7f79c01496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c00a74f0 0x7f79c01496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 -- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00c4a10 msgr2=0x7f79c0149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00c4a10 0x7f79c0149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 -- 172.21.15.32:0/3178147031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009a70 con 0x7f79c006b820 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79be000640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c00a74f0 0x7f79c01496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79bea00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79c006b820 0x7f79c006bf00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f79b000c420 tx=0x7f79b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79b6a00640 1 -- 172.21.15.32:0/3178147031 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0005cf0 con 0x7f79c006b820 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79b6a00640 1 -- 172.21.15.32:0/3178147031 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0005e50 con 0x7f79c006b820 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c01f0a80 con 0x7f79c006b820 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79b6a00640 1 -- 172.21.15.32:0/3178147031 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00072d0 con 0x7f79c006b820 2024-01-19T04:17:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c0153300 con 0x7f79c006b820 2024-01-19T04:17:01.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.965+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c004e980 con 0x7f79c006b820 2024-01-19T04:17:01.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.969+0000 7f79b6a00640 1 -- 172.21.15.32:0/3178147031 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f79b0007430 con 0x7f79c006b820 2024-01-19T04:17:01.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.969+0000 7f79b6a00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7998066500 0x7f79980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:01.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.969+0000 7f79b6a00640 1 -- 172.21.15.32:0/3178147031 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b00833e0 con 0x7f79c006b820 2024-01-19T04:17:01.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.969+0000 7f79be000640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7998066500 0x7f79980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:01.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.969+0000 7f79be000640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7998066500 0x7f79980689c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f79c00c71e0 tx=0x7f79a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:01.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:01.973+0000 7f79b6a00640 1 -- 172.21.15.32:0/3178147031 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f79b0050720 con 0x7f79c006b820 2024-01-19T04:17:02.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.133+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f79c00701f0 con 0x7f79c006b820 2024-01-19T04:17:02.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.677+0000 7f79b6a00640 1 -- 172.21.15.32:0/3178147031 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v54) v1 ==== 140+0+0 (secure 0 0 0) 0x7f79b0053d40 con 0x7f79c006b820 2024-01-19T04:17:02.679 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_metadata' created 2024-01-19T04:17:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7998066500 msgr2=0x7f79980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7998066500 0x7f79980689c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f79c00c71e0 tx=0x7f79a8009040 comp rx=0 tx=0).stop 2024-01-19T04:17:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79c006b820 msgr2=0x7f79c006bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79c006b820 0x7f79c006bf00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f79b000c420 tx=0x7f79b000c8e0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 shutdown_connections 2024-01-19T04:17:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7998066500 0x7f79980689c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79c00c4a10 0x7f79c0149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f79c00a74f0 0x7f79c01496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 --2- 172.21.15.32:0/3178147031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79c006b820 0x7f79c006bf00 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 >> 172.21.15.32:0/3178147031 conn(0x7f79c00a99f0 msgr2=0x7f79c00a9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 shutdown_connections 2024-01-19T04:17:02.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.681+0000 7f79c5c00640 1 -- 172.21.15.32:0/3178147031 wait complete. 2024-01-19T04:17:02.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:17:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.853+0000 7f2c4f800640 1 Processor -- start 2024-01-19T04:17:02.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.853+0000 7f2c4f800640 1 -- start start 2024-01-19T04:17:02.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4f800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2c48153120 0x7f2c480719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4f800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c48071510 con 0x7f2c4806e540 2024-01-19T04:17:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4f800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4806d830 con 0x7f2c48072830 2024-01-19T04:17:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4f800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4806db10 con 0x7f2c48153120 2024-01-19T04:17:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2c48153120 0x7f2c480719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2c48153120 0x7f2c480719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35402/0 (socket says 172.21.15.32:35402) 2024-01-19T04:17:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4d800640 1 -- 172.21.15.32:0/1179862057 learned_addr learned my addr 172.21.15.32:0/1179862057 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:02.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4ce00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2c4806e540 0x7f2c48156460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36330/0 (socket says 172.21.15.32:36330) 2024-01-19T04:17:02.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4d800640 1 -- 172.21.15.32:0/1179862057 >> v1:172.21.15.67:6789/0 conn(0x7f2c48072830 legacy=0x7f2c48152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:02.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4d800640 1 -- 172.21.15.32:0/1179862057 >> v1:172.21.15.32:6789/0 conn(0x7f2c4806e540 legacy=0x7f2c48156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:02.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c47400640 1 -- 172.21.15.32:0/1179862057 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108240895 0 0) 0x7f2c48071510 con 0x7f2c4806e540 2024-01-19T04:17:02.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.857+0000 7f2c4d800640 1 -- 172.21.15.32:0/1179862057 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4806ddf0 con 0x7f2c48153120 2024-01-19T04:17:02.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4d800640 1 --2- 172.21.15.32:0/1179862057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c480719a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009e50 tx=0x7f2c4001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9ab2d9043f1878 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:02.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c47400640 1 -- 172.21.15.32:0/1179862057 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400a5750 con 0x7f2c48153120 2024-01-19T04:17:02.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c47400640 1 -- 172.21.15.32:0/1179862057 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400a58b0 con 0x7f2c48153120 2024-01-19T04:17:02.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c47400640 1 -- 172.21.15.32:0/1179862057 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400a5c40 con 0x7f2c48153120 2024-01-19T04:17:02.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 -- 172.21.15.32:0/1179862057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 msgr2=0x7f2c480719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:02.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 --2- 172.21.15.32:0/1179862057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c480719a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009e50 tx=0x7f2c4001c950 comp rx=0 tx=0).stop 2024-01-19T04:17:02.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 -- 172.21.15.32:0/1179862057 shutdown_connections 2024-01-19T04:17:02.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 --2- 172.21.15.32:0/1179862057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c480719a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 -- 172.21.15.32:0/1179862057 >> 172.21.15.32:0/1179862057 conn(0x7f2c480a8220 msgr2=0x7f2c480a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:02.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 -- 172.21.15.32:0/1179862057 shutdown_connections 2024-01-19T04:17:02.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 -- 172.21.15.32:0/1179862057 wait complete. 2024-01-19T04:17:02.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 Processor -- start 2024-01-19T04:17:02.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.861+0000 7f2c4f800640 1 -- start start 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c4806e540 0x7f2c481ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c48072830 0x7f2c48154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c481ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48071a80 con 0x7f2c48153120 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48155160 con 0x7f2c48072830 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48153b80 con 0x7f2c4806e540 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c481ebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:02.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c481ebc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35404/0 (socket says 172.21.15.32:35404) 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 -- 172.21.15.32:0/3131812190 learned_addr learned my addr 172.21.15.32:0/3131812190 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4ce00640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c4806e540 0x7f2c481ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c47e00640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c48072830 0x7f2c48154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 -- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c4806e540 msgr2=0x7f2c481ea7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c4806e540 0x7f2c481ea7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 -- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c48072830 msgr2=0x7f2c48154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c48072830 0x7f2c48154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 -- 172.21.15.32:0/3131812190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009b30 con 0x7f2c48153120 2024-01-19T04:17:02.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4d800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c481ebc30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2c400af040 tx=0x7f2c400196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:02.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c44c00640 1 -- 172.21.15.32:0/3131812190 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400b8670 con 0x7f2c48153120 2024-01-19T04:17:02.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c44c00640 1 -- 172.21.15.32:0/3131812190 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400b87f0 con 0x7f2c48153120 2024-01-19T04:17:02.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c44c00640 1 -- 172.21.15.32:0/3131812190 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400b8ba0 con 0x7f2c48153120 2024-01-19T04:17:02.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c48153e60 con 0x7f2c48153120 2024-01-19T04:17:02.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c48154420 con 0x7f2c48153120 2024-01-19T04:17:02.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.865+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4815dc10 con 0x7f2c48153120 2024-01-19T04:17:02.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.869+0000 7f2c44c00640 1 -- 172.21.15.32:0/3131812190 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2c400b8d00 con 0x7f2c48153120 2024-01-19T04:17:02.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.869+0000 7f2c44c00640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2c20066500 0x7f2c200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:02.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.869+0000 7f2c44c00640 1 -- 172.21.15.32:0/3131812190 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f2c4806eb30 con 0x7f2c48153120 2024-01-19T04:17:02.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.869+0000 7f2c4ce00640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2c20066500 0x7f2c200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:02.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.869+0000 7f2c4ce00640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2c20066500 0x7f2c200689c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000f70 tx=0x7f2c38007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:02.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:02.873+0000 7f2c44c00640 1 -- 172.21.15.32:0/3131812190 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2c400ed140 con 0x7f2c48153120 2024-01-19T04:17:03.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.029+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2c480749f0 con 0x7f2c48153120 2024-01-19T04:17:03.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.681+0000 7f2c44c00640 1 -- 172.21.15.32:0/3131812190 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v55) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2c400f0760 con 0x7f2c48153120 2024-01-19T04:17:03.686 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_data' created 2024-01-19T04:17:03.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2c20066500 msgr2=0x7f2c200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:03.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2c20066500 0x7f2c200689c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000f70 tx=0x7f2c38007240 comp rx=0 tx=0).stop 2024-01-19T04:17:03.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 msgr2=0x7f2c481ebc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:03.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c481ebc30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2c400af040 tx=0x7f2c400196f0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 shutdown_connections 2024-01-19T04:17:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2c20066500 0x7f2c200689c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c48153120 0x7f2c481ebc30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c48072830 0x7f2c48154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 --2- 172.21.15.32:0/3131812190 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2c4806e540 0x7f2c481ea7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.689+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 >> 172.21.15.32:0/3131812190 conn(0x7f2c480a8220 msgr2=0x7f2c480c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:03.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.693+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 shutdown_connections 2024-01-19T04:17:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.693+0000 7f2c4f800640 1 -- 172.21.15.32:0/3131812190 wait complete. 2024-01-19T04:17:03.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-19T04:17:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c8800640 1 Processor -- start 2024-01-19T04:17:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c8800640 1 -- start start 2024-01-19T04:17:03.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c8800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c006c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:03.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c8800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd9c0072490 0x7fd9c006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c8800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c00beed0 con 0x7fd9c00bf360 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c8800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c00c3a80 con 0x7fd9c0072490 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c8800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00c3d60 con 0x7fd9c0155520 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd9c0072490 0x7fd9c006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd9c0072490 0x7fd9c006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35418/0 (socket says 172.21.15.32:35418) 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5400640 1 -- 172.21.15.32:0/2665862812 learned_addr learned my addr 172.21.15.32:0/2665862812 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5e00640 1 --2- 172.21.15.32:0/2665862812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c006c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:03.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5400640 1 -- 172.21.15.32:0/2665862812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 msgr2=0x7fd9c006c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5400640 1 --2- 172.21.15.32:0/2665862812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c006c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5400640 1 -- 172.21.15.32:0/2665862812 >> v1:172.21.15.67:6789/0 conn(0x7fd9c00bf360 legacy=0x7fd9c00a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5400640 1 -- 172.21.15.32:0/2665862812 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00c4040 con 0x7fd9c0072490 2024-01-19T04:17:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.881+0000 7fd9c5e00640 1 --2- 172.21.15.32:0/2665862812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c006c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:03.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c5400640 1 --2- 172.21.15.32:0/2665862812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c0072490 0x7fd9c006d9b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009870 tx=0x7fd9a801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235d3b666e59050e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:03.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c4a00640 1 -- 172.21.15.32:0/2665862812 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80ab600 con 0x7fd9c0072490 2024-01-19T04:17:03.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c4a00640 1 -- 172.21.15.32:0/2665862812 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a80a7050 con 0x7fd9c0072490 2024-01-19T04:17:03.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c4a00640 1 -- 172.21.15.32:0/2665862812 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80ab980 con 0x7fd9c0072490 2024-01-19T04:17:03.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 -- 172.21.15.32:0/2665862812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c0072490 msgr2=0x7fd9c006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:03.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2665862812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c0072490 0x7fd9c006d9b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009870 tx=0x7fd9a801c4b0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 -- 172.21.15.32:0/2665862812 shutdown_connections 2024-01-19T04:17:03.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2665862812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c0072490 0x7fd9c006d9b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2665862812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c006c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 -- 172.21.15.32:0/2665862812 >> 172.21.15.32:0/2665862812 conn(0x7fd9c00c25a0 msgr2=0x7fd9c00c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:03.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 -- 172.21.15.32:0/2665862812 shutdown_connections 2024-01-19T04:17:03.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.885+0000 7fd9c8800640 1 -- 172.21.15.32:0/2665862812 wait complete. 2024-01-19T04:17:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 Processor -- start 2024-01-19T04:17:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 -- start start 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9c0072490 0x7fd9c00a6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c00bf360 0x7fd9c0157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c01576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0156070 con 0x7fd9c00bf360 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c01f18f0 con 0x7fd9c0072490 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c014a110 con 0x7fd9c0155520 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c00bf360 0x7fd9c0157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9c0072490 0x7fd9c00a6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c00bf360 0x7fd9c0157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35428/0 (socket says 172.21.15.32:35428) 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 -- 172.21.15.32:0/2299472516 learned_addr learned my addr 172.21.15.32:0/2299472516 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c6800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c01576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 -- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 msgr2=0x7fd9c01576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c01576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 -- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9c0072490 msgr2=0x7fd9c00a6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9c0072490 0x7fd9c00a6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 -- 172.21.15.32:0/2299472516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80094d0 con 0x7fd9c00bf360 2024-01-19T04:17:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c6800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c01576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:03.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c5400640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c00bf360 0x7fd9c0157160 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80ae040 tx=0x7fd9a801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:03.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9be000640 1 -- 172.21.15.32:0/2299472516 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80b6620 con 0x7fd9c00bf360 2024-01-19T04:17:03.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9be000640 1 -- 172.21.15.32:0/2299472516 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a80abe90 con 0x7fd9c00bf360 2024-01-19T04:17:03.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c01f1d80 con 0x7fd9c00bf360 2024-01-19T04:17:03.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.889+0000 7fd9be000640 1 -- 172.21.15.32:0/2299472516 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80b69e0 con 0x7fd9c00bf360 2024-01-19T04:17:03.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.893+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c01f12a0 con 0x7fd9c00bf360 2024-01-19T04:17:03.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.893+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c00749f0 con 0x7fd9c00bf360 2024-01-19T04:17:03.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.893+0000 7fd9be000640 1 -- 172.21.15.32:0/2299472516 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd9a80b2040 con 0x7fd9c00bf360 2024-01-19T04:17:03.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.893+0000 7fd9be000640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd998066500 0x7fd9980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:03.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.893+0000 7fd9be000640 1 -- 172.21.15.32:0/2299472516 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fd9a811ea10 con 0x7fd9c00bf360 2024-01-19T04:17:03.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.893+0000 7fd9c5e00640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd998066500 0x7fd9980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:03.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.897+0000 7fd9c5e00640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd998066500 0x7fd9980689c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9c015ec30 tx=0x7fd9b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:03.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:03.897+0000 7fd9be000640 1 -- 172.21.15.32:0/2299472516 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd9a80ebae0 con 0x7fd9c00bf360 2024-01-19T04:17:04.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.089+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fd9c00c50e0 con 0x7fd9c00bf360 2024-01-19T04:17:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.685+0000 7fd9be000640 1 -- 172.21.15.32:0/2299472516 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v32) v1 ==== 177+0+0 (secure 0 0 0) 0x7fd9a80ef100 con 0x7fd9c00bf360 2024-01-19T04:17:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 10 and data pool 11 2024-01-19T04:17:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd998066500 msgr2=0x7fd9980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd998066500 0x7fd9980689c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9c015ec30 tx=0x7fd9b0008040 comp rx=0 tx=0).stop 2024-01-19T04:17:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c00bf360 msgr2=0x7fd9c0157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c00bf360 0x7fd9c0157160 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80ae040 tx=0x7fd9a801acf0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 shutdown_connections 2024-01-19T04:17:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd998066500 0x7fd9980689c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd9c0155520 0x7fd9c01576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9c00bf360 0x7fd9c0157160 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 --2- 172.21.15.32:0/2299472516 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9c0072490 0x7fd9c00a6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 >> 172.21.15.32:0/2299472516 conn(0x7fd9c00c25a0 msgr2=0x7fd9c006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.689+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 shutdown_connections 2024-01-19T04:17:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.693+0000 7fd9c8800640 1 -- 172.21.15.32:0/2299472516 wait complete. 2024-01-19T04:17:04.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:04.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f011c200640 1 Processor -- start 2024-01-19T04:17:04.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f011c200640 1 -- start start 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f011c200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01140a6d30 0x7f01140c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f011c200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01141533a0 con 0x7f01140c6e20 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f011c200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0114152800 con 0x7f011406fda0 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f011c200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0114156380 con 0x7f01140a6d30 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f0118e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01140a6d30 0x7f01140c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f0118e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01140a6d30 0x7f01140c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35440/0 (socket says 172.21.15.32:35440) 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f0118e00640 1 -- 172.21.15.32:0/397559890 learned_addr learned my addr 172.21.15.32:0/397559890 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:04.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f0119800640 1 --1- 172.21.15.32:0/397559890 >> v1:172.21.15.32:6789/0 conn(0x7f01140c6e20 0x7f0114152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36334/0 (socket says 172.21.15.32:36334) 2024-01-19T04:17:04.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f0118e00640 1 -- 172.21.15.32:0/397559890 >> v1:172.21.15.67:6789/0 conn(0x7f011406fda0 legacy=0x7f011415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:04.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f0118e00640 1 -- 172.21.15.32:0/397559890 >> v1:172.21.15.32:6789/0 conn(0x7f01140c6e20 legacy=0x7f0114152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:04.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.881+0000 7f0118e00640 1 -- 172.21.15.32:0/397559890 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114156590 con 0x7f01140a6d30 2024-01-19T04:17:04.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f0118e00640 1 --2- 172.21.15.32:0/397559890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140a6d30 0x7f01140c7200 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009870 tx=0x7f00fc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718fda19f032163f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:04.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f0113e00640 1 -- 172.21.15.32:0/397559890 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0ad680 con 0x7f01140a6d30 2024-01-19T04:17:04.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f0113e00640 1 -- 172.21.15.32:0/397559890 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc0ad7e0 con 0x7f01140a6d30 2024-01-19T04:17:04.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f0113e00640 1 -- 172.21.15.32:0/397559890 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0adb70 con 0x7f01140a6d30 2024-01-19T04:17:04.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 -- 172.21.15.32:0/397559890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140a6d30 msgr2=0x7f01140c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:04.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 --2- 172.21.15.32:0/397559890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140a6d30 0x7f01140c7200 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009870 tx=0x7f00fc01c4b0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 -- 172.21.15.32:0/397559890 shutdown_connections 2024-01-19T04:17:04.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 --2- 172.21.15.32:0/397559890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140a6d30 0x7f01140c7200 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 -- 172.21.15.32:0/397559890 >> 172.21.15.32:0/397559890 conn(0x7f01140a9870 msgr2=0x7f01140a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:04.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 -- 172.21.15.32:0/397559890 shutdown_connections 2024-01-19T04:17:04.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 -- 172.21.15.32:0/397559890 wait complete. 2024-01-19T04:17:04.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.885+0000 7f011c200640 1 Processor -- start 2024-01-19T04:17:04.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 -- start start 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011406fda0 0x7f0114154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01140a6d30 0x7f01141ed110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140c6e20 0x7f01141ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011414e510 con 0x7f01140c6e20 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011414e930 con 0x7f01140a6d30 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011406d610 con 0x7f011406fda0 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140c6e20 0x7f01141ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:04.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140c6e20 0x7f01141ed650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35450/0 (socket says 172.21.15.32:35450) 2024-01-19T04:17:04.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 -- 172.21.15.32:0/1091900963 learned_addr learned my addr 172.21.15.32:0/1091900963 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:04.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f0118e00640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01140a6d30 0x7f01141ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:04.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f0119800640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011406fda0 0x7f0114154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 -- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011406fda0 msgr2=0x7f0114154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011406fda0 0x7f0114154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 -- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01140a6d30 msgr2=0x7f01141ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01140a6d30 0x7f01141ed110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 -- 172.21.15.32:0/1091900963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0094d0 con 0x7f01140c6e20 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f0118e00640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01140a6d30 0x7f01141ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011a200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140c6e20 0x7f01141ed650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c770 tx=0x7f010c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f0111600640 1 -- 172.21.15.32:0/1091900963 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c003b80 con 0x7f01140c6e20 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f0111600640 1 -- 172.21.15.32:0/1091900963 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c003ce0 con 0x7f01140c6e20 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f0111600640 1 -- 172.21.15.32:0/1091900963 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00aa90 con 0x7f01140c6e20 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011414ebd0 con 0x7f01140c6e20 2024-01-19T04:17:04.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011414f190 con 0x7f01140c6e20 2024-01-19T04:17:04.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.889+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01140749f0 con 0x7f01140c6e20 2024-01-19T04:17:04.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.893+0000 7f0111600640 1 -- 172.21.15.32:0/1091900963 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f010c00abf0 con 0x7f01140c6e20 2024-01-19T04:17:04.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.893+0000 7f0111600640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f00ec066500 0x7f00ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:04.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.893+0000 7f0111600640 1 -- 172.21.15.32:0/1091900963 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f010c083e70 con 0x7f01140c6e20 2024-01-19T04:17:04.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.893+0000 7f0119800640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f00ec066500 0x7f00ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:04.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.893+0000 7f0119800640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f00ec066500 0x7f00ec0689c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0104000f70 tx=0x7f0104007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:04.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:04.897+0000 7f0111600640 1 -- 172.21.15.32:0/1091900963 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f010c050ef0 con 0x7f01140c6e20 2024-01-19T04:17:05.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0114067b80 con 0x7f01140c6e20 2024-01-19T04:17:05.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f0111600640 1 -- 172.21.15.32:0/1091900963 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20198 (secure 0 0 0) 0x7f010c054510 con 0x7f01140c6e20 2024-01-19T04:17:05.064 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:05.064 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":56,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:04.094774+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f00ec066500 msgr2=0x7f00ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f00ec066500 0x7f00ec0689c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0104000f70 tx=0x7f0104007e50 comp rx=0 tx=0).stop 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140c6e20 msgr2=0x7f01141ed650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140c6e20 0x7f01141ed650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c770 tx=0x7f010c00cc30 comp rx=0 tx=0).stop 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 shutdown_connections 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f00ec066500 0x7f00ec0689c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01140c6e20 0x7f01141ed650 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01140a6d30 0x7f01141ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 --2- 172.21.15.32:0/1091900963 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f011406fda0 0x7f0114154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.061+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 >> 172.21.15.32:0/1091900963 conn(0x7f01140a9870 msgr2=0x7f01141505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:05.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.065+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 shutdown_connections 2024-01-19T04:17:05.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.065+0000 7f011c200640 1 -- 172.21.15.32:0/1091900963 wait complete. 2024-01-19T04:17:05.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:05.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.225+0000 7f91efe00640 1 Processor -- start 2024-01-19T04:17:05.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.225+0000 7f91efe00640 1 -- start start 2024-01-19T04:17:05.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.225+0000 7f91efe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e8147f90 0x7f91e8151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.225+0000 7f91efe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91e80c18b0 0x7f91e80a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.225+0000 7f91efe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80c1d10 con 0x7f91e80c55e0 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.225+0000 7f91efe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e806c5c0 con 0x7f91e80c18b0 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.225+0000 7f91efe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80c0810 con 0x7f91e8147f90 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91eca00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f91e80c55e0 0x7f91e806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36338/0 (socket says 172.21.15.32:36338) 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91eca00640 1 -- 172.21.15.32:0/2125163527 learned_addr learned my addr 172.21.15.32:0/2125163527 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91ede00640 1 --2- 172.21.15.32:0/2125163527 >> v2:172.21.15.67:3300/0 conn(0x7f91e80c18b0 0x7f91e80a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91ed400640 1 --2- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e8147f90 0x7f91e8151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91e7e00640 1 -- 172.21.15.32:0/2125163527 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277315391 0 0) 0x7f91e80c1d10 con 0x7f91e80c55e0 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91e7e00640 1 -- 172.21.15.32:0/2125163527 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c8003530 con 0x7f91e80c55e0 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91ede00640 1 -- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e8147f90 msgr2=0x7f91e8151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91ede00640 1 --2- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e8147f90 0x7f91e8151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91ede00640 1 -- 172.21.15.32:0/2125163527 >> v1:172.21.15.32:6789/0 conn(0x7f91e80c55e0 legacy=0x7f91e806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91ede00640 1 -- 172.21.15.32:0/2125163527 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80c0af0 con 0x7f91e80c18b0 2024-01-19T04:17:05.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.229+0000 7f91ede00640 1 --2- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e80a4d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009d90 tx=0x7f91e001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c34029d6c5f83445 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:05.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91e7e00640 1 -- 172.21.15.32:0/2125163527 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00a5950 con 0x7f91e80c18b0 2024-01-19T04:17:05.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91e7e00640 1 -- 172.21.15.32:0/2125163527 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00a5ab0 con 0x7f91e80c18b0 2024-01-19T04:17:05.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91e7e00640 1 -- 172.21.15.32:0/2125163527 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00a5e40 con 0x7f91e80c18b0 2024-01-19T04:17:05.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 msgr2=0x7f91e80a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 --2- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e80a4d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009d90 tx=0x7f91e001c890 comp rx=0 tx=0).stop 2024-01-19T04:17:05.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- 172.21.15.32:0/2125163527 shutdown_connections 2024-01-19T04:17:05.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 --2- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e80a4d10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 --2- 172.21.15.32:0/2125163527 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e8147f90 0x7f91e8151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- 172.21.15.32:0/2125163527 >> 172.21.15.32:0/2125163527 conn(0x7f91e80c5b20 msgr2=0x7f91e80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:05.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- 172.21.15.32:0/2125163527 shutdown_connections 2024-01-19T04:17:05.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- 172.21.15.32:0/2125163527 wait complete. 2024-01-19T04:17:05.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 Processor -- start 2024-01-19T04:17:05.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- start start 2024-01-19T04:17:05.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e81526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e80c55e0 0x7f91e814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e8147f90 0x7f91e815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8153170 con 0x7f91e8147f90 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81f13c0 con 0x7f91e80c18b0 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.233+0000 7f91efe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81f0f30 con 0x7f91e80c55e0 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e8147f90 0x7f91e815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e8147f90 0x7f91e815bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35454/0 (socket says 172.21.15.32:35454) 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 -- 172.21.15.32:0/2581035615 learned_addr learned my addr 172.21.15.32:0/2581035615 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91eca00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e80c55e0 0x7f91e814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ed400640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e81526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 -- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e80c55e0 msgr2=0x7f91e814aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e80c55e0 0x7f91e814aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 -- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 msgr2=0x7f91e81526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e81526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 -- 172.21.15.32:0/2581035615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0009a70 con 0x7f91e8147f90 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ed400640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e81526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91ede00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e8147f90 0x7f91e815bf10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f91e001af40 tx=0x7f91e0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91e5600640 1 -- 172.21.15.32:0/2581035615 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00adce0 con 0x7f91e8147f90 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91e5600640 1 -- 172.21.15.32:0/2581035615 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00ade40 con 0x7f91e8147f90 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e81f0600 con 0x7f91e8147f90 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91e5600640 1 -- 172.21.15.32:0/2581035615 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00b9670 con 0x7f91e8147f90 2024-01-19T04:17:05.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e81f0bc0 con 0x7f91e8147f90 2024-01-19T04:17:05.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e80749f0 con 0x7f91e8147f90 2024-01-19T04:17:05.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.237+0000 7f91e5600640 1 -- 172.21.15.32:0/2581035615 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f91e00b97d0 con 0x7f91e8147f90 2024-01-19T04:17:05.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.241+0000 7f91e5600640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91c0066500 0x7f91c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.241+0000 7f91e5600640 1 -- 172.21.15.32:0/2581035615 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f91e011f830 con 0x7f91e8147f90 2024-01-19T04:17:05.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.241+0000 7f91ed400640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91c0066500 0x7f91c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.241+0000 7f91ed400640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91c0066500 0x7f91c00689c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f91e80abd20 tx=0x7f91d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:05.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.245+0000 7f91e5600640 1 -- 172.21.15.32:0/2581035615 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f91e00ec810 con 0x7f91e8147f90 2024-01-19T04:17:05.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.405+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e81f1070 con 0x7f91e8147f90 2024-01-19T04:17:05.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.405+0000 7f91e5600640 1 -- 172.21.15.32:0/2581035615 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20198 (secure 0 0 0) 0x7f91e0009450 con 0x7f91e8147f90 2024-01-19T04:17:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:05.408 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":56,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:04.094774+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.405+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91c0066500 msgr2=0x7f91c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.405+0000 7f91efe00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91c0066500 0x7f91c00689c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f91e80abd20 tx=0x7f91d8008040 comp rx=0 tx=0).stop 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.405+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e8147f90 msgr2=0x7f91e815bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.405+0000 7f91efe00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e8147f90 0x7f91e815bf10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f91e001af40 tx=0x7f91e0019630 comp rx=0 tx=0).stop 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 shutdown_connections 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f91c0066500 0x7f91c00689c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91e8147f90 0x7f91e815bf10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f91e80c55e0 0x7f91e814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 --2- 172.21.15.32:0/2581035615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e80c18b0 0x7f91e81526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 >> 172.21.15.32:0/2581035615 conn(0x7f91e80c5b20 msgr2=0x7f91e806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:05.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 shutdown_connections 2024-01-19T04:17:05.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.409+0000 7f91efe00640 1 -- 172.21.15.32:0/2581035615 wait complete. 2024-01-19T04:17:05.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-19T04:17:05.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 Processor -- start 2024-01-19T04:17:05.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 -- start start 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5b580c4e50 0x7f5b580c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5b58152620 0x7f5b5806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b5806fd50 0x7f5b580c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5806ea00 con 0x7f5b58152620 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b58152bc0 con 0x7f5b580c4e50 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b5d000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58152ea0 con 0x7f5b5806fd50 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5b58152620 0x7f5b5806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5b58152620 0x7f5b5806f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35466/0 (socket says 172.21.15.32:35466) 2024-01-19T04:17:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 -- 172.21.15.32:0/1606931695 learned_addr learned my addr 172.21.15.32:0/1606931695 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b56800640 1 --2- 172.21.15.32:0/1606931695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b5806fd50 0x7f5b580c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55e00640 1 --2- 172.21.15.32:0/1606931695 >> v2:172.21.15.67:3300/0 conn(0x7f5b580c4e50 0x7f5b580c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 -- 172.21.15.32:0/1606931695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b5806fd50 msgr2=0x7f5b580c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 --2- 172.21.15.32:0/1606931695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b5806fd50 0x7f5b580c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 -- 172.21.15.32:0/1606931695 >> v2:172.21.15.67:3300/0 conn(0x7f5b580c4e50 msgr2=0x7f5b580c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 --2- 172.21.15.32:0/1606931695 >> v2:172.21.15.67:3300/0 conn(0x7f5b580c4e50 0x7f5b580c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55400640 1 -- 172.21.15.32:0/1606931695 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58153180 con 0x7f5b58152620 2024-01-19T04:17:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b56800640 1 --2- 172.21.15.32:0/1606931695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b5806fd50 0x7f5b580c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:05.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.573+0000 7f5b55e00640 1 --2- 172.21.15.32:0/1606931695 >> v2:172.21.15.67:3300/0 conn(0x7f5b580c4e50 0x7f5b580c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:05.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b55400640 1 --2- 172.21.15.32:0/1606931695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b58152620 0x7f5b5806f810 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b580703d0 tx=0x7f5b4001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ac4e9f1c0de30b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:05.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b54a00640 1 -- 172.21.15.32:0/1606931695 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400a89b0 con 0x7f5b58152620 2024-01-19T04:17:05.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b54a00640 1 -- 172.21.15.32:0/1606931695 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b400a8b10 con 0x7f5b58152620 2024-01-19T04:17:05.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b54a00640 1 -- 172.21.15.32:0/1606931695 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400a8ea0 con 0x7f5b58152620 2024-01-19T04:17:05.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 -- 172.21.15.32:0/1606931695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b58152620 msgr2=0x7f5b5806f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 --2- 172.21.15.32:0/1606931695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b58152620 0x7f5b5806f810 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b580703d0 tx=0x7f5b4001ecf0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 -- 172.21.15.32:0/1606931695 shutdown_connections 2024-01-19T04:17:05.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 --2- 172.21.15.32:0/1606931695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b5806fd50 0x7f5b580c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 --2- 172.21.15.32:0/1606931695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b58152620 0x7f5b5806f810 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 --2- 172.21.15.32:0/1606931695 >> v2:172.21.15.67:3300/0 conn(0x7f5b580c4e50 0x7f5b580c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 -- 172.21.15.32:0/1606931695 >> 172.21.15.32:0/1606931695 conn(0x7f5b580c7d40 msgr2=0x7f5b580c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:05.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 -- 172.21.15.32:0/1606931695 shutdown_connections 2024-01-19T04:17:05.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.577+0000 7f5b5d000640 1 -- 172.21.15.32:0/1606931695 wait complete. 2024-01-19T04:17:05.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 Processor -- start 2024-01-19T04:17:05.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 -- start start 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5806fd50 0x7f5b580c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b580c4e50 0x7f5b5806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58152620 0x7f5b581452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5806c2d0 con 0x7f5b5806fd50 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5806c5b0 con 0x7f5b58152620 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b580ab5d0 con 0x7f5b580c4e50 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5806fd50 0x7f5b580c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5806fd50 0x7f5b580c13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35468/0 (socket says 172.21.15.32:35468) 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 -- 172.21.15.32:0/3510438309 learned_addr learned my addr 172.21.15.32:0/3510438309 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55400640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b580c4e50 0x7f5b5806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b56800640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58152620 0x7f5b581452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 -- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b580c4e50 msgr2=0x7f5b5806cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b580c4e50 0x7f5b5806cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 -- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58152620 msgr2=0x7f5b581452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58152620 0x7f5b581452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 -- 172.21.15.32:0/3510438309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400094d0 con 0x7f5b5806fd50 2024-01-19T04:17:05.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b55e00640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5806fd50 0x7f5b580c13d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c7c0 tx=0x7f5b4800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:05.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b4e000640 1 -- 172.21.15.32:0/3510438309 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48007a30 con 0x7f5b5806fd50 2024-01-19T04:17:05.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b4e000640 1 -- 172.21.15.32:0/3510438309 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b48007b90 con 0x7f5b5806fd50 2024-01-19T04:17:05.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b4e000640 1 -- 172.21.15.32:0/3510438309 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800ce70 con 0x7f5b5806fd50 2024-01-19T04:17:05.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b580ab8b0 con 0x7f5b5806fd50 2024-01-19T04:17:05.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.581+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b580c1910 con 0x7f5b5806fd50 2024-01-19T04:17:05.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.585+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b580749f0 con 0x7f5b5806fd50 2024-01-19T04:17:05.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.585+0000 7f5b4e000640 1 -- 172.21.15.32:0/3510438309 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5b480113f0 con 0x7f5b5806fd50 2024-01-19T04:17:05.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.585+0000 7f5b4e000640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b30066500 0x7f5b300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:05.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.585+0000 7f5b4e000640 1 -- 172.21.15.32:0/3510438309 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5b48084630 con 0x7f5b5806fd50 2024-01-19T04:17:05.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.585+0000 7f5b55400640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b30066500 0x7f5b300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:05.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.585+0000 7f5b55400640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b30066500 0x7f5b300689c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5b400b2000 tx=0x7f5b400aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:05.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.589+0000 7f5b4e000640 1 -- 172.21.15.32:0/3510438309 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5b48051630 con 0x7f5b5806fd50 2024-01-19T04:17:05.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:05.789+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5b5806f9f0 con 0x7f5b5806fd50 2024-01-19T04:17:06.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.709+0000 7f5b4e000640 1 -- 172.21.15.32:0/3510438309 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 119+0+0 (secure 0 0 0) 0x7f5b48054c50 con 0x7f5b5806fd50 2024-01-19T04:17:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.713+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b30066500 msgr2=0x7f5b300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.713+0000 7f5b5d000640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b30066500 0x7f5b300689c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5b400b2000 tx=0x7f5b400aa070 comp rx=0 tx=0).stop 2024-01-19T04:17:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.713+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5806fd50 msgr2=0x7f5b580c13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.713+0000 7f5b5d000640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5806fd50 0x7f5b580c13d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c7c0 tx=0x7f5b4800cc80 comp rx=0 tx=0).stop 2024-01-19T04:17:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 shutdown_connections 2024-01-19T04:17:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b30066500 0x7f5b300689c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58152620 0x7f5b581452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b580c4e50 0x7f5b5806cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 --2- 172.21.15.32:0/3510438309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5806fd50 0x7f5b580c13d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 >> 172.21.15.32:0/3510438309 conn(0x7f5b580c7d40 msgr2=0x7f5b580a92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:06.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 shutdown_connections 2024-01-19T04:17:06.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.717+0000 7f5b5d000640 1 -- 172.21.15.32:0/3510438309 wait complete. 2024-01-19T04:17:06.746 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T04:17:06.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-19T04:17:06.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057ec00640 1 Processor -- start 2024-01-19T04:17:06.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057ec00640 1 -- start start 2024-01-19T04:17:06.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057ec00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f057814eb90 0x7f05781549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:06.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057ec00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f0578154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:06.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057ec00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0578072730 con 0x7f057806dbc0 2024-01-19T04:17:06.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057ec00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0578072a10 con 0x7f057814eb90 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057ec00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057814ef70 con 0x7f057806c670 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f0577e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f057814eb90 0x7f05781549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f0577e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f057814eb90 0x7f05781549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35482/0 (socket says 172.21.15.32:35482) 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f0577e00640 1 -- 172.21.15.32:0/866055200 learned_addr learned my addr 172.21.15.32:0/866055200 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f057cc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f057806dbc0 0x7f05780719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36350/0 (socket says 172.21.15.32:36350) 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.893+0000 7f0577400640 1 --2- 172.21.15.32:0/866055200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f0578154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0577e00640 1 -- 172.21.15.32:0/866055200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 msgr2=0x7f0578154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0577e00640 1 --2- 172.21.15.32:0/866055200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f0578154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0577e00640 1 -- 172.21.15.32:0/866055200 >> v1:172.21.15.32:6789/0 conn(0x7f057806dbc0 legacy=0x7f05780719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:06.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0577e00640 1 -- 172.21.15.32:0/866055200 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578155580 con 0x7f057814eb90 2024-01-19T04:17:06.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0576a00640 1 -- 172.21.15.32:0/866055200 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681457199 0 0) 0x7f0578072730 con 0x7f057806dbc0 2024-01-19T04:17:06.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0577e00640 1 --2- 172.21.15.32:0/866055200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057814eb90 0x7f05781549d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f056800bb10 tx=0x7f056801eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1e47cad58112ee server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:06.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0576a00640 1 -- 172.21.15.32:0/866055200 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680a7ad0 con 0x7f057814eb90 2024-01-19T04:17:06.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0576a00640 1 -- 172.21.15.32:0/866055200 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680a7c30 con 0x7f057814eb90 2024-01-19T04:17:06.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f0576a00640 1 -- 172.21.15.32:0/866055200 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680af440 con 0x7f057814eb90 2024-01-19T04:17:06.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f057ec00640 1 -- 172.21.15.32:0/866055200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057814eb90 msgr2=0x7f05781549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:06.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.897+0000 7f057ec00640 1 --2- 172.21.15.32:0/866055200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057814eb90 0x7f05781549d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f056800bb10 tx=0x7f056801eaf0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- 172.21.15.32:0/866055200 shutdown_connections 2024-01-19T04:17:06.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 --2- 172.21.15.32:0/866055200 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f0578154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 --2- 172.21.15.32:0/866055200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057814eb90 0x7f05781549d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- 172.21.15.32:0/866055200 >> 172.21.15.32:0/866055200 conn(0x7f05780c25a0 msgr2=0x7f05780c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:06.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- 172.21.15.32:0/866055200 shutdown_connections 2024-01-19T04:17:06.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- 172.21.15.32:0/866055200 wait complete. 2024-01-19T04:17:06.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 Processor -- start 2024-01-19T04:17:06.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- start start 2024-01-19T04:17:06.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f057815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:06.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057806dbc0 0x7f05780ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:06.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057814eb90 0x7f05781ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:06.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780c4320 con 0x7f057806dbc0 2024-01-19T04:17:06.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05781f08b0 con 0x7f057814eb90 2024-01-19T04:17:06.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057ec00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05781f0b90 con 0x7f057806c670 2024-01-19T04:17:06.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057806dbc0 0x7f05780ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:06.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057806dbc0 0x7f05780ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35484/0 (socket says 172.21.15.32:35484) 2024-01-19T04:17:06.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577400640 1 -- 172.21.15.32:0/3509495183 learned_addr learned my addr 172.21.15.32:0/3509495183 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:06.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f057cc00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057814eb90 0x7f05781ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:06.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577e00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f057815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577400640 1 -- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 msgr2=0x7f057815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577400640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f057815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577400640 1 -- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057814eb90 msgr2=0x7f05781ed2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.901+0000 7f0577400640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057814eb90 0x7f05781ed2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f0577400640 1 -- 172.21.15.32:0/3509495183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056800b770 con 0x7f057806dbc0 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f0577e00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f057815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f0577400640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057806dbc0 0x7f05780ab240 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f056000d800 tx=0x7f056000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f056fe00640 1 -- 172.21.15.32:0/3509495183 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000b6c0 con 0x7f057806dbc0 2024-01-19T04:17:06.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f056fe00640 1 -- 172.21.15.32:0/3509495183 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056000b820 con 0x7f057806dbc0 2024-01-19T04:17:06.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f056fe00640 1 -- 172.21.15.32:0/3509495183 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000bb90 con 0x7f057806dbc0 2024-01-19T04:17:06.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05781f0e70 con 0x7f057806dbc0 2024-01-19T04:17:06.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05781f1650 con 0x7f057806dbc0 2024-01-19T04:17:06.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05780749f0 con 0x7f057806dbc0 2024-01-19T04:17:06.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f056fe00640 1 -- 172.21.15.32:0/3509495183 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f056000bcf0 con 0x7f057806dbc0 2024-01-19T04:17:06.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f056fe00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0550066500 0x7f05500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:06.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.905+0000 7f056fe00640 1 -- 172.21.15.32:0/3509495183 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0560084620 con 0x7f057806dbc0 2024-01-19T04:17:06.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.909+0000 7f0577e00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0550066500 0x7f05500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:06.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.909+0000 7f0577e00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0550066500 0x7f05500689c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f05680b1000 tx=0x7f05680a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:06.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:06.909+0000 7f056fe00640 1 -- 172.21.15.32:0/3509495183 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0560051600 con 0x7f057806dbc0 2024-01-19T04:17:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.105+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f05780c54d0 con 0x7f057806dbc0 2024-01-19T04:17:07.524 INFO:tasks.ceph.mds.c.smithi032.stderr:2024-01-19T04:17:07.521+0000 7f3801600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:17:07.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.717+0000 7f056fe00640 1 -- 172.21.15.32:0/3509495183 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0560054c20 con 0x7f057806dbc0 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0550066500 msgr2=0x7f05500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0550066500 0x7f05500689c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f05680b1000 tx=0x7f05680a9070 comp rx=0 tx=0).stop 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057806dbc0 msgr2=0x7f05780ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057806dbc0 0x7f05780ab240 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f056000d800 tx=0x7f056000dcc0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 shutdown_connections 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0550066500 0x7f05500689c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057814eb90 0x7f05781ed2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f057806dbc0 0x7f05780ab240 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 --2- 172.21.15.32:0/3509495183 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f057806c670 0x7f057815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 >> 172.21.15.32:0/3509495183 conn(0x7f05780c25a0 msgr2=0x7f05780c0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 shutdown_connections 2024-01-19T04:17:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.721+0000 7f057ec00640 1 -- 172.21.15.32:0/3509495183 wait complete. 2024-01-19T04:17:07.748 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-19T04:17:07.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:07.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f936dc00640 1 Processor -- start 2024-01-19T04:17:07.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f936dc00640 1 -- start start 2024-01-19T04:17:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f936dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680c6e20 0x7f93680c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f936dc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f93680a6d30 0x7f93680c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f936dc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93681533a0 con 0x7f936806fda0 2024-01-19T04:17:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f936dc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9368156380 con 0x7f93680a6d30 2024-01-19T04:17:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f936dc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936814fe40 con 0x7f93680c6e20 2024-01-19T04:17:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f93680a6d30 0x7f93680c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680c6e20 0x7f93680c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680c6e20 0x7f93680c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:40182/0 (socket says 172.21.15.32:40182) 2024-01-19T04:17:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f93680a6d30 0x7f93680c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:54842/0 (socket says 172.21.15.32:54842) 2024-01-19T04:17:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366a00640 1 -- 172.21.15.32:0/2108115587 learned_addr learned my addr 172.21.15.32:0/2108115587 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9367400640 1 --1- 172.21.15.32:0/2108115587 >> v1:172.21.15.67:6789/0 conn(0x7f936806fda0 0x7f9368152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:42594/0 (socket says 172.21.15.32:42594) 2024-01-19T04:17:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366a00640 1 -- 172.21.15.32:0/2108115587 >> v2:172.21.15.67:3300/0 conn(0x7f93680a6d30 msgr2=0x7f93680c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366a00640 1 --2- 172.21.15.32:0/2108115587 >> v2:172.21.15.67:3300/0 conn(0x7f93680a6d30 0x7f93680c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366a00640 1 -- 172.21.15.32:0/2108115587 >> v1:172.21.15.67:6789/0 conn(0x7f936806fda0 legacy=0x7f9368152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366a00640 1 -- 172.21.15.32:0/2108115587 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368152800 con 0x7f93680c6e20 2024-01-19T04:17:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.893+0000 7f9366000640 1 --2- 172.21.15.32:0/2108115587 >> v2:172.21.15.67:3300/0 conn(0x7f93680a6d30 0x7f93680c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:07.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f9366a00640 1 --2- 172.21.15.32:0/2108115587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680c6e20 0x7f93680c7200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9358009870 tx=0x7f935801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e39fe5be9ee01d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f9365600640 1 -- 172.21.15.32:0/2108115587 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580ab620 con 0x7f93680c6e20 2024-01-19T04:17:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f9365600640 1 -- 172.21.15.32:0/2108115587 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93580ab780 con 0x7f93680c6e20 2024-01-19T04:17:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f9365600640 1 -- 172.21.15.32:0/2108115587 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580abb10 con 0x7f93680c6e20 2024-01-19T04:17:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f936dc00640 1 -- 172.21.15.32:0/2108115587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680c6e20 msgr2=0x7f93680c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:07.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f936dc00640 1 --2- 172.21.15.32:0/2108115587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680c6e20 0x7f93680c7200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9358009870 tx=0x7f935801c420 comp rx=0 tx=0).stop 2024-01-19T04:17:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f936dc00640 1 -- 172.21.15.32:0/2108115587 shutdown_connections 2024-01-19T04:17:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f936dc00640 1 --2- 172.21.15.32:0/2108115587 >> v2:172.21.15.67:3300/0 conn(0x7f93680a6d30 0x7f93680c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f936dc00640 1 --2- 172.21.15.32:0/2108115587 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680c6e20 0x7f93680c7200 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.897+0000 7f936dc00640 1 -- 172.21.15.32:0/2108115587 >> 172.21.15.32:0/2108115587 conn(0x7f93680a9870 msgr2=0x7f93680a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 -- 172.21.15.32:0/2108115587 shutdown_connections 2024-01-19T04:17:07.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 -- 172.21.15.32:0/2108115587 wait complete. 2024-01-19T04:17:07.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 Processor -- start 2024-01-19T04:17:07.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 -- start start 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f936806fda0 0x7f9368151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680a6d30 0x7f9368151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93680c6e20 0x7f93681535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9368154d40 con 0x7f93680c6e20 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680be7a0 con 0x7f936806fda0 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f936dc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9368150850 con 0x7f93680a6d30 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93680c6e20 0x7f93681535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93680c6e20 0x7f93681535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45328/0 (socket says 172.21.15.32:45328) 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 -- 172.21.15.32:0/2255436258 learned_addr learned my addr 172.21.15.32:0/2255436258 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9366000640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680a6d30 0x7f9368151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9366a00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f936806fda0 0x7f9368151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 -- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680a6d30 msgr2=0x7f9368151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680a6d30 0x7f9368151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 -- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f936806fda0 msgr2=0x7f9368151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f936806fda0 0x7f9368151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 -- 172.21.15.32:0/2255436258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009420 con 0x7f93680c6e20 2024-01-19T04:17:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f9367400640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93680c6e20 0x7f93681535d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f936000c730 tx=0x7f936000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.901+0000 7f935ea00640 1 -- 172.21.15.32:0/2255436258 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936000ce40 con 0x7f93680c6e20 2024-01-19T04:17:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f935ea00640 1 -- 172.21.15.32:0/2255436258 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936000a640 con 0x7f93680c6e20 2024-01-19T04:17:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93580094d0 con 0x7f93680c6e20 2024-01-19T04:17:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f935ea00640 1 -- 172.21.15.32:0/2255436258 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936000a9b0 con 0x7f93680c6e20 2024-01-19T04:17:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93681ee2d0 con 0x7f93680c6e20 2024-01-19T04:17:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93680749f0 con 0x7f93680c6e20 2024-01-19T04:17:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f935ea00640 1 -- 172.21.15.32:0/2255436258 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f936000ab10 con 0x7f93680c6e20 2024-01-19T04:17:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f935ea00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9340066530 0x7f93400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f935ea00640 1 -- 172.21.15.32:0/2255436258 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9360083770 con 0x7f93680c6e20 2024-01-19T04:17:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.905+0000 7f9366a00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9340066530 0x7f93400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.909+0000 7f9366a00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9340066530 0x7f93400689f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f93580af000 tx=0x7f93580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:07.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:07.909+0000 7f935ea00640 1 -- 172.21.15.32:0/2255436258 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9360050750 con 0x7f93680c6e20 2024-01-19T04:17:08.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93681533a0 con 0x7f93680c6e20 2024-01-19T04:17:08.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f935ea00640 1 -- 172.21.15.32:0/2255436258 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6176 (secure 0 0 0) 0x7f93681533a0 con 0x7f93680c6e20 2024-01-19T04:17:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:08.111 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:50.950328+0000","modified":"2024-01-19T04:16:54.081170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/246892917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":246892917},{"type":"v1","addr":"172.21.15.67:6837","nonce":246892917}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:08.111 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 36 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9340066530 msgr2=0x7f93400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9340066530 0x7f93400689f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f93580af000 tx=0x7f93580a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93680c6e20 msgr2=0x7f93681535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93680c6e20 0x7f93681535d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f936000c730 tx=0x7f936000cbf0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 shutdown_connections 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9340066530 0x7f93400689f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93680c6e20 0x7f93681535d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f93680a6d30 0x7f9368151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 --2- 172.21.15.32:0/2255436258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f936806fda0 0x7f9368151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 >> 172.21.15.32:0/2255436258 conn(0x7f93680a9870 msgr2=0x7f936814f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 shutdown_connections 2024-01-19T04:17:08.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.109+0000 7f936dc00640 1 -- 172.21.15.32:0/2255436258 wait complete. 2024-01-19T04:17:08.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:08.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a3400640 1 Processor -- start 2024-01-19T04:17:08.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a3400640 1 -- start start 2024-01-19T04:17:08.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f709c147f90 0x7f709c151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c0c55e0 0x7f709c0c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a3400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0c0810 con 0x7f709c06beb0 2024-01-19T04:17:08.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a3400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0c1df0 con 0x7f709c147f90 2024-01-19T04:17:08.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0c0af0 con 0x7f709c0c55e0 2024-01-19T04:17:08.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a0a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f709c147f90 0x7f709c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a0a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f709c147f90 0x7f709c151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45342/0 (socket says 172.21.15.32:45342) 2024-01-19T04:17:08.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f70a0a00640 1 -- 172.21.15.32:0/1562274809 learned_addr learned my addr 172.21.15.32:0/1562274809 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:08.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.273+0000 7f709be00640 1 --2- 172.21.15.32:0/1562274809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c0c55e0 0x7f709c0c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f70a0a00640 1 -- 172.21.15.32:0/1562274809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c0c55e0 msgr2=0x7f709c0c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:08.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f70a0a00640 1 --2- 172.21.15.32:0/1562274809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c0c55e0 0x7f709c0c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f70a0a00640 1 -- 172.21.15.32:0/1562274809 >> v1:172.21.15.67:6789/0 conn(0x7f709c06beb0 legacy=0x7f709c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f709b400640 1 -- 172.21.15.32:0/1562274809 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976181197 0 0) 0x7f709c0c0810 con 0x7f709c06beb0 2024-01-19T04:17:08.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f70a0a00640 1 -- 172.21.15.32:0/1562274809 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0c0dd0 con 0x7f709c147f90 2024-01-19T04:17:08.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f70a0a00640 1 --2- 172.21.15.32:0/1562274809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c151350 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f708c009870 tx=0x7f708c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded991aac0721182 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:08.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f709b400640 1 -- 172.21.15.32:0/1562274809 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0ab680 con 0x7f709c147f90 2024-01-19T04:17:08.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f709b400640 1 -- 172.21.15.32:0/1562274809 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c0ab7e0 con 0x7f709c147f90 2024-01-19T04:17:08.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f709b400640 1 -- 172.21.15.32:0/1562274809 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0abb70 con 0x7f709c147f90 2024-01-19T04:17:08.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f70a3400640 1 -- 172.21.15.32:0/1562274809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 msgr2=0x7f709c151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.277+0000 7f70a3400640 1 --2- 172.21.15.32:0/1562274809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c151350 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f708c009870 tx=0x7f708c01c480 comp rx=0 tx=0).stop 2024-01-19T04:17:08.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- 172.21.15.32:0/1562274809 shutdown_connections 2024-01-19T04:17:08.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 --2- 172.21.15.32:0/1562274809 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c0c55e0 0x7f709c0c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 --2- 172.21.15.32:0/1562274809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c151350 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- 172.21.15.32:0/1562274809 >> 172.21.15.32:0/1562274809 conn(0x7f709c0c5b20 msgr2=0x7f709c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:08.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- 172.21.15.32:0/1562274809 shutdown_connections 2024-01-19T04:17:08.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- 172.21.15.32:0/1562274809 wait complete. 2024-01-19T04:17:08.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 Processor -- start 2024-01-19T04:17:08.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- start start 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c06beb0 0x7f709c1ee320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f709c0c55e0 0x7f709c1ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c0a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c154a00 con 0x7f709c147f90 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0aa5e0 con 0x7f709c0c55e0 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0a89e0 con 0x7f709c06beb0 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c0a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a0a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c06beb0 0x7f709c1ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f709be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f709c0c55e0 0x7f709c1ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a0a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c06beb0 0x7f709c1ee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:40208/0 (socket says 172.21.15.32:40208) 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c0a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45354/0 (socket says 172.21.15.32:45354) 2024-01-19T04:17:08.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a0a00640 1 -- 172.21.15.32:0/166535560 learned_addr learned my addr 172.21.15.32:0/166535560 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a1400640 1 -- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c06beb0 msgr2=0x7f709c1ee320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a1400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c06beb0 0x7f709c1ee320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a1400640 1 -- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f709c0c55e0 msgr2=0x7f709c1ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a1400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f709c0c55e0 0x7f709c1ed930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.281+0000 7f70a1400640 1 -- 172.21.15.32:0/166535560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0094d0 con 0x7f709c147f90 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f70a1400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c0a9a80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70940012f0 tx=0x7f709400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f7098c00640 1 -- 172.21.15.32:0/166535560 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094003b80 con 0x7f709c147f90 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f7098c00640 1 -- 172.21.15.32:0/166535560 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094003d00 con 0x7f709c147f90 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f7098c00640 1 -- 172.21.15.32:0/166535560 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940052b0 con 0x7f709c147f90 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c0a8cc0 con 0x7f709c147f90 2024-01-19T04:17:08.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c0a9280 con 0x7f709c147f90 2024-01-19T04:17:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c0749f0 con 0x7f709c147f90 2024-01-19T04:17:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f7098c00640 1 -- 172.21.15.32:0/166535560 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7094005410 con 0x7f709c147f90 2024-01-19T04:17:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f7098c00640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7074066530 0x7f70740689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.285+0000 7f7098c00640 1 -- 172.21.15.32:0/166535560 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7094083cc0 con 0x7f709c147f90 2024-01-19T04:17:08.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.289+0000 7f70a0a00640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7074066530 0x7f70740689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.289+0000 7f70a0a00640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7074066530 0x7f70740689f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f708c01c4c0 tx=0x7f708c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:08.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.289+0000 7f7098c00640 1 -- 172.21.15.32:0/166535560 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7094050d40 con 0x7f709c147f90 2024-01-19T04:17:08.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.449+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f709c0c21d0 con 0x7f709c147f90 2024-01-19T04:17:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f7098c00640 1 -- 172.21.15.32:0/166535560 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20185 (secure 0 0 0) 0x7f7094054360 con 0x7f709c147f90 2024-01-19T04:17:08.454 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:08.454 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":57,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:05.701251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:08.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7074066530 msgr2=0x7f70740689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7074066530 0x7f70740689f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f708c01c4c0 tx=0x7f708c0b6040 comp rx=0 tx=0).stop 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 msgr2=0x7f709c0a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c0a9a80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f70940012f0 tx=0x7f709400cbe0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 shutdown_connections 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7074066530 0x7f70740689f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c147f90 0x7f709c0a9a80 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f709c0c55e0 0x7f709c1ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 --2- 172.21.15.32:0/166535560 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f709c06beb0 0x7f709c1ee320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 >> 172.21.15.32:0/166535560 conn(0x7f709c0c5b20 msgr2=0x7f709c1511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 shutdown_connections 2024-01-19T04:17:08.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.453+0000 7f70a3400640 1 -- 172.21.15.32:0/166535560 wait complete. 2024-01-19T04:17:08.476 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:17:08.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:17:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 Processor -- start 2024-01-19T04:17:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 -- start start 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff400c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff400c5740 0x7eff400c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff4006beb0 0x7eff40154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff40150f90 con 0x7eff400c5740 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400c1660 con 0x7eff4006beb0 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff45000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff400c0c90 con 0x7eff400c42b0 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff400c5740 0x7eff400c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7eff400c5740 0x7eff400c1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45370/0 (socket says 172.21.15.32:45370) 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 -- 172.21.15.32:0/3533812091 learned_addr learned my addr 172.21.15.32:0/3533812091 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3de00640 1 --2- 172.21.15.32:0/3533812091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff400c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3e800640 1 --2- 172.21.15.32:0/3533812091 >> v2:172.21.15.67:3300/0 conn(0x7eff4006beb0 0x7eff40154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 -- 172.21.15.32:0/3533812091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 msgr2=0x7eff400c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 --2- 172.21.15.32:0/3533812091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff400c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 -- 172.21.15.32:0/3533812091 >> v2:172.21.15.67:3300/0 conn(0x7eff4006beb0 msgr2=0x7eff40154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 --2- 172.21.15.32:0/3533812091 >> v2:172.21.15.67:3300/0 conn(0x7eff4006beb0 0x7eff40154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3d400640 1 -- 172.21.15.32:0/3533812091 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40150cb0 con 0x7eff400c5740 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3de00640 1 --2- 172.21.15.32:0/3533812091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff400c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.617+0000 7eff3e800640 1 --2- 172.21.15.32:0/3533812091 >> v2:172.21.15.67:3300/0 conn(0x7eff4006beb0 0x7eff40154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:08.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff3d400640 1 --2- 172.21.15.32:0/3533812091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff400c1120 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7eff400a77e0 tx=0x7eff2801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f602c3cf07035551 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:08.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff3ca00640 1 -- 172.21.15.32:0/3533812091 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280ad680 con 0x7eff400c5740 2024-01-19T04:17:08.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff3ca00640 1 -- 172.21.15.32:0/3533812091 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff280ad7e0 con 0x7eff400c5740 2024-01-19T04:17:08.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff3ca00640 1 -- 172.21.15.32:0/3533812091 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280adb70 con 0x7eff400c5740 2024-01-19T04:17:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 -- 172.21.15.32:0/3533812091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 msgr2=0x7eff400c1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 --2- 172.21.15.32:0/3533812091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff400c1120 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7eff400a77e0 tx=0x7eff2801c440 comp rx=0 tx=0).stop 2024-01-19T04:17:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 -- 172.21.15.32:0/3533812091 shutdown_connections 2024-01-19T04:17:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 --2- 172.21.15.32:0/3533812091 >> v2:172.21.15.67:3300/0 conn(0x7eff4006beb0 0x7eff40154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 --2- 172.21.15.32:0/3533812091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff400c1120 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 --2- 172.21.15.32:0/3533812091 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff400c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 -- 172.21.15.32:0/3533812091 >> 172.21.15.32:0/3533812091 conn(0x7eff400c5b20 msgr2=0x7eff400c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 -- 172.21.15.32:0/3533812091 shutdown_connections 2024-01-19T04:17:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 -- 172.21.15.32:0/3533812091 wait complete. 2024-01-19T04:17:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.621+0000 7eff45000640 1 Processor -- start 2024-01-19T04:17:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 -- start start 2024-01-19T04:17:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4006beb0 0x7eff400a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff401ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff401eead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4014d7e0 con 0x7eff400c5740 2024-01-19T04:17:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff401ef2b0 con 0x7eff4006beb0 2024-01-19T04:17:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff401ef010 con 0x7eff400c42b0 2024-01-19T04:17:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff401eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff401eead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45382/0 (socket says 172.21.15.32:45382) 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 -- 172.21.15.32:0/2715026182 learned_addr learned my addr 172.21.15.32:0/2715026182 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3de00640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4006beb0 0x7eff400a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3d400640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff401ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 -- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 msgr2=0x7eff401ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff401ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 -- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4006beb0 msgr2=0x7eff400a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4006beb0 0x7eff400a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 -- 172.21.15.32:0/2715026182 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280094d0 con 0x7eff400c5740 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3de00640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4006beb0 0x7eff400a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff3e800640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff401eead0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7eff38007cc0 tx=0x7eff3800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff36000640 1 -- 172.21.15.32:0/2715026182 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380039a0 con 0x7eff400c5740 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff36000640 1 -- 172.21.15.32:0/2715026182 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800f040 con 0x7eff400c5740 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4014ec70 con 0x7eff400c5740 2024-01-19T04:17:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff36000640 1 -- 172.21.15.32:0/2715026182 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38003d60 con 0x7eff400c5740 2024-01-19T04:17:08.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4014f230 con 0x7eff400c5740 2024-01-19T04:17:08.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.625+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff40151170 con 0x7eff400c5740 2024-01-19T04:17:08.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.629+0000 7eff36000640 1 -- 172.21.15.32:0/2715026182 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7eff38004030 con 0x7eff400c5740 2024-01-19T04:17:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.629+0000 7eff36000640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff18066500 0x7eff180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.629+0000 7eff36000640 1 -- 172.21.15.32:0/2715026182 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7eff380844f0 con 0x7eff400c5740 2024-01-19T04:17:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.629+0000 7eff3de00640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff18066500 0x7eff180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:08.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.629+0000 7eff3de00640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff18066500 0x7eff180689c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7eff3000b990 tx=0x7eff30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:08.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.633+0000 7eff36000640 1 -- 172.21.15.32:0/2715026182 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7eff38051310 con 0x7eff400c5740 2024-01-19T04:17:08.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.789+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff400c2230 con 0x7eff18066500 2024-01-19T04:17:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.805+0000 7eff36000640 1 -- 172.21.15.32:0/2715026182 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525745 (secure 0 0 0) 0x7eff3000b710 con 0x7eff18066500 2024-01-19T04:17:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:08.817 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff18066500 msgr2=0x7eff180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff18066500 0x7eff180689c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7eff3000b990 tx=0x7eff30008040 comp rx=0 tx=0).stop 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 msgr2=0x7eff401eead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff401eead0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7eff38007cc0 tx=0x7eff3800d4a0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 shutdown_connections 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff18066500 0x7eff180689c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff400c5740 0x7eff401eead0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff400c42b0 0x7eff401ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 --2- 172.21.15.32:0/2715026182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff4006beb0 0x7eff400a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:08.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 >> 172.21.15.32:0/2715026182 conn(0x7eff400c5b20 msgr2=0x7eff40148fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:08.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 shutdown_connections 2024-01-19T04:17:08.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:08.809+0000 7eff45000640 1 -- 172.21.15.32:0/2715026182 wait complete. 2024-01-19T04:17:08.833 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-01-19T04:17:08.058683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595037,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":241,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":266,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239108,"kb_used_data":6288,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735612,"statfs":{"total":773094113280,"available":772849266688,"internally_reserved":0,"allocated":6438912,"data_stored":3385404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.377855"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924285+0000","last_change":"2024-01-19T04:17:04.707561+0000","last_active":"2024-01-19T04:17:06.924285+0000","last_peered":"2024-01-19T04:17:06.924285+0000","last_clean":"2024-01-19T04:17:06.924285+0000","last_became_active":"2024-01-19T04:17:04.706328+0000","last_became_peered":"2024-01-19T04:17:04.706328+0000","last_unstale":"2024-01-19T04:17:06.924285+0000","last_undegraded":"2024-01-19T04:17:06.924285+0000","last_fullsized":"2024-01-19T04:17:06.924285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:31:51.010861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687854+0000","last_change":"2024-01-19T04:16:51.581477+0000","last_active":"2024-01-19T04:17:02.687854+0000","last_peered":"2024-01-19T04:17:02.687854+0000","last_clean":"2024-01-19T04:17:02.687854+0000","last_became_active":"2024-01-19T04:16:51.580890+0000","last_became_peered":"2024-01-19T04:16:51.580890+0000","last_unstale":"2024-01-19T04:17:02.687854+0000","last_undegraded":"2024-01-19T04:17:02.687854+0000","last_fullsized":"2024-01-19T04:17:02.687854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.849907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693844+0000","last_change":"2024-01-19T04:17:03.693844+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693844+0000","last_undegraded":"2024-01-19T04:17:03.693844+0000","last_fullsized":"2024-01-19T04:17:03.693844+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698045+0000","last_change":"2024-01-19T04:16:51.580129+0000","last_active":"2024-01-19T04:17:04.698045+0000","last_peered":"2024-01-19T04:17:04.698045+0000","last_clean":"2024-01-19T04:17:04.698045+0000","last_became_active":"2024-01-19T04:16:51.579840+0000","last_became_peered":"2024-01-19T04:16:51.579840+0000","last_unstale":"2024-01-19T04:17:04.698045+0000","last_undegraded":"2024-01-19T04:17:04.698045+0000","last_fullsized":"2024-01-19T04:17:04.698045+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:56:54.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724604+0000","last_change":"2024-01-19T04:17:04.716555+0000","last_active":"2024-01-19T04:17:04.724604+0000","last_peered":"2024-01-19T04:17:04.724604+0000","last_clean":"2024-01-19T04:17:04.724604+0000","last_became_active":"2024-01-19T04:17:04.716072+0000","last_became_peered":"2024-01-19T04:17:04.716072+0000","last_unstale":"2024-01-19T04:17:04.724604+0000","last_undegraded":"2024-01-19T04:17:04.724604+0000","last_fullsized":"2024-01-19T04:17:04.724604+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700886+0000","last_change":"2024-01-19T04:16:51.574027+0000","last_active":"2024-01-19T04:17:03.700886+0000","last_peered":"2024-01-19T04:17:03.700886+0000","last_clean":"2024-01-19T04:17:03.700886+0000","last_became_active":"2024-01-19T04:16:51.573756+0000","last_became_peered":"2024-01-19T04:16:51.573756+0000","last_unstale":"2024-01-19T04:17:03.700886+0000","last_undegraded":"2024-01-19T04:17:03.700886+0000","last_fullsized":"2024-01-19T04:17:03.700886+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727171+0000","last_change":"2024-01-19T04:17:04.715758+0000","last_active":"2024-01-19T04:17:04.727171+0000","last_peered":"2024-01-19T04:17:04.727171+0000","last_clean":"2024-01-19T04:17:04.727171+0000","last_became_active":"2024-01-19T04:17:04.715514+0000","last_became_peered":"2024-01-19T04:17:04.715514+0000","last_unstale":"2024-01-19T04:17:04.727171+0000","last_undegraded":"2024-01-19T04:17:04.727171+0000","last_fullsized":"2024-01-19T04:17:04.727171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:04:35.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703432+0000","last_change":"2024-01-19T04:16:51.563134+0000","last_active":"2024-01-19T04:17:03.703432+0000","last_peered":"2024-01-19T04:17:03.703432+0000","last_clean":"2024-01-19T04:17:03.703432+0000","last_became_active":"2024-01-19T04:16:51.562243+0000","last_became_peered":"2024-01-19T04:16:51.562243+0000","last_unstale":"2024-01-19T04:17:03.703432+0000","last_undegraded":"2024-01-19T04:17:03.703432+0000","last_fullsized":"2024-01-19T04:17:03.703432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.722158+0000","last_change":"2024-01-19T04:17:04.717509+0000","last_active":"2024-01-19T04:17:04.722158+0000","last_peered":"2024-01-19T04:17:04.722158+0000","last_clean":"2024-01-19T04:17:04.722158+0000","last_became_active":"2024-01-19T04:17:04.717170+0000","last_became_peered":"2024-01-19T04:17:04.717170+0000","last_unstale":"2024-01-19T04:17:04.722158+0000","last_undegraded":"2024-01-19T04:17:04.722158+0000","last_fullsized":"2024-01-19T04:17:04.722158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687545+0000","last_change":"2024-01-19T04:16:51.568590+0000","last_active":"2024-01-19T04:17:02.687545+0000","last_peered":"2024-01-19T04:17:02.687545+0000","last_clean":"2024-01-19T04:17:02.687545+0000","last_became_active":"2024-01-19T04:16:51.567062+0000","last_became_peered":"2024-01-19T04:16:51.567062+0000","last_unstale":"2024-01-19T04:17:02.687545+0000","last_undegraded":"2024-01-19T04:17:02.687545+0000","last_fullsized":"2024-01-19T04:17:02.687545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:05.611512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733737+0000","last_change":"2024-01-19T04:17:04.727256+0000","last_active":"2024-01-19T04:17:04.733737+0000","last_peered":"2024-01-19T04:17:04.733737+0000","last_clean":"2024-01-19T04:17:04.733737+0000","last_became_active":"2024-01-19T04:17:04.726804+0000","last_became_peered":"2024-01-19T04:17:04.726804+0000","last_unstale":"2024-01-19T04:17:04.733737+0000","last_undegraded":"2024-01-19T04:17:04.733737+0000","last_fullsized":"2024-01-19T04:17:04.733737+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:20.362363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688126+0000","last_change":"2024-01-19T04:16:51.567447+0000","last_active":"2024-01-19T04:17:02.688126+0000","last_peered":"2024-01-19T04:17:02.688126+0000","last_clean":"2024-01-19T04:17:02.688126+0000","last_became_active":"2024-01-19T04:16:51.567187+0000","last_became_peered":"2024-01-19T04:16:51.567187+0000","last_unstale":"2024-01-19T04:17:02.688126+0000","last_undegraded":"2024-01-19T04:17:02.688126+0000","last_fullsized":"2024-01-19T04:17:02.688126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.695464+0000","last_change":"2024-01-19T04:17:03.695464+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.695464+0000","last_undegraded":"2024-01-19T04:17:03.695464+0000","last_fullsized":"2024-01-19T04:17:03.695464+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696299+0000","last_change":"2024-01-19T04:16:51.568350+0000","last_active":"2024-01-19T04:17:03.696299+0000","last_peered":"2024-01-19T04:17:03.696299+0000","last_clean":"2024-01-19T04:17:03.696299+0000","last_became_active":"2024-01-19T04:16:51.568051+0000","last_became_peered":"2024-01-19T04:16:51.568051+0000","last_unstale":"2024-01-19T04:17:03.696299+0000","last_undegraded":"2024-01-19T04:17:03.696299+0000","last_fullsized":"2024-01-19T04:17:03.696299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:31.896945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720368+0000","last_change":"2024-01-19T04:17:04.713905+0000","last_active":"2024-01-19T04:17:04.720368+0000","last_peered":"2024-01-19T04:17:04.720368+0000","last_clean":"2024-01-19T04:17:04.720368+0000","last_became_active":"2024-01-19T04:17:04.713659+0000","last_became_peered":"2024-01-19T04:17:04.713659+0000","last_unstale":"2024-01-19T04:17:04.720368+0000","last_undegraded":"2024-01-19T04:17:04.720368+0000","last_fullsized":"2024-01-19T04:17:04.720368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:44.988632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693196+0000","last_change":"2024-01-19T04:16:51.572672+0000","last_active":"2024-01-19T04:17:04.693196+0000","last_peered":"2024-01-19T04:17:04.693196+0000","last_clean":"2024-01-19T04:17:04.693196+0000","last_became_active":"2024-01-19T04:16:51.572209+0000","last_became_peered":"2024-01-19T04:16:51.572209+0000","last_unstale":"2024-01-19T04:17:04.693196+0000","last_undegraded":"2024-01-19T04:17:04.693196+0000","last_fullsized":"2024-01-19T04:17:04.693196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725169+0000","last_change":"2024-01-19T04:17:04.717847+0000","last_active":"2024-01-19T04:17:04.725169+0000","last_peered":"2024-01-19T04:17:04.725169+0000","last_clean":"2024-01-19T04:17:04.725169+0000","last_became_active":"2024-01-19T04:17:04.715209+0000","last_became_peered":"2024-01-19T04:17:04.715209+0000","last_unstale":"2024-01-19T04:17:04.725169+0000","last_undegraded":"2024-01-19T04:17:04.725169+0000","last_fullsized":"2024-01-19T04:17:04.725169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696371+0000","last_change":"2024-01-19T04:16:51.569401+0000","last_active":"2024-01-19T04:17:03.696371+0000","last_peered":"2024-01-19T04:17:03.696371+0000","last_clean":"2024-01-19T04:17:03.696371+0000","last_became_active":"2024-01-19T04:16:51.569130+0000","last_became_peered":"2024-01-19T04:16:51.569130+0000","last_unstale":"2024-01-19T04:17:03.696371+0000","last_undegraded":"2024-01-19T04:17:03.696371+0000","last_fullsized":"2024-01-19T04:17:03.696371+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:46.968261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693377+0000","last_change":"2024-01-19T04:17:03.693377+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693377+0000","last_undegraded":"2024-01-19T04:17:03.693377+0000","last_fullsized":"2024-01-19T04:17:03.693377+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682678+0000","last_change":"2024-01-19T04:16:51.583971+0000","last_active":"2024-01-19T04:17:02.682678+0000","last_peered":"2024-01-19T04:17:02.682678+0000","last_clean":"2024-01-19T04:17:02.682678+0000","last_became_active":"2024-01-19T04:16:51.583688+0000","last_became_peered":"2024-01-19T04:16:51.583688+0000","last_unstale":"2024-01-19T04:17:02.682678+0000","last_undegraded":"2024-01-19T04:17:02.682678+0000","last_fullsized":"2024-01-19T04:17:02.682678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:51.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697378+0000","last_change":"2024-01-19T04:17:03.697378+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697378+0000","last_undegraded":"2024-01-19T04:17:03.697378+0000","last_fullsized":"2024-01-19T04:17:03.697378+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682624+0000","last_change":"2024-01-19T04:16:51.581824+0000","last_active":"2024-01-19T04:17:02.682624+0000","last_peered":"2024-01-19T04:17:02.682624+0000","last_clean":"2024-01-19T04:17:02.682624+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:02.682624+0000","last_undegraded":"2024-01-19T04:17:02.682624+0000","last_fullsized":"2024-01-19T04:17:02.682624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:26.385285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721556+0000","last_change":"2024-01-19T04:17:04.711461+0000","last_active":"2024-01-19T04:17:04.721556+0000","last_peered":"2024-01-19T04:17:04.721556+0000","last_clean":"2024-01-19T04:17:04.721556+0000","last_became_active":"2024-01-19T04:17:04.711292+0000","last_became_peered":"2024-01-19T04:17:04.711292+0000","last_unstale":"2024-01-19T04:17:04.721556+0000","last_undegraded":"2024-01-19T04:17:04.721556+0000","last_fullsized":"2024-01-19T04:17:04.721556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:54.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703524+0000","last_change":"2024-01-19T04:16:51.575108+0000","last_active":"2024-01-19T04:17:03.703524+0000","last_peered":"2024-01-19T04:17:03.703524+0000","last_clean":"2024-01-19T04:17:03.703524+0000","last_became_active":"2024-01-19T04:16:51.574596+0000","last_became_peered":"2024-01-19T04:16:51.574596+0000","last_unstale":"2024-01-19T04:17:03.703524+0000","last_undegraded":"2024-01-19T04:17:03.703524+0000","last_fullsized":"2024-01-19T04:17:03.703524+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694959+0000","last_change":"2024-01-19T04:17:03.694959+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694959+0000","last_undegraded":"2024-01-19T04:17:03.694959+0000","last_fullsized":"2024-01-19T04:17:03.694959+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704901+0000","last_change":"2024-01-19T04:16:51.579903+0000","last_active":"2024-01-19T04:17:03.704901+0000","last_peered":"2024-01-19T04:17:03.704901+0000","last_clean":"2024-01-19T04:17:03.704901+0000","last_became_active":"2024-01-19T04:16:51.579415+0000","last_became_peered":"2024-01-19T04:16:51.579415+0000","last_unstale":"2024-01-19T04:17:03.704901+0000","last_undegraded":"2024-01-19T04:17:03.704901+0000","last_fullsized":"2024-01-19T04:17:03.704901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:31.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730411+0000","last_change":"2024-01-19T04:17:04.723485+0000","last_active":"2024-01-19T04:17:04.730411+0000","last_peered":"2024-01-19T04:17:04.730411+0000","last_clean":"2024-01-19T04:17:04.730411+0000","last_became_active":"2024-01-19T04:17:04.723202+0000","last_became_peered":"2024-01-19T04:17:04.723202+0000","last_unstale":"2024-01-19T04:17:04.730411+0000","last_undegraded":"2024-01-19T04:17:04.730411+0000","last_fullsized":"2024-01-19T04:17:04.730411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:19.815868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700684+0000","last_change":"2024-01-19T04:16:51.568949+0000","last_active":"2024-01-19T04:17:03.700684+0000","last_peered":"2024-01-19T04:17:03.700684+0000","last_clean":"2024-01-19T04:17:03.700684+0000","last_became_active":"2024-01-19T04:16:51.568682+0000","last_became_peered":"2024-01-19T04:16:51.568682+0000","last_unstale":"2024-01-19T04:17:03.700684+0000","last_undegraded":"2024-01-19T04:17:03.700684+0000","last_fullsized":"2024-01-19T04:17:03.700684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:23.038136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696463+0000","last_change":"2024-01-19T04:17:03.696463+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696463+0000","last_undegraded":"2024-01-19T04:17:03.696463+0000","last_fullsized":"2024-01-19T04:17:03.696463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696464+0000","last_change":"2024-01-19T04:16:51.588950+0000","last_active":"2024-01-19T04:17:03.696464+0000","last_peered":"2024-01-19T04:17:03.696464+0000","last_clean":"2024-01-19T04:17:03.696464+0000","last_became_active":"2024-01-19T04:16:51.577721+0000","last_became_peered":"2024-01-19T04:16:51.577721+0000","last_unstale":"2024-01-19T04:17:03.696464+0000","last_undegraded":"2024-01-19T04:17:03.696464+0000","last_fullsized":"2024-01-19T04:17:03.696464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:30.735073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.695321+0000","last_change":"2024-01-19T04:17:03.695321+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.695321+0000","last_undegraded":"2024-01-19T04:17:03.695321+0000","last_fullsized":"2024-01-19T04:17:03.695321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687590+0000","last_change":"2024-01-19T04:16:51.581861+0000","last_active":"2024-01-19T04:17:02.687590+0000","last_peered":"2024-01-19T04:17:02.687590+0000","last_clean":"2024-01-19T04:17:02.687590+0000","last_became_active":"2024-01-19T04:16:51.581465+0000","last_became_peered":"2024-01-19T04:16:51.581465+0000","last_unstale":"2024-01-19T04:17:02.687590+0000","last_undegraded":"2024-01-19T04:17:02.687590+0000","last_fullsized":"2024-01-19T04:17:02.687590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727994+0000","last_change":"2024-01-19T04:17:04.717627+0000","last_active":"2024-01-19T04:17:04.727994+0000","last_peered":"2024-01-19T04:17:04.727994+0000","last_clean":"2024-01-19T04:17:04.727994+0000","last_became_active":"2024-01-19T04:17:04.717351+0000","last_became_peered":"2024-01-19T04:17:04.717351+0000","last_unstale":"2024-01-19T04:17:04.727994+0000","last_undegraded":"2024-01-19T04:17:04.727994+0000","last_fullsized":"2024-01-19T04:17:04.727994+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:51:25.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698393+0000","last_change":"2024-01-19T04:16:51.589385+0000","last_active":"2024-01-19T04:17:04.698393+0000","last_peered":"2024-01-19T04:17:04.698393+0000","last_clean":"2024-01-19T04:17:04.698393+0000","last_became_active":"2024-01-19T04:16:51.586748+0000","last_became_peered":"2024-01-19T04:16:51.586748+0000","last_unstale":"2024-01-19T04:17:04.698393+0000","last_undegraded":"2024-01-19T04:17:04.698393+0000","last_fullsized":"2024-01-19T04:17:04.698393+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:17:50.471394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696048+0000","last_change":"2024-01-19T04:17:03.696048+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696048+0000","last_undegraded":"2024-01-19T04:17:03.696048+0000","last_fullsized":"2024-01-19T04:17:03.696048+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702978+0000","last_change":"2024-01-19T04:16:51.576164+0000","last_active":"2024-01-19T04:17:03.702978+0000","last_peered":"2024-01-19T04:17:03.702978+0000","last_clean":"2024-01-19T04:17:03.702978+0000","last_became_active":"2024-01-19T04:16:51.575615+0000","last_became_peered":"2024-01-19T04:16:51.575615+0000","last_unstale":"2024-01-19T04:17:03.702978+0000","last_undegraded":"2024-01-19T04:17:03.702978+0000","last_fullsized":"2024-01-19T04:17:03.702978+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696804+0000","last_change":"2024-01-19T04:17:03.696804+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696804+0000","last_undegraded":"2024-01-19T04:17:03.696804+0000","last_fullsized":"2024-01-19T04:17:03.696804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687934+0000","last_change":"2024-01-19T04:16:51.587440+0000","last_active":"2024-01-19T04:17:02.687934+0000","last_peered":"2024-01-19T04:17:02.687934+0000","last_clean":"2024-01-19T04:17:02.687934+0000","last_became_active":"2024-01-19T04:16:51.584713+0000","last_became_peered":"2024-01-19T04:16:51.584713+0000","last_unstale":"2024-01-19T04:17:02.687934+0000","last_undegraded":"2024-01-19T04:17:02.687934+0000","last_fullsized":"2024-01-19T04:17:02.687934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:19.082622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692299+0000","last_change":"2024-01-19T04:17:03.692299+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692299+0000","last_undegraded":"2024-01-19T04:17:03.692299+0000","last_fullsized":"2024-01-19T04:17:03.692299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696903+0000","last_change":"2024-01-19T04:16:51.584822+0000","last_active":"2024-01-19T04:17:04.696903+0000","last_peered":"2024-01-19T04:17:04.696903+0000","last_clean":"2024-01-19T04:17:04.696903+0000","last_became_active":"2024-01-19T04:16:51.584562+0000","last_became_peered":"2024-01-19T04:16:51.584562+0000","last_unstale":"2024-01-19T04:17:04.696903+0000","last_undegraded":"2024-01-19T04:17:04.696903+0000","last_fullsized":"2024-01-19T04:17:04.696903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:42.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724892+0000","last_change":"2024-01-19T04:17:04.716882+0000","last_active":"2024-01-19T04:17:04.724892+0000","last_peered":"2024-01-19T04:17:04.724892+0000","last_clean":"2024-01-19T04:17:04.724892+0000","last_became_active":"2024-01-19T04:17:04.713277+0000","last_became_peered":"2024-01-19T04:17:04.713277+0000","last_unstale":"2024-01-19T04:17:04.724892+0000","last_undegraded":"2024-01-19T04:17:04.724892+0000","last_fullsized":"2024-01-19T04:17:04.724892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702137+0000","last_change":"2024-01-19T04:16:51.577212+0000","last_active":"2024-01-19T04:17:03.702137+0000","last_peered":"2024-01-19T04:17:03.702137+0000","last_clean":"2024-01-19T04:17:03.702137+0000","last_became_active":"2024-01-19T04:16:51.576909+0000","last_became_peered":"2024-01-19T04:16:51.576909+0000","last_unstale":"2024-01-19T04:17:03.702137+0000","last_undegraded":"2024-01-19T04:17:03.702137+0000","last_fullsized":"2024-01-19T04:17:03.702137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732282+0000","last_change":"2024-01-19T04:17:04.730136+0000","last_active":"2024-01-19T04:17:04.732282+0000","last_peered":"2024-01-19T04:17:04.732282+0000","last_clean":"2024-01-19T04:17:04.732282+0000","last_became_active":"2024-01-19T04:17:04.729830+0000","last_became_peered":"2024-01-19T04:17:04.729830+0000","last_unstale":"2024-01-19T04:17:04.732282+0000","last_undegraded":"2024-01-19T04:17:04.732282+0000","last_fullsized":"2024-01-19T04:17:04.732282+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695154+0000","last_change":"2024-01-19T04:16:51.576501+0000","last_active":"2024-01-19T04:17:04.695154+0000","last_peered":"2024-01-19T04:17:04.695154+0000","last_clean":"2024-01-19T04:17:04.695154+0000","last_became_active":"2024-01-19T04:16:51.570654+0000","last_became_peered":"2024-01-19T04:16:51.570654+0000","last_unstale":"2024-01-19T04:17:04.695154+0000","last_undegraded":"2024-01-19T04:17:04.695154+0000","last_fullsized":"2024-01-19T04:17:04.695154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:47:50.383122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.706465+0000","last_change":"2024-01-19T04:17:04.702550+0000","last_active":"2024-01-19T04:17:04.706465+0000","last_peered":"2024-01-19T04:17:04.706465+0000","last_clean":"2024-01-19T04:17:04.706465+0000","last_became_active":"2024-01-19T04:17:04.702274+0000","last_became_peered":"2024-01-19T04:17:04.702274+0000","last_unstale":"2024-01-19T04:17:04.706465+0000","last_undegraded":"2024-01-19T04:17:04.706465+0000","last_fullsized":"2024-01-19T04:17:04.706465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:20.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700083+0000","last_change":"2024-01-19T04:16:51.581241+0000","last_active":"2024-01-19T04:17:03.700083+0000","last_peered":"2024-01-19T04:17:03.700083+0000","last_clean":"2024-01-19T04:17:03.700083+0000","last_became_active":"2024-01-19T04:16:51.580556+0000","last_became_peered":"2024-01-19T04:16:51.580556+0000","last_unstale":"2024-01-19T04:17:03.700083+0000","last_undegraded":"2024-01-19T04:17:03.700083+0000","last_fullsized":"2024-01-19T04:17:03.700083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:08.881391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716708+0000","last_change":"2024-01-19T04:17:04.709401+0000","last_active":"2024-01-19T04:17:04.716708+0000","last_peered":"2024-01-19T04:17:04.716708+0000","last_clean":"2024-01-19T04:17:04.716708+0000","last_became_active":"2024-01-19T04:17:04.709156+0000","last_became_peered":"2024-01-19T04:17:04.709156+0000","last_unstale":"2024-01-19T04:17:04.716708+0000","last_undegraded":"2024-01-19T04:17:04.716708+0000","last_fullsized":"2024-01-19T04:17:04.716708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:21.586290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701902+0000","last_change":"2024-01-19T04:16:51.579937+0000","last_active":"2024-01-19T04:17:03.701902+0000","last_peered":"2024-01-19T04:17:03.701902+0000","last_clean":"2024-01-19T04:17:03.701902+0000","last_became_active":"2024-01-19T04:16:51.579649+0000","last_became_peered":"2024-01-19T04:16:51.579649+0000","last_unstale":"2024-01-19T04:17:03.701902+0000","last_undegraded":"2024-01-19T04:17:03.701902+0000","last_fullsized":"2024-01-19T04:17:03.701902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:34.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924294+0000","last_change":"2024-01-19T04:17:04.712711+0000","last_active":"2024-01-19T04:17:06.924294+0000","last_peered":"2024-01-19T04:17:06.924294+0000","last_clean":"2024-01-19T04:17:06.924294+0000","last_became_active":"2024-01-19T04:17:04.712411+0000","last_became_peered":"2024-01-19T04:17:04.712411+0000","last_unstale":"2024-01-19T04:17:06.924294+0000","last_undegraded":"2024-01-19T04:17:06.924294+0000","last_fullsized":"2024-01-19T04:17:06.924294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:51:57.520659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687942+0000","last_change":"2024-01-19T04:16:51.578912+0000","last_active":"2024-01-19T04:17:02.687942+0000","last_peered":"2024-01-19T04:17:02.687942+0000","last_clean":"2024-01-19T04:17:02.687942+0000","last_became_active":"2024-01-19T04:16:51.578643+0000","last_became_peered":"2024-01-19T04:16:51.578643+0000","last_unstale":"2024-01-19T04:17:02.687942+0000","last_undegraded":"2024-01-19T04:17:02.687942+0000","last_fullsized":"2024-01-19T04:17:02.687942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:23.111411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721525+0000","last_change":"2024-01-19T04:17:04.713886+0000","last_active":"2024-01-19T04:17:04.721525+0000","last_peered":"2024-01-19T04:17:04.721525+0000","last_clean":"2024-01-19T04:17:04.721525+0000","last_became_active":"2024-01-19T04:17:04.713640+0000","last_became_peered":"2024-01-19T04:17:04.713640+0000","last_unstale":"2024-01-19T04:17:04.721525+0000","last_undegraded":"2024-01-19T04:17:04.721525+0000","last_fullsized":"2024-01-19T04:17:04.721525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:32.413236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703417+0000","last_change":"2024-01-19T04:16:51.573193+0000","last_active":"2024-01-19T04:17:03.703417+0000","last_peered":"2024-01-19T04:17:03.703417+0000","last_clean":"2024-01-19T04:17:03.703417+0000","last_became_active":"2024-01-19T04:16:51.572674+0000","last_became_peered":"2024-01-19T04:16:51.572674+0000","last_unstale":"2024-01-19T04:17:03.703417+0000","last_undegraded":"2024-01-19T04:17:03.703417+0000","last_fullsized":"2024-01-19T04:17:03.703417+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710812+0000","last_change":"2024-01-19T04:17:04.707630+0000","last_active":"2024-01-19T04:17:04.710812+0000","last_peered":"2024-01-19T04:17:04.710812+0000","last_clean":"2024-01-19T04:17:04.710812+0000","last_became_active":"2024-01-19T04:17:04.707287+0000","last_became_peered":"2024-01-19T04:17:04.707287+0000","last_unstale":"2024-01-19T04:17:04.710812+0000","last_undegraded":"2024-01-19T04:17:04.710812+0000","last_fullsized":"2024-01-19T04:17:04.710812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:40.576911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689061+0000","last_change":"2024-01-19T04:16:51.586794+0000","last_active":"2024-01-19T04:17:02.689061+0000","last_peered":"2024-01-19T04:17:02.689061+0000","last_clean":"2024-01-19T04:17:02.689061+0000","last_became_active":"2024-01-19T04:16:51.582729+0000","last_became_peered":"2024-01-19T04:16:51.582729+0000","last_unstale":"2024-01-19T04:17:02.689061+0000","last_undegraded":"2024-01-19T04:17:02.689061+0000","last_fullsized":"2024-01-19T04:17:02.689061+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730997+0000","last_change":"2024-01-19T04:17:04.726864+0000","last_active":"2024-01-19T04:17:04.730997+0000","last_peered":"2024-01-19T04:17:04.730997+0000","last_clean":"2024-01-19T04:17:04.730997+0000","last_became_active":"2024-01-19T04:17:04.726530+0000","last_became_peered":"2024-01-19T04:17:04.726530+0000","last_unstale":"2024-01-19T04:17:04.730997+0000","last_undegraded":"2024-01-19T04:17:04.730997+0000","last_fullsized":"2024-01-19T04:17:04.730997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687514+0000","last_change":"2024-01-19T04:16:51.568656+0000","last_active":"2024-01-19T04:17:02.687514+0000","last_peered":"2024-01-19T04:17:02.687514+0000","last_clean":"2024-01-19T04:17:02.687514+0000","last_became_active":"2024-01-19T04:16:51.568371+0000","last_became_peered":"2024-01-19T04:16:51.568371+0000","last_unstale":"2024-01-19T04:17:02.687514+0000","last_undegraded":"2024-01-19T04:17:02.687514+0000","last_fullsized":"2024-01-19T04:17:02.687514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:42.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719165+0000","last_change":"2024-01-19T04:17:04.713110+0000","last_active":"2024-01-19T04:17:04.719165+0000","last_peered":"2024-01-19T04:17:04.719165+0000","last_clean":"2024-01-19T04:17:04.719165+0000","last_became_active":"2024-01-19T04:17:04.712838+0000","last_became_peered":"2024-01-19T04:17:04.712838+0000","last_unstale":"2024-01-19T04:17:04.719165+0000","last_undegraded":"2024-01-19T04:17:04.719165+0000","last_fullsized":"2024-01-19T04:17:04.719165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695186+0000","last_change":"2024-01-19T04:16:51.583324+0000","last_active":"2024-01-19T04:17:04.695186+0000","last_peered":"2024-01-19T04:17:04.695186+0000","last_clean":"2024-01-19T04:17:04.695186+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:04.695186+0000","last_undegraded":"2024-01-19T04:17:04.695186+0000","last_fullsized":"2024-01-19T04:17:04.695186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:01.837432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733715+0000","last_change":"2024-01-19T04:17:04.727034+0000","last_active":"2024-01-19T04:17:04.733715+0000","last_peered":"2024-01-19T04:17:04.733715+0000","last_clean":"2024-01-19T04:17:04.733715+0000","last_became_active":"2024-01-19T04:17:04.726442+0000","last_became_peered":"2024-01-19T04:17:04.726442+0000","last_unstale":"2024-01-19T04:17:04.733715+0000","last_undegraded":"2024-01-19T04:17:04.733715+0000","last_fullsized":"2024-01-19T04:17:04.733715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.021270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700737+0000","last_change":"2024-01-19T04:16:51.577511+0000","last_active":"2024-01-19T04:17:03.700737+0000","last_peered":"2024-01-19T04:17:03.700737+0000","last_clean":"2024-01-19T04:17:03.700737+0000","last_became_active":"2024-01-19T04:16:51.577076+0000","last_became_peered":"2024-01-19T04:16:51.577076+0000","last_unstale":"2024-01-19T04:17:03.700737+0000","last_undegraded":"2024-01-19T04:17:03.700737+0000","last_fullsized":"2024-01-19T04:17:03.700737+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924130+0000","last_change":"2024-01-19T04:17:04.713152+0000","last_active":"2024-01-19T04:17:06.924130+0000","last_peered":"2024-01-19T04:17:06.924130+0000","last_clean":"2024-01-19T04:17:06.924130+0000","last_became_active":"2024-01-19T04:17:04.712882+0000","last_became_peered":"2024-01-19T04:17:04.712882+0000","last_unstale":"2024-01-19T04:17:06.924130+0000","last_undegraded":"2024-01-19T04:17:06.924130+0000","last_fullsized":"2024-01-19T04:17:06.924130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:02.470278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687096+0000","last_change":"2024-01-19T04:16:51.578248+0000","last_active":"2024-01-19T04:17:02.687096+0000","last_peered":"2024-01-19T04:17:02.687096+0000","last_clean":"2024-01-19T04:17:02.687096+0000","last_became_active":"2024-01-19T04:16:51.577983+0000","last_became_peered":"2024-01-19T04:16:51.577983+0000","last_unstale":"2024-01-19T04:17:02.687096+0000","last_undegraded":"2024-01-19T04:17:02.687096+0000","last_fullsized":"2024-01-19T04:17:02.687096+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:14.895654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730956+0000","last_change":"2024-01-19T04:17:04.727249+0000","last_active":"2024-01-19T04:17:04.730956+0000","last_peered":"2024-01-19T04:17:04.730956+0000","last_clean":"2024-01-19T04:17:04.730956+0000","last_became_active":"2024-01-19T04:17:04.726674+0000","last_became_peered":"2024-01-19T04:17:04.726674+0000","last_unstale":"2024-01-19T04:17:04.730956+0000","last_undegraded":"2024-01-19T04:17:04.730956+0000","last_fullsized":"2024-01-19T04:17:04.730956+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688262+0000","last_change":"2024-01-19T04:16:51.586614+0000","last_active":"2024-01-19T04:17:02.688262+0000","last_peered":"2024-01-19T04:17:02.688262+0000","last_clean":"2024-01-19T04:17:02.688262+0000","last_became_active":"2024-01-19T04:16:51.586104+0000","last_became_peered":"2024-01-19T04:16:51.586104+0000","last_unstale":"2024-01-19T04:17:02.688262+0000","last_undegraded":"2024-01-19T04:17:02.688262+0000","last_fullsized":"2024-01-19T04:17:02.688262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734509+0000","last_change":"2024-01-19T04:17:04.730684+0000","last_active":"2024-01-19T04:17:04.734509+0000","last_peered":"2024-01-19T04:17:04.734509+0000","last_clean":"2024-01-19T04:17:04.734509+0000","last_became_active":"2024-01-19T04:17:04.729893+0000","last_became_peered":"2024-01-19T04:17:04.729893+0000","last_unstale":"2024-01-19T04:17:04.734509+0000","last_undegraded":"2024-01-19T04:17:04.734509+0000","last_fullsized":"2024-01-19T04:17:04.734509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:39.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733676+0000","last_change":"2024-01-19T04:17:03.712060+0000","last_active":"2024-01-19T04:17:04.733676+0000","last_peered":"2024-01-19T04:17:04.733676+0000","last_clean":"2024-01-19T04:17:04.733676+0000","last_became_active":"2024-01-19T04:17:03.711745+0000","last_became_peered":"2024-01-19T04:17:03.711745+0000","last_unstale":"2024-01-19T04:17:04.733676+0000","last_undegraded":"2024-01-19T04:17:04.733676+0000","last_fullsized":"2024-01-19T04:17:04.733676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:39.750994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689966+0000","last_change":"2024-01-19T04:16:51.575044+0000","last_active":"2024-01-19T04:17:02.689966+0000","last_peered":"2024-01-19T04:17:02.689966+0000","last_clean":"2024-01-19T04:17:02.689966+0000","last_became_active":"2024-01-19T04:16:51.574674+0000","last_became_peered":"2024-01-19T04:16:51.574674+0000","last_unstale":"2024-01-19T04:17:02.689966+0000","last_undegraded":"2024-01-19T04:17:02.689966+0000","last_fullsized":"2024-01-19T04:17:02.689966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689548+0000","last_change":"2024-01-19T04:16:50.572149+0000","last_active":"2024-01-19T04:17:02.689548+0000","last_peered":"2024-01-19T04:17:02.689548+0000","last_clean":"2024-01-19T04:17:02.689548+0000","last_became_active":"2024-01-19T04:16:50.571648+0000","last_became_peered":"2024-01-19T04:16:50.571648+0000","last_unstale":"2024-01-19T04:17:02.689548+0000","last_undegraded":"2024-01-19T04:17:02.689548+0000","last_fullsized":"2024-01-19T04:17:02.689548+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728547+0000","last_change":"2024-01-19T04:17:04.718498+0000","last_active":"2024-01-19T04:17:04.728547+0000","last_peered":"2024-01-19T04:17:04.728547+0000","last_clean":"2024-01-19T04:17:04.728547+0000","last_became_active":"2024-01-19T04:17:04.717566+0000","last_became_peered":"2024-01-19T04:17:04.717566+0000","last_unstale":"2024-01-19T04:17:04.728547+0000","last_undegraded":"2024-01-19T04:17:04.728547+0000","last_fullsized":"2024-01-19T04:17:04.728547+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732753+0000","last_change":"2024-01-19T04:17:03.709880+0000","last_active":"2024-01-19T04:17:04.732753+0000","last_peered":"2024-01-19T04:17:04.732753+0000","last_clean":"2024-01-19T04:17:04.732753+0000","last_became_active":"2024-01-19T04:17:03.709543+0000","last_became_peered":"2024-01-19T04:17:03.709543+0000","last_unstale":"2024-01-19T04:17:04.732753+0000","last_undegraded":"2024-01-19T04:17:04.732753+0000","last_fullsized":"2024-01-19T04:17:04.732753+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:31:11.411184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682832+0000","last_change":"2024-01-19T04:16:51.590705+0000","last_active":"2024-01-19T04:17:02.682832+0000","last_peered":"2024-01-19T04:17:02.682832+0000","last_clean":"2024-01-19T04:17:02.682832+0000","last_became_active":"2024-01-19T04:16:51.590304+0000","last_became_peered":"2024-01-19T04:16:51.590304+0000","last_unstale":"2024-01-19T04:17:02.682832+0000","last_undegraded":"2024-01-19T04:17:02.682832+0000","last_fullsized":"2024-01-19T04:17:02.682832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:51.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698137+0000","last_change":"2024-01-19T04:16:50.567145+0000","last_active":"2024-01-19T04:17:04.698137+0000","last_peered":"2024-01-19T04:17:04.698137+0000","last_clean":"2024-01-19T04:17:04.698137+0000","last_became_active":"2024-01-19T04:16:50.566844+0000","last_became_peered":"2024-01-19T04:16:50.566844+0000","last_unstale":"2024-01-19T04:17:04.698137+0000","last_undegraded":"2024-01-19T04:17:04.698137+0000","last_fullsized":"2024-01-19T04:17:04.698137+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:07.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735309+0000","last_change":"2024-01-19T04:17:04.732829+0000","last_active":"2024-01-19T04:17:04.735309+0000","last_peered":"2024-01-19T04:17:04.735309+0000","last_clean":"2024-01-19T04:17:04.735309+0000","last_became_active":"2024-01-19T04:17:04.732552+0000","last_became_peered":"2024-01-19T04:17:04.732552+0000","last_unstale":"2024-01-19T04:17:04.735309+0000","last_undegraded":"2024-01-19T04:17:04.735309+0000","last_fullsized":"2024-01-19T04:17:04.735309+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:56:58.089850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727954+0000","last_change":"2024-01-19T04:17:03.713210+0000","last_active":"2024-01-19T04:17:04.727954+0000","last_peered":"2024-01-19T04:17:04.727954+0000","last_clean":"2024-01-19T04:17:04.727954+0000","last_became_active":"2024-01-19T04:17:03.712941+0000","last_became_peered":"2024-01-19T04:17:03.712941+0000","last_unstale":"2024-01-19T04:17:04.727954+0000","last_undegraded":"2024-01-19T04:17:04.727954+0000","last_fullsized":"2024-01-19T04:17:04.727954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688783+0000","last_change":"2024-01-19T04:16:51.573140+0000","last_active":"2024-01-19T04:17:02.688783+0000","last_peered":"2024-01-19T04:17:02.688783+0000","last_clean":"2024-01-19T04:17:02.688783+0000","last_became_active":"2024-01-19T04:16:51.572831+0000","last_became_peered":"2024-01-19T04:16:51.572831+0000","last_unstale":"2024-01-19T04:17:02.688783+0000","last_undegraded":"2024-01-19T04:17:02.688783+0000","last_fullsized":"2024-01-19T04:17:02.688783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689361+0000","last_change":"2024-01-19T04:16:50.563884+0000","last_active":"2024-01-19T04:17:02.689361+0000","last_peered":"2024-01-19T04:17:02.689361+0000","last_clean":"2024-01-19T04:17:02.689361+0000","last_became_active":"2024-01-19T04:16:50.563631+0000","last_became_peered":"2024-01-19T04:16:50.563631+0000","last_unstale":"2024-01-19T04:17:02.689361+0000","last_undegraded":"2024-01-19T04:17:02.689361+0000","last_fullsized":"2024-01-19T04:17:02.689361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696290+0000","last_change":"2024-01-19T04:17:03.696290+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696290+0000","last_undegraded":"2024-01-19T04:17:03.696290+0000","last_fullsized":"2024-01-19T04:17:03.696290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.714476+0000","last_change":"2024-01-19T04:17:03.710296+0000","last_active":"2024-01-19T04:17:03.714476+0000","last_peered":"2024-01-19T04:17:03.714476+0000","last_clean":"2024-01-19T04:17:03.714476+0000","last_became_active":"2024-01-19T04:17:03.710001+0000","last_became_peered":"2024-01-19T04:17:03.710001+0000","last_unstale":"2024-01-19T04:17:03.714476+0000","last_undegraded":"2024-01-19T04:17:03.714476+0000","last_fullsized":"2024-01-19T04:17:03.714476+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689683+0000","last_change":"2024-01-19T04:16:51.574394+0000","last_active":"2024-01-19T04:17:02.689683+0000","last_peered":"2024-01-19T04:17:02.689683+0000","last_clean":"2024-01-19T04:17:02.689683+0000","last_became_active":"2024-01-19T04:16:51.573866+0000","last_became_peered":"2024-01-19T04:16:51.573866+0000","last_unstale":"2024-01-19T04:17:02.689683+0000","last_undegraded":"2024-01-19T04:17:02.689683+0000","last_fullsized":"2024-01-19T04:17:02.689683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703621+0000","last_change":"2024-01-19T04:16:50.571503+0000","last_active":"2024-01-19T04:17:03.703621+0000","last_peered":"2024-01-19T04:17:03.703621+0000","last_clean":"2024-01-19T04:17:03.703621+0000","last_became_active":"2024-01-19T04:16:50.571066+0000","last_became_peered":"2024-01-19T04:16:50.571066+0000","last_unstale":"2024-01-19T04:17:03.703621+0000","last_undegraded":"2024-01-19T04:17:03.703621+0000","last_fullsized":"2024-01-19T04:17:03.703621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694152+0000","last_change":"2024-01-19T04:17:03.694152+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694152+0000","last_undegraded":"2024-01-19T04:17:03.694152+0000","last_fullsized":"2024-01-19T04:17:03.694152+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709771+0000","last_change":"2024-01-19T04:17:03.705700+0000","last_active":"2024-01-19T04:17:03.709771+0000","last_peered":"2024-01-19T04:17:03.709771+0000","last_clean":"2024-01-19T04:17:03.709771+0000","last_became_active":"2024-01-19T04:17:03.705353+0000","last_became_peered":"2024-01-19T04:17:03.705353+0000","last_unstale":"2024-01-19T04:17:03.709771+0000","last_undegraded":"2024-01-19T04:17:03.709771+0000","last_fullsized":"2024-01-19T04:17:03.709771+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:43:27.804228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695238+0000","last_change":"2024-01-19T04:16:51.573659+0000","last_active":"2024-01-19T04:17:04.695238+0000","last_peered":"2024-01-19T04:17:04.695238+0000","last_clean":"2024-01-19T04:17:04.695238+0000","last_became_active":"2024-01-19T04:16:51.570362+0000","last_became_peered":"2024-01-19T04:16:51.570362+0000","last_unstale":"2024-01-19T04:17:04.695238+0000","last_undegraded":"2024-01-19T04:17:04.695238+0000","last_fullsized":"2024-01-19T04:17:04.695238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:12.091637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697876+0000","last_change":"2024-01-19T04:16:50.562830+0000","last_active":"2024-01-19T04:17:03.697876+0000","last_peered":"2024-01-19T04:17:03.697876+0000","last_clean":"2024-01-19T04:17:03.697876+0000","last_became_active":"2024-01-19T04:16:50.562528+0000","last_became_peered":"2024-01-19T04:16:50.562528+0000","last_unstale":"2024-01-19T04:17:03.697876+0000","last_undegraded":"2024-01-19T04:17:03.697876+0000","last_fullsized":"2024-01-19T04:17:03.697876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:03.641474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694545+0000","last_change":"2024-01-19T04:17:03.694545+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694545+0000","last_undegraded":"2024-01-19T04:17:03.694545+0000","last_fullsized":"2024-01-19T04:17:03.694545+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.708375+0000","last_change":"2024-01-19T04:17:03.704020+0000","last_active":"2024-01-19T04:17:03.708375+0000","last_peered":"2024-01-19T04:17:03.708375+0000","last_clean":"2024-01-19T04:17:03.708375+0000","last_became_active":"2024-01-19T04:17:03.703750+0000","last_became_peered":"2024-01-19T04:17:03.703750+0000","last_unstale":"2024-01-19T04:17:03.708375+0000","last_undegraded":"2024-01-19T04:17:03.708375+0000","last_fullsized":"2024-01-19T04:17:03.708375+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:11:42.246097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694990+0000","last_change":"2024-01-19T04:16:51.582274+0000","last_active":"2024-01-19T04:17:04.694990+0000","last_peered":"2024-01-19T04:17:04.694990+0000","last_clean":"2024-01-19T04:17:04.694990+0000","last_became_active":"2024-01-19T04:16:51.581164+0000","last_became_peered":"2024-01-19T04:16:51.581164+0000","last_unstale":"2024-01-19T04:17:04.694990+0000","last_undegraded":"2024-01-19T04:17:04.694990+0000","last_fullsized":"2024-01-19T04:17:04.694990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:47.861123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688218+0000","last_change":"2024-01-19T04:16:50.566550+0000","last_active":"2024-01-19T04:17:02.688218+0000","last_peered":"2024-01-19T04:17:02.688218+0000","last_clean":"2024-01-19T04:17:02.688218+0000","last_became_active":"2024-01-19T04:16:50.566278+0000","last_became_peered":"2024-01-19T04:16:50.566278+0000","last_unstale":"2024-01-19T04:17:02.688218+0000","last_undegraded":"2024-01-19T04:17:02.688218+0000","last_fullsized":"2024-01-19T04:17:02.688218+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711170+0000","last_change":"2024-01-19T04:17:04.707638+0000","last_active":"2024-01-19T04:17:04.711170+0000","last_peered":"2024-01-19T04:17:04.711170+0000","last_clean":"2024-01-19T04:17:04.711170+0000","last_became_active":"2024-01-19T04:17:04.707389+0000","last_became_peered":"2024-01-19T04:17:04.707389+0000","last_unstale":"2024-01-19T04:17:04.711170+0000","last_undegraded":"2024-01-19T04:17:04.711170+0000","last_fullsized":"2024-01-19T04:17:04.711170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725642+0000","last_change":"2024-01-19T04:17:03.713411+0000","last_active":"2024-01-19T04:17:04.725642+0000","last_peered":"2024-01-19T04:17:04.725642+0000","last_clean":"2024-01-19T04:17:04.725642+0000","last_became_active":"2024-01-19T04:17:03.712945+0000","last_became_peered":"2024-01-19T04:17:03.712945+0000","last_unstale":"2024-01-19T04:17:04.725642+0000","last_undegraded":"2024-01-19T04:17:04.725642+0000","last_fullsized":"2024-01-19T04:17:04.725642+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:18.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702014+0000","last_change":"2024-01-19T04:16:51.579590+0000","last_active":"2024-01-19T04:17:03.702014+0000","last_peered":"2024-01-19T04:17:03.702014+0000","last_clean":"2024-01-19T04:17:03.702014+0000","last_became_active":"2024-01-19T04:16:51.579242+0000","last_became_peered":"2024-01-19T04:16:51.579242+0000","last_unstale":"2024-01-19T04:17:03.702014+0000","last_undegraded":"2024-01-19T04:17:03.702014+0000","last_fullsized":"2024-01-19T04:17:03.702014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:09.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699654+0000","last_change":"2024-01-19T04:16:50.568633+0000","last_active":"2024-01-19T04:17:03.699654+0000","last_peered":"2024-01-19T04:17:03.699654+0000","last_clean":"2024-01-19T04:17:03.699654+0000","last_became_active":"2024-01-19T04:16:50.568334+0000","last_became_peered":"2024-01-19T04:16:50.568334+0000","last_unstale":"2024-01-19T04:17:03.699654+0000","last_undegraded":"2024-01-19T04:17:03.699654+0000","last_fullsized":"2024-01-19T04:17:03.699654+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716215+0000","last_change":"2024-01-19T04:17:04.708655+0000","last_active":"2024-01-19T04:17:04.716215+0000","last_peered":"2024-01-19T04:17:04.716215+0000","last_clean":"2024-01-19T04:17:04.716215+0000","last_became_active":"2024-01-19T04:17:04.708364+0000","last_became_peered":"2024-01-19T04:17:04.708364+0000","last_unstale":"2024-01-19T04:17:04.716215+0000","last_undegraded":"2024-01-19T04:17:04.716215+0000","last_fullsized":"2024-01-19T04:17:04.716215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:16.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733062+0000","last_change":"2024-01-19T04:17:03.717810+0000","last_active":"2024-01-19T04:17:04.733062+0000","last_peered":"2024-01-19T04:17:04.733062+0000","last_clean":"2024-01-19T04:17:04.733062+0000","last_became_active":"2024-01-19T04:17:03.717529+0000","last_became_peered":"2024-01-19T04:17:03.717529+0000","last_unstale":"2024-01-19T04:17:04.733062+0000","last_undegraded":"2024-01-19T04:17:04.733062+0000","last_fullsized":"2024-01-19T04:17:04.733062+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:57.511703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695501+0000","last_change":"2024-01-19T04:16:51.585817+0000","last_active":"2024-01-19T04:17:04.695501+0000","last_peered":"2024-01-19T04:17:04.695501+0000","last_clean":"2024-01-19T04:17:04.695501+0000","last_became_active":"2024-01-19T04:16:51.585142+0000","last_became_peered":"2024-01-19T04:16:51.585142+0000","last_unstale":"2024-01-19T04:17:04.695501+0000","last_undegraded":"2024-01-19T04:17:04.695501+0000","last_fullsized":"2024-01-19T04:17:04.695501+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:41.744656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697098+0000","last_change":"2024-01-19T04:16:50.569683+0000","last_active":"2024-01-19T04:17:03.697098+0000","last_peered":"2024-01-19T04:17:03.697098+0000","last_clean":"2024-01-19T04:17:03.697098+0000","last_became_active":"2024-01-19T04:16:50.567925+0000","last_became_peered":"2024-01-19T04:16:50.567925+0000","last_unstale":"2024-01-19T04:17:03.697098+0000","last_undegraded":"2024-01-19T04:17:03.697098+0000","last_fullsized":"2024-01-19T04:17:03.697098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:25.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720559+0000","last_change":"2024-01-19T04:17:04.714330+0000","last_active":"2024-01-19T04:17:04.720559+0000","last_peered":"2024-01-19T04:17:04.720559+0000","last_clean":"2024-01-19T04:17:04.720559+0000","last_became_active":"2024-01-19T04:17:04.712504+0000","last_became_peered":"2024-01-19T04:17:04.712504+0000","last_unstale":"2024-01-19T04:17:04.720559+0000","last_undegraded":"2024-01-19T04:17:04.720559+0000","last_fullsized":"2024-01-19T04:17:04.720559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:20:39.111262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728964+0000","last_change":"2024-01-19T04:17:03.707765+0000","last_active":"2024-01-19T04:17:04.728964+0000","last_peered":"2024-01-19T04:17:04.728964+0000","last_clean":"2024-01-19T04:17:04.728964+0000","last_became_active":"2024-01-19T04:17:03.707463+0000","last_became_peered":"2024-01-19T04:17:03.707463+0000","last_unstale":"2024-01-19T04:17:04.728964+0000","last_undegraded":"2024-01-19T04:17:04.728964+0000","last_fullsized":"2024-01-19T04:17:04.728964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:30.923295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705625+0000","last_change":"2024-01-19T04:16:51.587058+0000","last_active":"2024-01-19T04:17:03.705625+0000","last_peered":"2024-01-19T04:17:03.705625+0000","last_clean":"2024-01-19T04:17:03.705625+0000","last_became_active":"2024-01-19T04:16:51.577162+0000","last_became_peered":"2024-01-19T04:16:51.577162+0000","last_unstale":"2024-01-19T04:17:03.705625+0000","last_undegraded":"2024-01-19T04:17:03.705625+0000","last_fullsized":"2024-01-19T04:17:03.705625+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:59.277518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701457+0000","last_change":"2024-01-19T04:16:50.568525+0000","last_active":"2024-01-19T04:17:03.701457+0000","last_peered":"2024-01-19T04:17:03.701457+0000","last_clean":"2024-01-19T04:17:03.701457+0000","last_became_active":"2024-01-19T04:16:50.568256+0000","last_became_peered":"2024-01-19T04:16:50.568256+0000","last_unstale":"2024-01-19T04:17:03.701457+0000","last_undegraded":"2024-01-19T04:17:03.701457+0000","last_fullsized":"2024-01-19T04:17:03.701457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697444+0000","last_change":"2024-01-19T04:17:03.697444+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697444+0000","last_undegraded":"2024-01-19T04:17:03.697444+0000","last_fullsized":"2024-01-19T04:17:03.697444+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709846+0000","last_change":"2024-01-19T04:17:03.705858+0000","last_active":"2024-01-19T04:17:03.709846+0000","last_peered":"2024-01-19T04:17:03.709846+0000","last_clean":"2024-01-19T04:17:03.709846+0000","last_became_active":"2024-01-19T04:17:03.705336+0000","last_became_peered":"2024-01-19T04:17:03.705336+0000","last_unstale":"2024-01-19T04:17:03.709846+0000","last_undegraded":"2024-01-19T04:17:03.709846+0000","last_fullsized":"2024-01-19T04:17:03.709846+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:13:06.911289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701334+0000","last_change":"2024-01-19T04:16:51.583117+0000","last_active":"2024-01-19T04:17:03.701334+0000","last_peered":"2024-01-19T04:17:03.701334+0000","last_clean":"2024-01-19T04:17:03.701334+0000","last_became_active":"2024-01-19T04:16:51.582850+0000","last_became_peered":"2024-01-19T04:16:51.582850+0000","last_unstale":"2024-01-19T04:17:03.701334+0000","last_undegraded":"2024-01-19T04:17:03.701334+0000","last_fullsized":"2024-01-19T04:17:03.701334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:19.273356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698214+0000","last_change":"2024-01-19T04:16:50.568671+0000","last_active":"2024-01-19T04:17:04.698214+0000","last_peered":"2024-01-19T04:17:04.698214+0000","last_clean":"2024-01-19T04:17:04.698214+0000","last_became_active":"2024-01-19T04:16:50.568385+0000","last_became_peered":"2024-01-19T04:16:50.568385+0000","last_unstale":"2024-01-19T04:17:04.698214+0000","last_undegraded":"2024-01-19T04:17:04.698214+0000","last_fullsized":"2024-01-19T04:17:04.698214+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:51.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.718727+0000","last_change":"2024-01-19T04:17:04.711029+0000","last_active":"2024-01-19T04:17:04.718727+0000","last_peered":"2024-01-19T04:17:04.718727+0000","last_clean":"2024-01-19T04:17:04.718727+0000","last_became_active":"2024-01-19T04:17:04.709892+0000","last_became_peered":"2024-01-19T04:17:04.709892+0000","last_unstale":"2024-01-19T04:17:04.718727+0000","last_undegraded":"2024-01-19T04:17:04.718727+0000","last_fullsized":"2024-01-19T04:17:04.718727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695249+0000","last_change":"2024-01-19T04:17:03.711352+0000","last_active":"2024-01-19T04:17:04.695249+0000","last_peered":"2024-01-19T04:17:04.695249+0000","last_clean":"2024-01-19T04:17:04.695249+0000","last_became_active":"2024-01-19T04:17:03.711063+0000","last_became_peered":"2024-01-19T04:17:03.711063+0000","last_unstale":"2024-01-19T04:17:04.695249+0000","last_undegraded":"2024-01-19T04:17:04.695249+0000","last_fullsized":"2024-01-19T04:17:04.695249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:38.820788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682407+0000","last_change":"2024-01-19T04:16:51.580811+0000","last_active":"2024-01-19T04:17:02.682407+0000","last_peered":"2024-01-19T04:17:02.682407+0000","last_clean":"2024-01-19T04:17:02.682407+0000","last_became_active":"2024-01-19T04:16:51.579990+0000","last_became_peered":"2024-01-19T04:16:51.579990+0000","last_unstale":"2024-01-19T04:17:02.682407+0000","last_undegraded":"2024-01-19T04:17:02.682407+0000","last_fullsized":"2024-01-19T04:17:02.682407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:43:24.773146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701261+0000","last_change":"2024-01-19T04:16:50.569777+0000","last_active":"2024-01-19T04:17:03.701261+0000","last_peered":"2024-01-19T04:17:03.701261+0000","last_clean":"2024-01-19T04:17:03.701261+0000","last_became_active":"2024-01-19T04:16:50.569507+0000","last_became_peered":"2024-01-19T04:16:50.569507+0000","last_unstale":"2024-01-19T04:17:03.701261+0000","last_undegraded":"2024-01-19T04:17:03.701261+0000","last_fullsized":"2024-01-19T04:17:03.701261+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735294+0000","last_change":"2024-01-19T04:17:04.732838+0000","last_active":"2024-01-19T04:17:04.735294+0000","last_peered":"2024-01-19T04:17:04.735294+0000","last_clean":"2024-01-19T04:17:04.735294+0000","last_became_active":"2024-01-19T04:17:04.732579+0000","last_became_peered":"2024-01-19T04:17:04.732579+0000","last_unstale":"2024-01-19T04:17:04.735294+0000","last_undegraded":"2024-01-19T04:17:04.735294+0000","last_fullsized":"2024-01-19T04:17:04.735294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:26.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701729+0000","last_change":"2024-01-19T04:17:03.710016+0000","last_active":"2024-01-19T04:17:04.701729+0000","last_peered":"2024-01-19T04:17:04.701729+0000","last_clean":"2024-01-19T04:17:04.701729+0000","last_became_active":"2024-01-19T04:17:03.709659+0000","last_became_peered":"2024-01-19T04:17:03.709659+0000","last_unstale":"2024-01-19T04:17:04.701729+0000","last_undegraded":"2024-01-19T04:17:04.701729+0000","last_fullsized":"2024-01-19T04:17:04.701729+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:35.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701014+0000","last_change":"2024-01-19T04:16:51.582425+0000","last_active":"2024-01-19T04:17:03.701014+0000","last_peered":"2024-01-19T04:17:03.701014+0000","last_clean":"2024-01-19T04:17:03.701014+0000","last_became_active":"2024-01-19T04:16:51.582136+0000","last_became_peered":"2024-01-19T04:16:51.582136+0000","last_unstale":"2024-01-19T04:17:03.701014+0000","last_undegraded":"2024-01-19T04:17:03.701014+0000","last_fullsized":"2024-01-19T04:17:03.701014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702836+0000","last_change":"2024-01-19T04:16:50.563850+0000","last_active":"2024-01-19T04:17:03.702836+0000","last_peered":"2024-01-19T04:17:03.702836+0000","last_clean":"2024-01-19T04:17:03.702836+0000","last_became_active":"2024-01-19T04:16:50.563492+0000","last_became_peered":"2024-01-19T04:16:50.563492+0000","last_unstale":"2024-01-19T04:17:03.702836+0000","last_undegraded":"2024-01-19T04:17:03.702836+0000","last_fullsized":"2024-01-19T04:17:03.702836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:50.446354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693984+0000","last_change":"2024-01-19T04:17:03.693984+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693984+0000","last_undegraded":"2024-01-19T04:17:03.693984+0000","last_fullsized":"2024-01-19T04:17:03.693984+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702056+0000","last_change":"2024-01-19T04:17:03.713104+0000","last_active":"2024-01-19T04:17:04.702056+0000","last_peered":"2024-01-19T04:17:04.702056+0000","last_clean":"2024-01-19T04:17:04.702056+0000","last_became_active":"2024-01-19T04:17:03.712774+0000","last_became_peered":"2024-01-19T04:17:03.712774+0000","last_unstale":"2024-01-19T04:17:04.702056+0000","last_undegraded":"2024-01-19T04:17:04.702056+0000","last_fullsized":"2024-01-19T04:17:04.702056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700474+0000","last_change":"2024-01-19T04:16:51.579099+0000","last_active":"2024-01-19T04:17:03.700474+0000","last_peered":"2024-01-19T04:17:03.700474+0000","last_clean":"2024-01-19T04:17:03.700474+0000","last_became_active":"2024-01-19T04:16:51.578809+0000","last_became_peered":"2024-01-19T04:16:51.578809+0000","last_unstale":"2024-01-19T04:17:03.700474+0000","last_undegraded":"2024-01-19T04:17:03.700474+0000","last_fullsized":"2024-01-19T04:17:03.700474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695098+0000","last_change":"2024-01-19T04:16:50.565530+0000","last_active":"2024-01-19T04:17:04.695098+0000","last_peered":"2024-01-19T04:17:04.695098+0000","last_clean":"2024-01-19T04:17:04.695098+0000","last_became_active":"2024-01-19T04:16:50.565191+0000","last_became_peered":"2024-01-19T04:16:50.565191+0000","last_unstale":"2024-01-19T04:17:04.695098+0000","last_undegraded":"2024-01-19T04:17:04.695098+0000","last_fullsized":"2024-01-19T04:17:04.695098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:14.286352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694155+0000","last_change":"2024-01-19T04:17:03.694155+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694155+0000","last_undegraded":"2024-01-19T04:17:03.694155+0000","last_fullsized":"2024-01-19T04:17:03.694155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.731424+0000","last_change":"2024-01-19T04:17:03.711561+0000","last_active":"2024-01-19T04:17:04.731424+0000","last_peered":"2024-01-19T04:17:04.731424+0000","last_clean":"2024-01-19T04:17:04.731424+0000","last_became_active":"2024-01-19T04:17:03.711261+0000","last_became_peered":"2024-01-19T04:17:03.711261+0000","last_unstale":"2024-01-19T04:17:04.731424+0000","last_undegraded":"2024-01-19T04:17:04.731424+0000","last_fullsized":"2024-01-19T04:17:04.731424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:19.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702246+0000","last_change":"2024-01-19T04:16:51.587155+0000","last_active":"2024-01-19T04:17:03.702246+0000","last_peered":"2024-01-19T04:17:03.702246+0000","last_clean":"2024-01-19T04:17:03.702246+0000","last_became_active":"2024-01-19T04:16:51.584989+0000","last_became_peered":"2024-01-19T04:16:51.584989+0000","last_unstale":"2024-01-19T04:17:03.702246+0000","last_undegraded":"2024-01-19T04:17:03.702246+0000","last_fullsized":"2024-01-19T04:17:03.702246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704254+0000","last_change":"2024-01-19T04:16:50.566824+0000","last_active":"2024-01-19T04:17:03.704254+0000","last_peered":"2024-01-19T04:17:03.704254+0000","last_clean":"2024-01-19T04:17:03.704254+0000","last_became_active":"2024-01-19T04:16:50.566530+0000","last_became_peered":"2024-01-19T04:16:50.566530+0000","last_unstale":"2024-01-19T04:17:03.704254+0000","last_undegraded":"2024-01-19T04:17:03.704254+0000","last_fullsized":"2024-01-19T04:17:03.704254+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727903+0000","last_change":"2024-01-19T04:17:04.718338+0000","last_active":"2024-01-19T04:17:04.727903+0000","last_peered":"2024-01-19T04:17:04.727903+0000","last_clean":"2024-01-19T04:17:04.727903+0000","last_became_active":"2024-01-19T04:17:04.714128+0000","last_became_peered":"2024-01-19T04:17:04.714128+0000","last_unstale":"2024-01-19T04:17:04.727903+0000","last_undegraded":"2024-01-19T04:17:04.727903+0000","last_fullsized":"2024-01-19T04:17:04.727903+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.710312+0000","last_change":"2024-01-19T04:17:03.706653+0000","last_active":"2024-01-19T04:17:03.710312+0000","last_peered":"2024-01-19T04:17:03.710312+0000","last_clean":"2024-01-19T04:17:03.710312+0000","last_became_active":"2024-01-19T04:17:03.706259+0000","last_became_peered":"2024-01-19T04:17:03.706259+0000","last_unstale":"2024-01-19T04:17:03.710312+0000","last_undegraded":"2024-01-19T04:17:03.710312+0000","last_fullsized":"2024-01-19T04:17:03.710312+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:20:49.616898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697004+0000","last_change":"2024-01-19T04:16:51.576072+0000","last_active":"2024-01-19T04:17:03.697004+0000","last_peered":"2024-01-19T04:17:03.697004+0000","last_clean":"2024-01-19T04:17:03.697004+0000","last_became_active":"2024-01-19T04:16:51.575754+0000","last_became_peered":"2024-01-19T04:16:51.575754+0000","last_unstale":"2024-01-19T04:17:03.697004+0000","last_undegraded":"2024-01-19T04:17:03.697004+0000","last_fullsized":"2024-01-19T04:17:03.697004+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:58.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699751+0000","last_change":"2024-01-19T04:16:50.571102+0000","last_active":"2024-01-19T04:17:03.699751+0000","last_peered":"2024-01-19T04:17:03.699751+0000","last_clean":"2024-01-19T04:17:03.699751+0000","last_became_active":"2024-01-19T04:16:50.570597+0000","last_became_peered":"2024-01-19T04:16:50.570597+0000","last_unstale":"2024-01-19T04:17:03.699751+0000","last_undegraded":"2024-01-19T04:17:03.699751+0000","last_fullsized":"2024-01-19T04:17:03.699751+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.717191+0000","last_change":"2024-01-19T04:17:04.710314+0000","last_active":"2024-01-19T04:17:04.717191+0000","last_peered":"2024-01-19T04:17:04.717191+0000","last_clean":"2024-01-19T04:17:04.717191+0000","last_became_active":"2024-01-19T04:17:04.709915+0000","last_became_peered":"2024-01-19T04:17:04.709915+0000","last_unstale":"2024-01-19T04:17:04.717191+0000","last_undegraded":"2024-01-19T04:17:04.717191+0000","last_fullsized":"2024-01-19T04:17:04.717191+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698318+0000","last_change":"2024-01-19T04:17:03.709688+0000","last_active":"2024-01-19T04:17:04.698318+0000","last_peered":"2024-01-19T04:17:04.698318+0000","last_clean":"2024-01-19T04:17:04.698318+0000","last_became_active":"2024-01-19T04:17:03.709392+0000","last_became_peered":"2024-01-19T04:17:03.709392+0000","last_unstale":"2024-01-19T04:17:04.698318+0000","last_undegraded":"2024-01-19T04:17:04.698318+0000","last_fullsized":"2024-01-19T04:17:04.698318+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:44.030611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700170+0000","last_change":"2024-01-19T04:16:51.581476+0000","last_active":"2024-01-19T04:17:03.700170+0000","last_peered":"2024-01-19T04:17:03.700170+0000","last_clean":"2024-01-19T04:17:03.700170+0000","last_became_active":"2024-01-19T04:16:51.580937+0000","last_became_peered":"2024-01-19T04:16:51.580937+0000","last_unstale":"2024-01-19T04:17:03.700170+0000","last_undegraded":"2024-01-19T04:17:03.700170+0000","last_fullsized":"2024-01-19T04:17:03.700170+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701243+0000","last_change":"2024-01-19T04:16:50.572829+0000","last_active":"2024-01-19T04:17:03.701243+0000","last_peered":"2024-01-19T04:17:03.701243+0000","last_clean":"2024-01-19T04:17:03.701243+0000","last_became_active":"2024-01-19T04:16:50.572538+0000","last_became_peered":"2024-01-19T04:16:50.572538+0000","last_unstale":"2024-01-19T04:17:03.701243+0000","last_undegraded":"2024-01-19T04:17:03.701243+0000","last_fullsized":"2024-01-19T04:17:03.701243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692735+0000","last_change":"2024-01-19T04:17:03.692735+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692735+0000","last_undegraded":"2024-01-19T04:17:03.692735+0000","last_fullsized":"2024-01-19T04:17:03.692735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733767+0000","last_change":"2024-01-19T04:17:03.710856+0000","last_active":"2024-01-19T04:17:04.733767+0000","last_peered":"2024-01-19T04:17:04.733767+0000","last_clean":"2024-01-19T04:17:04.733767+0000","last_became_active":"2024-01-19T04:17:03.709025+0000","last_became_peered":"2024-01-19T04:17:03.709025+0000","last_unstale":"2024-01-19T04:17:04.733767+0000","last_undegraded":"2024-01-19T04:17:04.733767+0000","last_fullsized":"2024-01-19T04:17:04.733767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:59.101927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702987+0000","last_change":"2024-01-19T04:16:51.588191+0000","last_active":"2024-01-19T04:17:03.702987+0000","last_peered":"2024-01-19T04:17:03.702987+0000","last_clean":"2024-01-19T04:17:03.702987+0000","last_became_active":"2024-01-19T04:16:51.587927+0000","last_became_peered":"2024-01-19T04:16:51.587927+0000","last_unstale":"2024-01-19T04:17:03.702987+0000","last_undegraded":"2024-01-19T04:17:03.702987+0000","last_fullsized":"2024-01-19T04:17:03.702987+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698421+0000","last_change":"2024-01-19T04:16:50.569273+0000","last_active":"2024-01-19T04:17:04.698421+0000","last_peered":"2024-01-19T04:17:04.698421+0000","last_clean":"2024-01-19T04:17:04.698421+0000","last_became_active":"2024-01-19T04:16:50.569009+0000","last_became_peered":"2024-01-19T04:16:50.569009+0000","last_unstale":"2024-01-19T04:17:04.698421+0000","last_undegraded":"2024-01-19T04:17:04.698421+0000","last_fullsized":"2024-01-19T04:17:04.698421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:59:10.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696863+0000","last_change":"2024-01-19T04:17:03.696863+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696863+0000","last_undegraded":"2024-01-19T04:17:03.696863+0000","last_fullsized":"2024-01-19T04:17:03.696863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.703496+0000","last_change":"2024-01-19T04:17:03.711904+0000","last_active":"2024-01-19T04:17:04.703496+0000","last_peered":"2024-01-19T04:17:04.703496+0000","last_clean":"2024-01-19T04:17:04.703496+0000","last_became_active":"2024-01-19T04:17:03.711592+0000","last_became_peered":"2024-01-19T04:17:03.711592+0000","last_unstale":"2024-01-19T04:17:04.703496+0000","last_undegraded":"2024-01-19T04:17:04.703496+0000","last_fullsized":"2024-01-19T04:17:04.703496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704488+0000","last_change":"2024-01-19T04:16:51.578342+0000","last_active":"2024-01-19T04:17:03.704488+0000","last_peered":"2024-01-19T04:17:03.704488+0000","last_clean":"2024-01-19T04:17:03.704488+0000","last_became_active":"2024-01-19T04:16:51.575581+0000","last_became_peered":"2024-01-19T04:16:51.575581+0000","last_unstale":"2024-01-19T04:17:03.704488+0000","last_undegraded":"2024-01-19T04:17:03.704488+0000","last_fullsized":"2024-01-19T04:17:03.704488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.690077+0000","last_change":"2024-01-19T04:16:50.572020+0000","last_active":"2024-01-19T04:17:02.690077+0000","last_peered":"2024-01-19T04:17:02.690077+0000","last_clean":"2024-01-19T04:17:02.690077+0000","last_became_active":"2024-01-19T04:16:50.571617+0000","last_became_peered":"2024-01-19T04:16:50.571617+0000","last_unstale":"2024-01-19T04:17:02.690077+0000","last_undegraded":"2024-01-19T04:17:02.690077+0000","last_fullsized":"2024-01-19T04:17:02.690077+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721580+0000","last_change":"2024-01-19T04:17:04.715751+0000","last_active":"2024-01-19T04:17:04.721580+0000","last_peered":"2024-01-19T04:17:04.721580+0000","last_clean":"2024-01-19T04:17:04.721580+0000","last_became_active":"2024-01-19T04:17:04.715489+0000","last_became_peered":"2024-01-19T04:17:04.715489+0000","last_unstale":"2024-01-19T04:17:04.721580+0000","last_undegraded":"2024-01-19T04:17:04.721580+0000","last_fullsized":"2024-01-19T04:17:04.721580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:47.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734310+0000","last_change":"2024-01-19T04:17:03.715436+0000","last_active":"2024-01-19T04:17:04.734310+0000","last_peered":"2024-01-19T04:17:04.734310+0000","last_clean":"2024-01-19T04:17:04.734310+0000","last_became_active":"2024-01-19T04:17:03.715157+0000","last_became_peered":"2024-01-19T04:17:03.715157+0000","last_unstale":"2024-01-19T04:17:04.734310+0000","last_undegraded":"2024-01-19T04:17:04.734310+0000","last_fullsized":"2024-01-19T04:17:04.734310+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:49.326125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696979+0000","last_change":"2024-01-19T04:16:51.575079+0000","last_active":"2024-01-19T04:17:04.696979+0000","last_peered":"2024-01-19T04:17:04.696979+0000","last_clean":"2024-01-19T04:17:04.696979+0000","last_became_active":"2024-01-19T04:16:51.574248+0000","last_became_peered":"2024-01-19T04:16:51.574248+0000","last_unstale":"2024-01-19T04:17:04.696979+0000","last_undegraded":"2024-01-19T04:17:04.696979+0000","last_fullsized":"2024-01-19T04:17:04.696979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:17.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702750+0000","last_change":"2024-01-19T04:16:50.571109+0000","last_active":"2024-01-19T04:17:03.702750+0000","last_peered":"2024-01-19T04:17:03.702750+0000","last_clean":"2024-01-19T04:17:03.702750+0000","last_became_active":"2024-01-19T04:16:50.570839+0000","last_became_peered":"2024-01-19T04:16:50.570839+0000","last_unstale":"2024-01-19T04:17:03.702750+0000","last_undegraded":"2024-01-19T04:17:03.702750+0000","last_fullsized":"2024-01-19T04:17:03.702750+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:22.030862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724584+0000","last_change":"2024-01-19T04:17:04.716334+0000","last_active":"2024-01-19T04:17:04.724584+0000","last_peered":"2024-01-19T04:17:04.724584+0000","last_clean":"2024-01-19T04:17:04.724584+0000","last_became_active":"2024-01-19T04:17:04.715736+0000","last_became_peered":"2024-01-19T04:17:04.715736+0000","last_unstale":"2024-01-19T04:17:04.724584+0000","last_undegraded":"2024-01-19T04:17:04.724584+0000","last_fullsized":"2024-01-19T04:17:04.724584+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734211+0000","last_change":"2024-01-19T04:17:03.717168+0000","last_active":"2024-01-19T04:17:04.734211+0000","last_peered":"2024-01-19T04:17:04.734211+0000","last_clean":"2024-01-19T04:17:04.734211+0000","last_became_active":"2024-01-19T04:17:03.716597+0000","last_became_peered":"2024-01-19T04:17:03.716597+0000","last_unstale":"2024-01-19T04:17:04.734211+0000","last_undegraded":"2024-01-19T04:17:04.734211+0000","last_fullsized":"2024-01-19T04:17:04.734211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:40.365611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701131+0000","last_change":"2024-01-19T04:16:51.582601+0000","last_active":"2024-01-19T04:17:03.701131+0000","last_peered":"2024-01-19T04:17:03.701131+0000","last_clean":"2024-01-19T04:17:03.701131+0000","last_became_active":"2024-01-19T04:16:51.582294+0000","last_became_peered":"2024-01-19T04:16:51.582294+0000","last_unstale":"2024-01-19T04:17:03.701131+0000","last_undegraded":"2024-01-19T04:17:03.701131+0000","last_fullsized":"2024-01-19T04:17:03.701131+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689034+0000","last_change":"2024-01-19T04:16:50.568331+0000","last_active":"2024-01-19T04:17:02.689034+0000","last_peered":"2024-01-19T04:17:02.689034+0000","last_clean":"2024-01-19T04:17:02.689034+0000","last_became_active":"2024-01-19T04:16:50.567695+0000","last_became_peered":"2024-01-19T04:16:50.567695+0000","last_unstale":"2024-01-19T04:17:02.689034+0000","last_undegraded":"2024-01-19T04:17:02.689034+0000","last_fullsized":"2024-01-19T04:17:02.689034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923571+0000","last_change":"2024-01-19T04:17:04.722284+0000","last_active":"2024-01-19T04:17:06.923571+0000","last_peered":"2024-01-19T04:17:06.923571+0000","last_clean":"2024-01-19T04:17:06.923571+0000","last_became_active":"2024-01-19T04:17:04.722004+0000","last_became_peered":"2024-01-19T04:17:04.722004+0000","last_unstale":"2024-01-19T04:17:06.923571+0000","last_undegraded":"2024-01-19T04:17:06.923571+0000","last_fullsized":"2024-01-19T04:17:06.923571+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:15.275480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701951+0000","last_change":"2024-01-19T04:17:03.712871+0000","last_active":"2024-01-19T04:17:04.701951+0000","last_peered":"2024-01-19T04:17:04.701951+0000","last_clean":"2024-01-19T04:17:04.701951+0000","last_became_active":"2024-01-19T04:17:03.710684+0000","last_became_peered":"2024-01-19T04:17:03.710684+0000","last_unstale":"2024-01-19T04:17:04.701951+0000","last_undegraded":"2024-01-19T04:17:04.701951+0000","last_fullsized":"2024-01-19T04:17:04.701951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700567+0000","last_change":"2024-01-19T04:16:51.579139+0000","last_active":"2024-01-19T04:17:03.700567+0000","last_peered":"2024-01-19T04:17:03.700567+0000","last_clean":"2024-01-19T04:17:03.700567+0000","last_became_active":"2024-01-19T04:16:51.578820+0000","last_became_peered":"2024-01-19T04:16:51.578820+0000","last_unstale":"2024-01-19T04:17:03.700567+0000","last_undegraded":"2024-01-19T04:17:03.700567+0000","last_fullsized":"2024-01-19T04:17:03.700567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695278+0000","last_change":"2024-01-19T04:16:50.563572+0000","last_active":"2024-01-19T04:17:04.695278+0000","last_peered":"2024-01-19T04:17:04.695278+0000","last_clean":"2024-01-19T04:17:04.695278+0000","last_became_active":"2024-01-19T04:16:50.561160+0000","last_became_peered":"2024-01-19T04:16:50.561160+0000","last_unstale":"2024-01-19T04:17:04.695278+0000","last_undegraded":"2024-01-19T04:17:04.695278+0000","last_fullsized":"2024-01-19T04:17:04.695278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:40:18.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923752+0000","last_change":"2024-01-19T04:17:04.722269+0000","last_active":"2024-01-19T04:17:06.923752+0000","last_peered":"2024-01-19T04:17:06.923752+0000","last_clean":"2024-01-19T04:17:06.923752+0000","last_became_active":"2024-01-19T04:17:04.722003+0000","last_became_peered":"2024-01-19T04:17:04.722003+0000","last_unstale":"2024-01-19T04:17:06.923752+0000","last_undegraded":"2024-01-19T04:17:06.923752+0000","last_fullsized":"2024-01-19T04:17:06.923752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:53.689915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709368+0000","last_change":"2024-01-19T04:17:03.703625+0000","last_active":"2024-01-19T04:17:03.709368+0000","last_peered":"2024-01-19T04:17:03.709368+0000","last_clean":"2024-01-19T04:17:03.709368+0000","last_became_active":"2024-01-19T04:17:03.702960+0000","last_became_peered":"2024-01-19T04:17:03.702960+0000","last_unstale":"2024-01-19T04:17:03.709368+0000","last_undegraded":"2024-01-19T04:17:03.709368+0000","last_fullsized":"2024-01-19T04:17:03.709368+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:58:33.792427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688531+0000","last_change":"2024-01-19T04:16:51.581877+0000","last_active":"2024-01-19T04:17:02.688531+0000","last_peered":"2024-01-19T04:17:02.688531+0000","last_clean":"2024-01-19T04:17:02.688531+0000","last_became_active":"2024-01-19T04:16:51.580713+0000","last_became_peered":"2024-01-19T04:16:51.580713+0000","last_unstale":"2024-01-19T04:17:02.688531+0000","last_undegraded":"2024-01-19T04:17:02.688531+0000","last_fullsized":"2024-01-19T04:17:02.688531+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682309+0000","last_change":"2024-01-19T04:16:50.572947+0000","last_active":"2024-01-19T04:17:02.682309+0000","last_peered":"2024-01-19T04:17:02.682309+0000","last_clean":"2024-01-19T04:17:02.682309+0000","last_became_active":"2024-01-19T04:16:50.572679+0000","last_became_peered":"2024-01-19T04:16:50.572679+0000","last_unstale":"2024-01-19T04:17:02.682309+0000","last_undegraded":"2024-01-19T04:17:02.682309+0000","last_fullsized":"2024-01-19T04:17:02.682309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:41.006603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923756+0000","last_change":"2024-01-19T04:17:04.715568+0000","last_active":"2024-01-19T04:17:06.923756+0000","last_peered":"2024-01-19T04:17:06.923756+0000","last_clean":"2024-01-19T04:17:06.923756+0000","last_became_active":"2024-01-19T04:17:04.715214+0000","last_became_peered":"2024-01-19T04:17:04.715214+0000","last_unstale":"2024-01-19T04:17:06.923756+0000","last_undegraded":"2024-01-19T04:17:06.923756+0000","last_fullsized":"2024-01-19T04:17:06.923756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:15.118406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711926+0000","last_change":"2024-01-19T04:17:03.716279+0000","last_active":"2024-01-19T04:17:04.711926+0000","last_peered":"2024-01-19T04:17:04.711926+0000","last_clean":"2024-01-19T04:17:04.711926+0000","last_became_active":"2024-01-19T04:17:03.715875+0000","last_became_peered":"2024-01-19T04:17:03.715875+0000","last_unstale":"2024-01-19T04:17:04.711926+0000","last_undegraded":"2024-01-19T04:17:04.711926+0000","last_fullsized":"2024-01-19T04:17:04.711926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:55.411637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687924+0000","last_change":"2024-01-19T04:16:51.575958+0000","last_active":"2024-01-19T04:17:02.687924+0000","last_peered":"2024-01-19T04:17:02.687924+0000","last_clean":"2024-01-19T04:17:02.687924+0000","last_became_active":"2024-01-19T04:16:51.575635+0000","last_became_peered":"2024-01-19T04:16:51.575635+0000","last_unstale":"2024-01-19T04:17:02.687924+0000","last_undegraded":"2024-01-19T04:17:02.687924+0000","last_fullsized":"2024-01-19T04:17:02.687924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697752+0000","last_change":"2024-01-19T04:16:50.568547+0000","last_active":"2024-01-19T04:17:03.697752+0000","last_peered":"2024-01-19T04:17:03.697752+0000","last_clean":"2024-01-19T04:17:03.697752+0000","last_became_active":"2024-01-19T04:16:50.568248+0000","last_became_peered":"2024-01-19T04:16:50.568248+0000","last_unstale":"2024-01-19T04:17:03.697752+0000","last_undegraded":"2024-01-19T04:17:03.697752+0000","last_fullsized":"2024-01-19T04:17:03.697752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:45.960987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734018+0000","last_change":"2024-01-19T04:17:04.732413+0000","last_active":"2024-01-19T04:17:04.734018+0000","last_peered":"2024-01-19T04:17:04.734018+0000","last_clean":"2024-01-19T04:17:04.734018+0000","last_became_active":"2024-01-19T04:17:04.732057+0000","last_became_peered":"2024-01-19T04:17:04.732057+0000","last_unstale":"2024-01-19T04:17:04.734018+0000","last_undegraded":"2024-01-19T04:17:04.734018+0000","last_fullsized":"2024-01-19T04:17:04.734018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:29:59.877276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.711992+0000","last_change":"2024-01-19T04:17:03.711094+0000","last_active":"2024-01-19T04:17:03.711992+0000","last_peered":"2024-01-19T04:17:03.711992+0000","last_clean":"2024-01-19T04:17:03.711992+0000","last_became_active":"2024-01-19T04:17:03.710806+0000","last_became_peered":"2024-01-19T04:17:03.710806+0000","last_unstale":"2024-01-19T04:17:03.711992+0000","last_undegraded":"2024-01-19T04:17:03.711992+0000","last_fullsized":"2024-01-19T04:17:03.711992+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:45.583850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703526+0000","last_change":"2024-01-19T04:16:51.562371+0000","last_active":"2024-01-19T04:17:03.703526+0000","last_peered":"2024-01-19T04:17:03.703526+0000","last_clean":"2024-01-19T04:17:03.703526+0000","last_became_active":"2024-01-19T04:16:51.562057+0000","last_became_peered":"2024-01-19T04:16:51.562057+0000","last_unstale":"2024-01-19T04:17:03.703526+0000","last_undegraded":"2024-01-19T04:17:03.703526+0000","last_fullsized":"2024-01-19T04:17:03.703526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682907+0000","last_change":"2024-01-19T04:16:50.575311+0000","last_active":"2024-01-19T04:17:02.682907+0000","last_peered":"2024-01-19T04:17:02.682907+0000","last_clean":"2024-01-19T04:17:02.682907+0000","last_became_active":"2024-01-19T04:16:50.574897+0000","last_became_peered":"2024-01-19T04:16:50.574897+0000","last_unstale":"2024-01-19T04:17:02.682907+0000","last_undegraded":"2024-01-19T04:17:02.682907+0000","last_fullsized":"2024-01-19T04:17:02.682907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725149+0000","last_change":"2024-01-19T04:17:04.717650+0000","last_active":"2024-01-19T04:17:04.725149+0000","last_peered":"2024-01-19T04:17:04.725149+0000","last_clean":"2024-01-19T04:17:04.725149+0000","last_became_active":"2024-01-19T04:17:04.713401+0000","last_became_peered":"2024-01-19T04:17:04.713401+0000","last_unstale":"2024-01-19T04:17:04.725149+0000","last_undegraded":"2024-01-19T04:17:04.725149+0000","last_fullsized":"2024-01-19T04:17:04.725149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.714569+0000","last_change":"2024-01-19T04:17:03.711629+0000","last_active":"2024-01-19T04:17:03.714569+0000","last_peered":"2024-01-19T04:17:03.714569+0000","last_clean":"2024-01-19T04:17:03.714569+0000","last_became_active":"2024-01-19T04:17:03.711338+0000","last_became_peered":"2024-01-19T04:17:03.711338+0000","last_unstale":"2024-01-19T04:17:03.714569+0000","last_undegraded":"2024-01-19T04:17:03.714569+0000","last_fullsized":"2024-01-19T04:17:03.714569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704626+0000","last_change":"2024-01-19T04:16:51.585936+0000","last_active":"2024-01-19T04:17:03.704626+0000","last_peered":"2024-01-19T04:17:03.704626+0000","last_clean":"2024-01-19T04:17:03.704626+0000","last_became_active":"2024-01-19T04:16:51.585682+0000","last_became_peered":"2024-01-19T04:16:51.585682+0000","last_unstale":"2024-01-19T04:17:03.704626+0000","last_undegraded":"2024-01-19T04:17:03.704626+0000","last_fullsized":"2024-01-19T04:17:03.704626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.690071+0000","last_change":"2024-01-19T04:16:50.567862+0000","last_active":"2024-01-19T04:17:02.690071+0000","last_peered":"2024-01-19T04:17:02.690071+0000","last_clean":"2024-01-19T04:17:02.690071+0000","last_became_active":"2024-01-19T04:16:50.567482+0000","last_became_peered":"2024-01-19T04:16:50.567482+0000","last_unstale":"2024-01-19T04:17:02.690071+0000","last_undegraded":"2024-01-19T04:17:02.690071+0000","last_fullsized":"2024-01-19T04:17:02.690071+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697577+0000","last_change":"2024-01-19T04:17:03.697577+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697577+0000","last_undegraded":"2024-01-19T04:17:03.697577+0000","last_fullsized":"2024-01-19T04:17:03.697577+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734217+0000","last_change":"2024-01-19T04:17:03.715400+0000","last_active":"2024-01-19T04:17:04.734217+0000","last_peered":"2024-01-19T04:17:04.734217+0000","last_clean":"2024-01-19T04:17:04.734217+0000","last_became_active":"2024-01-19T04:17:03.714763+0000","last_became_peered":"2024-01-19T04:17:03.714763+0000","last_unstale":"2024-01-19T04:17:04.734217+0000","last_undegraded":"2024-01-19T04:17:04.734217+0000","last_fullsized":"2024-01-19T04:17:04.734217+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:42.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682466+0000","last_change":"2024-01-19T04:16:51.581054+0000","last_active":"2024-01-19T04:17:02.682466+0000","last_peered":"2024-01-19T04:17:02.682466+0000","last_clean":"2024-01-19T04:17:02.682466+0000","last_became_active":"2024-01-19T04:16:51.580564+0000","last_became_peered":"2024-01-19T04:16:51.580564+0000","last_unstale":"2024-01-19T04:17:02.682466+0000","last_undegraded":"2024-01-19T04:17:02.682466+0000","last_fullsized":"2024-01-19T04:17:02.682466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.841231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705816+0000","last_change":"2024-01-19T04:16:50.565555+0000","last_active":"2024-01-19T04:17:03.705816+0000","last_peered":"2024-01-19T04:17:03.705816+0000","last_clean":"2024-01-19T04:17:03.705816+0000","last_became_active":"2024-01-19T04:16:50.565273+0000","last_became_peered":"2024-01-19T04:16:50.565273+0000","last_unstale":"2024-01-19T04:17:03.705816+0000","last_undegraded":"2024-01-19T04:17:03.705816+0000","last_fullsized":"2024-01-19T04:17:03.705816+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719993+0000","last_change":"2024-01-19T04:17:04.716116+0000","last_active":"2024-01-19T04:17:04.719993+0000","last_peered":"2024-01-19T04:17:04.719993+0000","last_clean":"2024-01-19T04:17:04.719993+0000","last_became_active":"2024-01-19T04:17:04.715861+0000","last_became_peered":"2024-01-19T04:17:04.715861+0000","last_unstale":"2024-01-19T04:17:04.719993+0000","last_undegraded":"2024-01-19T04:17:04.719993+0000","last_fullsized":"2024-01-19T04:17:04.719993+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704490+0000","last_change":"2024-01-19T04:17:03.713437+0000","last_active":"2024-01-19T04:17:04.704490+0000","last_peered":"2024-01-19T04:17:04.704490+0000","last_clean":"2024-01-19T04:17:04.704490+0000","last_became_active":"2024-01-19T04:17:03.713127+0000","last_became_peered":"2024-01-19T04:17:03.713127+0000","last_unstale":"2024-01-19T04:17:04.704490+0000","last_undegraded":"2024-01-19T04:17:04.704490+0000","last_fullsized":"2024-01-19T04:17:04.704490+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689270+0000","last_change":"2024-01-19T04:16:51.574116+0000","last_active":"2024-01-19T04:17:02.689270+0000","last_peered":"2024-01-19T04:17:02.689270+0000","last_clean":"2024-01-19T04:17:02.689270+0000","last_became_active":"2024-01-19T04:16:51.573543+0000","last_became_peered":"2024-01-19T04:16:51.573543+0000","last_unstale":"2024-01-19T04:17:02.689270+0000","last_undegraded":"2024-01-19T04:17:02.689270+0000","last_fullsized":"2024-01-19T04:17:02.689270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703710+0000","last_change":"2024-01-19T04:16:50.571359+0000","last_active":"2024-01-19T04:17:03.703710+0000","last_peered":"2024-01-19T04:17:03.703710+0000","last_clean":"2024-01-19T04:17:03.703710+0000","last_became_active":"2024-01-19T04:16:50.570715+0000","last_became_peered":"2024-01-19T04:16:50.570715+0000","last_unstale":"2024-01-19T04:17:03.703710+0000","last_undegraded":"2024-01-19T04:17:03.703710+0000","last_fullsized":"2024-01-19T04:17:03.703710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692259+0000","last_change":"2024-01-19T04:17:03.692259+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692259+0000","last_undegraded":"2024-01-19T04:17:03.692259+0000","last_fullsized":"2024-01-19T04:17:03.692259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694496+0000","last_change":"2024-01-19T04:17:03.711684+0000","last_active":"2024-01-19T04:17:04.694496+0000","last_peered":"2024-01-19T04:17:04.694496+0000","last_clean":"2024-01-19T04:17:04.694496+0000","last_became_active":"2024-01-19T04:17:03.711404+0000","last_became_peered":"2024-01-19T04:17:03.711404+0000","last_unstale":"2024-01-19T04:17:04.694496+0000","last_undegraded":"2024-01-19T04:17:04.694496+0000","last_fullsized":"2024-01-19T04:17:04.694496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:05.518024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695322+0000","last_change":"2024-01-19T04:16:51.578118+0000","last_active":"2024-01-19T04:17:04.695322+0000","last_peered":"2024-01-19T04:17:04.695322+0000","last_clean":"2024-01-19T04:17:04.695322+0000","last_became_active":"2024-01-19T04:16:51.577861+0000","last_became_peered":"2024-01-19T04:16:51.577861+0000","last_unstale":"2024-01-19T04:17:04.695322+0000","last_undegraded":"2024-01-19T04:17:04.695322+0000","last_fullsized":"2024-01-19T04:17:04.695322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:52:16.044197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682351+0000","last_change":"2024-01-19T04:16:50.572873+0000","last_active":"2024-01-19T04:17:02.682351+0000","last_peered":"2024-01-19T04:17:02.682351+0000","last_clean":"2024-01-19T04:17:02.682351+0000","last_became_active":"2024-01-19T04:16:50.571172+0000","last_became_peered":"2024-01-19T04:16:50.571172+0000","last_unstale":"2024-01-19T04:17:02.682351+0000","last_undegraded":"2024-01-19T04:17:02.682351+0000","last_fullsized":"2024-01-19T04:17:02.682351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734205+0000","last_change":"2024-01-19T04:17:04.727787+0000","last_active":"2024-01-19T04:17:04.734205+0000","last_peered":"2024-01-19T04:17:04.734205+0000","last_clean":"2024-01-19T04:17:04.734205+0000","last_became_active":"2024-01-19T04:17:04.727503+0000","last_became_peered":"2024-01-19T04:17:04.727503+0000","last_unstale":"2024-01-19T04:17:04.734205+0000","last_undegraded":"2024-01-19T04:17:04.734205+0000","last_fullsized":"2024-01-19T04:17:04.734205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:06.524237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710562+0000","last_change":"2024-01-19T04:17:03.711107+0000","last_active":"2024-01-19T04:17:04.710562+0000","last_peered":"2024-01-19T04:17:04.710562+0000","last_clean":"2024-01-19T04:17:04.710562+0000","last_became_active":"2024-01-19T04:17:03.709301+0000","last_became_peered":"2024-01-19T04:17:03.709301+0000","last_unstale":"2024-01-19T04:17:04.710562+0000","last_undegraded":"2024-01-19T04:17:04.710562+0000","last_fullsized":"2024-01-19T04:17:04.710562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:26.645481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702350+0000","last_change":"2024-01-19T04:16:51.590515+0000","last_active":"2024-01-19T04:17:03.702350+0000","last_peered":"2024-01-19T04:17:03.702350+0000","last_clean":"2024-01-19T04:17:03.702350+0000","last_became_active":"2024-01-19T04:16:51.590319+0000","last_became_peered":"2024-01-19T04:16:51.590319+0000","last_unstale":"2024-01-19T04:17:03.702350+0000","last_undegraded":"2024-01-19T04:17:03.702350+0000","last_fullsized":"2024-01-19T04:17:03.702350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700291+0000","last_change":"2024-01-19T04:16:50.567937+0000","last_active":"2024-01-19T04:17:03.700291+0000","last_peered":"2024-01-19T04:17:03.700291+0000","last_clean":"2024-01-19T04:17:03.700291+0000","last_became_active":"2024-01-19T04:16:50.567687+0000","last_became_peered":"2024-01-19T04:16:50.567687+0000","last_unstale":"2024-01-19T04:17:03.700291+0000","last_undegraded":"2024-01-19T04:17:03.700291+0000","last_fullsized":"2024-01-19T04:17:03.700291+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:05.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694524+0000","last_change":"2024-01-19T04:17:03.694524+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694524+0000","last_undegraded":"2024-01-19T04:17:03.694524+0000","last_fullsized":"2024-01-19T04:17:03.694524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709614+0000","last_change":"2024-01-19T04:17:03.707107+0000","last_active":"2024-01-19T04:17:03.709614+0000","last_peered":"2024-01-19T04:17:03.709614+0000","last_clean":"2024-01-19T04:17:03.709614+0000","last_became_active":"2024-01-19T04:17:03.706799+0000","last_became_peered":"2024-01-19T04:17:03.706799+0000","last_unstale":"2024-01-19T04:17:03.709614+0000","last_undegraded":"2024-01-19T04:17:03.709614+0000","last_fullsized":"2024-01-19T04:17:03.709614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:37:43.557082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682168+0000","last_change":"2024-01-19T04:16:51.583555+0000","last_active":"2024-01-19T04:17:02.682168+0000","last_peered":"2024-01-19T04:17:02.682168+0000","last_clean":"2024-01-19T04:17:02.682168+0000","last_became_active":"2024-01-19T04:16:51.583278+0000","last_became_peered":"2024-01-19T04:16:51.583278+0000","last_unstale":"2024-01-19T04:17:02.682168+0000","last_undegraded":"2024-01-19T04:17:02.682168+0000","last_fullsized":"2024-01-19T04:17:02.682168+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:10.004835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682292+0000","last_change":"2024-01-19T04:16:50.570692+0000","last_active":"2024-01-19T04:17:02.682292+0000","last_peered":"2024-01-19T04:17:02.682292+0000","last_clean":"2024-01-19T04:17:02.682292+0000","last_became_active":"2024-01-19T04:16:50.570414+0000","last_became_peered":"2024-01-19T04:16:50.570414+0000","last_unstale":"2024-01-19T04:17:02.682292+0000","last_undegraded":"2024-01-19T04:17:02.682292+0000","last_fullsized":"2024-01-19T04:17:02.682292+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:18.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734457+0000","last_change":"2024-01-19T04:17:04.730280+0000","last_active":"2024-01-19T04:17:04.734457+0000","last_peered":"2024-01-19T04:17:04.734457+0000","last_clean":"2024-01-19T04:17:04.734457+0000","last_became_active":"2024-01-19T04:17:04.729904+0000","last_became_peered":"2024-01-19T04:17:04.729904+0000","last_unstale":"2024-01-19T04:17:04.734457+0000","last_undegraded":"2024-01-19T04:17:04.734457+0000","last_fullsized":"2024-01-19T04:17:04.734457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:41.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.711331+0000","last_change":"2024-01-19T04:17:03.708010+0000","last_active":"2024-01-19T04:17:03.711331+0000","last_peered":"2024-01-19T04:17:03.711331+0000","last_clean":"2024-01-19T04:17:03.711331+0000","last_became_active":"2024-01-19T04:17:03.707622+0000","last_became_peered":"2024-01-19T04:17:03.707622+0000","last_unstale":"2024-01-19T04:17:03.711331+0000","last_undegraded":"2024-01-19T04:17:03.711331+0000","last_fullsized":"2024-01-19T04:17:03.711331+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:41:00.904557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695576+0000","last_change":"2024-01-19T04:16:51.586087+0000","last_active":"2024-01-19T04:17:04.695576+0000","last_peered":"2024-01-19T04:17:04.695576+0000","last_clean":"2024-01-19T04:17:04.695576+0000","last_became_active":"2024-01-19T04:16:51.585533+0000","last_became_peered":"2024-01-19T04:16:51.585533+0000","last_unstale":"2024-01-19T04:17:04.695576+0000","last_undegraded":"2024-01-19T04:17:04.695576+0000","last_fullsized":"2024-01-19T04:17:04.695576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:32.942430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693448+0000","last_change":"2024-01-19T04:16:50.570854+0000","last_active":"2024-01-19T04:17:04.693448+0000","last_peered":"2024-01-19T04:17:04.693448+0000","last_clean":"2024-01-19T04:17:04.693448+0000","last_became_active":"2024-01-19T04:16:50.570594+0000","last_became_peered":"2024-01-19T04:16:50.570594+0000","last_unstale":"2024-01-19T04:17:04.693448+0000","last_undegraded":"2024-01-19T04:17:04.693448+0000","last_fullsized":"2024-01-19T04:17:04.693448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:51:58.259661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923676+0000","last_change":"2024-01-19T04:17:04.726240+0000","last_active":"2024-01-19T04:17:06.923676+0000","last_peered":"2024-01-19T04:17:06.923676+0000","last_clean":"2024-01-19T04:17:06.923676+0000","last_became_active":"2024-01-19T04:17:04.725967+0000","last_became_peered":"2024-01-19T04:17:04.725967+0000","last_unstale":"2024-01-19T04:17:06.923676+0000","last_undegraded":"2024-01-19T04:17:06.923676+0000","last_fullsized":"2024-01-19T04:17:06.923676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:12:40.918817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732193+0000","last_change":"2024-01-19T04:17:03.710289+0000","last_active":"2024-01-19T04:17:04.732193+0000","last_peered":"2024-01-19T04:17:04.732193+0000","last_clean":"2024-01-19T04:17:04.732193+0000","last_became_active":"2024-01-19T04:17:03.709448+0000","last_became_peered":"2024-01-19T04:17:03.709448+0000","last_unstale":"2024-01-19T04:17:04.732193+0000","last_undegraded":"2024-01-19T04:17:04.732193+0000","last_fullsized":"2024-01-19T04:17:04.732193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:10.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693344+0000","last_change":"2024-01-19T04:16:51.574512+0000","last_active":"2024-01-19T04:17:04.693344+0000","last_peered":"2024-01-19T04:17:04.693344+0000","last_clean":"2024-01-19T04:17:04.693344+0000","last_became_active":"2024-01-19T04:16:51.574197+0000","last_became_peered":"2024-01-19T04:16:51.574197+0000","last_unstale":"2024-01-19T04:17:04.693344+0000","last_undegraded":"2024-01-19T04:17:04.693344+0000","last_fullsized":"2024-01-19T04:17:04.693344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:44:34.041080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704158+0000","last_change":"2024-01-19T04:16:50.574052+0000","last_active":"2024-01-19T04:17:03.704158+0000","last_peered":"2024-01-19T04:17:03.704158+0000","last_clean":"2024-01-19T04:17:03.704158+0000","last_became_active":"2024-01-19T04:16:50.572944+0000","last_became_peered":"2024-01-19T04:16:50.572944+0000","last_unstale":"2024-01-19T04:17:03.704158+0000","last_undegraded":"2024-01-19T04:17:03.704158+0000","last_fullsized":"2024-01-19T04:17:03.704158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:10:00.992470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701364+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:17:03.701364+0000","last_peered":"2024-01-19T04:17:03.701364+0000","last_clean":"2024-01-19T04:17:03.701364+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:17:03.701364+0000","last_undegraded":"2024-01-19T04:17:03.701364+0000","last_fullsized":"2024-01-19T04:17:03.701364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476766,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":865055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.63200000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476766,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":274527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.45200000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476765,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":275179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628}]},{"osd":1,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98299999999999998,"5min":1.107,"15min":1.107},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.246,"15min":1.246},"last":0.755},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.878},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0820000000000001,"5min":1.708,"15min":1.708},"last":0.71699999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476767,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":277634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.54300000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.381,"15min":1.381},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.095,"15min":1.095},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0940000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.495}]},{"osd":7,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.139,"15min":1.139},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1120000000000001,"5min":1.266,"15min":1.266},"last":0.69699999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":655360,"data_stored":274583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.504},{"interface":"front","average":{"1min":0.439,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54700000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.503},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.63300000000000001,"5min":0.879,"15min":0.879},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95799999999999996,"5min":1.016,"15min":1.016},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.89500000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93000000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98199999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.77300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":638976,"data_stored":267487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.964,"15min":1.964},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.441},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":2.827,"15min":2.827},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60299999999999998,"5min":2.343,"15min":2.343},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.665,"15min":1.665},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.032,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.94199999999999995,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.002,"5min":1.198,"15min":1.198},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.504},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.67500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.04,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.56100000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":861454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.60999999999999999,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60799999999999998,"5min":3.129,"15min":3.129},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.66700000000000004,"15min":0.69999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.72299999999999998,"15min":0.755},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.61299999999999999,"5min":3.633,"15min":3.633},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.59499999999999997,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93200000000000005,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.96299999999999997,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89500000000000002,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.004,"15min":1.052},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0469999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":1.034,"15min":1.0860000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97499999999999998,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.96799999999999997,"15min":1.008},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.85099999999999998,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.876,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75,"5min":1.052,"15min":1.1020000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95099999999999996,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.61499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":289485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54600000000000004,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.77600000000000002,"15min":0.81799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82699999999999996,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.65300000000000002,"15min":0.68300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":5.226,"15min":5.226},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":5.319,"15min":5.319},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.745,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96599999999999997,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.085,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.01,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.133,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.093,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93999999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.165,"5min":5.423,"15min":5.423},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1459999999999999,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:17:08.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:17:09.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.013+0000 7fef49000640 1 Processor -- start 2024-01-19T04:17:09.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef49000640 1 -- start start 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef49000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef44155320 0x7fef440a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef49000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef440c54b0 0x7fef4406cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef49000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440a52e0 0x7fef4406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef49000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef440c44f0 con 0x7fef440c54b0 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef49000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef440c4980 con 0x7fef44155320 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef49000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef440c3bc0 con 0x7fef440a52e0 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef440c54b0 0x7fef4406cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fef44155320 0x7fef440a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef440c54b0 0x7fef4406cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45396/0 (socket says 172.21.15.32:45396) 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 -- 172.21.15.32:0/2956114791 learned_addr learned my addr 172.21.15.32:0/2956114791 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef42800640 1 --2- 172.21.15.32:0/2956114791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440a52e0 0x7fef4406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 -- 172.21.15.32:0/2956114791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440a52e0 msgr2=0x7fef4406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:09.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 --2- 172.21.15.32:0/2956114791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440a52e0 0x7fef4406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 -- 172.21.15.32:0/2956114791 >> v2:172.21.15.67:3300/0 conn(0x7fef44155320 msgr2=0x7fef440a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:09.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 --2- 172.21.15.32:0/2956114791 >> v2:172.21.15.67:3300/0 conn(0x7fef44155320 0x7fef440a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.017+0000 7fef41400640 1 -- 172.21.15.32:0/2956114791 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef440c3ea0 con 0x7fef440c54b0 2024-01-19T04:17:09.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef41400640 1 --2- 172.21.15.32:0/2956114791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440c54b0 0x7fef4406cc80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fef4406f5f0 tx=0x7fef2c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f43dd7003ef5837 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef40a00640 1 -- 172.21.15.32:0/2956114791 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0ac600 con 0x7fef440c54b0 2024-01-19T04:17:09.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef40a00640 1 -- 172.21.15.32:0/2956114791 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c0a8050 con 0x7fef440c54b0 2024-01-19T04:17:09.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef40a00640 1 -- 172.21.15.32:0/2956114791 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0ac980 con 0x7fef440c54b0 2024-01-19T04:17:09.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 -- 172.21.15.32:0/2956114791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440c54b0 msgr2=0x7fef4406cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 --2- 172.21.15.32:0/2956114791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440c54b0 0x7fef4406cc80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fef4406f5f0 tx=0x7fef2c01c440 comp rx=0 tx=0).stop 2024-01-19T04:17:09.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 -- 172.21.15.32:0/2956114791 shutdown_connections 2024-01-19T04:17:09.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 --2- 172.21.15.32:0/2956114791 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440a52e0 0x7fef4406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 --2- 172.21.15.32:0/2956114791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440c54b0 0x7fef4406cc80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 --2- 172.21.15.32:0/2956114791 >> v2:172.21.15.67:3300/0 conn(0x7fef44155320 0x7fef440a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 -- 172.21.15.32:0/2956114791 >> 172.21.15.32:0/2956114791 conn(0x7fef440c5b20 msgr2=0x7fef440c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:09.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 -- 172.21.15.32:0/2956114791 shutdown_connections 2024-01-19T04:17:09.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.021+0000 7fef49000640 1 -- 172.21.15.32:0/2956114791 wait complete. 2024-01-19T04:17:09.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 Processor -- start 2024-01-19T04:17:09.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 -- start start 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440a52e0 0x7fef441f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440c54b0 0x7fef441ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44155320 0x7fef44155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef441eceb0 con 0x7fef440a52e0 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef441f1370 con 0x7fef44155320 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef44156f90 con 0x7fef440c54b0 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440a52e0 0x7fef441f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440a52e0 0x7fef441f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45402/0 (socket says 172.21.15.32:45402) 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 -- 172.21.15.32:0/3790262419 learned_addr learned my addr 172.21.15.32:0/3790262419 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41400640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440c54b0 0x7fef441ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef42800640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44155320 0x7fef44155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 -- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440c54b0 msgr2=0x7fef441ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440c54b0 0x7fef441ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 -- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44155320 msgr2=0x7fef44155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44155320 0x7fef44155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 -- 172.21.15.32:0/3790262419 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0094d0 con 0x7fef440a52e0 2024-01-19T04:17:09.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef42800640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44155320 0x7fef44155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:09.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef41e00640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440a52e0 0x7fef441f0e30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e8a0 tx=0x7fef3400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef3a000640 1 -- 172.21.15.32:0/3790262419 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34009510 con 0x7fef440a52e0 2024-01-19T04:17:09.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef3a000640 1 -- 172.21.15.32:0/3790262419 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3400c8e0 con 0x7fef440a52e0 2024-01-19T04:17:09.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef441ede00 con 0x7fef440a52e0 2024-01-19T04:17:09.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef3a000640 1 -- 172.21.15.32:0/3790262419 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400cc50 con 0x7fef440a52e0 2024-01-19T04:17:09.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4414d030 con 0x7fef440a52e0 2024-01-19T04:17:09.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.025+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef44071b70 con 0x7fef440a52e0 2024-01-19T04:17:09.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.029+0000 7fef3a000640 1 -- 172.21.15.32:0/3790262419 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fef34013470 con 0x7fef440a52e0 2024-01-19T04:17:09.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.029+0000 7fef3a000640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fef1c066500 0x7fef1c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.029+0000 7fef3a000640 1 -- 172.21.15.32:0/3790262419 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fef34084160 con 0x7fef440a52e0 2024-01-19T04:17:09.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.029+0000 7fef41400640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fef1c066500 0x7fef1c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.029+0000 7fef41400640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fef1c066500 0x7fef1c0689c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0ae000 tx=0x7fef2c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.033+0000 7fef3a000640 1 -- 172.21.15.32:0/3790262419 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fef34051140 con 0x7fef440a52e0 2024-01-19T04:17:09.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.189+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef440749f0 con 0x7fef1c066500 2024-01-19T04:17:09.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.201+0000 7fef3a000640 1 -- 172.21.15.32:0/3790262419 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525745 (secure 0 0 0) 0x7fef440749f0 con 0x7fef1c066500 2024-01-19T04:17:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:09.215 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fef1c066500 msgr2=0x7fef1c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fef1c066500 0x7fef1c0689c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0ae000 tx=0x7fef2c0a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440a52e0 msgr2=0x7fef441f0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440a52e0 0x7fef441f0e30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e8a0 tx=0x7fef3400eca0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 shutdown_connections 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fef1c066500 0x7fef1c0689c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef44155320 0x7fef44155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fef440c54b0 0x7fef441ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 --2- 172.21.15.32:0/3790262419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef440a52e0 0x7fef441f0e30 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 >> 172.21.15.32:0/3790262419 conn(0x7fef440c5b20 msgr2=0x7fef44154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:09.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 shutdown_connections 2024-01-19T04:17:09.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.209+0000 7fef49000640 1 -- 172.21.15.32:0/3790262419 wait complete. 2024-01-19T04:17:09.230 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-01-19T04:17:08.058683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595037,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":241,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":266,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239108,"kb_used_data":6288,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735612,"statfs":{"total":773094113280,"available":772849266688,"internally_reserved":0,"allocated":6438912,"data_stored":3385404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.377855"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924285+0000","last_change":"2024-01-19T04:17:04.707561+0000","last_active":"2024-01-19T04:17:06.924285+0000","last_peered":"2024-01-19T04:17:06.924285+0000","last_clean":"2024-01-19T04:17:06.924285+0000","last_became_active":"2024-01-19T04:17:04.706328+0000","last_became_peered":"2024-01-19T04:17:04.706328+0000","last_unstale":"2024-01-19T04:17:06.924285+0000","last_undegraded":"2024-01-19T04:17:06.924285+0000","last_fullsized":"2024-01-19T04:17:06.924285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:31:51.010861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687854+0000","last_change":"2024-01-19T04:16:51.581477+0000","last_active":"2024-01-19T04:17:02.687854+0000","last_peered":"2024-01-19T04:17:02.687854+0000","last_clean":"2024-01-19T04:17:02.687854+0000","last_became_active":"2024-01-19T04:16:51.580890+0000","last_became_peered":"2024-01-19T04:16:51.580890+0000","last_unstale":"2024-01-19T04:17:02.687854+0000","last_undegraded":"2024-01-19T04:17:02.687854+0000","last_fullsized":"2024-01-19T04:17:02.687854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.849907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693844+0000","last_change":"2024-01-19T04:17:03.693844+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693844+0000","last_undegraded":"2024-01-19T04:17:03.693844+0000","last_fullsized":"2024-01-19T04:17:03.693844+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698045+0000","last_change":"2024-01-19T04:16:51.580129+0000","last_active":"2024-01-19T04:17:04.698045+0000","last_peered":"2024-01-19T04:17:04.698045+0000","last_clean":"2024-01-19T04:17:04.698045+0000","last_became_active":"2024-01-19T04:16:51.579840+0000","last_became_peered":"2024-01-19T04:16:51.579840+0000","last_unstale":"2024-01-19T04:17:04.698045+0000","last_undegraded":"2024-01-19T04:17:04.698045+0000","last_fullsized":"2024-01-19T04:17:04.698045+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:56:54.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724604+0000","last_change":"2024-01-19T04:17:04.716555+0000","last_active":"2024-01-19T04:17:04.724604+0000","last_peered":"2024-01-19T04:17:04.724604+0000","last_clean":"2024-01-19T04:17:04.724604+0000","last_became_active":"2024-01-19T04:17:04.716072+0000","last_became_peered":"2024-01-19T04:17:04.716072+0000","last_unstale":"2024-01-19T04:17:04.724604+0000","last_undegraded":"2024-01-19T04:17:04.724604+0000","last_fullsized":"2024-01-19T04:17:04.724604+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700886+0000","last_change":"2024-01-19T04:16:51.574027+0000","last_active":"2024-01-19T04:17:03.700886+0000","last_peered":"2024-01-19T04:17:03.700886+0000","last_clean":"2024-01-19T04:17:03.700886+0000","last_became_active":"2024-01-19T04:16:51.573756+0000","last_became_peered":"2024-01-19T04:16:51.573756+0000","last_unstale":"2024-01-19T04:17:03.700886+0000","last_undegraded":"2024-01-19T04:17:03.700886+0000","last_fullsized":"2024-01-19T04:17:03.700886+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727171+0000","last_change":"2024-01-19T04:17:04.715758+0000","last_active":"2024-01-19T04:17:04.727171+0000","last_peered":"2024-01-19T04:17:04.727171+0000","last_clean":"2024-01-19T04:17:04.727171+0000","last_became_active":"2024-01-19T04:17:04.715514+0000","last_became_peered":"2024-01-19T04:17:04.715514+0000","last_unstale":"2024-01-19T04:17:04.727171+0000","last_undegraded":"2024-01-19T04:17:04.727171+0000","last_fullsized":"2024-01-19T04:17:04.727171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:04:35.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703432+0000","last_change":"2024-01-19T04:16:51.563134+0000","last_active":"2024-01-19T04:17:03.703432+0000","last_peered":"2024-01-19T04:17:03.703432+0000","last_clean":"2024-01-19T04:17:03.703432+0000","last_became_active":"2024-01-19T04:16:51.562243+0000","last_became_peered":"2024-01-19T04:16:51.562243+0000","last_unstale":"2024-01-19T04:17:03.703432+0000","last_undegraded":"2024-01-19T04:17:03.703432+0000","last_fullsized":"2024-01-19T04:17:03.703432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.722158+0000","last_change":"2024-01-19T04:17:04.717509+0000","last_active":"2024-01-19T04:17:04.722158+0000","last_peered":"2024-01-19T04:17:04.722158+0000","last_clean":"2024-01-19T04:17:04.722158+0000","last_became_active":"2024-01-19T04:17:04.717170+0000","last_became_peered":"2024-01-19T04:17:04.717170+0000","last_unstale":"2024-01-19T04:17:04.722158+0000","last_undegraded":"2024-01-19T04:17:04.722158+0000","last_fullsized":"2024-01-19T04:17:04.722158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687545+0000","last_change":"2024-01-19T04:16:51.568590+0000","last_active":"2024-01-19T04:17:02.687545+0000","last_peered":"2024-01-19T04:17:02.687545+0000","last_clean":"2024-01-19T04:17:02.687545+0000","last_became_active":"2024-01-19T04:16:51.567062+0000","last_became_peered":"2024-01-19T04:16:51.567062+0000","last_unstale":"2024-01-19T04:17:02.687545+0000","last_undegraded":"2024-01-19T04:17:02.687545+0000","last_fullsized":"2024-01-19T04:17:02.687545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:05.611512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733737+0000","last_change":"2024-01-19T04:17:04.727256+0000","last_active":"2024-01-19T04:17:04.733737+0000","last_peered":"2024-01-19T04:17:04.733737+0000","last_clean":"2024-01-19T04:17:04.733737+0000","last_became_active":"2024-01-19T04:17:04.726804+0000","last_became_peered":"2024-01-19T04:17:04.726804+0000","last_unstale":"2024-01-19T04:17:04.733737+0000","last_undegraded":"2024-01-19T04:17:04.733737+0000","last_fullsized":"2024-01-19T04:17:04.733737+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:20.362363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688126+0000","last_change":"2024-01-19T04:16:51.567447+0000","last_active":"2024-01-19T04:17:02.688126+0000","last_peered":"2024-01-19T04:17:02.688126+0000","last_clean":"2024-01-19T04:17:02.688126+0000","last_became_active":"2024-01-19T04:16:51.567187+0000","last_became_peered":"2024-01-19T04:16:51.567187+0000","last_unstale":"2024-01-19T04:17:02.688126+0000","last_undegraded":"2024-01-19T04:17:02.688126+0000","last_fullsized":"2024-01-19T04:17:02.688126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.695464+0000","last_change":"2024-01-19T04:17:03.695464+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.695464+0000","last_undegraded":"2024-01-19T04:17:03.695464+0000","last_fullsized":"2024-01-19T04:17:03.695464+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696299+0000","last_change":"2024-01-19T04:16:51.568350+0000","last_active":"2024-01-19T04:17:03.696299+0000","last_peered":"2024-01-19T04:17:03.696299+0000","last_clean":"2024-01-19T04:17:03.696299+0000","last_became_active":"2024-01-19T04:16:51.568051+0000","last_became_peered":"2024-01-19T04:16:51.568051+0000","last_unstale":"2024-01-19T04:17:03.696299+0000","last_undegraded":"2024-01-19T04:17:03.696299+0000","last_fullsized":"2024-01-19T04:17:03.696299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:31.896945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720368+0000","last_change":"2024-01-19T04:17:04.713905+0000","last_active":"2024-01-19T04:17:04.720368+0000","last_peered":"2024-01-19T04:17:04.720368+0000","last_clean":"2024-01-19T04:17:04.720368+0000","last_became_active":"2024-01-19T04:17:04.713659+0000","last_became_peered":"2024-01-19T04:17:04.713659+0000","last_unstale":"2024-01-19T04:17:04.720368+0000","last_undegraded":"2024-01-19T04:17:04.720368+0000","last_fullsized":"2024-01-19T04:17:04.720368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:44.988632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693196+0000","last_change":"2024-01-19T04:16:51.572672+0000","last_active":"2024-01-19T04:17:04.693196+0000","last_peered":"2024-01-19T04:17:04.693196+0000","last_clean":"2024-01-19T04:17:04.693196+0000","last_became_active":"2024-01-19T04:16:51.572209+0000","last_became_peered":"2024-01-19T04:16:51.572209+0000","last_unstale":"2024-01-19T04:17:04.693196+0000","last_undegraded":"2024-01-19T04:17:04.693196+0000","last_fullsized":"2024-01-19T04:17:04.693196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725169+0000","last_change":"2024-01-19T04:17:04.717847+0000","last_active":"2024-01-19T04:17:04.725169+0000","last_peered":"2024-01-19T04:17:04.725169+0000","last_clean":"2024-01-19T04:17:04.725169+0000","last_became_active":"2024-01-19T04:17:04.715209+0000","last_became_peered":"2024-01-19T04:17:04.715209+0000","last_unstale":"2024-01-19T04:17:04.725169+0000","last_undegraded":"2024-01-19T04:17:04.725169+0000","last_fullsized":"2024-01-19T04:17:04.725169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696371+0000","last_change":"2024-01-19T04:16:51.569401+0000","last_active":"2024-01-19T04:17:03.696371+0000","last_peered":"2024-01-19T04:17:03.696371+0000","last_clean":"2024-01-19T04:17:03.696371+0000","last_became_active":"2024-01-19T04:16:51.569130+0000","last_became_peered":"2024-01-19T04:16:51.569130+0000","last_unstale":"2024-01-19T04:17:03.696371+0000","last_undegraded":"2024-01-19T04:17:03.696371+0000","last_fullsized":"2024-01-19T04:17:03.696371+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:46.968261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693377+0000","last_change":"2024-01-19T04:17:03.693377+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693377+0000","last_undegraded":"2024-01-19T04:17:03.693377+0000","last_fullsized":"2024-01-19T04:17:03.693377+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682678+0000","last_change":"2024-01-19T04:16:51.583971+0000","last_active":"2024-01-19T04:17:02.682678+0000","last_peered":"2024-01-19T04:17:02.682678+0000","last_clean":"2024-01-19T04:17:02.682678+0000","last_became_active":"2024-01-19T04:16:51.583688+0000","last_became_peered":"2024-01-19T04:16:51.583688+0000","last_unstale":"2024-01-19T04:17:02.682678+0000","last_undegraded":"2024-01-19T04:17:02.682678+0000","last_fullsized":"2024-01-19T04:17:02.682678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:51.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697378+0000","last_change":"2024-01-19T04:17:03.697378+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697378+0000","last_undegraded":"2024-01-19T04:17:03.697378+0000","last_fullsized":"2024-01-19T04:17:03.697378+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682624+0000","last_change":"2024-01-19T04:16:51.581824+0000","last_active":"2024-01-19T04:17:02.682624+0000","last_peered":"2024-01-19T04:17:02.682624+0000","last_clean":"2024-01-19T04:17:02.682624+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:02.682624+0000","last_undegraded":"2024-01-19T04:17:02.682624+0000","last_fullsized":"2024-01-19T04:17:02.682624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:26.385285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721556+0000","last_change":"2024-01-19T04:17:04.711461+0000","last_active":"2024-01-19T04:17:04.721556+0000","last_peered":"2024-01-19T04:17:04.721556+0000","last_clean":"2024-01-19T04:17:04.721556+0000","last_became_active":"2024-01-19T04:17:04.711292+0000","last_became_peered":"2024-01-19T04:17:04.711292+0000","last_unstale":"2024-01-19T04:17:04.721556+0000","last_undegraded":"2024-01-19T04:17:04.721556+0000","last_fullsized":"2024-01-19T04:17:04.721556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:54.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703524+0000","last_change":"2024-01-19T04:16:51.575108+0000","last_active":"2024-01-19T04:17:03.703524+0000","last_peered":"2024-01-19T04:17:03.703524+0000","last_clean":"2024-01-19T04:17:03.703524+0000","last_became_active":"2024-01-19T04:16:51.574596+0000","last_became_peered":"2024-01-19T04:16:51.574596+0000","last_unstale":"2024-01-19T04:17:03.703524+0000","last_undegraded":"2024-01-19T04:17:03.703524+0000","last_fullsized":"2024-01-19T04:17:03.703524+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694959+0000","last_change":"2024-01-19T04:17:03.694959+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694959+0000","last_undegraded":"2024-01-19T04:17:03.694959+0000","last_fullsized":"2024-01-19T04:17:03.694959+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704901+0000","last_change":"2024-01-19T04:16:51.579903+0000","last_active":"2024-01-19T04:17:03.704901+0000","last_peered":"2024-01-19T04:17:03.704901+0000","last_clean":"2024-01-19T04:17:03.704901+0000","last_became_active":"2024-01-19T04:16:51.579415+0000","last_became_peered":"2024-01-19T04:16:51.579415+0000","last_unstale":"2024-01-19T04:17:03.704901+0000","last_undegraded":"2024-01-19T04:17:03.704901+0000","last_fullsized":"2024-01-19T04:17:03.704901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:31.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730411+0000","last_change":"2024-01-19T04:17:04.723485+0000","last_active":"2024-01-19T04:17:04.730411+0000","last_peered":"2024-01-19T04:17:04.730411+0000","last_clean":"2024-01-19T04:17:04.730411+0000","last_became_active":"2024-01-19T04:17:04.723202+0000","last_became_peered":"2024-01-19T04:17:04.723202+0000","last_unstale":"2024-01-19T04:17:04.730411+0000","last_undegraded":"2024-01-19T04:17:04.730411+0000","last_fullsized":"2024-01-19T04:17:04.730411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:19.815868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700684+0000","last_change":"2024-01-19T04:16:51.568949+0000","last_active":"2024-01-19T04:17:03.700684+0000","last_peered":"2024-01-19T04:17:03.700684+0000","last_clean":"2024-01-19T04:17:03.700684+0000","last_became_active":"2024-01-19T04:16:51.568682+0000","last_became_peered":"2024-01-19T04:16:51.568682+0000","last_unstale":"2024-01-19T04:17:03.700684+0000","last_undegraded":"2024-01-19T04:17:03.700684+0000","last_fullsized":"2024-01-19T04:17:03.700684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:23.038136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696463+0000","last_change":"2024-01-19T04:17:03.696463+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696463+0000","last_undegraded":"2024-01-19T04:17:03.696463+0000","last_fullsized":"2024-01-19T04:17:03.696463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696464+0000","last_change":"2024-01-19T04:16:51.588950+0000","last_active":"2024-01-19T04:17:03.696464+0000","last_peered":"2024-01-19T04:17:03.696464+0000","last_clean":"2024-01-19T04:17:03.696464+0000","last_became_active":"2024-01-19T04:16:51.577721+0000","last_became_peered":"2024-01-19T04:16:51.577721+0000","last_unstale":"2024-01-19T04:17:03.696464+0000","last_undegraded":"2024-01-19T04:17:03.696464+0000","last_fullsized":"2024-01-19T04:17:03.696464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:30.735073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.695321+0000","last_change":"2024-01-19T04:17:03.695321+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.695321+0000","last_undegraded":"2024-01-19T04:17:03.695321+0000","last_fullsized":"2024-01-19T04:17:03.695321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687590+0000","last_change":"2024-01-19T04:16:51.581861+0000","last_active":"2024-01-19T04:17:02.687590+0000","last_peered":"2024-01-19T04:17:02.687590+0000","last_clean":"2024-01-19T04:17:02.687590+0000","last_became_active":"2024-01-19T04:16:51.581465+0000","last_became_peered":"2024-01-19T04:16:51.581465+0000","last_unstale":"2024-01-19T04:17:02.687590+0000","last_undegraded":"2024-01-19T04:17:02.687590+0000","last_fullsized":"2024-01-19T04:17:02.687590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727994+0000","last_change":"2024-01-19T04:17:04.717627+0000","last_active":"2024-01-19T04:17:04.727994+0000","last_peered":"2024-01-19T04:17:04.727994+0000","last_clean":"2024-01-19T04:17:04.727994+0000","last_became_active":"2024-01-19T04:17:04.717351+0000","last_became_peered":"2024-01-19T04:17:04.717351+0000","last_unstale":"2024-01-19T04:17:04.727994+0000","last_undegraded":"2024-01-19T04:17:04.727994+0000","last_fullsized":"2024-01-19T04:17:04.727994+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:51:25.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698393+0000","last_change":"2024-01-19T04:16:51.589385+0000","last_active":"2024-01-19T04:17:04.698393+0000","last_peered":"2024-01-19T04:17:04.698393+0000","last_clean":"2024-01-19T04:17:04.698393+0000","last_became_active":"2024-01-19T04:16:51.586748+0000","last_became_peered":"2024-01-19T04:16:51.586748+0000","last_unstale":"2024-01-19T04:17:04.698393+0000","last_undegraded":"2024-01-19T04:17:04.698393+0000","last_fullsized":"2024-01-19T04:17:04.698393+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:17:50.471394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696048+0000","last_change":"2024-01-19T04:17:03.696048+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696048+0000","last_undegraded":"2024-01-19T04:17:03.696048+0000","last_fullsized":"2024-01-19T04:17:03.696048+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702978+0000","last_change":"2024-01-19T04:16:51.576164+0000","last_active":"2024-01-19T04:17:03.702978+0000","last_peered":"2024-01-19T04:17:03.702978+0000","last_clean":"2024-01-19T04:17:03.702978+0000","last_became_active":"2024-01-19T04:16:51.575615+0000","last_became_peered":"2024-01-19T04:16:51.575615+0000","last_unstale":"2024-01-19T04:17:03.702978+0000","last_undegraded":"2024-01-19T04:17:03.702978+0000","last_fullsized":"2024-01-19T04:17:03.702978+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696804+0000","last_change":"2024-01-19T04:17:03.696804+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696804+0000","last_undegraded":"2024-01-19T04:17:03.696804+0000","last_fullsized":"2024-01-19T04:17:03.696804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687934+0000","last_change":"2024-01-19T04:16:51.587440+0000","last_active":"2024-01-19T04:17:02.687934+0000","last_peered":"2024-01-19T04:17:02.687934+0000","last_clean":"2024-01-19T04:17:02.687934+0000","last_became_active":"2024-01-19T04:16:51.584713+0000","last_became_peered":"2024-01-19T04:16:51.584713+0000","last_unstale":"2024-01-19T04:17:02.687934+0000","last_undegraded":"2024-01-19T04:17:02.687934+0000","last_fullsized":"2024-01-19T04:17:02.687934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:19.082622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692299+0000","last_change":"2024-01-19T04:17:03.692299+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692299+0000","last_undegraded":"2024-01-19T04:17:03.692299+0000","last_fullsized":"2024-01-19T04:17:03.692299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696903+0000","last_change":"2024-01-19T04:16:51.584822+0000","last_active":"2024-01-19T04:17:04.696903+0000","last_peered":"2024-01-19T04:17:04.696903+0000","last_clean":"2024-01-19T04:17:04.696903+0000","last_became_active":"2024-01-19T04:16:51.584562+0000","last_became_peered":"2024-01-19T04:16:51.584562+0000","last_unstale":"2024-01-19T04:17:04.696903+0000","last_undegraded":"2024-01-19T04:17:04.696903+0000","last_fullsized":"2024-01-19T04:17:04.696903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:42.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724892+0000","last_change":"2024-01-19T04:17:04.716882+0000","last_active":"2024-01-19T04:17:04.724892+0000","last_peered":"2024-01-19T04:17:04.724892+0000","last_clean":"2024-01-19T04:17:04.724892+0000","last_became_active":"2024-01-19T04:17:04.713277+0000","last_became_peered":"2024-01-19T04:17:04.713277+0000","last_unstale":"2024-01-19T04:17:04.724892+0000","last_undegraded":"2024-01-19T04:17:04.724892+0000","last_fullsized":"2024-01-19T04:17:04.724892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702137+0000","last_change":"2024-01-19T04:16:51.577212+0000","last_active":"2024-01-19T04:17:03.702137+0000","last_peered":"2024-01-19T04:17:03.702137+0000","last_clean":"2024-01-19T04:17:03.702137+0000","last_became_active":"2024-01-19T04:16:51.576909+0000","last_became_peered":"2024-01-19T04:16:51.576909+0000","last_unstale":"2024-01-19T04:17:03.702137+0000","last_undegraded":"2024-01-19T04:17:03.702137+0000","last_fullsized":"2024-01-19T04:17:03.702137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732282+0000","last_change":"2024-01-19T04:17:04.730136+0000","last_active":"2024-01-19T04:17:04.732282+0000","last_peered":"2024-01-19T04:17:04.732282+0000","last_clean":"2024-01-19T04:17:04.732282+0000","last_became_active":"2024-01-19T04:17:04.729830+0000","last_became_peered":"2024-01-19T04:17:04.729830+0000","last_unstale":"2024-01-19T04:17:04.732282+0000","last_undegraded":"2024-01-19T04:17:04.732282+0000","last_fullsized":"2024-01-19T04:17:04.732282+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695154+0000","last_change":"2024-01-19T04:16:51.576501+0000","last_active":"2024-01-19T04:17:04.695154+0000","last_peered":"2024-01-19T04:17:04.695154+0000","last_clean":"2024-01-19T04:17:04.695154+0000","last_became_active":"2024-01-19T04:16:51.570654+0000","last_became_peered":"2024-01-19T04:16:51.570654+0000","last_unstale":"2024-01-19T04:17:04.695154+0000","last_undegraded":"2024-01-19T04:17:04.695154+0000","last_fullsized":"2024-01-19T04:17:04.695154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:47:50.383122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.706465+0000","last_change":"2024-01-19T04:17:04.702550+0000","last_active":"2024-01-19T04:17:04.706465+0000","last_peered":"2024-01-19T04:17:04.706465+0000","last_clean":"2024-01-19T04:17:04.706465+0000","last_became_active":"2024-01-19T04:17:04.702274+0000","last_became_peered":"2024-01-19T04:17:04.702274+0000","last_unstale":"2024-01-19T04:17:04.706465+0000","last_undegraded":"2024-01-19T04:17:04.706465+0000","last_fullsized":"2024-01-19T04:17:04.706465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:20.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700083+0000","last_change":"2024-01-19T04:16:51.581241+0000","last_active":"2024-01-19T04:17:03.700083+0000","last_peered":"2024-01-19T04:17:03.700083+0000","last_clean":"2024-01-19T04:17:03.700083+0000","last_became_active":"2024-01-19T04:16:51.580556+0000","last_became_peered":"2024-01-19T04:16:51.580556+0000","last_unstale":"2024-01-19T04:17:03.700083+0000","last_undegraded":"2024-01-19T04:17:03.700083+0000","last_fullsized":"2024-01-19T04:17:03.700083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:08.881391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716708+0000","last_change":"2024-01-19T04:17:04.709401+0000","last_active":"2024-01-19T04:17:04.716708+0000","last_peered":"2024-01-19T04:17:04.716708+0000","last_clean":"2024-01-19T04:17:04.716708+0000","last_became_active":"2024-01-19T04:17:04.709156+0000","last_became_peered":"2024-01-19T04:17:04.709156+0000","last_unstale":"2024-01-19T04:17:04.716708+0000","last_undegraded":"2024-01-19T04:17:04.716708+0000","last_fullsized":"2024-01-19T04:17:04.716708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:21.586290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701902+0000","last_change":"2024-01-19T04:16:51.579937+0000","last_active":"2024-01-19T04:17:03.701902+0000","last_peered":"2024-01-19T04:17:03.701902+0000","last_clean":"2024-01-19T04:17:03.701902+0000","last_became_active":"2024-01-19T04:16:51.579649+0000","last_became_peered":"2024-01-19T04:16:51.579649+0000","last_unstale":"2024-01-19T04:17:03.701902+0000","last_undegraded":"2024-01-19T04:17:03.701902+0000","last_fullsized":"2024-01-19T04:17:03.701902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:34.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924294+0000","last_change":"2024-01-19T04:17:04.712711+0000","last_active":"2024-01-19T04:17:06.924294+0000","last_peered":"2024-01-19T04:17:06.924294+0000","last_clean":"2024-01-19T04:17:06.924294+0000","last_became_active":"2024-01-19T04:17:04.712411+0000","last_became_peered":"2024-01-19T04:17:04.712411+0000","last_unstale":"2024-01-19T04:17:06.924294+0000","last_undegraded":"2024-01-19T04:17:06.924294+0000","last_fullsized":"2024-01-19T04:17:06.924294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:51:57.520659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687942+0000","last_change":"2024-01-19T04:16:51.578912+0000","last_active":"2024-01-19T04:17:02.687942+0000","last_peered":"2024-01-19T04:17:02.687942+0000","last_clean":"2024-01-19T04:17:02.687942+0000","last_became_active":"2024-01-19T04:16:51.578643+0000","last_became_peered":"2024-01-19T04:16:51.578643+0000","last_unstale":"2024-01-19T04:17:02.687942+0000","last_undegraded":"2024-01-19T04:17:02.687942+0000","last_fullsized":"2024-01-19T04:17:02.687942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:23.111411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721525+0000","last_change":"2024-01-19T04:17:04.713886+0000","last_active":"2024-01-19T04:17:04.721525+0000","last_peered":"2024-01-19T04:17:04.721525+0000","last_clean":"2024-01-19T04:17:04.721525+0000","last_became_active":"2024-01-19T04:17:04.713640+0000","last_became_peered":"2024-01-19T04:17:04.713640+0000","last_unstale":"2024-01-19T04:17:04.721525+0000","last_undegraded":"2024-01-19T04:17:04.721525+0000","last_fullsized":"2024-01-19T04:17:04.721525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:32.413236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703417+0000","last_change":"2024-01-19T04:16:51.573193+0000","last_active":"2024-01-19T04:17:03.703417+0000","last_peered":"2024-01-19T04:17:03.703417+0000","last_clean":"2024-01-19T04:17:03.703417+0000","last_became_active":"2024-01-19T04:16:51.572674+0000","last_became_peered":"2024-01-19T04:16:51.572674+0000","last_unstale":"2024-01-19T04:17:03.703417+0000","last_undegraded":"2024-01-19T04:17:03.703417+0000","last_fullsized":"2024-01-19T04:17:03.703417+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710812+0000","last_change":"2024-01-19T04:17:04.707630+0000","last_active":"2024-01-19T04:17:04.710812+0000","last_peered":"2024-01-19T04:17:04.710812+0000","last_clean":"2024-01-19T04:17:04.710812+0000","last_became_active":"2024-01-19T04:17:04.707287+0000","last_became_peered":"2024-01-19T04:17:04.707287+0000","last_unstale":"2024-01-19T04:17:04.710812+0000","last_undegraded":"2024-01-19T04:17:04.710812+0000","last_fullsized":"2024-01-19T04:17:04.710812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:40.576911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689061+0000","last_change":"2024-01-19T04:16:51.586794+0000","last_active":"2024-01-19T04:17:02.689061+0000","last_peered":"2024-01-19T04:17:02.689061+0000","last_clean":"2024-01-19T04:17:02.689061+0000","last_became_active":"2024-01-19T04:16:51.582729+0000","last_became_peered":"2024-01-19T04:16:51.582729+0000","last_unstale":"2024-01-19T04:17:02.689061+0000","last_undegraded":"2024-01-19T04:17:02.689061+0000","last_fullsized":"2024-01-19T04:17:02.689061+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730997+0000","last_change":"2024-01-19T04:17:04.726864+0000","last_active":"2024-01-19T04:17:04.730997+0000","last_peered":"2024-01-19T04:17:04.730997+0000","last_clean":"2024-01-19T04:17:04.730997+0000","last_became_active":"2024-01-19T04:17:04.726530+0000","last_became_peered":"2024-01-19T04:17:04.726530+0000","last_unstale":"2024-01-19T04:17:04.730997+0000","last_undegraded":"2024-01-19T04:17:04.730997+0000","last_fullsized":"2024-01-19T04:17:04.730997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687514+0000","last_change":"2024-01-19T04:16:51.568656+0000","last_active":"2024-01-19T04:17:02.687514+0000","last_peered":"2024-01-19T04:17:02.687514+0000","last_clean":"2024-01-19T04:17:02.687514+0000","last_became_active":"2024-01-19T04:16:51.568371+0000","last_became_peered":"2024-01-19T04:16:51.568371+0000","last_unstale":"2024-01-19T04:17:02.687514+0000","last_undegraded":"2024-01-19T04:17:02.687514+0000","last_fullsized":"2024-01-19T04:17:02.687514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:42.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719165+0000","last_change":"2024-01-19T04:17:04.713110+0000","last_active":"2024-01-19T04:17:04.719165+0000","last_peered":"2024-01-19T04:17:04.719165+0000","last_clean":"2024-01-19T04:17:04.719165+0000","last_became_active":"2024-01-19T04:17:04.712838+0000","last_became_peered":"2024-01-19T04:17:04.712838+0000","last_unstale":"2024-01-19T04:17:04.719165+0000","last_undegraded":"2024-01-19T04:17:04.719165+0000","last_fullsized":"2024-01-19T04:17:04.719165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695186+0000","last_change":"2024-01-19T04:16:51.583324+0000","last_active":"2024-01-19T04:17:04.695186+0000","last_peered":"2024-01-19T04:17:04.695186+0000","last_clean":"2024-01-19T04:17:04.695186+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:04.695186+0000","last_undegraded":"2024-01-19T04:17:04.695186+0000","last_fullsized":"2024-01-19T04:17:04.695186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:01.837432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733715+0000","last_change":"2024-01-19T04:17:04.727034+0000","last_active":"2024-01-19T04:17:04.733715+0000","last_peered":"2024-01-19T04:17:04.733715+0000","last_clean":"2024-01-19T04:17:04.733715+0000","last_became_active":"2024-01-19T04:17:04.726442+0000","last_became_peered":"2024-01-19T04:17:04.726442+0000","last_unstale":"2024-01-19T04:17:04.733715+0000","last_undegraded":"2024-01-19T04:17:04.733715+0000","last_fullsized":"2024-01-19T04:17:04.733715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.021270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700737+0000","last_change":"2024-01-19T04:16:51.577511+0000","last_active":"2024-01-19T04:17:03.700737+0000","last_peered":"2024-01-19T04:17:03.700737+0000","last_clean":"2024-01-19T04:17:03.700737+0000","last_became_active":"2024-01-19T04:16:51.577076+0000","last_became_peered":"2024-01-19T04:16:51.577076+0000","last_unstale":"2024-01-19T04:17:03.700737+0000","last_undegraded":"2024-01-19T04:17:03.700737+0000","last_fullsized":"2024-01-19T04:17:03.700737+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924130+0000","last_change":"2024-01-19T04:17:04.713152+0000","last_active":"2024-01-19T04:17:06.924130+0000","last_peered":"2024-01-19T04:17:06.924130+0000","last_clean":"2024-01-19T04:17:06.924130+0000","last_became_active":"2024-01-19T04:17:04.712882+0000","last_became_peered":"2024-01-19T04:17:04.712882+0000","last_unstale":"2024-01-19T04:17:06.924130+0000","last_undegraded":"2024-01-19T04:17:06.924130+0000","last_fullsized":"2024-01-19T04:17:06.924130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:02.470278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687096+0000","last_change":"2024-01-19T04:16:51.578248+0000","last_active":"2024-01-19T04:17:02.687096+0000","last_peered":"2024-01-19T04:17:02.687096+0000","last_clean":"2024-01-19T04:17:02.687096+0000","last_became_active":"2024-01-19T04:16:51.577983+0000","last_became_peered":"2024-01-19T04:16:51.577983+0000","last_unstale":"2024-01-19T04:17:02.687096+0000","last_undegraded":"2024-01-19T04:17:02.687096+0000","last_fullsized":"2024-01-19T04:17:02.687096+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:14.895654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730956+0000","last_change":"2024-01-19T04:17:04.727249+0000","last_active":"2024-01-19T04:17:04.730956+0000","last_peered":"2024-01-19T04:17:04.730956+0000","last_clean":"2024-01-19T04:17:04.730956+0000","last_became_active":"2024-01-19T04:17:04.726674+0000","last_became_peered":"2024-01-19T04:17:04.726674+0000","last_unstale":"2024-01-19T04:17:04.730956+0000","last_undegraded":"2024-01-19T04:17:04.730956+0000","last_fullsized":"2024-01-19T04:17:04.730956+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688262+0000","last_change":"2024-01-19T04:16:51.586614+0000","last_active":"2024-01-19T04:17:02.688262+0000","last_peered":"2024-01-19T04:17:02.688262+0000","last_clean":"2024-01-19T04:17:02.688262+0000","last_became_active":"2024-01-19T04:16:51.586104+0000","last_became_peered":"2024-01-19T04:16:51.586104+0000","last_unstale":"2024-01-19T04:17:02.688262+0000","last_undegraded":"2024-01-19T04:17:02.688262+0000","last_fullsized":"2024-01-19T04:17:02.688262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734509+0000","last_change":"2024-01-19T04:17:04.730684+0000","last_active":"2024-01-19T04:17:04.734509+0000","last_peered":"2024-01-19T04:17:04.734509+0000","last_clean":"2024-01-19T04:17:04.734509+0000","last_became_active":"2024-01-19T04:17:04.729893+0000","last_became_peered":"2024-01-19T04:17:04.729893+0000","last_unstale":"2024-01-19T04:17:04.734509+0000","last_undegraded":"2024-01-19T04:17:04.734509+0000","last_fullsized":"2024-01-19T04:17:04.734509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:39.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733676+0000","last_change":"2024-01-19T04:17:03.712060+0000","last_active":"2024-01-19T04:17:04.733676+0000","last_peered":"2024-01-19T04:17:04.733676+0000","last_clean":"2024-01-19T04:17:04.733676+0000","last_became_active":"2024-01-19T04:17:03.711745+0000","last_became_peered":"2024-01-19T04:17:03.711745+0000","last_unstale":"2024-01-19T04:17:04.733676+0000","last_undegraded":"2024-01-19T04:17:04.733676+0000","last_fullsized":"2024-01-19T04:17:04.733676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:39.750994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689966+0000","last_change":"2024-01-19T04:16:51.575044+0000","last_active":"2024-01-19T04:17:02.689966+0000","last_peered":"2024-01-19T04:17:02.689966+0000","last_clean":"2024-01-19T04:17:02.689966+0000","last_became_active":"2024-01-19T04:16:51.574674+0000","last_became_peered":"2024-01-19T04:16:51.574674+0000","last_unstale":"2024-01-19T04:17:02.689966+0000","last_undegraded":"2024-01-19T04:17:02.689966+0000","last_fullsized":"2024-01-19T04:17:02.689966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689548+0000","last_change":"2024-01-19T04:16:50.572149+0000","last_active":"2024-01-19T04:17:02.689548+0000","last_peered":"2024-01-19T04:17:02.689548+0000","last_clean":"2024-01-19T04:17:02.689548+0000","last_became_active":"2024-01-19T04:16:50.571648+0000","last_became_peered":"2024-01-19T04:16:50.571648+0000","last_unstale":"2024-01-19T04:17:02.689548+0000","last_undegraded":"2024-01-19T04:17:02.689548+0000","last_fullsized":"2024-01-19T04:17:02.689548+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728547+0000","last_change":"2024-01-19T04:17:04.718498+0000","last_active":"2024-01-19T04:17:04.728547+0000","last_peered":"2024-01-19T04:17:04.728547+0000","last_clean":"2024-01-19T04:17:04.728547+0000","last_became_active":"2024-01-19T04:17:04.717566+0000","last_became_peered":"2024-01-19T04:17:04.717566+0000","last_unstale":"2024-01-19T04:17:04.728547+0000","last_undegraded":"2024-01-19T04:17:04.728547+0000","last_fullsized":"2024-01-19T04:17:04.728547+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732753+0000","last_change":"2024-01-19T04:17:03.709880+0000","last_active":"2024-01-19T04:17:04.732753+0000","last_peered":"2024-01-19T04:17:04.732753+0000","last_clean":"2024-01-19T04:17:04.732753+0000","last_became_active":"2024-01-19T04:17:03.709543+0000","last_became_peered":"2024-01-19T04:17:03.709543+0000","last_unstale":"2024-01-19T04:17:04.732753+0000","last_undegraded":"2024-01-19T04:17:04.732753+0000","last_fullsized":"2024-01-19T04:17:04.732753+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:31:11.411184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682832+0000","last_change":"2024-01-19T04:16:51.590705+0000","last_active":"2024-01-19T04:17:02.682832+0000","last_peered":"2024-01-19T04:17:02.682832+0000","last_clean":"2024-01-19T04:17:02.682832+0000","last_became_active":"2024-01-19T04:16:51.590304+0000","last_became_peered":"2024-01-19T04:16:51.590304+0000","last_unstale":"2024-01-19T04:17:02.682832+0000","last_undegraded":"2024-01-19T04:17:02.682832+0000","last_fullsized":"2024-01-19T04:17:02.682832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:51.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698137+0000","last_change":"2024-01-19T04:16:50.567145+0000","last_active":"2024-01-19T04:17:04.698137+0000","last_peered":"2024-01-19T04:17:04.698137+0000","last_clean":"2024-01-19T04:17:04.698137+0000","last_became_active":"2024-01-19T04:16:50.566844+0000","last_became_peered":"2024-01-19T04:16:50.566844+0000","last_unstale":"2024-01-19T04:17:04.698137+0000","last_undegraded":"2024-01-19T04:17:04.698137+0000","last_fullsized":"2024-01-19T04:17:04.698137+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:07.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735309+0000","last_change":"2024-01-19T04:17:04.732829+0000","last_active":"2024-01-19T04:17:04.735309+0000","last_peered":"2024-01-19T04:17:04.735309+0000","last_clean":"2024-01-19T04:17:04.735309+0000","last_became_active":"2024-01-19T04:17:04.732552+0000","last_became_peered":"2024-01-19T04:17:04.732552+0000","last_unstale":"2024-01-19T04:17:04.735309+0000","last_undegraded":"2024-01-19T04:17:04.735309+0000","last_fullsized":"2024-01-19T04:17:04.735309+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:56:58.089850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727954+0000","last_change":"2024-01-19T04:17:03.713210+0000","last_active":"2024-01-19T04:17:04.727954+0000","last_peered":"2024-01-19T04:17:04.727954+0000","last_clean":"2024-01-19T04:17:04.727954+0000","last_became_active":"2024-01-19T04:17:03.712941+0000","last_became_peered":"2024-01-19T04:17:03.712941+0000","last_unstale":"2024-01-19T04:17:04.727954+0000","last_undegraded":"2024-01-19T04:17:04.727954+0000","last_fullsized":"2024-01-19T04:17:04.727954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688783+0000","last_change":"2024-01-19T04:16:51.573140+0000","last_active":"2024-01-19T04:17:02.688783+0000","last_peered":"2024-01-19T04:17:02.688783+0000","last_clean":"2024-01-19T04:17:02.688783+0000","last_became_active":"2024-01-19T04:16:51.572831+0000","last_became_peered":"2024-01-19T04:16:51.572831+0000","last_unstale":"2024-01-19T04:17:02.688783+0000","last_undegraded":"2024-01-19T04:17:02.688783+0000","last_fullsized":"2024-01-19T04:17:02.688783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689361+0000","last_change":"2024-01-19T04:16:50.563884+0000","last_active":"2024-01-19T04:17:02.689361+0000","last_peered":"2024-01-19T04:17:02.689361+0000","last_clean":"2024-01-19T04:17:02.689361+0000","last_became_active":"2024-01-19T04:16:50.563631+0000","last_became_peered":"2024-01-19T04:16:50.563631+0000","last_unstale":"2024-01-19T04:17:02.689361+0000","last_undegraded":"2024-01-19T04:17:02.689361+0000","last_fullsized":"2024-01-19T04:17:02.689361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696290+0000","last_change":"2024-01-19T04:17:03.696290+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696290+0000","last_undegraded":"2024-01-19T04:17:03.696290+0000","last_fullsized":"2024-01-19T04:17:03.696290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.714476+0000","last_change":"2024-01-19T04:17:03.710296+0000","last_active":"2024-01-19T04:17:03.714476+0000","last_peered":"2024-01-19T04:17:03.714476+0000","last_clean":"2024-01-19T04:17:03.714476+0000","last_became_active":"2024-01-19T04:17:03.710001+0000","last_became_peered":"2024-01-19T04:17:03.710001+0000","last_unstale":"2024-01-19T04:17:03.714476+0000","last_undegraded":"2024-01-19T04:17:03.714476+0000","last_fullsized":"2024-01-19T04:17:03.714476+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689683+0000","last_change":"2024-01-19T04:16:51.574394+0000","last_active":"2024-01-19T04:17:02.689683+0000","last_peered":"2024-01-19T04:17:02.689683+0000","last_clean":"2024-01-19T04:17:02.689683+0000","last_became_active":"2024-01-19T04:16:51.573866+0000","last_became_peered":"2024-01-19T04:16:51.573866+0000","last_unstale":"2024-01-19T04:17:02.689683+0000","last_undegraded":"2024-01-19T04:17:02.689683+0000","last_fullsized":"2024-01-19T04:17:02.689683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703621+0000","last_change":"2024-01-19T04:16:50.571503+0000","last_active":"2024-01-19T04:17:03.703621+0000","last_peered":"2024-01-19T04:17:03.703621+0000","last_clean":"2024-01-19T04:17:03.703621+0000","last_became_active":"2024-01-19T04:16:50.571066+0000","last_became_peered":"2024-01-19T04:16:50.571066+0000","last_unstale":"2024-01-19T04:17:03.703621+0000","last_undegraded":"2024-01-19T04:17:03.703621+0000","last_fullsized":"2024-01-19T04:17:03.703621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694152+0000","last_change":"2024-01-19T04:17:03.694152+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694152+0000","last_undegraded":"2024-01-19T04:17:03.694152+0000","last_fullsized":"2024-01-19T04:17:03.694152+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709771+0000","last_change":"2024-01-19T04:17:03.705700+0000","last_active":"2024-01-19T04:17:03.709771+0000","last_peered":"2024-01-19T04:17:03.709771+0000","last_clean":"2024-01-19T04:17:03.709771+0000","last_became_active":"2024-01-19T04:17:03.705353+0000","last_became_peered":"2024-01-19T04:17:03.705353+0000","last_unstale":"2024-01-19T04:17:03.709771+0000","last_undegraded":"2024-01-19T04:17:03.709771+0000","last_fullsized":"2024-01-19T04:17:03.709771+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:43:27.804228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695238+0000","last_change":"2024-01-19T04:16:51.573659+0000","last_active":"2024-01-19T04:17:04.695238+0000","last_peered":"2024-01-19T04:17:04.695238+0000","last_clean":"2024-01-19T04:17:04.695238+0000","last_became_active":"2024-01-19T04:16:51.570362+0000","last_became_peered":"2024-01-19T04:16:51.570362+0000","last_unstale":"2024-01-19T04:17:04.695238+0000","last_undegraded":"2024-01-19T04:17:04.695238+0000","last_fullsized":"2024-01-19T04:17:04.695238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:12.091637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697876+0000","last_change":"2024-01-19T04:16:50.562830+0000","last_active":"2024-01-19T04:17:03.697876+0000","last_peered":"2024-01-19T04:17:03.697876+0000","last_clean":"2024-01-19T04:17:03.697876+0000","last_became_active":"2024-01-19T04:16:50.562528+0000","last_became_peered":"2024-01-19T04:16:50.562528+0000","last_unstale":"2024-01-19T04:17:03.697876+0000","last_undegraded":"2024-01-19T04:17:03.697876+0000","last_fullsized":"2024-01-19T04:17:03.697876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:03.641474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694545+0000","last_change":"2024-01-19T04:17:03.694545+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694545+0000","last_undegraded":"2024-01-19T04:17:03.694545+0000","last_fullsized":"2024-01-19T04:17:03.694545+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.708375+0000","last_change":"2024-01-19T04:17:03.704020+0000","last_active":"2024-01-19T04:17:03.708375+0000","last_peered":"2024-01-19T04:17:03.708375+0000","last_clean":"2024-01-19T04:17:03.708375+0000","last_became_active":"2024-01-19T04:17:03.703750+0000","last_became_peered":"2024-01-19T04:17:03.703750+0000","last_unstale":"2024-01-19T04:17:03.708375+0000","last_undegraded":"2024-01-19T04:17:03.708375+0000","last_fullsized":"2024-01-19T04:17:03.708375+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:11:42.246097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694990+0000","last_change":"2024-01-19T04:16:51.582274+0000","last_active":"2024-01-19T04:17:04.694990+0000","last_peered":"2024-01-19T04:17:04.694990+0000","last_clean":"2024-01-19T04:17:04.694990+0000","last_became_active":"2024-01-19T04:16:51.581164+0000","last_became_peered":"2024-01-19T04:16:51.581164+0000","last_unstale":"2024-01-19T04:17:04.694990+0000","last_undegraded":"2024-01-19T04:17:04.694990+0000","last_fullsized":"2024-01-19T04:17:04.694990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:47.861123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688218+0000","last_change":"2024-01-19T04:16:50.566550+0000","last_active":"2024-01-19T04:17:02.688218+0000","last_peered":"2024-01-19T04:17:02.688218+0000","last_clean":"2024-01-19T04:17:02.688218+0000","last_became_active":"2024-01-19T04:16:50.566278+0000","last_became_peered":"2024-01-19T04:16:50.566278+0000","last_unstale":"2024-01-19T04:17:02.688218+0000","last_undegraded":"2024-01-19T04:17:02.688218+0000","last_fullsized":"2024-01-19T04:17:02.688218+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711170+0000","last_change":"2024-01-19T04:17:04.707638+0000","last_active":"2024-01-19T04:17:04.711170+0000","last_peered":"2024-01-19T04:17:04.711170+0000","last_clean":"2024-01-19T04:17:04.711170+0000","last_became_active":"2024-01-19T04:17:04.707389+0000","last_became_peered":"2024-01-19T04:17:04.707389+0000","last_unstale":"2024-01-19T04:17:04.711170+0000","last_undegraded":"2024-01-19T04:17:04.711170+0000","last_fullsized":"2024-01-19T04:17:04.711170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725642+0000","last_change":"2024-01-19T04:17:03.713411+0000","last_active":"2024-01-19T04:17:04.725642+0000","last_peered":"2024-01-19T04:17:04.725642+0000","last_clean":"2024-01-19T04:17:04.725642+0000","last_became_active":"2024-01-19T04:17:03.712945+0000","last_became_peered":"2024-01-19T04:17:03.712945+0000","last_unstale":"2024-01-19T04:17:04.725642+0000","last_undegraded":"2024-01-19T04:17:04.725642+0000","last_fullsized":"2024-01-19T04:17:04.725642+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:18.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702014+0000","last_change":"2024-01-19T04:16:51.579590+0000","last_active":"2024-01-19T04:17:03.702014+0000","last_peered":"2024-01-19T04:17:03.702014+0000","last_clean":"2024-01-19T04:17:03.702014+0000","last_became_active":"2024-01-19T04:16:51.579242+0000","last_became_peered":"2024-01-19T04:16:51.579242+0000","last_unstale":"2024-01-19T04:17:03.702014+0000","last_undegraded":"2024-01-19T04:17:03.702014+0000","last_fullsized":"2024-01-19T04:17:03.702014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:09.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699654+0000","last_change":"2024-01-19T04:16:50.568633+0000","last_active":"2024-01-19T04:17:03.699654+0000","last_peered":"2024-01-19T04:17:03.699654+0000","last_clean":"2024-01-19T04:17:03.699654+0000","last_became_active":"2024-01-19T04:16:50.568334+0000","last_became_peered":"2024-01-19T04:16:50.568334+0000","last_unstale":"2024-01-19T04:17:03.699654+0000","last_undegraded":"2024-01-19T04:17:03.699654+0000","last_fullsized":"2024-01-19T04:17:03.699654+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716215+0000","last_change":"2024-01-19T04:17:04.708655+0000","last_active":"2024-01-19T04:17:04.716215+0000","last_peered":"2024-01-19T04:17:04.716215+0000","last_clean":"2024-01-19T04:17:04.716215+0000","last_became_active":"2024-01-19T04:17:04.708364+0000","last_became_peered":"2024-01-19T04:17:04.708364+0000","last_unstale":"2024-01-19T04:17:04.716215+0000","last_undegraded":"2024-01-19T04:17:04.716215+0000","last_fullsized":"2024-01-19T04:17:04.716215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:16.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733062+0000","last_change":"2024-01-19T04:17:03.717810+0000","last_active":"2024-01-19T04:17:04.733062+0000","last_peered":"2024-01-19T04:17:04.733062+0000","last_clean":"2024-01-19T04:17:04.733062+0000","last_became_active":"2024-01-19T04:17:03.717529+0000","last_became_peered":"2024-01-19T04:17:03.717529+0000","last_unstale":"2024-01-19T04:17:04.733062+0000","last_undegraded":"2024-01-19T04:17:04.733062+0000","last_fullsized":"2024-01-19T04:17:04.733062+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:57.511703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695501+0000","last_change":"2024-01-19T04:16:51.585817+0000","last_active":"2024-01-19T04:17:04.695501+0000","last_peered":"2024-01-19T04:17:04.695501+0000","last_clean":"2024-01-19T04:17:04.695501+0000","last_became_active":"2024-01-19T04:16:51.585142+0000","last_became_peered":"2024-01-19T04:16:51.585142+0000","last_unstale":"2024-01-19T04:17:04.695501+0000","last_undegraded":"2024-01-19T04:17:04.695501+0000","last_fullsized":"2024-01-19T04:17:04.695501+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:41.744656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697098+0000","last_change":"2024-01-19T04:16:50.569683+0000","last_active":"2024-01-19T04:17:03.697098+0000","last_peered":"2024-01-19T04:17:03.697098+0000","last_clean":"2024-01-19T04:17:03.697098+0000","last_became_active":"2024-01-19T04:16:50.567925+0000","last_became_peered":"2024-01-19T04:16:50.567925+0000","last_unstale":"2024-01-19T04:17:03.697098+0000","last_undegraded":"2024-01-19T04:17:03.697098+0000","last_fullsized":"2024-01-19T04:17:03.697098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:25.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720559+0000","last_change":"2024-01-19T04:17:04.714330+0000","last_active":"2024-01-19T04:17:04.720559+0000","last_peered":"2024-01-19T04:17:04.720559+0000","last_clean":"2024-01-19T04:17:04.720559+0000","last_became_active":"2024-01-19T04:17:04.712504+0000","last_became_peered":"2024-01-19T04:17:04.712504+0000","last_unstale":"2024-01-19T04:17:04.720559+0000","last_undegraded":"2024-01-19T04:17:04.720559+0000","last_fullsized":"2024-01-19T04:17:04.720559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:20:39.111262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728964+0000","last_change":"2024-01-19T04:17:03.707765+0000","last_active":"2024-01-19T04:17:04.728964+0000","last_peered":"2024-01-19T04:17:04.728964+0000","last_clean":"2024-01-19T04:17:04.728964+0000","last_became_active":"2024-01-19T04:17:03.707463+0000","last_became_peered":"2024-01-19T04:17:03.707463+0000","last_unstale":"2024-01-19T04:17:04.728964+0000","last_undegraded":"2024-01-19T04:17:04.728964+0000","last_fullsized":"2024-01-19T04:17:04.728964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:30.923295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705625+0000","last_change":"2024-01-19T04:16:51.587058+0000","last_active":"2024-01-19T04:17:03.705625+0000","last_peered":"2024-01-19T04:17:03.705625+0000","last_clean":"2024-01-19T04:17:03.705625+0000","last_became_active":"2024-01-19T04:16:51.577162+0000","last_became_peered":"2024-01-19T04:16:51.577162+0000","last_unstale":"2024-01-19T04:17:03.705625+0000","last_undegraded":"2024-01-19T04:17:03.705625+0000","last_fullsized":"2024-01-19T04:17:03.705625+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:59.277518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701457+0000","last_change":"2024-01-19T04:16:50.568525+0000","last_active":"2024-01-19T04:17:03.701457+0000","last_peered":"2024-01-19T04:17:03.701457+0000","last_clean":"2024-01-19T04:17:03.701457+0000","last_became_active":"2024-01-19T04:16:50.568256+0000","last_became_peered":"2024-01-19T04:16:50.568256+0000","last_unstale":"2024-01-19T04:17:03.701457+0000","last_undegraded":"2024-01-19T04:17:03.701457+0000","last_fullsized":"2024-01-19T04:17:03.701457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697444+0000","last_change":"2024-01-19T04:17:03.697444+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697444+0000","last_undegraded":"2024-01-19T04:17:03.697444+0000","last_fullsized":"2024-01-19T04:17:03.697444+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709846+0000","last_change":"2024-01-19T04:17:03.705858+0000","last_active":"2024-01-19T04:17:03.709846+0000","last_peered":"2024-01-19T04:17:03.709846+0000","last_clean":"2024-01-19T04:17:03.709846+0000","last_became_active":"2024-01-19T04:17:03.705336+0000","last_became_peered":"2024-01-19T04:17:03.705336+0000","last_unstale":"2024-01-19T04:17:03.709846+0000","last_undegraded":"2024-01-19T04:17:03.709846+0000","last_fullsized":"2024-01-19T04:17:03.709846+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:13:06.911289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701334+0000","last_change":"2024-01-19T04:16:51.583117+0000","last_active":"2024-01-19T04:17:03.701334+0000","last_peered":"2024-01-19T04:17:03.701334+0000","last_clean":"2024-01-19T04:17:03.701334+0000","last_became_active":"2024-01-19T04:16:51.582850+0000","last_became_peered":"2024-01-19T04:16:51.582850+0000","last_unstale":"2024-01-19T04:17:03.701334+0000","last_undegraded":"2024-01-19T04:17:03.701334+0000","last_fullsized":"2024-01-19T04:17:03.701334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:19.273356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698214+0000","last_change":"2024-01-19T04:16:50.568671+0000","last_active":"2024-01-19T04:17:04.698214+0000","last_peered":"2024-01-19T04:17:04.698214+0000","last_clean":"2024-01-19T04:17:04.698214+0000","last_became_active":"2024-01-19T04:16:50.568385+0000","last_became_peered":"2024-01-19T04:16:50.568385+0000","last_unstale":"2024-01-19T04:17:04.698214+0000","last_undegraded":"2024-01-19T04:17:04.698214+0000","last_fullsized":"2024-01-19T04:17:04.698214+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:51.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.718727+0000","last_change":"2024-01-19T04:17:04.711029+0000","last_active":"2024-01-19T04:17:04.718727+0000","last_peered":"2024-01-19T04:17:04.718727+0000","last_clean":"2024-01-19T04:17:04.718727+0000","last_became_active":"2024-01-19T04:17:04.709892+0000","last_became_peered":"2024-01-19T04:17:04.709892+0000","last_unstale":"2024-01-19T04:17:04.718727+0000","last_undegraded":"2024-01-19T04:17:04.718727+0000","last_fullsized":"2024-01-19T04:17:04.718727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695249+0000","last_change":"2024-01-19T04:17:03.711352+0000","last_active":"2024-01-19T04:17:04.695249+0000","last_peered":"2024-01-19T04:17:04.695249+0000","last_clean":"2024-01-19T04:17:04.695249+0000","last_became_active":"2024-01-19T04:17:03.711063+0000","last_became_peered":"2024-01-19T04:17:03.711063+0000","last_unstale":"2024-01-19T04:17:04.695249+0000","last_undegraded":"2024-01-19T04:17:04.695249+0000","last_fullsized":"2024-01-19T04:17:04.695249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:38.820788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682407+0000","last_change":"2024-01-19T04:16:51.580811+0000","last_active":"2024-01-19T04:17:02.682407+0000","last_peered":"2024-01-19T04:17:02.682407+0000","last_clean":"2024-01-19T04:17:02.682407+0000","last_became_active":"2024-01-19T04:16:51.579990+0000","last_became_peered":"2024-01-19T04:16:51.579990+0000","last_unstale":"2024-01-19T04:17:02.682407+0000","last_undegraded":"2024-01-19T04:17:02.682407+0000","last_fullsized":"2024-01-19T04:17:02.682407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:43:24.773146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701261+0000","last_change":"2024-01-19T04:16:50.569777+0000","last_active":"2024-01-19T04:17:03.701261+0000","last_peered":"2024-01-19T04:17:03.701261+0000","last_clean":"2024-01-19T04:17:03.701261+0000","last_became_active":"2024-01-19T04:16:50.569507+0000","last_became_peered":"2024-01-19T04:16:50.569507+0000","last_unstale":"2024-01-19T04:17:03.701261+0000","last_undegraded":"2024-01-19T04:17:03.701261+0000","last_fullsized":"2024-01-19T04:17:03.701261+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735294+0000","last_change":"2024-01-19T04:17:04.732838+0000","last_active":"2024-01-19T04:17:04.735294+0000","last_peered":"2024-01-19T04:17:04.735294+0000","last_clean":"2024-01-19T04:17:04.735294+0000","last_became_active":"2024-01-19T04:17:04.732579+0000","last_became_peered":"2024-01-19T04:17:04.732579+0000","last_unstale":"2024-01-19T04:17:04.735294+0000","last_undegraded":"2024-01-19T04:17:04.735294+0000","last_fullsized":"2024-01-19T04:17:04.735294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:26.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701729+0000","last_change":"2024-01-19T04:17:03.710016+0000","last_active":"2024-01-19T04:17:04.701729+0000","last_peered":"2024-01-19T04:17:04.701729+0000","last_clean":"2024-01-19T04:17:04.701729+0000","last_became_active":"2024-01-19T04:17:03.709659+0000","last_became_peered":"2024-01-19T04:17:03.709659+0000","last_unstale":"2024-01-19T04:17:04.701729+0000","last_undegraded":"2024-01-19T04:17:04.701729+0000","last_fullsized":"2024-01-19T04:17:04.701729+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:35.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701014+0000","last_change":"2024-01-19T04:16:51.582425+0000","last_active":"2024-01-19T04:17:03.701014+0000","last_peered":"2024-01-19T04:17:03.701014+0000","last_clean":"2024-01-19T04:17:03.701014+0000","last_became_active":"2024-01-19T04:16:51.582136+0000","last_became_peered":"2024-01-19T04:16:51.582136+0000","last_unstale":"2024-01-19T04:17:03.701014+0000","last_undegraded":"2024-01-19T04:17:03.701014+0000","last_fullsized":"2024-01-19T04:17:03.701014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702836+0000","last_change":"2024-01-19T04:16:50.563850+0000","last_active":"2024-01-19T04:17:03.702836+0000","last_peered":"2024-01-19T04:17:03.702836+0000","last_clean":"2024-01-19T04:17:03.702836+0000","last_became_active":"2024-01-19T04:16:50.563492+0000","last_became_peered":"2024-01-19T04:16:50.563492+0000","last_unstale":"2024-01-19T04:17:03.702836+0000","last_undegraded":"2024-01-19T04:17:03.702836+0000","last_fullsized":"2024-01-19T04:17:03.702836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:50.446354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693984+0000","last_change":"2024-01-19T04:17:03.693984+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693984+0000","last_undegraded":"2024-01-19T04:17:03.693984+0000","last_fullsized":"2024-01-19T04:17:03.693984+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702056+0000","last_change":"2024-01-19T04:17:03.713104+0000","last_active":"2024-01-19T04:17:04.702056+0000","last_peered":"2024-01-19T04:17:04.702056+0000","last_clean":"2024-01-19T04:17:04.702056+0000","last_became_active":"2024-01-19T04:17:03.712774+0000","last_became_peered":"2024-01-19T04:17:03.712774+0000","last_unstale":"2024-01-19T04:17:04.702056+0000","last_undegraded":"2024-01-19T04:17:04.702056+0000","last_fullsized":"2024-01-19T04:17:04.702056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700474+0000","last_change":"2024-01-19T04:16:51.579099+0000","last_active":"2024-01-19T04:17:03.700474+0000","last_peered":"2024-01-19T04:17:03.700474+0000","last_clean":"2024-01-19T04:17:03.700474+0000","last_became_active":"2024-01-19T04:16:51.578809+0000","last_became_peered":"2024-01-19T04:16:51.578809+0000","last_unstale":"2024-01-19T04:17:03.700474+0000","last_undegraded":"2024-01-19T04:17:03.700474+0000","last_fullsized":"2024-01-19T04:17:03.700474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695098+0000","last_change":"2024-01-19T04:16:50.565530+0000","last_active":"2024-01-19T04:17:04.695098+0000","last_peered":"2024-01-19T04:17:04.695098+0000","last_clean":"2024-01-19T04:17:04.695098+0000","last_became_active":"2024-01-19T04:16:50.565191+0000","last_became_peered":"2024-01-19T04:16:50.565191+0000","last_unstale":"2024-01-19T04:17:04.695098+0000","last_undegraded":"2024-01-19T04:17:04.695098+0000","last_fullsized":"2024-01-19T04:17:04.695098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:14.286352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694155+0000","last_change":"2024-01-19T04:17:03.694155+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694155+0000","last_undegraded":"2024-01-19T04:17:03.694155+0000","last_fullsized":"2024-01-19T04:17:03.694155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.731424+0000","last_change":"2024-01-19T04:17:03.711561+0000","last_active":"2024-01-19T04:17:04.731424+0000","last_peered":"2024-01-19T04:17:04.731424+0000","last_clean":"2024-01-19T04:17:04.731424+0000","last_became_active":"2024-01-19T04:17:03.711261+0000","last_became_peered":"2024-01-19T04:17:03.711261+0000","last_unstale":"2024-01-19T04:17:04.731424+0000","last_undegraded":"2024-01-19T04:17:04.731424+0000","last_fullsized":"2024-01-19T04:17:04.731424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:19.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702246+0000","last_change":"2024-01-19T04:16:51.587155+0000","last_active":"2024-01-19T04:17:03.702246+0000","last_peered":"2024-01-19T04:17:03.702246+0000","last_clean":"2024-01-19T04:17:03.702246+0000","last_became_active":"2024-01-19T04:16:51.584989+0000","last_became_peered":"2024-01-19T04:16:51.584989+0000","last_unstale":"2024-01-19T04:17:03.702246+0000","last_undegraded":"2024-01-19T04:17:03.702246+0000","last_fullsized":"2024-01-19T04:17:03.702246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704254+0000","last_change":"2024-01-19T04:16:50.566824+0000","last_active":"2024-01-19T04:17:03.704254+0000","last_peered":"2024-01-19T04:17:03.704254+0000","last_clean":"2024-01-19T04:17:03.704254+0000","last_became_active":"2024-01-19T04:16:50.566530+0000","last_became_peered":"2024-01-19T04:16:50.566530+0000","last_unstale":"2024-01-19T04:17:03.704254+0000","last_undegraded":"2024-01-19T04:17:03.704254+0000","last_fullsized":"2024-01-19T04:17:03.704254+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727903+0000","last_change":"2024-01-19T04:17:04.718338+0000","last_active":"2024-01-19T04:17:04.727903+0000","last_peered":"2024-01-19T04:17:04.727903+0000","last_clean":"2024-01-19T04:17:04.727903+0000","last_became_active":"2024-01-19T04:17:04.714128+0000","last_became_peered":"2024-01-19T04:17:04.714128+0000","last_unstale":"2024-01-19T04:17:04.727903+0000","last_undegraded":"2024-01-19T04:17:04.727903+0000","last_fullsized":"2024-01-19T04:17:04.727903+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.710312+0000","last_change":"2024-01-19T04:17:03.706653+0000","last_active":"2024-01-19T04:17:03.710312+0000","last_peered":"2024-01-19T04:17:03.710312+0000","last_clean":"2024-01-19T04:17:03.710312+0000","last_became_active":"2024-01-19T04:17:03.706259+0000","last_became_peered":"2024-01-19T04:17:03.706259+0000","last_unstale":"2024-01-19T04:17:03.710312+0000","last_undegraded":"2024-01-19T04:17:03.710312+0000","last_fullsized":"2024-01-19T04:17:03.710312+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:20:49.616898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697004+0000","last_change":"2024-01-19T04:16:51.576072+0000","last_active":"2024-01-19T04:17:03.697004+0000","last_peered":"2024-01-19T04:17:03.697004+0000","last_clean":"2024-01-19T04:17:03.697004+0000","last_became_active":"2024-01-19T04:16:51.575754+0000","last_became_peered":"2024-01-19T04:16:51.575754+0000","last_unstale":"2024-01-19T04:17:03.697004+0000","last_undegraded":"2024-01-19T04:17:03.697004+0000","last_fullsized":"2024-01-19T04:17:03.697004+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:58.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699751+0000","last_change":"2024-01-19T04:16:50.571102+0000","last_active":"2024-01-19T04:17:03.699751+0000","last_peered":"2024-01-19T04:17:03.699751+0000","last_clean":"2024-01-19T04:17:03.699751+0000","last_became_active":"2024-01-19T04:16:50.570597+0000","last_became_peered":"2024-01-19T04:16:50.570597+0000","last_unstale":"2024-01-19T04:17:03.699751+0000","last_undegraded":"2024-01-19T04:17:03.699751+0000","last_fullsized":"2024-01-19T04:17:03.699751+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.717191+0000","last_change":"2024-01-19T04:17:04.710314+0000","last_active":"2024-01-19T04:17:04.717191+0000","last_peered":"2024-01-19T04:17:04.717191+0000","last_clean":"2024-01-19T04:17:04.717191+0000","last_became_active":"2024-01-19T04:17:04.709915+0000","last_became_peered":"2024-01-19T04:17:04.709915+0000","last_unstale":"2024-01-19T04:17:04.717191+0000","last_undegraded":"2024-01-19T04:17:04.717191+0000","last_fullsized":"2024-01-19T04:17:04.717191+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698318+0000","last_change":"2024-01-19T04:17:03.709688+0000","last_active":"2024-01-19T04:17:04.698318+0000","last_peered":"2024-01-19T04:17:04.698318+0000","last_clean":"2024-01-19T04:17:04.698318+0000","last_became_active":"2024-01-19T04:17:03.709392+0000","last_became_peered":"2024-01-19T04:17:03.709392+0000","last_unstale":"2024-01-19T04:17:04.698318+0000","last_undegraded":"2024-01-19T04:17:04.698318+0000","last_fullsized":"2024-01-19T04:17:04.698318+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:44.030611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700170+0000","last_change":"2024-01-19T04:16:51.581476+0000","last_active":"2024-01-19T04:17:03.700170+0000","last_peered":"2024-01-19T04:17:03.700170+0000","last_clean":"2024-01-19T04:17:03.700170+0000","last_became_active":"2024-01-19T04:16:51.580937+0000","last_became_peered":"2024-01-19T04:16:51.580937+0000","last_unstale":"2024-01-19T04:17:03.700170+0000","last_undegraded":"2024-01-19T04:17:03.700170+0000","last_fullsized":"2024-01-19T04:17:03.700170+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701243+0000","last_change":"2024-01-19T04:16:50.572829+0000","last_active":"2024-01-19T04:17:03.701243+0000","last_peered":"2024-01-19T04:17:03.701243+0000","last_clean":"2024-01-19T04:17:03.701243+0000","last_became_active":"2024-01-19T04:16:50.572538+0000","last_became_peered":"2024-01-19T04:16:50.572538+0000","last_unstale":"2024-01-19T04:17:03.701243+0000","last_undegraded":"2024-01-19T04:17:03.701243+0000","last_fullsized":"2024-01-19T04:17:03.701243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692735+0000","last_change":"2024-01-19T04:17:03.692735+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692735+0000","last_undegraded":"2024-01-19T04:17:03.692735+0000","last_fullsized":"2024-01-19T04:17:03.692735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733767+0000","last_change":"2024-01-19T04:17:03.710856+0000","last_active":"2024-01-19T04:17:04.733767+0000","last_peered":"2024-01-19T04:17:04.733767+0000","last_clean":"2024-01-19T04:17:04.733767+0000","last_became_active":"2024-01-19T04:17:03.709025+0000","last_became_peered":"2024-01-19T04:17:03.709025+0000","last_unstale":"2024-01-19T04:17:04.733767+0000","last_undegraded":"2024-01-19T04:17:04.733767+0000","last_fullsized":"2024-01-19T04:17:04.733767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:59.101927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702987+0000","last_change":"2024-01-19T04:16:51.588191+0000","last_active":"2024-01-19T04:17:03.702987+0000","last_peered":"2024-01-19T04:17:03.702987+0000","last_clean":"2024-01-19T04:17:03.702987+0000","last_became_active":"2024-01-19T04:16:51.587927+0000","last_became_peered":"2024-01-19T04:16:51.587927+0000","last_unstale":"2024-01-19T04:17:03.702987+0000","last_undegraded":"2024-01-19T04:17:03.702987+0000","last_fullsized":"2024-01-19T04:17:03.702987+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698421+0000","last_change":"2024-01-19T04:16:50.569273+0000","last_active":"2024-01-19T04:17:04.698421+0000","last_peered":"2024-01-19T04:17:04.698421+0000","last_clean":"2024-01-19T04:17:04.698421+0000","last_became_active":"2024-01-19T04:16:50.569009+0000","last_became_peered":"2024-01-19T04:16:50.569009+0000","last_unstale":"2024-01-19T04:17:04.698421+0000","last_undegraded":"2024-01-19T04:17:04.698421+0000","last_fullsized":"2024-01-19T04:17:04.698421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:59:10.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696863+0000","last_change":"2024-01-19T04:17:03.696863+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696863+0000","last_undegraded":"2024-01-19T04:17:03.696863+0000","last_fullsized":"2024-01-19T04:17:03.696863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.703496+0000","last_change":"2024-01-19T04:17:03.711904+0000","last_active":"2024-01-19T04:17:04.703496+0000","last_peered":"2024-01-19T04:17:04.703496+0000","last_clean":"2024-01-19T04:17:04.703496+0000","last_became_active":"2024-01-19T04:17:03.711592+0000","last_became_peered":"2024-01-19T04:17:03.711592+0000","last_unstale":"2024-01-19T04:17:04.703496+0000","last_undegraded":"2024-01-19T04:17:04.703496+0000","last_fullsized":"2024-01-19T04:17:04.703496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704488+0000","last_change":"2024-01-19T04:16:51.578342+0000","last_active":"2024-01-19T04:17:03.704488+0000","last_peered":"2024-01-19T04:17:03.704488+0000","last_clean":"2024-01-19T04:17:03.704488+0000","last_became_active":"2024-01-19T04:16:51.575581+0000","last_became_peered":"2024-01-19T04:16:51.575581+0000","last_unstale":"2024-01-19T04:17:03.704488+0000","last_undegraded":"2024-01-19T04:17:03.704488+0000","last_fullsized":"2024-01-19T04:17:03.704488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.690077+0000","last_change":"2024-01-19T04:16:50.572020+0000","last_active":"2024-01-19T04:17:02.690077+0000","last_peered":"2024-01-19T04:17:02.690077+0000","last_clean":"2024-01-19T04:17:02.690077+0000","last_became_active":"2024-01-19T04:16:50.571617+0000","last_became_peered":"2024-01-19T04:16:50.571617+0000","last_unstale":"2024-01-19T04:17:02.690077+0000","last_undegraded":"2024-01-19T04:17:02.690077+0000","last_fullsized":"2024-01-19T04:17:02.690077+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721580+0000","last_change":"2024-01-19T04:17:04.715751+0000","last_active":"2024-01-19T04:17:04.721580+0000","last_peered":"2024-01-19T04:17:04.721580+0000","last_clean":"2024-01-19T04:17:04.721580+0000","last_became_active":"2024-01-19T04:17:04.715489+0000","last_became_peered":"2024-01-19T04:17:04.715489+0000","last_unstale":"2024-01-19T04:17:04.721580+0000","last_undegraded":"2024-01-19T04:17:04.721580+0000","last_fullsized":"2024-01-19T04:17:04.721580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:47.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734310+0000","last_change":"2024-01-19T04:17:03.715436+0000","last_active":"2024-01-19T04:17:04.734310+0000","last_peered":"2024-01-19T04:17:04.734310+0000","last_clean":"2024-01-19T04:17:04.734310+0000","last_became_active":"2024-01-19T04:17:03.715157+0000","last_became_peered":"2024-01-19T04:17:03.715157+0000","last_unstale":"2024-01-19T04:17:04.734310+0000","last_undegraded":"2024-01-19T04:17:04.734310+0000","last_fullsized":"2024-01-19T04:17:04.734310+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:49.326125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696979+0000","last_change":"2024-01-19T04:16:51.575079+0000","last_active":"2024-01-19T04:17:04.696979+0000","last_peered":"2024-01-19T04:17:04.696979+0000","last_clean":"2024-01-19T04:17:04.696979+0000","last_became_active":"2024-01-19T04:16:51.574248+0000","last_became_peered":"2024-01-19T04:16:51.574248+0000","last_unstale":"2024-01-19T04:17:04.696979+0000","last_undegraded":"2024-01-19T04:17:04.696979+0000","last_fullsized":"2024-01-19T04:17:04.696979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:17.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702750+0000","last_change":"2024-01-19T04:16:50.571109+0000","last_active":"2024-01-19T04:17:03.702750+0000","last_peered":"2024-01-19T04:17:03.702750+0000","last_clean":"2024-01-19T04:17:03.702750+0000","last_became_active":"2024-01-19T04:16:50.570839+0000","last_became_peered":"2024-01-19T04:16:50.570839+0000","last_unstale":"2024-01-19T04:17:03.702750+0000","last_undegraded":"2024-01-19T04:17:03.702750+0000","last_fullsized":"2024-01-19T04:17:03.702750+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:22.030862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724584+0000","last_change":"2024-01-19T04:17:04.716334+0000","last_active":"2024-01-19T04:17:04.724584+0000","last_peered":"2024-01-19T04:17:04.724584+0000","last_clean":"2024-01-19T04:17:04.724584+0000","last_became_active":"2024-01-19T04:17:04.715736+0000","last_became_peered":"2024-01-19T04:17:04.715736+0000","last_unstale":"2024-01-19T04:17:04.724584+0000","last_undegraded":"2024-01-19T04:17:04.724584+0000","last_fullsized":"2024-01-19T04:17:04.724584+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734211+0000","last_change":"2024-01-19T04:17:03.717168+0000","last_active":"2024-01-19T04:17:04.734211+0000","last_peered":"2024-01-19T04:17:04.734211+0000","last_clean":"2024-01-19T04:17:04.734211+0000","last_became_active":"2024-01-19T04:17:03.716597+0000","last_became_peered":"2024-01-19T04:17:03.716597+0000","last_unstale":"2024-01-19T04:17:04.734211+0000","last_undegraded":"2024-01-19T04:17:04.734211+0000","last_fullsized":"2024-01-19T04:17:04.734211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:40.365611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701131+0000","last_change":"2024-01-19T04:16:51.582601+0000","last_active":"2024-01-19T04:17:03.701131+0000","last_peered":"2024-01-19T04:17:03.701131+0000","last_clean":"2024-01-19T04:17:03.701131+0000","last_became_active":"2024-01-19T04:16:51.582294+0000","last_became_peered":"2024-01-19T04:16:51.582294+0000","last_unstale":"2024-01-19T04:17:03.701131+0000","last_undegraded":"2024-01-19T04:17:03.701131+0000","last_fullsized":"2024-01-19T04:17:03.701131+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689034+0000","last_change":"2024-01-19T04:16:50.568331+0000","last_active":"2024-01-19T04:17:02.689034+0000","last_peered":"2024-01-19T04:17:02.689034+0000","last_clean":"2024-01-19T04:17:02.689034+0000","last_became_active":"2024-01-19T04:16:50.567695+0000","last_became_peered":"2024-01-19T04:16:50.567695+0000","last_unstale":"2024-01-19T04:17:02.689034+0000","last_undegraded":"2024-01-19T04:17:02.689034+0000","last_fullsized":"2024-01-19T04:17:02.689034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923571+0000","last_change":"2024-01-19T04:17:04.722284+0000","last_active":"2024-01-19T04:17:06.923571+0000","last_peered":"2024-01-19T04:17:06.923571+0000","last_clean":"2024-01-19T04:17:06.923571+0000","last_became_active":"2024-01-19T04:17:04.722004+0000","last_became_peered":"2024-01-19T04:17:04.722004+0000","last_unstale":"2024-01-19T04:17:06.923571+0000","last_undegraded":"2024-01-19T04:17:06.923571+0000","last_fullsized":"2024-01-19T04:17:06.923571+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:15.275480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701951+0000","last_change":"2024-01-19T04:17:03.712871+0000","last_active":"2024-01-19T04:17:04.701951+0000","last_peered":"2024-01-19T04:17:04.701951+0000","last_clean":"2024-01-19T04:17:04.701951+0000","last_became_active":"2024-01-19T04:17:03.710684+0000","last_became_peered":"2024-01-19T04:17:03.710684+0000","last_unstale":"2024-01-19T04:17:04.701951+0000","last_undegraded":"2024-01-19T04:17:04.701951+0000","last_fullsized":"2024-01-19T04:17:04.701951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700567+0000","last_change":"2024-01-19T04:16:51.579139+0000","last_active":"2024-01-19T04:17:03.700567+0000","last_peered":"2024-01-19T04:17:03.700567+0000","last_clean":"2024-01-19T04:17:03.700567+0000","last_became_active":"2024-01-19T04:16:51.578820+0000","last_became_peered":"2024-01-19T04:16:51.578820+0000","last_unstale":"2024-01-19T04:17:03.700567+0000","last_undegraded":"2024-01-19T04:17:03.700567+0000","last_fullsized":"2024-01-19T04:17:03.700567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695278+0000","last_change":"2024-01-19T04:16:50.563572+0000","last_active":"2024-01-19T04:17:04.695278+0000","last_peered":"2024-01-19T04:17:04.695278+0000","last_clean":"2024-01-19T04:17:04.695278+0000","last_became_active":"2024-01-19T04:16:50.561160+0000","last_became_peered":"2024-01-19T04:16:50.561160+0000","last_unstale":"2024-01-19T04:17:04.695278+0000","last_undegraded":"2024-01-19T04:17:04.695278+0000","last_fullsized":"2024-01-19T04:17:04.695278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:40:18.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923752+0000","last_change":"2024-01-19T04:17:04.722269+0000","last_active":"2024-01-19T04:17:06.923752+0000","last_peered":"2024-01-19T04:17:06.923752+0000","last_clean":"2024-01-19T04:17:06.923752+0000","last_became_active":"2024-01-19T04:17:04.722003+0000","last_became_peered":"2024-01-19T04:17:04.722003+0000","last_unstale":"2024-01-19T04:17:06.923752+0000","last_undegraded":"2024-01-19T04:17:06.923752+0000","last_fullsized":"2024-01-19T04:17:06.923752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:53.689915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709368+0000","last_change":"2024-01-19T04:17:03.703625+0000","last_active":"2024-01-19T04:17:03.709368+0000","last_peered":"2024-01-19T04:17:03.709368+0000","last_clean":"2024-01-19T04:17:03.709368+0000","last_became_active":"2024-01-19T04:17:03.702960+0000","last_became_peered":"2024-01-19T04:17:03.702960+0000","last_unstale":"2024-01-19T04:17:03.709368+0000","last_undegraded":"2024-01-19T04:17:03.709368+0000","last_fullsized":"2024-01-19T04:17:03.709368+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:58:33.792427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688531+0000","last_change":"2024-01-19T04:16:51.581877+0000","last_active":"2024-01-19T04:17:02.688531+0000","last_peered":"2024-01-19T04:17:02.688531+0000","last_clean":"2024-01-19T04:17:02.688531+0000","last_became_active":"2024-01-19T04:16:51.580713+0000","last_became_peered":"2024-01-19T04:16:51.580713+0000","last_unstale":"2024-01-19T04:17:02.688531+0000","last_undegraded":"2024-01-19T04:17:02.688531+0000","last_fullsized":"2024-01-19T04:17:02.688531+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682309+0000","last_change":"2024-01-19T04:16:50.572947+0000","last_active":"2024-01-19T04:17:02.682309+0000","last_peered":"2024-01-19T04:17:02.682309+0000","last_clean":"2024-01-19T04:17:02.682309+0000","last_became_active":"2024-01-19T04:16:50.572679+0000","last_became_peered":"2024-01-19T04:16:50.572679+0000","last_unstale":"2024-01-19T04:17:02.682309+0000","last_undegraded":"2024-01-19T04:17:02.682309+0000","last_fullsized":"2024-01-19T04:17:02.682309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:41.006603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923756+0000","last_change":"2024-01-19T04:17:04.715568+0000","last_active":"2024-01-19T04:17:06.923756+0000","last_peered":"2024-01-19T04:17:06.923756+0000","last_clean":"2024-01-19T04:17:06.923756+0000","last_became_active":"2024-01-19T04:17:04.715214+0000","last_became_peered":"2024-01-19T04:17:04.715214+0000","last_unstale":"2024-01-19T04:17:06.923756+0000","last_undegraded":"2024-01-19T04:17:06.923756+0000","last_fullsized":"2024-01-19T04:17:06.923756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:15.118406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711926+0000","last_change":"2024-01-19T04:17:03.716279+0000","last_active":"2024-01-19T04:17:04.711926+0000","last_peered":"2024-01-19T04:17:04.711926+0000","last_clean":"2024-01-19T04:17:04.711926+0000","last_became_active":"2024-01-19T04:17:03.715875+0000","last_became_peered":"2024-01-19T04:17:03.715875+0000","last_unstale":"2024-01-19T04:17:04.711926+0000","last_undegraded":"2024-01-19T04:17:04.711926+0000","last_fullsized":"2024-01-19T04:17:04.711926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:55.411637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687924+0000","last_change":"2024-01-19T04:16:51.575958+0000","last_active":"2024-01-19T04:17:02.687924+0000","last_peered":"2024-01-19T04:17:02.687924+0000","last_clean":"2024-01-19T04:17:02.687924+0000","last_became_active":"2024-01-19T04:16:51.575635+0000","last_became_peered":"2024-01-19T04:16:51.575635+0000","last_unstale":"2024-01-19T04:17:02.687924+0000","last_undegraded":"2024-01-19T04:17:02.687924+0000","last_fullsized":"2024-01-19T04:17:02.687924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697752+0000","last_change":"2024-01-19T04:16:50.568547+0000","last_active":"2024-01-19T04:17:03.697752+0000","last_peered":"2024-01-19T04:17:03.697752+0000","last_clean":"2024-01-19T04:17:03.697752+0000","last_became_active":"2024-01-19T04:16:50.568248+0000","last_became_peered":"2024-01-19T04:16:50.568248+0000","last_unstale":"2024-01-19T04:17:03.697752+0000","last_undegraded":"2024-01-19T04:17:03.697752+0000","last_fullsized":"2024-01-19T04:17:03.697752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:45.960987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734018+0000","last_change":"2024-01-19T04:17:04.732413+0000","last_active":"2024-01-19T04:17:04.734018+0000","last_peered":"2024-01-19T04:17:04.734018+0000","last_clean":"2024-01-19T04:17:04.734018+0000","last_became_active":"2024-01-19T04:17:04.732057+0000","last_became_peered":"2024-01-19T04:17:04.732057+0000","last_unstale":"2024-01-19T04:17:04.734018+0000","last_undegraded":"2024-01-19T04:17:04.734018+0000","last_fullsized":"2024-01-19T04:17:04.734018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:29:59.877276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.711992+0000","last_change":"2024-01-19T04:17:03.711094+0000","last_active":"2024-01-19T04:17:03.711992+0000","last_peered":"2024-01-19T04:17:03.711992+0000","last_clean":"2024-01-19T04:17:03.711992+0000","last_became_active":"2024-01-19T04:17:03.710806+0000","last_became_peered":"2024-01-19T04:17:03.710806+0000","last_unstale":"2024-01-19T04:17:03.711992+0000","last_undegraded":"2024-01-19T04:17:03.711992+0000","last_fullsized":"2024-01-19T04:17:03.711992+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:45.583850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703526+0000","last_change":"2024-01-19T04:16:51.562371+0000","last_active":"2024-01-19T04:17:03.703526+0000","last_peered":"2024-01-19T04:17:03.703526+0000","last_clean":"2024-01-19T04:17:03.703526+0000","last_became_active":"2024-01-19T04:16:51.562057+0000","last_became_peered":"2024-01-19T04:16:51.562057+0000","last_unstale":"2024-01-19T04:17:03.703526+0000","last_undegraded":"2024-01-19T04:17:03.703526+0000","last_fullsized":"2024-01-19T04:17:03.703526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682907+0000","last_change":"2024-01-19T04:16:50.575311+0000","last_active":"2024-01-19T04:17:02.682907+0000","last_peered":"2024-01-19T04:17:02.682907+0000","last_clean":"2024-01-19T04:17:02.682907+0000","last_became_active":"2024-01-19T04:16:50.574897+0000","last_became_peered":"2024-01-19T04:16:50.574897+0000","last_unstale":"2024-01-19T04:17:02.682907+0000","last_undegraded":"2024-01-19T04:17:02.682907+0000","last_fullsized":"2024-01-19T04:17:02.682907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725149+0000","last_change":"2024-01-19T04:17:04.717650+0000","last_active":"2024-01-19T04:17:04.725149+0000","last_peered":"2024-01-19T04:17:04.725149+0000","last_clean":"2024-01-19T04:17:04.725149+0000","last_became_active":"2024-01-19T04:17:04.713401+0000","last_became_peered":"2024-01-19T04:17:04.713401+0000","last_unstale":"2024-01-19T04:17:04.725149+0000","last_undegraded":"2024-01-19T04:17:04.725149+0000","last_fullsized":"2024-01-19T04:17:04.725149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.714569+0000","last_change":"2024-01-19T04:17:03.711629+0000","last_active":"2024-01-19T04:17:03.714569+0000","last_peered":"2024-01-19T04:17:03.714569+0000","last_clean":"2024-01-19T04:17:03.714569+0000","last_became_active":"2024-01-19T04:17:03.711338+0000","last_became_peered":"2024-01-19T04:17:03.711338+0000","last_unstale":"2024-01-19T04:17:03.714569+0000","last_undegraded":"2024-01-19T04:17:03.714569+0000","last_fullsized":"2024-01-19T04:17:03.714569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704626+0000","last_change":"2024-01-19T04:16:51.585936+0000","last_active":"2024-01-19T04:17:03.704626+0000","last_peered":"2024-01-19T04:17:03.704626+0000","last_clean":"2024-01-19T04:17:03.704626+0000","last_became_active":"2024-01-19T04:16:51.585682+0000","last_became_peered":"2024-01-19T04:16:51.585682+0000","last_unstale":"2024-01-19T04:17:03.704626+0000","last_undegraded":"2024-01-19T04:17:03.704626+0000","last_fullsized":"2024-01-19T04:17:03.704626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.690071+0000","last_change":"2024-01-19T04:16:50.567862+0000","last_active":"2024-01-19T04:17:02.690071+0000","last_peered":"2024-01-19T04:17:02.690071+0000","last_clean":"2024-01-19T04:17:02.690071+0000","last_became_active":"2024-01-19T04:16:50.567482+0000","last_became_peered":"2024-01-19T04:16:50.567482+0000","last_unstale":"2024-01-19T04:17:02.690071+0000","last_undegraded":"2024-01-19T04:17:02.690071+0000","last_fullsized":"2024-01-19T04:17:02.690071+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697577+0000","last_change":"2024-01-19T04:17:03.697577+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697577+0000","last_undegraded":"2024-01-19T04:17:03.697577+0000","last_fullsized":"2024-01-19T04:17:03.697577+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734217+0000","last_change":"2024-01-19T04:17:03.715400+0000","last_active":"2024-01-19T04:17:04.734217+0000","last_peered":"2024-01-19T04:17:04.734217+0000","last_clean":"2024-01-19T04:17:04.734217+0000","last_became_active":"2024-01-19T04:17:03.714763+0000","last_became_peered":"2024-01-19T04:17:03.714763+0000","last_unstale":"2024-01-19T04:17:04.734217+0000","last_undegraded":"2024-01-19T04:17:04.734217+0000","last_fullsized":"2024-01-19T04:17:04.734217+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:42.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682466+0000","last_change":"2024-01-19T04:16:51.581054+0000","last_active":"2024-01-19T04:17:02.682466+0000","last_peered":"2024-01-19T04:17:02.682466+0000","last_clean":"2024-01-19T04:17:02.682466+0000","last_became_active":"2024-01-19T04:16:51.580564+0000","last_became_peered":"2024-01-19T04:16:51.580564+0000","last_unstale":"2024-01-19T04:17:02.682466+0000","last_undegraded":"2024-01-19T04:17:02.682466+0000","last_fullsized":"2024-01-19T04:17:02.682466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.841231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705816+0000","last_change":"2024-01-19T04:16:50.565555+0000","last_active":"2024-01-19T04:17:03.705816+0000","last_peered":"2024-01-19T04:17:03.705816+0000","last_clean":"2024-01-19T04:17:03.705816+0000","last_became_active":"2024-01-19T04:16:50.565273+0000","last_became_peered":"2024-01-19T04:16:50.565273+0000","last_unstale":"2024-01-19T04:17:03.705816+0000","last_undegraded":"2024-01-19T04:17:03.705816+0000","last_fullsized":"2024-01-19T04:17:03.705816+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719993+0000","last_change":"2024-01-19T04:17:04.716116+0000","last_active":"2024-01-19T04:17:04.719993+0000","last_peered":"2024-01-19T04:17:04.719993+0000","last_clean":"2024-01-19T04:17:04.719993+0000","last_became_active":"2024-01-19T04:17:04.715861+0000","last_became_peered":"2024-01-19T04:17:04.715861+0000","last_unstale":"2024-01-19T04:17:04.719993+0000","last_undegraded":"2024-01-19T04:17:04.719993+0000","last_fullsized":"2024-01-19T04:17:04.719993+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704490+0000","last_change":"2024-01-19T04:17:03.713437+0000","last_active":"2024-01-19T04:17:04.704490+0000","last_peered":"2024-01-19T04:17:04.704490+0000","last_clean":"2024-01-19T04:17:04.704490+0000","last_became_active":"2024-01-19T04:17:03.713127+0000","last_became_peered":"2024-01-19T04:17:03.713127+0000","last_unstale":"2024-01-19T04:17:04.704490+0000","last_undegraded":"2024-01-19T04:17:04.704490+0000","last_fullsized":"2024-01-19T04:17:04.704490+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689270+0000","last_change":"2024-01-19T04:16:51.574116+0000","last_active":"2024-01-19T04:17:02.689270+0000","last_peered":"2024-01-19T04:17:02.689270+0000","last_clean":"2024-01-19T04:17:02.689270+0000","last_became_active":"2024-01-19T04:16:51.573543+0000","last_became_peered":"2024-01-19T04:16:51.573543+0000","last_unstale":"2024-01-19T04:17:02.689270+0000","last_undegraded":"2024-01-19T04:17:02.689270+0000","last_fullsized":"2024-01-19T04:17:02.689270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703710+0000","last_change":"2024-01-19T04:16:50.571359+0000","last_active":"2024-01-19T04:17:03.703710+0000","last_peered":"2024-01-19T04:17:03.703710+0000","last_clean":"2024-01-19T04:17:03.703710+0000","last_became_active":"2024-01-19T04:16:50.570715+0000","last_became_peered":"2024-01-19T04:16:50.570715+0000","last_unstale":"2024-01-19T04:17:03.703710+0000","last_undegraded":"2024-01-19T04:17:03.703710+0000","last_fullsized":"2024-01-19T04:17:03.703710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692259+0000","last_change":"2024-01-19T04:17:03.692259+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692259+0000","last_undegraded":"2024-01-19T04:17:03.692259+0000","last_fullsized":"2024-01-19T04:17:03.692259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694496+0000","last_change":"2024-01-19T04:17:03.711684+0000","last_active":"2024-01-19T04:17:04.694496+0000","last_peered":"2024-01-19T04:17:04.694496+0000","last_clean":"2024-01-19T04:17:04.694496+0000","last_became_active":"2024-01-19T04:17:03.711404+0000","last_became_peered":"2024-01-19T04:17:03.711404+0000","last_unstale":"2024-01-19T04:17:04.694496+0000","last_undegraded":"2024-01-19T04:17:04.694496+0000","last_fullsized":"2024-01-19T04:17:04.694496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:05.518024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695322+0000","last_change":"2024-01-19T04:16:51.578118+0000","last_active":"2024-01-19T04:17:04.695322+0000","last_peered":"2024-01-19T04:17:04.695322+0000","last_clean":"2024-01-19T04:17:04.695322+0000","last_became_active":"2024-01-19T04:16:51.577861+0000","last_became_peered":"2024-01-19T04:16:51.577861+0000","last_unstale":"2024-01-19T04:17:04.695322+0000","last_undegraded":"2024-01-19T04:17:04.695322+0000","last_fullsized":"2024-01-19T04:17:04.695322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:52:16.044197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682351+0000","last_change":"2024-01-19T04:16:50.572873+0000","last_active":"2024-01-19T04:17:02.682351+0000","last_peered":"2024-01-19T04:17:02.682351+0000","last_clean":"2024-01-19T04:17:02.682351+0000","last_became_active":"2024-01-19T04:16:50.571172+0000","last_became_peered":"2024-01-19T04:16:50.571172+0000","last_unstale":"2024-01-19T04:17:02.682351+0000","last_undegraded":"2024-01-19T04:17:02.682351+0000","last_fullsized":"2024-01-19T04:17:02.682351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734205+0000","last_change":"2024-01-19T04:17:04.727787+0000","last_active":"2024-01-19T04:17:04.734205+0000","last_peered":"2024-01-19T04:17:04.734205+0000","last_clean":"2024-01-19T04:17:04.734205+0000","last_became_active":"2024-01-19T04:17:04.727503+0000","last_became_peered":"2024-01-19T04:17:04.727503+0000","last_unstale":"2024-01-19T04:17:04.734205+0000","last_undegraded":"2024-01-19T04:17:04.734205+0000","last_fullsized":"2024-01-19T04:17:04.734205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:06.524237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710562+0000","last_change":"2024-01-19T04:17:03.711107+0000","last_active":"2024-01-19T04:17:04.710562+0000","last_peered":"2024-01-19T04:17:04.710562+0000","last_clean":"2024-01-19T04:17:04.710562+0000","last_became_active":"2024-01-19T04:17:03.709301+0000","last_became_peered":"2024-01-19T04:17:03.709301+0000","last_unstale":"2024-01-19T04:17:04.710562+0000","last_undegraded":"2024-01-19T04:17:04.710562+0000","last_fullsized":"2024-01-19T04:17:04.710562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:26.645481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702350+0000","last_change":"2024-01-19T04:16:51.590515+0000","last_active":"2024-01-19T04:17:03.702350+0000","last_peered":"2024-01-19T04:17:03.702350+0000","last_clean":"2024-01-19T04:17:03.702350+0000","last_became_active":"2024-01-19T04:16:51.590319+0000","last_became_peered":"2024-01-19T04:16:51.590319+0000","last_unstale":"2024-01-19T04:17:03.702350+0000","last_undegraded":"2024-01-19T04:17:03.702350+0000","last_fullsized":"2024-01-19T04:17:03.702350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700291+0000","last_change":"2024-01-19T04:16:50.567937+0000","last_active":"2024-01-19T04:17:03.700291+0000","last_peered":"2024-01-19T04:17:03.700291+0000","last_clean":"2024-01-19T04:17:03.700291+0000","last_became_active":"2024-01-19T04:16:50.567687+0000","last_became_peered":"2024-01-19T04:16:50.567687+0000","last_unstale":"2024-01-19T04:17:03.700291+0000","last_undegraded":"2024-01-19T04:17:03.700291+0000","last_fullsized":"2024-01-19T04:17:03.700291+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:05.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694524+0000","last_change":"2024-01-19T04:17:03.694524+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694524+0000","last_undegraded":"2024-01-19T04:17:03.694524+0000","last_fullsized":"2024-01-19T04:17:03.694524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709614+0000","last_change":"2024-01-19T04:17:03.707107+0000","last_active":"2024-01-19T04:17:03.709614+0000","last_peered":"2024-01-19T04:17:03.709614+0000","last_clean":"2024-01-19T04:17:03.709614+0000","last_became_active":"2024-01-19T04:17:03.706799+0000","last_became_peered":"2024-01-19T04:17:03.706799+0000","last_unstale":"2024-01-19T04:17:03.709614+0000","last_undegraded":"2024-01-19T04:17:03.709614+0000","last_fullsized":"2024-01-19T04:17:03.709614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:37:43.557082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682168+0000","last_change":"2024-01-19T04:16:51.583555+0000","last_active":"2024-01-19T04:17:02.682168+0000","last_peered":"2024-01-19T04:17:02.682168+0000","last_clean":"2024-01-19T04:17:02.682168+0000","last_became_active":"2024-01-19T04:16:51.583278+0000","last_became_peered":"2024-01-19T04:16:51.583278+0000","last_unstale":"2024-01-19T04:17:02.682168+0000","last_undegraded":"2024-01-19T04:17:02.682168+0000","last_fullsized":"2024-01-19T04:17:02.682168+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:10.004835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682292+0000","last_change":"2024-01-19T04:16:50.570692+0000","last_active":"2024-01-19T04:17:02.682292+0000","last_peered":"2024-01-19T04:17:02.682292+0000","last_clean":"2024-01-19T04:17:02.682292+0000","last_became_active":"2024-01-19T04:16:50.570414+0000","last_became_peered":"2024-01-19T04:16:50.570414+0000","last_unstale":"2024-01-19T04:17:02.682292+0000","last_undegraded":"2024-01-19T04:17:02.682292+0000","last_fullsized":"2024-01-19T04:17:02.682292+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:18.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734457+0000","last_change":"2024-01-19T04:17:04.730280+0000","last_active":"2024-01-19T04:17:04.734457+0000","last_peered":"2024-01-19T04:17:04.734457+0000","last_clean":"2024-01-19T04:17:04.734457+0000","last_became_active":"2024-01-19T04:17:04.729904+0000","last_became_peered":"2024-01-19T04:17:04.729904+0000","last_unstale":"2024-01-19T04:17:04.734457+0000","last_undegraded":"2024-01-19T04:17:04.734457+0000","last_fullsized":"2024-01-19T04:17:04.734457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:41.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.711331+0000","last_change":"2024-01-19T04:17:03.708010+0000","last_active":"2024-01-19T04:17:03.711331+0000","last_peered":"2024-01-19T04:17:03.711331+0000","last_clean":"2024-01-19T04:17:03.711331+0000","last_became_active":"2024-01-19T04:17:03.707622+0000","last_became_peered":"2024-01-19T04:17:03.707622+0000","last_unstale":"2024-01-19T04:17:03.711331+0000","last_undegraded":"2024-01-19T04:17:03.711331+0000","last_fullsized":"2024-01-19T04:17:03.711331+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:41:00.904557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695576+0000","last_change":"2024-01-19T04:16:51.586087+0000","last_active":"2024-01-19T04:17:04.695576+0000","last_peered":"2024-01-19T04:17:04.695576+0000","last_clean":"2024-01-19T04:17:04.695576+0000","last_became_active":"2024-01-19T04:16:51.585533+0000","last_became_peered":"2024-01-19T04:16:51.585533+0000","last_unstale":"2024-01-19T04:17:04.695576+0000","last_undegraded":"2024-01-19T04:17:04.695576+0000","last_fullsized":"2024-01-19T04:17:04.695576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:32.942430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693448+0000","last_change":"2024-01-19T04:16:50.570854+0000","last_active":"2024-01-19T04:17:04.693448+0000","last_peered":"2024-01-19T04:17:04.693448+0000","last_clean":"2024-01-19T04:17:04.693448+0000","last_became_active":"2024-01-19T04:16:50.570594+0000","last_became_peered":"2024-01-19T04:16:50.570594+0000","last_unstale":"2024-01-19T04:17:04.693448+0000","last_undegraded":"2024-01-19T04:17:04.693448+0000","last_fullsized":"2024-01-19T04:17:04.693448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:51:58.259661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923676+0000","last_change":"2024-01-19T04:17:04.726240+0000","last_active":"2024-01-19T04:17:06.923676+0000","last_peered":"2024-01-19T04:17:06.923676+0000","last_clean":"2024-01-19T04:17:06.923676+0000","last_became_active":"2024-01-19T04:17:04.725967+0000","last_became_peered":"2024-01-19T04:17:04.725967+0000","last_unstale":"2024-01-19T04:17:06.923676+0000","last_undegraded":"2024-01-19T04:17:06.923676+0000","last_fullsized":"2024-01-19T04:17:06.923676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:12:40.918817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732193+0000","last_change":"2024-01-19T04:17:03.710289+0000","last_active":"2024-01-19T04:17:04.732193+0000","last_peered":"2024-01-19T04:17:04.732193+0000","last_clean":"2024-01-19T04:17:04.732193+0000","last_became_active":"2024-01-19T04:17:03.709448+0000","last_became_peered":"2024-01-19T04:17:03.709448+0000","last_unstale":"2024-01-19T04:17:04.732193+0000","last_undegraded":"2024-01-19T04:17:04.732193+0000","last_fullsized":"2024-01-19T04:17:04.732193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:10.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693344+0000","last_change":"2024-01-19T04:16:51.574512+0000","last_active":"2024-01-19T04:17:04.693344+0000","last_peered":"2024-01-19T04:17:04.693344+0000","last_clean":"2024-01-19T04:17:04.693344+0000","last_became_active":"2024-01-19T04:16:51.574197+0000","last_became_peered":"2024-01-19T04:16:51.574197+0000","last_unstale":"2024-01-19T04:17:04.693344+0000","last_undegraded":"2024-01-19T04:17:04.693344+0000","last_fullsized":"2024-01-19T04:17:04.693344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:44:34.041080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704158+0000","last_change":"2024-01-19T04:16:50.574052+0000","last_active":"2024-01-19T04:17:03.704158+0000","last_peered":"2024-01-19T04:17:03.704158+0000","last_clean":"2024-01-19T04:17:03.704158+0000","last_became_active":"2024-01-19T04:16:50.572944+0000","last_became_peered":"2024-01-19T04:16:50.572944+0000","last_unstale":"2024-01-19T04:17:03.704158+0000","last_undegraded":"2024-01-19T04:17:03.704158+0000","last_fullsized":"2024-01-19T04:17:03.704158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:10:00.992470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701364+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:17:03.701364+0000","last_peered":"2024-01-19T04:17:03.701364+0000","last_clean":"2024-01-19T04:17:03.701364+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:17:03.701364+0000","last_undegraded":"2024-01-19T04:17:03.701364+0000","last_fullsized":"2024-01-19T04:17:03.701364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476766,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":865055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.63200000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476766,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":274527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.45200000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476765,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":275179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628}]},{"osd":1,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98299999999999998,"5min":1.107,"15min":1.107},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.246,"15min":1.246},"last":0.755},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.878},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0820000000000001,"5min":1.708,"15min":1.708},"last":0.71699999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476767,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":277634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.54300000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.381,"15min":1.381},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.095,"15min":1.095},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0940000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.495}]},{"osd":7,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.139,"15min":1.139},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1120000000000001,"5min":1.266,"15min":1.266},"last":0.69699999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":655360,"data_stored":274583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.504},{"interface":"front","average":{"1min":0.439,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54700000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.503},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.63300000000000001,"5min":0.879,"15min":0.879},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95799999999999996,"5min":1.016,"15min":1.016},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.89500000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93000000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98199999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.77300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":638976,"data_stored":267487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.964,"15min":1.964},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.441},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":2.827,"15min":2.827},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60299999999999998,"5min":2.343,"15min":2.343},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.665,"15min":1.665},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.032,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.94199999999999995,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.002,"5min":1.198,"15min":1.198},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.504},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.67500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.04,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.56100000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":861454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.60999999999999999,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60799999999999998,"5min":3.129,"15min":3.129},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.66700000000000004,"15min":0.69999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.72299999999999998,"15min":0.755},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.61299999999999999,"5min":3.633,"15min":3.633},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.59499999999999997,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93200000000000005,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.96299999999999997,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89500000000000002,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.004,"15min":1.052},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0469999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":1.034,"15min":1.0860000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97499999999999998,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.96799999999999997,"15min":1.008},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.85099999999999998,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.876,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75,"5min":1.052,"15min":1.1020000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95099999999999996,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.61499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":289485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54600000000000004,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.77600000000000002,"15min":0.81799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82699999999999996,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.65300000000000002,"15min":0.68300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":5.226,"15min":5.226},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":5.319,"15min":5.319},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.745,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96599999999999997,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.085,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.01,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.133,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.093,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93999999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.165,"5min":5.423,"15min":5.423},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1459999999999999,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:17:09.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:17:09.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 Processor -- start 2024-01-19T04:17:09.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 -- start start 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f39d8151f30 0x7f39d80c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f39d806fda0 0x7f39d80c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d806eb70 0x7f39d806f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d80c5b40 con 0x7f39d8151f30 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d80c3fa0 con 0x7f39d806fda0 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dee00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81551e0 con 0x7f39d806eb70 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f39d8151f30 0x7f39d80c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f39d8151f30 0x7f39d80c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45408/0 (socket says 172.21.15.32:45408) 2024-01-19T04:17:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 -- 172.21.15.32:0/3431454727 learned_addr learned my addr 172.21.15.32:0/3431454727 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dce00640 1 --2- 172.21.15.32:0/3431454727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d806eb70 0x7f39d806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7400640 1 --2- 172.21.15.32:0/3431454727 >> v2:172.21.15.67:3300/0 conn(0x7f39d806fda0 0x7f39d80c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 -- 172.21.15.32:0/3431454727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d806eb70 msgr2=0x7f39d806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 --2- 172.21.15.32:0/3431454727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d806eb70 0x7f39d806f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 -- 172.21.15.32:0/3431454727 >> v2:172.21.15.67:3300/0 conn(0x7f39d806fda0 msgr2=0x7f39d80c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 --2- 172.21.15.32:0/3431454727 >> v2:172.21.15.67:3300/0 conn(0x7f39d806fda0 0x7f39d80c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7e00640 1 -- 172.21.15.32:0/3431454727 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d8155710 con 0x7f39d8151f30 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39dce00640 1 --2- 172.21.15.32:0/3431454727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d806eb70 0x7f39d806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.413+0000 7f39d7400640 1 --2- 172.21.15.32:0/3431454727 >> v2:172.21.15.67:3300/0 conn(0x7f39d806fda0 0x7f39d80c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39d7e00640 1 --2- 172.21.15.32:0/3431454727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d8151f30 0x7f39d80c4430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f39d806da70 tx=0x7f39c801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add15f356240a573 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39d6a00640 1 -- 172.21.15.32:0/3431454727 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80ab600 con 0x7f39d8151f30 2024-01-19T04:17:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39d6a00640 1 -- 172.21.15.32:0/3431454727 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c80a7050 con 0x7f39d8151f30 2024-01-19T04:17:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39d6a00640 1 -- 172.21.15.32:0/3431454727 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80ab980 con 0x7f39d8151f30 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 -- 172.21.15.32:0/3431454727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d8151f30 msgr2=0x7f39d80c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 --2- 172.21.15.32:0/3431454727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d8151f30 0x7f39d80c4430 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f39d806da70 tx=0x7f39c801c470 comp rx=0 tx=0).stop 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 -- 172.21.15.32:0/3431454727 shutdown_connections 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 --2- 172.21.15.32:0/3431454727 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d806eb70 0x7f39d806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 --2- 172.21.15.32:0/3431454727 >> v2:172.21.15.67:3300/0 conn(0x7f39d806fda0 0x7f39d80c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 --2- 172.21.15.32:0/3431454727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d8151f30 0x7f39d80c4430 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 -- 172.21.15.32:0/3431454727 >> 172.21.15.32:0/3431454727 conn(0x7f39d80a9870 msgr2=0x7f39d80a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 -- 172.21.15.32:0/3431454727 shutdown_connections 2024-01-19T04:17:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.417+0000 7f39dee00640 1 -- 172.21.15.32:0/3431454727 wait complete. 2024-01-19T04:17:09.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 Processor -- start 2024-01-19T04:17:09.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 -- start start 2024-01-19T04:17:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d806eb70 0x7f39d81f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d806fda0 0x7f39d8152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d8151f30 0x7f39d80be1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80bd780 con 0x7f39d806eb70 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80bdd20 con 0x7f39d806fda0 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81f13a0 con 0x7f39d8151f30 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d806eb70 0x7f39d81f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d806eb70 0x7f39d81f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45422/0 (socket says 172.21.15.32:45422) 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 -- 172.21.15.32:0/126428484 learned_addr learned my addr 172.21.15.32:0/126428484 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 -- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d8151f30 msgr2=0x7f39d80be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d8151f30 0x7f39d80be1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 -- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d806fda0 msgr2=0x7f39d8152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7400640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d806fda0 0x7f39d8152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d806fda0 0x7f39d8152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 -- 172.21.15.32:0/126428484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c80094d0 con 0x7f39d806eb70 2024-01-19T04:17:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7400640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d806fda0 0x7f39d8152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39d7e00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d806eb70 0x7f39d81f0e60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f39c8000c10 tx=0x7f39c8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39cfe00640 1 -- 172.21.15.32:0/126428484 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80b6640 con 0x7f39d806eb70 2024-01-19T04:17:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39cfe00640 1 -- 172.21.15.32:0/126428484 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c80abe90 con 0x7f39d806eb70 2024-01-19T04:17:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39cfe00640 1 -- 172.21.15.32:0/126428484 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80b69c0 con 0x7f39d806eb70 2024-01-19T04:17:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d81540d0 con 0x7f39d806eb70 2024-01-19T04:17:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.421+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d80bd9b0 con 0x7f39d806eb70 2024-01-19T04:17:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.425+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d80749f0 con 0x7f39d806eb70 2024-01-19T04:17:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.425+0000 7f39cfe00640 1 -- 172.21.15.32:0/126428484 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f39c80b2040 con 0x7f39d806eb70 2024-01-19T04:17:09.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.425+0000 7f39cfe00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f39b0066500 0x7f39b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.425+0000 7f39cfe00640 1 -- 172.21.15.32:0/126428484 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f39c811e350 con 0x7f39d806eb70 2024-01-19T04:17:09.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.425+0000 7f39d7400640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f39b0066500 0x7f39b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.425+0000 7f39d7400640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f39b0066500 0x7f39b00689c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39d8146750 tx=0x7f39c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.429+0000 7f39cfe00640 1 -- 172.21.15.32:0/126428484 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f39c80eb1f0 con 0x7f39d806eb70 2024-01-19T04:17:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.585+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39d80c4eb0 con 0x7f39b0066500 2024-01-19T04:17:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.601+0000 7f39cfe00640 1 -- 172.21.15.32:0/126428484 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525745 (secure 0 0 0) 0x7f39c000c040 con 0x7f39b0066500 2024-01-19T04:17:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:09.613 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f39b0066500 msgr2=0x7f39b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f39b0066500 0x7f39b00689c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39d8146750 tx=0x7f39c0008040 comp rx=0 tx=0).stop 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d806eb70 msgr2=0x7f39d81f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d806eb70 0x7f39d81f0e60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f39c8000c10 tx=0x7f39c8019210 comp rx=0 tx=0).stop 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 shutdown_connections 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f39b0066500 0x7f39b00689c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f39d8151f30 0x7f39d80be1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39d806fda0 0x7f39d8152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 --2- 172.21.15.32:0/126428484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39d806eb70 0x7f39d81f0e60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 >> 172.21.15.32:0/126428484 conn(0x7f39d80a9870 msgr2=0x7f39d80a7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 shutdown_connections 2024-01-19T04:17:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.605+0000 7f39dee00640 1 -- 172.21.15.32:0/126428484 wait complete. 2024-01-19T04:17:09.630 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-01-19T04:17:08.058683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595037,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":241,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":266,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239108,"kb_used_data":6288,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735612,"statfs":{"total":773094113280,"available":772849266688,"internally_reserved":0,"allocated":6438912,"data_stored":3385404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.377855"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924285+0000","last_change":"2024-01-19T04:17:04.707561+0000","last_active":"2024-01-19T04:17:06.924285+0000","last_peered":"2024-01-19T04:17:06.924285+0000","last_clean":"2024-01-19T04:17:06.924285+0000","last_became_active":"2024-01-19T04:17:04.706328+0000","last_became_peered":"2024-01-19T04:17:04.706328+0000","last_unstale":"2024-01-19T04:17:06.924285+0000","last_undegraded":"2024-01-19T04:17:06.924285+0000","last_fullsized":"2024-01-19T04:17:06.924285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:31:51.010861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687854+0000","last_change":"2024-01-19T04:16:51.581477+0000","last_active":"2024-01-19T04:17:02.687854+0000","last_peered":"2024-01-19T04:17:02.687854+0000","last_clean":"2024-01-19T04:17:02.687854+0000","last_became_active":"2024-01-19T04:16:51.580890+0000","last_became_peered":"2024-01-19T04:16:51.580890+0000","last_unstale":"2024-01-19T04:17:02.687854+0000","last_undegraded":"2024-01-19T04:17:02.687854+0000","last_fullsized":"2024-01-19T04:17:02.687854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.849907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693844+0000","last_change":"2024-01-19T04:17:03.693844+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693844+0000","last_undegraded":"2024-01-19T04:17:03.693844+0000","last_fullsized":"2024-01-19T04:17:03.693844+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698045+0000","last_change":"2024-01-19T04:16:51.580129+0000","last_active":"2024-01-19T04:17:04.698045+0000","last_peered":"2024-01-19T04:17:04.698045+0000","last_clean":"2024-01-19T04:17:04.698045+0000","last_became_active":"2024-01-19T04:16:51.579840+0000","last_became_peered":"2024-01-19T04:16:51.579840+0000","last_unstale":"2024-01-19T04:17:04.698045+0000","last_undegraded":"2024-01-19T04:17:04.698045+0000","last_fullsized":"2024-01-19T04:17:04.698045+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:56:54.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724604+0000","last_change":"2024-01-19T04:17:04.716555+0000","last_active":"2024-01-19T04:17:04.724604+0000","last_peered":"2024-01-19T04:17:04.724604+0000","last_clean":"2024-01-19T04:17:04.724604+0000","last_became_active":"2024-01-19T04:17:04.716072+0000","last_became_peered":"2024-01-19T04:17:04.716072+0000","last_unstale":"2024-01-19T04:17:04.724604+0000","last_undegraded":"2024-01-19T04:17:04.724604+0000","last_fullsized":"2024-01-19T04:17:04.724604+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700886+0000","last_change":"2024-01-19T04:16:51.574027+0000","last_active":"2024-01-19T04:17:03.700886+0000","last_peered":"2024-01-19T04:17:03.700886+0000","last_clean":"2024-01-19T04:17:03.700886+0000","last_became_active":"2024-01-19T04:16:51.573756+0000","last_became_peered":"2024-01-19T04:16:51.573756+0000","last_unstale":"2024-01-19T04:17:03.700886+0000","last_undegraded":"2024-01-19T04:17:03.700886+0000","last_fullsized":"2024-01-19T04:17:03.700886+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727171+0000","last_change":"2024-01-19T04:17:04.715758+0000","last_active":"2024-01-19T04:17:04.727171+0000","last_peered":"2024-01-19T04:17:04.727171+0000","last_clean":"2024-01-19T04:17:04.727171+0000","last_became_active":"2024-01-19T04:17:04.715514+0000","last_became_peered":"2024-01-19T04:17:04.715514+0000","last_unstale":"2024-01-19T04:17:04.727171+0000","last_undegraded":"2024-01-19T04:17:04.727171+0000","last_fullsized":"2024-01-19T04:17:04.727171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:04:35.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703432+0000","last_change":"2024-01-19T04:16:51.563134+0000","last_active":"2024-01-19T04:17:03.703432+0000","last_peered":"2024-01-19T04:17:03.703432+0000","last_clean":"2024-01-19T04:17:03.703432+0000","last_became_active":"2024-01-19T04:16:51.562243+0000","last_became_peered":"2024-01-19T04:16:51.562243+0000","last_unstale":"2024-01-19T04:17:03.703432+0000","last_undegraded":"2024-01-19T04:17:03.703432+0000","last_fullsized":"2024-01-19T04:17:03.703432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.722158+0000","last_change":"2024-01-19T04:17:04.717509+0000","last_active":"2024-01-19T04:17:04.722158+0000","last_peered":"2024-01-19T04:17:04.722158+0000","last_clean":"2024-01-19T04:17:04.722158+0000","last_became_active":"2024-01-19T04:17:04.717170+0000","last_became_peered":"2024-01-19T04:17:04.717170+0000","last_unstale":"2024-01-19T04:17:04.722158+0000","last_undegraded":"2024-01-19T04:17:04.722158+0000","last_fullsized":"2024-01-19T04:17:04.722158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687545+0000","last_change":"2024-01-19T04:16:51.568590+0000","last_active":"2024-01-19T04:17:02.687545+0000","last_peered":"2024-01-19T04:17:02.687545+0000","last_clean":"2024-01-19T04:17:02.687545+0000","last_became_active":"2024-01-19T04:16:51.567062+0000","last_became_peered":"2024-01-19T04:16:51.567062+0000","last_unstale":"2024-01-19T04:17:02.687545+0000","last_undegraded":"2024-01-19T04:17:02.687545+0000","last_fullsized":"2024-01-19T04:17:02.687545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:05.611512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733737+0000","last_change":"2024-01-19T04:17:04.727256+0000","last_active":"2024-01-19T04:17:04.733737+0000","last_peered":"2024-01-19T04:17:04.733737+0000","last_clean":"2024-01-19T04:17:04.733737+0000","last_became_active":"2024-01-19T04:17:04.726804+0000","last_became_peered":"2024-01-19T04:17:04.726804+0000","last_unstale":"2024-01-19T04:17:04.733737+0000","last_undegraded":"2024-01-19T04:17:04.733737+0000","last_fullsized":"2024-01-19T04:17:04.733737+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:20.362363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688126+0000","last_change":"2024-01-19T04:16:51.567447+0000","last_active":"2024-01-19T04:17:02.688126+0000","last_peered":"2024-01-19T04:17:02.688126+0000","last_clean":"2024-01-19T04:17:02.688126+0000","last_became_active":"2024-01-19T04:16:51.567187+0000","last_became_peered":"2024-01-19T04:16:51.567187+0000","last_unstale":"2024-01-19T04:17:02.688126+0000","last_undegraded":"2024-01-19T04:17:02.688126+0000","last_fullsized":"2024-01-19T04:17:02.688126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.695464+0000","last_change":"2024-01-19T04:17:03.695464+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.695464+0000","last_undegraded":"2024-01-19T04:17:03.695464+0000","last_fullsized":"2024-01-19T04:17:03.695464+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696299+0000","last_change":"2024-01-19T04:16:51.568350+0000","last_active":"2024-01-19T04:17:03.696299+0000","last_peered":"2024-01-19T04:17:03.696299+0000","last_clean":"2024-01-19T04:17:03.696299+0000","last_became_active":"2024-01-19T04:16:51.568051+0000","last_became_peered":"2024-01-19T04:16:51.568051+0000","last_unstale":"2024-01-19T04:17:03.696299+0000","last_undegraded":"2024-01-19T04:17:03.696299+0000","last_fullsized":"2024-01-19T04:17:03.696299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:31.896945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720368+0000","last_change":"2024-01-19T04:17:04.713905+0000","last_active":"2024-01-19T04:17:04.720368+0000","last_peered":"2024-01-19T04:17:04.720368+0000","last_clean":"2024-01-19T04:17:04.720368+0000","last_became_active":"2024-01-19T04:17:04.713659+0000","last_became_peered":"2024-01-19T04:17:04.713659+0000","last_unstale":"2024-01-19T04:17:04.720368+0000","last_undegraded":"2024-01-19T04:17:04.720368+0000","last_fullsized":"2024-01-19T04:17:04.720368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:44.988632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693196+0000","last_change":"2024-01-19T04:16:51.572672+0000","last_active":"2024-01-19T04:17:04.693196+0000","last_peered":"2024-01-19T04:17:04.693196+0000","last_clean":"2024-01-19T04:17:04.693196+0000","last_became_active":"2024-01-19T04:16:51.572209+0000","last_became_peered":"2024-01-19T04:16:51.572209+0000","last_unstale":"2024-01-19T04:17:04.693196+0000","last_undegraded":"2024-01-19T04:17:04.693196+0000","last_fullsized":"2024-01-19T04:17:04.693196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725169+0000","last_change":"2024-01-19T04:17:04.717847+0000","last_active":"2024-01-19T04:17:04.725169+0000","last_peered":"2024-01-19T04:17:04.725169+0000","last_clean":"2024-01-19T04:17:04.725169+0000","last_became_active":"2024-01-19T04:17:04.715209+0000","last_became_peered":"2024-01-19T04:17:04.715209+0000","last_unstale":"2024-01-19T04:17:04.725169+0000","last_undegraded":"2024-01-19T04:17:04.725169+0000","last_fullsized":"2024-01-19T04:17:04.725169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696371+0000","last_change":"2024-01-19T04:16:51.569401+0000","last_active":"2024-01-19T04:17:03.696371+0000","last_peered":"2024-01-19T04:17:03.696371+0000","last_clean":"2024-01-19T04:17:03.696371+0000","last_became_active":"2024-01-19T04:16:51.569130+0000","last_became_peered":"2024-01-19T04:16:51.569130+0000","last_unstale":"2024-01-19T04:17:03.696371+0000","last_undegraded":"2024-01-19T04:17:03.696371+0000","last_fullsized":"2024-01-19T04:17:03.696371+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:46.968261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693377+0000","last_change":"2024-01-19T04:17:03.693377+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693377+0000","last_undegraded":"2024-01-19T04:17:03.693377+0000","last_fullsized":"2024-01-19T04:17:03.693377+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682678+0000","last_change":"2024-01-19T04:16:51.583971+0000","last_active":"2024-01-19T04:17:02.682678+0000","last_peered":"2024-01-19T04:17:02.682678+0000","last_clean":"2024-01-19T04:17:02.682678+0000","last_became_active":"2024-01-19T04:16:51.583688+0000","last_became_peered":"2024-01-19T04:16:51.583688+0000","last_unstale":"2024-01-19T04:17:02.682678+0000","last_undegraded":"2024-01-19T04:17:02.682678+0000","last_fullsized":"2024-01-19T04:17:02.682678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:51.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697378+0000","last_change":"2024-01-19T04:17:03.697378+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697378+0000","last_undegraded":"2024-01-19T04:17:03.697378+0000","last_fullsized":"2024-01-19T04:17:03.697378+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682624+0000","last_change":"2024-01-19T04:16:51.581824+0000","last_active":"2024-01-19T04:17:02.682624+0000","last_peered":"2024-01-19T04:17:02.682624+0000","last_clean":"2024-01-19T04:17:02.682624+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:02.682624+0000","last_undegraded":"2024-01-19T04:17:02.682624+0000","last_fullsized":"2024-01-19T04:17:02.682624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:26.385285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721556+0000","last_change":"2024-01-19T04:17:04.711461+0000","last_active":"2024-01-19T04:17:04.721556+0000","last_peered":"2024-01-19T04:17:04.721556+0000","last_clean":"2024-01-19T04:17:04.721556+0000","last_became_active":"2024-01-19T04:17:04.711292+0000","last_became_peered":"2024-01-19T04:17:04.711292+0000","last_unstale":"2024-01-19T04:17:04.721556+0000","last_undegraded":"2024-01-19T04:17:04.721556+0000","last_fullsized":"2024-01-19T04:17:04.721556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:54.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703524+0000","last_change":"2024-01-19T04:16:51.575108+0000","last_active":"2024-01-19T04:17:03.703524+0000","last_peered":"2024-01-19T04:17:03.703524+0000","last_clean":"2024-01-19T04:17:03.703524+0000","last_became_active":"2024-01-19T04:16:51.574596+0000","last_became_peered":"2024-01-19T04:16:51.574596+0000","last_unstale":"2024-01-19T04:17:03.703524+0000","last_undegraded":"2024-01-19T04:17:03.703524+0000","last_fullsized":"2024-01-19T04:17:03.703524+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694959+0000","last_change":"2024-01-19T04:17:03.694959+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694959+0000","last_undegraded":"2024-01-19T04:17:03.694959+0000","last_fullsized":"2024-01-19T04:17:03.694959+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704901+0000","last_change":"2024-01-19T04:16:51.579903+0000","last_active":"2024-01-19T04:17:03.704901+0000","last_peered":"2024-01-19T04:17:03.704901+0000","last_clean":"2024-01-19T04:17:03.704901+0000","last_became_active":"2024-01-19T04:16:51.579415+0000","last_became_peered":"2024-01-19T04:16:51.579415+0000","last_unstale":"2024-01-19T04:17:03.704901+0000","last_undegraded":"2024-01-19T04:17:03.704901+0000","last_fullsized":"2024-01-19T04:17:03.704901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:31.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730411+0000","last_change":"2024-01-19T04:17:04.723485+0000","last_active":"2024-01-19T04:17:04.730411+0000","last_peered":"2024-01-19T04:17:04.730411+0000","last_clean":"2024-01-19T04:17:04.730411+0000","last_became_active":"2024-01-19T04:17:04.723202+0000","last_became_peered":"2024-01-19T04:17:04.723202+0000","last_unstale":"2024-01-19T04:17:04.730411+0000","last_undegraded":"2024-01-19T04:17:04.730411+0000","last_fullsized":"2024-01-19T04:17:04.730411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:19.815868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700684+0000","last_change":"2024-01-19T04:16:51.568949+0000","last_active":"2024-01-19T04:17:03.700684+0000","last_peered":"2024-01-19T04:17:03.700684+0000","last_clean":"2024-01-19T04:17:03.700684+0000","last_became_active":"2024-01-19T04:16:51.568682+0000","last_became_peered":"2024-01-19T04:16:51.568682+0000","last_unstale":"2024-01-19T04:17:03.700684+0000","last_undegraded":"2024-01-19T04:17:03.700684+0000","last_fullsized":"2024-01-19T04:17:03.700684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:23.038136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696463+0000","last_change":"2024-01-19T04:17:03.696463+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696463+0000","last_undegraded":"2024-01-19T04:17:03.696463+0000","last_fullsized":"2024-01-19T04:17:03.696463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696464+0000","last_change":"2024-01-19T04:16:51.588950+0000","last_active":"2024-01-19T04:17:03.696464+0000","last_peered":"2024-01-19T04:17:03.696464+0000","last_clean":"2024-01-19T04:17:03.696464+0000","last_became_active":"2024-01-19T04:16:51.577721+0000","last_became_peered":"2024-01-19T04:16:51.577721+0000","last_unstale":"2024-01-19T04:17:03.696464+0000","last_undegraded":"2024-01-19T04:17:03.696464+0000","last_fullsized":"2024-01-19T04:17:03.696464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:30.735073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.695321+0000","last_change":"2024-01-19T04:17:03.695321+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.695321+0000","last_undegraded":"2024-01-19T04:17:03.695321+0000","last_fullsized":"2024-01-19T04:17:03.695321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687590+0000","last_change":"2024-01-19T04:16:51.581861+0000","last_active":"2024-01-19T04:17:02.687590+0000","last_peered":"2024-01-19T04:17:02.687590+0000","last_clean":"2024-01-19T04:17:02.687590+0000","last_became_active":"2024-01-19T04:16:51.581465+0000","last_became_peered":"2024-01-19T04:16:51.581465+0000","last_unstale":"2024-01-19T04:17:02.687590+0000","last_undegraded":"2024-01-19T04:17:02.687590+0000","last_fullsized":"2024-01-19T04:17:02.687590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727994+0000","last_change":"2024-01-19T04:17:04.717627+0000","last_active":"2024-01-19T04:17:04.727994+0000","last_peered":"2024-01-19T04:17:04.727994+0000","last_clean":"2024-01-19T04:17:04.727994+0000","last_became_active":"2024-01-19T04:17:04.717351+0000","last_became_peered":"2024-01-19T04:17:04.717351+0000","last_unstale":"2024-01-19T04:17:04.727994+0000","last_undegraded":"2024-01-19T04:17:04.727994+0000","last_fullsized":"2024-01-19T04:17:04.727994+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:51:25.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698393+0000","last_change":"2024-01-19T04:16:51.589385+0000","last_active":"2024-01-19T04:17:04.698393+0000","last_peered":"2024-01-19T04:17:04.698393+0000","last_clean":"2024-01-19T04:17:04.698393+0000","last_became_active":"2024-01-19T04:16:51.586748+0000","last_became_peered":"2024-01-19T04:16:51.586748+0000","last_unstale":"2024-01-19T04:17:04.698393+0000","last_undegraded":"2024-01-19T04:17:04.698393+0000","last_fullsized":"2024-01-19T04:17:04.698393+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:17:50.471394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696048+0000","last_change":"2024-01-19T04:17:03.696048+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696048+0000","last_undegraded":"2024-01-19T04:17:03.696048+0000","last_fullsized":"2024-01-19T04:17:03.696048+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702978+0000","last_change":"2024-01-19T04:16:51.576164+0000","last_active":"2024-01-19T04:17:03.702978+0000","last_peered":"2024-01-19T04:17:03.702978+0000","last_clean":"2024-01-19T04:17:03.702978+0000","last_became_active":"2024-01-19T04:16:51.575615+0000","last_became_peered":"2024-01-19T04:16:51.575615+0000","last_unstale":"2024-01-19T04:17:03.702978+0000","last_undegraded":"2024-01-19T04:17:03.702978+0000","last_fullsized":"2024-01-19T04:17:03.702978+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696804+0000","last_change":"2024-01-19T04:17:03.696804+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696804+0000","last_undegraded":"2024-01-19T04:17:03.696804+0000","last_fullsized":"2024-01-19T04:17:03.696804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687934+0000","last_change":"2024-01-19T04:16:51.587440+0000","last_active":"2024-01-19T04:17:02.687934+0000","last_peered":"2024-01-19T04:17:02.687934+0000","last_clean":"2024-01-19T04:17:02.687934+0000","last_became_active":"2024-01-19T04:16:51.584713+0000","last_became_peered":"2024-01-19T04:16:51.584713+0000","last_unstale":"2024-01-19T04:17:02.687934+0000","last_undegraded":"2024-01-19T04:17:02.687934+0000","last_fullsized":"2024-01-19T04:17:02.687934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:19.082622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692299+0000","last_change":"2024-01-19T04:17:03.692299+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692299+0000","last_undegraded":"2024-01-19T04:17:03.692299+0000","last_fullsized":"2024-01-19T04:17:03.692299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696903+0000","last_change":"2024-01-19T04:16:51.584822+0000","last_active":"2024-01-19T04:17:04.696903+0000","last_peered":"2024-01-19T04:17:04.696903+0000","last_clean":"2024-01-19T04:17:04.696903+0000","last_became_active":"2024-01-19T04:16:51.584562+0000","last_became_peered":"2024-01-19T04:16:51.584562+0000","last_unstale":"2024-01-19T04:17:04.696903+0000","last_undegraded":"2024-01-19T04:17:04.696903+0000","last_fullsized":"2024-01-19T04:17:04.696903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:42.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724892+0000","last_change":"2024-01-19T04:17:04.716882+0000","last_active":"2024-01-19T04:17:04.724892+0000","last_peered":"2024-01-19T04:17:04.724892+0000","last_clean":"2024-01-19T04:17:04.724892+0000","last_became_active":"2024-01-19T04:17:04.713277+0000","last_became_peered":"2024-01-19T04:17:04.713277+0000","last_unstale":"2024-01-19T04:17:04.724892+0000","last_undegraded":"2024-01-19T04:17:04.724892+0000","last_fullsized":"2024-01-19T04:17:04.724892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702137+0000","last_change":"2024-01-19T04:16:51.577212+0000","last_active":"2024-01-19T04:17:03.702137+0000","last_peered":"2024-01-19T04:17:03.702137+0000","last_clean":"2024-01-19T04:17:03.702137+0000","last_became_active":"2024-01-19T04:16:51.576909+0000","last_became_peered":"2024-01-19T04:16:51.576909+0000","last_unstale":"2024-01-19T04:17:03.702137+0000","last_undegraded":"2024-01-19T04:17:03.702137+0000","last_fullsized":"2024-01-19T04:17:03.702137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732282+0000","last_change":"2024-01-19T04:17:04.730136+0000","last_active":"2024-01-19T04:17:04.732282+0000","last_peered":"2024-01-19T04:17:04.732282+0000","last_clean":"2024-01-19T04:17:04.732282+0000","last_became_active":"2024-01-19T04:17:04.729830+0000","last_became_peered":"2024-01-19T04:17:04.729830+0000","last_unstale":"2024-01-19T04:17:04.732282+0000","last_undegraded":"2024-01-19T04:17:04.732282+0000","last_fullsized":"2024-01-19T04:17:04.732282+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695154+0000","last_change":"2024-01-19T04:16:51.576501+0000","last_active":"2024-01-19T04:17:04.695154+0000","last_peered":"2024-01-19T04:17:04.695154+0000","last_clean":"2024-01-19T04:17:04.695154+0000","last_became_active":"2024-01-19T04:16:51.570654+0000","last_became_peered":"2024-01-19T04:16:51.570654+0000","last_unstale":"2024-01-19T04:17:04.695154+0000","last_undegraded":"2024-01-19T04:17:04.695154+0000","last_fullsized":"2024-01-19T04:17:04.695154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:47:50.383122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.706465+0000","last_change":"2024-01-19T04:17:04.702550+0000","last_active":"2024-01-19T04:17:04.706465+0000","last_peered":"2024-01-19T04:17:04.706465+0000","last_clean":"2024-01-19T04:17:04.706465+0000","last_became_active":"2024-01-19T04:17:04.702274+0000","last_became_peered":"2024-01-19T04:17:04.702274+0000","last_unstale":"2024-01-19T04:17:04.706465+0000","last_undegraded":"2024-01-19T04:17:04.706465+0000","last_fullsized":"2024-01-19T04:17:04.706465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:20.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700083+0000","last_change":"2024-01-19T04:16:51.581241+0000","last_active":"2024-01-19T04:17:03.700083+0000","last_peered":"2024-01-19T04:17:03.700083+0000","last_clean":"2024-01-19T04:17:03.700083+0000","last_became_active":"2024-01-19T04:16:51.580556+0000","last_became_peered":"2024-01-19T04:16:51.580556+0000","last_unstale":"2024-01-19T04:17:03.700083+0000","last_undegraded":"2024-01-19T04:17:03.700083+0000","last_fullsized":"2024-01-19T04:17:03.700083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:08.881391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716708+0000","last_change":"2024-01-19T04:17:04.709401+0000","last_active":"2024-01-19T04:17:04.716708+0000","last_peered":"2024-01-19T04:17:04.716708+0000","last_clean":"2024-01-19T04:17:04.716708+0000","last_became_active":"2024-01-19T04:17:04.709156+0000","last_became_peered":"2024-01-19T04:17:04.709156+0000","last_unstale":"2024-01-19T04:17:04.716708+0000","last_undegraded":"2024-01-19T04:17:04.716708+0000","last_fullsized":"2024-01-19T04:17:04.716708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:21.586290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701902+0000","last_change":"2024-01-19T04:16:51.579937+0000","last_active":"2024-01-19T04:17:03.701902+0000","last_peered":"2024-01-19T04:17:03.701902+0000","last_clean":"2024-01-19T04:17:03.701902+0000","last_became_active":"2024-01-19T04:16:51.579649+0000","last_became_peered":"2024-01-19T04:16:51.579649+0000","last_unstale":"2024-01-19T04:17:03.701902+0000","last_undegraded":"2024-01-19T04:17:03.701902+0000","last_fullsized":"2024-01-19T04:17:03.701902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:34.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924294+0000","last_change":"2024-01-19T04:17:04.712711+0000","last_active":"2024-01-19T04:17:06.924294+0000","last_peered":"2024-01-19T04:17:06.924294+0000","last_clean":"2024-01-19T04:17:06.924294+0000","last_became_active":"2024-01-19T04:17:04.712411+0000","last_became_peered":"2024-01-19T04:17:04.712411+0000","last_unstale":"2024-01-19T04:17:06.924294+0000","last_undegraded":"2024-01-19T04:17:06.924294+0000","last_fullsized":"2024-01-19T04:17:06.924294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:51:57.520659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687942+0000","last_change":"2024-01-19T04:16:51.578912+0000","last_active":"2024-01-19T04:17:02.687942+0000","last_peered":"2024-01-19T04:17:02.687942+0000","last_clean":"2024-01-19T04:17:02.687942+0000","last_became_active":"2024-01-19T04:16:51.578643+0000","last_became_peered":"2024-01-19T04:16:51.578643+0000","last_unstale":"2024-01-19T04:17:02.687942+0000","last_undegraded":"2024-01-19T04:17:02.687942+0000","last_fullsized":"2024-01-19T04:17:02.687942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:23.111411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721525+0000","last_change":"2024-01-19T04:17:04.713886+0000","last_active":"2024-01-19T04:17:04.721525+0000","last_peered":"2024-01-19T04:17:04.721525+0000","last_clean":"2024-01-19T04:17:04.721525+0000","last_became_active":"2024-01-19T04:17:04.713640+0000","last_became_peered":"2024-01-19T04:17:04.713640+0000","last_unstale":"2024-01-19T04:17:04.721525+0000","last_undegraded":"2024-01-19T04:17:04.721525+0000","last_fullsized":"2024-01-19T04:17:04.721525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:32.413236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703417+0000","last_change":"2024-01-19T04:16:51.573193+0000","last_active":"2024-01-19T04:17:03.703417+0000","last_peered":"2024-01-19T04:17:03.703417+0000","last_clean":"2024-01-19T04:17:03.703417+0000","last_became_active":"2024-01-19T04:16:51.572674+0000","last_became_peered":"2024-01-19T04:16:51.572674+0000","last_unstale":"2024-01-19T04:17:03.703417+0000","last_undegraded":"2024-01-19T04:17:03.703417+0000","last_fullsized":"2024-01-19T04:17:03.703417+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710812+0000","last_change":"2024-01-19T04:17:04.707630+0000","last_active":"2024-01-19T04:17:04.710812+0000","last_peered":"2024-01-19T04:17:04.710812+0000","last_clean":"2024-01-19T04:17:04.710812+0000","last_became_active":"2024-01-19T04:17:04.707287+0000","last_became_peered":"2024-01-19T04:17:04.707287+0000","last_unstale":"2024-01-19T04:17:04.710812+0000","last_undegraded":"2024-01-19T04:17:04.710812+0000","last_fullsized":"2024-01-19T04:17:04.710812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:40.576911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689061+0000","last_change":"2024-01-19T04:16:51.586794+0000","last_active":"2024-01-19T04:17:02.689061+0000","last_peered":"2024-01-19T04:17:02.689061+0000","last_clean":"2024-01-19T04:17:02.689061+0000","last_became_active":"2024-01-19T04:16:51.582729+0000","last_became_peered":"2024-01-19T04:16:51.582729+0000","last_unstale":"2024-01-19T04:17:02.689061+0000","last_undegraded":"2024-01-19T04:17:02.689061+0000","last_fullsized":"2024-01-19T04:17:02.689061+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730997+0000","last_change":"2024-01-19T04:17:04.726864+0000","last_active":"2024-01-19T04:17:04.730997+0000","last_peered":"2024-01-19T04:17:04.730997+0000","last_clean":"2024-01-19T04:17:04.730997+0000","last_became_active":"2024-01-19T04:17:04.726530+0000","last_became_peered":"2024-01-19T04:17:04.726530+0000","last_unstale":"2024-01-19T04:17:04.730997+0000","last_undegraded":"2024-01-19T04:17:04.730997+0000","last_fullsized":"2024-01-19T04:17:04.730997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687514+0000","last_change":"2024-01-19T04:16:51.568656+0000","last_active":"2024-01-19T04:17:02.687514+0000","last_peered":"2024-01-19T04:17:02.687514+0000","last_clean":"2024-01-19T04:17:02.687514+0000","last_became_active":"2024-01-19T04:16:51.568371+0000","last_became_peered":"2024-01-19T04:16:51.568371+0000","last_unstale":"2024-01-19T04:17:02.687514+0000","last_undegraded":"2024-01-19T04:17:02.687514+0000","last_fullsized":"2024-01-19T04:17:02.687514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:42.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719165+0000","last_change":"2024-01-19T04:17:04.713110+0000","last_active":"2024-01-19T04:17:04.719165+0000","last_peered":"2024-01-19T04:17:04.719165+0000","last_clean":"2024-01-19T04:17:04.719165+0000","last_became_active":"2024-01-19T04:17:04.712838+0000","last_became_peered":"2024-01-19T04:17:04.712838+0000","last_unstale":"2024-01-19T04:17:04.719165+0000","last_undegraded":"2024-01-19T04:17:04.719165+0000","last_fullsized":"2024-01-19T04:17:04.719165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695186+0000","last_change":"2024-01-19T04:16:51.583324+0000","last_active":"2024-01-19T04:17:04.695186+0000","last_peered":"2024-01-19T04:17:04.695186+0000","last_clean":"2024-01-19T04:17:04.695186+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:04.695186+0000","last_undegraded":"2024-01-19T04:17:04.695186+0000","last_fullsized":"2024-01-19T04:17:04.695186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:01.837432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733715+0000","last_change":"2024-01-19T04:17:04.727034+0000","last_active":"2024-01-19T04:17:04.733715+0000","last_peered":"2024-01-19T04:17:04.733715+0000","last_clean":"2024-01-19T04:17:04.733715+0000","last_became_active":"2024-01-19T04:17:04.726442+0000","last_became_peered":"2024-01-19T04:17:04.726442+0000","last_unstale":"2024-01-19T04:17:04.733715+0000","last_undegraded":"2024-01-19T04:17:04.733715+0000","last_fullsized":"2024-01-19T04:17:04.733715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.021270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700737+0000","last_change":"2024-01-19T04:16:51.577511+0000","last_active":"2024-01-19T04:17:03.700737+0000","last_peered":"2024-01-19T04:17:03.700737+0000","last_clean":"2024-01-19T04:17:03.700737+0000","last_became_active":"2024-01-19T04:16:51.577076+0000","last_became_peered":"2024-01-19T04:16:51.577076+0000","last_unstale":"2024-01-19T04:17:03.700737+0000","last_undegraded":"2024-01-19T04:17:03.700737+0000","last_fullsized":"2024-01-19T04:17:03.700737+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924130+0000","last_change":"2024-01-19T04:17:04.713152+0000","last_active":"2024-01-19T04:17:06.924130+0000","last_peered":"2024-01-19T04:17:06.924130+0000","last_clean":"2024-01-19T04:17:06.924130+0000","last_became_active":"2024-01-19T04:17:04.712882+0000","last_became_peered":"2024-01-19T04:17:04.712882+0000","last_unstale":"2024-01-19T04:17:06.924130+0000","last_undegraded":"2024-01-19T04:17:06.924130+0000","last_fullsized":"2024-01-19T04:17:06.924130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:02.470278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687096+0000","last_change":"2024-01-19T04:16:51.578248+0000","last_active":"2024-01-19T04:17:02.687096+0000","last_peered":"2024-01-19T04:17:02.687096+0000","last_clean":"2024-01-19T04:17:02.687096+0000","last_became_active":"2024-01-19T04:16:51.577983+0000","last_became_peered":"2024-01-19T04:16:51.577983+0000","last_unstale":"2024-01-19T04:17:02.687096+0000","last_undegraded":"2024-01-19T04:17:02.687096+0000","last_fullsized":"2024-01-19T04:17:02.687096+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:14.895654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730956+0000","last_change":"2024-01-19T04:17:04.727249+0000","last_active":"2024-01-19T04:17:04.730956+0000","last_peered":"2024-01-19T04:17:04.730956+0000","last_clean":"2024-01-19T04:17:04.730956+0000","last_became_active":"2024-01-19T04:17:04.726674+0000","last_became_peered":"2024-01-19T04:17:04.726674+0000","last_unstale":"2024-01-19T04:17:04.730956+0000","last_undegraded":"2024-01-19T04:17:04.730956+0000","last_fullsized":"2024-01-19T04:17:04.730956+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688262+0000","last_change":"2024-01-19T04:16:51.586614+0000","last_active":"2024-01-19T04:17:02.688262+0000","last_peered":"2024-01-19T04:17:02.688262+0000","last_clean":"2024-01-19T04:17:02.688262+0000","last_became_active":"2024-01-19T04:16:51.586104+0000","last_became_peered":"2024-01-19T04:16:51.586104+0000","last_unstale":"2024-01-19T04:17:02.688262+0000","last_undegraded":"2024-01-19T04:17:02.688262+0000","last_fullsized":"2024-01-19T04:17:02.688262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734509+0000","last_change":"2024-01-19T04:17:04.730684+0000","last_active":"2024-01-19T04:17:04.734509+0000","last_peered":"2024-01-19T04:17:04.734509+0000","last_clean":"2024-01-19T04:17:04.734509+0000","last_became_active":"2024-01-19T04:17:04.729893+0000","last_became_peered":"2024-01-19T04:17:04.729893+0000","last_unstale":"2024-01-19T04:17:04.734509+0000","last_undegraded":"2024-01-19T04:17:04.734509+0000","last_fullsized":"2024-01-19T04:17:04.734509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:39.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733676+0000","last_change":"2024-01-19T04:17:03.712060+0000","last_active":"2024-01-19T04:17:04.733676+0000","last_peered":"2024-01-19T04:17:04.733676+0000","last_clean":"2024-01-19T04:17:04.733676+0000","last_became_active":"2024-01-19T04:17:03.711745+0000","last_became_peered":"2024-01-19T04:17:03.711745+0000","last_unstale":"2024-01-19T04:17:04.733676+0000","last_undegraded":"2024-01-19T04:17:04.733676+0000","last_fullsized":"2024-01-19T04:17:04.733676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:39.750994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689966+0000","last_change":"2024-01-19T04:16:51.575044+0000","last_active":"2024-01-19T04:17:02.689966+0000","last_peered":"2024-01-19T04:17:02.689966+0000","last_clean":"2024-01-19T04:17:02.689966+0000","last_became_active":"2024-01-19T04:16:51.574674+0000","last_became_peered":"2024-01-19T04:16:51.574674+0000","last_unstale":"2024-01-19T04:17:02.689966+0000","last_undegraded":"2024-01-19T04:17:02.689966+0000","last_fullsized":"2024-01-19T04:17:02.689966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689548+0000","last_change":"2024-01-19T04:16:50.572149+0000","last_active":"2024-01-19T04:17:02.689548+0000","last_peered":"2024-01-19T04:17:02.689548+0000","last_clean":"2024-01-19T04:17:02.689548+0000","last_became_active":"2024-01-19T04:16:50.571648+0000","last_became_peered":"2024-01-19T04:16:50.571648+0000","last_unstale":"2024-01-19T04:17:02.689548+0000","last_undegraded":"2024-01-19T04:17:02.689548+0000","last_fullsized":"2024-01-19T04:17:02.689548+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728547+0000","last_change":"2024-01-19T04:17:04.718498+0000","last_active":"2024-01-19T04:17:04.728547+0000","last_peered":"2024-01-19T04:17:04.728547+0000","last_clean":"2024-01-19T04:17:04.728547+0000","last_became_active":"2024-01-19T04:17:04.717566+0000","last_became_peered":"2024-01-19T04:17:04.717566+0000","last_unstale":"2024-01-19T04:17:04.728547+0000","last_undegraded":"2024-01-19T04:17:04.728547+0000","last_fullsized":"2024-01-19T04:17:04.728547+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732753+0000","last_change":"2024-01-19T04:17:03.709880+0000","last_active":"2024-01-19T04:17:04.732753+0000","last_peered":"2024-01-19T04:17:04.732753+0000","last_clean":"2024-01-19T04:17:04.732753+0000","last_became_active":"2024-01-19T04:17:03.709543+0000","last_became_peered":"2024-01-19T04:17:03.709543+0000","last_unstale":"2024-01-19T04:17:04.732753+0000","last_undegraded":"2024-01-19T04:17:04.732753+0000","last_fullsized":"2024-01-19T04:17:04.732753+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:31:11.411184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682832+0000","last_change":"2024-01-19T04:16:51.590705+0000","last_active":"2024-01-19T04:17:02.682832+0000","last_peered":"2024-01-19T04:17:02.682832+0000","last_clean":"2024-01-19T04:17:02.682832+0000","last_became_active":"2024-01-19T04:16:51.590304+0000","last_became_peered":"2024-01-19T04:16:51.590304+0000","last_unstale":"2024-01-19T04:17:02.682832+0000","last_undegraded":"2024-01-19T04:17:02.682832+0000","last_fullsized":"2024-01-19T04:17:02.682832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:51.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698137+0000","last_change":"2024-01-19T04:16:50.567145+0000","last_active":"2024-01-19T04:17:04.698137+0000","last_peered":"2024-01-19T04:17:04.698137+0000","last_clean":"2024-01-19T04:17:04.698137+0000","last_became_active":"2024-01-19T04:16:50.566844+0000","last_became_peered":"2024-01-19T04:16:50.566844+0000","last_unstale":"2024-01-19T04:17:04.698137+0000","last_undegraded":"2024-01-19T04:17:04.698137+0000","last_fullsized":"2024-01-19T04:17:04.698137+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:07.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735309+0000","last_change":"2024-01-19T04:17:04.732829+0000","last_active":"2024-01-19T04:17:04.735309+0000","last_peered":"2024-01-19T04:17:04.735309+0000","last_clean":"2024-01-19T04:17:04.735309+0000","last_became_active":"2024-01-19T04:17:04.732552+0000","last_became_peered":"2024-01-19T04:17:04.732552+0000","last_unstale":"2024-01-19T04:17:04.735309+0000","last_undegraded":"2024-01-19T04:17:04.735309+0000","last_fullsized":"2024-01-19T04:17:04.735309+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:56:58.089850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727954+0000","last_change":"2024-01-19T04:17:03.713210+0000","last_active":"2024-01-19T04:17:04.727954+0000","last_peered":"2024-01-19T04:17:04.727954+0000","last_clean":"2024-01-19T04:17:04.727954+0000","last_became_active":"2024-01-19T04:17:03.712941+0000","last_became_peered":"2024-01-19T04:17:03.712941+0000","last_unstale":"2024-01-19T04:17:04.727954+0000","last_undegraded":"2024-01-19T04:17:04.727954+0000","last_fullsized":"2024-01-19T04:17:04.727954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688783+0000","last_change":"2024-01-19T04:16:51.573140+0000","last_active":"2024-01-19T04:17:02.688783+0000","last_peered":"2024-01-19T04:17:02.688783+0000","last_clean":"2024-01-19T04:17:02.688783+0000","last_became_active":"2024-01-19T04:16:51.572831+0000","last_became_peered":"2024-01-19T04:16:51.572831+0000","last_unstale":"2024-01-19T04:17:02.688783+0000","last_undegraded":"2024-01-19T04:17:02.688783+0000","last_fullsized":"2024-01-19T04:17:02.688783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689361+0000","last_change":"2024-01-19T04:16:50.563884+0000","last_active":"2024-01-19T04:17:02.689361+0000","last_peered":"2024-01-19T04:17:02.689361+0000","last_clean":"2024-01-19T04:17:02.689361+0000","last_became_active":"2024-01-19T04:16:50.563631+0000","last_became_peered":"2024-01-19T04:16:50.563631+0000","last_unstale":"2024-01-19T04:17:02.689361+0000","last_undegraded":"2024-01-19T04:17:02.689361+0000","last_fullsized":"2024-01-19T04:17:02.689361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696290+0000","last_change":"2024-01-19T04:17:03.696290+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696290+0000","last_undegraded":"2024-01-19T04:17:03.696290+0000","last_fullsized":"2024-01-19T04:17:03.696290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.714476+0000","last_change":"2024-01-19T04:17:03.710296+0000","last_active":"2024-01-19T04:17:03.714476+0000","last_peered":"2024-01-19T04:17:03.714476+0000","last_clean":"2024-01-19T04:17:03.714476+0000","last_became_active":"2024-01-19T04:17:03.710001+0000","last_became_peered":"2024-01-19T04:17:03.710001+0000","last_unstale":"2024-01-19T04:17:03.714476+0000","last_undegraded":"2024-01-19T04:17:03.714476+0000","last_fullsized":"2024-01-19T04:17:03.714476+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689683+0000","last_change":"2024-01-19T04:16:51.574394+0000","last_active":"2024-01-19T04:17:02.689683+0000","last_peered":"2024-01-19T04:17:02.689683+0000","last_clean":"2024-01-19T04:17:02.689683+0000","last_became_active":"2024-01-19T04:16:51.573866+0000","last_became_peered":"2024-01-19T04:16:51.573866+0000","last_unstale":"2024-01-19T04:17:02.689683+0000","last_undegraded":"2024-01-19T04:17:02.689683+0000","last_fullsized":"2024-01-19T04:17:02.689683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703621+0000","last_change":"2024-01-19T04:16:50.571503+0000","last_active":"2024-01-19T04:17:03.703621+0000","last_peered":"2024-01-19T04:17:03.703621+0000","last_clean":"2024-01-19T04:17:03.703621+0000","last_became_active":"2024-01-19T04:16:50.571066+0000","last_became_peered":"2024-01-19T04:16:50.571066+0000","last_unstale":"2024-01-19T04:17:03.703621+0000","last_undegraded":"2024-01-19T04:17:03.703621+0000","last_fullsized":"2024-01-19T04:17:03.703621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694152+0000","last_change":"2024-01-19T04:17:03.694152+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694152+0000","last_undegraded":"2024-01-19T04:17:03.694152+0000","last_fullsized":"2024-01-19T04:17:03.694152+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709771+0000","last_change":"2024-01-19T04:17:03.705700+0000","last_active":"2024-01-19T04:17:03.709771+0000","last_peered":"2024-01-19T04:17:03.709771+0000","last_clean":"2024-01-19T04:17:03.709771+0000","last_became_active":"2024-01-19T04:17:03.705353+0000","last_became_peered":"2024-01-19T04:17:03.705353+0000","last_unstale":"2024-01-19T04:17:03.709771+0000","last_undegraded":"2024-01-19T04:17:03.709771+0000","last_fullsized":"2024-01-19T04:17:03.709771+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:43:27.804228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695238+0000","last_change":"2024-01-19T04:16:51.573659+0000","last_active":"2024-01-19T04:17:04.695238+0000","last_peered":"2024-01-19T04:17:04.695238+0000","last_clean":"2024-01-19T04:17:04.695238+0000","last_became_active":"2024-01-19T04:16:51.570362+0000","last_became_peered":"2024-01-19T04:16:51.570362+0000","last_unstale":"2024-01-19T04:17:04.695238+0000","last_undegraded":"2024-01-19T04:17:04.695238+0000","last_fullsized":"2024-01-19T04:17:04.695238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:12.091637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697876+0000","last_change":"2024-01-19T04:16:50.562830+0000","last_active":"2024-01-19T04:17:03.697876+0000","last_peered":"2024-01-19T04:17:03.697876+0000","last_clean":"2024-01-19T04:17:03.697876+0000","last_became_active":"2024-01-19T04:16:50.562528+0000","last_became_peered":"2024-01-19T04:16:50.562528+0000","last_unstale":"2024-01-19T04:17:03.697876+0000","last_undegraded":"2024-01-19T04:17:03.697876+0000","last_fullsized":"2024-01-19T04:17:03.697876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:03.641474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694545+0000","last_change":"2024-01-19T04:17:03.694545+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694545+0000","last_undegraded":"2024-01-19T04:17:03.694545+0000","last_fullsized":"2024-01-19T04:17:03.694545+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.708375+0000","last_change":"2024-01-19T04:17:03.704020+0000","last_active":"2024-01-19T04:17:03.708375+0000","last_peered":"2024-01-19T04:17:03.708375+0000","last_clean":"2024-01-19T04:17:03.708375+0000","last_became_active":"2024-01-19T04:17:03.703750+0000","last_became_peered":"2024-01-19T04:17:03.703750+0000","last_unstale":"2024-01-19T04:17:03.708375+0000","last_undegraded":"2024-01-19T04:17:03.708375+0000","last_fullsized":"2024-01-19T04:17:03.708375+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:11:42.246097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694990+0000","last_change":"2024-01-19T04:16:51.582274+0000","last_active":"2024-01-19T04:17:04.694990+0000","last_peered":"2024-01-19T04:17:04.694990+0000","last_clean":"2024-01-19T04:17:04.694990+0000","last_became_active":"2024-01-19T04:16:51.581164+0000","last_became_peered":"2024-01-19T04:16:51.581164+0000","last_unstale":"2024-01-19T04:17:04.694990+0000","last_undegraded":"2024-01-19T04:17:04.694990+0000","last_fullsized":"2024-01-19T04:17:04.694990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:47.861123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688218+0000","last_change":"2024-01-19T04:16:50.566550+0000","last_active":"2024-01-19T04:17:02.688218+0000","last_peered":"2024-01-19T04:17:02.688218+0000","last_clean":"2024-01-19T04:17:02.688218+0000","last_became_active":"2024-01-19T04:16:50.566278+0000","last_became_peered":"2024-01-19T04:16:50.566278+0000","last_unstale":"2024-01-19T04:17:02.688218+0000","last_undegraded":"2024-01-19T04:17:02.688218+0000","last_fullsized":"2024-01-19T04:17:02.688218+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711170+0000","last_change":"2024-01-19T04:17:04.707638+0000","last_active":"2024-01-19T04:17:04.711170+0000","last_peered":"2024-01-19T04:17:04.711170+0000","last_clean":"2024-01-19T04:17:04.711170+0000","last_became_active":"2024-01-19T04:17:04.707389+0000","last_became_peered":"2024-01-19T04:17:04.707389+0000","last_unstale":"2024-01-19T04:17:04.711170+0000","last_undegraded":"2024-01-19T04:17:04.711170+0000","last_fullsized":"2024-01-19T04:17:04.711170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725642+0000","last_change":"2024-01-19T04:17:03.713411+0000","last_active":"2024-01-19T04:17:04.725642+0000","last_peered":"2024-01-19T04:17:04.725642+0000","last_clean":"2024-01-19T04:17:04.725642+0000","last_became_active":"2024-01-19T04:17:03.712945+0000","last_became_peered":"2024-01-19T04:17:03.712945+0000","last_unstale":"2024-01-19T04:17:04.725642+0000","last_undegraded":"2024-01-19T04:17:04.725642+0000","last_fullsized":"2024-01-19T04:17:04.725642+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:18.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702014+0000","last_change":"2024-01-19T04:16:51.579590+0000","last_active":"2024-01-19T04:17:03.702014+0000","last_peered":"2024-01-19T04:17:03.702014+0000","last_clean":"2024-01-19T04:17:03.702014+0000","last_became_active":"2024-01-19T04:16:51.579242+0000","last_became_peered":"2024-01-19T04:16:51.579242+0000","last_unstale":"2024-01-19T04:17:03.702014+0000","last_undegraded":"2024-01-19T04:17:03.702014+0000","last_fullsized":"2024-01-19T04:17:03.702014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:09.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699654+0000","last_change":"2024-01-19T04:16:50.568633+0000","last_active":"2024-01-19T04:17:03.699654+0000","last_peered":"2024-01-19T04:17:03.699654+0000","last_clean":"2024-01-19T04:17:03.699654+0000","last_became_active":"2024-01-19T04:16:50.568334+0000","last_became_peered":"2024-01-19T04:16:50.568334+0000","last_unstale":"2024-01-19T04:17:03.699654+0000","last_undegraded":"2024-01-19T04:17:03.699654+0000","last_fullsized":"2024-01-19T04:17:03.699654+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716215+0000","last_change":"2024-01-19T04:17:04.708655+0000","last_active":"2024-01-19T04:17:04.716215+0000","last_peered":"2024-01-19T04:17:04.716215+0000","last_clean":"2024-01-19T04:17:04.716215+0000","last_became_active":"2024-01-19T04:17:04.708364+0000","last_became_peered":"2024-01-19T04:17:04.708364+0000","last_unstale":"2024-01-19T04:17:04.716215+0000","last_undegraded":"2024-01-19T04:17:04.716215+0000","last_fullsized":"2024-01-19T04:17:04.716215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:16.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733062+0000","last_change":"2024-01-19T04:17:03.717810+0000","last_active":"2024-01-19T04:17:04.733062+0000","last_peered":"2024-01-19T04:17:04.733062+0000","last_clean":"2024-01-19T04:17:04.733062+0000","last_became_active":"2024-01-19T04:17:03.717529+0000","last_became_peered":"2024-01-19T04:17:03.717529+0000","last_unstale":"2024-01-19T04:17:04.733062+0000","last_undegraded":"2024-01-19T04:17:04.733062+0000","last_fullsized":"2024-01-19T04:17:04.733062+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:57.511703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695501+0000","last_change":"2024-01-19T04:16:51.585817+0000","last_active":"2024-01-19T04:17:04.695501+0000","last_peered":"2024-01-19T04:17:04.695501+0000","last_clean":"2024-01-19T04:17:04.695501+0000","last_became_active":"2024-01-19T04:16:51.585142+0000","last_became_peered":"2024-01-19T04:16:51.585142+0000","last_unstale":"2024-01-19T04:17:04.695501+0000","last_undegraded":"2024-01-19T04:17:04.695501+0000","last_fullsized":"2024-01-19T04:17:04.695501+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:41.744656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697098+0000","last_change":"2024-01-19T04:16:50.569683+0000","last_active":"2024-01-19T04:17:03.697098+0000","last_peered":"2024-01-19T04:17:03.697098+0000","last_clean":"2024-01-19T04:17:03.697098+0000","last_became_active":"2024-01-19T04:16:50.567925+0000","last_became_peered":"2024-01-19T04:16:50.567925+0000","last_unstale":"2024-01-19T04:17:03.697098+0000","last_undegraded":"2024-01-19T04:17:03.697098+0000","last_fullsized":"2024-01-19T04:17:03.697098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:25.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720559+0000","last_change":"2024-01-19T04:17:04.714330+0000","last_active":"2024-01-19T04:17:04.720559+0000","last_peered":"2024-01-19T04:17:04.720559+0000","last_clean":"2024-01-19T04:17:04.720559+0000","last_became_active":"2024-01-19T04:17:04.712504+0000","last_became_peered":"2024-01-19T04:17:04.712504+0000","last_unstale":"2024-01-19T04:17:04.720559+0000","last_undegraded":"2024-01-19T04:17:04.720559+0000","last_fullsized":"2024-01-19T04:17:04.720559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:20:39.111262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728964+0000","last_change":"2024-01-19T04:17:03.707765+0000","last_active":"2024-01-19T04:17:04.728964+0000","last_peered":"2024-01-19T04:17:04.728964+0000","last_clean":"2024-01-19T04:17:04.728964+0000","last_became_active":"2024-01-19T04:17:03.707463+0000","last_became_peered":"2024-01-19T04:17:03.707463+0000","last_unstale":"2024-01-19T04:17:04.728964+0000","last_undegraded":"2024-01-19T04:17:04.728964+0000","last_fullsized":"2024-01-19T04:17:04.728964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:30.923295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705625+0000","last_change":"2024-01-19T04:16:51.587058+0000","last_active":"2024-01-19T04:17:03.705625+0000","last_peered":"2024-01-19T04:17:03.705625+0000","last_clean":"2024-01-19T04:17:03.705625+0000","last_became_active":"2024-01-19T04:16:51.577162+0000","last_became_peered":"2024-01-19T04:16:51.577162+0000","last_unstale":"2024-01-19T04:17:03.705625+0000","last_undegraded":"2024-01-19T04:17:03.705625+0000","last_fullsized":"2024-01-19T04:17:03.705625+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:59.277518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701457+0000","last_change":"2024-01-19T04:16:50.568525+0000","last_active":"2024-01-19T04:17:03.701457+0000","last_peered":"2024-01-19T04:17:03.701457+0000","last_clean":"2024-01-19T04:17:03.701457+0000","last_became_active":"2024-01-19T04:16:50.568256+0000","last_became_peered":"2024-01-19T04:16:50.568256+0000","last_unstale":"2024-01-19T04:17:03.701457+0000","last_undegraded":"2024-01-19T04:17:03.701457+0000","last_fullsized":"2024-01-19T04:17:03.701457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697444+0000","last_change":"2024-01-19T04:17:03.697444+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697444+0000","last_undegraded":"2024-01-19T04:17:03.697444+0000","last_fullsized":"2024-01-19T04:17:03.697444+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709846+0000","last_change":"2024-01-19T04:17:03.705858+0000","last_active":"2024-01-19T04:17:03.709846+0000","last_peered":"2024-01-19T04:17:03.709846+0000","last_clean":"2024-01-19T04:17:03.709846+0000","last_became_active":"2024-01-19T04:17:03.705336+0000","last_became_peered":"2024-01-19T04:17:03.705336+0000","last_unstale":"2024-01-19T04:17:03.709846+0000","last_undegraded":"2024-01-19T04:17:03.709846+0000","last_fullsized":"2024-01-19T04:17:03.709846+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:13:06.911289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701334+0000","last_change":"2024-01-19T04:16:51.583117+0000","last_active":"2024-01-19T04:17:03.701334+0000","last_peered":"2024-01-19T04:17:03.701334+0000","last_clean":"2024-01-19T04:17:03.701334+0000","last_became_active":"2024-01-19T04:16:51.582850+0000","last_became_peered":"2024-01-19T04:16:51.582850+0000","last_unstale":"2024-01-19T04:17:03.701334+0000","last_undegraded":"2024-01-19T04:17:03.701334+0000","last_fullsized":"2024-01-19T04:17:03.701334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:19.273356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698214+0000","last_change":"2024-01-19T04:16:50.568671+0000","last_active":"2024-01-19T04:17:04.698214+0000","last_peered":"2024-01-19T04:17:04.698214+0000","last_clean":"2024-01-19T04:17:04.698214+0000","last_became_active":"2024-01-19T04:16:50.568385+0000","last_became_peered":"2024-01-19T04:16:50.568385+0000","last_unstale":"2024-01-19T04:17:04.698214+0000","last_undegraded":"2024-01-19T04:17:04.698214+0000","last_fullsized":"2024-01-19T04:17:04.698214+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:51.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.718727+0000","last_change":"2024-01-19T04:17:04.711029+0000","last_active":"2024-01-19T04:17:04.718727+0000","last_peered":"2024-01-19T04:17:04.718727+0000","last_clean":"2024-01-19T04:17:04.718727+0000","last_became_active":"2024-01-19T04:17:04.709892+0000","last_became_peered":"2024-01-19T04:17:04.709892+0000","last_unstale":"2024-01-19T04:17:04.718727+0000","last_undegraded":"2024-01-19T04:17:04.718727+0000","last_fullsized":"2024-01-19T04:17:04.718727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695249+0000","last_change":"2024-01-19T04:17:03.711352+0000","last_active":"2024-01-19T04:17:04.695249+0000","last_peered":"2024-01-19T04:17:04.695249+0000","last_clean":"2024-01-19T04:17:04.695249+0000","last_became_active":"2024-01-19T04:17:03.711063+0000","last_became_peered":"2024-01-19T04:17:03.711063+0000","last_unstale":"2024-01-19T04:17:04.695249+0000","last_undegraded":"2024-01-19T04:17:04.695249+0000","last_fullsized":"2024-01-19T04:17:04.695249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:38.820788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682407+0000","last_change":"2024-01-19T04:16:51.580811+0000","last_active":"2024-01-19T04:17:02.682407+0000","last_peered":"2024-01-19T04:17:02.682407+0000","last_clean":"2024-01-19T04:17:02.682407+0000","last_became_active":"2024-01-19T04:16:51.579990+0000","last_became_peered":"2024-01-19T04:16:51.579990+0000","last_unstale":"2024-01-19T04:17:02.682407+0000","last_undegraded":"2024-01-19T04:17:02.682407+0000","last_fullsized":"2024-01-19T04:17:02.682407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:43:24.773146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701261+0000","last_change":"2024-01-19T04:16:50.569777+0000","last_active":"2024-01-19T04:17:03.701261+0000","last_peered":"2024-01-19T04:17:03.701261+0000","last_clean":"2024-01-19T04:17:03.701261+0000","last_became_active":"2024-01-19T04:16:50.569507+0000","last_became_peered":"2024-01-19T04:16:50.569507+0000","last_unstale":"2024-01-19T04:17:03.701261+0000","last_undegraded":"2024-01-19T04:17:03.701261+0000","last_fullsized":"2024-01-19T04:17:03.701261+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735294+0000","last_change":"2024-01-19T04:17:04.732838+0000","last_active":"2024-01-19T04:17:04.735294+0000","last_peered":"2024-01-19T04:17:04.735294+0000","last_clean":"2024-01-19T04:17:04.735294+0000","last_became_active":"2024-01-19T04:17:04.732579+0000","last_became_peered":"2024-01-19T04:17:04.732579+0000","last_unstale":"2024-01-19T04:17:04.735294+0000","last_undegraded":"2024-01-19T04:17:04.735294+0000","last_fullsized":"2024-01-19T04:17:04.735294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:26.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701729+0000","last_change":"2024-01-19T04:17:03.710016+0000","last_active":"2024-01-19T04:17:04.701729+0000","last_peered":"2024-01-19T04:17:04.701729+0000","last_clean":"2024-01-19T04:17:04.701729+0000","last_became_active":"2024-01-19T04:17:03.709659+0000","last_became_peered":"2024-01-19T04:17:03.709659+0000","last_unstale":"2024-01-19T04:17:04.701729+0000","last_undegraded":"2024-01-19T04:17:04.701729+0000","last_fullsized":"2024-01-19T04:17:04.701729+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:35.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701014+0000","last_change":"2024-01-19T04:16:51.582425+0000","last_active":"2024-01-19T04:17:03.701014+0000","last_peered":"2024-01-19T04:17:03.701014+0000","last_clean":"2024-01-19T04:17:03.701014+0000","last_became_active":"2024-01-19T04:16:51.582136+0000","last_became_peered":"2024-01-19T04:16:51.582136+0000","last_unstale":"2024-01-19T04:17:03.701014+0000","last_undegraded":"2024-01-19T04:17:03.701014+0000","last_fullsized":"2024-01-19T04:17:03.701014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702836+0000","last_change":"2024-01-19T04:16:50.563850+0000","last_active":"2024-01-19T04:17:03.702836+0000","last_peered":"2024-01-19T04:17:03.702836+0000","last_clean":"2024-01-19T04:17:03.702836+0000","last_became_active":"2024-01-19T04:16:50.563492+0000","last_became_peered":"2024-01-19T04:16:50.563492+0000","last_unstale":"2024-01-19T04:17:03.702836+0000","last_undegraded":"2024-01-19T04:17:03.702836+0000","last_fullsized":"2024-01-19T04:17:03.702836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:50.446354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.693984+0000","last_change":"2024-01-19T04:17:03.693984+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.693984+0000","last_undegraded":"2024-01-19T04:17:03.693984+0000","last_fullsized":"2024-01-19T04:17:03.693984+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702056+0000","last_change":"2024-01-19T04:17:03.713104+0000","last_active":"2024-01-19T04:17:04.702056+0000","last_peered":"2024-01-19T04:17:04.702056+0000","last_clean":"2024-01-19T04:17:04.702056+0000","last_became_active":"2024-01-19T04:17:03.712774+0000","last_became_peered":"2024-01-19T04:17:03.712774+0000","last_unstale":"2024-01-19T04:17:04.702056+0000","last_undegraded":"2024-01-19T04:17:04.702056+0000","last_fullsized":"2024-01-19T04:17:04.702056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700474+0000","last_change":"2024-01-19T04:16:51.579099+0000","last_active":"2024-01-19T04:17:03.700474+0000","last_peered":"2024-01-19T04:17:03.700474+0000","last_clean":"2024-01-19T04:17:03.700474+0000","last_became_active":"2024-01-19T04:16:51.578809+0000","last_became_peered":"2024-01-19T04:16:51.578809+0000","last_unstale":"2024-01-19T04:17:03.700474+0000","last_undegraded":"2024-01-19T04:17:03.700474+0000","last_fullsized":"2024-01-19T04:17:03.700474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695098+0000","last_change":"2024-01-19T04:16:50.565530+0000","last_active":"2024-01-19T04:17:04.695098+0000","last_peered":"2024-01-19T04:17:04.695098+0000","last_clean":"2024-01-19T04:17:04.695098+0000","last_became_active":"2024-01-19T04:16:50.565191+0000","last_became_peered":"2024-01-19T04:16:50.565191+0000","last_unstale":"2024-01-19T04:17:04.695098+0000","last_undegraded":"2024-01-19T04:17:04.695098+0000","last_fullsized":"2024-01-19T04:17:04.695098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:14.286352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694155+0000","last_change":"2024-01-19T04:17:03.694155+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694155+0000","last_undegraded":"2024-01-19T04:17:03.694155+0000","last_fullsized":"2024-01-19T04:17:03.694155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.731424+0000","last_change":"2024-01-19T04:17:03.711561+0000","last_active":"2024-01-19T04:17:04.731424+0000","last_peered":"2024-01-19T04:17:04.731424+0000","last_clean":"2024-01-19T04:17:04.731424+0000","last_became_active":"2024-01-19T04:17:03.711261+0000","last_became_peered":"2024-01-19T04:17:03.711261+0000","last_unstale":"2024-01-19T04:17:04.731424+0000","last_undegraded":"2024-01-19T04:17:04.731424+0000","last_fullsized":"2024-01-19T04:17:04.731424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:19.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702246+0000","last_change":"2024-01-19T04:16:51.587155+0000","last_active":"2024-01-19T04:17:03.702246+0000","last_peered":"2024-01-19T04:17:03.702246+0000","last_clean":"2024-01-19T04:17:03.702246+0000","last_became_active":"2024-01-19T04:16:51.584989+0000","last_became_peered":"2024-01-19T04:16:51.584989+0000","last_unstale":"2024-01-19T04:17:03.702246+0000","last_undegraded":"2024-01-19T04:17:03.702246+0000","last_fullsized":"2024-01-19T04:17:03.702246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704254+0000","last_change":"2024-01-19T04:16:50.566824+0000","last_active":"2024-01-19T04:17:03.704254+0000","last_peered":"2024-01-19T04:17:03.704254+0000","last_clean":"2024-01-19T04:17:03.704254+0000","last_became_active":"2024-01-19T04:16:50.566530+0000","last_became_peered":"2024-01-19T04:16:50.566530+0000","last_unstale":"2024-01-19T04:17:03.704254+0000","last_undegraded":"2024-01-19T04:17:03.704254+0000","last_fullsized":"2024-01-19T04:17:03.704254+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727903+0000","last_change":"2024-01-19T04:17:04.718338+0000","last_active":"2024-01-19T04:17:04.727903+0000","last_peered":"2024-01-19T04:17:04.727903+0000","last_clean":"2024-01-19T04:17:04.727903+0000","last_became_active":"2024-01-19T04:17:04.714128+0000","last_became_peered":"2024-01-19T04:17:04.714128+0000","last_unstale":"2024-01-19T04:17:04.727903+0000","last_undegraded":"2024-01-19T04:17:04.727903+0000","last_fullsized":"2024-01-19T04:17:04.727903+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.710312+0000","last_change":"2024-01-19T04:17:03.706653+0000","last_active":"2024-01-19T04:17:03.710312+0000","last_peered":"2024-01-19T04:17:03.710312+0000","last_clean":"2024-01-19T04:17:03.710312+0000","last_became_active":"2024-01-19T04:17:03.706259+0000","last_became_peered":"2024-01-19T04:17:03.706259+0000","last_unstale":"2024-01-19T04:17:03.710312+0000","last_undegraded":"2024-01-19T04:17:03.710312+0000","last_fullsized":"2024-01-19T04:17:03.710312+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:20:49.616898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697004+0000","last_change":"2024-01-19T04:16:51.576072+0000","last_active":"2024-01-19T04:17:03.697004+0000","last_peered":"2024-01-19T04:17:03.697004+0000","last_clean":"2024-01-19T04:17:03.697004+0000","last_became_active":"2024-01-19T04:16:51.575754+0000","last_became_peered":"2024-01-19T04:16:51.575754+0000","last_unstale":"2024-01-19T04:17:03.697004+0000","last_undegraded":"2024-01-19T04:17:03.697004+0000","last_fullsized":"2024-01-19T04:17:03.697004+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:58.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699751+0000","last_change":"2024-01-19T04:16:50.571102+0000","last_active":"2024-01-19T04:17:03.699751+0000","last_peered":"2024-01-19T04:17:03.699751+0000","last_clean":"2024-01-19T04:17:03.699751+0000","last_became_active":"2024-01-19T04:16:50.570597+0000","last_became_peered":"2024-01-19T04:16:50.570597+0000","last_unstale":"2024-01-19T04:17:03.699751+0000","last_undegraded":"2024-01-19T04:17:03.699751+0000","last_fullsized":"2024-01-19T04:17:03.699751+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.717191+0000","last_change":"2024-01-19T04:17:04.710314+0000","last_active":"2024-01-19T04:17:04.717191+0000","last_peered":"2024-01-19T04:17:04.717191+0000","last_clean":"2024-01-19T04:17:04.717191+0000","last_became_active":"2024-01-19T04:17:04.709915+0000","last_became_peered":"2024-01-19T04:17:04.709915+0000","last_unstale":"2024-01-19T04:17:04.717191+0000","last_undegraded":"2024-01-19T04:17:04.717191+0000","last_fullsized":"2024-01-19T04:17:04.717191+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698318+0000","last_change":"2024-01-19T04:17:03.709688+0000","last_active":"2024-01-19T04:17:04.698318+0000","last_peered":"2024-01-19T04:17:04.698318+0000","last_clean":"2024-01-19T04:17:04.698318+0000","last_became_active":"2024-01-19T04:17:03.709392+0000","last_became_peered":"2024-01-19T04:17:03.709392+0000","last_unstale":"2024-01-19T04:17:04.698318+0000","last_undegraded":"2024-01-19T04:17:04.698318+0000","last_fullsized":"2024-01-19T04:17:04.698318+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:44.030611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700170+0000","last_change":"2024-01-19T04:16:51.581476+0000","last_active":"2024-01-19T04:17:03.700170+0000","last_peered":"2024-01-19T04:17:03.700170+0000","last_clean":"2024-01-19T04:17:03.700170+0000","last_became_active":"2024-01-19T04:16:51.580937+0000","last_became_peered":"2024-01-19T04:16:51.580937+0000","last_unstale":"2024-01-19T04:17:03.700170+0000","last_undegraded":"2024-01-19T04:17:03.700170+0000","last_fullsized":"2024-01-19T04:17:03.700170+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701243+0000","last_change":"2024-01-19T04:16:50.572829+0000","last_active":"2024-01-19T04:17:03.701243+0000","last_peered":"2024-01-19T04:17:03.701243+0000","last_clean":"2024-01-19T04:17:03.701243+0000","last_became_active":"2024-01-19T04:16:50.572538+0000","last_became_peered":"2024-01-19T04:16:50.572538+0000","last_unstale":"2024-01-19T04:17:03.701243+0000","last_undegraded":"2024-01-19T04:17:03.701243+0000","last_fullsized":"2024-01-19T04:17:03.701243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692735+0000","last_change":"2024-01-19T04:17:03.692735+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692735+0000","last_undegraded":"2024-01-19T04:17:03.692735+0000","last_fullsized":"2024-01-19T04:17:03.692735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733767+0000","last_change":"2024-01-19T04:17:03.710856+0000","last_active":"2024-01-19T04:17:04.733767+0000","last_peered":"2024-01-19T04:17:04.733767+0000","last_clean":"2024-01-19T04:17:04.733767+0000","last_became_active":"2024-01-19T04:17:03.709025+0000","last_became_peered":"2024-01-19T04:17:03.709025+0000","last_unstale":"2024-01-19T04:17:04.733767+0000","last_undegraded":"2024-01-19T04:17:04.733767+0000","last_fullsized":"2024-01-19T04:17:04.733767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:59.101927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702987+0000","last_change":"2024-01-19T04:16:51.588191+0000","last_active":"2024-01-19T04:17:03.702987+0000","last_peered":"2024-01-19T04:17:03.702987+0000","last_clean":"2024-01-19T04:17:03.702987+0000","last_became_active":"2024-01-19T04:16:51.587927+0000","last_became_peered":"2024-01-19T04:16:51.587927+0000","last_unstale":"2024-01-19T04:17:03.702987+0000","last_undegraded":"2024-01-19T04:17:03.702987+0000","last_fullsized":"2024-01-19T04:17:03.702987+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698421+0000","last_change":"2024-01-19T04:16:50.569273+0000","last_active":"2024-01-19T04:17:04.698421+0000","last_peered":"2024-01-19T04:17:04.698421+0000","last_clean":"2024-01-19T04:17:04.698421+0000","last_became_active":"2024-01-19T04:16:50.569009+0000","last_became_peered":"2024-01-19T04:16:50.569009+0000","last_unstale":"2024-01-19T04:17:04.698421+0000","last_undegraded":"2024-01-19T04:17:04.698421+0000","last_fullsized":"2024-01-19T04:17:04.698421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:59:10.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.696863+0000","last_change":"2024-01-19T04:17:03.696863+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.696863+0000","last_undegraded":"2024-01-19T04:17:03.696863+0000","last_fullsized":"2024-01-19T04:17:03.696863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.703496+0000","last_change":"2024-01-19T04:17:03.711904+0000","last_active":"2024-01-19T04:17:04.703496+0000","last_peered":"2024-01-19T04:17:04.703496+0000","last_clean":"2024-01-19T04:17:04.703496+0000","last_became_active":"2024-01-19T04:17:03.711592+0000","last_became_peered":"2024-01-19T04:17:03.711592+0000","last_unstale":"2024-01-19T04:17:04.703496+0000","last_undegraded":"2024-01-19T04:17:04.703496+0000","last_fullsized":"2024-01-19T04:17:04.703496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704488+0000","last_change":"2024-01-19T04:16:51.578342+0000","last_active":"2024-01-19T04:17:03.704488+0000","last_peered":"2024-01-19T04:17:03.704488+0000","last_clean":"2024-01-19T04:17:03.704488+0000","last_became_active":"2024-01-19T04:16:51.575581+0000","last_became_peered":"2024-01-19T04:16:51.575581+0000","last_unstale":"2024-01-19T04:17:03.704488+0000","last_undegraded":"2024-01-19T04:17:03.704488+0000","last_fullsized":"2024-01-19T04:17:03.704488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.690077+0000","last_change":"2024-01-19T04:16:50.572020+0000","last_active":"2024-01-19T04:17:02.690077+0000","last_peered":"2024-01-19T04:17:02.690077+0000","last_clean":"2024-01-19T04:17:02.690077+0000","last_became_active":"2024-01-19T04:16:50.571617+0000","last_became_peered":"2024-01-19T04:16:50.571617+0000","last_unstale":"2024-01-19T04:17:02.690077+0000","last_undegraded":"2024-01-19T04:17:02.690077+0000","last_fullsized":"2024-01-19T04:17:02.690077+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721580+0000","last_change":"2024-01-19T04:17:04.715751+0000","last_active":"2024-01-19T04:17:04.721580+0000","last_peered":"2024-01-19T04:17:04.721580+0000","last_clean":"2024-01-19T04:17:04.721580+0000","last_became_active":"2024-01-19T04:17:04.715489+0000","last_became_peered":"2024-01-19T04:17:04.715489+0000","last_unstale":"2024-01-19T04:17:04.721580+0000","last_undegraded":"2024-01-19T04:17:04.721580+0000","last_fullsized":"2024-01-19T04:17:04.721580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:47.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734310+0000","last_change":"2024-01-19T04:17:03.715436+0000","last_active":"2024-01-19T04:17:04.734310+0000","last_peered":"2024-01-19T04:17:04.734310+0000","last_clean":"2024-01-19T04:17:04.734310+0000","last_became_active":"2024-01-19T04:17:03.715157+0000","last_became_peered":"2024-01-19T04:17:03.715157+0000","last_unstale":"2024-01-19T04:17:04.734310+0000","last_undegraded":"2024-01-19T04:17:04.734310+0000","last_fullsized":"2024-01-19T04:17:04.734310+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:49.326125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696979+0000","last_change":"2024-01-19T04:16:51.575079+0000","last_active":"2024-01-19T04:17:04.696979+0000","last_peered":"2024-01-19T04:17:04.696979+0000","last_clean":"2024-01-19T04:17:04.696979+0000","last_became_active":"2024-01-19T04:16:51.574248+0000","last_became_peered":"2024-01-19T04:16:51.574248+0000","last_unstale":"2024-01-19T04:17:04.696979+0000","last_undegraded":"2024-01-19T04:17:04.696979+0000","last_fullsized":"2024-01-19T04:17:04.696979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:17.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702750+0000","last_change":"2024-01-19T04:16:50.571109+0000","last_active":"2024-01-19T04:17:03.702750+0000","last_peered":"2024-01-19T04:17:03.702750+0000","last_clean":"2024-01-19T04:17:03.702750+0000","last_became_active":"2024-01-19T04:16:50.570839+0000","last_became_peered":"2024-01-19T04:16:50.570839+0000","last_unstale":"2024-01-19T04:17:03.702750+0000","last_undegraded":"2024-01-19T04:17:03.702750+0000","last_fullsized":"2024-01-19T04:17:03.702750+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:22.030862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724584+0000","last_change":"2024-01-19T04:17:04.716334+0000","last_active":"2024-01-19T04:17:04.724584+0000","last_peered":"2024-01-19T04:17:04.724584+0000","last_clean":"2024-01-19T04:17:04.724584+0000","last_became_active":"2024-01-19T04:17:04.715736+0000","last_became_peered":"2024-01-19T04:17:04.715736+0000","last_unstale":"2024-01-19T04:17:04.724584+0000","last_undegraded":"2024-01-19T04:17:04.724584+0000","last_fullsized":"2024-01-19T04:17:04.724584+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734211+0000","last_change":"2024-01-19T04:17:03.717168+0000","last_active":"2024-01-19T04:17:04.734211+0000","last_peered":"2024-01-19T04:17:04.734211+0000","last_clean":"2024-01-19T04:17:04.734211+0000","last_became_active":"2024-01-19T04:17:03.716597+0000","last_became_peered":"2024-01-19T04:17:03.716597+0000","last_unstale":"2024-01-19T04:17:04.734211+0000","last_undegraded":"2024-01-19T04:17:04.734211+0000","last_fullsized":"2024-01-19T04:17:04.734211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:40.365611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701131+0000","last_change":"2024-01-19T04:16:51.582601+0000","last_active":"2024-01-19T04:17:03.701131+0000","last_peered":"2024-01-19T04:17:03.701131+0000","last_clean":"2024-01-19T04:17:03.701131+0000","last_became_active":"2024-01-19T04:16:51.582294+0000","last_became_peered":"2024-01-19T04:16:51.582294+0000","last_unstale":"2024-01-19T04:17:03.701131+0000","last_undegraded":"2024-01-19T04:17:03.701131+0000","last_fullsized":"2024-01-19T04:17:03.701131+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689034+0000","last_change":"2024-01-19T04:16:50.568331+0000","last_active":"2024-01-19T04:17:02.689034+0000","last_peered":"2024-01-19T04:17:02.689034+0000","last_clean":"2024-01-19T04:17:02.689034+0000","last_became_active":"2024-01-19T04:16:50.567695+0000","last_became_peered":"2024-01-19T04:16:50.567695+0000","last_unstale":"2024-01-19T04:17:02.689034+0000","last_undegraded":"2024-01-19T04:17:02.689034+0000","last_fullsized":"2024-01-19T04:17:02.689034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923571+0000","last_change":"2024-01-19T04:17:04.722284+0000","last_active":"2024-01-19T04:17:06.923571+0000","last_peered":"2024-01-19T04:17:06.923571+0000","last_clean":"2024-01-19T04:17:06.923571+0000","last_became_active":"2024-01-19T04:17:04.722004+0000","last_became_peered":"2024-01-19T04:17:04.722004+0000","last_unstale":"2024-01-19T04:17:06.923571+0000","last_undegraded":"2024-01-19T04:17:06.923571+0000","last_fullsized":"2024-01-19T04:17:06.923571+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:15.275480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701951+0000","last_change":"2024-01-19T04:17:03.712871+0000","last_active":"2024-01-19T04:17:04.701951+0000","last_peered":"2024-01-19T04:17:04.701951+0000","last_clean":"2024-01-19T04:17:04.701951+0000","last_became_active":"2024-01-19T04:17:03.710684+0000","last_became_peered":"2024-01-19T04:17:03.710684+0000","last_unstale":"2024-01-19T04:17:04.701951+0000","last_undegraded":"2024-01-19T04:17:04.701951+0000","last_fullsized":"2024-01-19T04:17:04.701951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700567+0000","last_change":"2024-01-19T04:16:51.579139+0000","last_active":"2024-01-19T04:17:03.700567+0000","last_peered":"2024-01-19T04:17:03.700567+0000","last_clean":"2024-01-19T04:17:03.700567+0000","last_became_active":"2024-01-19T04:16:51.578820+0000","last_became_peered":"2024-01-19T04:16:51.578820+0000","last_unstale":"2024-01-19T04:17:03.700567+0000","last_undegraded":"2024-01-19T04:17:03.700567+0000","last_fullsized":"2024-01-19T04:17:03.700567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695278+0000","last_change":"2024-01-19T04:16:50.563572+0000","last_active":"2024-01-19T04:17:04.695278+0000","last_peered":"2024-01-19T04:17:04.695278+0000","last_clean":"2024-01-19T04:17:04.695278+0000","last_became_active":"2024-01-19T04:16:50.561160+0000","last_became_peered":"2024-01-19T04:16:50.561160+0000","last_unstale":"2024-01-19T04:17:04.695278+0000","last_undegraded":"2024-01-19T04:17:04.695278+0000","last_fullsized":"2024-01-19T04:17:04.695278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:40:18.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923752+0000","last_change":"2024-01-19T04:17:04.722269+0000","last_active":"2024-01-19T04:17:06.923752+0000","last_peered":"2024-01-19T04:17:06.923752+0000","last_clean":"2024-01-19T04:17:06.923752+0000","last_became_active":"2024-01-19T04:17:04.722003+0000","last_became_peered":"2024-01-19T04:17:04.722003+0000","last_unstale":"2024-01-19T04:17:06.923752+0000","last_undegraded":"2024-01-19T04:17:06.923752+0000","last_fullsized":"2024-01-19T04:17:06.923752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:53.689915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709368+0000","last_change":"2024-01-19T04:17:03.703625+0000","last_active":"2024-01-19T04:17:03.709368+0000","last_peered":"2024-01-19T04:17:03.709368+0000","last_clean":"2024-01-19T04:17:03.709368+0000","last_became_active":"2024-01-19T04:17:03.702960+0000","last_became_peered":"2024-01-19T04:17:03.702960+0000","last_unstale":"2024-01-19T04:17:03.709368+0000","last_undegraded":"2024-01-19T04:17:03.709368+0000","last_fullsized":"2024-01-19T04:17:03.709368+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:58:33.792427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.688531+0000","last_change":"2024-01-19T04:16:51.581877+0000","last_active":"2024-01-19T04:17:02.688531+0000","last_peered":"2024-01-19T04:17:02.688531+0000","last_clean":"2024-01-19T04:17:02.688531+0000","last_became_active":"2024-01-19T04:16:51.580713+0000","last_became_peered":"2024-01-19T04:16:51.580713+0000","last_unstale":"2024-01-19T04:17:02.688531+0000","last_undegraded":"2024-01-19T04:17:02.688531+0000","last_fullsized":"2024-01-19T04:17:02.688531+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682309+0000","last_change":"2024-01-19T04:16:50.572947+0000","last_active":"2024-01-19T04:17:02.682309+0000","last_peered":"2024-01-19T04:17:02.682309+0000","last_clean":"2024-01-19T04:17:02.682309+0000","last_became_active":"2024-01-19T04:16:50.572679+0000","last_became_peered":"2024-01-19T04:16:50.572679+0000","last_unstale":"2024-01-19T04:17:02.682309+0000","last_undegraded":"2024-01-19T04:17:02.682309+0000","last_fullsized":"2024-01-19T04:17:02.682309+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:41.006603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923756+0000","last_change":"2024-01-19T04:17:04.715568+0000","last_active":"2024-01-19T04:17:06.923756+0000","last_peered":"2024-01-19T04:17:06.923756+0000","last_clean":"2024-01-19T04:17:06.923756+0000","last_became_active":"2024-01-19T04:17:04.715214+0000","last_became_peered":"2024-01-19T04:17:04.715214+0000","last_unstale":"2024-01-19T04:17:06.923756+0000","last_undegraded":"2024-01-19T04:17:06.923756+0000","last_fullsized":"2024-01-19T04:17:06.923756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:15.118406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711926+0000","last_change":"2024-01-19T04:17:03.716279+0000","last_active":"2024-01-19T04:17:04.711926+0000","last_peered":"2024-01-19T04:17:04.711926+0000","last_clean":"2024-01-19T04:17:04.711926+0000","last_became_active":"2024-01-19T04:17:03.715875+0000","last_became_peered":"2024-01-19T04:17:03.715875+0000","last_unstale":"2024-01-19T04:17:04.711926+0000","last_undegraded":"2024-01-19T04:17:04.711926+0000","last_fullsized":"2024-01-19T04:17:04.711926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:55.411637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.687924+0000","last_change":"2024-01-19T04:16:51.575958+0000","last_active":"2024-01-19T04:17:02.687924+0000","last_peered":"2024-01-19T04:17:02.687924+0000","last_clean":"2024-01-19T04:17:02.687924+0000","last_became_active":"2024-01-19T04:16:51.575635+0000","last_became_peered":"2024-01-19T04:16:51.575635+0000","last_unstale":"2024-01-19T04:17:02.687924+0000","last_undegraded":"2024-01-19T04:17:02.687924+0000","last_fullsized":"2024-01-19T04:17:02.687924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697752+0000","last_change":"2024-01-19T04:16:50.568547+0000","last_active":"2024-01-19T04:17:03.697752+0000","last_peered":"2024-01-19T04:17:03.697752+0000","last_clean":"2024-01-19T04:17:03.697752+0000","last_became_active":"2024-01-19T04:16:50.568248+0000","last_became_peered":"2024-01-19T04:16:50.568248+0000","last_unstale":"2024-01-19T04:17:03.697752+0000","last_undegraded":"2024-01-19T04:17:03.697752+0000","last_fullsized":"2024-01-19T04:17:03.697752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:45.960987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734018+0000","last_change":"2024-01-19T04:17:04.732413+0000","last_active":"2024-01-19T04:17:04.734018+0000","last_peered":"2024-01-19T04:17:04.734018+0000","last_clean":"2024-01-19T04:17:04.734018+0000","last_became_active":"2024-01-19T04:17:04.732057+0000","last_became_peered":"2024-01-19T04:17:04.732057+0000","last_unstale":"2024-01-19T04:17:04.734018+0000","last_undegraded":"2024-01-19T04:17:04.734018+0000","last_fullsized":"2024-01-19T04:17:04.734018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:29:59.877276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.711992+0000","last_change":"2024-01-19T04:17:03.711094+0000","last_active":"2024-01-19T04:17:03.711992+0000","last_peered":"2024-01-19T04:17:03.711992+0000","last_clean":"2024-01-19T04:17:03.711992+0000","last_became_active":"2024-01-19T04:17:03.710806+0000","last_became_peered":"2024-01-19T04:17:03.710806+0000","last_unstale":"2024-01-19T04:17:03.711992+0000","last_undegraded":"2024-01-19T04:17:03.711992+0000","last_fullsized":"2024-01-19T04:17:03.711992+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:45.583850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703526+0000","last_change":"2024-01-19T04:16:51.562371+0000","last_active":"2024-01-19T04:17:03.703526+0000","last_peered":"2024-01-19T04:17:03.703526+0000","last_clean":"2024-01-19T04:17:03.703526+0000","last_became_active":"2024-01-19T04:16:51.562057+0000","last_became_peered":"2024-01-19T04:16:51.562057+0000","last_unstale":"2024-01-19T04:17:03.703526+0000","last_undegraded":"2024-01-19T04:17:03.703526+0000","last_fullsized":"2024-01-19T04:17:03.703526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682907+0000","last_change":"2024-01-19T04:16:50.575311+0000","last_active":"2024-01-19T04:17:02.682907+0000","last_peered":"2024-01-19T04:17:02.682907+0000","last_clean":"2024-01-19T04:17:02.682907+0000","last_became_active":"2024-01-19T04:16:50.574897+0000","last_became_peered":"2024-01-19T04:16:50.574897+0000","last_unstale":"2024-01-19T04:17:02.682907+0000","last_undegraded":"2024-01-19T04:17:02.682907+0000","last_fullsized":"2024-01-19T04:17:02.682907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725149+0000","last_change":"2024-01-19T04:17:04.717650+0000","last_active":"2024-01-19T04:17:04.725149+0000","last_peered":"2024-01-19T04:17:04.725149+0000","last_clean":"2024-01-19T04:17:04.725149+0000","last_became_active":"2024-01-19T04:17:04.713401+0000","last_became_peered":"2024-01-19T04:17:04.713401+0000","last_unstale":"2024-01-19T04:17:04.725149+0000","last_undegraded":"2024-01-19T04:17:04.725149+0000","last_fullsized":"2024-01-19T04:17:04.725149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.714569+0000","last_change":"2024-01-19T04:17:03.711629+0000","last_active":"2024-01-19T04:17:03.714569+0000","last_peered":"2024-01-19T04:17:03.714569+0000","last_clean":"2024-01-19T04:17:03.714569+0000","last_became_active":"2024-01-19T04:17:03.711338+0000","last_became_peered":"2024-01-19T04:17:03.711338+0000","last_unstale":"2024-01-19T04:17:03.714569+0000","last_undegraded":"2024-01-19T04:17:03.714569+0000","last_fullsized":"2024-01-19T04:17:03.714569+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704626+0000","last_change":"2024-01-19T04:16:51.585936+0000","last_active":"2024-01-19T04:17:03.704626+0000","last_peered":"2024-01-19T04:17:03.704626+0000","last_clean":"2024-01-19T04:17:03.704626+0000","last_became_active":"2024-01-19T04:16:51.585682+0000","last_became_peered":"2024-01-19T04:16:51.585682+0000","last_unstale":"2024-01-19T04:17:03.704626+0000","last_undegraded":"2024-01-19T04:17:03.704626+0000","last_fullsized":"2024-01-19T04:17:03.704626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.690071+0000","last_change":"2024-01-19T04:16:50.567862+0000","last_active":"2024-01-19T04:17:02.690071+0000","last_peered":"2024-01-19T04:17:02.690071+0000","last_clean":"2024-01-19T04:17:02.690071+0000","last_became_active":"2024-01-19T04:16:50.567482+0000","last_became_peered":"2024-01-19T04:16:50.567482+0000","last_unstale":"2024-01-19T04:17:02.690071+0000","last_undegraded":"2024-01-19T04:17:02.690071+0000","last_fullsized":"2024-01-19T04:17:02.690071+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.697577+0000","last_change":"2024-01-19T04:17:03.697577+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.697577+0000","last_undegraded":"2024-01-19T04:17:03.697577+0000","last_fullsized":"2024-01-19T04:17:03.697577+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734217+0000","last_change":"2024-01-19T04:17:03.715400+0000","last_active":"2024-01-19T04:17:04.734217+0000","last_peered":"2024-01-19T04:17:04.734217+0000","last_clean":"2024-01-19T04:17:04.734217+0000","last_became_active":"2024-01-19T04:17:03.714763+0000","last_became_peered":"2024-01-19T04:17:03.714763+0000","last_unstale":"2024-01-19T04:17:04.734217+0000","last_undegraded":"2024-01-19T04:17:04.734217+0000","last_fullsized":"2024-01-19T04:17:04.734217+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:42.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682466+0000","last_change":"2024-01-19T04:16:51.581054+0000","last_active":"2024-01-19T04:17:02.682466+0000","last_peered":"2024-01-19T04:17:02.682466+0000","last_clean":"2024-01-19T04:17:02.682466+0000","last_became_active":"2024-01-19T04:16:51.580564+0000","last_became_peered":"2024-01-19T04:16:51.580564+0000","last_unstale":"2024-01-19T04:17:02.682466+0000","last_undegraded":"2024-01-19T04:17:02.682466+0000","last_fullsized":"2024-01-19T04:17:02.682466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.841231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705816+0000","last_change":"2024-01-19T04:16:50.565555+0000","last_active":"2024-01-19T04:17:03.705816+0000","last_peered":"2024-01-19T04:17:03.705816+0000","last_clean":"2024-01-19T04:17:03.705816+0000","last_became_active":"2024-01-19T04:16:50.565273+0000","last_became_peered":"2024-01-19T04:16:50.565273+0000","last_unstale":"2024-01-19T04:17:03.705816+0000","last_undegraded":"2024-01-19T04:17:03.705816+0000","last_fullsized":"2024-01-19T04:17:03.705816+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719993+0000","last_change":"2024-01-19T04:17:04.716116+0000","last_active":"2024-01-19T04:17:04.719993+0000","last_peered":"2024-01-19T04:17:04.719993+0000","last_clean":"2024-01-19T04:17:04.719993+0000","last_became_active":"2024-01-19T04:17:04.715861+0000","last_became_peered":"2024-01-19T04:17:04.715861+0000","last_unstale":"2024-01-19T04:17:04.719993+0000","last_undegraded":"2024-01-19T04:17:04.719993+0000","last_fullsized":"2024-01-19T04:17:04.719993+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704490+0000","last_change":"2024-01-19T04:17:03.713437+0000","last_active":"2024-01-19T04:17:04.704490+0000","last_peered":"2024-01-19T04:17:04.704490+0000","last_clean":"2024-01-19T04:17:04.704490+0000","last_became_active":"2024-01-19T04:17:03.713127+0000","last_became_peered":"2024-01-19T04:17:03.713127+0000","last_unstale":"2024-01-19T04:17:04.704490+0000","last_undegraded":"2024-01-19T04:17:04.704490+0000","last_fullsized":"2024-01-19T04:17:04.704490+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.689270+0000","last_change":"2024-01-19T04:16:51.574116+0000","last_active":"2024-01-19T04:17:02.689270+0000","last_peered":"2024-01-19T04:17:02.689270+0000","last_clean":"2024-01-19T04:17:02.689270+0000","last_became_active":"2024-01-19T04:16:51.573543+0000","last_became_peered":"2024-01-19T04:16:51.573543+0000","last_unstale":"2024-01-19T04:17:02.689270+0000","last_undegraded":"2024-01-19T04:17:02.689270+0000","last_fullsized":"2024-01-19T04:17:02.689270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703710+0000","last_change":"2024-01-19T04:16:50.571359+0000","last_active":"2024-01-19T04:17:03.703710+0000","last_peered":"2024-01-19T04:17:03.703710+0000","last_clean":"2024-01-19T04:17:03.703710+0000","last_became_active":"2024-01-19T04:16:50.570715+0000","last_became_peered":"2024-01-19T04:16:50.570715+0000","last_unstale":"2024-01-19T04:17:03.703710+0000","last_undegraded":"2024-01-19T04:17:03.703710+0000","last_fullsized":"2024-01-19T04:17:03.703710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.692259+0000","last_change":"2024-01-19T04:17:03.692259+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.692259+0000","last_undegraded":"2024-01-19T04:17:03.692259+0000","last_fullsized":"2024-01-19T04:17:03.692259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694496+0000","last_change":"2024-01-19T04:17:03.711684+0000","last_active":"2024-01-19T04:17:04.694496+0000","last_peered":"2024-01-19T04:17:04.694496+0000","last_clean":"2024-01-19T04:17:04.694496+0000","last_became_active":"2024-01-19T04:17:03.711404+0000","last_became_peered":"2024-01-19T04:17:03.711404+0000","last_unstale":"2024-01-19T04:17:04.694496+0000","last_undegraded":"2024-01-19T04:17:04.694496+0000","last_fullsized":"2024-01-19T04:17:04.694496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:05.518024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695322+0000","last_change":"2024-01-19T04:16:51.578118+0000","last_active":"2024-01-19T04:17:04.695322+0000","last_peered":"2024-01-19T04:17:04.695322+0000","last_clean":"2024-01-19T04:17:04.695322+0000","last_became_active":"2024-01-19T04:16:51.577861+0000","last_became_peered":"2024-01-19T04:16:51.577861+0000","last_unstale":"2024-01-19T04:17:04.695322+0000","last_undegraded":"2024-01-19T04:17:04.695322+0000","last_fullsized":"2024-01-19T04:17:04.695322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:52:16.044197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682351+0000","last_change":"2024-01-19T04:16:50.572873+0000","last_active":"2024-01-19T04:17:02.682351+0000","last_peered":"2024-01-19T04:17:02.682351+0000","last_clean":"2024-01-19T04:17:02.682351+0000","last_became_active":"2024-01-19T04:16:50.571172+0000","last_became_peered":"2024-01-19T04:16:50.571172+0000","last_unstale":"2024-01-19T04:17:02.682351+0000","last_undegraded":"2024-01-19T04:17:02.682351+0000","last_fullsized":"2024-01-19T04:17:02.682351+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734205+0000","last_change":"2024-01-19T04:17:04.727787+0000","last_active":"2024-01-19T04:17:04.734205+0000","last_peered":"2024-01-19T04:17:04.734205+0000","last_clean":"2024-01-19T04:17:04.734205+0000","last_became_active":"2024-01-19T04:17:04.727503+0000","last_became_peered":"2024-01-19T04:17:04.727503+0000","last_unstale":"2024-01-19T04:17:04.734205+0000","last_undegraded":"2024-01-19T04:17:04.734205+0000","last_fullsized":"2024-01-19T04:17:04.734205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:06.524237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710562+0000","last_change":"2024-01-19T04:17:03.711107+0000","last_active":"2024-01-19T04:17:04.710562+0000","last_peered":"2024-01-19T04:17:04.710562+0000","last_clean":"2024-01-19T04:17:04.710562+0000","last_became_active":"2024-01-19T04:17:03.709301+0000","last_became_peered":"2024-01-19T04:17:03.709301+0000","last_unstale":"2024-01-19T04:17:04.710562+0000","last_undegraded":"2024-01-19T04:17:04.710562+0000","last_fullsized":"2024-01-19T04:17:04.710562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:26.645481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702350+0000","last_change":"2024-01-19T04:16:51.590515+0000","last_active":"2024-01-19T04:17:03.702350+0000","last_peered":"2024-01-19T04:17:03.702350+0000","last_clean":"2024-01-19T04:17:03.702350+0000","last_became_active":"2024-01-19T04:16:51.590319+0000","last_became_peered":"2024-01-19T04:16:51.590319+0000","last_unstale":"2024-01-19T04:17:03.702350+0000","last_undegraded":"2024-01-19T04:17:03.702350+0000","last_fullsized":"2024-01-19T04:17:03.702350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700291+0000","last_change":"2024-01-19T04:16:50.567937+0000","last_active":"2024-01-19T04:17:03.700291+0000","last_peered":"2024-01-19T04:17:03.700291+0000","last_clean":"2024-01-19T04:17:03.700291+0000","last_became_active":"2024-01-19T04:16:50.567687+0000","last_became_peered":"2024-01-19T04:16:50.567687+0000","last_unstale":"2024-01-19T04:17:03.700291+0000","last_undegraded":"2024-01-19T04:17:03.700291+0000","last_fullsized":"2024-01-19T04:17:03.700291+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:05.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-01-19T04:17:03.694524+0000","last_change":"2024-01-19T04:17:03.694524+0000","last_active":"2024-01-19T04:17:03.680056+0000","last_peered":"2024-01-19T04:17:03.680056+0000","last_clean":"2024-01-19T04:17:03.680056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:03.694524+0000","last_undegraded":"2024-01-19T04:17:03.694524+0000","last_fullsized":"2024-01-19T04:17:03.694524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.709614+0000","last_change":"2024-01-19T04:17:03.707107+0000","last_active":"2024-01-19T04:17:03.709614+0000","last_peered":"2024-01-19T04:17:03.709614+0000","last_clean":"2024-01-19T04:17:03.709614+0000","last_became_active":"2024-01-19T04:17:03.706799+0000","last_became_peered":"2024-01-19T04:17:03.706799+0000","last_unstale":"2024-01-19T04:17:03.709614+0000","last_undegraded":"2024-01-19T04:17:03.709614+0000","last_fullsized":"2024-01-19T04:17:03.709614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:37:43.557082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682168+0000","last_change":"2024-01-19T04:16:51.583555+0000","last_active":"2024-01-19T04:17:02.682168+0000","last_peered":"2024-01-19T04:17:02.682168+0000","last_clean":"2024-01-19T04:17:02.682168+0000","last_became_active":"2024-01-19T04:16:51.583278+0000","last_became_peered":"2024-01-19T04:16:51.583278+0000","last_unstale":"2024-01-19T04:17:02.682168+0000","last_undegraded":"2024-01-19T04:17:02.682168+0000","last_fullsized":"2024-01-19T04:17:02.682168+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:10.004835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-01-19T04:17:02.682292+0000","last_change":"2024-01-19T04:16:50.570692+0000","last_active":"2024-01-19T04:17:02.682292+0000","last_peered":"2024-01-19T04:17:02.682292+0000","last_clean":"2024-01-19T04:17:02.682292+0000","last_became_active":"2024-01-19T04:16:50.570414+0000","last_became_peered":"2024-01-19T04:16:50.570414+0000","last_unstale":"2024-01-19T04:17:02.682292+0000","last_undegraded":"2024-01-19T04:17:02.682292+0000","last_fullsized":"2024-01-19T04:17:02.682292+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:18.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734457+0000","last_change":"2024-01-19T04:17:04.730280+0000","last_active":"2024-01-19T04:17:04.734457+0000","last_peered":"2024-01-19T04:17:04.734457+0000","last_clean":"2024-01-19T04:17:04.734457+0000","last_became_active":"2024-01-19T04:17:04.729904+0000","last_became_peered":"2024-01-19T04:17:04.729904+0000","last_unstale":"2024-01-19T04:17:04.734457+0000","last_undegraded":"2024-01-19T04:17:04.734457+0000","last_fullsized":"2024-01-19T04:17:04.734457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:41.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.711331+0000","last_change":"2024-01-19T04:17:03.708010+0000","last_active":"2024-01-19T04:17:03.711331+0000","last_peered":"2024-01-19T04:17:03.711331+0000","last_clean":"2024-01-19T04:17:03.711331+0000","last_became_active":"2024-01-19T04:17:03.707622+0000","last_became_peered":"2024-01-19T04:17:03.707622+0000","last_unstale":"2024-01-19T04:17:03.711331+0000","last_undegraded":"2024-01-19T04:17:03.711331+0000","last_fullsized":"2024-01-19T04:17:03.711331+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:41:00.904557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695576+0000","last_change":"2024-01-19T04:16:51.586087+0000","last_active":"2024-01-19T04:17:04.695576+0000","last_peered":"2024-01-19T04:17:04.695576+0000","last_clean":"2024-01-19T04:17:04.695576+0000","last_became_active":"2024-01-19T04:16:51.585533+0000","last_became_peered":"2024-01-19T04:16:51.585533+0000","last_unstale":"2024-01-19T04:17:04.695576+0000","last_undegraded":"2024-01-19T04:17:04.695576+0000","last_fullsized":"2024-01-19T04:17:04.695576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:32.942430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693448+0000","last_change":"2024-01-19T04:16:50.570854+0000","last_active":"2024-01-19T04:17:04.693448+0000","last_peered":"2024-01-19T04:17:04.693448+0000","last_clean":"2024-01-19T04:17:04.693448+0000","last_became_active":"2024-01-19T04:16:50.570594+0000","last_became_peered":"2024-01-19T04:16:50.570594+0000","last_unstale":"2024-01-19T04:17:04.693448+0000","last_undegraded":"2024-01-19T04:17:04.693448+0000","last_fullsized":"2024-01-19T04:17:04.693448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:51:58.259661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923676+0000","last_change":"2024-01-19T04:17:04.726240+0000","last_active":"2024-01-19T04:17:06.923676+0000","last_peered":"2024-01-19T04:17:06.923676+0000","last_clean":"2024-01-19T04:17:06.923676+0000","last_became_active":"2024-01-19T04:17:04.725967+0000","last_became_peered":"2024-01-19T04:17:04.725967+0000","last_unstale":"2024-01-19T04:17:06.923676+0000","last_undegraded":"2024-01-19T04:17:06.923676+0000","last_fullsized":"2024-01-19T04:17:06.923676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:12:40.918817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732193+0000","last_change":"2024-01-19T04:17:03.710289+0000","last_active":"2024-01-19T04:17:04.732193+0000","last_peered":"2024-01-19T04:17:04.732193+0000","last_clean":"2024-01-19T04:17:04.732193+0000","last_became_active":"2024-01-19T04:17:03.709448+0000","last_became_peered":"2024-01-19T04:17:03.709448+0000","last_unstale":"2024-01-19T04:17:04.732193+0000","last_undegraded":"2024-01-19T04:17:04.732193+0000","last_fullsized":"2024-01-19T04:17:04.732193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:10.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693344+0000","last_change":"2024-01-19T04:16:51.574512+0000","last_active":"2024-01-19T04:17:04.693344+0000","last_peered":"2024-01-19T04:17:04.693344+0000","last_clean":"2024-01-19T04:17:04.693344+0000","last_became_active":"2024-01-19T04:16:51.574197+0000","last_became_peered":"2024-01-19T04:16:51.574197+0000","last_unstale":"2024-01-19T04:17:04.693344+0000","last_undegraded":"2024-01-19T04:17:04.693344+0000","last_fullsized":"2024-01-19T04:17:04.693344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:44:34.041080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704158+0000","last_change":"2024-01-19T04:16:50.574052+0000","last_active":"2024-01-19T04:17:03.704158+0000","last_peered":"2024-01-19T04:17:03.704158+0000","last_clean":"2024-01-19T04:17:03.704158+0000","last_became_active":"2024-01-19T04:16:50.572944+0000","last_became_peered":"2024-01-19T04:16:50.572944+0000","last_unstale":"2024-01-19T04:17:03.704158+0000","last_undegraded":"2024-01-19T04:17:03.704158+0000","last_fullsized":"2024-01-19T04:17:03.704158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:10:00.992470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701364+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:17:03.701364+0000","last_peered":"2024-01-19T04:17:03.701364+0000","last_clean":"2024-01-19T04:17:03.701364+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:17:03.701364+0000","last_undegraded":"2024-01-19T04:17:03.701364+0000","last_fullsized":"2024-01-19T04:17:03.701364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476766,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":865055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.63200000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476766,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":274527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.45200000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476765,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":275179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628}]},{"osd":1,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98299999999999998,"5min":1.107,"15min":1.107},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.246,"15min":1.246},"last":0.755},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.878},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0820000000000001,"5min":1.708,"15min":1.708},"last":0.71699999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476767,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":277634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.54300000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.381,"15min":1.381},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.095,"15min":1.095},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0940000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.495}]},{"osd":7,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.139,"15min":1.139},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1120000000000001,"5min":1.266,"15min":1.266},"last":0.69699999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":655360,"data_stored":274583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.504},{"interface":"front","average":{"1min":0.439,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54700000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.503},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.63300000000000001,"5min":0.879,"15min":0.879},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95799999999999996,"5min":1.016,"15min":1.016},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.89500000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93000000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98199999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.77300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":638976,"data_stored":267487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.964,"15min":1.964},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.441},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":2.827,"15min":2.827},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60299999999999998,"5min":2.343,"15min":2.343},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.665,"15min":1.665},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.032,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.94199999999999995,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.002,"5min":1.198,"15min":1.198},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.504},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.67500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.04,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.56100000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":861454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.60999999999999999,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60799999999999998,"5min":3.129,"15min":3.129},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.66700000000000004,"15min":0.69999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.72299999999999998,"15min":0.755},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.61299999999999999,"5min":3.633,"15min":3.633},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.59499999999999997,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93200000000000005,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.96299999999999997,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89500000000000002,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.004,"15min":1.052},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0469999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":1.034,"15min":1.0860000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97499999999999998,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.96799999999999997,"15min":1.008},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.85099999999999998,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.876,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75,"5min":1.052,"15min":1.1020000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95099999999999996,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.61499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":289485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54600000000000004,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.77600000000000002,"15min":0.81799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82699999999999996,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.65300000000000002,"15min":0.68300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":5.226,"15min":5.226},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":5.319,"15min":5.319},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.745,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96599999999999997,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.085,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.01,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.133,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.093,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93999999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.165,"5min":5.423,"15min":5.423},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1459999999999999,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:17:09.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-01-19T04:17:09.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.693844+0000', 'last_change': '2024-01-19T04:17:03.693844+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.693844+0000', 'last_undegraded': '2024-01-19T04:17:03.693844+0000', 'last_fullsized': '2024-01-19T04:17:03.693844+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:17:09.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-01-19T04:17:09.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.695464+0000', 'last_change': '2024-01-19T04:17:03.695464+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.695464+0000', 'last_undegraded': '2024-01-19T04:17:03.695464+0000', 'last_fullsized': '2024-01-19T04:17:03.695464+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.693377+0000', 'last_change': '2024-01-19T04:17:03.693377+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.693377+0000', 'last_undegraded': '2024-01-19T04:17:03.693377+0000', 'last_fullsized': '2024-01-19T04:17:03.693377+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.697378+0000', 'last_change': '2024-01-19T04:17:03.697378+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.697378+0000', 'last_undegraded': '2024-01-19T04:17:03.697378+0000', 'last_fullsized': '2024-01-19T04:17:03.697378+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.694959+0000', 'last_change': '2024-01-19T04:17:03.694959+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.694959+0000', 'last_undegraded': '2024-01-19T04:17:03.694959+0000', 'last_fullsized': '2024-01-19T04:17:03.694959+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.696463+0000', 'last_change': '2024-01-19T04:17:03.696463+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.696463+0000', 'last_undegraded': '2024-01-19T04:17:03.696463+0000', 'last_fullsized': '2024-01-19T04:17:03.696463+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.695321+0000', 'last_change': '2024-01-19T04:17:03.695321+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.695321+0000', 'last_undegraded': '2024-01-19T04:17:03.695321+0000', 'last_fullsized': '2024-01-19T04:17:03.695321+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-01-19T04:17:09.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.696048+0000', 'last_change': '2024-01-19T04:17:03.696048+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.696048+0000', 'last_undegraded': '2024-01-19T04:17:03.696048+0000', 'last_fullsized': '2024-01-19T04:17:03.696048+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.696804+0000', 'last_change': '2024-01-19T04:17:03.696804+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.696804+0000', 'last_undegraded': '2024-01-19T04:17:03.696804+0000', 'last_fullsized': '2024-01-19T04:17:03.696804+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.692299+0000', 'last_change': '2024-01-19T04:17:03.692299+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.692299+0000', 'last_undegraded': '2024-01-19T04:17:03.692299+0000', 'last_fullsized': '2024-01-19T04:17:03.692299+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.696290+0000', 'last_change': '2024-01-19T04:17:03.696290+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.696290+0000', 'last_undegraded': '2024-01-19T04:17:03.696290+0000', 'last_fullsized': '2024-01-19T04:17:03.696290+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.694152+0000', 'last_change': '2024-01-19T04:17:03.694152+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.694152+0000', 'last_undegraded': '2024-01-19T04:17:03.694152+0000', 'last_fullsized': '2024-01-19T04:17:03.694152+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.694545+0000', 'last_change': '2024-01-19T04:17:03.694545+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.694545+0000', 'last_undegraded': '2024-01-19T04:17:03.694545+0000', 'last_fullsized': '2024-01-19T04:17:03.694545+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:17:09.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.697444+0000', 'last_change': '2024-01-19T04:17:03.697444+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.697444+0000', 'last_undegraded': '2024-01-19T04:17:03.697444+0000', 'last_fullsized': '2024-01-19T04:17:03.697444+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.693984+0000', 'last_change': '2024-01-19T04:17:03.693984+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.693984+0000', 'last_undegraded': '2024-01-19T04:17:03.693984+0000', 'last_fullsized': '2024-01-19T04:17:03.693984+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.694155+0000', 'last_change': '2024-01-19T04:17:03.694155+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.694155+0000', 'last_undegraded': '2024-01-19T04:17:03.694155+0000', 'last_fullsized': '2024-01-19T04:17:03.694155+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.692735+0000', 'last_change': '2024-01-19T04:17:03.692735+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.692735+0000', 'last_undegraded': '2024-01-19T04:17:03.692735+0000', 'last_fullsized': '2024-01-19T04:17:03.692735+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.696863+0000', 'last_change': '2024-01-19T04:17:03.696863+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.696863+0000', 'last_undegraded': '2024-01-19T04:17:03.696863+0000', 'last_fullsized': '2024-01-19T04:17:03.696863+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.697577+0000', 'last_change': '2024-01-19T04:17:03.697577+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.697577+0000', 'last_undegraded': '2024-01-19T04:17:03.697577+0000', 'last_fullsized': '2024-01-19T04:17:03.697577+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-19T04:17:09.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-01-19T04:17:09.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.692259+0000', 'last_change': '2024-01-19T04:17:03.692259+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.692259+0000', 'last_undegraded': '2024-01-19T04:17:03.692259+0000', 'last_fullsized': '2024-01-19T04:17:03.692259+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T04:17:09.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-01-19T04:17:09.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-01-19T04:17:03.694524+0000', 'last_change': '2024-01-19T04:17:03.694524+0000', 'last_active': '2024-01-19T04:17:03.680056+0000', 'last_peered': '2024-01-19T04:17:03.680056+0000', 'last_clean': '2024-01-19T04:17:03.680056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T04:17:03.694524+0000', 'last_undegraded': '2024-01-19T04:17:03.694524+0000', 'last_fullsized': '2024-01-19T04:17:03.694524+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'last_clean_scrub_stamp': '2024-01-19T04:17:03.680056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T04:17:09.642 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-19T04:17:09.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.809+0000 7fd873800640 1 Processor -- start 2024-01-19T04:17:09.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd873800640 1 -- start start 2024-01-19T04:17:09.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd873800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd86c0c8290 0x7fd86c0a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd873800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd86c0c1bc0 0x7fd86c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd873800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86c157d60 con 0x7fd86c06fe50 2024-01-19T04:17:09.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd873800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c158040 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd873800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c158320 con 0x7fd86c0c8290 2024-01-19T04:17:09.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd86be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd86c0c1bc0 0x7fd86c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd871800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd86c06fe50 0x7fd86c154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42362/0 (socket says 172.21.15.32:42362) 2024-01-19T04:17:09.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd871800640 1 -- 172.21.15.32:0/3053378768 learned_addr learned my addr 172.21.15.32:0/3053378768 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:09.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd870e00640 1 --2- 172.21.15.32:0/3053378768 >> v2:172.21.15.67:3300/0 conn(0x7fd86c0c8290 0x7fd86c0a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd86be00640 1 -- 172.21.15.32:0/3053378768 >> v2:172.21.15.67:3300/0 conn(0x7fd86c0c8290 msgr2=0x7fd86c0a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:09.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd86be00640 1 --2- 172.21.15.32:0/3053378768 >> v2:172.21.15.67:3300/0 conn(0x7fd86c0c8290 0x7fd86c0a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd86be00640 1 -- 172.21.15.32:0/3053378768 >> v1:172.21.15.32:6789/0 conn(0x7fd86c06fe50 legacy=0x7fd86c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd86be00640 1 -- 172.21.15.32:0/3053378768 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c158600 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.813+0000 7fd86b400640 1 -- 172.21.15.32:0/3053378768 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790698168 0 0) 0x7fd86c157d60 con 0x7fd86c06fe50 2024-01-19T04:17:09.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd86be00640 1 --2- 172.21.15.32:0/3053378768 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c06f910 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd8540097c0 tx=0x7fd85401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884e865d957706e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd86b400640 1 -- 172.21.15.32:0/3053378768 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540ab600 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd86b400640 1 -- 172.21.15.32:0/3053378768 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8540a7050 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd86b400640 1 -- 172.21.15.32:0/3053378768 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540ab980 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 -- 172.21.15.32:0/3053378768 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 msgr2=0x7fd86c06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 --2- 172.21.15.32:0/3053378768 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c06f910 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd8540097c0 tx=0x7fd85401cd80 comp rx=0 tx=0).stop 2024-01-19T04:17:09.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 -- 172.21.15.32:0/3053378768 shutdown_connections 2024-01-19T04:17:09.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 --2- 172.21.15.32:0/3053378768 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c06f910 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 --2- 172.21.15.32:0/3053378768 >> v2:172.21.15.67:3300/0 conn(0x7fd86c0c8290 0x7fd86c0a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 -- 172.21.15.32:0/3053378768 >> 172.21.15.32:0/3053378768 conn(0x7fd86c0726d0 msgr2=0x7fd86c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:09.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 -- 172.21.15.32:0/3053378768 shutdown_connections 2024-01-19T04:17:09.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 -- 172.21.15.32:0/3053378768 wait complete. 2024-01-19T04:17:09.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 Processor -- start 2024-01-19T04:17:09.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.817+0000 7fd873800640 1 -- start start 2024-01-19T04:17:09.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd86c06fe50 0x7fd86c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd86c0c8290 0x7fd86c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1591f0 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1579d0 con 0x7fd86c0c8290 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1ed510 con 0x7fd86c06fe50 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c0ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45440/0 (socket says 172.21.15.32:45440) 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 -- 172.21.15.32:0/2672504063 learned_addr learned my addr 172.21.15.32:0/2672504063 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd871800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd86c0c8290 0x7fd86c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd870e00640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd86c06fe50 0x7fd86c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 -- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd86c06fe50 msgr2=0x7fd86c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd86c06fe50 0x7fd86c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 -- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd86c0c8290 msgr2=0x7fd86c153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd86c0c8290 0x7fd86c153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 -- 172.21.15.32:0/2672504063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd854009420 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd871800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd86c0c8290 0x7fd86c153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:09.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd86be00640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c0ac930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd854018f30 tx=0x7fd8540190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd868c00640 1 -- 172.21.15.32:0/2672504063 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540b4410 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd868c00640 1 -- 172.21.15.32:0/2672504063 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8540b4570 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd868c00640 1 -- 172.21.15.32:0/2672504063 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540b4920 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c1ed7f0 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c1eddb0 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.821+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c1f0730 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.825+0000 7fd868c00640 1 -- 172.21.15.32:0/2672504063 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd8540b2040 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.825+0000 7fd868c00640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd844066500 0x7fd8440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:09.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.825+0000 7fd868c00640 1 -- 172.21.15.32:0/2672504063 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd85411e1a0 con 0x7fd86c0c1bc0 2024-01-19T04:17:09.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.825+0000 7fd870e00640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd844066500 0x7fd8440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:09.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.825+0000 7fd870e00640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd844066500 0x7fd8440689c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009af0 tx=0x7fd85c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:09.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:09.829+0000 7fd868c00640 1 -- 172.21.15.32:0/2672504063 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd8540eb0d0 con 0x7fd86c0c1bc0 2024-01-19T04:17:10.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.045+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd86c0749f0 con 0x7fd86c0c1bc0 2024-01-19T04:17:10.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.045+0000 7fd868c00640 1 -- 172.21.15.32:0/2672504063 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1491 (secure 0 0 0) 0x7fd8540ee6f0 con 0x7fd86c0c1bc0 2024-01-19T04:17:10.048 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:10.049 INFO:teuthology.orchestra.run.smithi032.stdout:{"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":153,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1705637689,"num_in_osds":8,"osd_in_since":1705637679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":172},{"state_name":"creating+peering","count":21}],"num_pgs":193,"num_pools":5,"num_objects":39,"data_bytes":595037,"bytes_used":244846592,"bytes_avail":772849266688,"bytes_total":773094113280,"inactive_pgs_ratio":0.10880828648805618,"write_bytes_sec":761,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":36,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5835},{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":5841}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-01-19T04:16:44.053415+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd844066500 msgr2=0x7fd8440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd844066500 0x7fd8440689c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009af0 tx=0x7fd85c008040 comp rx=0 tx=0).stop 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 msgr2=0x7fd86c0ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c0ac930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd854018f30 tx=0x7fd8540190c0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 shutdown_connections 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd844066500 0x7fd8440689c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd86c0c8290 0x7fd86c153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd86c0c1bc0 0x7fd86c0ac930 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 --2- 172.21.15.32:0/2672504063 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd86c06fe50 0x7fd86c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 >> 172.21.15.32:0/2672504063 conn(0x7fd86c0726d0 msgr2=0x7fd86c06d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 shutdown_connections 2024-01-19T04:17:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.049+0000 7fd873800640 1 -- 172.21.15.32:0/2672504063 wait complete. 2024-01-19T04:17:10.072 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-19T04:17:10.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:17:10.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.209+0000 7f5806200640 1 Processor -- start 2024-01-19T04:17:10.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.209+0000 7f5806200640 1 -- start start 2024-01-19T04:17:10.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f5806200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f580014fb50 0x7f580006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:10.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f5806200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000a4ec0 0x7f580015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:10.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f5806200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5800071e80 con 0x7f58000c04a0 2024-01-19T04:17:10.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f5806200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58001535c0 con 0x7f580014fb50 2024-01-19T04:17:10.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f5806200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000726c0 con 0x7f58000a4ec0 2024-01-19T04:17:10.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ff400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f580014fb50 0x7f580006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:10.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000a4ec0 0x7f580015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:10.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ff400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f580014fb50 0x7f580006fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:54964/0 (socket says 172.21.15.32:54964) 2024-01-19T04:17:10.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ff400640 1 -- 172.21.15.32:0/64155622 learned_addr learned my addr 172.21.15.32:0/64155622 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:10.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000a4ec0 0x7f580015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:40268/0 (socket says 172.21.15.32:40268) 2024-01-19T04:17:10.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57fea00640 1 --1- 172.21.15.32:0/64155622 >> v1:172.21.15.67:6789/0 conn(0x7f58000c04a0 0x7f58000c1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:42614/0 (socket says 172.21.15.32:42614) 2024-01-19T04:17:10.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ffe00640 1 -- 172.21.15.32:0/64155622 >> v2:172.21.15.67:3300/0 conn(0x7f580014fb50 msgr2=0x7f580006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:10.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ffe00640 1 --2- 172.21.15.32:0/64155622 >> v2:172.21.15.67:3300/0 conn(0x7f580014fb50 0x7f580006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ffe00640 1 -- 172.21.15.32:0/64155622 >> v1:172.21.15.67:6789/0 conn(0x7f58000c04a0 legacy=0x7f58000c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ffe00640 1 -- 172.21.15.32:0/64155622 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000c0a20 con 0x7f58000a4ec0 2024-01-19T04:17:10.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.213+0000 7f57ff400640 1 --2- 172.21.15.32:0/64155622 >> v2:172.21.15.67:3300/0 conn(0x7f580014fb50 0x7f580006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:10.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f57ffe00640 1 --2- 172.21.15.32:0/64155622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000a4ec0 0x7f580015cf00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009d90 tx=0x7f57f801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3133a1202460a904 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:10.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f57fe000640 1 -- 172.21.15.32:0/64155622 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80a5780 con 0x7f58000a4ec0 2024-01-19T04:17:10.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f57fe000640 1 -- 172.21.15.32:0/64155622 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f80a58e0 con 0x7f58000a4ec0 2024-01-19T04:17:10.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f57fe000640 1 -- 172.21.15.32:0/64155622 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80a5c70 con 0x7f58000a4ec0 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 -- 172.21.15.32:0/64155622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000a4ec0 msgr2=0x7f580015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 --2- 172.21.15.32:0/64155622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000a4ec0 0x7f580015cf00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009d90 tx=0x7f57f801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 -- 172.21.15.32:0/64155622 shutdown_connections 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 --2- 172.21.15.32:0/64155622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000a4ec0 0x7f580015cf00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 --2- 172.21.15.32:0/64155622 >> v2:172.21.15.67:3300/0 conn(0x7f580014fb50 0x7f580006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 -- 172.21.15.32:0/64155622 >> 172.21.15.32:0/64155622 conn(0x7f58000c5b20 msgr2=0x7f58000c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 -- 172.21.15.32:0/64155622 shutdown_connections 2024-01-19T04:17:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 -- 172.21.15.32:0/64155622 wait complete. 2024-01-19T04:17:10.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 Processor -- start 2024-01-19T04:17:10.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.217+0000 7f5806200640 1 -- start start 2024-01-19T04:17:10.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58000a4ec0 0x7f58001f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:10.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000c04a0 0x7f58001eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:10.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580014fb50 0x7f5800149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:10.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5800144b20 con 0x7f58000a4ec0 2024-01-19T04:17:10.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58001f0c00 con 0x7f580014fb50 2024-01-19T04:17:10.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5800144560 con 0x7f58000c04a0 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58000a4ec0 0x7f58001f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58000a4ec0 0x7f58001f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45450/0 (socket says 172.21.15.32:45450) 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 -- 172.21.15.32:0/4028420652 learned_addr learned my addr 172.21.15.32:0/4028420652 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ffe00640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580014fb50 0x7f5800149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57fea00640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000c04a0 0x7f58001eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 -- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000c04a0 msgr2=0x7f58001eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000c04a0 0x7f58001eda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 -- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580014fb50 msgr2=0x7f5800149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580014fb50 0x7f5800149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 -- 172.21.15.32:0/4028420652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00094d0 con 0x7f58000a4ec0 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57fea00640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000c04a0 0x7f58001eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:10.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57ff400640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58000a4ec0 0x7f58001f06c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f57f000e960 tx=0x7f57f000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57f7400640 1 -- 172.21.15.32:0/4028420652 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f000ca00 con 0x7f58000a4ec0 2024-01-19T04:17:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57f7400640 1 -- 172.21.15.32:0/4028420652 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f000cb60 con 0x7f58000a4ec0 2024-01-19T04:17:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f57f7400640 1 -- 172.21.15.32:0/4028420652 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f000ced0 con 0x7f58000a4ec0 2024-01-19T04:17:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f8009a70 con 0x7f58000a4ec0 2024-01-19T04:17:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58001ed270 con 0x7f58000a4ec0 2024-01-19T04:17:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.221+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58001ed0d0 con 0x7f58000a4ec0 2024-01-19T04:17:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.225+0000 7f57f7400640 1 -- 172.21.15.32:0/4028420652 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f57f0013470 con 0x7f58000a4ec0 2024-01-19T04:17:10.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.225+0000 7f57f7400640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57d8066500 0x7f57d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:10.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.225+0000 7f57f7400640 1 -- 172.21.15.32:0/4028420652 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f57f0084400 con 0x7f58000a4ec0 2024-01-19T04:17:10.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.225+0000 7f57fea00640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57d8066500 0x7f57d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:10.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.225+0000 7f57fea00640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57d8066500 0x7f57d80689c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f580014db70 tx=0x7f57e8007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:10.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.229+0000 7f57f7400640 1 -- 172.21.15.32:0/4028420652 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f58001ed0d0 con 0x7f58000a4ec0 2024-01-19T04:17:10.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.389+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f580015fc60 con 0x7f57d8066500 2024-01-19T04:17:10.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.405+0000 7f57f7400640 1 -- 172.21.15.32:0/4028420652 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527434 (secure 0 0 0) 0x7f57e80075a0 con 0x7f57d8066500 2024-01-19T04:17:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:10.416 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57d8066500 msgr2=0x7f57d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57d8066500 0x7f57d80689c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f580014db70 tx=0x7f57e8007d70 comp rx=0 tx=0).stop 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58000a4ec0 msgr2=0x7f58001f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58000a4ec0 0x7f58001f06c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f57f000e960 tx=0x7f57f000ee20 comp rx=0 tx=0).stop 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 shutdown_connections 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57d8066500 0x7f57d80689c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580014fb50 0x7f5800149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58000c04a0 0x7f58001eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 --2- 172.21.15.32:0/4028420652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58000a4ec0 0x7f58001f06c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:10.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 >> 172.21.15.32:0/4028420652 conn(0x7f58000c5b20 msgr2=0x7f58001474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:10.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 shutdown_connections 2024-01-19T04:17:10.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:10.409+0000 7f5806200640 1 -- 172.21.15.32:0/4028420652 wait complete. 2024-01-19T04:17:10.432 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-01-19T04:17:10.059293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":325,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239248,"kb_used_data":6416,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735472,"statfs":{"total":773094113280,"available":772849123328,"internally_reserved":0,"allocated":6569984,"data_stored":3447874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.370999"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924285+0000","last_change":"2024-01-19T04:17:04.707561+0000","last_active":"2024-01-19T04:17:06.924285+0000","last_peered":"2024-01-19T04:17:06.924285+0000","last_clean":"2024-01-19T04:17:06.924285+0000","last_became_active":"2024-01-19T04:17:04.706328+0000","last_became_peered":"2024-01-19T04:17:04.706328+0000","last_unstale":"2024-01-19T04:17:06.924285+0000","last_undegraded":"2024-01-19T04:17:06.924285+0000","last_fullsized":"2024-01-19T04:17:06.924285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:31:51.010861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705557+0000","last_change":"2024-01-19T04:16:51.581477+0000","last_active":"2024-01-19T04:17:04.705557+0000","last_peered":"2024-01-19T04:17:04.705557+0000","last_clean":"2024-01-19T04:17:04.705557+0000","last_became_active":"2024-01-19T04:16:51.580890+0000","last_became_peered":"2024-01-19T04:16:51.580890+0000","last_unstale":"2024-01-19T04:17:04.705557+0000","last_undegraded":"2024-01-19T04:17:04.705557+0000","last_fullsized":"2024-01-19T04:17:04.705557+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.849907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743768+0000","last_change":"2024-01-19T04:17:04.722525+0000","last_active":"2024-01-19T04:17:06.743768+0000","last_peered":"2024-01-19T04:17:06.743768+0000","last_clean":"2024-01-19T04:17:06.743768+0000","last_became_active":"2024-01-19T04:17:04.722229+0000","last_became_peered":"2024-01-19T04:17:04.722229+0000","last_unstale":"2024-01-19T04:17:06.743768+0000","last_undegraded":"2024-01-19T04:17:06.743768+0000","last_fullsized":"2024-01-19T04:17:06.743768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:51:25.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698045+0000","last_change":"2024-01-19T04:16:51.580129+0000","last_active":"2024-01-19T04:17:04.698045+0000","last_peered":"2024-01-19T04:17:04.698045+0000","last_clean":"2024-01-19T04:17:04.698045+0000","last_became_active":"2024-01-19T04:16:51.579840+0000","last_became_peered":"2024-01-19T04:16:51.579840+0000","last_unstale":"2024-01-19T04:17:04.698045+0000","last_undegraded":"2024-01-19T04:17:04.698045+0000","last_fullsized":"2024-01-19T04:17:04.698045+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:56:54.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724604+0000","last_change":"2024-01-19T04:17:04.716555+0000","last_active":"2024-01-19T04:17:04.724604+0000","last_peered":"2024-01-19T04:17:04.724604+0000","last_clean":"2024-01-19T04:17:04.724604+0000","last_became_active":"2024-01-19T04:17:04.716072+0000","last_became_peered":"2024-01-19T04:17:04.716072+0000","last_unstale":"2024-01-19T04:17:04.724604+0000","last_undegraded":"2024-01-19T04:17:04.724604+0000","last_fullsized":"2024-01-19T04:17:04.724604+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700886+0000","last_change":"2024-01-19T04:16:51.574027+0000","last_active":"2024-01-19T04:17:03.700886+0000","last_peered":"2024-01-19T04:17:03.700886+0000","last_clean":"2024-01-19T04:17:03.700886+0000","last_became_active":"2024-01-19T04:16:51.573756+0000","last_became_peered":"2024-01-19T04:16:51.573756+0000","last_unstale":"2024-01-19T04:17:03.700886+0000","last_undegraded":"2024-01-19T04:17:03.700886+0000","last_fullsized":"2024-01-19T04:17:03.700886+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727171+0000","last_change":"2024-01-19T04:17:04.715758+0000","last_active":"2024-01-19T04:17:04.727171+0000","last_peered":"2024-01-19T04:17:04.727171+0000","last_clean":"2024-01-19T04:17:04.727171+0000","last_became_active":"2024-01-19T04:17:04.715514+0000","last_became_peered":"2024-01-19T04:17:04.715514+0000","last_unstale":"2024-01-19T04:17:04.727171+0000","last_undegraded":"2024-01-19T04:17:04.727171+0000","last_fullsized":"2024-01-19T04:17:04.727171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:04:35.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703432+0000","last_change":"2024-01-19T04:16:51.563134+0000","last_active":"2024-01-19T04:17:03.703432+0000","last_peered":"2024-01-19T04:17:03.703432+0000","last_clean":"2024-01-19T04:17:03.703432+0000","last_became_active":"2024-01-19T04:16:51.562243+0000","last_became_peered":"2024-01-19T04:16:51.562243+0000","last_unstale":"2024-01-19T04:17:03.703432+0000","last_undegraded":"2024-01-19T04:17:03.703432+0000","last_fullsized":"2024-01-19T04:17:03.703432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.722158+0000","last_change":"2024-01-19T04:17:04.717509+0000","last_active":"2024-01-19T04:17:04.722158+0000","last_peered":"2024-01-19T04:17:04.722158+0000","last_clean":"2024-01-19T04:17:04.722158+0000","last_became_active":"2024-01-19T04:17:04.717170+0000","last_became_peered":"2024-01-19T04:17:04.717170+0000","last_unstale":"2024-01-19T04:17:04.722158+0000","last_undegraded":"2024-01-19T04:17:04.722158+0000","last_fullsized":"2024-01-19T04:17:04.722158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705187+0000","last_change":"2024-01-19T04:16:51.568590+0000","last_active":"2024-01-19T04:17:04.705187+0000","last_peered":"2024-01-19T04:17:04.705187+0000","last_clean":"2024-01-19T04:17:04.705187+0000","last_became_active":"2024-01-19T04:16:51.567062+0000","last_became_peered":"2024-01-19T04:16:51.567062+0000","last_unstale":"2024-01-19T04:17:04.705187+0000","last_undegraded":"2024-01-19T04:17:04.705187+0000","last_fullsized":"2024-01-19T04:17:04.705187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:05.611512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733737+0000","last_change":"2024-01-19T04:17:04.727256+0000","last_active":"2024-01-19T04:17:04.733737+0000","last_peered":"2024-01-19T04:17:04.733737+0000","last_clean":"2024-01-19T04:17:04.733737+0000","last_became_active":"2024-01-19T04:17:04.726804+0000","last_became_peered":"2024-01-19T04:17:04.726804+0000","last_unstale":"2024-01-19T04:17:04.733737+0000","last_undegraded":"2024-01-19T04:17:04.733737+0000","last_fullsized":"2024-01-19T04:17:04.733737+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:20.362363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698880+0000","last_change":"2024-01-19T04:16:51.567447+0000","last_active":"2024-01-19T04:17:04.698880+0000","last_peered":"2024-01-19T04:17:04.698880+0000","last_clean":"2024-01-19T04:17:04.698880+0000","last_became_active":"2024-01-19T04:16:51.567187+0000","last_became_peered":"2024-01-19T04:16:51.567187+0000","last_unstale":"2024-01-19T04:17:04.698880+0000","last_undegraded":"2024-01-19T04:17:04.698880+0000","last_fullsized":"2024-01-19T04:17:04.698880+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729515+0000","last_change":"2024-01-19T04:17:04.719319+0000","last_active":"2024-01-19T04:17:06.729515+0000","last_peered":"2024-01-19T04:17:06.729515+0000","last_clean":"2024-01-19T04:17:06.729515+0000","last_became_active":"2024-01-19T04:17:04.717209+0000","last_became_peered":"2024-01-19T04:17:04.717209+0000","last_unstale":"2024-01-19T04:17:06.729515+0000","last_undegraded":"2024-01-19T04:17:06.729515+0000","last_fullsized":"2024-01-19T04:17:06.729515+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:58.517916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696299+0000","last_change":"2024-01-19T04:16:51.568350+0000","last_active":"2024-01-19T04:17:03.696299+0000","last_peered":"2024-01-19T04:17:03.696299+0000","last_clean":"2024-01-19T04:17:03.696299+0000","last_became_active":"2024-01-19T04:16:51.568051+0000","last_became_peered":"2024-01-19T04:16:51.568051+0000","last_unstale":"2024-01-19T04:17:03.696299+0000","last_undegraded":"2024-01-19T04:17:03.696299+0000","last_fullsized":"2024-01-19T04:17:03.696299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:31.896945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720368+0000","last_change":"2024-01-19T04:17:04.713905+0000","last_active":"2024-01-19T04:17:04.720368+0000","last_peered":"2024-01-19T04:17:04.720368+0000","last_clean":"2024-01-19T04:17:04.720368+0000","last_became_active":"2024-01-19T04:17:04.713659+0000","last_became_peered":"2024-01-19T04:17:04.713659+0000","last_unstale":"2024-01-19T04:17:04.720368+0000","last_undegraded":"2024-01-19T04:17:04.720368+0000","last_fullsized":"2024-01-19T04:17:04.720368+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:44.988632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693196+0000","last_change":"2024-01-19T04:16:51.572672+0000","last_active":"2024-01-19T04:17:04.693196+0000","last_peered":"2024-01-19T04:17:04.693196+0000","last_clean":"2024-01-19T04:17:04.693196+0000","last_became_active":"2024-01-19T04:16:51.572209+0000","last_became_peered":"2024-01-19T04:16:51.572209+0000","last_unstale":"2024-01-19T04:17:04.693196+0000","last_undegraded":"2024-01-19T04:17:04.693196+0000","last_fullsized":"2024-01-19T04:17:04.693196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725169+0000","last_change":"2024-01-19T04:17:04.717847+0000","last_active":"2024-01-19T04:17:04.725169+0000","last_peered":"2024-01-19T04:17:04.725169+0000","last_clean":"2024-01-19T04:17:04.725169+0000","last_became_active":"2024-01-19T04:17:04.715209+0000","last_became_peered":"2024-01-19T04:17:04.715209+0000","last_unstale":"2024-01-19T04:17:04.725169+0000","last_undegraded":"2024-01-19T04:17:04.725169+0000","last_fullsized":"2024-01-19T04:17:04.725169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696371+0000","last_change":"2024-01-19T04:16:51.569401+0000","last_active":"2024-01-19T04:17:03.696371+0000","last_peered":"2024-01-19T04:17:03.696371+0000","last_clean":"2024-01-19T04:17:03.696371+0000","last_became_active":"2024-01-19T04:16:51.569130+0000","last_became_peered":"2024-01-19T04:16:51.569130+0000","last_unstale":"2024-01-19T04:17:03.696371+0000","last_undegraded":"2024-01-19T04:17:03.696371+0000","last_fullsized":"2024-01-19T04:17:03.696371+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:46.968261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743462+0000","last_change":"2024-01-19T04:17:04.711509+0000","last_active":"2024-01-19T04:17:06.743462+0000","last_peered":"2024-01-19T04:17:06.743462+0000","last_clean":"2024-01-19T04:17:06.743462+0000","last_became_active":"2024-01-19T04:17:04.711256+0000","last_became_peered":"2024-01-19T04:17:04.711256+0000","last_unstale":"2024-01-19T04:17:06.743462+0000","last_undegraded":"2024-01-19T04:17:06.743462+0000","last_fullsized":"2024-01-19T04:17:06.743462+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:20:39.111262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.697718+0000","last_change":"2024-01-19T04:16:51.583971+0000","last_active":"2024-01-19T04:17:04.697718+0000","last_peered":"2024-01-19T04:17:04.697718+0000","last_clean":"2024-01-19T04:17:04.697718+0000","last_became_active":"2024-01-19T04:16:51.583688+0000","last_became_peered":"2024-01-19T04:16:51.583688+0000","last_unstale":"2024-01-19T04:17:04.697718+0000","last_undegraded":"2024-01-19T04:17:04.697718+0000","last_fullsized":"2024-01-19T04:17:04.697718+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:51.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.730182+0000","last_change":"2024-01-19T04:17:04.711401+0000","last_active":"2024-01-19T04:17:06.730182+0000","last_peered":"2024-01-19T04:17:06.730182+0000","last_clean":"2024-01-19T04:17:06.730182+0000","last_became_active":"2024-01-19T04:17:04.711035+0000","last_became_peered":"2024-01-19T04:17:04.711035+0000","last_unstale":"2024-01-19T04:17:06.730182+0000","last_undegraded":"2024-01-19T04:17:06.730182+0000","last_fullsized":"2024-01-19T04:17:06.730182+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:36.178015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698065+0000","last_change":"2024-01-19T04:16:51.581824+0000","last_active":"2024-01-19T04:17:04.698065+0000","last_peered":"2024-01-19T04:17:04.698065+0000","last_clean":"2024-01-19T04:17:04.698065+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:04.698065+0000","last_undegraded":"2024-01-19T04:17:04.698065+0000","last_fullsized":"2024-01-19T04:17:04.698065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:26.385285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721556+0000","last_change":"2024-01-19T04:17:04.711461+0000","last_active":"2024-01-19T04:17:04.721556+0000","last_peered":"2024-01-19T04:17:04.721556+0000","last_clean":"2024-01-19T04:17:04.721556+0000","last_became_active":"2024-01-19T04:17:04.711292+0000","last_became_peered":"2024-01-19T04:17:04.711292+0000","last_unstale":"2024-01-19T04:17:04.721556+0000","last_undegraded":"2024-01-19T04:17:04.721556+0000","last_fullsized":"2024-01-19T04:17:04.721556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:54.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703524+0000","last_change":"2024-01-19T04:16:51.575108+0000","last_active":"2024-01-19T04:17:03.703524+0000","last_peered":"2024-01-19T04:17:03.703524+0000","last_clean":"2024-01-19T04:17:03.703524+0000","last_became_active":"2024-01-19T04:16:51.574596+0000","last_became_peered":"2024-01-19T04:16:51.574596+0000","last_unstale":"2024-01-19T04:17:03.703524+0000","last_undegraded":"2024-01-19T04:17:03.703524+0000","last_fullsized":"2024-01-19T04:17:03.703524+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709459+0000","last_change":"2024-01-19T04:17:04.713824+0000","last_active":"2024-01-19T04:17:05.709459+0000","last_peered":"2024-01-19T04:17:05.709459+0000","last_clean":"2024-01-19T04:17:05.709459+0000","last_became_active":"2024-01-19T04:17:04.713548+0000","last_became_peered":"2024-01-19T04:17:04.713548+0000","last_unstale":"2024-01-19T04:17:05.709459+0000","last_undegraded":"2024-01-19T04:17:05.709459+0000","last_fullsized":"2024-01-19T04:17:05.709459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:56:58.089850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704901+0000","last_change":"2024-01-19T04:16:51.579903+0000","last_active":"2024-01-19T04:17:03.704901+0000","last_peered":"2024-01-19T04:17:03.704901+0000","last_clean":"2024-01-19T04:17:03.704901+0000","last_became_active":"2024-01-19T04:16:51.579415+0000","last_became_peered":"2024-01-19T04:16:51.579415+0000","last_unstale":"2024-01-19T04:17:03.704901+0000","last_undegraded":"2024-01-19T04:17:03.704901+0000","last_fullsized":"2024-01-19T04:17:03.704901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:31.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730411+0000","last_change":"2024-01-19T04:17:04.723485+0000","last_active":"2024-01-19T04:17:04.730411+0000","last_peered":"2024-01-19T04:17:04.730411+0000","last_clean":"2024-01-19T04:17:04.730411+0000","last_became_active":"2024-01-19T04:17:04.723202+0000","last_became_peered":"2024-01-19T04:17:04.723202+0000","last_unstale":"2024-01-19T04:17:04.730411+0000","last_undegraded":"2024-01-19T04:17:04.730411+0000","last_fullsized":"2024-01-19T04:17:04.730411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:19.815868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700684+0000","last_change":"2024-01-19T04:16:51.568949+0000","last_active":"2024-01-19T04:17:03.700684+0000","last_peered":"2024-01-19T04:17:03.700684+0000","last_clean":"2024-01-19T04:17:03.700684+0000","last_became_active":"2024-01-19T04:16:51.568682+0000","last_became_peered":"2024-01-19T04:16:51.568682+0000","last_unstale":"2024-01-19T04:17:03.700684+0000","last_undegraded":"2024-01-19T04:17:03.700684+0000","last_fullsized":"2024-01-19T04:17:03.700684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:23.038136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709628+0000","last_change":"2024-01-19T04:17:04.730023+0000","last_active":"2024-01-19T04:17:05.709628+0000","last_peered":"2024-01-19T04:17:05.709628+0000","last_clean":"2024-01-19T04:17:05.709628+0000","last_became_active":"2024-01-19T04:17:04.729725+0000","last_became_peered":"2024-01-19T04:17:04.729725+0000","last_unstale":"2024-01-19T04:17:05.709628+0000","last_undegraded":"2024-01-19T04:17:05.709628+0000","last_fullsized":"2024-01-19T04:17:05.709628+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:11:42.817870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.696464+0000","last_change":"2024-01-19T04:16:51.588950+0000","last_active":"2024-01-19T04:17:03.696464+0000","last_peered":"2024-01-19T04:17:03.696464+0000","last_clean":"2024-01-19T04:17:03.696464+0000","last_became_active":"2024-01-19T04:16:51.577721+0000","last_became_peered":"2024-01-19T04:16:51.577721+0000","last_unstale":"2024-01-19T04:17:03.696464+0000","last_undegraded":"2024-01-19T04:17:03.696464+0000","last_fullsized":"2024-01-19T04:17:03.696464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:30.735073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729496+0000","last_change":"2024-01-19T04:17:04.711759+0000","last_active":"2024-01-19T04:17:06.729496+0000","last_peered":"2024-01-19T04:17:06.729496+0000","last_clean":"2024-01-19T04:17:06.729496+0000","last_became_active":"2024-01-19T04:17:04.711508+0000","last_became_peered":"2024-01-19T04:17:04.711508+0000","last_unstale":"2024-01-19T04:17:06.729496+0000","last_undegraded":"2024-01-19T04:17:06.729496+0000","last_fullsized":"2024-01-19T04:17:06.729496+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:50.332339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700130+0000","last_change":"2024-01-19T04:16:51.581861+0000","last_active":"2024-01-19T04:17:04.700130+0000","last_peered":"2024-01-19T04:17:04.700130+0000","last_clean":"2024-01-19T04:17:04.700130+0000","last_became_active":"2024-01-19T04:16:51.581465+0000","last_became_peered":"2024-01-19T04:16:51.581465+0000","last_unstale":"2024-01-19T04:17:04.700130+0000","last_undegraded":"2024-01-19T04:17:04.700130+0000","last_fullsized":"2024-01-19T04:17:04.700130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727994+0000","last_change":"2024-01-19T04:17:04.717627+0000","last_active":"2024-01-19T04:17:04.727994+0000","last_peered":"2024-01-19T04:17:04.727994+0000","last_clean":"2024-01-19T04:17:04.727994+0000","last_became_active":"2024-01-19T04:17:04.717351+0000","last_became_peered":"2024-01-19T04:17:04.717351+0000","last_unstale":"2024-01-19T04:17:04.727994+0000","last_undegraded":"2024-01-19T04:17:04.727994+0000","last_fullsized":"2024-01-19T04:17:04.727994+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:51:25.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698393+0000","last_change":"2024-01-19T04:16:51.589385+0000","last_active":"2024-01-19T04:17:04.698393+0000","last_peered":"2024-01-19T04:17:04.698393+0000","last_clean":"2024-01-19T04:17:04.698393+0000","last_became_active":"2024-01-19T04:16:51.586748+0000","last_became_peered":"2024-01-19T04:16:51.586748+0000","last_unstale":"2024-01-19T04:17:04.698393+0000","last_undegraded":"2024-01-19T04:17:04.698393+0000","last_fullsized":"2024-01-19T04:17:04.698393+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:17:50.471394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709595+0000","last_change":"2024-01-19T04:17:04.714398+0000","last_active":"2024-01-19T04:17:05.709595+0000","last_peered":"2024-01-19T04:17:05.709595+0000","last_clean":"2024-01-19T04:17:05.709595+0000","last_became_active":"2024-01-19T04:17:04.713488+0000","last_became_peered":"2024-01-19T04:17:04.713488+0000","last_unstale":"2024-01-19T04:17:05.709595+0000","last_undegraded":"2024-01-19T04:17:05.709595+0000","last_fullsized":"2024-01-19T04:17:05.709595+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:16.431064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702978+0000","last_change":"2024-01-19T04:16:51.576164+0000","last_active":"2024-01-19T04:17:03.702978+0000","last_peered":"2024-01-19T04:17:03.702978+0000","last_clean":"2024-01-19T04:17:03.702978+0000","last_became_active":"2024-01-19T04:16:51.575615+0000","last_became_peered":"2024-01-19T04:16:51.575615+0000","last_unstale":"2024-01-19T04:17:03.702978+0000","last_undegraded":"2024-01-19T04:17:03.702978+0000","last_fullsized":"2024-01-19T04:17:03.702978+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.730280+0000","last_change":"2024-01-19T04:17:04.709853+0000","last_active":"2024-01-19T04:17:06.730280+0000","last_peered":"2024-01-19T04:17:06.730280+0000","last_clean":"2024-01-19T04:17:06.730280+0000","last_became_active":"2024-01-19T04:17:04.709465+0000","last_became_peered":"2024-01-19T04:17:04.709465+0000","last_unstale":"2024-01-19T04:17:06.730280+0000","last_undegraded":"2024-01-19T04:17:06.730280+0000","last_fullsized":"2024-01-19T04:17:06.730280+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:00.108140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705399+0000","last_change":"2024-01-19T04:16:51.587440+0000","last_active":"2024-01-19T04:17:04.705399+0000","last_peered":"2024-01-19T04:17:04.705399+0000","last_clean":"2024-01-19T04:17:04.705399+0000","last_became_active":"2024-01-19T04:16:51.584713+0000","last_became_peered":"2024-01-19T04:16:51.584713+0000","last_unstale":"2024-01-19T04:17:04.705399+0000","last_undegraded":"2024-01-19T04:17:04.705399+0000","last_fullsized":"2024-01-19T04:17:04.705399+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:19.082622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743841+0000","last_change":"2024-01-19T04:17:04.723661+0000","last_active":"2024-01-19T04:17:06.743841+0000","last_peered":"2024-01-19T04:17:06.743841+0000","last_clean":"2024-01-19T04:17:06.743841+0000","last_became_active":"2024-01-19T04:17:04.723415+0000","last_became_peered":"2024-01-19T04:17:04.723415+0000","last_unstale":"2024-01-19T04:17:06.743841+0000","last_undegraded":"2024-01-19T04:17:06.743841+0000","last_fullsized":"2024-01-19T04:17:06.743841+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.021270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696903+0000","last_change":"2024-01-19T04:16:51.584822+0000","last_active":"2024-01-19T04:17:04.696903+0000","last_peered":"2024-01-19T04:17:04.696903+0000","last_clean":"2024-01-19T04:17:04.696903+0000","last_became_active":"2024-01-19T04:16:51.584562+0000","last_became_peered":"2024-01-19T04:16:51.584562+0000","last_unstale":"2024-01-19T04:17:04.696903+0000","last_undegraded":"2024-01-19T04:17:04.696903+0000","last_fullsized":"2024-01-19T04:17:04.696903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:42.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724892+0000","last_change":"2024-01-19T04:17:04.716882+0000","last_active":"2024-01-19T04:17:04.724892+0000","last_peered":"2024-01-19T04:17:04.724892+0000","last_clean":"2024-01-19T04:17:04.724892+0000","last_became_active":"2024-01-19T04:17:04.713277+0000","last_became_peered":"2024-01-19T04:17:04.713277+0000","last_unstale":"2024-01-19T04:17:04.724892+0000","last_undegraded":"2024-01-19T04:17:04.724892+0000","last_fullsized":"2024-01-19T04:17:04.724892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702137+0000","last_change":"2024-01-19T04:16:51.577212+0000","last_active":"2024-01-19T04:17:03.702137+0000","last_peered":"2024-01-19T04:17:03.702137+0000","last_clean":"2024-01-19T04:17:03.702137+0000","last_became_active":"2024-01-19T04:16:51.576909+0000","last_became_peered":"2024-01-19T04:16:51.576909+0000","last_unstale":"2024-01-19T04:17:03.702137+0000","last_undegraded":"2024-01-19T04:17:03.702137+0000","last_fullsized":"2024-01-19T04:17:03.702137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732282+0000","last_change":"2024-01-19T04:17:04.730136+0000","last_active":"2024-01-19T04:17:04.732282+0000","last_peered":"2024-01-19T04:17:04.732282+0000","last_clean":"2024-01-19T04:17:04.732282+0000","last_became_active":"2024-01-19T04:17:04.729830+0000","last_became_peered":"2024-01-19T04:17:04.729830+0000","last_unstale":"2024-01-19T04:17:04.732282+0000","last_undegraded":"2024-01-19T04:17:04.732282+0000","last_fullsized":"2024-01-19T04:17:04.732282+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695154+0000","last_change":"2024-01-19T04:16:51.576501+0000","last_active":"2024-01-19T04:17:04.695154+0000","last_peered":"2024-01-19T04:17:04.695154+0000","last_clean":"2024-01-19T04:17:04.695154+0000","last_became_active":"2024-01-19T04:16:51.570654+0000","last_became_peered":"2024-01-19T04:16:51.570654+0000","last_unstale":"2024-01-19T04:17:04.695154+0000","last_undegraded":"2024-01-19T04:17:04.695154+0000","last_fullsized":"2024-01-19T04:17:04.695154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:47:50.383122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.706465+0000","last_change":"2024-01-19T04:17:04.702550+0000","last_active":"2024-01-19T04:17:04.706465+0000","last_peered":"2024-01-19T04:17:04.706465+0000","last_clean":"2024-01-19T04:17:04.706465+0000","last_became_active":"2024-01-19T04:17:04.702274+0000","last_became_peered":"2024-01-19T04:17:04.702274+0000","last_unstale":"2024-01-19T04:17:04.706465+0000","last_undegraded":"2024-01-19T04:17:04.706465+0000","last_fullsized":"2024-01-19T04:17:04.706465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:20.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700083+0000","last_change":"2024-01-19T04:16:51.581241+0000","last_active":"2024-01-19T04:17:03.700083+0000","last_peered":"2024-01-19T04:17:03.700083+0000","last_clean":"2024-01-19T04:17:03.700083+0000","last_became_active":"2024-01-19T04:16:51.580556+0000","last_became_peered":"2024-01-19T04:16:51.580556+0000","last_unstale":"2024-01-19T04:17:03.700083+0000","last_undegraded":"2024-01-19T04:17:03.700083+0000","last_fullsized":"2024-01-19T04:17:03.700083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:08.881391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716708+0000","last_change":"2024-01-19T04:17:04.709401+0000","last_active":"2024-01-19T04:17:04.716708+0000","last_peered":"2024-01-19T04:17:04.716708+0000","last_clean":"2024-01-19T04:17:04.716708+0000","last_became_active":"2024-01-19T04:17:04.709156+0000","last_became_peered":"2024-01-19T04:17:04.709156+0000","last_unstale":"2024-01-19T04:17:04.716708+0000","last_undegraded":"2024-01-19T04:17:04.716708+0000","last_fullsized":"2024-01-19T04:17:04.716708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:21.586290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701902+0000","last_change":"2024-01-19T04:16:51.579937+0000","last_active":"2024-01-19T04:17:03.701902+0000","last_peered":"2024-01-19T04:17:03.701902+0000","last_clean":"2024-01-19T04:17:03.701902+0000","last_became_active":"2024-01-19T04:16:51.579649+0000","last_became_peered":"2024-01-19T04:16:51.579649+0000","last_unstale":"2024-01-19T04:17:03.701902+0000","last_undegraded":"2024-01-19T04:17:03.701902+0000","last_fullsized":"2024-01-19T04:17:03.701902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:34.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924294+0000","last_change":"2024-01-19T04:17:04.712711+0000","last_active":"2024-01-19T04:17:06.924294+0000","last_peered":"2024-01-19T04:17:06.924294+0000","last_clean":"2024-01-19T04:17:06.924294+0000","last_became_active":"2024-01-19T04:17:04.712411+0000","last_became_peered":"2024-01-19T04:17:04.712411+0000","last_unstale":"2024-01-19T04:17:06.924294+0000","last_undegraded":"2024-01-19T04:17:06.924294+0000","last_fullsized":"2024-01-19T04:17:06.924294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:51:57.520659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705659+0000","last_change":"2024-01-19T04:16:51.578912+0000","last_active":"2024-01-19T04:17:04.705659+0000","last_peered":"2024-01-19T04:17:04.705659+0000","last_clean":"2024-01-19T04:17:04.705659+0000","last_became_active":"2024-01-19T04:16:51.578643+0000","last_became_peered":"2024-01-19T04:16:51.578643+0000","last_unstale":"2024-01-19T04:17:04.705659+0000","last_undegraded":"2024-01-19T04:17:04.705659+0000","last_fullsized":"2024-01-19T04:17:04.705659+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:23.111411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721525+0000","last_change":"2024-01-19T04:17:04.713886+0000","last_active":"2024-01-19T04:17:04.721525+0000","last_peered":"2024-01-19T04:17:04.721525+0000","last_clean":"2024-01-19T04:17:04.721525+0000","last_became_active":"2024-01-19T04:17:04.713640+0000","last_became_peered":"2024-01-19T04:17:04.713640+0000","last_unstale":"2024-01-19T04:17:04.721525+0000","last_undegraded":"2024-01-19T04:17:04.721525+0000","last_fullsized":"2024-01-19T04:17:04.721525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:32.413236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703417+0000","last_change":"2024-01-19T04:16:51.573193+0000","last_active":"2024-01-19T04:17:03.703417+0000","last_peered":"2024-01-19T04:17:03.703417+0000","last_clean":"2024-01-19T04:17:03.703417+0000","last_became_active":"2024-01-19T04:16:51.572674+0000","last_became_peered":"2024-01-19T04:16:51.572674+0000","last_unstale":"2024-01-19T04:17:03.703417+0000","last_undegraded":"2024-01-19T04:17:03.703417+0000","last_fullsized":"2024-01-19T04:17:03.703417+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710812+0000","last_change":"2024-01-19T04:17:04.707630+0000","last_active":"2024-01-19T04:17:04.710812+0000","last_peered":"2024-01-19T04:17:04.710812+0000","last_clean":"2024-01-19T04:17:04.710812+0000","last_became_active":"2024-01-19T04:17:04.707287+0000","last_became_peered":"2024-01-19T04:17:04.707287+0000","last_unstale":"2024-01-19T04:17:04.710812+0000","last_undegraded":"2024-01-19T04:17:04.710812+0000","last_fullsized":"2024-01-19T04:17:04.710812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:40.576911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702366+0000","last_change":"2024-01-19T04:16:51.586794+0000","last_active":"2024-01-19T04:17:04.702366+0000","last_peered":"2024-01-19T04:17:04.702366+0000","last_clean":"2024-01-19T04:17:04.702366+0000","last_became_active":"2024-01-19T04:16:51.582729+0000","last_became_peered":"2024-01-19T04:16:51.582729+0000","last_unstale":"2024-01-19T04:17:04.702366+0000","last_undegraded":"2024-01-19T04:17:04.702366+0000","last_fullsized":"2024-01-19T04:17:04.702366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730997+0000","last_change":"2024-01-19T04:17:04.726864+0000","last_active":"2024-01-19T04:17:04.730997+0000","last_peered":"2024-01-19T04:17:04.730997+0000","last_clean":"2024-01-19T04:17:04.730997+0000","last_became_active":"2024-01-19T04:17:04.726530+0000","last_became_peered":"2024-01-19T04:17:04.726530+0000","last_unstale":"2024-01-19T04:17:04.730997+0000","last_undegraded":"2024-01-19T04:17:04.730997+0000","last_fullsized":"2024-01-19T04:17:04.730997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705459+0000","last_change":"2024-01-19T04:16:51.568656+0000","last_active":"2024-01-19T04:17:04.705459+0000","last_peered":"2024-01-19T04:17:04.705459+0000","last_clean":"2024-01-19T04:17:04.705459+0000","last_became_active":"2024-01-19T04:16:51.568371+0000","last_became_peered":"2024-01-19T04:16:51.568371+0000","last_unstale":"2024-01-19T04:17:04.705459+0000","last_undegraded":"2024-01-19T04:17:04.705459+0000","last_fullsized":"2024-01-19T04:17:04.705459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:42.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719165+0000","last_change":"2024-01-19T04:17:04.713110+0000","last_active":"2024-01-19T04:17:04.719165+0000","last_peered":"2024-01-19T04:17:04.719165+0000","last_clean":"2024-01-19T04:17:04.719165+0000","last_became_active":"2024-01-19T04:17:04.712838+0000","last_became_peered":"2024-01-19T04:17:04.712838+0000","last_unstale":"2024-01-19T04:17:04.719165+0000","last_undegraded":"2024-01-19T04:17:04.719165+0000","last_fullsized":"2024-01-19T04:17:04.719165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695186+0000","last_change":"2024-01-19T04:16:51.583324+0000","last_active":"2024-01-19T04:17:04.695186+0000","last_peered":"2024-01-19T04:17:04.695186+0000","last_clean":"2024-01-19T04:17:04.695186+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:04.695186+0000","last_undegraded":"2024-01-19T04:17:04.695186+0000","last_fullsized":"2024-01-19T04:17:04.695186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:01.837432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733715+0000","last_change":"2024-01-19T04:17:04.727034+0000","last_active":"2024-01-19T04:17:04.733715+0000","last_peered":"2024-01-19T04:17:04.733715+0000","last_clean":"2024-01-19T04:17:04.733715+0000","last_became_active":"2024-01-19T04:17:04.726442+0000","last_became_peered":"2024-01-19T04:17:04.726442+0000","last_unstale":"2024-01-19T04:17:04.733715+0000","last_undegraded":"2024-01-19T04:17:04.733715+0000","last_fullsized":"2024-01-19T04:17:04.733715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.021270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700737+0000","last_change":"2024-01-19T04:16:51.577511+0000","last_active":"2024-01-19T04:17:03.700737+0000","last_peered":"2024-01-19T04:17:03.700737+0000","last_clean":"2024-01-19T04:17:03.700737+0000","last_became_active":"2024-01-19T04:16:51.577076+0000","last_became_peered":"2024-01-19T04:16:51.577076+0000","last_unstale":"2024-01-19T04:17:03.700737+0000","last_undegraded":"2024-01-19T04:17:03.700737+0000","last_fullsized":"2024-01-19T04:17:03.700737+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924130+0000","last_change":"2024-01-19T04:17:04.713152+0000","last_active":"2024-01-19T04:17:06.924130+0000","last_peered":"2024-01-19T04:17:06.924130+0000","last_clean":"2024-01-19T04:17:06.924130+0000","last_became_active":"2024-01-19T04:17:04.712882+0000","last_became_peered":"2024-01-19T04:17:04.712882+0000","last_unstale":"2024-01-19T04:17:06.924130+0000","last_undegraded":"2024-01-19T04:17:06.924130+0000","last_fullsized":"2024-01-19T04:17:06.924130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:02.470278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705151+0000","last_change":"2024-01-19T04:16:51.578248+0000","last_active":"2024-01-19T04:17:04.705151+0000","last_peered":"2024-01-19T04:17:04.705151+0000","last_clean":"2024-01-19T04:17:04.705151+0000","last_became_active":"2024-01-19T04:16:51.577983+0000","last_became_peered":"2024-01-19T04:16:51.577983+0000","last_unstale":"2024-01-19T04:17:04.705151+0000","last_undegraded":"2024-01-19T04:17:04.705151+0000","last_fullsized":"2024-01-19T04:17:04.705151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:14.895654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.730956+0000","last_change":"2024-01-19T04:17:04.727249+0000","last_active":"2024-01-19T04:17:04.730956+0000","last_peered":"2024-01-19T04:17:04.730956+0000","last_clean":"2024-01-19T04:17:04.730956+0000","last_became_active":"2024-01-19T04:17:04.726674+0000","last_became_peered":"2024-01-19T04:17:04.726674+0000","last_unstale":"2024-01-19T04:17:04.730956+0000","last_undegraded":"2024-01-19T04:17:04.730956+0000","last_fullsized":"2024-01-19T04:17:04.730956+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:48:53.825553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700337+0000","last_change":"2024-01-19T04:16:51.586614+0000","last_active":"2024-01-19T04:17:04.700337+0000","last_peered":"2024-01-19T04:17:04.700337+0000","last_clean":"2024-01-19T04:17:04.700337+0000","last_became_active":"2024-01-19T04:16:51.586104+0000","last_became_peered":"2024-01-19T04:16:51.586104+0000","last_unstale":"2024-01-19T04:17:04.700337+0000","last_undegraded":"2024-01-19T04:17:04.700337+0000","last_fullsized":"2024-01-19T04:17:04.700337+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734509+0000","last_change":"2024-01-19T04:17:04.730684+0000","last_active":"2024-01-19T04:17:04.734509+0000","last_peered":"2024-01-19T04:17:04.734509+0000","last_clean":"2024-01-19T04:17:04.734509+0000","last_became_active":"2024-01-19T04:17:04.729893+0000","last_became_peered":"2024-01-19T04:17:04.729893+0000","last_unstale":"2024-01-19T04:17:04.734509+0000","last_undegraded":"2024-01-19T04:17:04.734509+0000","last_fullsized":"2024-01-19T04:17:04.734509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:39.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733676+0000","last_change":"2024-01-19T04:17:03.712060+0000","last_active":"2024-01-19T04:17:04.733676+0000","last_peered":"2024-01-19T04:17:04.733676+0000","last_clean":"2024-01-19T04:17:04.733676+0000","last_became_active":"2024-01-19T04:17:03.711745+0000","last_became_peered":"2024-01-19T04:17:03.711745+0000","last_unstale":"2024-01-19T04:17:04.733676+0000","last_undegraded":"2024-01-19T04:17:04.733676+0000","last_fullsized":"2024-01-19T04:17:04.733676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:39.750994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702199+0000","last_change":"2024-01-19T04:16:51.575044+0000","last_active":"2024-01-19T04:17:04.702199+0000","last_peered":"2024-01-19T04:17:04.702199+0000","last_clean":"2024-01-19T04:17:04.702199+0000","last_became_active":"2024-01-19T04:16:51.574674+0000","last_became_peered":"2024-01-19T04:16:51.574674+0000","last_unstale":"2024-01-19T04:17:04.702199+0000","last_undegraded":"2024-01-19T04:17:04.702199+0000","last_fullsized":"2024-01-19T04:17:04.702199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701686+0000","last_change":"2024-01-19T04:16:50.572149+0000","last_active":"2024-01-19T04:17:04.701686+0000","last_peered":"2024-01-19T04:17:04.701686+0000","last_clean":"2024-01-19T04:17:04.701686+0000","last_became_active":"2024-01-19T04:16:50.571648+0000","last_became_peered":"2024-01-19T04:16:50.571648+0000","last_unstale":"2024-01-19T04:17:04.701686+0000","last_undegraded":"2024-01-19T04:17:04.701686+0000","last_fullsized":"2024-01-19T04:17:04.701686+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728547+0000","last_change":"2024-01-19T04:17:04.718498+0000","last_active":"2024-01-19T04:17:04.728547+0000","last_peered":"2024-01-19T04:17:04.728547+0000","last_clean":"2024-01-19T04:17:04.728547+0000","last_became_active":"2024-01-19T04:17:04.717566+0000","last_became_peered":"2024-01-19T04:17:04.717566+0000","last_unstale":"2024-01-19T04:17:04.728547+0000","last_undegraded":"2024-01-19T04:17:04.728547+0000","last_fullsized":"2024-01-19T04:17:04.728547+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:53:22.658664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732753+0000","last_change":"2024-01-19T04:17:03.709880+0000","last_active":"2024-01-19T04:17:04.732753+0000","last_peered":"2024-01-19T04:17:04.732753+0000","last_clean":"2024-01-19T04:17:04.732753+0000","last_became_active":"2024-01-19T04:17:03.709543+0000","last_became_peered":"2024-01-19T04:17:03.709543+0000","last_unstale":"2024-01-19T04:17:04.732753+0000","last_undegraded":"2024-01-19T04:17:04.732753+0000","last_fullsized":"2024-01-19T04:17:04.732753+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:31:11.411184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698745+0000","last_change":"2024-01-19T04:16:51.590705+0000","last_active":"2024-01-19T04:17:04.698745+0000","last_peered":"2024-01-19T04:17:04.698745+0000","last_clean":"2024-01-19T04:17:04.698745+0000","last_became_active":"2024-01-19T04:16:51.590304+0000","last_became_peered":"2024-01-19T04:16:51.590304+0000","last_unstale":"2024-01-19T04:17:04.698745+0000","last_undegraded":"2024-01-19T04:17:04.698745+0000","last_fullsized":"2024-01-19T04:17:04.698745+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:51.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698137+0000","last_change":"2024-01-19T04:16:50.567145+0000","last_active":"2024-01-19T04:17:04.698137+0000","last_peered":"2024-01-19T04:17:04.698137+0000","last_clean":"2024-01-19T04:17:04.698137+0000","last_became_active":"2024-01-19T04:16:50.566844+0000","last_became_peered":"2024-01-19T04:16:50.566844+0000","last_unstale":"2024-01-19T04:17:04.698137+0000","last_undegraded":"2024-01-19T04:17:04.698137+0000","last_fullsized":"2024-01-19T04:17:04.698137+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:07.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735309+0000","last_change":"2024-01-19T04:17:04.732829+0000","last_active":"2024-01-19T04:17:04.735309+0000","last_peered":"2024-01-19T04:17:04.735309+0000","last_clean":"2024-01-19T04:17:04.735309+0000","last_became_active":"2024-01-19T04:17:04.732552+0000","last_became_peered":"2024-01-19T04:17:04.732552+0000","last_unstale":"2024-01-19T04:17:04.735309+0000","last_undegraded":"2024-01-19T04:17:04.735309+0000","last_fullsized":"2024-01-19T04:17:04.735309+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:56:58.089850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727954+0000","last_change":"2024-01-19T04:17:03.713210+0000","last_active":"2024-01-19T04:17:04.727954+0000","last_peered":"2024-01-19T04:17:04.727954+0000","last_clean":"2024-01-19T04:17:04.727954+0000","last_became_active":"2024-01-19T04:17:03.712941+0000","last_became_peered":"2024-01-19T04:17:03.712941+0000","last_unstale":"2024-01-19T04:17:04.727954+0000","last_undegraded":"2024-01-19T04:17:04.727954+0000","last_fullsized":"2024-01-19T04:17:04.727954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701314+0000","last_change":"2024-01-19T04:16:51.573140+0000","last_active":"2024-01-19T04:17:04.701314+0000","last_peered":"2024-01-19T04:17:04.701314+0000","last_clean":"2024-01-19T04:17:04.701314+0000","last_became_active":"2024-01-19T04:16:51.572831+0000","last_became_peered":"2024-01-19T04:16:51.572831+0000","last_unstale":"2024-01-19T04:17:04.701314+0000","last_undegraded":"2024-01-19T04:17:04.701314+0000","last_fullsized":"2024-01-19T04:17:04.701314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702610+0000","last_change":"2024-01-19T04:16:50.563884+0000","last_active":"2024-01-19T04:17:04.702610+0000","last_peered":"2024-01-19T04:17:04.702610+0000","last_clean":"2024-01-19T04:17:04.702610+0000","last_became_active":"2024-01-19T04:16:50.563631+0000","last_became_peered":"2024-01-19T04:16:50.563631+0000","last_unstale":"2024-01-19T04:17:04.702610+0000","last_undegraded":"2024-01-19T04:17:04.702610+0000","last_fullsized":"2024-01-19T04:17:04.702610+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.730350+0000","last_change":"2024-01-19T04:17:04.716858+0000","last_active":"2024-01-19T04:17:06.730350+0000","last_peered":"2024-01-19T04:17:06.730350+0000","last_clean":"2024-01-19T04:17:06.730350+0000","last_became_active":"2024-01-19T04:17:04.712316+0000","last_became_peered":"2024-01-19T04:17:04.712316+0000","last_unstale":"2024-01-19T04:17:06.730350+0000","last_undegraded":"2024-01-19T04:17:06.730350+0000","last_fullsized":"2024-01-19T04:17:06.730350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:31:12.417397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.723980+0000","last_change":"2024-01-19T04:17:03.710296+0000","last_active":"2024-01-19T04:17:04.723980+0000","last_peered":"2024-01-19T04:17:04.723980+0000","last_clean":"2024-01-19T04:17:04.723980+0000","last_became_active":"2024-01-19T04:17:03.710001+0000","last_became_peered":"2024-01-19T04:17:03.710001+0000","last_unstale":"2024-01-19T04:17:04.723980+0000","last_undegraded":"2024-01-19T04:17:04.723980+0000","last_fullsized":"2024-01-19T04:17:04.723980+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:03.653501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702458+0000","last_change":"2024-01-19T04:16:51.574394+0000","last_active":"2024-01-19T04:17:04.702458+0000","last_peered":"2024-01-19T04:17:04.702458+0000","last_clean":"2024-01-19T04:17:04.702458+0000","last_became_active":"2024-01-19T04:16:51.573866+0000","last_became_peered":"2024-01-19T04:16:51.573866+0000","last_unstale":"2024-01-19T04:17:04.702458+0000","last_undegraded":"2024-01-19T04:17:04.702458+0000","last_fullsized":"2024-01-19T04:17:04.702458+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703621+0000","last_change":"2024-01-19T04:16:50.571503+0000","last_active":"2024-01-19T04:17:03.703621+0000","last_peered":"2024-01-19T04:17:03.703621+0000","last_clean":"2024-01-19T04:17:03.703621+0000","last_became_active":"2024-01-19T04:16:50.571066+0000","last_became_peered":"2024-01-19T04:16:50.571066+0000","last_unstale":"2024-01-19T04:17:03.703621+0000","last_undegraded":"2024-01-19T04:17:03.703621+0000","last_fullsized":"2024-01-19T04:17:03.703621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729208+0000","last_change":"2024-01-19T04:17:04.713600+0000","last_active":"2024-01-19T04:17:06.729208+0000","last_peered":"2024-01-19T04:17:06.729208+0000","last_clean":"2024-01-19T04:17:06.729208+0000","last_became_active":"2024-01-19T04:17:04.710781+0000","last_became_peered":"2024-01-19T04:17:04.710781+0000","last_unstale":"2024-01-19T04:17:06.729208+0000","last_undegraded":"2024-01-19T04:17:06.729208+0000","last_fullsized":"2024-01-19T04:17:06.729208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:20:50.623112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699133+0000","last_change":"2024-01-19T04:17:03.705700+0000","last_active":"2024-01-19T04:17:04.699133+0000","last_peered":"2024-01-19T04:17:04.699133+0000","last_clean":"2024-01-19T04:17:04.699133+0000","last_became_active":"2024-01-19T04:17:03.705353+0000","last_became_peered":"2024-01-19T04:17:03.705353+0000","last_unstale":"2024-01-19T04:17:04.699133+0000","last_undegraded":"2024-01-19T04:17:04.699133+0000","last_fullsized":"2024-01-19T04:17:04.699133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:10.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695238+0000","last_change":"2024-01-19T04:16:51.573659+0000","last_active":"2024-01-19T04:17:04.695238+0000","last_peered":"2024-01-19T04:17:04.695238+0000","last_clean":"2024-01-19T04:17:04.695238+0000","last_became_active":"2024-01-19T04:16:51.570362+0000","last_became_peered":"2024-01-19T04:16:51.570362+0000","last_unstale":"2024-01-19T04:17:04.695238+0000","last_undegraded":"2024-01-19T04:17:04.695238+0000","last_fullsized":"2024-01-19T04:17:04.695238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:12.091637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697876+0000","last_change":"2024-01-19T04:16:50.562830+0000","last_active":"2024-01-19T04:17:03.697876+0000","last_peered":"2024-01-19T04:17:03.697876+0000","last_clean":"2024-01-19T04:17:03.697876+0000","last_became_active":"2024-01-19T04:16:50.562528+0000","last_became_peered":"2024-01-19T04:16:50.562528+0000","last_unstale":"2024-01-19T04:17:03.697876+0000","last_undegraded":"2024-01-19T04:17:03.697876+0000","last_fullsized":"2024-01-19T04:17:03.697876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:03.641474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709508+0000","last_change":"2024-01-19T04:17:04.707403+0000","last_active":"2024-01-19T04:17:05.709508+0000","last_peered":"2024-01-19T04:17:05.709508+0000","last_clean":"2024-01-19T04:17:05.709508+0000","last_became_active":"2024-01-19T04:17:04.707152+0000","last_became_peered":"2024-01-19T04:17:04.707152+0000","last_unstale":"2024-01-19T04:17:05.709508+0000","last_undegraded":"2024-01-19T04:17:05.709508+0000","last_fullsized":"2024-01-19T04:17:05.709508+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:26.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.703400+0000","last_change":"2024-01-19T04:17:03.704020+0000","last_active":"2024-01-19T04:17:04.703400+0000","last_peered":"2024-01-19T04:17:04.703400+0000","last_clean":"2024-01-19T04:17:04.703400+0000","last_became_active":"2024-01-19T04:17:03.703750+0000","last_became_peered":"2024-01-19T04:17:03.703750+0000","last_unstale":"2024-01-19T04:17:04.703400+0000","last_undegraded":"2024-01-19T04:17:04.703400+0000","last_fullsized":"2024-01-19T04:17:04.703400+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:47.046120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694990+0000","last_change":"2024-01-19T04:16:51.582274+0000","last_active":"2024-01-19T04:17:04.694990+0000","last_peered":"2024-01-19T04:17:04.694990+0000","last_clean":"2024-01-19T04:17:04.694990+0000","last_became_active":"2024-01-19T04:16:51.581164+0000","last_became_peered":"2024-01-19T04:16:51.581164+0000","last_unstale":"2024-01-19T04:17:04.694990+0000","last_undegraded":"2024-01-19T04:17:04.694990+0000","last_fullsized":"2024-01-19T04:17:04.694990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:47.861123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698921+0000","last_change":"2024-01-19T04:16:50.566550+0000","last_active":"2024-01-19T04:17:04.698921+0000","last_peered":"2024-01-19T04:17:04.698921+0000","last_clean":"2024-01-19T04:17:04.698921+0000","last_became_active":"2024-01-19T04:16:50.566278+0000","last_became_peered":"2024-01-19T04:16:50.566278+0000","last_unstale":"2024-01-19T04:17:04.698921+0000","last_undegraded":"2024-01-19T04:17:04.698921+0000","last_fullsized":"2024-01-19T04:17:04.698921+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711170+0000","last_change":"2024-01-19T04:17:04.707638+0000","last_active":"2024-01-19T04:17:04.711170+0000","last_peered":"2024-01-19T04:17:04.711170+0000","last_clean":"2024-01-19T04:17:04.711170+0000","last_became_active":"2024-01-19T04:17:04.707389+0000","last_became_peered":"2024-01-19T04:17:04.707389+0000","last_unstale":"2024-01-19T04:17:04.711170+0000","last_undegraded":"2024-01-19T04:17:04.711170+0000","last_fullsized":"2024-01-19T04:17:04.711170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725642+0000","last_change":"2024-01-19T04:17:03.713411+0000","last_active":"2024-01-19T04:17:04.725642+0000","last_peered":"2024-01-19T04:17:04.725642+0000","last_clean":"2024-01-19T04:17:04.725642+0000","last_became_active":"2024-01-19T04:17:03.712945+0000","last_became_peered":"2024-01-19T04:17:03.712945+0000","last_unstale":"2024-01-19T04:17:04.725642+0000","last_undegraded":"2024-01-19T04:17:04.725642+0000","last_fullsized":"2024-01-19T04:17:04.725642+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:18.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702014+0000","last_change":"2024-01-19T04:16:51.579590+0000","last_active":"2024-01-19T04:17:03.702014+0000","last_peered":"2024-01-19T04:17:03.702014+0000","last_clean":"2024-01-19T04:17:03.702014+0000","last_became_active":"2024-01-19T04:16:51.579242+0000","last_became_peered":"2024-01-19T04:16:51.579242+0000","last_unstale":"2024-01-19T04:17:03.702014+0000","last_undegraded":"2024-01-19T04:17:03.702014+0000","last_fullsized":"2024-01-19T04:17:03.702014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:09.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699654+0000","last_change":"2024-01-19T04:16:50.568633+0000","last_active":"2024-01-19T04:17:03.699654+0000","last_peered":"2024-01-19T04:17:03.699654+0000","last_clean":"2024-01-19T04:17:03.699654+0000","last_became_active":"2024-01-19T04:16:50.568334+0000","last_became_peered":"2024-01-19T04:16:50.568334+0000","last_unstale":"2024-01-19T04:17:03.699654+0000","last_undegraded":"2024-01-19T04:17:03.699654+0000","last_fullsized":"2024-01-19T04:17:03.699654+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.716215+0000","last_change":"2024-01-19T04:17:04.708655+0000","last_active":"2024-01-19T04:17:04.716215+0000","last_peered":"2024-01-19T04:17:04.716215+0000","last_clean":"2024-01-19T04:17:04.716215+0000","last_became_active":"2024-01-19T04:17:04.708364+0000","last_became_peered":"2024-01-19T04:17:04.708364+0000","last_unstale":"2024-01-19T04:17:04.716215+0000","last_undegraded":"2024-01-19T04:17:04.716215+0000","last_fullsized":"2024-01-19T04:17:04.716215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:16.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733062+0000","last_change":"2024-01-19T04:17:03.717810+0000","last_active":"2024-01-19T04:17:04.733062+0000","last_peered":"2024-01-19T04:17:04.733062+0000","last_clean":"2024-01-19T04:17:04.733062+0000","last_became_active":"2024-01-19T04:17:03.717529+0000","last_became_peered":"2024-01-19T04:17:03.717529+0000","last_unstale":"2024-01-19T04:17:04.733062+0000","last_undegraded":"2024-01-19T04:17:04.733062+0000","last_fullsized":"2024-01-19T04:17:04.733062+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:57.511703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695501+0000","last_change":"2024-01-19T04:16:51.585817+0000","last_active":"2024-01-19T04:17:04.695501+0000","last_peered":"2024-01-19T04:17:04.695501+0000","last_clean":"2024-01-19T04:17:04.695501+0000","last_became_active":"2024-01-19T04:16:51.585142+0000","last_became_peered":"2024-01-19T04:16:51.585142+0000","last_unstale":"2024-01-19T04:17:04.695501+0000","last_undegraded":"2024-01-19T04:17:04.695501+0000","last_fullsized":"2024-01-19T04:17:04.695501+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:41.744656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697098+0000","last_change":"2024-01-19T04:16:50.569683+0000","last_active":"2024-01-19T04:17:03.697098+0000","last_peered":"2024-01-19T04:17:03.697098+0000","last_clean":"2024-01-19T04:17:03.697098+0000","last_became_active":"2024-01-19T04:16:50.567925+0000","last_became_peered":"2024-01-19T04:16:50.567925+0000","last_unstale":"2024-01-19T04:17:03.697098+0000","last_undegraded":"2024-01-19T04:17:03.697098+0000","last_fullsized":"2024-01-19T04:17:03.697098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:25.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.720559+0000","last_change":"2024-01-19T04:17:04.714330+0000","last_active":"2024-01-19T04:17:04.720559+0000","last_peered":"2024-01-19T04:17:04.720559+0000","last_clean":"2024-01-19T04:17:04.720559+0000","last_became_active":"2024-01-19T04:17:04.712504+0000","last_became_peered":"2024-01-19T04:17:04.712504+0000","last_unstale":"2024-01-19T04:17:04.720559+0000","last_undegraded":"2024-01-19T04:17:04.720559+0000","last_fullsized":"2024-01-19T04:17:04.720559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:20:39.111262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728964+0000","last_change":"2024-01-19T04:17:03.707765+0000","last_active":"2024-01-19T04:17:04.728964+0000","last_peered":"2024-01-19T04:17:04.728964+0000","last_clean":"2024-01-19T04:17:04.728964+0000","last_became_active":"2024-01-19T04:17:03.707463+0000","last_became_peered":"2024-01-19T04:17:03.707463+0000","last_unstale":"2024-01-19T04:17:04.728964+0000","last_undegraded":"2024-01-19T04:17:04.728964+0000","last_fullsized":"2024-01-19T04:17:04.728964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:30.923295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705625+0000","last_change":"2024-01-19T04:16:51.587058+0000","last_active":"2024-01-19T04:17:03.705625+0000","last_peered":"2024-01-19T04:17:03.705625+0000","last_clean":"2024-01-19T04:17:03.705625+0000","last_became_active":"2024-01-19T04:16:51.577162+0000","last_became_peered":"2024-01-19T04:16:51.577162+0000","last_unstale":"2024-01-19T04:17:03.705625+0000","last_undegraded":"2024-01-19T04:17:03.705625+0000","last_fullsized":"2024-01-19T04:17:03.705625+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:59.277518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701457+0000","last_change":"2024-01-19T04:16:50.568525+0000","last_active":"2024-01-19T04:17:03.701457+0000","last_peered":"2024-01-19T04:17:03.701457+0000","last_clean":"2024-01-19T04:17:03.701457+0000","last_became_active":"2024-01-19T04:16:50.568256+0000","last_became_peered":"2024-01-19T04:16:50.568256+0000","last_unstale":"2024-01-19T04:17:03.701457+0000","last_undegraded":"2024-01-19T04:17:03.701457+0000","last_fullsized":"2024-01-19T04:17:03.701457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729815+0000","last_change":"2024-01-19T04:17:04.719632+0000","last_active":"2024-01-19T04:17:06.729815+0000","last_peered":"2024-01-19T04:17:06.729815+0000","last_clean":"2024-01-19T04:17:06.729815+0000","last_became_active":"2024-01-19T04:17:04.719350+0000","last_became_peered":"2024-01-19T04:17:04.719350+0000","last_unstale":"2024-01-19T04:17:06.729815+0000","last_undegraded":"2024-01-19T04:17:06.729815+0000","last_fullsized":"2024-01-19T04:17:06.729815+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:11.822538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"56'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.731268+0000","last_change":"2024-01-19T04:17:03.705858+0000","last_active":"2024-01-19T04:17:04.731268+0000","last_peered":"2024-01-19T04:17:04.731268+0000","last_clean":"2024-01-19T04:17:04.731268+0000","last_became_active":"2024-01-19T04:17:03.705336+0000","last_became_peered":"2024-01-19T04:17:03.705336+0000","last_unstale":"2024-01-19T04:17:04.731268+0000","last_undegraded":"2024-01-19T04:17:04.731268+0000","last_fullsized":"2024-01-19T04:17:04.731268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:42.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701334+0000","last_change":"2024-01-19T04:16:51.583117+0000","last_active":"2024-01-19T04:17:03.701334+0000","last_peered":"2024-01-19T04:17:03.701334+0000","last_clean":"2024-01-19T04:17:03.701334+0000","last_became_active":"2024-01-19T04:16:51.582850+0000","last_became_peered":"2024-01-19T04:16:51.582850+0000","last_unstale":"2024-01-19T04:17:03.701334+0000","last_undegraded":"2024-01-19T04:17:03.701334+0000","last_fullsized":"2024-01-19T04:17:03.701334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:19.273356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698214+0000","last_change":"2024-01-19T04:16:50.568671+0000","last_active":"2024-01-19T04:17:04.698214+0000","last_peered":"2024-01-19T04:17:04.698214+0000","last_clean":"2024-01-19T04:17:04.698214+0000","last_became_active":"2024-01-19T04:16:50.568385+0000","last_became_peered":"2024-01-19T04:16:50.568385+0000","last_unstale":"2024-01-19T04:17:04.698214+0000","last_undegraded":"2024-01-19T04:17:04.698214+0000","last_fullsized":"2024-01-19T04:17:04.698214+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:51.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.718727+0000","last_change":"2024-01-19T04:17:04.711029+0000","last_active":"2024-01-19T04:17:04.718727+0000","last_peered":"2024-01-19T04:17:04.718727+0000","last_clean":"2024-01-19T04:17:04.718727+0000","last_became_active":"2024-01-19T04:17:04.709892+0000","last_became_peered":"2024-01-19T04:17:04.709892+0000","last_unstale":"2024-01-19T04:17:04.718727+0000","last_undegraded":"2024-01-19T04:17:04.718727+0000","last_fullsized":"2024-01-19T04:17:04.718727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695249+0000","last_change":"2024-01-19T04:17:03.711352+0000","last_active":"2024-01-19T04:17:04.695249+0000","last_peered":"2024-01-19T04:17:04.695249+0000","last_clean":"2024-01-19T04:17:04.695249+0000","last_became_active":"2024-01-19T04:17:03.711063+0000","last_became_peered":"2024-01-19T04:17:03.711063+0000","last_unstale":"2024-01-19T04:17:04.695249+0000","last_undegraded":"2024-01-19T04:17:04.695249+0000","last_fullsized":"2024-01-19T04:17:04.695249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:38.820788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702193+0000","last_change":"2024-01-19T04:16:51.580811+0000","last_active":"2024-01-19T04:17:04.702193+0000","last_peered":"2024-01-19T04:17:04.702193+0000","last_clean":"2024-01-19T04:17:04.702193+0000","last_became_active":"2024-01-19T04:16:51.579990+0000","last_became_peered":"2024-01-19T04:16:51.579990+0000","last_unstale":"2024-01-19T04:17:04.702193+0000","last_undegraded":"2024-01-19T04:17:04.702193+0000","last_fullsized":"2024-01-19T04:17:04.702193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:43:24.773146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701261+0000","last_change":"2024-01-19T04:16:50.569777+0000","last_active":"2024-01-19T04:17:03.701261+0000","last_peered":"2024-01-19T04:17:03.701261+0000","last_clean":"2024-01-19T04:17:03.701261+0000","last_became_active":"2024-01-19T04:16:50.569507+0000","last_became_peered":"2024-01-19T04:16:50.569507+0000","last_unstale":"2024-01-19T04:17:03.701261+0000","last_undegraded":"2024-01-19T04:17:03.701261+0000","last_fullsized":"2024-01-19T04:17:03.701261+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.735294+0000","last_change":"2024-01-19T04:17:04.732838+0000","last_active":"2024-01-19T04:17:04.735294+0000","last_peered":"2024-01-19T04:17:04.735294+0000","last_clean":"2024-01-19T04:17:04.735294+0000","last_became_active":"2024-01-19T04:17:04.732579+0000","last_became_peered":"2024-01-19T04:17:04.732579+0000","last_unstale":"2024-01-19T04:17:04.735294+0000","last_undegraded":"2024-01-19T04:17:04.735294+0000","last_fullsized":"2024-01-19T04:17:04.735294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:26.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701729+0000","last_change":"2024-01-19T04:17:03.710016+0000","last_active":"2024-01-19T04:17:04.701729+0000","last_peered":"2024-01-19T04:17:04.701729+0000","last_clean":"2024-01-19T04:17:04.701729+0000","last_became_active":"2024-01-19T04:17:03.709659+0000","last_became_peered":"2024-01-19T04:17:03.709659+0000","last_unstale":"2024-01-19T04:17:04.701729+0000","last_undegraded":"2024-01-19T04:17:04.701729+0000","last_fullsized":"2024-01-19T04:17:04.701729+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:35.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701014+0000","last_change":"2024-01-19T04:16:51.582425+0000","last_active":"2024-01-19T04:17:03.701014+0000","last_peered":"2024-01-19T04:17:03.701014+0000","last_clean":"2024-01-19T04:17:03.701014+0000","last_became_active":"2024-01-19T04:16:51.582136+0000","last_became_peered":"2024-01-19T04:16:51.582136+0000","last_unstale":"2024-01-19T04:17:03.701014+0000","last_undegraded":"2024-01-19T04:17:03.701014+0000","last_fullsized":"2024-01-19T04:17:03.701014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702836+0000","last_change":"2024-01-19T04:16:50.563850+0000","last_active":"2024-01-19T04:17:03.702836+0000","last_peered":"2024-01-19T04:17:03.702836+0000","last_clean":"2024-01-19T04:17:03.702836+0000","last_became_active":"2024-01-19T04:16:50.563492+0000","last_became_peered":"2024-01-19T04:16:50.563492+0000","last_unstale":"2024-01-19T04:17:03.702836+0000","last_undegraded":"2024-01-19T04:17:03.702836+0000","last_fullsized":"2024-01-19T04:17:03.702836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:50.446354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709559+0000","last_change":"2024-01-19T04:17:04.719917+0000","last_active":"2024-01-19T04:17:05.709559+0000","last_peered":"2024-01-19T04:17:05.709559+0000","last_clean":"2024-01-19T04:17:05.709559+0000","last_became_active":"2024-01-19T04:17:04.719594+0000","last_became_peered":"2024-01-19T04:17:04.719594+0000","last_unstale":"2024-01-19T04:17:05.709559+0000","last_undegraded":"2024-01-19T04:17:05.709559+0000","last_fullsized":"2024-01-19T04:17:05.709559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:04:22.069072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702056+0000","last_change":"2024-01-19T04:17:03.713104+0000","last_active":"2024-01-19T04:17:04.702056+0000","last_peered":"2024-01-19T04:17:04.702056+0000","last_clean":"2024-01-19T04:17:04.702056+0000","last_became_active":"2024-01-19T04:17:03.712774+0000","last_became_peered":"2024-01-19T04:17:03.712774+0000","last_unstale":"2024-01-19T04:17:04.702056+0000","last_undegraded":"2024-01-19T04:17:04.702056+0000","last_fullsized":"2024-01-19T04:17:04.702056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700474+0000","last_change":"2024-01-19T04:16:51.579099+0000","last_active":"2024-01-19T04:17:03.700474+0000","last_peered":"2024-01-19T04:17:03.700474+0000","last_clean":"2024-01-19T04:17:03.700474+0000","last_became_active":"2024-01-19T04:16:51.578809+0000","last_became_peered":"2024-01-19T04:16:51.578809+0000","last_unstale":"2024-01-19T04:17:03.700474+0000","last_undegraded":"2024-01-19T04:17:03.700474+0000","last_fullsized":"2024-01-19T04:17:03.700474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695098+0000","last_change":"2024-01-19T04:16:50.565530+0000","last_active":"2024-01-19T04:17:04.695098+0000","last_peered":"2024-01-19T04:17:04.695098+0000","last_clean":"2024-01-19T04:17:04.695098+0000","last_became_active":"2024-01-19T04:16:50.565191+0000","last_became_peered":"2024-01-19T04:16:50.565191+0000","last_unstale":"2024-01-19T04:17:04.695098+0000","last_undegraded":"2024-01-19T04:17:04.695098+0000","last_fullsized":"2024-01-19T04:17:04.695098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:14.286352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729425+0000","last_change":"2024-01-19T04:17:04.711115+0000","last_active":"2024-01-19T04:17:06.729425+0000","last_peered":"2024-01-19T04:17:06.729425+0000","last_clean":"2024-01-19T04:17:06.729425+0000","last_became_active":"2024-01-19T04:17:04.710807+0000","last_became_peered":"2024-01-19T04:17:04.710807+0000","last_unstale":"2024-01-19T04:17:06.729425+0000","last_undegraded":"2024-01-19T04:17:06.729425+0000","last_fullsized":"2024-01-19T04:17:06.729425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:41:01.910770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.731424+0000","last_change":"2024-01-19T04:17:03.711561+0000","last_active":"2024-01-19T04:17:04.731424+0000","last_peered":"2024-01-19T04:17:04.731424+0000","last_clean":"2024-01-19T04:17:04.731424+0000","last_became_active":"2024-01-19T04:17:03.711261+0000","last_became_peered":"2024-01-19T04:17:03.711261+0000","last_unstale":"2024-01-19T04:17:04.731424+0000","last_undegraded":"2024-01-19T04:17:04.731424+0000","last_fullsized":"2024-01-19T04:17:04.731424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:19.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702246+0000","last_change":"2024-01-19T04:16:51.587155+0000","last_active":"2024-01-19T04:17:03.702246+0000","last_peered":"2024-01-19T04:17:03.702246+0000","last_clean":"2024-01-19T04:17:03.702246+0000","last_became_active":"2024-01-19T04:16:51.584989+0000","last_became_peered":"2024-01-19T04:16:51.584989+0000","last_unstale":"2024-01-19T04:17:03.702246+0000","last_undegraded":"2024-01-19T04:17:03.702246+0000","last_fullsized":"2024-01-19T04:17:03.702246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704254+0000","last_change":"2024-01-19T04:16:50.566824+0000","last_active":"2024-01-19T04:17:03.704254+0000","last_peered":"2024-01-19T04:17:03.704254+0000","last_clean":"2024-01-19T04:17:03.704254+0000","last_became_active":"2024-01-19T04:16:50.566530+0000","last_became_peered":"2024-01-19T04:16:50.566530+0000","last_unstale":"2024-01-19T04:17:03.704254+0000","last_undegraded":"2024-01-19T04:17:03.704254+0000","last_fullsized":"2024-01-19T04:17:03.704254+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.727903+0000","last_change":"2024-01-19T04:17:04.718338+0000","last_active":"2024-01-19T04:17:04.727903+0000","last_peered":"2024-01-19T04:17:04.727903+0000","last_clean":"2024-01-19T04:17:04.727903+0000","last_became_active":"2024-01-19T04:17:04.714128+0000","last_became_peered":"2024-01-19T04:17:04.714128+0000","last_unstale":"2024-01-19T04:17:04.727903+0000","last_undegraded":"2024-01-19T04:17:04.727903+0000","last_fullsized":"2024-01-19T04:17:04.727903+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:16:18.568720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732524+0000","last_change":"2024-01-19T04:17:03.706653+0000","last_active":"2024-01-19T04:17:04.732524+0000","last_peered":"2024-01-19T04:17:04.732524+0000","last_clean":"2024-01-19T04:17:04.732524+0000","last_became_active":"2024-01-19T04:17:03.706259+0000","last_became_peered":"2024-01-19T04:17:03.706259+0000","last_unstale":"2024-01-19T04:17:04.732524+0000","last_undegraded":"2024-01-19T04:17:04.732524+0000","last_fullsized":"2024-01-19T04:17:04.732524+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:44.030611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697004+0000","last_change":"2024-01-19T04:16:51.576072+0000","last_active":"2024-01-19T04:17:03.697004+0000","last_peered":"2024-01-19T04:17:03.697004+0000","last_clean":"2024-01-19T04:17:03.697004+0000","last_became_active":"2024-01-19T04:16:51.575754+0000","last_became_peered":"2024-01-19T04:16:51.575754+0000","last_unstale":"2024-01-19T04:17:03.697004+0000","last_undegraded":"2024-01-19T04:17:03.697004+0000","last_fullsized":"2024-01-19T04:17:03.697004+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:58.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.699751+0000","last_change":"2024-01-19T04:16:50.571102+0000","last_active":"2024-01-19T04:17:03.699751+0000","last_peered":"2024-01-19T04:17:03.699751+0000","last_clean":"2024-01-19T04:17:03.699751+0000","last_became_active":"2024-01-19T04:16:50.570597+0000","last_became_peered":"2024-01-19T04:16:50.570597+0000","last_unstale":"2024-01-19T04:17:03.699751+0000","last_undegraded":"2024-01-19T04:17:03.699751+0000","last_fullsized":"2024-01-19T04:17:03.699751+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.717191+0000","last_change":"2024-01-19T04:17:04.710314+0000","last_active":"2024-01-19T04:17:04.717191+0000","last_peered":"2024-01-19T04:17:04.717191+0000","last_clean":"2024-01-19T04:17:04.717191+0000","last_became_active":"2024-01-19T04:17:04.709915+0000","last_became_peered":"2024-01-19T04:17:04.709915+0000","last_unstale":"2024-01-19T04:17:04.717191+0000","last_undegraded":"2024-01-19T04:17:04.717191+0000","last_fullsized":"2024-01-19T04:17:04.717191+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698318+0000","last_change":"2024-01-19T04:17:03.709688+0000","last_active":"2024-01-19T04:17:04.698318+0000","last_peered":"2024-01-19T04:17:04.698318+0000","last_clean":"2024-01-19T04:17:04.698318+0000","last_became_active":"2024-01-19T04:17:03.709392+0000","last_became_peered":"2024-01-19T04:17:03.709392+0000","last_unstale":"2024-01-19T04:17:04.698318+0000","last_undegraded":"2024-01-19T04:17:04.698318+0000","last_fullsized":"2024-01-19T04:17:04.698318+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:44.030611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700170+0000","last_change":"2024-01-19T04:16:51.581476+0000","last_active":"2024-01-19T04:17:03.700170+0000","last_peered":"2024-01-19T04:17:03.700170+0000","last_clean":"2024-01-19T04:17:03.700170+0000","last_became_active":"2024-01-19T04:16:51.580937+0000","last_became_peered":"2024-01-19T04:16:51.580937+0000","last_unstale":"2024-01-19T04:17:03.700170+0000","last_undegraded":"2024-01-19T04:17:03.700170+0000","last_fullsized":"2024-01-19T04:17:03.700170+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701243+0000","last_change":"2024-01-19T04:16:50.572829+0000","last_active":"2024-01-19T04:17:03.701243+0000","last_peered":"2024-01-19T04:17:03.701243+0000","last_clean":"2024-01-19T04:17:03.701243+0000","last_became_active":"2024-01-19T04:16:50.572538+0000","last_became_peered":"2024-01-19T04:16:50.572538+0000","last_unstale":"2024-01-19T04:17:03.701243+0000","last_undegraded":"2024-01-19T04:17:03.701243+0000","last_fullsized":"2024-01-19T04:17:03.701243+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743535+0000","last_change":"2024-01-19T04:17:04.710112+0000","last_active":"2024-01-19T04:17:06.743535+0000","last_peered":"2024-01-19T04:17:06.743535+0000","last_clean":"2024-01-19T04:17:06.743535+0000","last_became_active":"2024-01-19T04:17:04.709830+0000","last_became_peered":"2024-01-19T04:17:04.709830+0000","last_unstale":"2024-01-19T04:17:06.743535+0000","last_undegraded":"2024-01-19T04:17:06.743535+0000","last_fullsized":"2024-01-19T04:17:06.743535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:04:35.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.733767+0000","last_change":"2024-01-19T04:17:03.710856+0000","last_active":"2024-01-19T04:17:04.733767+0000","last_peered":"2024-01-19T04:17:04.733767+0000","last_clean":"2024-01-19T04:17:04.733767+0000","last_became_active":"2024-01-19T04:17:03.709025+0000","last_became_peered":"2024-01-19T04:17:03.709025+0000","last_unstale":"2024-01-19T04:17:04.733767+0000","last_undegraded":"2024-01-19T04:17:04.733767+0000","last_fullsized":"2024-01-19T04:17:04.733767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:59.101927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702987+0000","last_change":"2024-01-19T04:16:51.588191+0000","last_active":"2024-01-19T04:17:03.702987+0000","last_peered":"2024-01-19T04:17:03.702987+0000","last_clean":"2024-01-19T04:17:03.702987+0000","last_became_active":"2024-01-19T04:16:51.587927+0000","last_became_peered":"2024-01-19T04:16:51.587927+0000","last_unstale":"2024-01-19T04:17:03.702987+0000","last_undegraded":"2024-01-19T04:17:03.702987+0000","last_fullsized":"2024-01-19T04:17:03.702987+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698421+0000","last_change":"2024-01-19T04:16:50.569273+0000","last_active":"2024-01-19T04:17:04.698421+0000","last_peered":"2024-01-19T04:17:04.698421+0000","last_clean":"2024-01-19T04:17:04.698421+0000","last_became_active":"2024-01-19T04:16:50.569009+0000","last_became_peered":"2024-01-19T04:16:50.569009+0000","last_unstale":"2024-01-19T04:17:04.698421+0000","last_undegraded":"2024-01-19T04:17:04.698421+0000","last_fullsized":"2024-01-19T04:17:04.698421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:59:10.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729984+0000","last_change":"2024-01-19T04:17:04.709224+0000","last_active":"2024-01-19T04:17:06.729984+0000","last_peered":"2024-01-19T04:17:06.729984+0000","last_clean":"2024-01-19T04:17:06.729984+0000","last_became_active":"2024-01-19T04:17:04.708928+0000","last_became_peered":"2024-01-19T04:17:04.708928+0000","last_unstale":"2024-01-19T04:17:06.729984+0000","last_undegraded":"2024-01-19T04:17:06.729984+0000","last_fullsized":"2024-01-19T04:17:06.729984+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:43.874952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.703496+0000","last_change":"2024-01-19T04:17:03.711904+0000","last_active":"2024-01-19T04:17:04.703496+0000","last_peered":"2024-01-19T04:17:04.703496+0000","last_clean":"2024-01-19T04:17:04.703496+0000","last_became_active":"2024-01-19T04:17:03.711592+0000","last_became_peered":"2024-01-19T04:17:03.711592+0000","last_unstale":"2024-01-19T04:17:04.703496+0000","last_undegraded":"2024-01-19T04:17:04.703496+0000","last_fullsized":"2024-01-19T04:17:04.703496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704488+0000","last_change":"2024-01-19T04:16:51.578342+0000","last_active":"2024-01-19T04:17:03.704488+0000","last_peered":"2024-01-19T04:17:03.704488+0000","last_clean":"2024-01-19T04:17:03.704488+0000","last_became_active":"2024-01-19T04:16:51.575581+0000","last_became_peered":"2024-01-19T04:16:51.575581+0000","last_unstale":"2024-01-19T04:17:03.704488+0000","last_undegraded":"2024-01-19T04:17:03.704488+0000","last_fullsized":"2024-01-19T04:17:03.704488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702290+0000","last_change":"2024-01-19T04:16:50.572020+0000","last_active":"2024-01-19T04:17:04.702290+0000","last_peered":"2024-01-19T04:17:04.702290+0000","last_clean":"2024-01-19T04:17:04.702290+0000","last_became_active":"2024-01-19T04:16:50.571617+0000","last_became_peered":"2024-01-19T04:16:50.571617+0000","last_unstale":"2024-01-19T04:17:04.702290+0000","last_undegraded":"2024-01-19T04:17:04.702290+0000","last_fullsized":"2024-01-19T04:17:04.702290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.721580+0000","last_change":"2024-01-19T04:17:04.715751+0000","last_active":"2024-01-19T04:17:04.721580+0000","last_peered":"2024-01-19T04:17:04.721580+0000","last_clean":"2024-01-19T04:17:04.721580+0000","last_became_active":"2024-01-19T04:17:04.715489+0000","last_became_peered":"2024-01-19T04:17:04.715489+0000","last_unstale":"2024-01-19T04:17:04.721580+0000","last_undegraded":"2024-01-19T04:17:04.721580+0000","last_fullsized":"2024-01-19T04:17:04.721580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:47.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734310+0000","last_change":"2024-01-19T04:17:03.715436+0000","last_active":"2024-01-19T04:17:04.734310+0000","last_peered":"2024-01-19T04:17:04.734310+0000","last_clean":"2024-01-19T04:17:04.734310+0000","last_became_active":"2024-01-19T04:17:03.715157+0000","last_became_peered":"2024-01-19T04:17:03.715157+0000","last_unstale":"2024-01-19T04:17:04.734310+0000","last_undegraded":"2024-01-19T04:17:04.734310+0000","last_fullsized":"2024-01-19T04:17:04.734310+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:49.326125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696979+0000","last_change":"2024-01-19T04:16:51.575079+0000","last_active":"2024-01-19T04:17:04.696979+0000","last_peered":"2024-01-19T04:17:04.696979+0000","last_clean":"2024-01-19T04:17:04.696979+0000","last_became_active":"2024-01-19T04:16:51.574248+0000","last_became_peered":"2024-01-19T04:16:51.574248+0000","last_unstale":"2024-01-19T04:17:04.696979+0000","last_undegraded":"2024-01-19T04:17:04.696979+0000","last_fullsized":"2024-01-19T04:17:04.696979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:17.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702750+0000","last_change":"2024-01-19T04:16:50.571109+0000","last_active":"2024-01-19T04:17:03.702750+0000","last_peered":"2024-01-19T04:17:03.702750+0000","last_clean":"2024-01-19T04:17:03.702750+0000","last_became_active":"2024-01-19T04:16:50.570839+0000","last_became_peered":"2024-01-19T04:16:50.570839+0000","last_unstale":"2024-01-19T04:17:03.702750+0000","last_undegraded":"2024-01-19T04:17:03.702750+0000","last_fullsized":"2024-01-19T04:17:03.702750+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:22.030862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.724584+0000","last_change":"2024-01-19T04:17:04.716334+0000","last_active":"2024-01-19T04:17:04.724584+0000","last_peered":"2024-01-19T04:17:04.724584+0000","last_clean":"2024-01-19T04:17:04.724584+0000","last_became_active":"2024-01-19T04:17:04.715736+0000","last_became_peered":"2024-01-19T04:17:04.715736+0000","last_unstale":"2024-01-19T04:17:04.724584+0000","last_undegraded":"2024-01-19T04:17:04.724584+0000","last_fullsized":"2024-01-19T04:17:04.724584+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734211+0000","last_change":"2024-01-19T04:17:03.717168+0000","last_active":"2024-01-19T04:17:04.734211+0000","last_peered":"2024-01-19T04:17:04.734211+0000","last_clean":"2024-01-19T04:17:04.734211+0000","last_became_active":"2024-01-19T04:17:03.716597+0000","last_became_peered":"2024-01-19T04:17:03.716597+0000","last_unstale":"2024-01-19T04:17:04.734211+0000","last_undegraded":"2024-01-19T04:17:04.734211+0000","last_fullsized":"2024-01-19T04:17:04.734211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:40.365611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701131+0000","last_change":"2024-01-19T04:16:51.582601+0000","last_active":"2024-01-19T04:17:03.701131+0000","last_peered":"2024-01-19T04:17:03.701131+0000","last_clean":"2024-01-19T04:17:03.701131+0000","last_became_active":"2024-01-19T04:16:51.582294+0000","last_became_peered":"2024-01-19T04:16:51.582294+0000","last_unstale":"2024-01-19T04:17:03.701131+0000","last_undegraded":"2024-01-19T04:17:03.701131+0000","last_fullsized":"2024-01-19T04:17:03.701131+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701448+0000","last_change":"2024-01-19T04:16:50.568331+0000","last_active":"2024-01-19T04:17:04.701448+0000","last_peered":"2024-01-19T04:17:04.701448+0000","last_clean":"2024-01-19T04:17:04.701448+0000","last_became_active":"2024-01-19T04:16:50.567695+0000","last_became_peered":"2024-01-19T04:16:50.567695+0000","last_unstale":"2024-01-19T04:17:04.701448+0000","last_undegraded":"2024-01-19T04:17:04.701448+0000","last_fullsized":"2024-01-19T04:17:04.701448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923571+0000","last_change":"2024-01-19T04:17:04.722284+0000","last_active":"2024-01-19T04:17:06.923571+0000","last_peered":"2024-01-19T04:17:06.923571+0000","last_clean":"2024-01-19T04:17:06.923571+0000","last_became_active":"2024-01-19T04:17:04.722004+0000","last_became_peered":"2024-01-19T04:17:04.722004+0000","last_unstale":"2024-01-19T04:17:06.923571+0000","last_undegraded":"2024-01-19T04:17:06.923571+0000","last_fullsized":"2024-01-19T04:17:06.923571+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:15.275480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701951+0000","last_change":"2024-01-19T04:17:03.712871+0000","last_active":"2024-01-19T04:17:04.701951+0000","last_peered":"2024-01-19T04:17:04.701951+0000","last_clean":"2024-01-19T04:17:04.701951+0000","last_became_active":"2024-01-19T04:17:03.710684+0000","last_became_peered":"2024-01-19T04:17:03.710684+0000","last_unstale":"2024-01-19T04:17:04.701951+0000","last_undegraded":"2024-01-19T04:17:04.701951+0000","last_fullsized":"2024-01-19T04:17:04.701951+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700567+0000","last_change":"2024-01-19T04:16:51.579139+0000","last_active":"2024-01-19T04:17:03.700567+0000","last_peered":"2024-01-19T04:17:03.700567+0000","last_clean":"2024-01-19T04:17:03.700567+0000","last_became_active":"2024-01-19T04:16:51.578820+0000","last_became_peered":"2024-01-19T04:16:51.578820+0000","last_unstale":"2024-01-19T04:17:03.700567+0000","last_undegraded":"2024-01-19T04:17:03.700567+0000","last_fullsized":"2024-01-19T04:17:03.700567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695278+0000","last_change":"2024-01-19T04:16:50.563572+0000","last_active":"2024-01-19T04:17:04.695278+0000","last_peered":"2024-01-19T04:17:04.695278+0000","last_clean":"2024-01-19T04:17:04.695278+0000","last_became_active":"2024-01-19T04:16:50.561160+0000","last_became_peered":"2024-01-19T04:16:50.561160+0000","last_unstale":"2024-01-19T04:17:04.695278+0000","last_undegraded":"2024-01-19T04:17:04.695278+0000","last_fullsized":"2024-01-19T04:17:04.695278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:40:18.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923752+0000","last_change":"2024-01-19T04:17:04.722269+0000","last_active":"2024-01-19T04:17:06.923752+0000","last_peered":"2024-01-19T04:17:06.923752+0000","last_clean":"2024-01-19T04:17:06.923752+0000","last_became_active":"2024-01-19T04:17:04.722003+0000","last_became_peered":"2024-01-19T04:17:04.722003+0000","last_unstale":"2024-01-19T04:17:06.923752+0000","last_undegraded":"2024-01-19T04:17:06.923752+0000","last_fullsized":"2024-01-19T04:17:06.923752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:53.689915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700260+0000","last_change":"2024-01-19T04:17:03.703625+0000","last_active":"2024-01-19T04:17:04.700260+0000","last_peered":"2024-01-19T04:17:04.700260+0000","last_clean":"2024-01-19T04:17:04.700260+0000","last_became_active":"2024-01-19T04:17:03.702960+0000","last_became_peered":"2024-01-19T04:17:03.702960+0000","last_unstale":"2024-01-19T04:17:04.700260+0000","last_undegraded":"2024-01-19T04:17:04.700260+0000","last_fullsized":"2024-01-19T04:17:04.700260+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699038+0000","last_change":"2024-01-19T04:16:51.581877+0000","last_active":"2024-01-19T04:17:04.699038+0000","last_peered":"2024-01-19T04:17:04.699038+0000","last_clean":"2024-01-19T04:17:04.699038+0000","last_became_active":"2024-01-19T04:16:51.580713+0000","last_became_peered":"2024-01-19T04:16:51.580713+0000","last_unstale":"2024-01-19T04:17:04.699038+0000","last_undegraded":"2024-01-19T04:17:04.699038+0000","last_fullsized":"2024-01-19T04:17:04.699038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699294+0000","last_change":"2024-01-19T04:16:50.572947+0000","last_active":"2024-01-19T04:17:04.699294+0000","last_peered":"2024-01-19T04:17:04.699294+0000","last_clean":"2024-01-19T04:17:04.699294+0000","last_became_active":"2024-01-19T04:16:50.572679+0000","last_became_peered":"2024-01-19T04:16:50.572679+0000","last_unstale":"2024-01-19T04:17:04.699294+0000","last_undegraded":"2024-01-19T04:17:04.699294+0000","last_fullsized":"2024-01-19T04:17:04.699294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:41.006603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923756+0000","last_change":"2024-01-19T04:17:04.715568+0000","last_active":"2024-01-19T04:17:06.923756+0000","last_peered":"2024-01-19T04:17:06.923756+0000","last_clean":"2024-01-19T04:17:06.923756+0000","last_became_active":"2024-01-19T04:17:04.715214+0000","last_became_peered":"2024-01-19T04:17:04.715214+0000","last_unstale":"2024-01-19T04:17:06.923756+0000","last_undegraded":"2024-01-19T04:17:06.923756+0000","last_fullsized":"2024-01-19T04:17:06.923756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:15.118406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711926+0000","last_change":"2024-01-19T04:17:03.716279+0000","last_active":"2024-01-19T04:17:04.711926+0000","last_peered":"2024-01-19T04:17:04.711926+0000","last_clean":"2024-01-19T04:17:04.711926+0000","last_became_active":"2024-01-19T04:17:03.715875+0000","last_became_peered":"2024-01-19T04:17:03.715875+0000","last_unstale":"2024-01-19T04:17:04.711926+0000","last_undegraded":"2024-01-19T04:17:04.711926+0000","last_fullsized":"2024-01-19T04:17:04.711926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:55.411637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698786+0000","last_change":"2024-01-19T04:16:51.575958+0000","last_active":"2024-01-19T04:17:04.698786+0000","last_peered":"2024-01-19T04:17:04.698786+0000","last_clean":"2024-01-19T04:17:04.698786+0000","last_became_active":"2024-01-19T04:16:51.575635+0000","last_became_peered":"2024-01-19T04:16:51.575635+0000","last_unstale":"2024-01-19T04:17:04.698786+0000","last_undegraded":"2024-01-19T04:17:04.698786+0000","last_fullsized":"2024-01-19T04:17:04.698786+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.697752+0000","last_change":"2024-01-19T04:16:50.568547+0000","last_active":"2024-01-19T04:17:03.697752+0000","last_peered":"2024-01-19T04:17:03.697752+0000","last_clean":"2024-01-19T04:17:03.697752+0000","last_became_active":"2024-01-19T04:16:50.568248+0000","last_became_peered":"2024-01-19T04:16:50.568248+0000","last_unstale":"2024-01-19T04:17:03.697752+0000","last_undegraded":"2024-01-19T04:17:03.697752+0000","last_fullsized":"2024-01-19T04:17:03.697752+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:45.960987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734018+0000","last_change":"2024-01-19T04:17:04.732413+0000","last_active":"2024-01-19T04:17:04.734018+0000","last_peered":"2024-01-19T04:17:04.734018+0000","last_clean":"2024-01-19T04:17:04.734018+0000","last_became_active":"2024-01-19T04:17:04.732057+0000","last_became_peered":"2024-01-19T04:17:04.732057+0000","last_unstale":"2024-01-19T04:17:04.734018+0000","last_undegraded":"2024-01-19T04:17:04.734018+0000","last_fullsized":"2024-01-19T04:17:04.734018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:29:59.877276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705408+0000","last_change":"2024-01-19T04:17:03.711094+0000","last_active":"2024-01-19T04:17:04.705408+0000","last_peered":"2024-01-19T04:17:04.705408+0000","last_clean":"2024-01-19T04:17:04.705408+0000","last_became_active":"2024-01-19T04:17:03.710806+0000","last_became_peered":"2024-01-19T04:17:03.710806+0000","last_unstale":"2024-01-19T04:17:04.705408+0000","last_undegraded":"2024-01-19T04:17:04.705408+0000","last_fullsized":"2024-01-19T04:17:04.705408+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:22.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703526+0000","last_change":"2024-01-19T04:16:51.562371+0000","last_active":"2024-01-19T04:17:03.703526+0000","last_peered":"2024-01-19T04:17:03.703526+0000","last_clean":"2024-01-19T04:17:03.703526+0000","last_became_active":"2024-01-19T04:16:51.562057+0000","last_became_peered":"2024-01-19T04:16:51.562057+0000","last_unstale":"2024-01-19T04:17:03.703526+0000","last_undegraded":"2024-01-19T04:17:03.703526+0000","last_fullsized":"2024-01-19T04:17:03.703526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698830+0000","last_change":"2024-01-19T04:16:50.575311+0000","last_active":"2024-01-19T04:17:04.698830+0000","last_peered":"2024-01-19T04:17:04.698830+0000","last_clean":"2024-01-19T04:17:04.698830+0000","last_became_active":"2024-01-19T04:16:50.574897+0000","last_became_peered":"2024-01-19T04:16:50.574897+0000","last_unstale":"2024-01-19T04:17:04.698830+0000","last_undegraded":"2024-01-19T04:17:04.698830+0000","last_fullsized":"2024-01-19T04:17:04.698830+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725149+0000","last_change":"2024-01-19T04:17:04.717650+0000","last_active":"2024-01-19T04:17:04.725149+0000","last_peered":"2024-01-19T04:17:04.725149+0000","last_clean":"2024-01-19T04:17:04.725149+0000","last_became_active":"2024-01-19T04:17:04.713401+0000","last_became_peered":"2024-01-19T04:17:04.713401+0000","last_unstale":"2024-01-19T04:17:04.725149+0000","last_undegraded":"2024-01-19T04:17:04.725149+0000","last_fullsized":"2024-01-19T04:17:04.725149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:42:58.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700911+0000","last_change":"2024-01-19T04:17:03.711629+0000","last_active":"2024-01-19T04:17:04.700911+0000","last_peered":"2024-01-19T04:17:04.700911+0000","last_clean":"2024-01-19T04:17:04.700911+0000","last_became_active":"2024-01-19T04:17:03.711338+0000","last_became_peered":"2024-01-19T04:17:03.711338+0000","last_unstale":"2024-01-19T04:17:04.700911+0000","last_undegraded":"2024-01-19T04:17:04.700911+0000","last_fullsized":"2024-01-19T04:17:04.700911+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:25.182852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704626+0000","last_change":"2024-01-19T04:16:51.585936+0000","last_active":"2024-01-19T04:17:03.704626+0000","last_peered":"2024-01-19T04:17:03.704626+0000","last_clean":"2024-01-19T04:17:03.704626+0000","last_became_active":"2024-01-19T04:16:51.585682+0000","last_became_peered":"2024-01-19T04:16:51.585682+0000","last_unstale":"2024-01-19T04:17:03.704626+0000","last_undegraded":"2024-01-19T04:17:03.704626+0000","last_fullsized":"2024-01-19T04:17:03.704626+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702380+0000","last_change":"2024-01-19T04:16:50.567862+0000","last_active":"2024-01-19T04:17:04.702380+0000","last_peered":"2024-01-19T04:17:04.702380+0000","last_clean":"2024-01-19T04:17:04.702380+0000","last_became_active":"2024-01-19T04:16:50.567482+0000","last_became_peered":"2024-01-19T04:16:50.567482+0000","last_unstale":"2024-01-19T04:17:04.702380+0000","last_undegraded":"2024-01-19T04:17:04.702380+0000","last_fullsized":"2024-01-19T04:17:04.702380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.710915+0000","last_change":"2024-01-19T04:17:04.710123+0000","last_active":"2024-01-19T04:17:05.710915+0000","last_peered":"2024-01-19T04:17:05.710915+0000","last_clean":"2024-01-19T04:17:05.710915+0000","last_became_active":"2024-01-19T04:17:04.709533+0000","last_became_peered":"2024-01-19T04:17:04.709533+0000","last_unstale":"2024-01-19T04:17:05.710915+0000","last_undegraded":"2024-01-19T04:17:05.710915+0000","last_fullsized":"2024-01-19T04:17:05.710915+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:26:24.913274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734217+0000","last_change":"2024-01-19T04:17:03.715400+0000","last_active":"2024-01-19T04:17:04.734217+0000","last_peered":"2024-01-19T04:17:04.734217+0000","last_clean":"2024-01-19T04:17:04.734217+0000","last_became_active":"2024-01-19T04:17:03.714763+0000","last_became_peered":"2024-01-19T04:17:03.714763+0000","last_unstale":"2024-01-19T04:17:04.734217+0000","last_undegraded":"2024-01-19T04:17:04.734217+0000","last_fullsized":"2024-01-19T04:17:04.734217+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:42.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702269+0000","last_change":"2024-01-19T04:16:51.581054+0000","last_active":"2024-01-19T04:17:04.702269+0000","last_peered":"2024-01-19T04:17:04.702269+0000","last_clean":"2024-01-19T04:17:04.702269+0000","last_became_active":"2024-01-19T04:16:51.580564+0000","last_became_peered":"2024-01-19T04:16:51.580564+0000","last_unstale":"2024-01-19T04:17:04.702269+0000","last_undegraded":"2024-01-19T04:17:04.702269+0000","last_fullsized":"2024-01-19T04:17:04.702269+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.841231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.705816+0000","last_change":"2024-01-19T04:16:50.565555+0000","last_active":"2024-01-19T04:17:03.705816+0000","last_peered":"2024-01-19T04:17:03.705816+0000","last_clean":"2024-01-19T04:17:03.705816+0000","last_became_active":"2024-01-19T04:16:50.565273+0000","last_became_peered":"2024-01-19T04:16:50.565273+0000","last_unstale":"2024-01-19T04:17:03.705816+0000","last_undegraded":"2024-01-19T04:17:03.705816+0000","last_fullsized":"2024-01-19T04:17:03.705816+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.719993+0000","last_change":"2024-01-19T04:17:04.716116+0000","last_active":"2024-01-19T04:17:04.719993+0000","last_peered":"2024-01-19T04:17:04.719993+0000","last_clean":"2024-01-19T04:17:04.719993+0000","last_became_active":"2024-01-19T04:17:04.715861+0000","last_became_peered":"2024-01-19T04:17:04.715861+0000","last_unstale":"2024-01-19T04:17:04.719993+0000","last_undegraded":"2024-01-19T04:17:04.719993+0000","last_fullsized":"2024-01-19T04:17:04.719993+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:01.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704490+0000","last_change":"2024-01-19T04:17:03.713437+0000","last_active":"2024-01-19T04:17:04.704490+0000","last_peered":"2024-01-19T04:17:04.704490+0000","last_clean":"2024-01-19T04:17:04.704490+0000","last_became_active":"2024-01-19T04:17:03.713127+0000","last_became_peered":"2024-01-19T04:17:03.713127+0000","last_unstale":"2024-01-19T04:17:04.704490+0000","last_undegraded":"2024-01-19T04:17:04.704490+0000","last_fullsized":"2024-01-19T04:17:04.704490+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702532+0000","last_change":"2024-01-19T04:16:51.574116+0000","last_active":"2024-01-19T04:17:04.702532+0000","last_peered":"2024-01-19T04:17:04.702532+0000","last_clean":"2024-01-19T04:17:04.702532+0000","last_became_active":"2024-01-19T04:16:51.573543+0000","last_became_peered":"2024-01-19T04:16:51.573543+0000","last_unstale":"2024-01-19T04:17:04.702532+0000","last_undegraded":"2024-01-19T04:17:04.702532+0000","last_fullsized":"2024-01-19T04:17:04.702532+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.703710+0000","last_change":"2024-01-19T04:16:50.571359+0000","last_active":"2024-01-19T04:17:03.703710+0000","last_peered":"2024-01-19T04:17:03.703710+0000","last_clean":"2024-01-19T04:17:03.703710+0000","last_became_active":"2024-01-19T04:16:50.570715+0000","last_became_peered":"2024-01-19T04:16:50.570715+0000","last_unstale":"2024-01-19T04:17:03.703710+0000","last_undegraded":"2024-01-19T04:17:03.703710+0000","last_fullsized":"2024-01-19T04:17:03.703710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.742952+0000","last_change":"2024-01-19T04:17:04.706826+0000","last_active":"2024-01-19T04:17:06.742952+0000","last_peered":"2024-01-19T04:17:06.742952+0000","last_clean":"2024-01-19T04:17:06.742952+0000","last_became_active":"2024-01-19T04:17:04.706578+0000","last_became_peered":"2024-01-19T04:17:04.706578+0000","last_unstale":"2024-01-19T04:17:06.742952+0000","last_undegraded":"2024-01-19T04:17:06.742952+0000","last_fullsized":"2024-01-19T04:17:06.742952+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:44.988632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694496+0000","last_change":"2024-01-19T04:17:03.711684+0000","last_active":"2024-01-19T04:17:04.694496+0000","last_peered":"2024-01-19T04:17:04.694496+0000","last_clean":"2024-01-19T04:17:04.694496+0000","last_became_active":"2024-01-19T04:17:03.711404+0000","last_became_peered":"2024-01-19T04:17:03.711404+0000","last_unstale":"2024-01-19T04:17:04.694496+0000","last_undegraded":"2024-01-19T04:17:04.694496+0000","last_fullsized":"2024-01-19T04:17:04.694496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:05.518024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695322+0000","last_change":"2024-01-19T04:16:51.578118+0000","last_active":"2024-01-19T04:17:04.695322+0000","last_peered":"2024-01-19T04:17:04.695322+0000","last_clean":"2024-01-19T04:17:04.695322+0000","last_became_active":"2024-01-19T04:16:51.577861+0000","last_became_peered":"2024-01-19T04:16:51.577861+0000","last_unstale":"2024-01-19T04:17:04.695322+0000","last_undegraded":"2024-01-19T04:17:04.695322+0000","last_fullsized":"2024-01-19T04:17:04.695322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:52:16.044197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701228+0000","last_change":"2024-01-19T04:16:50.572873+0000","last_active":"2024-01-19T04:17:04.701228+0000","last_peered":"2024-01-19T04:17:04.701228+0000","last_clean":"2024-01-19T04:17:04.701228+0000","last_became_active":"2024-01-19T04:16:50.571172+0000","last_became_peered":"2024-01-19T04:16:50.571172+0000","last_unstale":"2024-01-19T04:17:04.701228+0000","last_undegraded":"2024-01-19T04:17:04.701228+0000","last_fullsized":"2024-01-19T04:17:04.701228+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734205+0000","last_change":"2024-01-19T04:17:04.727787+0000","last_active":"2024-01-19T04:17:04.734205+0000","last_peered":"2024-01-19T04:17:04.734205+0000","last_clean":"2024-01-19T04:17:04.734205+0000","last_became_active":"2024-01-19T04:17:04.727503+0000","last_became_peered":"2024-01-19T04:17:04.727503+0000","last_unstale":"2024-01-19T04:17:04.734205+0000","last_undegraded":"2024-01-19T04:17:04.734205+0000","last_fullsized":"2024-01-19T04:17:04.734205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:06.524237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710562+0000","last_change":"2024-01-19T04:17:03.711107+0000","last_active":"2024-01-19T04:17:04.710562+0000","last_peered":"2024-01-19T04:17:04.710562+0000","last_clean":"2024-01-19T04:17:04.710562+0000","last_became_active":"2024-01-19T04:17:03.709301+0000","last_became_peered":"2024-01-19T04:17:03.709301+0000","last_unstale":"2024-01-19T04:17:04.710562+0000","last_undegraded":"2024-01-19T04:17:04.710562+0000","last_fullsized":"2024-01-19T04:17:04.710562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:26.645481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.702350+0000","last_change":"2024-01-19T04:16:51.590515+0000","last_active":"2024-01-19T04:17:03.702350+0000","last_peered":"2024-01-19T04:17:03.702350+0000","last_clean":"2024-01-19T04:17:03.702350+0000","last_became_active":"2024-01-19T04:16:51.590319+0000","last_became_peered":"2024-01-19T04:16:51.590319+0000","last_unstale":"2024-01-19T04:17:03.702350+0000","last_undegraded":"2024-01-19T04:17:03.702350+0000","last_fullsized":"2024-01-19T04:17:03.702350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.700291+0000","last_change":"2024-01-19T04:16:50.567937+0000","last_active":"2024-01-19T04:17:03.700291+0000","last_peered":"2024-01-19T04:17:03.700291+0000","last_clean":"2024-01-19T04:17:03.700291+0000","last_became_active":"2024-01-19T04:16:50.567687+0000","last_became_peered":"2024-01-19T04:16:50.567687+0000","last_unstale":"2024-01-19T04:17:03.700291+0000","last_undegraded":"2024-01-19T04:17:03.700291+0000","last_fullsized":"2024-01-19T04:17:03.700291+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:05.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729857+0000","last_change":"2024-01-19T04:17:04.708824+0000","last_active":"2024-01-19T04:17:06.729857+0000","last_peered":"2024-01-19T04:17:06.729857+0000","last_clean":"2024-01-19T04:17:06.729857+0000","last_became_active":"2024-01-19T04:17:04.708452+0000","last_became_peered":"2024-01-19T04:17:04.708452+0000","last_unstale":"2024-01-19T04:17:06.729857+0000","last_undegraded":"2024-01-19T04:17:06.729857+0000","last_fullsized":"2024-01-19T04:17:06.729857+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:45.036824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705206+0000","last_change":"2024-01-19T04:17:03.707107+0000","last_active":"2024-01-19T04:17:04.705206+0000","last_peered":"2024-01-19T04:17:04.705206+0000","last_clean":"2024-01-19T04:17:04.705206+0000","last_became_active":"2024-01-19T04:17:03.706799+0000","last_became_peered":"2024-01-19T04:17:03.706799+0000","last_unstale":"2024-01-19T04:17:04.705206+0000","last_undegraded":"2024-01-19T04:17:04.705206+0000","last_fullsized":"2024-01-19T04:17:04.705206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:43.326228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698335+0000","last_change":"2024-01-19T04:16:51.583555+0000","last_active":"2024-01-19T04:17:04.698335+0000","last_peered":"2024-01-19T04:17:04.698335+0000","last_clean":"2024-01-19T04:17:04.698335+0000","last_became_active":"2024-01-19T04:16:51.583278+0000","last_became_peered":"2024-01-19T04:16:51.583278+0000","last_unstale":"2024-01-19T04:17:04.698335+0000","last_undegraded":"2024-01-19T04:17:04.698335+0000","last_fullsized":"2024-01-19T04:17:04.698335+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:10.004835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699287+0000","last_change":"2024-01-19T04:16:50.570692+0000","last_active":"2024-01-19T04:17:04.699287+0000","last_peered":"2024-01-19T04:17:04.699287+0000","last_clean":"2024-01-19T04:17:04.699287+0000","last_became_active":"2024-01-19T04:16:50.570414+0000","last_became_peered":"2024-01-19T04:16:50.570414+0000","last_unstale":"2024-01-19T04:17:04.699287+0000","last_undegraded":"2024-01-19T04:17:04.699287+0000","last_fullsized":"2024-01-19T04:17:04.699287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:18.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.734457+0000","last_change":"2024-01-19T04:17:04.730280+0000","last_active":"2024-01-19T04:17:04.734457+0000","last_peered":"2024-01-19T04:17:04.734457+0000","last_clean":"2024-01-19T04:17:04.734457+0000","last_became_active":"2024-01-19T04:17:04.729904+0000","last_became_peered":"2024-01-19T04:17:04.729904+0000","last_unstale":"2024-01-19T04:17:04.734457+0000","last_undegraded":"2024-01-19T04:17:04.734457+0000","last_fullsized":"2024-01-19T04:17:04.734457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:41.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698985+0000","last_change":"2024-01-19T04:17:03.708010+0000","last_active":"2024-01-19T04:17:04.698985+0000","last_peered":"2024-01-19T04:17:04.698985+0000","last_clean":"2024-01-19T04:17:04.698985+0000","last_became_active":"2024-01-19T04:17:03.707622+0000","last_became_peered":"2024-01-19T04:17:03.707622+0000","last_unstale":"2024-01-19T04:17:04.698985+0000","last_undegraded":"2024-01-19T04:17:04.698985+0000","last_fullsized":"2024-01-19T04:17:04.698985+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:57.511703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695576+0000","last_change":"2024-01-19T04:16:51.586087+0000","last_active":"2024-01-19T04:17:04.695576+0000","last_peered":"2024-01-19T04:17:04.695576+0000","last_clean":"2024-01-19T04:17:04.695576+0000","last_became_active":"2024-01-19T04:16:51.585533+0000","last_became_peered":"2024-01-19T04:16:51.585533+0000","last_unstale":"2024-01-19T04:17:04.695576+0000","last_undegraded":"2024-01-19T04:17:04.695576+0000","last_fullsized":"2024-01-19T04:17:04.695576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:32.942430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693448+0000","last_change":"2024-01-19T04:16:50.570854+0000","last_active":"2024-01-19T04:17:04.693448+0000","last_peered":"2024-01-19T04:17:04.693448+0000","last_clean":"2024-01-19T04:17:04.693448+0000","last_became_active":"2024-01-19T04:16:50.570594+0000","last_became_peered":"2024-01-19T04:16:50.570594+0000","last_unstale":"2024-01-19T04:17:04.693448+0000","last_undegraded":"2024-01-19T04:17:04.693448+0000","last_fullsized":"2024-01-19T04:17:04.693448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:51:58.259661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923676+0000","last_change":"2024-01-19T04:17:04.726240+0000","last_active":"2024-01-19T04:17:06.923676+0000","last_peered":"2024-01-19T04:17:06.923676+0000","last_clean":"2024-01-19T04:17:06.923676+0000","last_became_active":"2024-01-19T04:17:04.725967+0000","last_became_peered":"2024-01-19T04:17:04.725967+0000","last_unstale":"2024-01-19T04:17:06.923676+0000","last_undegraded":"2024-01-19T04:17:06.923676+0000","last_fullsized":"2024-01-19T04:17:06.923676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:12:40.918817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732193+0000","last_change":"2024-01-19T04:17:03.710289+0000","last_active":"2024-01-19T04:17:04.732193+0000","last_peered":"2024-01-19T04:17:04.732193+0000","last_clean":"2024-01-19T04:17:04.732193+0000","last_became_active":"2024-01-19T04:17:03.709448+0000","last_became_peered":"2024-01-19T04:17:03.709448+0000","last_unstale":"2024-01-19T04:17:04.732193+0000","last_undegraded":"2024-01-19T04:17:04.732193+0000","last_fullsized":"2024-01-19T04:17:04.732193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:10.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693344+0000","last_change":"2024-01-19T04:16:51.574512+0000","last_active":"2024-01-19T04:17:04.693344+0000","last_peered":"2024-01-19T04:17:04.693344+0000","last_clean":"2024-01-19T04:17:04.693344+0000","last_became_active":"2024-01-19T04:16:51.574197+0000","last_became_peered":"2024-01-19T04:16:51.574197+0000","last_unstale":"2024-01-19T04:17:04.693344+0000","last_undegraded":"2024-01-19T04:17:04.693344+0000","last_fullsized":"2024-01-19T04:17:04.693344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:44:34.041080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.704158+0000","last_change":"2024-01-19T04:16:50.574052+0000","last_active":"2024-01-19T04:17:03.704158+0000","last_peered":"2024-01-19T04:17:03.704158+0000","last_clean":"2024-01-19T04:17:03.704158+0000","last_became_active":"2024-01-19T04:16:50.572944+0000","last_became_peered":"2024-01-19T04:16:50.572944+0000","last_unstale":"2024-01-19T04:17:03.704158+0000","last_undegraded":"2024-01-19T04:17:03.704158+0000","last_fullsized":"2024-01-19T04:17:03.704158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:10:00.992470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-19T04:17:03.701364+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:17:03.701364+0000","last_peered":"2024-01-19T04:17:03.701364+0000","last_clean":"2024-01-19T04:17:03.701364+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:17:03.701364+0000","last_undegraded":"2024-01-19T04:17:03.701364+0000","last_fullsized":"2024-01-19T04:17:03.701364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476766,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":865055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.63200000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476766,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":274527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.45200000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476765,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":275179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628}]},{"osd":1,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98299999999999998,"5min":1.107,"15min":1.107},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.246,"15min":1.246},"last":0.755},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.878},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0820000000000001,"5min":1.708,"15min":1.708},"last":0.71699999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476767,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":277634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.54300000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.381,"15min":1.381},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.095,"15min":1.095},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0940000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.495}]},{"osd":7,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.139,"15min":1.139},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1120000000000001,"5min":1.266,"15min":1.266},"last":0.69699999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":692224,"data_stored":290985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54700000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.503},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.63300000000000001,"5min":0.879,"15min":0.879},"last":0.439},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.495}]},{"osd":4,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95799999999999996,"5min":1.016,"15min":1.016},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.89500000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.754}]},{"osd":6,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93000000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98199999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.82099999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":696320,"data_stored":291635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.964,"15min":1.964},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":2.827,"15min":2.827},"last":0.62}]},{"osd":3,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60299999999999998,"5min":2.343,"15min":2.343},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.665,"15min":1.665},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.032,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.94199999999999995,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.002,"5min":1.198,"15min":1.198},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.96599999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.0600000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.67500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1},{"interface":"front","average":{"1min":0.747,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.04,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.85099999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":883374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.60999999999999999,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60799999999999998,"5min":3.129,"15min":3.129},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.66700000000000004,"15min":0.69999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.72299999999999998,"15min":0.755},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.61299999999999999,"5min":3.633,"15min":3.633},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.59499999999999997,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93200000000000005,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.96299999999999997,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89500000000000002,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.004,"15min":1.052},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0469999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":1.034,"15min":1.0860000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97499999999999998,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.96799999999999997,"15min":1.008},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.85099999999999998,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.96799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.876,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75,"5min":1.052,"15min":1.1020000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95099999999999996,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.90900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":289485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54600000000000004,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.77600000000000002,"15min":0.81799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82699999999999996,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.65300000000000002,"15min":0.68300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":5.226,"15min":5.226},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":5.319,"15min":5.319},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.745,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96599999999999997,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.085,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.01,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.133,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.093,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93999999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.165,"5min":5.423,"15min":5.423},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1459999999999999,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:17:13.441 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:17:13.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.589+0000 7efd8da00640 1 Processor -- start 2024-01-19T04:17:13.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd8da00640 1 -- start start 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd8da00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd88151de0 0x7efd880c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd8da00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efd880a7200 0x7efd880c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd8da00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880c41f0 0x7efd88154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd8da00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd881521c0 con 0x7efd88151de0 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd8da00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd881547e0 con 0x7efd880a7200 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd8da00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c1db0 con 0x7efd880c41f0 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd88151de0 0x7efd880c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efd88151de0 0x7efd880c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45454/0 (socket says 172.21.15.32:45454) 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 -- 172.21.15.32:0/1628460985 learned_addr learned my addr 172.21.15.32:0/1628460985 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86000640 1 --2- 172.21.15.32:0/1628460985 >> v2:172.21.15.67:3300/0 conn(0x7efd880a7200 0x7efd880c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd87400640 1 --2- 172.21.15.32:0/1628460985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880c41f0 0x7efd88154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:13.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 -- 172.21.15.32:0/1628460985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880c41f0 msgr2=0x7efd88154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:13.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 --2- 172.21.15.32:0/1628460985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880c41f0 0x7efd88154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 -- 172.21.15.32:0/1628460985 >> v2:172.21.15.67:3300/0 conn(0x7efd880a7200 msgr2=0x7efd880c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:13.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 --2- 172.21.15.32:0/1628460985 >> v2:172.21.15.67:3300/0 conn(0x7efd880a7200 0x7efd880c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.593+0000 7efd86a00640 1 -- 172.21.15.32:0/1628460985 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8806f820 con 0x7efd88151de0 2024-01-19T04:17:13.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd86a00640 1 --2- 172.21.15.32:0/1628460985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd880c1870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efd8806e870 tx=0x7efd7801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a0eea838a5f398 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:13.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd85600640 1 -- 172.21.15.32:0/1628460985 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780ac640 con 0x7efd88151de0 2024-01-19T04:17:13.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd85600640 1 -- 172.21.15.32:0/1628460985 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780ac7a0 con 0x7efd88151de0 2024-01-19T04:17:13.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd85600640 1 -- 172.21.15.32:0/1628460985 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780acb30 con 0x7efd88151de0 2024-01-19T04:17:13.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 -- 172.21.15.32:0/1628460985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 msgr2=0x7efd880c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:13.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 --2- 172.21.15.32:0/1628460985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd880c1870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efd8806e870 tx=0x7efd7801c440 comp rx=0 tx=0).stop 2024-01-19T04:17:13.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 -- 172.21.15.32:0/1628460985 shutdown_connections 2024-01-19T04:17:13.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 --2- 172.21.15.32:0/1628460985 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880c41f0 0x7efd88154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 --2- 172.21.15.32:0/1628460985 >> v2:172.21.15.67:3300/0 conn(0x7efd880a7200 0x7efd880c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 --2- 172.21.15.32:0/1628460985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd880c1870 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 -- 172.21.15.32:0/1628460985 >> 172.21.15.32:0/1628460985 conn(0x7efd880726d0 msgr2=0x7efd880663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:13.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 -- 172.21.15.32:0/1628460985 shutdown_connections 2024-01-19T04:17:13.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 -- 172.21.15.32:0/1628460985 wait complete. 2024-01-19T04:17:13.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.597+0000 7efd8da00640 1 Processor -- start 2024-01-19T04:17:13.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 -- start start 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880a7200 0x7efd880ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd880c41f0 0x7efd880abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd881f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880ab330 con 0x7efd88151de0 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd88159e50 con 0x7efd880c41f0 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8815a130 con 0x7efd880a7200 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd881f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd881f0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45458/0 (socket says 172.21.15.32:45458) 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 -- 172.21.15.32:0/971775599 learned_addr learned my addr 172.21.15.32:0/971775599 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd86000640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd880c41f0 0x7efd880abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:13.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd86a00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880a7200 0x7efd880ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 -- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880a7200 msgr2=0x7efd880ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880a7200 0x7efd880ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 -- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd880c41f0 msgr2=0x7efd880abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd880c41f0 0x7efd880abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 -- 172.21.15.32:0/971775599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780094d0 con 0x7efd88151de0 2024-01-19T04:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd86000640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd880c41f0 0x7efd880abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:13.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd87400640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd881f0bd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efd80007d90 tx=0x7efd8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd7ea00640 1 -- 172.21.15.32:0/971775599 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80014420 con 0x7efd88151de0 2024-01-19T04:17:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd7ea00640 1 -- 172.21.15.32:0/971775599 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd800145a0 con 0x7efd88151de0 2024-01-19T04:17:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd7ea00640 1 -- 172.21.15.32:0/971775599 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80014950 con 0x7efd88151de0 2024-01-19T04:17:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd880aac70 con 0x7efd88151de0 2024-01-19T04:17:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8815b060 con 0x7efd88151de0 2024-01-19T04:17:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.601+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd880ab470 con 0x7efd88151de0 2024-01-19T04:17:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.605+0000 7efd7ea00640 1 -- 172.21.15.32:0/971775599 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efd80014ab0 con 0x7efd88151de0 2024-01-19T04:17:13.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.605+0000 7efd7ea00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd60066500 0x7efd600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:13.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.605+0000 7efd7ea00640 1 -- 172.21.15.32:0/971775599 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efd80084bf0 con 0x7efd88151de0 2024-01-19T04:17:13.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.605+0000 7efd86a00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd60066500 0x7efd600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:13.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.605+0000 7efd86a00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd60066500 0x7efd600689c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efd780ae000 tx=0x7efd78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:13.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.609+0000 7efd7ea00640 1 -- 172.21.15.32:0/971775599 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efd880ab470 con 0x7efd88151de0 2024-01-19T04:17:13.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.765+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd880c2740 con 0x7efd60066500 2024-01-19T04:17:13.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.777+0000 7efd7ea00640 1 -- 172.21.15.32:0/971775599 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527469 (secure 0 0 0) 0x7efd780ac5a0 con 0x7efd60066500 2024-01-19T04:17:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:13.793 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd60066500 msgr2=0x7efd600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd60066500 0x7efd600689c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efd780ae000 tx=0x7efd78008040 comp rx=0 tx=0).stop 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 msgr2=0x7efd881f0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd881f0bd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efd80007d90 tx=0x7efd8000e4b0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 shutdown_connections 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7efd60066500 0x7efd600689c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd88151de0 0x7efd881f0bd0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd880c41f0 0x7efd880abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 --2- 172.21.15.32:0/971775599 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7efd880a7200 0x7efd880ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:13.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 >> 172.21.15.32:0/971775599 conn(0x7efd880726d0 msgr2=0x7efd88066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:13.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 shutdown_connections 2024-01-19T04:17:13.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:13.785+0000 7efd8da00640 1 -- 172.21.15.32:0/971775599 wait complete. 2024-01-19T04:17:13.807 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-01-19T04:17:12.059976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":378,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239356,"kb_used_data":6536,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735364,"statfs":{"total":773094113280,"available":772849012736,"internally_reserved":0,"allocated":6692864,"data_stored":3507902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002245"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924285+0000","last_change":"2024-01-19T04:17:04.707561+0000","last_active":"2024-01-19T04:17:06.924285+0000","last_peered":"2024-01-19T04:17:06.924285+0000","last_clean":"2024-01-19T04:17:06.924285+0000","last_became_active":"2024-01-19T04:17:04.706328+0000","last_became_peered":"2024-01-19T04:17:04.706328+0000","last_unstale":"2024-01-19T04:17:06.924285+0000","last_undegraded":"2024-01-19T04:17:06.924285+0000","last_fullsized":"2024-01-19T04:17:06.924285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:31:51.010861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705557+0000","last_change":"2024-01-19T04:16:51.581477+0000","last_active":"2024-01-19T04:17:04.705557+0000","last_peered":"2024-01-19T04:17:04.705557+0000","last_clean":"2024-01-19T04:17:04.705557+0000","last_became_active":"2024-01-19T04:16:51.580890+0000","last_became_peered":"2024-01-19T04:16:51.580890+0000","last_unstale":"2024-01-19T04:17:04.705557+0000","last_undegraded":"2024-01-19T04:17:04.705557+0000","last_fullsized":"2024-01-19T04:17:04.705557+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:46.849907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743768+0000","last_change":"2024-01-19T04:17:04.722525+0000","last_active":"2024-01-19T04:17:06.743768+0000","last_peered":"2024-01-19T04:17:06.743768+0000","last_clean":"2024-01-19T04:17:06.743768+0000","last_became_active":"2024-01-19T04:17:04.722229+0000","last_became_peered":"2024-01-19T04:17:04.722229+0000","last_unstale":"2024-01-19T04:17:06.743768+0000","last_undegraded":"2024-01-19T04:17:06.743768+0000","last_fullsized":"2024-01-19T04:17:06.743768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:51:25.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698045+0000","last_change":"2024-01-19T04:16:51.580129+0000","last_active":"2024-01-19T04:17:04.698045+0000","last_peered":"2024-01-19T04:17:04.698045+0000","last_clean":"2024-01-19T04:17:04.698045+0000","last_became_active":"2024-01-19T04:16:51.579840+0000","last_became_peered":"2024-01-19T04:16:51.579840+0000","last_unstale":"2024-01-19T04:17:04.698045+0000","last_undegraded":"2024-01-19T04:17:04.698045+0000","last_fullsized":"2024-01-19T04:17:04.698045+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:56:54.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.254220+0000","last_change":"2024-01-19T04:17:04.716555+0000","last_active":"2024-01-19T04:17:07.254220+0000","last_peered":"2024-01-19T04:17:07.254220+0000","last_clean":"2024-01-19T04:17:07.254220+0000","last_became_active":"2024-01-19T04:17:04.716072+0000","last_became_peered":"2024-01-19T04:17:04.716072+0000","last_unstale":"2024-01-19T04:17:07.254220+0000","last_undegraded":"2024-01-19T04:17:07.254220+0000","last_fullsized":"2024-01-19T04:17:07.254220+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:14.912645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702470+0000","last_change":"2024-01-19T04:16:51.574027+0000","last_active":"2024-01-19T04:17:04.702470+0000","last_peered":"2024-01-19T04:17:04.702470+0000","last_clean":"2024-01-19T04:17:04.702470+0000","last_became_active":"2024-01-19T04:16:51.573756+0000","last_became_peered":"2024-01-19T04:16:51.573756+0000","last_unstale":"2024-01-19T04:17:04.702470+0000","last_undegraded":"2024-01-19T04:17:04.702470+0000","last_fullsized":"2024-01-19T04:17:04.702470+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.105517+0000","last_change":"2024-01-19T04:17:04.715758+0000","last_active":"2024-01-19T04:17:06.105517+0000","last_peered":"2024-01-19T04:17:06.105517+0000","last_clean":"2024-01-19T04:17:06.105517+0000","last_became_active":"2024-01-19T04:17:04.715514+0000","last_became_peered":"2024-01-19T04:17:04.715514+0000","last_unstale":"2024-01-19T04:17:06.105517+0000","last_undegraded":"2024-01-19T04:17:06.105517+0000","last_fullsized":"2024-01-19T04:17:06.105517+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:51:36.650683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704740+0000","last_change":"2024-01-19T04:16:51.563134+0000","last_active":"2024-01-19T04:17:04.704740+0000","last_peered":"2024-01-19T04:17:04.704740+0000","last_clean":"2024-01-19T04:17:04.704740+0000","last_became_active":"2024-01-19T04:16:51.562243+0000","last_became_peered":"2024-01-19T04:16:51.562243+0000","last_unstale":"2024-01-19T04:17:04.704740+0000","last_undegraded":"2024-01-19T04:17:04.704740+0000","last_fullsized":"2024-01-19T04:17:04.704740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058023+0000","last_change":"2024-01-19T04:17:04.717509+0000","last_active":"2024-01-19T04:17:06.058023+0000","last_peered":"2024-01-19T04:17:06.058023+0000","last_clean":"2024-01-19T04:17:06.058023+0000","last_became_active":"2024-01-19T04:17:04.717170+0000","last_became_peered":"2024-01-19T04:17:04.717170+0000","last_unstale":"2024-01-19T04:17:06.058023+0000","last_undegraded":"2024-01-19T04:17:06.058023+0000","last_fullsized":"2024-01-19T04:17:06.058023+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:56:58.089850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705187+0000","last_change":"2024-01-19T04:16:51.568590+0000","last_active":"2024-01-19T04:17:04.705187+0000","last_peered":"2024-01-19T04:17:04.705187+0000","last_clean":"2024-01-19T04:17:04.705187+0000","last_became_active":"2024-01-19T04:16:51.567062+0000","last_became_peered":"2024-01-19T04:16:51.567062+0000","last_unstale":"2024-01-19T04:17:04.705187+0000","last_undegraded":"2024-01-19T04:17:04.705187+0000","last_fullsized":"2024-01-19T04:17:04.705187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:16:05.611512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.104345+0000","last_change":"2024-01-19T04:17:04.727256+0000","last_active":"2024-01-19T04:17:06.104345+0000","last_peered":"2024-01-19T04:17:06.104345+0000","last_clean":"2024-01-19T04:17:06.104345+0000","last_became_active":"2024-01-19T04:17:04.726804+0000","last_became_peered":"2024-01-19T04:17:04.726804+0000","last_unstale":"2024-01-19T04:17:06.104345+0000","last_undegraded":"2024-01-19T04:17:06.104345+0000","last_fullsized":"2024-01-19T04:17:06.104345+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:20.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698880+0000","last_change":"2024-01-19T04:16:51.567447+0000","last_active":"2024-01-19T04:17:04.698880+0000","last_peered":"2024-01-19T04:17:04.698880+0000","last_clean":"2024-01-19T04:17:04.698880+0000","last_became_active":"2024-01-19T04:16:51.567187+0000","last_became_peered":"2024-01-19T04:16:51.567187+0000","last_unstale":"2024-01-19T04:17:04.698880+0000","last_undegraded":"2024-01-19T04:17:04.698880+0000","last_fullsized":"2024-01-19T04:17:04.698880+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729515+0000","last_change":"2024-01-19T04:17:04.719319+0000","last_active":"2024-01-19T04:17:06.729515+0000","last_peered":"2024-01-19T04:17:06.729515+0000","last_clean":"2024-01-19T04:17:06.729515+0000","last_became_active":"2024-01-19T04:17:04.717209+0000","last_became_peered":"2024-01-19T04:17:04.717209+0000","last_unstale":"2024-01-19T04:17:06.729515+0000","last_undegraded":"2024-01-19T04:17:06.729515+0000","last_fullsized":"2024-01-19T04:17:06.729515+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:58.517916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694425+0000","last_change":"2024-01-19T04:16:51.568350+0000","last_active":"2024-01-19T04:17:04.694425+0000","last_peered":"2024-01-19T04:17:04.694425+0000","last_clean":"2024-01-19T04:17:04.694425+0000","last_became_active":"2024-01-19T04:16:51.568051+0000","last_became_peered":"2024-01-19T04:16:51.568051+0000","last_unstale":"2024-01-19T04:17:04.694425+0000","last_undegraded":"2024-01-19T04:17:04.694425+0000","last_fullsized":"2024-01-19T04:17:04.694425+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:31.896945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.104685+0000","last_change":"2024-01-19T04:17:04.713905+0000","last_active":"2024-01-19T04:17:06.104685+0000","last_peered":"2024-01-19T04:17:06.104685+0000","last_clean":"2024-01-19T04:17:06.104685+0000","last_became_active":"2024-01-19T04:17:04.713659+0000","last_became_peered":"2024-01-19T04:17:04.713659+0000","last_unstale":"2024-01-19T04:17:06.104685+0000","last_undegraded":"2024-01-19T04:17:06.104685+0000","last_fullsized":"2024-01-19T04:17:06.104685+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:16.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693196+0000","last_change":"2024-01-19T04:16:51.572672+0000","last_active":"2024-01-19T04:17:04.693196+0000","last_peered":"2024-01-19T04:17:04.693196+0000","last_clean":"2024-01-19T04:17:04.693196+0000","last_became_active":"2024-01-19T04:16:51.572209+0000","last_became_peered":"2024-01-19T04:16:51.572209+0000","last_unstale":"2024-01-19T04:17:04.693196+0000","last_undegraded":"2024-01-19T04:17:04.693196+0000","last_fullsized":"2024-01-19T04:17:04.693196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.253913+0000","last_change":"2024-01-19T04:17:04.717847+0000","last_active":"2024-01-19T04:17:07.253913+0000","last_peered":"2024-01-19T04:17:07.253913+0000","last_clean":"2024-01-19T04:17:07.253913+0000","last_became_active":"2024-01-19T04:17:04.715209+0000","last_became_peered":"2024-01-19T04:17:04.715209+0000","last_unstale":"2024-01-19T04:17:07.253913+0000","last_undegraded":"2024-01-19T04:17:07.253913+0000","last_fullsized":"2024-01-19T04:17:07.253913+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:18.964836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695339+0000","last_change":"2024-01-19T04:16:51.569401+0000","last_active":"2024-01-19T04:17:04.695339+0000","last_peered":"2024-01-19T04:17:04.695339+0000","last_clean":"2024-01-19T04:17:04.695339+0000","last_became_active":"2024-01-19T04:16:51.569130+0000","last_became_peered":"2024-01-19T04:16:51.569130+0000","last_unstale":"2024-01-19T04:17:04.695339+0000","last_undegraded":"2024-01-19T04:17:04.695339+0000","last_fullsized":"2024-01-19T04:17:04.695339+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:46.968261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743462+0000","last_change":"2024-01-19T04:17:04.711509+0000","last_active":"2024-01-19T04:17:06.743462+0000","last_peered":"2024-01-19T04:17:06.743462+0000","last_clean":"2024-01-19T04:17:06.743462+0000","last_became_active":"2024-01-19T04:17:04.711256+0000","last_became_peered":"2024-01-19T04:17:04.711256+0000","last_unstale":"2024-01-19T04:17:06.743462+0000","last_undegraded":"2024-01-19T04:17:06.743462+0000","last_fullsized":"2024-01-19T04:17:06.743462+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:20:39.111262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.697718+0000","last_change":"2024-01-19T04:16:51.583971+0000","last_active":"2024-01-19T04:17:04.697718+0000","last_peered":"2024-01-19T04:17:04.697718+0000","last_clean":"2024-01-19T04:17:04.697718+0000","last_became_active":"2024-01-19T04:16:51.583688+0000","last_became_peered":"2024-01-19T04:16:51.583688+0000","last_unstale":"2024-01-19T04:17:04.697718+0000","last_undegraded":"2024-01-19T04:17:04.697718+0000","last_fullsized":"2024-01-19T04:17:04.697718+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:56:51.290086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.730182+0000","last_change":"2024-01-19T04:17:04.711401+0000","last_active":"2024-01-19T04:17:06.730182+0000","last_peered":"2024-01-19T04:17:06.730182+0000","last_clean":"2024-01-19T04:17:06.730182+0000","last_became_active":"2024-01-19T04:17:04.711035+0000","last_became_peered":"2024-01-19T04:17:04.711035+0000","last_unstale":"2024-01-19T04:17:06.730182+0000","last_undegraded":"2024-01-19T04:17:06.730182+0000","last_fullsized":"2024-01-19T04:17:06.730182+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:36.178015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698065+0000","last_change":"2024-01-19T04:16:51.581824+0000","last_active":"2024-01-19T04:17:04.698065+0000","last_peered":"2024-01-19T04:17:04.698065+0000","last_clean":"2024-01-19T04:17:04.698065+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:04.698065+0000","last_undegraded":"2024-01-19T04:17:04.698065+0000","last_fullsized":"2024-01-19T04:17:04.698065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:26.385285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.712170+0000","last_change":"2024-01-19T04:17:04.711461+0000","last_active":"2024-01-19T04:17:05.712170+0000","last_peered":"2024-01-19T04:17:05.712170+0000","last_clean":"2024-01-19T04:17:05.712170+0000","last_became_active":"2024-01-19T04:17:04.711292+0000","last_became_peered":"2024-01-19T04:17:04.711292+0000","last_unstale":"2024-01-19T04:17:05.712170+0000","last_undegraded":"2024-01-19T04:17:05.712170+0000","last_fullsized":"2024-01-19T04:17:05.712170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:26.189065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704403+0000","last_change":"2024-01-19T04:16:51.575108+0000","last_active":"2024-01-19T04:17:04.704403+0000","last_peered":"2024-01-19T04:17:04.704403+0000","last_clean":"2024-01-19T04:17:04.704403+0000","last_became_active":"2024-01-19T04:16:51.574596+0000","last_became_peered":"2024-01-19T04:16:51.574596+0000","last_unstale":"2024-01-19T04:17:04.704403+0000","last_undegraded":"2024-01-19T04:17:04.704403+0000","last_fullsized":"2024-01-19T04:17:04.704403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709459+0000","last_change":"2024-01-19T04:17:04.713824+0000","last_active":"2024-01-19T04:17:05.709459+0000","last_peered":"2024-01-19T04:17:05.709459+0000","last_clean":"2024-01-19T04:17:05.709459+0000","last_became_active":"2024-01-19T04:17:04.713548+0000","last_became_peered":"2024-01-19T04:17:04.713548+0000","last_unstale":"2024-01-19T04:17:05.709459+0000","last_undegraded":"2024-01-19T04:17:05.709459+0000","last_fullsized":"2024-01-19T04:17:05.709459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:56:58.089850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702323+0000","last_change":"2024-01-19T04:16:51.579903+0000","last_active":"2024-01-19T04:17:04.702323+0000","last_peered":"2024-01-19T04:17:04.702323+0000","last_clean":"2024-01-19T04:17:04.702323+0000","last_became_active":"2024-01-19T04:16:51.579415+0000","last_became_peered":"2024-01-19T04:16:51.579415+0000","last_unstale":"2024-01-19T04:17:04.702323+0000","last_undegraded":"2024-01-19T04:17:04.702323+0000","last_fullsized":"2024-01-19T04:17:04.702323+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:31.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.711026+0000","last_change":"2024-01-19T04:17:04.723485+0000","last_active":"2024-01-19T04:17:05.711026+0000","last_peered":"2024-01-19T04:17:05.711026+0000","last_clean":"2024-01-19T04:17:05.711026+0000","last_became_active":"2024-01-19T04:17:04.723202+0000","last_became_peered":"2024-01-19T04:17:04.723202+0000","last_unstale":"2024-01-19T04:17:05.711026+0000","last_undegraded":"2024-01-19T04:17:05.711026+0000","last_fullsized":"2024-01-19T04:17:05.711026+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:51:36.650683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695631+0000","last_change":"2024-01-19T04:16:51.568949+0000","last_active":"2024-01-19T04:17:04.695631+0000","last_peered":"2024-01-19T04:17:04.695631+0000","last_clean":"2024-01-19T04:17:04.695631+0000","last_became_active":"2024-01-19T04:16:51.568682+0000","last_became_peered":"2024-01-19T04:16:51.568682+0000","last_unstale":"2024-01-19T04:17:04.695631+0000","last_undegraded":"2024-01-19T04:17:04.695631+0000","last_fullsized":"2024-01-19T04:17:04.695631+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:23.038136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709628+0000","last_change":"2024-01-19T04:17:04.730023+0000","last_active":"2024-01-19T04:17:05.709628+0000","last_peered":"2024-01-19T04:17:05.709628+0000","last_clean":"2024-01-19T04:17:05.709628+0000","last_became_active":"2024-01-19T04:17:04.729725+0000","last_became_peered":"2024-01-19T04:17:04.729725+0000","last_unstale":"2024-01-19T04:17:05.709628+0000","last_undegraded":"2024-01-19T04:17:05.709628+0000","last_fullsized":"2024-01-19T04:17:05.709628+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:11:42.817870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694621+0000","last_change":"2024-01-19T04:16:51.588950+0000","last_active":"2024-01-19T04:17:04.694621+0000","last_peered":"2024-01-19T04:17:04.694621+0000","last_clean":"2024-01-19T04:17:04.694621+0000","last_became_active":"2024-01-19T04:16:51.577721+0000","last_became_peered":"2024-01-19T04:16:51.577721+0000","last_unstale":"2024-01-19T04:17:04.694621+0000","last_undegraded":"2024-01-19T04:17:04.694621+0000","last_fullsized":"2024-01-19T04:17:04.694621+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:30.735073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729496+0000","last_change":"2024-01-19T04:17:04.711759+0000","last_active":"2024-01-19T04:17:06.729496+0000","last_peered":"2024-01-19T04:17:06.729496+0000","last_clean":"2024-01-19T04:17:06.729496+0000","last_became_active":"2024-01-19T04:17:04.711508+0000","last_became_peered":"2024-01-19T04:17:04.711508+0000","last_unstale":"2024-01-19T04:17:06.729496+0000","last_undegraded":"2024-01-19T04:17:06.729496+0000","last_fullsized":"2024-01-19T04:17:06.729496+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:50.332339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700130+0000","last_change":"2024-01-19T04:16:51.581861+0000","last_active":"2024-01-19T04:17:04.700130+0000","last_peered":"2024-01-19T04:17:04.700130+0000","last_clean":"2024-01-19T04:17:04.700130+0000","last_became_active":"2024-01-19T04:16:51.581465+0000","last_became_peered":"2024-01-19T04:16:51.581465+0000","last_unstale":"2024-01-19T04:17:04.700130+0000","last_undegraded":"2024-01-19T04:17:04.700130+0000","last_fullsized":"2024-01-19T04:17:04.700130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.105437+0000","last_change":"2024-01-19T04:17:04.717627+0000","last_active":"2024-01-19T04:17:06.105437+0000","last_peered":"2024-01-19T04:17:06.105437+0000","last_clean":"2024-01-19T04:17:06.105437+0000","last_became_active":"2024-01-19T04:17:04.717351+0000","last_became_peered":"2024-01-19T04:17:04.717351+0000","last_unstale":"2024-01-19T04:17:06.105437+0000","last_undegraded":"2024-01-19T04:17:06.105437+0000","last_fullsized":"2024-01-19T04:17:06.105437+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:19.815868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698393+0000","last_change":"2024-01-19T04:16:51.589385+0000","last_active":"2024-01-19T04:17:04.698393+0000","last_peered":"2024-01-19T04:17:04.698393+0000","last_clean":"2024-01-19T04:17:04.698393+0000","last_became_active":"2024-01-19T04:16:51.586748+0000","last_became_peered":"2024-01-19T04:16:51.586748+0000","last_unstale":"2024-01-19T04:17:04.698393+0000","last_undegraded":"2024-01-19T04:17:04.698393+0000","last_fullsized":"2024-01-19T04:17:04.698393+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:17:50.471394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709595+0000","last_change":"2024-01-19T04:17:04.714398+0000","last_active":"2024-01-19T04:17:05.709595+0000","last_peered":"2024-01-19T04:17:05.709595+0000","last_clean":"2024-01-19T04:17:05.709595+0000","last_became_active":"2024-01-19T04:17:04.713488+0000","last_became_peered":"2024-01-19T04:17:04.713488+0000","last_unstale":"2024-01-19T04:17:05.709595+0000","last_undegraded":"2024-01-19T04:17:05.709595+0000","last_fullsized":"2024-01-19T04:17:05.709595+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:16.431064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702135+0000","last_change":"2024-01-19T04:16:51.576164+0000","last_active":"2024-01-19T04:17:04.702135+0000","last_peered":"2024-01-19T04:17:04.702135+0000","last_clean":"2024-01-19T04:17:04.702135+0000","last_became_active":"2024-01-19T04:16:51.575615+0000","last_became_peered":"2024-01-19T04:16:51.575615+0000","last_unstale":"2024-01-19T04:17:04.702135+0000","last_undegraded":"2024-01-19T04:17:04.702135+0000","last_fullsized":"2024-01-19T04:17:04.702135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.730280+0000","last_change":"2024-01-19T04:17:04.709853+0000","last_active":"2024-01-19T04:17:06.730280+0000","last_peered":"2024-01-19T04:17:06.730280+0000","last_clean":"2024-01-19T04:17:06.730280+0000","last_became_active":"2024-01-19T04:17:04.709465+0000","last_became_peered":"2024-01-19T04:17:04.709465+0000","last_unstale":"2024-01-19T04:17:06.730280+0000","last_undegraded":"2024-01-19T04:17:06.730280+0000","last_fullsized":"2024-01-19T04:17:06.730280+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:00.108140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705399+0000","last_change":"2024-01-19T04:16:51.587440+0000","last_active":"2024-01-19T04:17:04.705399+0000","last_peered":"2024-01-19T04:17:04.705399+0000","last_clean":"2024-01-19T04:17:04.705399+0000","last_became_active":"2024-01-19T04:16:51.584713+0000","last_became_peered":"2024-01-19T04:16:51.584713+0000","last_unstale":"2024-01-19T04:17:04.705399+0000","last_undegraded":"2024-01-19T04:17:04.705399+0000","last_fullsized":"2024-01-19T04:17:04.705399+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:19.082622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743841+0000","last_change":"2024-01-19T04:17:04.723661+0000","last_active":"2024-01-19T04:17:06.743841+0000","last_peered":"2024-01-19T04:17:06.743841+0000","last_clean":"2024-01-19T04:17:06.743841+0000","last_became_active":"2024-01-19T04:17:04.723415+0000","last_became_peered":"2024-01-19T04:17:04.723415+0000","last_unstale":"2024-01-19T04:17:06.743841+0000","last_undegraded":"2024-01-19T04:17:06.743841+0000","last_fullsized":"2024-01-19T04:17:06.743841+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.021270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696903+0000","last_change":"2024-01-19T04:16:51.584822+0000","last_active":"2024-01-19T04:17:04.696903+0000","last_peered":"2024-01-19T04:17:04.696903+0000","last_clean":"2024-01-19T04:17:04.696903+0000","last_became_active":"2024-01-19T04:16:51.584562+0000","last_became_peered":"2024-01-19T04:16:51.584562+0000","last_unstale":"2024-01-19T04:17:04.696903+0000","last_undegraded":"2024-01-19T04:17:04.696903+0000","last_fullsized":"2024-01-19T04:17:04.696903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:10:42.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.253316+0000","last_change":"2024-01-19T04:17:04.716882+0000","last_active":"2024-01-19T04:17:07.253316+0000","last_peered":"2024-01-19T04:17:07.253316+0000","last_clean":"2024-01-19T04:17:07.253316+0000","last_became_active":"2024-01-19T04:17:04.713277+0000","last_became_peered":"2024-01-19T04:17:04.713277+0000","last_unstale":"2024-01-19T04:17:07.253316+0000","last_undegraded":"2024-01-19T04:17:07.253316+0000","last_fullsized":"2024-01-19T04:17:07.253316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:11:42.817870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699368+0000","last_change":"2024-01-19T04:16:51.577212+0000","last_active":"2024-01-19T04:17:04.699368+0000","last_peered":"2024-01-19T04:17:04.699368+0000","last_clean":"2024-01-19T04:17:04.699368+0000","last_became_active":"2024-01-19T04:16:51.576909+0000","last_became_peered":"2024-01-19T04:16:51.576909+0000","last_unstale":"2024-01-19T04:17:04.699368+0000","last_undegraded":"2024-01-19T04:17:04.699368+0000","last_fullsized":"2024-01-19T04:17:04.699368+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.253069+0000","last_change":"2024-01-19T04:17:04.730136+0000","last_active":"2024-01-19T04:17:07.253069+0000","last_peered":"2024-01-19T04:17:07.253069+0000","last_clean":"2024-01-19T04:17:07.253069+0000","last_became_active":"2024-01-19T04:17:04.729830+0000","last_became_peered":"2024-01-19T04:17:04.729830+0000","last_unstale":"2024-01-19T04:17:07.253069+0000","last_undegraded":"2024-01-19T04:17:07.253069+0000","last_fullsized":"2024-01-19T04:17:07.253069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:16.431064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695154+0000","last_change":"2024-01-19T04:16:51.576501+0000","last_active":"2024-01-19T04:17:04.695154+0000","last_peered":"2024-01-19T04:17:04.695154+0000","last_clean":"2024-01-19T04:17:04.695154+0000","last_became_active":"2024-01-19T04:16:51.570654+0000","last_became_peered":"2024-01-19T04:16:51.570654+0000","last_unstale":"2024-01-19T04:17:04.695154+0000","last_undegraded":"2024-01-19T04:17:04.695154+0000","last_fullsized":"2024-01-19T04:17:04.695154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:47:50.383122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.711803+0000","last_change":"2024-01-19T04:17:04.702550+0000","last_active":"2024-01-19T04:17:05.711803+0000","last_peered":"2024-01-19T04:17:05.711803+0000","last_clean":"2024-01-19T04:17:05.711803+0000","last_became_active":"2024-01-19T04:17:04.702274+0000","last_became_peered":"2024-01-19T04:17:04.702274+0000","last_unstale":"2024-01-19T04:17:05.711803+0000","last_undegraded":"2024-01-19T04:17:05.711803+0000","last_fullsized":"2024-01-19T04:17:05.711803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:29.636502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700366+0000","last_change":"2024-01-19T04:16:51.581241+0000","last_active":"2024-01-19T04:17:04.700366+0000","last_peered":"2024-01-19T04:17:04.700366+0000","last_clean":"2024-01-19T04:17:04.700366+0000","last_became_active":"2024-01-19T04:16:51.580556+0000","last_became_peered":"2024-01-19T04:16:51.580556+0000","last_unstale":"2024-01-19T04:17:04.700366+0000","last_undegraded":"2024-01-19T04:17:04.700366+0000","last_fullsized":"2024-01-19T04:17:04.700366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:08.881391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.711411+0000","last_change":"2024-01-19T04:17:04.709401+0000","last_active":"2024-01-19T04:17:05.711411+0000","last_peered":"2024-01-19T04:17:05.711411+0000","last_clean":"2024-01-19T04:17:05.711411+0000","last_became_active":"2024-01-19T04:17:04.709156+0000","last_became_peered":"2024-01-19T04:17:04.709156+0000","last_unstale":"2024-01-19T04:17:05.711411+0000","last_undegraded":"2024-01-19T04:17:05.711411+0000","last_fullsized":"2024-01-19T04:17:05.711411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:58:34.798641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710764+0000","last_change":"2024-01-19T04:16:51.579937+0000","last_active":"2024-01-19T04:17:04.710764+0000","last_peered":"2024-01-19T04:17:04.710764+0000","last_clean":"2024-01-19T04:17:04.710764+0000","last_became_active":"2024-01-19T04:16:51.579649+0000","last_became_peered":"2024-01-19T04:16:51.579649+0000","last_unstale":"2024-01-19T04:17:04.710764+0000","last_undegraded":"2024-01-19T04:17:04.710764+0000","last_fullsized":"2024-01-19T04:17:04.710764+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:34.912454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924294+0000","last_change":"2024-01-19T04:17:04.712711+0000","last_active":"2024-01-19T04:17:06.924294+0000","last_peered":"2024-01-19T04:17:06.924294+0000","last_clean":"2024-01-19T04:17:06.924294+0000","last_became_active":"2024-01-19T04:17:04.712411+0000","last_became_peered":"2024-01-19T04:17:04.712411+0000","last_unstale":"2024-01-19T04:17:06.924294+0000","last_undegraded":"2024-01-19T04:17:06.924294+0000","last_fullsized":"2024-01-19T04:17:06.924294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:51:57.520659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705659+0000","last_change":"2024-01-19T04:16:51.578912+0000","last_active":"2024-01-19T04:17:04.705659+0000","last_peered":"2024-01-19T04:17:04.705659+0000","last_clean":"2024-01-19T04:17:04.705659+0000","last_became_active":"2024-01-19T04:16:51.578643+0000","last_became_peered":"2024-01-19T04:16:51.578643+0000","last_unstale":"2024-01-19T04:17:04.705659+0000","last_undegraded":"2024-01-19T04:17:04.705659+0000","last_fullsized":"2024-01-19T04:17:04.705659+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:23.111411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.711716+0000","last_change":"2024-01-19T04:17:04.713886+0000","last_active":"2024-01-19T04:17:05.711716+0000","last_peered":"2024-01-19T04:17:05.711716+0000","last_clean":"2024-01-19T04:17:05.711716+0000","last_became_active":"2024-01-19T04:17:04.713640+0000","last_became_peered":"2024-01-19T04:17:04.713640+0000","last_unstale":"2024-01-19T04:17:05.711716+0000","last_undegraded":"2024-01-19T04:17:05.711716+0000","last_fullsized":"2024-01-19T04:17:05.711716+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:23.302966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704445+0000","last_change":"2024-01-19T04:16:51.573193+0000","last_active":"2024-01-19T04:17:04.704445+0000","last_peered":"2024-01-19T04:17:04.704445+0000","last_clean":"2024-01-19T04:17:04.704445+0000","last_became_active":"2024-01-19T04:16:51.572674+0000","last_became_peered":"2024-01-19T04:16:51.572674+0000","last_unstale":"2024-01-19T04:17:04.704445+0000","last_undegraded":"2024-01-19T04:17:04.704445+0000","last_fullsized":"2024-01-19T04:17:04.704445+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.712267+0000","last_change":"2024-01-19T04:17:04.707630+0000","last_active":"2024-01-19T04:17:05.712267+0000","last_peered":"2024-01-19T04:17:05.712267+0000","last_clean":"2024-01-19T04:17:05.712267+0000","last_became_active":"2024-01-19T04:17:04.707287+0000","last_became_peered":"2024-01-19T04:17:04.707287+0000","last_unstale":"2024-01-19T04:17:05.712267+0000","last_undegraded":"2024-01-19T04:17:05.712267+0000","last_fullsized":"2024-01-19T04:17:05.712267+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:04.659714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702366+0000","last_change":"2024-01-19T04:16:51.586794+0000","last_active":"2024-01-19T04:17:04.702366+0000","last_peered":"2024-01-19T04:17:04.702366+0000","last_clean":"2024-01-19T04:17:04.702366+0000","last_became_active":"2024-01-19T04:16:51.582729+0000","last_became_peered":"2024-01-19T04:16:51.582729+0000","last_unstale":"2024-01-19T04:17:04.702366+0000","last_undegraded":"2024-01-19T04:17:04.702366+0000","last_fullsized":"2024-01-19T04:17:04.702366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058805+0000","last_change":"2024-01-19T04:17:04.726864+0000","last_active":"2024-01-19T04:17:06.058805+0000","last_peered":"2024-01-19T04:17:06.058805+0000","last_clean":"2024-01-19T04:17:06.058805+0000","last_became_active":"2024-01-19T04:17:04.726530+0000","last_became_peered":"2024-01-19T04:17:04.726530+0000","last_unstale":"2024-01-19T04:17:06.058805+0000","last_undegraded":"2024-01-19T04:17:06.058805+0000","last_fullsized":"2024-01-19T04:17:06.058805+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:11:42.817870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705459+0000","last_change":"2024-01-19T04:16:51.568656+0000","last_active":"2024-01-19T04:17:04.705459+0000","last_peered":"2024-01-19T04:17:04.705459+0000","last_clean":"2024-01-19T04:17:04.705459+0000","last_became_active":"2024-01-19T04:16:51.568371+0000","last_became_peered":"2024-01-19T04:16:51.568371+0000","last_unstale":"2024-01-19T04:17:04.705459+0000","last_undegraded":"2024-01-19T04:17:04.705459+0000","last_fullsized":"2024-01-19T04:17:04.705459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:42.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058108+0000","last_change":"2024-01-19T04:17:04.713110+0000","last_active":"2024-01-19T04:17:06.058108+0000","last_peered":"2024-01-19T04:17:06.058108+0000","last_clean":"2024-01-19T04:17:06.058108+0000","last_became_active":"2024-01-19T04:17:04.712838+0000","last_became_peered":"2024-01-19T04:17:04.712838+0000","last_unstale":"2024-01-19T04:17:06.058108+0000","last_undegraded":"2024-01-19T04:17:06.058108+0000","last_fullsized":"2024-01-19T04:17:06.058108+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:26.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695186+0000","last_change":"2024-01-19T04:16:51.583324+0000","last_active":"2024-01-19T04:17:04.695186+0000","last_peered":"2024-01-19T04:17:04.695186+0000","last_clean":"2024-01-19T04:17:04.695186+0000","last_became_active":"2024-01-19T04:16:51.581565+0000","last_became_peered":"2024-01-19T04:16:51.581565+0000","last_unstale":"2024-01-19T04:17:04.695186+0000","last_undegraded":"2024-01-19T04:17:04.695186+0000","last_fullsized":"2024-01-19T04:17:04.695186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:01.837432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.105062+0000","last_change":"2024-01-19T04:17:04.727034+0000","last_active":"2024-01-19T04:17:06.105062+0000","last_peered":"2024-01-19T04:17:06.105062+0000","last_clean":"2024-01-19T04:17:06.105062+0000","last_became_active":"2024-01-19T04:17:04.726442+0000","last_became_peered":"2024-01-19T04:17:04.726442+0000","last_unstale":"2024-01-19T04:17:06.105062+0000","last_undegraded":"2024-01-19T04:17:06.105062+0000","last_fullsized":"2024-01-19T04:17:06.105062+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:54.685503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699600+0000","last_change":"2024-01-19T04:16:51.577511+0000","last_active":"2024-01-19T04:17:04.699600+0000","last_peered":"2024-01-19T04:17:04.699600+0000","last_clean":"2024-01-19T04:17:04.699600+0000","last_became_active":"2024-01-19T04:16:51.577076+0000","last_became_peered":"2024-01-19T04:16:51.577076+0000","last_unstale":"2024-01-19T04:17:04.699600+0000","last_undegraded":"2024-01-19T04:17:04.699600+0000","last_fullsized":"2024-01-19T04:17:04.699600+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:28.231945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.924130+0000","last_change":"2024-01-19T04:17:04.713152+0000","last_active":"2024-01-19T04:17:06.924130+0000","last_peered":"2024-01-19T04:17:06.924130+0000","last_clean":"2024-01-19T04:17:06.924130+0000","last_became_active":"2024-01-19T04:17:04.712882+0000","last_became_peered":"2024-01-19T04:17:04.712882+0000","last_unstale":"2024-01-19T04:17:06.924130+0000","last_undegraded":"2024-01-19T04:17:06.924130+0000","last_fullsized":"2024-01-19T04:17:06.924130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:02.470278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705151+0000","last_change":"2024-01-19T04:16:51.578248+0000","last_active":"2024-01-19T04:17:04.705151+0000","last_peered":"2024-01-19T04:17:04.705151+0000","last_clean":"2024-01-19T04:17:04.705151+0000","last_became_active":"2024-01-19T04:16:51.577983+0000","last_became_peered":"2024-01-19T04:16:51.577983+0000","last_unstale":"2024-01-19T04:17:04.705151+0000","last_undegraded":"2024-01-19T04:17:04.705151+0000","last_fullsized":"2024-01-19T04:17:04.705151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:08:14.895654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058393+0000","last_change":"2024-01-19T04:17:04.727249+0000","last_active":"2024-01-19T04:17:06.058393+0000","last_peered":"2024-01-19T04:17:06.058393+0000","last_clean":"2024-01-19T04:17:06.058393+0000","last_became_active":"2024-01-19T04:17:04.726674+0000","last_became_peered":"2024-01-19T04:17:04.726674+0000","last_unstale":"2024-01-19T04:17:06.058393+0000","last_undegraded":"2024-01-19T04:17:06.058393+0000","last_fullsized":"2024-01-19T04:17:06.058393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:16.431064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700337+0000","last_change":"2024-01-19T04:16:51.586614+0000","last_active":"2024-01-19T04:17:04.700337+0000","last_peered":"2024-01-19T04:17:04.700337+0000","last_clean":"2024-01-19T04:17:04.700337+0000","last_became_active":"2024-01-19T04:16:51.586104+0000","last_became_peered":"2024-01-19T04:16:51.586104+0000","last_unstale":"2024-01-19T04:17:04.700337+0000","last_undegraded":"2024-01-19T04:17:04.700337+0000","last_fullsized":"2024-01-19T04:17:04.700337+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.105226+0000","last_change":"2024-01-19T04:17:04.730684+0000","last_active":"2024-01-19T04:17:06.105226+0000","last_peered":"2024-01-19T04:17:06.105226+0000","last_clean":"2024-01-19T04:17:06.105226+0000","last_became_active":"2024-01-19T04:17:04.729893+0000","last_became_peered":"2024-01-19T04:17:04.729893+0000","last_unstale":"2024-01-19T04:17:06.105226+0000","last_undegraded":"2024-01-19T04:17:06.105226+0000","last_fullsized":"2024-01-19T04:17:06.105226+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:47.855585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062873+0000","last_change":"2024-01-19T04:17:03.712060+0000","last_active":"2024-01-19T04:17:05.062873+0000","last_peered":"2024-01-19T04:17:05.062873+0000","last_clean":"2024-01-19T04:17:05.062873+0000","last_became_active":"2024-01-19T04:17:03.711745+0000","last_became_peered":"2024-01-19T04:17:03.711745+0000","last_unstale":"2024-01-19T04:17:05.062873+0000","last_undegraded":"2024-01-19T04:17:05.062873+0000","last_fullsized":"2024-01-19T04:17:05.062873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:39.750994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702199+0000","last_change":"2024-01-19T04:16:51.575044+0000","last_active":"2024-01-19T04:17:04.702199+0000","last_peered":"2024-01-19T04:17:04.702199+0000","last_clean":"2024-01-19T04:17:04.702199+0000","last_became_active":"2024-01-19T04:16:51.574674+0000","last_became_peered":"2024-01-19T04:16:51.574674+0000","last_unstale":"2024-01-19T04:17:04.702199+0000","last_undegraded":"2024-01-19T04:17:04.702199+0000","last_fullsized":"2024-01-19T04:17:04.702199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701686+0000","last_change":"2024-01-19T04:16:50.572149+0000","last_active":"2024-01-19T04:17:04.701686+0000","last_peered":"2024-01-19T04:17:04.701686+0000","last_clean":"2024-01-19T04:17:04.701686+0000","last_became_active":"2024-01-19T04:16:50.571648+0000","last_became_peered":"2024-01-19T04:16:50.571648+0000","last_unstale":"2024-01-19T04:17:04.701686+0000","last_undegraded":"2024-01-19T04:17:04.701686+0000","last_fullsized":"2024-01-19T04:17:04.701686+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.253997+0000","last_change":"2024-01-19T04:17:04.718498+0000","last_active":"2024-01-19T04:17:07.253997+0000","last_peered":"2024-01-19T04:17:07.253997+0000","last_clean":"2024-01-19T04:17:07.253997+0000","last_became_active":"2024-01-19T04:17:04.717566+0000","last_became_peered":"2024-01-19T04:17:04.717566+0000","last_unstale":"2024-01-19T04:17:07.253997+0000","last_undegraded":"2024-01-19T04:17:07.253997+0000","last_fullsized":"2024-01-19T04:17:07.253997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:01.990405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062368+0000","last_change":"2024-01-19T04:17:03.709880+0000","last_active":"2024-01-19T04:17:05.062368+0000","last_peered":"2024-01-19T04:17:05.062368+0000","last_clean":"2024-01-19T04:17:05.062368+0000","last_became_active":"2024-01-19T04:17:03.709543+0000","last_became_peered":"2024-01-19T04:17:03.709543+0000","last_unstale":"2024-01-19T04:17:05.062368+0000","last_undegraded":"2024-01-19T04:17:05.062368+0000","last_fullsized":"2024-01-19T04:17:05.062368+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:31:11.411184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698745+0000","last_change":"2024-01-19T04:16:51.590705+0000","last_active":"2024-01-19T04:17:04.698745+0000","last_peered":"2024-01-19T04:17:04.698745+0000","last_clean":"2024-01-19T04:17:04.698745+0000","last_became_active":"2024-01-19T04:16:51.590304+0000","last_became_peered":"2024-01-19T04:16:51.590304+0000","last_unstale":"2024-01-19T04:17:04.698745+0000","last_undegraded":"2024-01-19T04:17:04.698745+0000","last_fullsized":"2024-01-19T04:17:04.698745+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:51.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698137+0000","last_change":"2024-01-19T04:16:50.567145+0000","last_active":"2024-01-19T04:17:04.698137+0000","last_peered":"2024-01-19T04:17:04.698137+0000","last_clean":"2024-01-19T04:17:04.698137+0000","last_became_active":"2024-01-19T04:16:50.566844+0000","last_became_peered":"2024-01-19T04:16:50.566844+0000","last_unstale":"2024-01-19T04:17:04.698137+0000","last_undegraded":"2024-01-19T04:17:04.698137+0000","last_fullsized":"2024-01-19T04:17:04.698137+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:21:07.777595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.254132+0000","last_change":"2024-01-19T04:17:04.732829+0000","last_active":"2024-01-19T04:17:07.254132+0000","last_peered":"2024-01-19T04:17:07.254132+0000","last_clean":"2024-01-19T04:17:07.254132+0000","last_became_active":"2024-01-19T04:17:04.732552+0000","last_became_peered":"2024-01-19T04:17:04.732552+0000","last_unstale":"2024-01-19T04:17:07.254132+0000","last_undegraded":"2024-01-19T04:17:07.254132+0000","last_fullsized":"2024-01-19T04:17:07.254132+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:11.115616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062719+0000","last_change":"2024-01-19T04:17:03.713210+0000","last_active":"2024-01-19T04:17:05.062719+0000","last_peered":"2024-01-19T04:17:05.062719+0000","last_clean":"2024-01-19T04:17:05.062719+0000","last_became_active":"2024-01-19T04:17:03.712941+0000","last_became_peered":"2024-01-19T04:17:03.712941+0000","last_unstale":"2024-01-19T04:17:05.062719+0000","last_undegraded":"2024-01-19T04:17:05.062719+0000","last_fullsized":"2024-01-19T04:17:05.062719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701314+0000","last_change":"2024-01-19T04:16:51.573140+0000","last_active":"2024-01-19T04:17:04.701314+0000","last_peered":"2024-01-19T04:17:04.701314+0000","last_clean":"2024-01-19T04:17:04.701314+0000","last_became_active":"2024-01-19T04:16:51.572831+0000","last_became_peered":"2024-01-19T04:16:51.572831+0000","last_unstale":"2024-01-19T04:17:04.701314+0000","last_undegraded":"2024-01-19T04:17:04.701314+0000","last_fullsized":"2024-01-19T04:17:04.701314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702610+0000","last_change":"2024-01-19T04:16:50.563884+0000","last_active":"2024-01-19T04:17:04.702610+0000","last_peered":"2024-01-19T04:17:04.702610+0000","last_clean":"2024-01-19T04:17:04.702610+0000","last_became_active":"2024-01-19T04:16:50.563631+0000","last_became_peered":"2024-01-19T04:16:50.563631+0000","last_unstale":"2024-01-19T04:17:04.702610+0000","last_undegraded":"2024-01-19T04:17:04.702610+0000","last_fullsized":"2024-01-19T04:17:04.702610+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.730350+0000","last_change":"2024-01-19T04:17:04.716858+0000","last_active":"2024-01-19T04:17:06.730350+0000","last_peered":"2024-01-19T04:17:06.730350+0000","last_clean":"2024-01-19T04:17:06.730350+0000","last_became_active":"2024-01-19T04:17:04.712316+0000","last_became_peered":"2024-01-19T04:17:04.712316+0000","last_unstale":"2024-01-19T04:17:06.730350+0000","last_undegraded":"2024-01-19T04:17:06.730350+0000","last_fullsized":"2024-01-19T04:17:06.730350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:31:12.417397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.723980+0000","last_change":"2024-01-19T04:17:03.710296+0000","last_active":"2024-01-19T04:17:04.723980+0000","last_peered":"2024-01-19T04:17:04.723980+0000","last_clean":"2024-01-19T04:17:04.723980+0000","last_became_active":"2024-01-19T04:17:03.710001+0000","last_became_peered":"2024-01-19T04:17:03.710001+0000","last_unstale":"2024-01-19T04:17:04.723980+0000","last_undegraded":"2024-01-19T04:17:04.723980+0000","last_fullsized":"2024-01-19T04:17:04.723980+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:03.653501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702458+0000","last_change":"2024-01-19T04:16:51.574394+0000","last_active":"2024-01-19T04:17:04.702458+0000","last_peered":"2024-01-19T04:17:04.702458+0000","last_clean":"2024-01-19T04:17:04.702458+0000","last_became_active":"2024-01-19T04:16:51.573866+0000","last_became_peered":"2024-01-19T04:16:51.573866+0000","last_unstale":"2024-01-19T04:17:04.702458+0000","last_undegraded":"2024-01-19T04:17:04.702458+0000","last_fullsized":"2024-01-19T04:17:04.702458+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704515+0000","last_change":"2024-01-19T04:16:50.571503+0000","last_active":"2024-01-19T04:17:04.704515+0000","last_peered":"2024-01-19T04:17:04.704515+0000","last_clean":"2024-01-19T04:17:04.704515+0000","last_became_active":"2024-01-19T04:16:50.571066+0000","last_became_peered":"2024-01-19T04:16:50.571066+0000","last_unstale":"2024-01-19T04:17:04.704515+0000","last_undegraded":"2024-01-19T04:17:04.704515+0000","last_fullsized":"2024-01-19T04:17:04.704515+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729208+0000","last_change":"2024-01-19T04:17:04.713600+0000","last_active":"2024-01-19T04:17:06.729208+0000","last_peered":"2024-01-19T04:17:06.729208+0000","last_clean":"2024-01-19T04:17:06.729208+0000","last_became_active":"2024-01-19T04:17:04.710781+0000","last_became_peered":"2024-01-19T04:17:04.710781+0000","last_unstale":"2024-01-19T04:17:06.729208+0000","last_undegraded":"2024-01-19T04:17:06.729208+0000","last_fullsized":"2024-01-19T04:17:06.729208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:20:50.623112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699133+0000","last_change":"2024-01-19T04:17:03.705700+0000","last_active":"2024-01-19T04:17:04.699133+0000","last_peered":"2024-01-19T04:17:04.699133+0000","last_clean":"2024-01-19T04:17:04.699133+0000","last_became_active":"2024-01-19T04:17:03.705353+0000","last_became_peered":"2024-01-19T04:17:03.705353+0000","last_unstale":"2024-01-19T04:17:04.699133+0000","last_undegraded":"2024-01-19T04:17:04.699133+0000","last_fullsized":"2024-01-19T04:17:04.699133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:10.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695238+0000","last_change":"2024-01-19T04:16:51.573659+0000","last_active":"2024-01-19T04:17:04.695238+0000","last_peered":"2024-01-19T04:17:04.695238+0000","last_clean":"2024-01-19T04:17:04.695238+0000","last_became_active":"2024-01-19T04:16:51.570362+0000","last_became_peered":"2024-01-19T04:16:51.570362+0000","last_unstale":"2024-01-19T04:17:04.695238+0000","last_undegraded":"2024-01-19T04:17:04.695238+0000","last_fullsized":"2024-01-19T04:17:04.695238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:40:12.091637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694633+0000","last_change":"2024-01-19T04:16:50.562830+0000","last_active":"2024-01-19T04:17:04.694633+0000","last_peered":"2024-01-19T04:17:04.694633+0000","last_clean":"2024-01-19T04:17:04.694633+0000","last_became_active":"2024-01-19T04:16:50.562528+0000","last_became_peered":"2024-01-19T04:16:50.562528+0000","last_unstale":"2024-01-19T04:17:04.694633+0000","last_undegraded":"2024-01-19T04:17:04.694633+0000","last_fullsized":"2024-01-19T04:17:04.694633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:03.641474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709508+0000","last_change":"2024-01-19T04:17:04.707403+0000","last_active":"2024-01-19T04:17:05.709508+0000","last_peered":"2024-01-19T04:17:05.709508+0000","last_clean":"2024-01-19T04:17:05.709508+0000","last_became_active":"2024-01-19T04:17:04.707152+0000","last_became_peered":"2024-01-19T04:17:04.707152+0000","last_unstale":"2024-01-19T04:17:05.709508+0000","last_undegraded":"2024-01-19T04:17:05.709508+0000","last_fullsized":"2024-01-19T04:17:05.709508+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:36:26.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.703400+0000","last_change":"2024-01-19T04:17:03.704020+0000","last_active":"2024-01-19T04:17:04.703400+0000","last_peered":"2024-01-19T04:17:04.703400+0000","last_clean":"2024-01-19T04:17:04.703400+0000","last_became_active":"2024-01-19T04:17:03.703750+0000","last_became_peered":"2024-01-19T04:17:03.703750+0000","last_unstale":"2024-01-19T04:17:04.703400+0000","last_undegraded":"2024-01-19T04:17:04.703400+0000","last_fullsized":"2024-01-19T04:17:04.703400+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:47.046120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694990+0000","last_change":"2024-01-19T04:16:51.582274+0000","last_active":"2024-01-19T04:17:04.694990+0000","last_peered":"2024-01-19T04:17:04.694990+0000","last_clean":"2024-01-19T04:17:04.694990+0000","last_became_active":"2024-01-19T04:16:51.581164+0000","last_became_peered":"2024-01-19T04:16:51.581164+0000","last_unstale":"2024-01-19T04:17:04.694990+0000","last_undegraded":"2024-01-19T04:17:04.694990+0000","last_fullsized":"2024-01-19T04:17:04.694990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:47.861123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698921+0000","last_change":"2024-01-19T04:16:50.566550+0000","last_active":"2024-01-19T04:17:04.698921+0000","last_peered":"2024-01-19T04:17:04.698921+0000","last_clean":"2024-01-19T04:17:04.698921+0000","last_became_active":"2024-01-19T04:16:50.566278+0000","last_became_peered":"2024-01-19T04:16:50.566278+0000","last_unstale":"2024-01-19T04:17:04.698921+0000","last_undegraded":"2024-01-19T04:17:04.698921+0000","last_fullsized":"2024-01-19T04:17:04.698921+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058226+0000","last_change":"2024-01-19T04:17:04.707638+0000","last_active":"2024-01-19T04:17:06.058226+0000","last_peered":"2024-01-19T04:17:06.058226+0000","last_clean":"2024-01-19T04:17:06.058226+0000","last_became_active":"2024-01-19T04:17:04.707389+0000","last_became_peered":"2024-01-19T04:17:04.707389+0000","last_unstale":"2024-01-19T04:17:06.058226+0000","last_undegraded":"2024-01-19T04:17:06.058226+0000","last_fullsized":"2024-01-19T04:17:06.058226+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:04:22.069072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.725642+0000","last_change":"2024-01-19T04:17:03.713411+0000","last_active":"2024-01-19T04:17:04.725642+0000","last_peered":"2024-01-19T04:17:04.725642+0000","last_clean":"2024-01-19T04:17:04.725642+0000","last_became_active":"2024-01-19T04:17:03.712945+0000","last_became_peered":"2024-01-19T04:17:03.712945+0000","last_unstale":"2024-01-19T04:17:04.725642+0000","last_undegraded":"2024-01-19T04:17:04.725642+0000","last_fullsized":"2024-01-19T04:17:04.725642+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:18.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.710862+0000","last_change":"2024-01-19T04:16:51.579590+0000","last_active":"2024-01-19T04:17:04.710862+0000","last_peered":"2024-01-19T04:17:04.710862+0000","last_clean":"2024-01-19T04:17:04.710862+0000","last_became_active":"2024-01-19T04:16:51.579242+0000","last_became_peered":"2024-01-19T04:16:51.579242+0000","last_unstale":"2024-01-19T04:17:04.710862+0000","last_undegraded":"2024-01-19T04:17:04.710862+0000","last_fullsized":"2024-01-19T04:17:04.710862+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:09.890731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702134+0000","last_change":"2024-01-19T04:16:50.568633+0000","last_active":"2024-01-19T04:17:04.702134+0000","last_peered":"2024-01-19T04:17:04.702134+0000","last_clean":"2024-01-19T04:17:04.702134+0000","last_became_active":"2024-01-19T04:16:50.568334+0000","last_became_peered":"2024-01-19T04:16:50.568334+0000","last_unstale":"2024-01-19T04:17:04.702134+0000","last_undegraded":"2024-01-19T04:17:04.702134+0000","last_fullsized":"2024-01-19T04:17:04.702134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.711595+0000","last_change":"2024-01-19T04:17:04.708655+0000","last_active":"2024-01-19T04:17:05.711595+0000","last_peered":"2024-01-19T04:17:05.711595+0000","last_clean":"2024-01-19T04:17:05.711595+0000","last_became_active":"2024-01-19T04:17:04.708364+0000","last_became_peered":"2024-01-19T04:17:04.708364+0000","last_unstale":"2024-01-19T04:17:05.711595+0000","last_undegraded":"2024-01-19T04:17:05.711595+0000","last_fullsized":"2024-01-19T04:17:05.711595+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:18.046583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062282+0000","last_change":"2024-01-19T04:17:03.717810+0000","last_active":"2024-01-19T04:17:05.062282+0000","last_peered":"2024-01-19T04:17:05.062282+0000","last_clean":"2024-01-19T04:17:05.062282+0000","last_became_active":"2024-01-19T04:17:03.717529+0000","last_became_peered":"2024-01-19T04:17:03.717529+0000","last_unstale":"2024-01-19T04:17:05.062282+0000","last_undegraded":"2024-01-19T04:17:05.062282+0000","last_fullsized":"2024-01-19T04:17:05.062282+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:57.511703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695501+0000","last_change":"2024-01-19T04:16:51.585817+0000","last_active":"2024-01-19T04:17:04.695501+0000","last_peered":"2024-01-19T04:17:04.695501+0000","last_clean":"2024-01-19T04:17:04.695501+0000","last_became_active":"2024-01-19T04:16:51.585142+0000","last_became_peered":"2024-01-19T04:16:51.585142+0000","last_unstale":"2024-01-19T04:17:04.695501+0000","last_undegraded":"2024-01-19T04:17:04.695501+0000","last_fullsized":"2024-01-19T04:17:04.695501+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:42:41.744656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694715+0000","last_change":"2024-01-19T04:16:50.569683+0000","last_active":"2024-01-19T04:17:04.694715+0000","last_peered":"2024-01-19T04:17:04.694715+0000","last_clean":"2024-01-19T04:17:04.694715+0000","last_became_active":"2024-01-19T04:16:50.567925+0000","last_became_peered":"2024-01-19T04:16:50.567925+0000","last_unstale":"2024-01-19T04:17:04.694715+0000","last_undegraded":"2024-01-19T04:17:04.694715+0000","last_fullsized":"2024-01-19T04:17:04.694715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:40:25.378012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.105082+0000","last_change":"2024-01-19T04:17:04.714330+0000","last_active":"2024-01-19T04:17:06.105082+0000","last_peered":"2024-01-19T04:17:06.105082+0000","last_clean":"2024-01-19T04:17:06.105082+0000","last_became_active":"2024-01-19T04:17:04.712504+0000","last_became_peered":"2024-01-19T04:17:04.712504+0000","last_unstale":"2024-01-19T04:17:06.105082+0000","last_undegraded":"2024-01-19T04:17:06.105082+0000","last_fullsized":"2024-01-19T04:17:06.105082+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:32.413236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.728964+0000","last_change":"2024-01-19T04:17:03.707765+0000","last_active":"2024-01-19T04:17:04.728964+0000","last_peered":"2024-01-19T04:17:04.728964+0000","last_clean":"2024-01-19T04:17:04.728964+0000","last_became_active":"2024-01-19T04:17:03.707463+0000","last_became_peered":"2024-01-19T04:17:03.707463+0000","last_unstale":"2024-01-19T04:17:04.728964+0000","last_undegraded":"2024-01-19T04:17:04.728964+0000","last_fullsized":"2024-01-19T04:17:04.728964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:24:30.923295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695491+0000","last_change":"2024-01-19T04:16:51.587058+0000","last_active":"2024-01-19T04:17:04.695491+0000","last_peered":"2024-01-19T04:17:04.695491+0000","last_clean":"2024-01-19T04:17:04.695491+0000","last_became_active":"2024-01-19T04:16:51.577162+0000","last_became_peered":"2024-01-19T04:16:51.577162+0000","last_unstale":"2024-01-19T04:17:04.695491+0000","last_undegraded":"2024-01-19T04:17:04.695491+0000","last_fullsized":"2024-01-19T04:17:04.695491+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:59.277518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.706023+0000","last_change":"2024-01-19T04:16:50.568525+0000","last_active":"2024-01-19T04:17:04.706023+0000","last_peered":"2024-01-19T04:17:04.706023+0000","last_clean":"2024-01-19T04:17:04.706023+0000","last_became_active":"2024-01-19T04:16:50.568256+0000","last_became_peered":"2024-01-19T04:16:50.568256+0000","last_unstale":"2024-01-19T04:17:04.706023+0000","last_undegraded":"2024-01-19T04:17:04.706023+0000","last_fullsized":"2024-01-19T04:17:04.706023+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:44.370764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729815+0000","last_change":"2024-01-19T04:17:04.719632+0000","last_active":"2024-01-19T04:17:06.729815+0000","last_peered":"2024-01-19T04:17:06.729815+0000","last_clean":"2024-01-19T04:17:06.729815+0000","last_became_active":"2024-01-19T04:17:04.719350+0000","last_became_peered":"2024-01-19T04:17:04.719350+0000","last_unstale":"2024-01-19T04:17:06.729815+0000","last_undegraded":"2024-01-19T04:17:06.729815+0000","last_fullsized":"2024-01-19T04:17:06.729815+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:11.822538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"56'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.731268+0000","last_change":"2024-01-19T04:17:03.705858+0000","last_active":"2024-01-19T04:17:04.731268+0000","last_peered":"2024-01-19T04:17:04.731268+0000","last_clean":"2024-01-19T04:17:04.731268+0000","last_became_active":"2024-01-19T04:17:03.705336+0000","last_became_peered":"2024-01-19T04:17:03.705336+0000","last_unstale":"2024-01-19T04:17:04.731268+0000","last_undegraded":"2024-01-19T04:17:04.731268+0000","last_fullsized":"2024-01-19T04:17:04.731268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:42.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705926+0000","last_change":"2024-01-19T04:16:51.583117+0000","last_active":"2024-01-19T04:17:04.705926+0000","last_peered":"2024-01-19T04:17:04.705926+0000","last_clean":"2024-01-19T04:17:04.705926+0000","last_became_active":"2024-01-19T04:16:51.582850+0000","last_became_peered":"2024-01-19T04:16:51.582850+0000","last_unstale":"2024-01-19T04:17:04.705926+0000","last_undegraded":"2024-01-19T04:17:04.705926+0000","last_fullsized":"2024-01-19T04:17:04.705926+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:55:19.273356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698214+0000","last_change":"2024-01-19T04:16:50.568671+0000","last_active":"2024-01-19T04:17:04.698214+0000","last_peered":"2024-01-19T04:17:04.698214+0000","last_clean":"2024-01-19T04:17:04.698214+0000","last_became_active":"2024-01-19T04:16:50.568385+0000","last_became_peered":"2024-01-19T04:16:50.568385+0000","last_unstale":"2024-01-19T04:17:04.698214+0000","last_undegraded":"2024-01-19T04:17:04.698214+0000","last_fullsized":"2024-01-19T04:17:04.698214+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:51.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058974+0000","last_change":"2024-01-19T04:17:04.711029+0000","last_active":"2024-01-19T04:17:06.058974+0000","last_peered":"2024-01-19T04:17:06.058974+0000","last_clean":"2024-01-19T04:17:06.058974+0000","last_became_active":"2024-01-19T04:17:04.709892+0000","last_became_peered":"2024-01-19T04:17:04.709892+0000","last_unstale":"2024-01-19T04:17:06.058974+0000","last_undegraded":"2024-01-19T04:17:06.058974+0000","last_fullsized":"2024-01-19T04:17:06.058974+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:44:18.964836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062935+0000","last_change":"2024-01-19T04:17:03.711352+0000","last_active":"2024-01-19T04:17:05.062935+0000","last_peered":"2024-01-19T04:17:05.062935+0000","last_clean":"2024-01-19T04:17:05.062935+0000","last_became_active":"2024-01-19T04:17:03.711063+0000","last_became_peered":"2024-01-19T04:17:03.711063+0000","last_unstale":"2024-01-19T04:17:05.062935+0000","last_undegraded":"2024-01-19T04:17:05.062935+0000","last_fullsized":"2024-01-19T04:17:05.062935+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:38.820788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702193+0000","last_change":"2024-01-19T04:16:51.580811+0000","last_active":"2024-01-19T04:17:04.702193+0000","last_peered":"2024-01-19T04:17:04.702193+0000","last_clean":"2024-01-19T04:17:04.702193+0000","last_became_active":"2024-01-19T04:16:51.579990+0000","last_became_peered":"2024-01-19T04:16:51.579990+0000","last_unstale":"2024-01-19T04:17:04.702193+0000","last_undegraded":"2024-01-19T04:17:04.702193+0000","last_fullsized":"2024-01-19T04:17:04.702193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:43:24.773146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702789+0000","last_change":"2024-01-19T04:16:50.569777+0000","last_active":"2024-01-19T04:17:04.702789+0000","last_peered":"2024-01-19T04:17:04.702789+0000","last_clean":"2024-01-19T04:17:04.702789+0000","last_became_active":"2024-01-19T04:16:50.569507+0000","last_became_peered":"2024-01-19T04:16:50.569507+0000","last_unstale":"2024-01-19T04:17:04.702789+0000","last_undegraded":"2024-01-19T04:17:04.702789+0000","last_fullsized":"2024-01-19T04:17:04.702789+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:47.763618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.254292+0000","last_change":"2024-01-19T04:17:04.732838+0000","last_active":"2024-01-19T04:17:07.254292+0000","last_peered":"2024-01-19T04:17:07.254292+0000","last_clean":"2024-01-19T04:17:07.254292+0000","last_became_active":"2024-01-19T04:17:04.732579+0000","last_became_peered":"2024-01-19T04:17:04.732579+0000","last_unstale":"2024-01-19T04:17:07.254292+0000","last_undegraded":"2024-01-19T04:17:07.254292+0000","last_fullsized":"2024-01-19T04:17:07.254292+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:06:29.021850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062404+0000","last_change":"2024-01-19T04:17:03.710016+0000","last_active":"2024-01-19T04:17:05.062404+0000","last_peered":"2024-01-19T04:17:05.062404+0000","last_clean":"2024-01-19T04:17:05.062404+0000","last_became_active":"2024-01-19T04:17:03.709659+0000","last_became_peered":"2024-01-19T04:17:03.709659+0000","last_unstale":"2024-01-19T04:17:05.062404+0000","last_undegraded":"2024-01-19T04:17:05.062404+0000","last_fullsized":"2024-01-19T04:17:05.062404+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:35.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702600+0000","last_change":"2024-01-19T04:16:51.582425+0000","last_active":"2024-01-19T04:17:04.702600+0000","last_peered":"2024-01-19T04:17:04.702600+0000","last_clean":"2024-01-19T04:17:04.702600+0000","last_became_active":"2024-01-19T04:16:51.582136+0000","last_became_peered":"2024-01-19T04:16:51.582136+0000","last_unstale":"2024-01-19T04:17:04.702600+0000","last_undegraded":"2024-01-19T04:17:04.702600+0000","last_fullsized":"2024-01-19T04:17:04.702600+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'8","reported_seq":24,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695154+0000","last_change":"2024-01-19T04:16:50.563850+0000","last_active":"2024-01-19T04:17:04.695154+0000","last_peered":"2024-01-19T04:17:04.695154+0000","last_clean":"2024-01-19T04:17:04.695154+0000","last_became_active":"2024-01-19T04:16:50.563492+0000","last_became_peered":"2024-01-19T04:16:50.563492+0000","last_unstale":"2024-01-19T04:17:04.695154+0000","last_undegraded":"2024-01-19T04:17:04.695154+0000","last_fullsized":"2024-01-19T04:17:04.695154+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:54:50.446354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.709559+0000","last_change":"2024-01-19T04:17:04.719917+0000","last_active":"2024-01-19T04:17:05.709559+0000","last_peered":"2024-01-19T04:17:05.709559+0000","last_clean":"2024-01-19T04:17:05.709559+0000","last_became_active":"2024-01-19T04:17:04.719594+0000","last_became_peered":"2024-01-19T04:17:04.719594+0000","last_unstale":"2024-01-19T04:17:05.709559+0000","last_undegraded":"2024-01-19T04:17:05.709559+0000","last_fullsized":"2024-01-19T04:17:05.709559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:04:22.069072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062587+0000","last_change":"2024-01-19T04:17:03.713104+0000","last_active":"2024-01-19T04:17:05.062587+0000","last_peered":"2024-01-19T04:17:05.062587+0000","last_clean":"2024-01-19T04:17:05.062587+0000","last_became_active":"2024-01-19T04:17:03.712774+0000","last_became_peered":"2024-01-19T04:17:03.712774+0000","last_unstale":"2024-01-19T04:17:05.062587+0000","last_undegraded":"2024-01-19T04:17:05.062587+0000","last_fullsized":"2024-01-19T04:17:05.062587+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702475+0000","last_change":"2024-01-19T04:16:51.579099+0000","last_active":"2024-01-19T04:17:04.702475+0000","last_peered":"2024-01-19T04:17:04.702475+0000","last_clean":"2024-01-19T04:17:04.702475+0000","last_became_active":"2024-01-19T04:16:51.578809+0000","last_became_peered":"2024-01-19T04:16:51.578809+0000","last_unstale":"2024-01-19T04:17:04.702475+0000","last_undegraded":"2024-01-19T04:17:04.702475+0000","last_fullsized":"2024-01-19T04:17:04.702475+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:59:07.532980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695098+0000","last_change":"2024-01-19T04:16:50.565530+0000","last_active":"2024-01-19T04:17:04.695098+0000","last_peered":"2024-01-19T04:17:04.695098+0000","last_clean":"2024-01-19T04:17:04.695098+0000","last_became_active":"2024-01-19T04:16:50.565191+0000","last_became_peered":"2024-01-19T04:16:50.565191+0000","last_unstale":"2024-01-19T04:17:04.695098+0000","last_undegraded":"2024-01-19T04:17:04.695098+0000","last_fullsized":"2024-01-19T04:17:04.695098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:14.286352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729425+0000","last_change":"2024-01-19T04:17:04.711115+0000","last_active":"2024-01-19T04:17:06.729425+0000","last_peered":"2024-01-19T04:17:06.729425+0000","last_clean":"2024-01-19T04:17:06.729425+0000","last_became_active":"2024-01-19T04:17:04.710807+0000","last_became_peered":"2024-01-19T04:17:04.710807+0000","last_unstale":"2024-01-19T04:17:06.729425+0000","last_undegraded":"2024-01-19T04:17:06.729425+0000","last_fullsized":"2024-01-19T04:17:06.729425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:41:01.910770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062779+0000","last_change":"2024-01-19T04:17:03.711561+0000","last_active":"2024-01-19T04:17:05.062779+0000","last_peered":"2024-01-19T04:17:05.062779+0000","last_clean":"2024-01-19T04:17:05.062779+0000","last_became_active":"2024-01-19T04:17:03.711261+0000","last_became_peered":"2024-01-19T04:17:03.711261+0000","last_unstale":"2024-01-19T04:17:05.062779+0000","last_undegraded":"2024-01-19T04:17:05.062779+0000","last_fullsized":"2024-01-19T04:17:05.062779+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:19.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699477+0000","last_change":"2024-01-19T04:16:51.587155+0000","last_active":"2024-01-19T04:17:04.699477+0000","last_peered":"2024-01-19T04:17:04.699477+0000","last_clean":"2024-01-19T04:17:04.699477+0000","last_became_active":"2024-01-19T04:16:51.584989+0000","last_became_peered":"2024-01-19T04:16:51.584989+0000","last_unstale":"2024-01-19T04:17:04.699477+0000","last_undegraded":"2024-01-19T04:17:04.699477+0000","last_fullsized":"2024-01-19T04:17:04.699477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:52:07.222484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698442+0000","last_change":"2024-01-19T04:16:50.566824+0000","last_active":"2024-01-19T04:17:04.698442+0000","last_peered":"2024-01-19T04:17:04.698442+0000","last_clean":"2024-01-19T04:17:04.698442+0000","last_became_active":"2024-01-19T04:16:50.566530+0000","last_became_peered":"2024-01-19T04:16:50.566530+0000","last_unstale":"2024-01-19T04:17:04.698442+0000","last_undegraded":"2024-01-19T04:17:04.698442+0000","last_fullsized":"2024-01-19T04:17:04.698442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.253540+0000","last_change":"2024-01-19T04:17:04.718338+0000","last_active":"2024-01-19T04:17:07.253540+0000","last_peered":"2024-01-19T04:17:07.253540+0000","last_clean":"2024-01-19T04:17:07.253540+0000","last_became_active":"2024-01-19T04:17:04.714128+0000","last_became_peered":"2024-01-19T04:17:04.714128+0000","last_unstale":"2024-01-19T04:17:07.253540+0000","last_undegraded":"2024-01-19T04:17:07.253540+0000","last_fullsized":"2024-01-19T04:17:07.253540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:26:24.913274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.732524+0000","last_change":"2024-01-19T04:17:03.706653+0000","last_active":"2024-01-19T04:17:04.732524+0000","last_peered":"2024-01-19T04:17:04.732524+0000","last_clean":"2024-01-19T04:17:04.732524+0000","last_became_active":"2024-01-19T04:17:03.706259+0000","last_became_peered":"2024-01-19T04:17:03.706259+0000","last_unstale":"2024-01-19T04:17:04.732524+0000","last_undegraded":"2024-01-19T04:17:04.732524+0000","last_fullsized":"2024-01-19T04:17:04.732524+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:44.030611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694263+0000","last_change":"2024-01-19T04:16:51.576072+0000","last_active":"2024-01-19T04:17:04.694263+0000","last_peered":"2024-01-19T04:17:04.694263+0000","last_clean":"2024-01-19T04:17:04.694263+0000","last_became_active":"2024-01-19T04:16:51.575754+0000","last_became_peered":"2024-01-19T04:16:51.575754+0000","last_unstale":"2024-01-19T04:17:04.694263+0000","last_undegraded":"2024-01-19T04:17:04.694263+0000","last_fullsized":"2024-01-19T04:17:04.694263+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:58.682659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702175+0000","last_change":"2024-01-19T04:16:50.571102+0000","last_active":"2024-01-19T04:17:04.702175+0000","last_peered":"2024-01-19T04:17:04.702175+0000","last_clean":"2024-01-19T04:17:04.702175+0000","last_became_active":"2024-01-19T04:16:50.570597+0000","last_became_peered":"2024-01-19T04:16:50.570597+0000","last_unstale":"2024-01-19T04:17:04.702175+0000","last_undegraded":"2024-01-19T04:17:04.702175+0000","last_fullsized":"2024-01-19T04:17:04.702175+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:26:57.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058594+0000","last_change":"2024-01-19T04:17:04.710314+0000","last_active":"2024-01-19T04:17:06.058594+0000","last_peered":"2024-01-19T04:17:06.058594+0000","last_clean":"2024-01-19T04:17:06.058594+0000","last_became_active":"2024-01-19T04:17:04.709915+0000","last_became_peered":"2024-01-19T04:17:04.709915+0000","last_unstale":"2024-01-19T04:17:06.058594+0000","last_undegraded":"2024-01-19T04:17:06.058594+0000","last_fullsized":"2024-01-19T04:17:06.058594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:26:24.913274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062294+0000","last_change":"2024-01-19T04:17:03.709688+0000","last_active":"2024-01-19T04:17:05.062294+0000","last_peered":"2024-01-19T04:17:05.062294+0000","last_clean":"2024-01-19T04:17:05.062294+0000","last_became_active":"2024-01-19T04:17:03.709392+0000","last_became_peered":"2024-01-19T04:17:03.709392+0000","last_unstale":"2024-01-19T04:17:05.062294+0000","last_undegraded":"2024-01-19T04:17:05.062294+0000","last_fullsized":"2024-01-19T04:17:05.062294+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:44.030611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700568+0000","last_change":"2024-01-19T04:16:51.581476+0000","last_active":"2024-01-19T04:17:04.700568+0000","last_peered":"2024-01-19T04:17:04.700568+0000","last_clean":"2024-01-19T04:17:04.700568+0000","last_became_active":"2024-01-19T04:16:51.580937+0000","last_became_peered":"2024-01-19T04:16:51.580937+0000","last_unstale":"2024-01-19T04:17:04.700568+0000","last_undegraded":"2024-01-19T04:17:04.700568+0000","last_fullsized":"2024-01-19T04:17:04.700568+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":24,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699635+0000","last_change":"2024-01-19T04:16:50.572829+0000","last_active":"2024-01-19T04:17:04.699635+0000","last_peered":"2024-01-19T04:17:04.699635+0000","last_clean":"2024-01-19T04:17:04.699635+0000","last_became_active":"2024-01-19T04:16:50.572538+0000","last_became_peered":"2024-01-19T04:16:50.572538+0000","last_unstale":"2024-01-19T04:17:04.699635+0000","last_undegraded":"2024-01-19T04:17:04.699635+0000","last_fullsized":"2024-01-19T04:17:04.699635+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.743535+0000","last_change":"2024-01-19T04:17:04.710112+0000","last_active":"2024-01-19T04:17:06.743535+0000","last_peered":"2024-01-19T04:17:06.743535+0000","last_clean":"2024-01-19T04:17:06.743535+0000","last_became_active":"2024-01-19T04:17:04.709830+0000","last_became_peered":"2024-01-19T04:17:04.709830+0000","last_unstale":"2024-01-19T04:17:06.743535+0000","last_undegraded":"2024-01-19T04:17:06.743535+0000","last_fullsized":"2024-01-19T04:17:06.743535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:04:35.990106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062390+0000","last_change":"2024-01-19T04:17:03.710856+0000","last_active":"2024-01-19T04:17:05.062390+0000","last_peered":"2024-01-19T04:17:05.062390+0000","last_clean":"2024-01-19T04:17:05.062390+0000","last_became_active":"2024-01-19T04:17:03.709025+0000","last_became_peered":"2024-01-19T04:17:03.709025+0000","last_unstale":"2024-01-19T04:17:05.062390+0000","last_undegraded":"2024-01-19T04:17:05.062390+0000","last_fullsized":"2024-01-19T04:17:05.062390+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:59.101927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702220+0000","last_change":"2024-01-19T04:16:51.588191+0000","last_active":"2024-01-19T04:17:04.702220+0000","last_peered":"2024-01-19T04:17:04.702220+0000","last_clean":"2024-01-19T04:17:04.702220+0000","last_became_active":"2024-01-19T04:16:51.587927+0000","last_became_peered":"2024-01-19T04:16:51.587927+0000","last_unstale":"2024-01-19T04:17:04.702220+0000","last_undegraded":"2024-01-19T04:17:04.702220+0000","last_fullsized":"2024-01-19T04:17:04.702220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698421+0000","last_change":"2024-01-19T04:16:50.569273+0000","last_active":"2024-01-19T04:17:04.698421+0000","last_peered":"2024-01-19T04:17:04.698421+0000","last_clean":"2024-01-19T04:17:04.698421+0000","last_became_active":"2024-01-19T04:16:50.569009+0000","last_became_peered":"2024-01-19T04:16:50.569009+0000","last_unstale":"2024-01-19T04:17:04.698421+0000","last_undegraded":"2024-01-19T04:17:04.698421+0000","last_fullsized":"2024-01-19T04:17:04.698421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:59:10.848564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729984+0000","last_change":"2024-01-19T04:17:04.709224+0000","last_active":"2024-01-19T04:17:06.729984+0000","last_peered":"2024-01-19T04:17:06.729984+0000","last_clean":"2024-01-19T04:17:06.729984+0000","last_became_active":"2024-01-19T04:17:04.708928+0000","last_became_peered":"2024-01-19T04:17:04.708928+0000","last_unstale":"2024-01-19T04:17:06.729984+0000","last_undegraded":"2024-01-19T04:17:06.729984+0000","last_fullsized":"2024-01-19T04:17:06.729984+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:43.874952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062603+0000","last_change":"2024-01-19T04:17:03.711904+0000","last_active":"2024-01-19T04:17:05.062603+0000","last_peered":"2024-01-19T04:17:05.062603+0000","last_clean":"2024-01-19T04:17:05.062603+0000","last_became_active":"2024-01-19T04:17:03.711592+0000","last_became_peered":"2024-01-19T04:17:03.711592+0000","last_unstale":"2024-01-19T04:17:05.062603+0000","last_undegraded":"2024-01-19T04:17:05.062603+0000","last_fullsized":"2024-01-19T04:17:05.062603+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:22.296752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704574+0000","last_change":"2024-01-19T04:16:51.578342+0000","last_active":"2024-01-19T04:17:04.704574+0000","last_peered":"2024-01-19T04:17:04.704574+0000","last_clean":"2024-01-19T04:17:04.704574+0000","last_became_active":"2024-01-19T04:16:51.575581+0000","last_became_peered":"2024-01-19T04:16:51.575581+0000","last_unstale":"2024-01-19T04:17:04.704574+0000","last_undegraded":"2024-01-19T04:17:04.704574+0000","last_fullsized":"2024-01-19T04:17:04.704574+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:27.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702290+0000","last_change":"2024-01-19T04:16:50.572020+0000","last_active":"2024-01-19T04:17:04.702290+0000","last_peered":"2024-01-19T04:17:04.702290+0000","last_clean":"2024-01-19T04:17:04.702290+0000","last_became_active":"2024-01-19T04:16:50.571617+0000","last_became_peered":"2024-01-19T04:16:50.571617+0000","last_unstale":"2024-01-19T04:17:04.702290+0000","last_undegraded":"2024-01-19T04:17:04.702290+0000","last_fullsized":"2024-01-19T04:17:04.702290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:30.889671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.712393+0000","last_change":"2024-01-19T04:17:04.715751+0000","last_active":"2024-01-19T04:17:05.712393+0000","last_peered":"2024-01-19T04:17:05.712393+0000","last_clean":"2024-01-19T04:17:05.712393+0000","last_became_active":"2024-01-19T04:17:04.715489+0000","last_became_peered":"2024-01-19T04:17:04.715489+0000","last_unstale":"2024-01-19T04:17:05.712393+0000","last_undegraded":"2024-01-19T04:17:05.712393+0000","last_fullsized":"2024-01-19T04:17:05.712393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:09.831378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062428+0000","last_change":"2024-01-19T04:17:03.715436+0000","last_active":"2024-01-19T04:17:05.062428+0000","last_peered":"2024-01-19T04:17:05.062428+0000","last_clean":"2024-01-19T04:17:05.062428+0000","last_became_active":"2024-01-19T04:17:03.715157+0000","last_became_peered":"2024-01-19T04:17:03.715157+0000","last_unstale":"2024-01-19T04:17:05.062428+0000","last_undegraded":"2024-01-19T04:17:05.062428+0000","last_fullsized":"2024-01-19T04:17:05.062428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:49.326125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.696979+0000","last_change":"2024-01-19T04:16:51.575079+0000","last_active":"2024-01-19T04:17:04.696979+0000","last_peered":"2024-01-19T04:17:04.696979+0000","last_clean":"2024-01-19T04:17:04.696979+0000","last_became_active":"2024-01-19T04:16:51.574248+0000","last_became_peered":"2024-01-19T04:16:51.574248+0000","last_unstale":"2024-01-19T04:17:04.696979+0000","last_undegraded":"2024-01-19T04:17:04.696979+0000","last_fullsized":"2024-01-19T04:17:04.696979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:04:17.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705545+0000","last_change":"2024-01-19T04:16:50.571109+0000","last_active":"2024-01-19T04:17:04.705545+0000","last_peered":"2024-01-19T04:17:04.705545+0000","last_clean":"2024-01-19T04:17:04.705545+0000","last_became_active":"2024-01-19T04:16:50.570839+0000","last_became_peered":"2024-01-19T04:16:50.570839+0000","last_unstale":"2024-01-19T04:17:04.705545+0000","last_undegraded":"2024-01-19T04:17:04.705545+0000","last_fullsized":"2024-01-19T04:17:04.705545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:18:22.030862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.254547+0000","last_change":"2024-01-19T04:17:04.716334+0000","last_active":"2024-01-19T04:17:07.254547+0000","last_peered":"2024-01-19T04:17:07.254547+0000","last_clean":"2024-01-19T04:17:07.254547+0000","last_became_active":"2024-01-19T04:17:04.715736+0000","last_became_peered":"2024-01-19T04:17:04.715736+0000","last_unstale":"2024-01-19T04:17:07.254547+0000","last_undegraded":"2024-01-19T04:17:07.254547+0000","last_fullsized":"2024-01-19T04:17:07.254547+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:20:46.867099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062897+0000","last_change":"2024-01-19T04:17:03.717168+0000","last_active":"2024-01-19T04:17:05.062897+0000","last_peered":"2024-01-19T04:17:05.062897+0000","last_clean":"2024-01-19T04:17:05.062897+0000","last_became_active":"2024-01-19T04:17:03.716597+0000","last_became_peered":"2024-01-19T04:17:03.716597+0000","last_unstale":"2024-01-19T04:17:05.062897+0000","last_undegraded":"2024-01-19T04:17:05.062897+0000","last_fullsized":"2024-01-19T04:17:05.062897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:53:40.365611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702692+0000","last_change":"2024-01-19T04:16:51.582601+0000","last_active":"2024-01-19T04:17:04.702692+0000","last_peered":"2024-01-19T04:17:04.702692+0000","last_clean":"2024-01-19T04:17:04.702692+0000","last_became_active":"2024-01-19T04:16:51.582294+0000","last_became_peered":"2024-01-19T04:16:51.582294+0000","last_unstale":"2024-01-19T04:17:04.702692+0000","last_undegraded":"2024-01-19T04:17:04.702692+0000","last_fullsized":"2024-01-19T04:17:04.702692+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:40:41.545623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701448+0000","last_change":"2024-01-19T04:16:50.568331+0000","last_active":"2024-01-19T04:17:04.701448+0000","last_peered":"2024-01-19T04:17:04.701448+0000","last_clean":"2024-01-19T04:17:04.701448+0000","last_became_active":"2024-01-19T04:16:50.567695+0000","last_became_peered":"2024-01-19T04:16:50.567695+0000","last_unstale":"2024-01-19T04:17:04.701448+0000","last_undegraded":"2024-01-19T04:17:04.701448+0000","last_fullsized":"2024-01-19T04:17:04.701448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:18:36.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923571+0000","last_change":"2024-01-19T04:17:04.722284+0000","last_active":"2024-01-19T04:17:06.923571+0000","last_peered":"2024-01-19T04:17:06.923571+0000","last_clean":"2024-01-19T04:17:06.923571+0000","last_became_active":"2024-01-19T04:17:04.722004+0000","last_became_peered":"2024-01-19T04:17:04.722004+0000","last_unstale":"2024-01-19T04:17:06.923571+0000","last_undegraded":"2024-01-19T04:17:06.923571+0000","last_fullsized":"2024-01-19T04:17:06.923571+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:23:15.275480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062572+0000","last_change":"2024-01-19T04:17:03.712871+0000","last_active":"2024-01-19T04:17:05.062572+0000","last_peered":"2024-01-19T04:17:05.062572+0000","last_clean":"2024-01-19T04:17:05.062572+0000","last_became_active":"2024-01-19T04:17:03.710684+0000","last_became_peered":"2024-01-19T04:17:03.710684+0000","last_unstale":"2024-01-19T04:17:05.062572+0000","last_undegraded":"2024-01-19T04:17:05.062572+0000","last_fullsized":"2024-01-19T04:17:05.062572+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:17.040369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702522+0000","last_change":"2024-01-19T04:16:51.579139+0000","last_active":"2024-01-19T04:17:04.702522+0000","last_peered":"2024-01-19T04:17:04.702522+0000","last_clean":"2024-01-19T04:17:04.702522+0000","last_became_active":"2024-01-19T04:16:51.578820+0000","last_became_peered":"2024-01-19T04:16:51.578820+0000","last_unstale":"2024-01-19T04:17:04.702522+0000","last_undegraded":"2024-01-19T04:17:04.702522+0000","last_fullsized":"2024-01-19T04:17:04.702522+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:49:26.687123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695278+0000","last_change":"2024-01-19T04:16:50.563572+0000","last_active":"2024-01-19T04:17:04.695278+0000","last_peered":"2024-01-19T04:17:04.695278+0000","last_clean":"2024-01-19T04:17:04.695278+0000","last_became_active":"2024-01-19T04:16:50.561160+0000","last_became_peered":"2024-01-19T04:16:50.561160+0000","last_unstale":"2024-01-19T04:17:04.695278+0000","last_undegraded":"2024-01-19T04:17:04.695278+0000","last_fullsized":"2024-01-19T04:17:04.695278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:40:18.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923752+0000","last_change":"2024-01-19T04:17:04.722269+0000","last_active":"2024-01-19T04:17:06.923752+0000","last_peered":"2024-01-19T04:17:06.923752+0000","last_clean":"2024-01-19T04:17:06.923752+0000","last_became_active":"2024-01-19T04:17:04.722003+0000","last_became_peered":"2024-01-19T04:17:04.722003+0000","last_unstale":"2024-01-19T04:17:06.923752+0000","last_undegraded":"2024-01-19T04:17:06.923752+0000","last_fullsized":"2024-01-19T04:17:06.923752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:53.689915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700260+0000","last_change":"2024-01-19T04:17:03.703625+0000","last_active":"2024-01-19T04:17:04.700260+0000","last_peered":"2024-01-19T04:17:04.700260+0000","last_clean":"2024-01-19T04:17:04.700260+0000","last_became_active":"2024-01-19T04:17:03.702960+0000","last_became_peered":"2024-01-19T04:17:03.702960+0000","last_unstale":"2024-01-19T04:17:04.700260+0000","last_undegraded":"2024-01-19T04:17:04.700260+0000","last_fullsized":"2024-01-19T04:17:04.700260+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699038+0000","last_change":"2024-01-19T04:16:51.581877+0000","last_active":"2024-01-19T04:17:04.699038+0000","last_peered":"2024-01-19T04:17:04.699038+0000","last_clean":"2024-01-19T04:17:04.699038+0000","last_became_active":"2024-01-19T04:16:51.580713+0000","last_became_peered":"2024-01-19T04:16:51.580713+0000","last_unstale":"2024-01-19T04:17:04.699038+0000","last_undegraded":"2024-01-19T04:17:04.699038+0000","last_fullsized":"2024-01-19T04:17:04.699038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699294+0000","last_change":"2024-01-19T04:16:50.572947+0000","last_active":"2024-01-19T04:17:04.699294+0000","last_peered":"2024-01-19T04:17:04.699294+0000","last_clean":"2024-01-19T04:17:04.699294+0000","last_became_active":"2024-01-19T04:16:50.572679+0000","last_became_peered":"2024-01-19T04:16:50.572679+0000","last_unstale":"2024-01-19T04:17:04.699294+0000","last_undegraded":"2024-01-19T04:17:04.699294+0000","last_fullsized":"2024-01-19T04:17:04.699294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:25:41.006603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923756+0000","last_change":"2024-01-19T04:17:04.715568+0000","last_active":"2024-01-19T04:17:06.923756+0000","last_peered":"2024-01-19T04:17:06.923756+0000","last_clean":"2024-01-19T04:17:06.923756+0000","last_became_active":"2024-01-19T04:17:04.715214+0000","last_became_peered":"2024-01-19T04:17:04.715214+0000","last_unstale":"2024-01-19T04:17:06.923756+0000","last_undegraded":"2024-01-19T04:17:06.923756+0000","last_fullsized":"2024-01-19T04:17:06.923756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:54:15.118406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062305+0000","last_change":"2024-01-19T04:17:03.716279+0000","last_active":"2024-01-19T04:17:05.062305+0000","last_peered":"2024-01-19T04:17:05.062305+0000","last_clean":"2024-01-19T04:17:05.062305+0000","last_became_active":"2024-01-19T04:17:03.715875+0000","last_became_peered":"2024-01-19T04:17:03.715875+0000","last_unstale":"2024-01-19T04:17:05.062305+0000","last_undegraded":"2024-01-19T04:17:05.062305+0000","last_fullsized":"2024-01-19T04:17:05.062305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:09:55.411637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698786+0000","last_change":"2024-01-19T04:16:51.575958+0000","last_active":"2024-01-19T04:17:04.698786+0000","last_peered":"2024-01-19T04:17:04.698786+0000","last_clean":"2024-01-19T04:17:04.698786+0000","last_became_active":"2024-01-19T04:16:51.575635+0000","last_became_peered":"2024-01-19T04:16:51.575635+0000","last_unstale":"2024-01-19T04:17:04.698786+0000","last_undegraded":"2024-01-19T04:17:04.698786+0000","last_fullsized":"2024-01-19T04:17:04.698786+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:53.384358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701797+0000","last_change":"2024-01-19T04:16:50.568547+0000","last_active":"2024-01-19T04:17:04.701797+0000","last_peered":"2024-01-19T04:17:04.701797+0000","last_clean":"2024-01-19T04:17:04.701797+0000","last_became_active":"2024-01-19T04:16:50.568248+0000","last_became_peered":"2024-01-19T04:16:50.568248+0000","last_unstale":"2024-01-19T04:17:04.701797+0000","last_undegraded":"2024-01-19T04:17:04.701797+0000","last_fullsized":"2024-01-19T04:17:04.701797+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:45.960987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.253777+0000","last_change":"2024-01-19T04:17:04.732413+0000","last_active":"2024-01-19T04:17:07.253777+0000","last_peered":"2024-01-19T04:17:07.253777+0000","last_clean":"2024-01-19T04:17:07.253777+0000","last_became_active":"2024-01-19T04:17:04.732057+0000","last_became_peered":"2024-01-19T04:17:04.732057+0000","last_unstale":"2024-01-19T04:17:07.253777+0000","last_undegraded":"2024-01-19T04:17:07.253777+0000","last_fullsized":"2024-01-19T04:17:07.253777+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:54.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705408+0000","last_change":"2024-01-19T04:17:03.711094+0000","last_active":"2024-01-19T04:17:04.705408+0000","last_peered":"2024-01-19T04:17:04.705408+0000","last_clean":"2024-01-19T04:17:04.705408+0000","last_became_active":"2024-01-19T04:17:03.710806+0000","last_became_peered":"2024-01-19T04:17:03.710806+0000","last_unstale":"2024-01-19T04:17:04.705408+0000","last_undegraded":"2024-01-19T04:17:04.705408+0000","last_fullsized":"2024-01-19T04:17:04.705408+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:23:22.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704574+0000","last_change":"2024-01-19T04:16:51.562371+0000","last_active":"2024-01-19T04:17:04.704574+0000","last_peered":"2024-01-19T04:17:04.704574+0000","last_clean":"2024-01-19T04:17:04.704574+0000","last_became_active":"2024-01-19T04:16:51.562057+0000","last_became_peered":"2024-01-19T04:16:51.562057+0000","last_unstale":"2024-01-19T04:17:04.704574+0000","last_undegraded":"2024-01-19T04:17:04.704574+0000","last_fullsized":"2024-01-19T04:17:04.704574+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698830+0000","last_change":"2024-01-19T04:16:50.575311+0000","last_active":"2024-01-19T04:17:04.698830+0000","last_peered":"2024-01-19T04:17:04.698830+0000","last_clean":"2024-01-19T04:17:04.698830+0000","last_became_active":"2024-01-19T04:16:50.574897+0000","last_became_peered":"2024-01-19T04:16:50.574897+0000","last_unstale":"2024-01-19T04:17:04.698830+0000","last_undegraded":"2024-01-19T04:17:04.698830+0000","last_fullsized":"2024-01-19T04:17:04.698830+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:07.254136+0000","last_change":"2024-01-19T04:17:04.717650+0000","last_active":"2024-01-19T04:17:07.254136+0000","last_peered":"2024-01-19T04:17:07.254136+0000","last_clean":"2024-01-19T04:17:07.254136+0000","last_became_active":"2024-01-19T04:17:04.713401+0000","last_became_peered":"2024-01-19T04:17:04.713401+0000","last_unstale":"2024-01-19T04:17:07.254136+0000","last_undegraded":"2024-01-19T04:17:07.254136+0000","last_fullsized":"2024-01-19T04:17:07.254136+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:55.861672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.700911+0000","last_change":"2024-01-19T04:17:03.711629+0000","last_active":"2024-01-19T04:17:04.700911+0000","last_peered":"2024-01-19T04:17:04.700911+0000","last_clean":"2024-01-19T04:17:04.700911+0000","last_became_active":"2024-01-19T04:17:03.711338+0000","last_became_peered":"2024-01-19T04:17:03.711338+0000","last_unstale":"2024-01-19T04:17:04.700911+0000","last_undegraded":"2024-01-19T04:17:04.700911+0000","last_fullsized":"2024-01-19T04:17:04.700911+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:25.182852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704646+0000","last_change":"2024-01-19T04:16:51.585936+0000","last_active":"2024-01-19T04:17:04.704646+0000","last_peered":"2024-01-19T04:17:04.704646+0000","last_clean":"2024-01-19T04:17:04.704646+0000","last_became_active":"2024-01-19T04:16:51.585682+0000","last_became_peered":"2024-01-19T04:16:51.585682+0000","last_unstale":"2024-01-19T04:17:04.704646+0000","last_undegraded":"2024-01-19T04:17:04.704646+0000","last_fullsized":"2024-01-19T04:17:04.704646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:03.462437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702380+0000","last_change":"2024-01-19T04:16:50.567862+0000","last_active":"2024-01-19T04:17:04.702380+0000","last_peered":"2024-01-19T04:17:04.702380+0000","last_clean":"2024-01-19T04:17:04.702380+0000","last_became_active":"2024-01-19T04:16:50.567482+0000","last_became_peered":"2024-01-19T04:16:50.567482+0000","last_unstale":"2024-01-19T04:17:04.702380+0000","last_undegraded":"2024-01-19T04:17:04.702380+0000","last_fullsized":"2024-01-19T04:17:04.702380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.710915+0000","last_change":"2024-01-19T04:17:04.710123+0000","last_active":"2024-01-19T04:17:05.710915+0000","last_peered":"2024-01-19T04:17:05.710915+0000","last_clean":"2024-01-19T04:17:05.710915+0000","last_became_active":"2024-01-19T04:17:04.709533+0000","last_became_peered":"2024-01-19T04:17:04.709533+0000","last_unstale":"2024-01-19T04:17:05.710915+0000","last_undegraded":"2024-01-19T04:17:05.710915+0000","last_fullsized":"2024-01-19T04:17:05.710915+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:26:24.913274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062443+0000","last_change":"2024-01-19T04:17:03.715400+0000","last_active":"2024-01-19T04:17:05.062443+0000","last_peered":"2024-01-19T04:17:05.062443+0000","last_clean":"2024-01-19T04:17:05.062443+0000","last_became_active":"2024-01-19T04:17:03.714763+0000","last_became_peered":"2024-01-19T04:17:03.714763+0000","last_unstale":"2024-01-19T04:17:05.062443+0000","last_undegraded":"2024-01-19T04:17:05.062443+0000","last_fullsized":"2024-01-19T04:17:05.062443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:42.868739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702269+0000","last_change":"2024-01-19T04:16:51.581054+0000","last_active":"2024-01-19T04:17:04.702269+0000","last_peered":"2024-01-19T04:17:04.702269+0000","last_clean":"2024-01-19T04:17:04.702269+0000","last_became_active":"2024-01-19T04:16:51.580564+0000","last_became_peered":"2024-01-19T04:16:51.580564+0000","last_unstale":"2024-01-19T04:17:04.702269+0000","last_undegraded":"2024-01-19T04:17:04.702269+0000","last_fullsized":"2024-01-19T04:17:04.702269+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:22:29.841231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702576+0000","last_change":"2024-01-19T04:16:50.565555+0000","last_active":"2024-01-19T04:17:04.702576+0000","last_peered":"2024-01-19T04:17:04.702576+0000","last_clean":"2024-01-19T04:17:04.702576+0000","last_became_active":"2024-01-19T04:16:50.565273+0000","last_became_peered":"2024-01-19T04:16:50.565273+0000","last_unstale":"2024-01-19T04:17:04.702576+0000","last_undegraded":"2024-01-19T04:17:04.702576+0000","last_fullsized":"2024-01-19T04:17:04.702576+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:38:45.842633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.058918+0000","last_change":"2024-01-19T04:17:04.716116+0000","last_active":"2024-01-19T04:17:06.058918+0000","last_peered":"2024-01-19T04:17:06.058918+0000","last_clean":"2024-01-19T04:17:06.058918+0000","last_became_active":"2024-01-19T04:17:04.715861+0000","last_became_peered":"2024-01-19T04:17:04.715861+0000","last_unstale":"2024-01-19T04:17:06.058918+0000","last_undegraded":"2024-01-19T04:17:06.058918+0000","last_fullsized":"2024-01-19T04:17:06.058918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:03:54.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062689+0000","last_change":"2024-01-19T04:17:03.713437+0000","last_active":"2024-01-19T04:17:05.062689+0000","last_peered":"2024-01-19T04:17:05.062689+0000","last_clean":"2024-01-19T04:17:05.062689+0000","last_became_active":"2024-01-19T04:17:03.713127+0000","last_became_peered":"2024-01-19T04:17:03.713127+0000","last_unstale":"2024-01-19T04:17:05.062689+0000","last_undegraded":"2024-01-19T04:17:05.062689+0000","last_fullsized":"2024-01-19T04:17:05.062689+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:07:28.630288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.702532+0000","last_change":"2024-01-19T04:16:51.574116+0000","last_active":"2024-01-19T04:17:04.702532+0000","last_peered":"2024-01-19T04:17:04.702532+0000","last_clean":"2024-01-19T04:17:04.702532+0000","last_became_active":"2024-01-19T04:16:51.573543+0000","last_became_peered":"2024-01-19T04:16:51.573543+0000","last_unstale":"2024-01-19T04:17:04.702532+0000","last_undegraded":"2024-01-19T04:17:04.702532+0000","last_fullsized":"2024-01-19T04:17:04.702532+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:08.446410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.704630+0000","last_change":"2024-01-19T04:16:50.571359+0000","last_active":"2024-01-19T04:17:04.704630+0000","last_peered":"2024-01-19T04:17:04.704630+0000","last_clean":"2024-01-19T04:17:04.704630+0000","last_became_active":"2024-01-19T04:16:50.570715+0000","last_became_peered":"2024-01-19T04:16:50.570715+0000","last_unstale":"2024-01-19T04:17:04.704630+0000","last_undegraded":"2024-01-19T04:17:04.704630+0000","last_fullsized":"2024-01-19T04:17:04.704630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:11:29.727799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.742952+0000","last_change":"2024-01-19T04:17:04.706826+0000","last_active":"2024-01-19T04:17:06.742952+0000","last_peered":"2024-01-19T04:17:06.742952+0000","last_clean":"2024-01-19T04:17:06.742952+0000","last_became_active":"2024-01-19T04:17:04.706578+0000","last_became_peered":"2024-01-19T04:17:04.706578+0000","last_unstale":"2024-01-19T04:17:06.742952+0000","last_undegraded":"2024-01-19T04:17:06.742952+0000","last_fullsized":"2024-01-19T04:17:06.742952+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:44.988632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062799+0000","last_change":"2024-01-19T04:17:03.711684+0000","last_active":"2024-01-19T04:17:05.062799+0000","last_peered":"2024-01-19T04:17:05.062799+0000","last_clean":"2024-01-19T04:17:05.062799+0000","last_became_active":"2024-01-19T04:17:03.711404+0000","last_became_peered":"2024-01-19T04:17:03.711404+0000","last_unstale":"2024-01-19T04:17:05.062799+0000","last_undegraded":"2024-01-19T04:17:05.062799+0000","last_fullsized":"2024-01-19T04:17:05.062799+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:39:05.518024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695322+0000","last_change":"2024-01-19T04:16:51.578118+0000","last_active":"2024-01-19T04:17:04.695322+0000","last_peered":"2024-01-19T04:17:04.695322+0000","last_clean":"2024-01-19T04:17:04.695322+0000","last_became_active":"2024-01-19T04:16:51.577861+0000","last_became_peered":"2024-01-19T04:16:51.577861+0000","last_unstale":"2024-01-19T04:17:04.695322+0000","last_undegraded":"2024-01-19T04:17:04.695322+0000","last_fullsized":"2024-01-19T04:17:04.695322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:52:16.044197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.701228+0000","last_change":"2024-01-19T04:16:50.572873+0000","last_active":"2024-01-19T04:17:04.701228+0000","last_peered":"2024-01-19T04:17:04.701228+0000","last_clean":"2024-01-19T04:17:04.701228+0000","last_became_active":"2024-01-19T04:16:50.571172+0000","last_became_peered":"2024-01-19T04:16:50.571172+0000","last_unstale":"2024-01-19T04:17:04.701228+0000","last_undegraded":"2024-01-19T04:17:04.701228+0000","last_fullsized":"2024-01-19T04:17:04.701228+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:22.104137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.104433+0000","last_change":"2024-01-19T04:17:04.727787+0000","last_active":"2024-01-19T04:17:06.104433+0000","last_peered":"2024-01-19T04:17:06.104433+0000","last_clean":"2024-01-19T04:17:06.104433+0000","last_became_active":"2024-01-19T04:17:04.727503+0000","last_became_peered":"2024-01-19T04:17:04.727503+0000","last_unstale":"2024-01-19T04:17:06.104433+0000","last_undegraded":"2024-01-19T04:17:06.104433+0000","last_fullsized":"2024-01-19T04:17:06.104433+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:29:40.576911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062218+0000","last_change":"2024-01-19T04:17:03.711107+0000","last_active":"2024-01-19T04:17:05.062218+0000","last_peered":"2024-01-19T04:17:05.062218+0000","last_clean":"2024-01-19T04:17:05.062218+0000","last_became_active":"2024-01-19T04:17:03.709301+0000","last_became_peered":"2024-01-19T04:17:03.709301+0000","last_unstale":"2024-01-19T04:17:05.062218+0000","last_undegraded":"2024-01-19T04:17:05.062218+0000","last_fullsized":"2024-01-19T04:17:05.062218+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:27:26.645481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699477+0000","last_change":"2024-01-19T04:16:51.590515+0000","last_active":"2024-01-19T04:17:04.699477+0000","last_peered":"2024-01-19T04:17:04.699477+0000","last_clean":"2024-01-19T04:17:04.699477+0000","last_became_active":"2024-01-19T04:16:51.590319+0000","last_became_peered":"2024-01-19T04:16:51.590319+0000","last_unstale":"2024-01-19T04:17:04.699477+0000","last_undegraded":"2024-01-19T04:17:04.699477+0000","last_fullsized":"2024-01-19T04:17:04.699477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:05:27.617328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.694605+0000","last_change":"2024-01-19T04:16:50.567937+0000","last_active":"2024-01-19T04:17:04.694605+0000","last_peered":"2024-01-19T04:17:04.694605+0000","last_clean":"2024-01-19T04:17:04.694605+0000","last_became_active":"2024-01-19T04:16:50.567687+0000","last_became_peered":"2024-01-19T04:16:50.567687+0000","last_unstale":"2024-01-19T04:17:04.694605+0000","last_undegraded":"2024-01-19T04:17:04.694605+0000","last_fullsized":"2024-01-19T04:17:04.694605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:05.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.729857+0000","last_change":"2024-01-19T04:17:04.708824+0000","last_active":"2024-01-19T04:17:06.729857+0000","last_peered":"2024-01-19T04:17:06.729857+0000","last_clean":"2024-01-19T04:17:06.729857+0000","last_became_active":"2024-01-19T04:17:04.708452+0000","last_became_peered":"2024-01-19T04:17:04.708452+0000","last_unstale":"2024-01-19T04:17:06.729857+0000","last_undegraded":"2024-01-19T04:17:06.729857+0000","last_fullsized":"2024-01-19T04:17:06.729857+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:48:45.036824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.705206+0000","last_change":"2024-01-19T04:17:03.707107+0000","last_active":"2024-01-19T04:17:04.705206+0000","last_peered":"2024-01-19T04:17:04.705206+0000","last_clean":"2024-01-19T04:17:04.705206+0000","last_became_active":"2024-01-19T04:17:03.706799+0000","last_became_peered":"2024-01-19T04:17:03.706799+0000","last_unstale":"2024-01-19T04:17:04.705206+0000","last_undegraded":"2024-01-19T04:17:04.705206+0000","last_fullsized":"2024-01-19T04:17:04.705206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:43.326228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698335+0000","last_change":"2024-01-19T04:16:51.583555+0000","last_active":"2024-01-19T04:17:04.698335+0000","last_peered":"2024-01-19T04:17:04.698335+0000","last_clean":"2024-01-19T04:17:04.698335+0000","last_became_active":"2024-01-19T04:16:51.583278+0000","last_became_peered":"2024-01-19T04:16:51.583278+0000","last_unstale":"2024-01-19T04:17:04.698335+0000","last_undegraded":"2024-01-19T04:17:04.698335+0000","last_fullsized":"2024-01-19T04:17:04.698335+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:10.004835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699287+0000","last_change":"2024-01-19T04:16:50.570692+0000","last_active":"2024-01-19T04:17:04.699287+0000","last_peered":"2024-01-19T04:17:04.699287+0000","last_clean":"2024-01-19T04:17:04.699287+0000","last_became_active":"2024-01-19T04:16:50.570414+0000","last_became_peered":"2024-01-19T04:16:50.570414+0000","last_unstale":"2024-01-19T04:17:04.699287+0000","last_undegraded":"2024-01-19T04:17:04.699287+0000","last_fullsized":"2024-01-19T04:17:04.699287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:36:18.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.104808+0000","last_change":"2024-01-19T04:17:04.730280+0000","last_active":"2024-01-19T04:17:06.104808+0000","last_peered":"2024-01-19T04:17:06.104808+0000","last_clean":"2024-01-19T04:17:06.104808+0000","last_became_active":"2024-01-19T04:17:04.729904+0000","last_became_peered":"2024-01-19T04:17:04.729904+0000","last_unstale":"2024-01-19T04:17:06.104808+0000","last_undegraded":"2024-01-19T04:17:06.104808+0000","last_fullsized":"2024-01-19T04:17:06.104808+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:37:21.586290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.698985+0000","last_change":"2024-01-19T04:17:03.708010+0000","last_active":"2024-01-19T04:17:04.698985+0000","last_peered":"2024-01-19T04:17:04.698985+0000","last_clean":"2024-01-19T04:17:04.698985+0000","last_became_active":"2024-01-19T04:17:03.707622+0000","last_became_peered":"2024-01-19T04:17:03.707622+0000","last_unstale":"2024-01-19T04:17:04.698985+0000","last_undegraded":"2024-01-19T04:17:04.698985+0000","last_fullsized":"2024-01-19T04:17:04.698985+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:57.511703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.695576+0000","last_change":"2024-01-19T04:16:51.586087+0000","last_active":"2024-01-19T04:17:04.695576+0000","last_peered":"2024-01-19T04:17:04.695576+0000","last_clean":"2024-01-19T04:17:04.695576+0000","last_became_active":"2024-01-19T04:16:51.585533+0000","last_became_peered":"2024-01-19T04:16:51.585533+0000","last_unstale":"2024-01-19T04:17:04.695576+0000","last_undegraded":"2024-01-19T04:17:04.695576+0000","last_fullsized":"2024-01-19T04:17:04.695576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:14:32.942430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693448+0000","last_change":"2024-01-19T04:16:50.570854+0000","last_active":"2024-01-19T04:17:04.693448+0000","last_peered":"2024-01-19T04:17:04.693448+0000","last_clean":"2024-01-19T04:17:04.693448+0000","last_became_active":"2024-01-19T04:16:50.570594+0000","last_became_peered":"2024-01-19T04:16:50.570594+0000","last_unstale":"2024-01-19T04:17:04.693448+0000","last_undegraded":"2024-01-19T04:17:04.693448+0000","last_fullsized":"2024-01-19T04:17:04.693448+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:51:58.259661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-19T04:17:06.923676+0000","last_change":"2024-01-19T04:17:04.726240+0000","last_active":"2024-01-19T04:17:06.923676+0000","last_peered":"2024-01-19T04:17:06.923676+0000","last_clean":"2024-01-19T04:17:06.923676+0000","last_became_active":"2024-01-19T04:17:04.725967+0000","last_became_peered":"2024-01-19T04:17:04.725967+0000","last_unstale":"2024-01-19T04:17:06.923676+0000","last_undegraded":"2024-01-19T04:17:06.923676+0000","last_fullsized":"2024-01-19T04:17:06.923676+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:03.680056+0000","last_clean_scrub_stamp":"2024-01-19T04:17:03.680056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:12:40.918817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:05.062329+0000","last_change":"2024-01-19T04:17:03.710289+0000","last_active":"2024-01-19T04:17:05.062329+0000","last_peered":"2024-01-19T04:17:05.062329+0000","last_clean":"2024-01-19T04:17:05.062329+0000","last_became_active":"2024-01-19T04:17:03.709448+0000","last_became_peered":"2024-01-19T04:17:03.709448+0000","last_unstale":"2024-01-19T04:17:05.062329+0000","last_undegraded":"2024-01-19T04:17:05.062329+0000","last_fullsized":"2024-01-19T04:17:05.062329+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:02.673842+0000","last_clean_scrub_stamp":"2024-01-19T04:17:02.673842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:27:10.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.693344+0000","last_change":"2024-01-19T04:16:51.574512+0000","last_active":"2024-01-19T04:17:04.693344+0000","last_peered":"2024-01-19T04:17:04.693344+0000","last_clean":"2024-01-19T04:17:04.693344+0000","last_became_active":"2024-01-19T04:16:51.574197+0000","last_became_peered":"2024-01-19T04:16:51.574197+0000","last_unstale":"2024-01-19T04:17:04.693344+0000","last_undegraded":"2024-01-19T04:17:04.693344+0000","last_fullsized":"2024-01-19T04:17:04.693344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:50.540176+0000","last_clean_scrub_stamp":"2024-01-19T04:16:50.540176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:44:34.041080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.711472+0000","last_change":"2024-01-19T04:16:50.574052+0000","last_active":"2024-01-19T04:17:04.711472+0000","last_peered":"2024-01-19T04:17:04.711472+0000","last_clean":"2024-01-19T04:17:04.711472+0000","last_became_active":"2024-01-19T04:16:50.572944+0000","last_became_peered":"2024-01-19T04:16:50.572944+0000","last_unstale":"2024-01-19T04:17:04.711472+0000","last_undegraded":"2024-01-19T04:17:04.711472+0000","last_fullsized":"2024-01-19T04:17:04.711472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:16:49.532903+0000","last_clean_scrub_stamp":"2024-01-19T04:16:49.532903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:10:00.992470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-19T04:17:04.699726+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:17:04.699726+0000","last_peered":"2024-01-19T04:17:04.699726+0000","last_clean":"2024-01-19T04:17:04.699726+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:17:04.699726+0000","last_undegraded":"2024-01-19T04:17:04.699726+0000","last_fullsized":"2024-01-19T04:17:04.699726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476767,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1282048,"data_stored":880461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.95499999999999996}]}]},{"osd":6,"up_from":16,"seq":68719476767,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":289409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.503},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.57499999999999996}]}]},{"osd":5,"up_from":16,"seq":68719476766,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":290059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98299999999999998,"5min":1.107,"15min":1.107},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.246,"15min":1.246},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.878},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0820000000000001,"5min":1.708,"15min":1.708},"last":0.745}]}]},{"osd":4,"up_from":16,"seq":68719476768,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":292494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.54300000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.381,"15min":1.381},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.095,"15min":1.095},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0940000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.139,"15min":1.139},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1120000000000001,"5min":1.266,"15min":1.266},"last":0.74099999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":692224,"data_stored":290985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54700000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.503},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.63300000000000001,"5min":0.879,"15min":0.879},"last":0.439},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.495}]},{"osd":4,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95799999999999996,"5min":1.016,"15min":1.016},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.89500000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.754}]},{"osd":6,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93000000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98199999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.82099999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":696320,"data_stored":291635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.964,"15min":1.964},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":2.827,"15min":2.827},"last":0.62}]},{"osd":3,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60299999999999998,"5min":2.343,"15min":2.343},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.665,"15min":1.665},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.032,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.94199999999999995,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.002,"5min":1.198,"15min":1.198},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.96599999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.0600000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.67500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1},{"interface":"front","average":{"1min":0.747,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.04,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.85099999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":883374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.60999999999999999,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60799999999999998,"5min":3.129,"15min":3.129},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.66700000000000004,"15min":0.69999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.72299999999999998,"15min":0.755},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.61299999999999999,"5min":3.633,"15min":3.633},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.59499999999999997,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93200000000000005,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.96299999999999997,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89500000000000002,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.004,"15min":1.052},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0469999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":1.034,"15min":1.0860000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97499999999999998,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.96799999999999997,"15min":1.008},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.85099999999999998,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.96799999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.876,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75,"5min":1.052,"15min":1.1020000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95099999999999996,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.90900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":289485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54600000000000004,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.77600000000000002,"15min":0.81799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82699999999999996,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.65300000000000002,"15min":0.68300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":5.226,"15min":5.226},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":5.319,"15min":5.319},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.745,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96599999999999997,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.085,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.01,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.133,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.093,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93999999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.165,"5min":5.423,"15min":5.423},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1459999999999999,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:17:13.815 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:17:13.815 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-19T04:17:14.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b4600640 1 Processor -- start 2024-01-19T04:17:14.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b4600640 1 -- start start 2024-01-19T04:17:14.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b4600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f75ac155150 0x7f75ac157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b4600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0c2d30 con 0x7f75ac0c6360 2024-01-19T04:17:14.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b4600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0c3010 con 0x7f75ac151b80 2024-01-19T04:17:14.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b4600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0c34a0 con 0x7f75ac155150 2024-01-19T04:17:14.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b2600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f75ac0c6360 0x7f75ac0c67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42368/0 (socket says 172.21.15.32:42368) 2024-01-19T04:17:14.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b2600640 1 -- 172.21.15.32:0/353854651 learned_addr learned my addr 172.21.15.32:0/353854651 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:14.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b1200640 1 --2- 172.21.15.32:0/353854651 >> v2:172.21.15.67:3300/0 conn(0x7f75ac155150 0x7f75ac157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75abe00640 1 -- 172.21.15.32:0/353854651 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017082907 0 0) 0x7f75ac0c2d30 con 0x7f75ac0c6360 2024-01-19T04:17:14.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75abe00640 1 -- 172.21.15.32:0/353854651 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f758c003530 con 0x7f75ac0c6360 2024-01-19T04:17:14.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b1200640 1 -- 172.21.15.32:0/353854651 >> v1:172.21.15.67:6789/0 conn(0x7f75ac151b80 legacy=0x7f75ac0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b1200640 1 -- 172.21.15.32:0/353854651 >> v1:172.21.15.32:6789/0 conn(0x7f75ac0c6360 legacy=0x7f75ac0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.001+0000 7f75b1200640 1 -- 172.21.15.32:0/353854651 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0c7700 con 0x7f75ac155150 2024-01-19T04:17:14.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b1200640 1 --2- 172.21.15.32:0/353854651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 0x7f75ac157cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75940097c0 tx=0x7f759401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8fdba93cfd475ba server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75abe00640 1 -- 172.21.15.32:0/353854651 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940ab610 con 0x7f75ac155150 2024-01-19T04:17:14.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75abe00640 1 -- 172.21.15.32:0/353854651 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75940ab770 con 0x7f75ac155150 2024-01-19T04:17:14.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75abe00640 1 -- 172.21.15.32:0/353854651 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940abb00 con 0x7f75ac155150 2024-01-19T04:17:14.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b4600640 1 -- 172.21.15.32:0/353854651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 msgr2=0x7f75ac157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b4600640 1 --2- 172.21.15.32:0/353854651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 0x7f75ac157cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75940097c0 tx=0x7f759401c450 comp rx=0 tx=0).stop 2024-01-19T04:17:14.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b4600640 1 -- 172.21.15.32:0/353854651 shutdown_connections 2024-01-19T04:17:14.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b4600640 1 --2- 172.21.15.32:0/353854651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 0x7f75ac157cc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b4600640 1 -- 172.21.15.32:0/353854651 >> 172.21.15.32:0/353854651 conn(0x7f75ac0c7d40 msgr2=0x7f75ac0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:14.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b4600640 1 -- 172.21.15.32:0/353854651 shutdown_connections 2024-01-19T04:17:14.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.005+0000 7f75b4600640 1 -- 172.21.15.32:0/353854651 wait complete. 2024-01-19T04:17:14.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 Processor -- start 2024-01-19T04:17:14.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 -- start start 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ac0c6360 0x7f75ac147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ac151b80 0x7f75ac146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 0x7f75ac146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac155730 con 0x7f75ac0c6360 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0a7c20 con 0x7f75ac155150 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0a8270 con 0x7f75ac151b80 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ac0c6360 0x7f75ac147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ac0c6360 0x7f75ac147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45460/0 (socket says 172.21.15.32:45460) 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 -- 172.21.15.32:0/2293201999 learned_addr learned my addr 172.21.15.32:0/2293201999 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b2600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 0x7f75ac146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1200640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ac151b80 0x7f75ac146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 -- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ac151b80 msgr2=0x7f75ac146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ac151b80 0x7f75ac146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 -- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 msgr2=0x7f75ac146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 0x7f75ac146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 -- 172.21.15.32:0/2293201999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594009420 con 0x7f75ac0c6360 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b1c00640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ac0c6360 0x7f75ac147ec0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c530 tx=0x7f759c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75a9600640 1 -- 172.21.15.32:0/2293201999 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c005220 con 0x7f75ac0c6360 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75a9600640 1 -- 172.21.15.32:0/2293201999 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c005380 con 0x7f75ac0c6360 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75a9600640 1 -- 172.21.15.32:0/2293201999 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c007270 con 0x7f75ac0c6360 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac148950 con 0x7f75ac0c6360 2024-01-19T04:17:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.009+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac153490 con 0x7f75ac0c6360 2024-01-19T04:17:14.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.013+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac1532f0 con 0x7f75ac0c6360 2024-01-19T04:17:14.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.013+0000 7f75a9600640 1 -- 172.21.15.32:0/2293201999 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f759c0073d0 con 0x7f75ac0c6360 2024-01-19T04:17:14.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.013+0000 7f75a9600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7584066500 0x7f75840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.013+0000 7f75a9600640 1 -- 172.21.15.32:0/2293201999 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f759c083950 con 0x7f75ac0c6360 2024-01-19T04:17:14.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.013+0000 7f75b1200640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7584066500 0x7f75840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.013+0000 7f75b1200640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7584066500 0x7f75840689c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f75940af000 tx=0x7f75940b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.017+0000 7f75a9600640 1 -- 172.21.15.32:0/2293201999 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f75ac1532f0 con 0x7f75ac0c6360 2024-01-19T04:17:14.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.233+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f75ac1532f0 con 0x7f75ac0c6360 2024-01-19T04:17:14.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.233+0000 7f75a9600640 1 -- 172.21.15.32:0/2293201999 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7f75ac1532f0 con 0x7f75ac0c6360 2024-01-19T04:17:14.237 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-01-19T04:17:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ== 2024-01-19T04:17:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-01-19T04:17:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-01-19T04:17:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-19T04:17:14.238 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.1 2024-01-19T04:17:14.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7584066500 msgr2=0x7f75840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7584066500 0x7f75840689c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f75940af000 tx=0x7f75940b6040 comp rx=0 tx=0).stop 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ac0c6360 msgr2=0x7f75ac147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ac0c6360 0x7f75ac147ec0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c530 tx=0x7f759c00c9f0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 shutdown_connections 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7584066500 0x7f75840689c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75ac155150 0x7f75ac146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f75ac151b80 0x7f75ac146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 --2- 172.21.15.32:0/2293201999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75ac0c6360 0x7f75ac147ec0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 >> 172.21.15.32:0/2293201999 conn(0x7f75ac0c7d40 msgr2=0x7f75ac1607c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 shutdown_connections 2024-01-19T04:17:14.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.237+0000 7f75b4600640 1 -- 172.21.15.32:0/2293201999 wait complete. 2024-01-19T04:17:14.261 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:14.261 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:14.271 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:14.272 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:14.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:14.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.457+0000 7f792f000640 1 Processor -- start 2024-01-19T04:17:14.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.457+0000 7f792f000640 1 -- start start 2024-01-19T04:17:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f792f000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7928151f30 0x7f79280c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f792f000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79280c5b40 con 0x7f792806eb70 2024-01-19T04:17:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f792f000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79280c3fa0 con 0x7f792806fda0 2024-01-19T04:17:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f792f000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79281551e0 con 0x7f7928151f30 2024-01-19T04:17:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f7927e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7928151f30 0x7f79280c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f792d000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f792806eb70 0x7f792806efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42370/0 (socket says 172.21.15.32:42370) 2024-01-19T04:17:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f792d000640 1 -- 172.21.15.32:0/3457751863 learned_addr learned my addr 172.21.15.32:0/3457751863 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:14.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f7927e00640 1 -- 172.21.15.32:0/3457751863 >> v1:172.21.15.67:6789/0 conn(0x7f792806fda0 legacy=0x7f79280c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f7927e00640 1 -- 172.21.15.32:0/3457751863 >> v1:172.21.15.32:6789/0 conn(0x7f792806eb70 legacy=0x7f792806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.461+0000 7f7927e00640 1 -- 172.21.15.32:0/3457751863 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928155710 con 0x7f7928151f30 2024-01-19T04:17:14.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f7927e00640 1 --2- 172.21.15.32:0/3457751863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7928151f30 0x7f79280c4430 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f79180097c0 tx=0x7f791801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268fece8cbd61f8f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f7926a00640 1 -- 172.21.15.32:0/3457751863 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180ab600 con 0x7f7928151f30 2024-01-19T04:17:14.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f7926a00640 1 -- 172.21.15.32:0/3457751863 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180a7050 con 0x7f7928151f30 2024-01-19T04:17:14.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f7926a00640 1 -- 172.21.15.32:0/3457751863 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180ab980 con 0x7f7928151f30 2024-01-19T04:17:14.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- 172.21.15.32:0/3457751863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7928151f30 msgr2=0x7f79280c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 --2- 172.21.15.32:0/3457751863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7928151f30 0x7f79280c4430 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f79180097c0 tx=0x7f791801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- 172.21.15.32:0/3457751863 shutdown_connections 2024-01-19T04:17:14.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 --2- 172.21.15.32:0/3457751863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7928151f30 0x7f79280c4430 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- 172.21.15.32:0/3457751863 >> 172.21.15.32:0/3457751863 conn(0x7f79280a9870 msgr2=0x7f79280a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- 172.21.15.32:0/3457751863 shutdown_connections 2024-01-19T04:17:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- 172.21.15.32:0/3457751863 wait complete. 2024-01-19T04:17:14.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 Processor -- start 2024-01-19T04:17:14.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- start start 2024-01-19T04:17:14.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f792806eb70 0x7f792814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f792806fda0 0x7f79280a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7928151f30 0x7f79281ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792814f8f0 con 0x7f792806eb70 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792814cae0 con 0x7f792806fda0 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.465+0000 7f792f000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79281527a0 con 0x7f7928151f30 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f792806eb70 0x7f792814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f792806eb70 0x7f792814c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45486/0 (socket says 172.21.15.32:45486) 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 -- 172.21.15.32:0/2530834300 learned_addr learned my addr 172.21.15.32:0/2530834300 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f792d000640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7928151f30 0x7f79281ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927400640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f792806fda0 0x7f79280a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 -- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7928151f30 msgr2=0x7f79281ecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7928151f30 0x7f79281ecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 -- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f792806fda0 msgr2=0x7f79280a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f792806fda0 0x7f79280a8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 -- 172.21.15.32:0/2530834300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009420 con 0x7f792806eb70 2024-01-19T04:17:14.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f7927e00640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f792806eb70 0x7f792814c5a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7918019000 tx=0x7f791801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f791fe00640 1 -- 172.21.15.32:0/2530834300 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180b7650 con 0x7f792806eb70 2024-01-19T04:17:14.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f791fe00640 1 -- 172.21.15.32:0/2530834300 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180abe90 con 0x7f792806eb70 2024-01-19T04:17:14.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f791fe00640 1 -- 172.21.15.32:0/2530834300 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180b7a10 con 0x7f792806eb70 2024-01-19T04:17:14.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792814f090 con 0x7f792806eb70 2024-01-19T04:17:14.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79281ed290 con 0x7f792806eb70 2024-01-19T04:17:14.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79280749f0 con 0x7f792806eb70 2024-01-19T04:17:14.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.469+0000 7f791fe00640 1 -- 172.21.15.32:0/2530834300 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f79180b7b70 con 0x7f792806eb70 2024-01-19T04:17:14.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.473+0000 7f791fe00640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7900066530 0x7f79000689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.473+0000 7f791fe00640 1 -- 172.21.15.32:0/2530834300 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f791811e830 con 0x7f792806eb70 2024-01-19T04:17:14.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.473+0000 7f7927400640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7900066530 0x7f79000689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.473+0000 7f7927400640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7900066530 0x7f79000689f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f792814d9b0 tx=0x7f7910009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.477+0000 7f791fe00640 1 -- 172.21.15.32:0/2530834300 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f79180eb810 con 0x7f792806eb70 2024-01-19T04:17:14.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.641+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7928067b80 con 0x7f792806eb70 2024-01-19T04:17:14.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.641+0000 7f791fe00640 1 -- 172.21.15.32:0/2530834300 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20185 (secure 0 0 0) 0x7f79180eee30 con 0x7f792806eb70 2024-01-19T04:17:14.644 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:14.645 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":57,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:05.701251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7900066530 msgr2=0x7f79000689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7900066530 0x7f79000689f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f792814d9b0 tx=0x7f7910009040 comp rx=0 tx=0).stop 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f792806eb70 msgr2=0x7f792814c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f792806eb70 0x7f792814c5a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7918019000 tx=0x7f791801ac30 comp rx=0 tx=0).stop 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 shutdown_connections 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7900066530 0x7f79000689f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7928151f30 0x7f79281ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f792806fda0 0x7f79280a8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 --2- 172.21.15.32:0/2530834300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f792806eb70 0x7f792814c5a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 >> 172.21.15.32:0/2530834300 conn(0x7f79280a9870 msgr2=0x7f7928151320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 shutdown_connections 2024-01-19T04:17:14.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.645+0000 7f792f000640 1 -- 172.21.15.32:0/2530834300 wait complete. 2024-01-19T04:17:14.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:16:48.753748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:16:49.947198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:17:02.181700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:17:03.077640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:14.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:14.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5dfd800640 1 Processor -- start 2024-01-19T04:17:14.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5dfd800640 1 -- start start 2024-01-19T04:17:14.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5dfd800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5df8151b80 0x7f5df8155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5dfd800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df80c6360 0x7f5df80c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5dfd800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80c2d30 con 0x7f5df8157cc0 2024-01-19T04:17:14.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5dfd800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df80c34a0 con 0x7f5df8151b80 2024-01-19T04:17:14.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5dfd800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8155730 con 0x7f5df80c6360 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5df6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5df8151b80 0x7f5df8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5df7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df80c6360 0x7f5df80c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5df6000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5df8157cc0 0x7f5df80c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:42636/0 (socket says 172.21.15.32:42636) 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5df6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5df8151b80 0x7f5df8155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:55018/0 (socket says 172.21.15.32:55018) 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5df6a00640 1 -- 172.21.15.32:0/2554709497 learned_addr learned my addr 172.21.15.32:0/2554709497 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.809+0000 7f5df7400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df80c6360 0x7f5df80c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:40308/0 (socket says 172.21.15.32:40308) 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df7400640 1 -- 172.21.15.32:0/2554709497 >> v2:172.21.15.67:3300/0 conn(0x7f5df8151b80 msgr2=0x7f5df8155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:14.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df7400640 1 --2- 172.21.15.32:0/2554709497 >> v2:172.21.15.67:3300/0 conn(0x7f5df8151b80 0x7f5df8155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df7400640 1 -- 172.21.15.32:0/2554709497 >> v1:172.21.15.67:6789/0 conn(0x7f5df8157cc0 legacy=0x7f5df80c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df7400640 1 -- 172.21.15.32:0/2554709497 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80c3010 con 0x7f5df80c6360 2024-01-19T04:17:14.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df6a00640 1 --2- 172.21.15.32:0/2554709497 >> v2:172.21.15.67:3300/0 conn(0x7f5df8151b80 0x7f5df8155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:14.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df7400640 1 --2- 172.21.15.32:0/2554709497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df80c6360 0x7f5df80c6780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009d90 tx=0x7f5df001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ccf121cca227fc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df5600640 1 -- 172.21.15.32:0/2554709497 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a58f0 con 0x7f5df80c6360 2024-01-19T04:17:14.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df5600640 1 -- 172.21.15.32:0/2554709497 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00a5a50 con 0x7f5df80c6360 2024-01-19T04:17:14.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.813+0000 7f5df5600640 1 -- 172.21.15.32:0/2554709497 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a5de0 con 0x7f5df80c6360 2024-01-19T04:17:14.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- 172.21.15.32:0/2554709497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df80c6360 msgr2=0x7f5df80c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2554709497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df80c6360 0x7f5df80c6780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009d90 tx=0x7f5df001c920 comp rx=0 tx=0).stop 2024-01-19T04:17:14.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- 172.21.15.32:0/2554709497 shutdown_connections 2024-01-19T04:17:14.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2554709497 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df80c6360 0x7f5df80c6780 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2554709497 >> v2:172.21.15.67:3300/0 conn(0x7f5df8151b80 0x7f5df8155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- 172.21.15.32:0/2554709497 >> 172.21.15.32:0/2554709497 conn(0x7f5df80c7d40 msgr2=0x7f5df80c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:14.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- 172.21.15.32:0/2554709497 shutdown_connections 2024-01-19T04:17:14.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- 172.21.15.32:0/2554709497 wait complete. 2024-01-19T04:17:14.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 Processor -- start 2024-01-19T04:17:14.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- start start 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df80c6360 0x7f5df814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df8151b80 0x7f5df8149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df8157cc0 0x7f5df806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8153180 con 0x7f5df8157cc0 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80ad620 con 0x7f5df80c6360 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5dfd800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81ed970 con 0x7f5df8151b80 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df8157cc0 0x7f5df806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df8157cc0 0x7f5df806cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45498/0 (socket says 172.21.15.32:45498) 2024-01-19T04:17:14.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 -- 172.21.15.32:0/2237222568 learned_addr learned my addr 172.21.15.32:0/2237222568 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:14.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df6a00640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df80c6360 0x7f5df814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df6000640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df8151b80 0x7f5df8149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 -- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df8151b80 msgr2=0x7f5df8149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df8151b80 0x7f5df8149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 -- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df80c6360 msgr2=0x7f5df814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df80c6360 0x7f5df814e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.817+0000 7f5df7400640 1 -- 172.21.15.32:0/2237222568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80094d0 con 0x7f5df8157cc0 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5df7400640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df8157cc0 0x7f5df806cda0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b0040 tx=0x7f5df00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5deea00640 1 -- 172.21.15.32:0/2237222568 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00b9860 con 0x7f5df8157cc0 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5deea00640 1 -- 172.21.15.32:0/2237222568 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00b99c0 con 0x7f5df8157cc0 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df0009a70 con 0x7f5df8157cc0 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5deea00640 1 -- 172.21.15.32:0/2237222568 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00b9d70 con 0x7f5df8157cc0 2024-01-19T04:17:14.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df80ad870 con 0x7f5df8157cc0 2024-01-19T04:17:14.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df80749f0 con 0x7f5df8157cc0 2024-01-19T04:17:14.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5deea00640 1 -- 172.21.15.32:0/2237222568 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5df00c4460 con 0x7f5df8157cc0 2024-01-19T04:17:14.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5deea00640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066500 0x7f5dd00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:14.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5deea00640 1 -- 172.21.15.32:0/2237222568 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5df011f510 con 0x7f5df8157cc0 2024-01-19T04:17:14.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.821+0000 7f5df6a00640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066500 0x7f5dd00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:14.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.825+0000 7f5df6a00640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066500 0x7f5dd00689c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5de8006cb0 tx=0x7f5de8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:14.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.825+0000 7f5deea00640 1 -- 172.21.15.32:0/2237222568 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5df00ec460 con 0x7f5df8157cc0 2024-01-19T04:17:14.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5df81edab0 con 0x7f5df8157cc0 2024-01-19T04:17:14.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5deea00640 1 -- 172.21.15.32:0/2237222568 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5df81edab0 con 0x7f5df8157cc0 2024-01-19T04:17:14.991 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066500 msgr2=0x7f5dd00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066500 0x7f5dd00689c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5de8006cb0 tx=0x7f5de8009240 comp rx=0 tx=0).stop 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df8157cc0 msgr2=0x7f5df806cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df8157cc0 0x7f5df806cda0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b0040 tx=0x7f5df00196c0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 shutdown_connections 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066500 0x7f5dd00689c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df8157cc0 0x7f5df806cda0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df8151b80 0x7f5df8149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 --2- 172.21.15.32:0/2237222568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df80c6360 0x7f5df814e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 >> 172.21.15.32:0/2237222568 conn(0x7f5df80c7d40 msgr2=0x7f5df8154c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 shutdown_connections 2024-01-19T04:17:14.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:14.989+0000 7f5dfd800640 1 -- 172.21.15.32:0/2237222568 wait complete. 2024-01-19T04:17:15.014 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:17:15.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.153+0000 7f10c3400640 1 Processor -- start 2024-01-19T04:17:15.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.153+0000 7f10c3400640 1 -- start start 2024-01-19T04:17:15.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10c3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10bc0c2080 0x7f10bc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10c3400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10bc06d440 0x7f10bc0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10c3400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0a4ea0 con 0x7f10bc0723b0 2024-01-19T04:17:15.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10c3400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc1524a0 con 0x7f10bc0c2080 2024-01-19T04:17:15.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10c3400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc152a20 con 0x7f10bc06d440 2024-01-19T04:17:15.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10bbe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10bc0c2080 0x7f10bc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10bbe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10bc0c2080 0x7f10bc155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45508/0 (socket says 172.21.15.32:45508) 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10bbe00640 1 -- 172.21.15.32:0/2254093732 learned_addr learned my addr 172.21.15.32:0/2254093732 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10c1400640 1 --2- 172.21.15.32:0/2254093732 >> v2:172.21.15.67:3300/0 conn(0x7f10bc06d440 0x7f10bc0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10bbe00640 1 -- 172.21.15.32:0/2254093732 >> v2:172.21.15.67:3300/0 conn(0x7f10bc06d440 msgr2=0x7f10bc0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10bbe00640 1 --2- 172.21.15.32:0/2254093732 >> v2:172.21.15.67:3300/0 conn(0x7f10bc06d440 0x7f10bc0c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10bbe00640 1 -- 172.21.15.32:0/2254093732 >> v1:172.21.15.67:6789/0 conn(0x7f10bc0723b0 legacy=0x7f10bc152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10bbe00640 1 -- 172.21.15.32:0/2254093732 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0c3430 con 0x7f10bc0c2080 2024-01-19T04:17:15.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.157+0000 7f10c1400640 1 --2- 172.21.15.32:0/2254093732 >> v2:172.21.15.67:3300/0 conn(0x7f10bc06d440 0x7f10bc0c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:15.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10bbe00640 1 --2- 172.21.15.32:0/2254093732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc0c2080 0x7f10bc155a90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f10bc072d10 tx=0x7f10a401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2a8acc8759b05 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10bb400640 1 -- 172.21.15.32:0/2254093732 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40ab600 con 0x7f10bc0c2080 2024-01-19T04:17:15.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10bb400640 1 -- 172.21.15.32:0/2254093732 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a40a7050 con 0x7f10bc0c2080 2024-01-19T04:17:15.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10bb400640 1 -- 172.21.15.32:0/2254093732 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40ab980 con 0x7f10bc0c2080 2024-01-19T04:17:15.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 -- 172.21.15.32:0/2254093732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc0c2080 msgr2=0x7f10bc155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 --2- 172.21.15.32:0/2254093732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc0c2080 0x7f10bc155a90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f10bc072d10 tx=0x7f10a401c370 comp rx=0 tx=0).stop 2024-01-19T04:17:15.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 -- 172.21.15.32:0/2254093732 shutdown_connections 2024-01-19T04:17:15.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 --2- 172.21.15.32:0/2254093732 >> v2:172.21.15.67:3300/0 conn(0x7f10bc06d440 0x7f10bc0c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 --2- 172.21.15.32:0/2254093732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc0c2080 0x7f10bc155a90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 -- 172.21.15.32:0/2254093732 >> 172.21.15.32:0/2254093732 conn(0x7f10bc0c25a0 msgr2=0x7f10bc0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:15.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 -- 172.21.15.32:0/2254093732 shutdown_connections 2024-01-19T04:17:15.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 -- 172.21.15.32:0/2254093732 wait complete. 2024-01-19T04:17:15.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 Processor -- start 2024-01-19T04:17:15.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.161+0000 7f10c3400640 1 -- start start 2024-01-19T04:17:15.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc06d440 0x7f10bc1ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10bc0723b0 0x7f10bc1f0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10bc0c2080 0x7f10bc0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc1552a0 con 0x7f10bc06d440 2024-01-19T04:17:15.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc14a9a0 con 0x7f10bc0723b0 2024-01-19T04:17:15.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc149cc0 con 0x7f10bc0c2080 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc06d440 0x7f10bc1ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc06d440 0x7f10bc1ecc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45510/0 (socket says 172.21.15.32:45510) 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 -- 172.21.15.32:0/2869956469 learned_addr learned my addr 172.21.15.32:0/2869956469 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10bbe00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10bc0723b0 0x7f10bc1f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c1400640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10bc0c2080 0x7f10bc0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 -- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10bc0c2080 msgr2=0x7f10bc0c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10bc0c2080 0x7f10bc0c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 -- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10bc0723b0 msgr2=0x7f10bc1f0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10bc0723b0 0x7f10bc1f0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 -- 172.21.15.32:0/2869956469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a40094d0 con 0x7f10bc06d440 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10bbe00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10bc0723b0 0x7f10bc1f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:15.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c0a00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc06d440 0x7f10bc1ecc90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00b410 tx=0x7f10ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10b8c00640 1 -- 172.21.15.32:0/2869956469 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac004020 con 0x7f10bc06d440 2024-01-19T04:17:15.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10b8c00640 1 -- 172.21.15.32:0/2869956469 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac004180 con 0x7f10bc06d440 2024-01-19T04:17:15.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10b8c00640 1 -- 172.21.15.32:0/2869956469 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac011630 con 0x7f10bc06d440 2024-01-19T04:17:15.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc1f1190 con 0x7f10bc06d440 2024-01-19T04:17:15.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc1f0bd0 con 0x7f10bc06d440 2024-01-19T04:17:15.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.165+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc0749f0 con 0x7f10bc06d440 2024-01-19T04:17:15.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.169+0000 7f10b8c00640 1 -- 172.21.15.32:0/2869956469 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f10ac011790 con 0x7f10bc06d440 2024-01-19T04:17:15.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.169+0000 7f10b8c00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1094066500 0x7f10940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.169+0000 7f10b8c00640 1 -- 172.21.15.32:0/2869956469 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f10ac083f90 con 0x7f10bc06d440 2024-01-19T04:17:15.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.169+0000 7f10bbe00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1094066500 0x7f10940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.169+0000 7f10bbe00640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1094066500 0x7f10940689c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f10a40ad000 tx=0x7f10a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.173+0000 7f10b8c00640 1 -- 172.21.15.32:0/2869956469 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f10ac050ec0 con 0x7f10bc06d440 2024-01-19T04:17:15.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.329+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10bc06cd00 con 0x7f10bc06d440 2024-01-19T04:17:15.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10b8c00640 1 -- 172.21.15.32:0/2869956469 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10ac0150a0 con 0x7f10bc06d440 2024-01-19T04:17:15.334 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1094066500 msgr2=0x7f10940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1094066500 0x7f10940689c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f10a40ad000 tx=0x7f10a4008040 comp rx=0 tx=0).stop 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc06d440 msgr2=0x7f10bc1ecc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc06d440 0x7f10bc1ecc90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00b410 tx=0x7f10ac00b8d0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 shutdown_connections 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1094066500 0x7f10940689c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10bc0c2080 0x7f10bc0c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10bc0723b0 0x7f10bc1f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 --2- 172.21.15.32:0/2869956469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc06d440 0x7f10bc1ecc90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 >> 172.21.15.32:0/2869956469 conn(0x7f10bc0c25a0 msgr2=0x7f10bc0c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 shutdown_connections 2024-01-19T04:17:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.333+0000 7f10c3400640 1 -- 172.21.15.32:0/2869956469 wait complete. 2024-01-19T04:17:15.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:17:15.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff832000640 1 Processor -- start 2024-01-19T04:17:15.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff832000640 1 -- start start 2024-01-19T04:17:15.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff832000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff832000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0a4ea0 con 0x7ff82c0c2080 2024-01-19T04:17:15.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff832000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c152a20 con 0x7ff82c0723b0 2024-01-19T04:17:15.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff832000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1524a0 con 0x7ff82c06d440 2024-01-19T04:17:15.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff82c0c2080 0x7ff82c155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42382/0 (socket says 172.21.15.32:42382) 2024-01-19T04:17:15.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82aa00640 1 -- 172.21.15.32:0/1198824876 learned_addr learned my addr 172.21.15.32:0/1198824876 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:15.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82be00640 1 --2- 172.21.15.32:0/1198824876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674186276 0 0) 0x7ff82c0a4ea0 con 0x7ff82c0c2080 2024-01-19T04:17:15.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff80c003530 con 0x7ff82c0c2080 2024-01-19T04:17:15.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088750223 0 0) 0x7ff82c152a20 con 0x7ff82c0723b0 2024-01-19T04:17:15.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82c0a4ea0 con 0x7ff82c0723b0 2024-01-19T04:17:15.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82be00640 1 -- 172.21.15.32:0/1198824876 >> v1:172.21.15.67:6789/0 conn(0x7ff82c0723b0 legacy=0x7ff82c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476103608 0 0) 0x7ff80c003530 con 0x7ff82c0c2080 2024-01-19T04:17:15.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82be00640 1 -- 172.21.15.32:0/1198824876 >> v1:172.21.15.32:6789/0 conn(0x7ff82c0c2080 legacy=0x7ff82c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.497+0000 7ff82be00640 1 -- 172.21.15.32:0/1198824876 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0c3430 con 0x7ff82c06d440 2024-01-19T04:17:15.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff82be00640 1 --2- 172.21.15.32:0/1198824876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c0c4e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff824009dc0 tx=0x7ff82401c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2fd9331dfa1952f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814001680 con 0x7ff82c06d440 2024-01-19T04:17:15.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8240a64a0 con 0x7ff82c06d440 2024-01-19T04:17:15.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff82a000640 1 -- 172.21.15.32:0/1198824876 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240a6830 con 0x7ff82c06d440 2024-01-19T04:17:15.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff832000640 1 -- 172.21.15.32:0/1198824876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 msgr2=0x7ff82c0c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff832000640 1 --2- 172.21.15.32:0/1198824876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c0c4e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff824009dc0 tx=0x7ff82401c740 comp rx=0 tx=0).stop 2024-01-19T04:17:15.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff832000640 1 -- 172.21.15.32:0/1198824876 shutdown_connections 2024-01-19T04:17:15.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff832000640 1 --2- 172.21.15.32:0/1198824876 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c0c4e50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff832000640 1 -- 172.21.15.32:0/1198824876 >> 172.21.15.32:0/1198824876 conn(0x7ff82c0c25a0 msgr2=0x7ff82c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:15.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff832000640 1 -- 172.21.15.32:0/1198824876 shutdown_connections 2024-01-19T04:17:15.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.501+0000 7ff832000640 1 -- 172.21.15.32:0/1198824876 wait complete. 2024-01-19T04:17:15.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 Processor -- start 2024-01-19T04:17:15.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 -- start start 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c14a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff82c0723b0 0x7ff82c14f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff82c0c2080 0x7ff82c1f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c14e530 con 0x7ff82c0723b0 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0aadf0 con 0x7ff82c0c2080 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1ed840 con 0x7ff82c06d440 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff82c0723b0 0x7ff82c14f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c14a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff82c0c2080 0x7ff82c1f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff82c0723b0 0x7ff82c14f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45524/0 (socket says 172.21.15.32:45524) 2024-01-19T04:17:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 -- 172.21.15.32:0/754455941 learned_addr learned my addr 172.21.15.32:0/754455941 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c14a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:40364/0 (socket says 172.21.15.32:40364) 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 -- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 msgr2=0x7ff82c14a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c14a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 -- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff82c0c2080 msgr2=0x7ff82c1f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff82c0c2080 0x7ff82c1f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 -- 172.21.15.32:0/754455941 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009a70 con 0x7ff82c0723b0 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff82aa00640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff82c0723b0 0x7ff82c14f610 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c760 tx=0x7ff81400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff823400640 1 -- 172.21.15.32:0/754455941 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814005cf0 con 0x7ff82c0723b0 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff823400640 1 -- 172.21.15.32:0/754455941 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814005e50 con 0x7ff82c0723b0 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff823400640 1 -- 172.21.15.32:0/754455941 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140072b0 con 0x7ff82c0723b0 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0abd40 con 0x7ff82c0723b0 2024-01-19T04:17:15.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.505+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c14a770 con 0x7ff82c0723b0 2024-01-19T04:17:15.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.509+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c14b8a0 con 0x7ff82c0723b0 2024-01-19T04:17:15.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.509+0000 7ff823400640 1 -- 172.21.15.32:0/754455941 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff814007410 con 0x7ff82c0723b0 2024-01-19T04:17:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.509+0000 7ff823400640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff804066500 0x7ff8040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.509+0000 7ff823400640 1 -- 172.21.15.32:0/754455941 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff814083de0 con 0x7ff82c0723b0 2024-01-19T04:17:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.509+0000 7ff82b400640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff804066500 0x7ff8040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.509+0000 7ff82b400640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff804066500 0x7ff8040689c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0011f0 tx=0x7ff81c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.513+0000 7ff823400640 1 -- 172.21.15.32:0/754455941 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff82c14b8a0 con 0x7ff82c0723b0 2024-01-19T04:17:15.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff82c14b8a0 con 0x7ff82c0723b0 2024-01-19T04:17:15.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff823400640 1 -- 172.21.15.32:0/754455941 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff82c14b8a0 con 0x7ff82c0723b0 2024-01-19T04:17:15.680 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff804066500 msgr2=0x7ff8040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff804066500 0x7ff8040689c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0011f0 tx=0x7ff81c009040 comp rx=0 tx=0).stop 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff82c0723b0 msgr2=0x7ff82c14f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff82c0723b0 0x7ff82c14f610 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c760 tx=0x7ff81400cc20 comp rx=0 tx=0).stop 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 shutdown_connections 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff804066500 0x7ff8040689c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff82c0c2080 0x7ff82c1f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff82c0723b0 0x7ff82c14f610 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 --2- 172.21.15.32:0/754455941 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff82c06d440 0x7ff82c14a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.677+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 >> 172.21.15.32:0/754455941 conn(0x7ff82c0c25a0 msgr2=0x7ff82c0c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.681+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 shutdown_connections 2024-01-19T04:17:15.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.681+0000 7ff832000640 1 -- 172.21.15.32:0/754455941 wait complete. 2024-01-19T04:17:15.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:17:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6087400640 1 Processor -- start 2024-01-19T04:17:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6087400640 1 -- start start 2024-01-19T04:17:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6087400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60800723b0 0x7f6080152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6087400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6087400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60800a4ea0 con 0x7f608006d440 2024-01-19T04:17:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6087400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60801524a0 con 0x7f60800723b0 2024-01-19T04:17:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6087400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6080152a20 con 0x7f60800c2080 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f607fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6084a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60800723b0 0x7f6080152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6084a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f60800723b0 0x7f6080152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:55052/0 (socket says 172.21.15.32:55052) 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f607fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:40374/0 (socket says 172.21.15.32:40374) 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6084a00640 1 -- 172.21.15.32:0/1166577263 learned_addr learned my addr 172.21.15.32:0/1166577263 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6085400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f608006d440 0x7f60800c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:42654/0 (socket says 172.21.15.32:42654) 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6084a00640 1 -- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 msgr2=0x7f6080155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6084a00640 1 --2- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6084a00640 1 -- 172.21.15.32:0/1166577263 >> v1:172.21.15.67:6789/0 conn(0x7f608006d440 legacy=0x7f60800c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f6084a00640 1 -- 172.21.15.32:0/1166577263 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60801533f0 con 0x7f60800723b0 2024-01-19T04:17:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.845+0000 7f607fe00640 1 --2- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:15.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6084a00640 1 --2- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60800723b0 0x7f6080152eb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f607001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8a025b731bef1d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f607f400640 1 -- 172.21.15.32:0/1166577263 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700ab620 con 0x7f60800723b0 2024-01-19T04:17:15.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f607f400640 1 -- 172.21.15.32:0/1166577263 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700ab780 con 0x7f60800723b0 2024-01-19T04:17:15.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f607f400640 1 -- 172.21.15.32:0/1166577263 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700abb10 con 0x7f60800723b0 2024-01-19T04:17:15.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 -- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60800723b0 msgr2=0x7f6080152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 --2- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60800723b0 0x7f6080152eb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f607001c420 comp rx=0 tx=0).stop 2024-01-19T04:17:15.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 -- 172.21.15.32:0/1166577263 shutdown_connections 2024-01-19T04:17:15.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 --2- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 --2- 172.21.15.32:0/1166577263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60800723b0 0x7f6080152eb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 -- 172.21.15.32:0/1166577263 >> 172.21.15.32:0/1166577263 conn(0x7f60800c25a0 msgr2=0x7f60800c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:15.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 -- 172.21.15.32:0/1166577263 shutdown_connections 2024-01-19T04:17:15.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.849+0000 7f6087400640 1 -- 172.21.15.32:0/1166577263 wait complete. 2024-01-19T04:17:15.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 Processor -- start 2024-01-19T04:17:15.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 -- start start 2024-01-19T04:17:15.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608006d440 0x7f60800bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60800723b0 0x7f6080146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60801ede20 con 0x7f60800723b0 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60801ed2a0 con 0x7f608006d440 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60801ed580 con 0x7f60800c2080 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60800723b0 0x7f6080146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60800723b0 0x7f6080146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45534/0 (socket says 172.21.15.32:45534) 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 -- 172.21.15.32:0/206245417 learned_addr learned my addr 172.21.15.32:0/206245417 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6084a00640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608006d440 0x7f60800bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6085400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 -- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 msgr2=0x7f6080147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 -- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608006d440 msgr2=0x7f60800bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608006d440 0x7f60800bf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 -- 172.21.15.32:0/206245417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6068009420 con 0x7f60800723b0 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6085400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:15.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607fe00640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60800723b0 0x7f6080146ae0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f606800e930 tx=0x7f606800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607cc00640 1 -- 172.21.15.32:0/206245417 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800ca00 con 0x7f60800723b0 2024-01-19T04:17:15.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607cc00640 1 -- 172.21.15.32:0/206245417 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800cb60 con 0x7f60800723b0 2024-01-19T04:17:15.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60700094d0 con 0x7f60800723b0 2024-01-19T04:17:15.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f607cc00640 1 -- 172.21.15.32:0/206245417 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068013470 con 0x7f60800723b0 2024-01-19T04:17:15.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.853+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60801edb40 con 0x7f60800723b0 2024-01-19T04:17:15.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.857+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60800749f0 con 0x7f60800723b0 2024-01-19T04:17:15.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.857+0000 7f607cc00640 1 -- 172.21.15.32:0/206245417 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f60680135d0 con 0x7f60800723b0 2024-01-19T04:17:15.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.857+0000 7f607cc00640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6058066500 0x7f60580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:15.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.857+0000 7f607cc00640 1 -- 172.21.15.32:0/206245417 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6068084390 con 0x7f60800723b0 2024-01-19T04:17:15.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.857+0000 7f6084a00640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6058066500 0x7f60580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:15.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.857+0000 7f6084a00640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6058066500 0x7f60580689c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f60700af000 tx=0x7f60700b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:15.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:15.861+0000 7f607cc00640 1 -- 172.21.15.32:0/206245417 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6068051380 con 0x7f60800723b0 2024-01-19T04:17:16.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.021+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f608006cc30 con 0x7f60800723b0 2024-01-19T04:17:16.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.021+0000 7f607cc00640 1 -- 172.21.15.32:0/206245417 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7f60680549a0 con 0x7f60800723b0 2024-01-19T04:17:16.025 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6058066500 msgr2=0x7f60580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6058066500 0x7f60580689c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f60700af000 tx=0x7f60700b6040 comp rx=0 tx=0).stop 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60800723b0 msgr2=0x7f6080146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60800723b0 0x7f6080146ae0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f606800e930 tx=0x7f606800edf0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 shutdown_connections 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6058066500 0x7f60580689c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f60800c2080 0x7f6080147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60800723b0 0x7f6080146ae0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 --2- 172.21.15.32:0/206245417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f608006d440 0x7f60800bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 >> 172.21.15.32:0/206245417 conn(0x7f60800c25a0 msgr2=0x7f6080149ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:16.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 shutdown_connections 2024-01-19T04:17:16.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.025+0000 7f6087400640 1 -- 172.21.15.32:0/206245417 wait complete. 2024-01-19T04:17:16.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:17:16.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa81b600640 1 Processor -- start 2024-01-19T04:17:16.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa81b600640 1 -- start start 2024-01-19T04:17:16.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa81b600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa8140c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa81b600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8141524e0 0x7fa814152920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa81b600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140c6cc0 con 0x7fa8140c2820 2024-01-19T04:17:16.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa81b600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa814155a50 con 0x7fa8141524e0 2024-01-19T04:17:16.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa81b600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140c40b0 con 0x7fa8140c6f80 2024-01-19T04:17:16.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa819600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8140c2820 0x7fa8140c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42390/0 (socket says 172.21.15.32:42390) 2024-01-19T04:17:16.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa819600640 1 -- 172.21.15.32:0/609218143 learned_addr learned my addr 172.21.15.32:0/609218143 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa818c00640 1 --2- 172.21.15.32:0/609218143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa8140c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa813e00640 1 --2- 172.21.15.32:0/609218143 >> v2:172.21.15.67:3300/0 conn(0x7fa8141524e0 0x7fa814152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa813400640 1 -- 172.21.15.32:0/609218143 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616994120 0 0) 0x7fa8140c6cc0 con 0x7fa8140c2820 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa813400640 1 -- 172.21.15.32:0/609218143 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f4003530 con 0x7fa8140c2820 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa818c00640 1 -- 172.21.15.32:0/609218143 >> v2:172.21.15.67:3300/0 conn(0x7fa8141524e0 msgr2=0x7fa814152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa818c00640 1 --2- 172.21.15.32:0/609218143 >> v2:172.21.15.67:3300/0 conn(0x7fa8141524e0 0x7fa814152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa818c00640 1 -- 172.21.15.32:0/609218143 >> v1:172.21.15.32:6789/0 conn(0x7fa8140c2820 legacy=0x7fa8140c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.189+0000 7fa818c00640 1 -- 172.21.15.32:0/609218143 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814155d10 con 0x7fa8140c6f80 2024-01-19T04:17:16.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa818c00640 1 --2- 172.21.15.32:0/609218143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa8140c7360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8040097c0 tx=0x7fa80401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd17b4d9ca7a145 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:16.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa813400640 1 -- 172.21.15.32:0/609218143 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040ab650 con 0x7fa8140c6f80 2024-01-19T04:17:16.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa813400640 1 -- 172.21.15.32:0/609218143 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8040ab7b0 con 0x7fa8140c6f80 2024-01-19T04:17:16.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa813400640 1 -- 172.21.15.32:0/609218143 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040abb20 con 0x7fa8140c6f80 2024-01-19T04:17:16.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa81b600640 1 -- 172.21.15.32:0/609218143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 msgr2=0x7fa8140c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa81b600640 1 --2- 172.21.15.32:0/609218143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa8140c7360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8040097c0 tx=0x7fa80401c450 comp rx=0 tx=0).stop 2024-01-19T04:17:16.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa81b600640 1 -- 172.21.15.32:0/609218143 shutdown_connections 2024-01-19T04:17:16.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa81b600640 1 --2- 172.21.15.32:0/609218143 >> v2:172.21.15.67:3300/0 conn(0x7fa8141524e0 0x7fa814152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa81b600640 1 --2- 172.21.15.32:0/609218143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa8140c7360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.193+0000 7fa81b600640 1 -- 172.21.15.32:0/609218143 >> 172.21.15.32:0/609218143 conn(0x7fa8140663f0 msgr2=0x7fa814066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:16.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 -- 172.21.15.32:0/609218143 shutdown_connections 2024-01-19T04:17:16.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 -- 172.21.15.32:0/609218143 wait complete. 2024-01-19T04:17:16.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 Processor -- start 2024-01-19T04:17:16.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 -- start start 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8140c2820 0x7fa81414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa814143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8141524e0 0x7fa8141435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814147d90 con 0x7fa8141524e0 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81414b710 con 0x7fa8140c2820 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa81b600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81406c240 con 0x7fa8140c6f80 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8141524e0 0x7fa8141435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8141524e0 0x7fa8141435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45548/0 (socket says 172.21.15.32:45548) 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 -- 172.21.15.32:0/1540527863 learned_addr learned my addr 172.21.15.32:0/1540527863 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa818c00640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8140c2820 0x7fa81414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa813e00640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa814143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 -- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 msgr2=0x7fa814143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa814143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 -- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8140c2820 msgr2=0x7fa81414aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8140c2820 0x7fa81414aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 -- 172.21.15.32:0/1540527863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009420 con 0x7fa8141524e0 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.197+0000 7fa819600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8141524e0 0x7fa8141435c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00cb40 tx=0x7fa80c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa810c00640 1 -- 172.21.15.32:0/1540527863 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00aca0 con 0x7fa8141524e0 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa810c00640 1 -- 172.21.15.32:0/1540527863 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00ae00 con 0x7fa8141524e0 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa810c00640 1 -- 172.21.15.32:0/1540527863 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c012620 con 0x7fa8141524e0 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81406c520 con 0x7fa8141524e0 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa814148480 con 0x7fa8141524e0 2024-01-19T04:17:16.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8140749f0 con 0x7fa8141524e0 2024-01-19T04:17:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa810c00640 1 -- 172.21.15.32:0/1540527863 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa80c007070 con 0x7fa8141524e0 2024-01-19T04:17:16.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa810c00640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa7ec066500 0x7fa7ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa810c00640 1 -- 172.21.15.32:0/1540527863 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa80c084270 con 0x7fa8141524e0 2024-01-19T04:17:16.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.201+0000 7fa818c00640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa7ec066500 0x7fa7ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.205+0000 7fa818c00640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa7ec066500 0x7fa7ec0689c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa8040af000 tx=0x7fa8040a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:16.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.205+0000 7fa810c00640 1 -- 172.21.15.32:0/1540527863 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa80c0511c0 con 0x7fa8141524e0 2024-01-19T04:17:16.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa81414bb80 con 0x7fa8141524e0 2024-01-19T04:17:16.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa810c00640 1 -- 172.21.15.32:0/1540527863 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa80c0547e0 con 0x7fa8141524e0 2024-01-19T04:17:16.368 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa7ec066500 msgr2=0x7fa7ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa7ec066500 0x7fa7ec0689c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa8040af000 tx=0x7fa8040a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8141524e0 msgr2=0x7fa8141435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8141524e0 0x7fa8141435c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00cb40 tx=0x7fa80c00a060 comp rx=0 tx=0).stop 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 shutdown_connections 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa7ec066500 0x7fa7ec0689c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8141524e0 0x7fa8141435c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8140c6f80 0x7fa814143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 --2- 172.21.15.32:0/1540527863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8140c2820 0x7fa81414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.365+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 >> 172.21.15.32:0/1540527863 conn(0x7fa8140663f0 msgr2=0x7fa8140c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.369+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 shutdown_connections 2024-01-19T04:17:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.369+0000 7fa81b600640 1 -- 172.21.15.32:0/1540527863 wait complete. 2024-01-19T04:17:16.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:17:16.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f206f200640 1 Processor -- start 2024-01-19T04:17:16.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f206f200640 1 -- start start 2024-01-19T04:17:16.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f206f200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c42b0 0x7f20680c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f206f200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20680c0c90 con 0x7f20680c5740 2024-01-19T04:17:16.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f206f200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2068150cb0 con 0x7f20680c1120 2024-01-19T04:17:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f206f200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2068150f90 con 0x7f20680c42b0 2024-01-19T04:17:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f2067400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f20680c5740 0x7f206806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42402/0 (socket says 172.21.15.32:42402) 2024-01-19T04:17:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.529+0000 7f2067400640 1 -- 172.21.15.32:0/1223332398 learned_addr learned my addr 172.21.15.32:0/1223332398 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2067e00640 1 --2- 172.21.15.32:0/1223332398 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c42b0 0x7f20680c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263993936 0 0) 0x7f20680c0c90 con 0x7f20680c5740 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2048003530 con 0x7f20680c5740 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283317402 0 0) 0x7f2068150cb0 con 0x7f20680c1120 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20680c0c90 con 0x7f20680c1120 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 574111482 0 0) 0x7f2048003530 con 0x7f20680c5740 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2067e00640 1 -- 172.21.15.32:0/1223332398 >> v1:172.21.15.67:6789/0 conn(0x7f20680c1120 legacy=0x7f206815b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2067e00640 1 -- 172.21.15.32:0/1223332398 >> v1:172.21.15.32:6789/0 conn(0x7f20680c5740 legacy=0x7f206806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2067e00640 1 -- 172.21.15.32:0/1223332398 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680c0640 con 0x7f20680c42b0 2024-01-19T04:17:16.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2067e00640 1 --2- 172.21.15.32:0/1223332398 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c42b0 0x7f20680c4690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f20580097f0 tx=0x7f205801cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3b75a15661c2250 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:16.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050001680 con 0x7f20680c42b0 2024-01-19T04:17:16.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20580a7050 con 0x7f20680c42b0 2024-01-19T04:17:16.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.533+0000 7f2066a00640 1 -- 172.21.15.32:0/1223332398 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580ab620 con 0x7f20680c42b0 2024-01-19T04:17:16.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- 172.21.15.32:0/1223332398 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c42b0 msgr2=0x7f20680c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 --2- 172.21.15.32:0/1223332398 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c42b0 0x7f20680c4690 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f20580097f0 tx=0x7f205801cd80 comp rx=0 tx=0).stop 2024-01-19T04:17:16.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- 172.21.15.32:0/1223332398 shutdown_connections 2024-01-19T04:17:16.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 --2- 172.21.15.32:0/1223332398 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c42b0 0x7f20680c4690 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- 172.21.15.32:0/1223332398 >> 172.21.15.32:0/1223332398 conn(0x7f20680c5b20 msgr2=0x7f20680c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:16.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- 172.21.15.32:0/1223332398 shutdown_connections 2024-01-19T04:17:16.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- 172.21.15.32:0/1223332398 wait complete. 2024-01-19T04:17:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 Processor -- start 2024-01-19T04:17:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- start start 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20680c1120 0x7f20680bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20680c42b0 0x7f20681f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c5740 0x7f20681f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680a5bb0 con 0x7f20680c1120 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680a5de0 con 0x7f20680c42b0 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f206f200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20680a60c0 con 0x7f20680c5740 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f2067e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20680c1120 0x7f20680bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f2067e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20680c1120 0x7f20680bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45554/0 (socket says 172.21.15.32:45554) 2024-01-19T04:17:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.537+0000 7f2067e00640 1 -- 172.21.15.32:0/3120670337 learned_addr learned my addr 172.21.15.32:0/3120670337 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067400640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20680c42b0 0x7f20681f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f206d200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c5740 0x7f20681f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067e00640 1 -- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c5740 msgr2=0x7f20681f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067e00640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c5740 0x7f20681f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067e00640 1 -- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20680c42b0 msgr2=0x7f20681f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067e00640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20680c42b0 0x7f20681f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067e00640 1 -- 172.21.15.32:0/3120670337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058009420 con 0x7f20680c1120 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f206d200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c5740 0x7f20681f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067400640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20680c42b0 0x7f20681f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:16.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f2067e00640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20680c1120 0x7f20680bf130 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f20580097f0 tx=0x7f205801ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:16.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f205fe00640 1 -- 172.21.15.32:0/3120670337 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058004020 con 0x7f20680c1120 2024-01-19T04:17:16.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f205fe00640 1 -- 172.21.15.32:0/3120670337 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2058004180 con 0x7f20680c1120 2024-01-19T04:17:16.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20680a9760 con 0x7f20680c1120 2024-01-19T04:17:16.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f205fe00640 1 -- 172.21.15.32:0/3120670337 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580044f0 con 0x7f20680c1120 2024-01-19T04:17:16.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20680a9460 con 0x7f20680c1120 2024-01-19T04:17:16.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20680c4eb0 con 0x7f20680c1120 2024-01-19T04:17:16.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.541+0000 7f205fe00640 1 -- 172.21.15.32:0/3120670337 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2058003620 con 0x7f20680c1120 2024-01-19T04:17:16.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.545+0000 7f205fe00640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2040066500 0x7f20400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:16.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.545+0000 7f205fe00640 1 -- 172.21.15.32:0/3120670337 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f205811dc20 con 0x7f20680c1120 2024-01-19T04:17:16.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.545+0000 7f2067400640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2040066500 0x7f20400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:16.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.545+0000 7f2067400640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2040066500 0x7f20400689c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2050001000 tx=0x7f2050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:16.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.545+0000 7f205fe00640 1 -- 172.21.15.32:0/3120670337 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f20580eaa30 con 0x7f20680c1120 2024-01-19T04:17:16.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20680749f0 con 0x7f20680c1120 2024-01-19T04:17:16.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f205fe00640 1 -- 172.21.15.32:0/3120670337 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) v1 ==== 80+0+0 (secure 0 0 0) 0x7f20580b0080 con 0x7f20680c1120 2024-01-19T04:17:16.727 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2040066500 msgr2=0x7f20400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2040066500 0x7f20400689c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2050001000 tx=0x7f2050009040 comp rx=0 tx=0).stop 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20680c1120 msgr2=0x7f20680bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20680c1120 0x7f20680bf130 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f20580097f0 tx=0x7f205801ab60 comp rx=0 tx=0).stop 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 shutdown_connections 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2040066500 0x7f20400689c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f20680c5740 0x7f20681f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20680c42b0 0x7f20681f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 --2- 172.21.15.32:0/3120670337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20680c1120 0x7f20680bf130 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:16.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 >> 172.21.15.32:0/3120670337 conn(0x7f20680c5b20 msgr2=0x7f20680c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:16.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 shutdown_connections 2024-01-19T04:17:16.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:16.725+0000 7f206f200640 1 -- 172.21.15.32:0/3120670337 wait complete. 2024-01-19T04:17:16.749 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-19T04:17:16.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:16.750 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:16.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:17:16.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:16.780 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:17:16.830 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:16.830 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:16.882 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:17:16.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:17:17.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6d2800640 1 Processor -- start 2024-01-19T04:17:17.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6d2800640 1 -- start start 2024-01-19T04:17:17.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6d2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6cc06fda0 0x7fd6cc0c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:17.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6d2800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0c5b40 con 0x7fd6cc06eb70 2024-01-19T04:17:17.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6d2800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0c3fa0 con 0x7fd6cc151f30 2024-01-19T04:17:17.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6d2800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc1551e0 con 0x7fd6cc06fda0 2024-01-19T04:17:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6caa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6cc06fda0 0x7fd6cc0c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6caa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6cc06fda0 0x7fd6cc0c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45560/0 (socket says 172.21.15.32:45560) 2024-01-19T04:17:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6caa00640 1 -- 172.21.15.32:0/3029593270 learned_addr learned my addr 172.21.15.32:0/3029593270 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6caa00640 1 -- 172.21.15.32:0/3029593270 >> v1:172.21.15.67:6789/0 conn(0x7fd6cc151f30 legacy=0x7fd6cc0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6caa00640 1 -- 172.21.15.32:0/3029593270 >> v1:172.21.15.32:6789/0 conn(0x7fd6cc06eb70 legacy=0x7fd6cc06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6caa00640 1 -- 172.21.15.32:0/3029593270 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc155710 con 0x7fd6cc06fda0 2024-01-19T04:17:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.021+0000 7fd6ca000640 1 -- 172.21.15.32:0/3029593270 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118817855 0 0) 0x7fd6cc0c5b40 con 0x7fd6cc06eb70 2024-01-19T04:17:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6caa00640 1 --2- 172.21.15.32:0/3029593270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc0c4b40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009870 tx=0x7fd6b401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9720f3708c1b5695 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6ca000640 1 -- 172.21.15.32:0/3029593270 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40ad680 con 0x7fd6cc06fda0 2024-01-19T04:17:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6ca000640 1 -- 172.21.15.32:0/3029593270 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b40ad7e0 con 0x7fd6cc06fda0 2024-01-19T04:17:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6ca000640 1 -- 172.21.15.32:0/3029593270 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40adb70 con 0x7fd6cc06fda0 2024-01-19T04:17:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6d2800640 1 -- 172.21.15.32:0/3029593270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 msgr2=0x7fd6cc0c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:17.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6d2800640 1 --2- 172.21.15.32:0/3029593270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc0c4b40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009870 tx=0x7fd6b401c470 comp rx=0 tx=0).stop 2024-01-19T04:17:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6d2800640 1 -- 172.21.15.32:0/3029593270 shutdown_connections 2024-01-19T04:17:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6d2800640 1 --2- 172.21.15.32:0/3029593270 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc0c4b40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6d2800640 1 -- 172.21.15.32:0/3029593270 >> 172.21.15.32:0/3029593270 conn(0x7fd6cc0a9870 msgr2=0x7fd6cc0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6d2800640 1 -- 172.21.15.32:0/3029593270 shutdown_connections 2024-01-19T04:17:17.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.025+0000 7fd6d2800640 1 -- 172.21.15.32:0/3029593270 wait complete. 2024-01-19T04:17:17.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 Processor -- start 2024-01-19T04:17:17.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 -- start start 2024-01-19T04:17:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6cc06eb70 0x7fd6cc1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc151f30 0x7fd6cc150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14dfc0 con 0x7fd6cc06fda0 2024-01-19T04:17:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14e2a0 con 0x7fd6cc151f30 2024-01-19T04:17:17.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc14e580 con 0x7fd6cc06eb70 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45572/0 (socket says 172.21.15.32:45572) 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 -- 172.21.15.32:0/2600665902 learned_addr learned my addr 172.21.15.32:0/2600665902 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6cb400640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6cc06eb70 0x7fd6cc1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6cbe00640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc151f30 0x7fd6cc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 -- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6cc06eb70 msgr2=0x7fd6cc1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6cc06eb70 0x7fd6cc1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 -- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc151f30 msgr2=0x7fd6cc150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc151f30 0x7fd6cc150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 -- 172.21.15.32:0/2600665902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40094d0 con 0x7fd6cc06fda0 2024-01-19T04:17:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6caa00640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc150440 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd6b401a0a0 tx=0x7fd6b401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6c3400640 1 -- 172.21.15.32:0/2600665902 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40b8420 con 0x7fd6cc06fda0 2024-01-19T04:17:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6c3400640 1 -- 172.21.15.32:0/2600665902 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b40b85a0 con 0x7fd6cc06fda0 2024-01-19T04:17:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc14e860 con 0x7fd6cc06fda0 2024-01-19T04:17:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6c3400640 1 -- 172.21.15.32:0/2600665902 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40b8950 con 0x7fd6cc06fda0 2024-01-19T04:17:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.029+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc154a00 con 0x7fd6cc06fda0 2024-01-19T04:17:17.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.033+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc0749f0 con 0x7fd6cc06fda0 2024-01-19T04:17:17.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.033+0000 7fd6c3400640 1 -- 172.21.15.32:0/2600665902 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd6b40b4040 con 0x7fd6cc06fda0 2024-01-19T04:17:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.033+0000 7fd6c3400640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6a4066500 0x7fd6a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.033+0000 7fd6c3400640 1 -- 172.21.15.32:0/2600665902 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd6b411e610 con 0x7fd6cc06fda0 2024-01-19T04:17:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.033+0000 7fd6cb400640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6a4066500 0x7fd6a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.033+0000 7fd6cb400640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6a4066500 0x7fd6a40689c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0098e0 tx=0x7fd6bc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:17.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.037+0000 7fd6c3400640 1 -- 172.21.15.32:0/2600665902 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd6b40eb710 con 0x7fd6cc06fda0 2024-01-19T04:17:17.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.233+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6cc067b80 con 0x7fd6cc06fda0 2024-01-19T04:17:17.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.233+0000 7fd6c3400640 1 -- 172.21.15.32:0/2600665902 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd6b40eed30 con 0x7fd6cc06fda0 2024-01-19T04:17:17.236 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:17:17.237 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-19T04:17:17.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6a4066500 msgr2=0x7fd6a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:17.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6a4066500 0x7fd6a40689c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0098e0 tx=0x7fd6bc009060 comp rx=0 tx=0).stop 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 msgr2=0x7fd6cc150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc150440 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd6b401a0a0 tx=0x7fd6b401acb0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 shutdown_connections 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd6a4066500 0x7fd6a40689c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd6cc151f30 0x7fd6cc150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6cc06fda0 0x7fd6cc150440 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 --2- 172.21.15.32:0/2600665902 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd6cc06eb70 0x7fd6cc1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 >> 172.21.15.32:0/2600665902 conn(0x7fd6cc0a9870 msgr2=0x7fd6cc0a8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 shutdown_connections 2024-01-19T04:17:17.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:17.237+0000 7fd6d2800640 1 -- 172.21.15.32:0/2600665902 wait complete. 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:17:17.258 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:17:17.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.259 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:17:17.268 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:17:17.268 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:17.269 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42329sec preferred_lft 42329sec 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:17:17.270 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:17.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.271 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:17:17.332 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:17:17.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.335 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:17:17.391 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:17:17.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.393 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:17:17.393 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:17:17.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:17:17.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:17:17.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:17:17.393 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:17:17.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.486 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:17:17.495 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:17:17.495 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:17:17.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:17:17.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:17.557 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:17.609 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:17:17.609 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:17.609 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:17.661 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2024-01-19T04:17:17.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:17.757 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:17.758 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:17.771 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:17.771 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:17.771 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:17:17.771 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs2=/ 2024-01-19T04:17:17.771 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:17:17.774 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:17:17.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:17.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:17.796 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:17:17.860 INFO:teuthology.orchestra.run.smithi067.stdout:client5516 2024-01-19T04:17:17.860 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:17.860 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:17.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2024-01-19T04:17:18.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee3400640 1 Processor -- start 2024-01-19T04:17:18.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee3400640 1 -- start start 2024-01-19T04:17:18.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 0x7f1edc06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee3400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc0c6470 con 0x7f1edc1565d0 2024-01-19T04:17:18.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee3400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc0c6ff0 con 0x7f1edc0c3230 2024-01-19T04:17:18.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0c3b40 con 0x7f1edc0c3690 2024-01-19T04:17:18.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee0a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1edc1565d0 0x7f1edc0c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59850/0 (socket says 172.21.15.32:59850) 2024-01-19T04:17:18.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee0a00640 1 -- 172.21.15.32:0/749736355 learned_addr learned my addr 172.21.15.32:0/749736355 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:18.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1ee1400640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 0x7f1edc06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658240765 0 0) 0x7f1edc0c6470 con 0x7f1edc1565d0 2024-01-19T04:17:18.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ebc003530 con 0x7f1edc1565d0 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428798567 0 0) 0x7f1edc0c6ff0 con 0x7f1edc0c3230 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1edc0c6470 con 0x7f1edc0c3230 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519253805 0 0) 0x7f1ebc003530 con 0x7f1edc1565d0 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 msgr2=0x7f1edc06f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 0x7f1edc06f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 >> v1:172.21.15.67:6789/0 conn(0x7f1edc0c3230 legacy=0x7f1edc06eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc0c88a0 con 0x7f1edc1565d0 2024-01-19T04:17:18.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f1ecc001680 con 0x7f1edc1565d0 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.065+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 >> v1:172.21.15.32:6789/0 conn(0x7f1edc1565d0 legacy=0x7f1edc0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edb400640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc003b40 0x7f1ebc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edb400640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1ebc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edb400640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 0x7f1ebc0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0c3b40 con 0x7f1ebc0047d0 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc00bad0 con 0x7f1ebc003b40 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc00bc90 con 0x7f1edc0c3690 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edbe00640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1ebc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1ee1400640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 0x7f1ebc0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1ee0a00640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc003b40 0x7f1ebc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edbe00640 1 -- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 msgr2=0x7f1ebc0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edbe00640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0c3690 0x7f1ebc0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edbe00640 1 -- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc003b40 msgr2=0x7f1ebc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edbe00640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ebc003b40 0x7f1ebc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edbe00640 1 -- 172.21.15.32:0/749736355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc003530 con 0x7f1ebc0047d0 2024-01-19T04:17:18.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.069+0000 7f1edbe00640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1ebc004c50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0c5980 tx=0x7f1ec401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b0580ba00854eb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:18.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40052d0 con 0x7f1ebc0047d0 2024-01-19T04:17:18.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4005450 con 0x7f1ebc0047d0 2024-01-19T04:17:18.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1edb400640 1 -- 172.21.15.32:0/749736355 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4003840 con 0x7f1ebc0047d0 2024-01-19T04:17:18.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- 172.21.15.32:0/749736355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 msgr2=0x7f1ebc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 --2- 172.21.15.32:0/749736355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1ebc004c50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0c5980 tx=0x7f1ec401c540 comp rx=0 tx=0).stop 2024-01-19T04:17:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee1400640 1 -- 172.21.15.32:0/749736355 reap_dead start 2024-01-19T04:17:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- 172.21.15.32:0/749736355 shutdown_connections 2024-01-19T04:17:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- 172.21.15.32:0/749736355 >> 172.21.15.32:0/749736355 conn(0x7f1edc0726d0 msgr2=0x7f1edc0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- 172.21.15.32:0/749736355 shutdown_connections 2024-01-19T04:17:18.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- 172.21.15.32:0/749736355 wait complete. 2024-01-19T04:17:18.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 Processor -- start 2024-01-19T04:17:18.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- start start 2024-01-19T04:17:18.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1edc0a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0ac980 0x7f1edc06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc0a9300 0x7f1edc06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc06c3d0 con 0x7f1ebc0047d0 2024-01-19T04:17:18.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc1f06d0 con 0x7f1edc0a9300 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.073+0000 7f1ee3400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc1f09b0 con 0x7f1edc0ac980 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1edc0a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1edc0a8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33692/0 (socket says 172.21.15.32:33692) 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 -- 172.21.15.32:0/2846488478 learned_addr learned my addr 172.21.15.32:0/2846488478 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1edbe00640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0ac980 0x7f1edc06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee1400640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc0a9300 0x7f1edc06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 -- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0ac980 msgr2=0x7f1edc06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0ac980 0x7f1edc06c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 -- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc0a9300 msgr2=0x7f1edc06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc0a9300 0x7f1edc06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 -- 172.21.15.32:0/2846488478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc1f0c90 con 0x7f1ebc0047d0 2024-01-19T04:17:18.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee0a00640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1edc0a8dc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc004f50 tx=0x7f1ecc0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:18.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ed8c00640 1 -- 172.21.15.32:0/2846488478 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0010c0 con 0x7f1ebc0047d0 2024-01-19T04:17:18.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ed8c00640 1 -- 172.21.15.32:0/2846488478 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc007740 con 0x7f1ebc0047d0 2024-01-19T04:17:18.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ed8c00640 1 -- 172.21.15.32:0/2846488478 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00fb80 con 0x7f1ebc0047d0 2024-01-19T04:17:18.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc1f0f70 con 0x7f1ebc0047d0 2024-01-19T04:17:18.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc150f60 con 0x7f1ebc0047d0 2024-01-19T04:17:18.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc0c2590 con 0x7f1ebc0047d0 2024-01-19T04:17:18.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ed8c00640 1 -- 172.21.15.32:0/2846488478 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1ecc00fce0 con 0x7f1ebc0047d0 2024-01-19T04:17:18.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.077+0000 7f1ed8c00640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1eb4066500 0x7f1eb40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.081+0000 7f1ed8c00640 1 -- 172.21.15.32:0/2846488478 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1ecc0841e0 con 0x7f1ebc0047d0 2024-01-19T04:17:18.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.081+0000 7f1edbe00640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1eb4066500 0x7f1eb40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.081+0000 7f1edbe00640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1eb4066500 0x7f1eb40689c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40ad000 tx=0x7f1ec40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:18.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.085+0000 7f1ed8c00640 1 -- 172.21.15.32:0/2846488478 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1ecc051130 con 0x7f1ebc0047d0 2024-01-19T04:17:18.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.301+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f1edc0749f0 con 0x7f1ebc0047d0 2024-01-19T04:17:18.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.305+0000 7f1ed8c00640 1 -- 172.21.15.32:0/2846488478 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f1ecc054750 con 0x7f1ebc0047d0 2024-01-19T04:17:18.308 INFO:teuthology.orchestra.run.smithi032.stderr:added key for client.testuser 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1eb4066500 msgr2=0x7f1eb40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1eb4066500 0x7f1eb40689c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40ad000 tx=0x7f1ec40a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 msgr2=0x7f1edc0a8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1edc0a8dc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc004f50 tx=0x7f1ecc0074f0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 shutdown_connections 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1eb4066500 0x7f1eb40689c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc0a9300 0x7f1edc06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1edc0ac980 0x7f1edc06c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 --2- 172.21.15.32:0/2846488478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ebc0047d0 0x7f1edc0a8dc0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 >> 172.21.15.32:0/2846488478 conn(0x7f1edc0726d0 msgr2=0x7f1edc15b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 shutdown_connections 2024-01-19T04:17:18.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.309+0000 7f1ee3400640 1 -- 172.21.15.32:0/2846488478 wait complete. 2024-01-19T04:17:18.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2024-01-19T04:17:18.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.469+0000 7f61ebc00640 1 Processor -- start 2024-01-19T04:17:18.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.469+0000 7f61ebc00640 1 -- start start 2024-01-19T04:17:18.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 0x7f61e40c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61ebc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e40c6470 con 0x7f61e41565d0 2024-01-19T04:17:18.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61ebc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e40c6ff0 con 0x7f61e406eeb0 2024-01-19T04:17:18.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61ebc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c88a0 con 0x7f61e40c3230 2024-01-19T04:17:18.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f61e41565d0 0x7f61e40c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59852/0 (socket says 172.21.15.32:59852) 2024-01-19T04:17:18.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 -- 172.21.15.32:0/1699052544 learned_addr learned my addr 172.21.15.32:0/1699052544 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:18.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3e00640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 0x7f61e40c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591571803 0 0) 0x7f61e40c6470 con 0x7f61e41565d0 2024-01-19T04:17:18.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c4003530 con 0x7f61e41565d0 2024-01-19T04:17:18.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104380812 0 0) 0x7f61e40c6ff0 con 0x7f61e406eeb0 2024-01-19T04:17:18.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e40c6470 con 0x7f61e406eeb0 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596025122 0 0) 0x7f61c4003530 con 0x7f61e41565d0 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 msgr2=0x7f61e40c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 0x7f61e40c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 >> v1:172.21.15.67:6789/0 conn(0x7f61e406eeb0 legacy=0x7f61e406f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40c66c0 con 0x7f61e41565d0 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f61d4001680 con 0x7f61e41565d0 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 >> v1:172.21.15.32:6789/0 conn(0x7f61e41565d0 legacy=0x7f61e40c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61c4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 0x7f61c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c4004d10 0x7f61c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c88a0 con 0x7f61c4003b40 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c400bb20 con 0x7f61c4004d10 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40100c0 con 0x7f61e40c3230 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61c4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e3e00640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 0x7f61c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9c00640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c4004d10 0x7f61c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 -- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 msgr2=0x7f61c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:18.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40c3230 0x7f61c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 -- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c4004d10 msgr2=0x7f61c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:18.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61c4004d10 0x7f61c4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.473+0000 7f61e9200640 1 -- 172.21.15.32:0/1699052544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4003530 con 0x7f61c4003b40 2024-01-19T04:17:18.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61e9200640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61c4003f40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c0e0 tx=0x7f61d401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8df9b085d084a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:18.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4005ae0 con 0x7f61c4003b40 2024-01-19T04:17:18.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4005c60 con 0x7f61c4003b40 2024-01-19T04:17:18.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61e3400640 1 -- 172.21.15.32:0/1699052544 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40a57c0 con 0x7f61c4003b40 2024-01-19T04:17:18.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61ebc00640 1 -- 172.21.15.32:0/1699052544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 msgr2=0x7f61c4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61ebc00640 1 --2- 172.21.15.32:0/1699052544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61c4003f40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c0e0 tx=0x7f61d401cae0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61e9c00640 1 -- 172.21.15.32:0/1699052544 reap_dead start 2024-01-19T04:17:18.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61ebc00640 1 -- 172.21.15.32:0/1699052544 shutdown_connections 2024-01-19T04:17:18.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61ebc00640 1 -- 172.21.15.32:0/1699052544 >> 172.21.15.32:0/1699052544 conn(0x7f61e40726d0 msgr2=0x7f61e40663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:18.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61ebc00640 1 -- 172.21.15.32:0/1699052544 shutdown_connections 2024-01-19T04:17:18.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61ebc00640 1 -- 172.21.15.32:0/1699052544 wait complete. 2024-01-19T04:17:18.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.477+0000 7f61ebc00640 1 Processor -- start 2024-01-19T04:17:18.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 -- start start 2024-01-19T04:17:18.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61e41e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61e414e390 0x7f61e414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40ab140 0x7f61e40ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40bd4a0 con 0x7f61c4003b40 2024-01-19T04:17:18.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41e97f0 con 0x7f61e414e390 2024-01-19T04:17:18.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41e9ad0 con 0x7f61e40ab140 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61e41e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61e41e9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33704/0 (socket says 172.21.15.32:33704) 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 -- 172.21.15.32:0/910963055 learned_addr learned my addr 172.21.15.32:0/910963055 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9c00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40ab140 0x7f61e40ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e3e00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61e414e390 0x7f61e414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 -- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40ab140 msgr2=0x7f61e40ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40ab140 0x7f61e40ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 -- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61e414e390 msgr2=0x7f61e414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61e414e390 0x7f61e414f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 -- 172.21.15.32:0/910963055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e41e9db0 con 0x7f61c4003b40 2024-01-19T04:17:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e9200640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61e41e9210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f61d401c910 tx=0x7f61c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e0c00640 1 -- 172.21.15.32:0/910963055 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40b4070 con 0x7f61c4003b40 2024-01-19T04:17:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e0c00640 1 -- 172.21.15.32:0/910963055 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4005dd0 con 0x7f61c4003b40 2024-01-19T04:17:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e41ea090 con 0x7f61c4003b40 2024-01-19T04:17:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61e0c00640 1 -- 172.21.15.32:0/910963055 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40a57c0 con 0x7f61c4003b40 2024-01-19T04:17:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e40abb00 con 0x7f61c4003b40 2024-01-19T04:17:18.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.481+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e40c2590 con 0x7f61c4003b40 2024-01-19T04:17:18.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.485+0000 7f61e0c00640 1 -- 172.21.15.32:0/910963055 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f61d40a5920 con 0x7f61c4003b40 2024-01-19T04:17:18.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.485+0000 7f61e0c00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61bc066500 0x7f61bc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:18.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.485+0000 7f61e0c00640 1 -- 172.21.15.32:0/910963055 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f61d411da80 con 0x7f61c4003b40 2024-01-19T04:17:18.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.485+0000 7f61e3e00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61bc066500 0x7f61bc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:18.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.485+0000 7f61e3e00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61bc066500 0x7f61bc0689c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f61e414e890 tx=0x7f61cc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:18.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.489+0000 7f61e0c00640 1 -- 172.21.15.32:0/910963055 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f61d40ea9d0 con 0x7f61c4003b40 2024-01-19T04:17:18.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.705+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f61e40749f0 con 0x7f61c4003b40 2024-01-19T04:17:18.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.705+0000 7f61e0c00640 1 -- 172.21.15.32:0/910963055 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7f61d40edff0 con 0x7f61c4003b40 2024-01-19T04:17:18.709 INFO:teuthology.orchestra.run.smithi032.stdout:[client.testuser] 2024-01-19T04:17:18.710 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDO96llVEZQEhAAxN/8Vv61apt/Z/rdKj0r0g== 2024-01-19T04:17:18.710 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow rw fsname=cephfs" 2024-01-19T04:17:18.710 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2024-01-19T04:17:18.710 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-01-19T04:17:18.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61bc066500 msgr2=0x7f61bc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61bc066500 0x7f61bc0689c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f61e414e890 tx=0x7f61cc009190 comp rx=0 tx=0).stop 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 msgr2=0x7f61e41e9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61e41e9210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f61d401c910 tx=0x7f61c4005800 comp rx=0 tx=0).stop 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 shutdown_connections 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f61bc066500 0x7f61bc0689c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61e40ab140 0x7f61e40ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61e414e390 0x7f61e414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 --2- 172.21.15.32:0/910963055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61c4003b40 0x7f61e41e9210 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 >> 172.21.15.32:0/910963055 conn(0x7f61e40726d0 msgr2=0x7f61e4152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 shutdown_connections 2024-01-19T04:17:18.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:18.709+0000 7f61ebc00640 1 -- 172.21.15.32:0/910963055 wait complete. 2024-01-19T04:17:18.732 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-01-19T04:17:18.740 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.1fx3RFQBnT 2024-01-19T04:17:18.741 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:18.741 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/tmp/tmp.1fx3RFQBnT 2024-01-19T04:17:18.794 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:18.794 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:18.846 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:18.846 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:18.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1aaa00640 1 Processor -- start 2024-01-19T04:17:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1aaa00640 1 -- start start 2024-01-19T04:17:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1aaa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1a40c5740 0x7fc1a40c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1aaa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a40c0c90 con 0x7fc1a40c1120 2024-01-19T04:17:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1aaa00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a4150cb0 con 0x7fc1a40c42b0 2024-01-19T04:17:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1aaa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a4150f90 con 0x7fc1a40c5740 2024-01-19T04:17:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1a3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1a40c5740 0x7fc1a40c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1a3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc1a40c5740 0x7fc1a40c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33712/0 (socket says 172.21.15.32:33712) 2024-01-19T04:17:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1a3400640 1 -- 172.21.15.32:0/838648485 learned_addr learned my addr 172.21.15.32:0/838648485 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1a8a00640 1 --1- 172.21.15.32:0/838648485 >> v1:172.21.15.32:6789/0 conn(0x7fc1a40c1120 0x7fc1a415b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59860/0 (socket says 172.21.15.32:59860) 2024-01-19T04:17:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1a3400640 1 -- 172.21.15.32:0/838648485 >> v1:172.21.15.67:6789/0 conn(0x7fc1a40c42b0 legacy=0x7fc1a406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1a3400640 1 -- 172.21.15.32:0/838648485 >> v1:172.21.15.32:6789/0 conn(0x7fc1a40c1120 legacy=0x7fc1a415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.081+0000 7fc1a3400640 1 -- 172.21.15.32:0/838648485 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40c0640 con 0x7fc1a40c5740 2024-01-19T04:17:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1a3400640 1 --2- 172.21.15.32:0/838648485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c5740 0x7fc1a40c4690 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c01dff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9047c7a071e0db server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1a2a00640 1 -- 172.21.15.32:0/838648485 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0aa400 con 0x7fc1a40c5740 2024-01-19T04:17:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1a2a00640 1 -- 172.21.15.32:0/838648485 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c0aa560 con 0x7fc1a40c5740 2024-01-19T04:17:19.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1a2a00640 1 -- 172.21.15.32:0/838648485 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0aa8f0 con 0x7fc1a40c5740 2024-01-19T04:17:19.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1aaa00640 1 -- 172.21.15.32:0/838648485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c5740 msgr2=0x7fc1a40c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/838648485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c5740 0x7fc1a40c4690 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c01dff0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1aaa00640 1 -- 172.21.15.32:0/838648485 shutdown_connections 2024-01-19T04:17:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/838648485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c5740 0x7fc1a40c4690 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1aaa00640 1 -- 172.21.15.32:0/838648485 >> 172.21.15.32:0/838648485 conn(0x7fc1a40c5b20 msgr2=0x7fc1a40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1aaa00640 1 -- 172.21.15.32:0/838648485 shutdown_connections 2024-01-19T04:17:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.085+0000 7fc1aaa00640 1 -- 172.21.15.32:0/838648485 wait complete. 2024-01-19T04:17:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 Processor -- start 2024-01-19T04:17:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 -- start start 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1a40c1120 0x7fc1a41f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c42b0 0x7fc1a4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a40c5740 0x7fc1a4153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4070f90 con 0x7fc1a40c42b0 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a40717f0 con 0x7fc1a40c1120 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a41f0f60 con 0x7fc1a40c5740 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c42b0 0x7fc1a4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c42b0 0x7fc1a4152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33728/0 (socket says 172.21.15.32:33728) 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 -- 172.21.15.32:0/4211636704 learned_addr learned my addr 172.21.15.32:0/4211636704 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a8a00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a40c5740 0x7fc1a4153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3e00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1a40c1120 0x7fc1a41f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 -- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a40c5740 msgr2=0x7fc1a4153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a40c5740 0x7fc1a4153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 -- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1a40c1120 msgr2=0x7fc1a41f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1a40c1120 0x7fc1a41f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 -- 172.21.15.32:0/4211636704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0094d0 con 0x7fc1a40c42b0 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3e00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1a40c1120 0x7fc1a41f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1a3400640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c42b0 0x7fc1a4152c10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc18c01a1a0 tx=0x7fc18c01bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc19be00640 1 -- 172.21.15.32:0/4211636704 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0b2800 con 0x7fc1a40c42b0 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc19be00640 1 -- 172.21.15.32:0/4211636704 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c0b6070 con 0x7fc1a40c42b0 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc19be00640 1 -- 172.21.15.32:0/4211636704 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0b2b80 con 0x7fc1a40c42b0 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a40711a0 con 0x7fc1a40c42b0 2024-01-19T04:17:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a4071c80 con 0x7fc1a40c42b0 2024-01-19T04:17:19.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.089+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4071980 con 0x7fc1a40c42b0 2024-01-19T04:17:19.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.093+0000 7fc19be00640 1 -- 172.21.15.32:0/4211636704 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc18c0b2ce0 con 0x7fc1a40c42b0 2024-01-19T04:17:19.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.093+0000 7fc19be00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc17c066500 0x7fc17c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.093+0000 7fc19be00640 1 -- 172.21.15.32:0/4211636704 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc18c11e6d0 con 0x7fc1a40c42b0 2024-01-19T04:17:19.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.093+0000 7fc1a3e00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc17c066500 0x7fc17c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.093+0000 7fc1a3e00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc17c066500 0x7fc17c0689c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc194000f70 tx=0x7fc194009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.097+0000 7fc19be00640 1 -- 172.21.15.32:0/4211636704 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc18c0eb720 con 0x7fc1a40c42b0 2024-01-19T04:17:19.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.265+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1a40c4eb0 con 0x7fc1a40c42b0 2024-01-19T04:17:19.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc19be00640 1 -- 172.21.15.32:0/4211636704 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20185 (secure 0 0 0) 0x7fc18c0a7030 con 0x7fc1a40c42b0 2024-01-19T04:17:19.271 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:19.271 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":57,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:05.701251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:19.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc17c066500 msgr2=0x7fc17c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc17c066500 0x7fc17c0689c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc194000f70 tx=0x7fc194009040 comp rx=0 tx=0).stop 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c42b0 msgr2=0x7fc1a4152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c42b0 0x7fc1a4152c10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc18c01a1a0 tx=0x7fc18c01bdd0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 shutdown_connections 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc17c066500 0x7fc17c0689c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc1a40c5740 0x7fc1a4153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a40c42b0 0x7fc1a4152c10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 --2- 172.21.15.32:0/4211636704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1a40c1120 0x7fc1a41f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 >> 172.21.15.32:0/4211636704 conn(0x7fc1a40c5b20 msgr2=0x7fc1a40c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:19.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 shutdown_connections 2024-01-19T04:17:19.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.269+0000 7fc1aaa00640 1 -- 172.21.15.32:0/4211636704 wait complete. 2024-01-19T04:17:19.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:16:48.753748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:16:49.947198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:17:02.181700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:17:03.077640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:19.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:19.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.433+0000 7febdc400640 1 Processor -- start 2024-01-19T04:17:19.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.433+0000 7febdc400640 1 -- start start 2024-01-19T04:17:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febdc400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febdc400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febd40705b0 0x7febd415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febdc400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40c0eb0 con 0x7febd40c55d0 2024-01-19T04:17:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febdc400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd406e5c0 con 0x7febd40705b0 2024-01-19T04:17:19.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febdc400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40a5330 con 0x7febd406cab0 2024-01-19T04:17:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febda400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febd40705b0 0x7febd415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febd9a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febda400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7febd40705b0 0x7febd415b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:49504/0 (socket says 172.21.15.32:49504) 2024-01-19T04:17:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febda400640 1 -- 172.21.15.32:0/939001211 learned_addr learned my addr 172.21.15.32:0/939001211 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febda400640 1 -- 172.21.15.32:0/939001211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 msgr2=0x7febd406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:19.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febda400640 1 --2- 172.21.15.32:0/939001211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febda400640 1 -- 172.21.15.32:0/939001211 >> v1:172.21.15.67:6789/0 conn(0x7febd40c55d0 legacy=0x7febd40c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.437+0000 7febda400640 1 -- 172.21.15.32:0/939001211 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd41516f0 con 0x7febd40705b0 2024-01-19T04:17:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febda400640 1 --2- 172.21.15.32:0/939001211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 0x7febd415b4b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e50 tx=0x7febcc01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99348bdb2cc428a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febd3e00640 1 -- 172.21.15.32:0/939001211 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0a58a0 con 0x7febd40705b0 2024-01-19T04:17:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febd3e00640 1 -- 172.21.15.32:0/939001211 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc0a5a00 con 0x7febd40705b0 2024-01-19T04:17:19.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febd3e00640 1 -- 172.21.15.32:0/939001211 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0a5d90 con 0x7febd40705b0 2024-01-19T04:17:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 -- 172.21.15.32:0/939001211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 msgr2=0x7febd415b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 --2- 172.21.15.32:0/939001211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 0x7febd415b4b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e50 tx=0x7febcc01c9e0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 -- 172.21.15.32:0/939001211 shutdown_connections 2024-01-19T04:17:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 --2- 172.21.15.32:0/939001211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 0x7febd415b4b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 --2- 172.21.15.32:0/939001211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 -- 172.21.15.32:0/939001211 >> 172.21.15.32:0/939001211 conn(0x7febd40c25a0 msgr2=0x7febd40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:19.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 -- 172.21.15.32:0/939001211 shutdown_connections 2024-01-19T04:17:19.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 -- 172.21.15.32:0/939001211 wait complete. 2024-01-19T04:17:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 Processor -- start 2024-01-19T04:17:19.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.441+0000 7febdc400640 1 -- start start 2024-01-19T04:17:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd41ee730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 0x7febd4154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febd40c55d0 0x7febd4144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd41eec70 con 0x7febd40c55d0 2024-01-19T04:17:19.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd4153ee0 con 0x7febd40705b0 2024-01-19T04:17:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40a8a60 con 0x7febd406cab0 2024-01-19T04:17:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febd40c55d0 0x7febd4144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febd40c55d0 0x7febd4144ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33730/0 (socket says 172.21.15.32:33730) 2024-01-19T04:17:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 -- 172.21.15.32:0/49667344 learned_addr learned my addr 172.21.15.32:0/49667344 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febd9a00640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd41ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febd9000640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 0x7febd4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 -- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 msgr2=0x7febd41ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd41ee730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 -- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 msgr2=0x7febd4154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 0x7febd4154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 -- 172.21.15.32:0/49667344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc009b30 con 0x7febd40c55d0 2024-01-19T04:17:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febda400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febd40c55d0 0x7febd4144ac0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7febcc01a610 tx=0x7febcc019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febd1600640 1 -- 172.21.15.32:0/49667344 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0b8670 con 0x7febd40c55d0 2024-01-19T04:17:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febd1600640 1 -- 172.21.15.32:0/49667344 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc0b87d0 con 0x7febd40c55d0 2024-01-19T04:17:19.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febd1600640 1 -- 172.21.15.32:0/49667344 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0b8b80 con 0x7febd40c55d0 2024-01-19T04:17:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd40a8d40 con 0x7febd40c55d0 2024-01-19T04:17:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd4153b70 con 0x7febd40c55d0 2024-01-19T04:17:19.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd4154050 con 0x7febd40c55d0 2024-01-19T04:17:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.445+0000 7febd1600640 1 -- 172.21.15.32:0/49667344 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7febcc0b8ce0 con 0x7febd40c55d0 2024-01-19T04:17:19.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.449+0000 7febd1600640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febac066500 0x7febac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.449+0000 7febd1600640 1 -- 172.21.15.32:0/49667344 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7febcc11f6b0 con 0x7febd40c55d0 2024-01-19T04:17:19.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.449+0000 7febd9a00640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febac066500 0x7febac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.449+0000 7febd9a00640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febac066500 0x7febac0689c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7febc4009b60 tx=0x7febc4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.453+0000 7febd1600640 1 -- 172.21.15.32:0/49667344 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7febcc0ec860 con 0x7febd40c55d0 2024-01-19T04:17:19.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febd40749f0 con 0x7febd40c55d0 2024-01-19T04:17:19.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febd1600640 1 -- 172.21.15.32:0/49667344 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7febcc0efe80 con 0x7febd40c55d0 2024-01-19T04:17:19.615 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febac066500 msgr2=0x7febac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febac066500 0x7febac0689c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7febc4009b60 tx=0x7febc4009190 comp rx=0 tx=0).stop 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febd40c55d0 msgr2=0x7febd4144ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febd40c55d0 0x7febd4144ac0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7febcc01a610 tx=0x7febcc019780 comp rx=0 tx=0).stop 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 shutdown_connections 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febac066500 0x7febac0689c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febd40c55d0 0x7febd4144ac0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febd40705b0 0x7febd4154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 --2- 172.21.15.32:0/49667344 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7febd406cab0 0x7febd41ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 >> 172.21.15.32:0/49667344 conn(0x7febd40c25a0 msgr2=0x7febd40c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:19.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 shutdown_connections 2024-01-19T04:17:19.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.613+0000 7febdc400640 1 -- 172.21.15.32:0/49667344 wait complete. 2024-01-19T04:17:19.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:17:19.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce93c00640 1 Processor -- start 2024-01-19T04:17:19.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce93c00640 1 -- start start 2024-01-19T04:17:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce93c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fce8c157cc0 0x7fce8c0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce93c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c0c2d30 con 0x7fce8c151b80 2024-01-19T04:17:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce93c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c0c3010 con 0x7fce8c155150 2024-01-19T04:17:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce93c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c0c34a0 con 0x7fce8c157cc0 2024-01-19T04:17:19.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce91200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fce8c151b80 0x7fce8c0c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59864/0 (socket says 172.21.15.32:59864) 2024-01-19T04:17:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce91200640 1 -- 172.21.15.32:0/1853351844 learned_addr learned my addr 172.21.15.32:0/1853351844 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.781+0000 7fce91c00640 1 --2- 172.21.15.32:0/1853351844 >> v2:172.21.15.67:3300/0 conn(0x7fce8c157cc0 0x7fce8c0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce8b400640 1 -- 172.21.15.32:0/1853351844 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185183937 0 0) 0x7fce8c0c2d30 con 0x7fce8c151b80 2024-01-19T04:17:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce8b400640 1 -- 172.21.15.32:0/1853351844 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6c003530 con 0x7fce8c151b80 2024-01-19T04:17:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce8b400640 1 -- 172.21.15.32:0/1853351844 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585821269 0 0) 0x7fce8c0c3010 con 0x7fce8c155150 2024-01-19T04:17:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce8b400640 1 -- 172.21.15.32:0/1853351844 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce8c0c2d30 con 0x7fce8c155150 2024-01-19T04:17:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce91c00640 1 -- 172.21.15.32:0/1853351844 >> v1:172.21.15.67:6789/0 conn(0x7fce8c155150 legacy=0x7fce8c0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce91c00640 1 -- 172.21.15.32:0/1853351844 >> v1:172.21.15.32:6789/0 conn(0x7fce8c151b80 legacy=0x7fce8c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce91c00640 1 -- 172.21.15.32:0/1853351844 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0c7700 con 0x7fce8c157cc0 2024-01-19T04:17:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce91c00640 1 --2- 172.21.15.32:0/1853351844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c157cc0 0x7fce8c0c6a70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce84009d90 tx=0x7fce8401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b0d176a84d2fe0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce8b400640 1 -- 172.21.15.32:0/1853351844 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840a5810 con 0x7fce8c157cc0 2024-01-19T04:17:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce8b400640 1 -- 172.21.15.32:0/1853351844 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840a5970 con 0x7fce8c157cc0 2024-01-19T04:17:19.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.785+0000 7fce8b400640 1 -- 172.21.15.32:0/1853351844 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840a5d00 con 0x7fce8c157cc0 2024-01-19T04:17:19.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- 172.21.15.32:0/1853351844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c157cc0 msgr2=0x7fce8c0c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 --2- 172.21.15.32:0/1853351844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c157cc0 0x7fce8c0c6a70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce84009d90 tx=0x7fce8401c950 comp rx=0 tx=0).stop 2024-01-19T04:17:19.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- 172.21.15.32:0/1853351844 shutdown_connections 2024-01-19T04:17:19.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 --2- 172.21.15.32:0/1853351844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c157cc0 0x7fce8c0c6a70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- 172.21.15.32:0/1853351844 >> 172.21.15.32:0/1853351844 conn(0x7fce8c0c7d40 msgr2=0x7fce8c0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:19.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- 172.21.15.32:0/1853351844 shutdown_connections 2024-01-19T04:17:19.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- 172.21.15.32:0/1853351844 wait complete. 2024-01-19T04:17:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 Processor -- start 2024-01-19T04:17:19.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- start start 2024-01-19T04:17:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c151b80 0x7fce8c149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce8c155150 0x7fce8c1f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce8c157cc0 0x7fce8c144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c155730 con 0x7fce8c155150 2024-01-19T04:17:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c14d3f0 con 0x7fce8c151b80 2024-01-19T04:17:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce93c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c150880 con 0x7fce8c157cc0 2024-01-19T04:17:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce8c155150 0x7fce8c1f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce8c155150 0x7fce8c1f04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33732/0 (socket says 172.21.15.32:33732) 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 -- 172.21.15.32:0/2060645846 learned_addr learned my addr 172.21.15.32:0/2060645846 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce91200640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c151b80 0x7fce8c149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce91c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce8c157cc0 0x7fce8c144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 -- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce8c157cc0 msgr2=0x7fce8c144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce8c157cc0 0x7fce8c144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 -- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c151b80 msgr2=0x7fce8c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c151b80 0x7fce8c149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce8be00640 1 -- 172.21.15.32:0/2060645846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84009a70 con 0x7fce8c155150 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.789+0000 7fce91c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce8c157cc0 0x7fce8c144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce8be00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce8c155150 0x7fce8c1f04d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c530 tx=0x7fce7400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce88c00640 1 -- 172.21.15.32:0/2060645846 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740052d0 con 0x7fce8c155150 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce88c00640 1 -- 172.21.15.32:0/2060645846 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74005450 con 0x7fce8c155150 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce88c00640 1 -- 172.21.15.32:0/2060645846 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74012870 con 0x7fce8c155150 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c14d190 con 0x7fce8c155150 2024-01-19T04:17:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c14d600 con 0x7fce8c155150 2024-01-19T04:17:19.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c1ee200 con 0x7fce8c155150 2024-01-19T04:17:19.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce88c00640 1 -- 172.21.15.32:0/2060645846 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fce740129d0 con 0x7fce8c155150 2024-01-19T04:17:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce88c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fce64066500 0x7fce640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce88c00640 1 -- 172.21.15.32:0/2060645846 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fce74083d70 con 0x7fce8c155150 2024-01-19T04:17:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.793+0000 7fce91200640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fce64066500 0x7fce640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:19.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.797+0000 7fce91200640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fce64066500 0x7fce640689c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0011f0 tx=0x7fce7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:19.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.797+0000 7fce88c00640 1 -- 172.21.15.32:0/2060645846 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fce8c1ee200 con 0x7fce8c155150 2024-01-19T04:17:19.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.957+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce8c1ee200 con 0x7fce8c155150 2024-01-19T04:17:19.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.957+0000 7fce88c00640 1 -- 172.21.15.32:0/2060645846 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce8c1ee200 con 0x7fce8c155150 2024-01-19T04:17:19.961 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:19.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fce64066500 msgr2=0x7fce640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fce64066500 0x7fce640689c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0011f0 tx=0x7fce7c009040 comp rx=0 tx=0).stop 2024-01-19T04:17:19.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce8c155150 msgr2=0x7fce8c1f04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:19.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce8c155150 0x7fce8c1f04d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c530 tx=0x7fce7400c9f0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 shutdown_connections 2024-01-19T04:17:19.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fce64066500 0x7fce640689c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fce8c157cc0 0x7fce8c144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fce8c155150 0x7fce8c1f04d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 --2- 172.21.15.32:0/2060645846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fce8c151b80 0x7fce8c149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:19.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 >> 172.21.15.32:0/2060645846 conn(0x7fce8c0c7d40 msgr2=0x7fce8c158220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:19.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 shutdown_connections 2024-01-19T04:17:19.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:19.961+0000 7fce93c00640 1 -- 172.21.15.32:0/2060645846 wait complete. 2024-01-19T04:17:19.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:17:20.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 Processor -- start 2024-01-19T04:17:20.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 -- start start 2024-01-19T04:17:20.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c151b80 0x7fab5c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab5c157cc0 0x7fab5c0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab5c0c4cd0 0x7fab5c0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c0c34a0 con 0x7fab5c0c4cd0 2024-01-19T04:17:20.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c155730 con 0x7fab5c157cc0 2024-01-19T04:17:20.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab62000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0c2d30 con 0x7fab5c151b80 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab5c0c4cd0 0x7fab5c0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab5c0c4cd0 0x7fab5c0c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33742/0 (socket says 172.21.15.32:33742) 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 -- 172.21.15.32:0/851213830 learned_addr learned my addr 172.21.15.32:0/851213830 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 -- 172.21.15.32:0/851213830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c151b80 msgr2=0x7fab5c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5b400640 1 --2- 172.21.15.32:0/851213830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c151b80 0x7fab5c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5aa00640 1 --2- 172.21.15.32:0/851213830 >> v2:172.21.15.67:3300/0 conn(0x7fab5c157cc0 0x7fab5c0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 --2- 172.21.15.32:0/851213830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c151b80 0x7fab5c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 -- 172.21.15.32:0/851213830 >> v2:172.21.15.67:3300/0 conn(0x7fab5c157cc0 msgr2=0x7fab5c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 --2- 172.21.15.32:0/851213830 >> v2:172.21.15.67:3300/0 conn(0x7fab5c157cc0 0x7fab5c0c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5be00640 1 -- 172.21.15.32:0/851213830 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0c3010 con 0x7fab5c0c4cd0 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5b400640 1 --2- 172.21.15.32:0/851213830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c151b80 0x7fab5c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:20.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.125+0000 7fab5aa00640 1 --2- 172.21.15.32:0/851213830 >> v2:172.21.15.67:3300/0 conn(0x7fab5c157cc0 0x7fab5c0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:20.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab5be00640 1 --2- 172.21.15.32:0/851213830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c0c4cd0 0x7fab5c0c6360 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fab5c06b360 tx=0x7fab5401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6e6baa1706d476 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab5a000640 1 -- 172.21.15.32:0/851213830 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540af400 con 0x7fab5c0c4cd0 2024-01-19T04:17:20.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab5a000640 1 -- 172.21.15.32:0/851213830 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540ab050 con 0x7fab5c0c4cd0 2024-01-19T04:17:20.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab5a000640 1 -- 172.21.15.32:0/851213830 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540af780 con 0x7fab5c0c4cd0 2024-01-19T04:17:20.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 -- 172.21.15.32:0/851213830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c0c4cd0 msgr2=0x7fab5c0c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 --2- 172.21.15.32:0/851213830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c0c4cd0 0x7fab5c0c6360 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fab5c06b360 tx=0x7fab5401f1c0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 -- 172.21.15.32:0/851213830 shutdown_connections 2024-01-19T04:17:20.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 --2- 172.21.15.32:0/851213830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c0c4cd0 0x7fab5c0c6360 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 --2- 172.21.15.32:0/851213830 >> v2:172.21.15.67:3300/0 conn(0x7fab5c157cc0 0x7fab5c0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 --2- 172.21.15.32:0/851213830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c151b80 0x7fab5c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 -- 172.21.15.32:0/851213830 >> 172.21.15.32:0/851213830 conn(0x7fab5c0c7d40 msgr2=0x7fab5c0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:20.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 -- 172.21.15.32:0/851213830 shutdown_connections 2024-01-19T04:17:20.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.129+0000 7fab62000640 1 -- 172.21.15.32:0/851213830 wait complete. 2024-01-19T04:17:20.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 Processor -- start 2024-01-19T04:17:20.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 -- start start 2024-01-19T04:17:20.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0c4cd0 0x7fab5c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c151b80 0x7fab5c099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c157cc0 0x7fab5c099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c09a4d0 con 0x7fab5c151b80 2024-01-19T04:17:20.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c09ad70 con 0x7fab5c0c4cd0 2024-01-19T04:17:20.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0a9b40 con 0x7fab5c157cc0 2024-01-19T04:17:20.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c157cc0 0x7fab5c099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0c4cd0 0x7fab5c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c157cc0 0x7fab5c099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:50050/0 (socket says 172.21.15.32:50050) 2024-01-19T04:17:20.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5be00640 1 -- 172.21.15.32:0/3134313442 learned_addr learned my addr 172.21.15.32:0/3134313442 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:20.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5aa00640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c151b80 0x7fab5c099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5aa00640 1 -- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c157cc0 msgr2=0x7fab5c099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5aa00640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c157cc0 0x7fab5c099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5aa00640 1 -- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0c4cd0 msgr2=0x7fab5c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5aa00640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0c4cd0 0x7fab5c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5aa00640 1 -- 172.21.15.32:0/3134313442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54009b30 con 0x7fab5c151b80 2024-01-19T04:17:20.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab5aa00640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c151b80 0x7fab5c099a50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c7f0 tx=0x7fab4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab53400640 1 -- 172.21.15.32:0/3134313442 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44004220 con 0x7fab5c151b80 2024-01-19T04:17:20.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab53400640 1 -- 172.21.15.32:0/3134313442 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44004380 con 0x7fab5c151b80 2024-01-19T04:17:20.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c0a9e20 con 0x7fab5c151b80 2024-01-19T04:17:20.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab53400640 1 -- 172.21.15.32:0/3134313442 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44003840 con 0x7fab5c151b80 2024-01-19T04:17:20.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.133+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c09aa00 con 0x7fab5c151b80 2024-01-19T04:17:20.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.137+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c0749f0 con 0x7fab5c151b80 2024-01-19T04:17:20.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.137+0000 7fab53400640 1 -- 172.21.15.32:0/3134313442 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fab44003bb0 con 0x7fab5c151b80 2024-01-19T04:17:20.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.137+0000 7fab53400640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab34066530 0x7fab340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.137+0000 7fab53400640 1 -- 172.21.15.32:0/3134313442 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fab44084040 con 0x7fab5c151b80 2024-01-19T04:17:20.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.137+0000 7fab5b400640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab34066530 0x7fab340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.137+0000 7fab5b400640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab34066530 0x7fab340689f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fab4c006b20 tx=0x7fab4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.141+0000 7fab53400640 1 -- 172.21.15.32:0/3134313442 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fab440510c0 con 0x7fab5c151b80 2024-01-19T04:17:20.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab5c09aeb0 con 0x7fab5c151b80 2024-01-19T04:17:20.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab53400640 1 -- 172.21.15.32:0/3134313442 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab44003e60 con 0x7fab5c151b80 2024-01-19T04:17:20.303 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab34066530 msgr2=0x7fab340689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab34066530 0x7fab340689f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fab4c006b20 tx=0x7fab4c008040 comp rx=0 tx=0).stop 2024-01-19T04:17:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c151b80 msgr2=0x7fab5c099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c151b80 0x7fab5c099a50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c7f0 tx=0x7fab4400ccb0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 shutdown_connections 2024-01-19T04:17:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fab34066530 0x7fab340689f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab5c157cc0 0x7fab5c099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab5c151b80 0x7fab5c099a50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 --2- 172.21.15.32:0/3134313442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab5c0c4cd0 0x7fab5c155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 >> 172.21.15.32:0/3134313442 conn(0x7fab5c0c7d40 msgr2=0x7fab5c150430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:20.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 shutdown_connections 2024-01-19T04:17:20.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.301+0000 7fab62000640 1 -- 172.21.15.32:0/3134313442 wait complete. 2024-01-19T04:17:20.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:17:20.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa905400640 1 Processor -- start 2024-01-19T04:17:20.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa905400640 1 -- start start 2024-01-19T04:17:20.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa905400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa90014eb90 0x7fa9001549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa905400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 0x7fa900154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa905400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa900072730 con 0x7fa90006c670 2024-01-19T04:17:20.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa905400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa900072a10 con 0x7fa90014eb90 2024-01-19T04:17:20.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa905400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90014ef70 con 0x7fa9000720b0 2024-01-19T04:17:20.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fde00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa90006c670 0x7fa9000719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59880/0 (socket says 172.21.15.32:59880) 2024-01-19T04:17:20.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fde00640 1 -- 172.21.15.32:0/77549491 learned_addr learned my addr 172.21.15.32:0/77549491 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8ff200640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 0x7fa900154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fe800640 1 --2- 172.21.15.32:0/77549491 >> v2:172.21.15.67:3300/0 conn(0x7fa90014eb90 0x7fa9001549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643620312 0 0) 0x7fa900072730 con 0x7fa90006c670 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e0005740 con 0x7fa90006c670 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891889292 0 0) 0x7fa8e0005740 con 0x7fa90006c670 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 msgr2=0x7fa900154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 0x7fa900154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 >> v2:172.21.15.67:3300/0 conn(0x7fa90014eb90 msgr2=0x7fa9001549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 --2- 172.21.15.32:0/77549491 >> v2:172.21.15.67:3300/0 conn(0x7fa90014eb90 0x7fa9001549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900155580 con 0x7fa90006c670 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fa8e8001680 con 0x7fa90006c670 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 >> v1:172.21.15.32:6789/0 conn(0x7fa90006c670 legacy=0x7fa9000719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0005b90 0x7fa8e0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 0x7fa8e00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8e0006f20 0x7fa8e00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa900072a10 con 0x7fa8e0006f20 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e000dbf0 con 0x7fa8e0005b90 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e000ddb0 con 0x7fa9000720b0 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8ff200640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8e0006f20 0x7fa8e00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fe800640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0005b90 0x7fa8e0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fde00640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 0x7fa8e00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8ff200640 1 -- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 msgr2=0x7fa8e00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8ff200640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 0x7fa8e00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8ff200640 1 -- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0005b90 msgr2=0x7fa8e0005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8ff200640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0005b90 0x7fa8e0005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8ff200640 1 -- 172.21.15.32:0/77549491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0005740 con 0x7fa8e0006f20 2024-01-19T04:17:20.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.469+0000 7fa8fde00640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9000720b0 0x7fa8e00069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:20.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa8ff200640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8e0006f20 0x7fa8e00073a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa9000724c0 tx=0x7fa8f801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164979b78a866e0e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80a59b0 con 0x7fa8e0006f20 2024-01-19T04:17:20.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800f040 con 0x7fa8e0006f20 2024-01-19T04:17:20.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa8fd400640 1 -- 172.21.15.32:0/77549491 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80a5d10 con 0x7fa8e0006f20 2024-01-19T04:17:20.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa905400640 1 -- 172.21.15.32:0/77549491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8e0006f20 msgr2=0x7fa8e00073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa905400640 1 --2- 172.21.15.32:0/77549491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8e0006f20 0x7fa8e00073a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa9000724c0 tx=0x7fa8f801cbc0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa8ff200640 1 -- 172.21.15.32:0/77549491 reap_dead start 2024-01-19T04:17:20.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa905400640 1 -- 172.21.15.32:0/77549491 shutdown_connections 2024-01-19T04:17:20.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa905400640 1 -- 172.21.15.32:0/77549491 >> 172.21.15.32:0/77549491 conn(0x7fa9000c25a0 msgr2=0x7fa9000c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:20.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa905400640 1 -- 172.21.15.32:0/77549491 shutdown_connections 2024-01-19T04:17:20.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.473+0000 7fa905400640 1 -- 172.21.15.32:0/77549491 wait complete. 2024-01-19T04:17:20.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 Processor -- start 2024-01-19T04:17:20.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 -- start start 2024-01-19T04:17:20.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0006f20 0x7fa9001e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9001e4580 0x7fa9001ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa90014ef70 0x7fa9001edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001f1310 con 0x7fa9001e4580 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001f1840 con 0x7fa8e0006f20 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa900154a80 con 0x7fa90014ef70 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9001e4580 0x7fa9001ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9001e4580 0x7fa9001ed640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33782/0 (socket says 172.21.15.32:33782) 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 -- 172.21.15.32:0/3769086155 learned_addr learned my addr 172.21.15.32:0/3769086155 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8ff200640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa90014ef70 0x7fa9001edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fe800640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0006f20 0x7fa9001e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 -- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa90014ef70 msgr2=0x7fa9001edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa90014ef70 0x7fa9001edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 -- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0006f20 msgr2=0x7fa9001e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0006f20 0x7fa9001e4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 -- 172.21.15.32:0/3769086155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9001f1560 con 0x7fa9001e4580 2024-01-19T04:17:20.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8fde00640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9001e4580 0x7fa9001ed640 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800e840 tx=0x7fa8e800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8f6a00640 1 -- 172.21.15.32:0/3769086155 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800ee90 con 0x7fa9001e4580 2024-01-19T04:17:20.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8f6a00640 1 -- 172.21.15.32:0/3769086155 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e800c870 con 0x7fa9001e4580 2024-01-19T04:17:20.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa8f6a00640 1 -- 172.21.15.32:0/3769086155 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800cbe0 con 0x7fa9001e4580 2024-01-19T04:17:20.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9001564d0 con 0x7fa9001e4580 2024-01-19T04:17:20.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.477+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa900156a90 con 0x7fa9001e4580 2024-01-19T04:17:20.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.481+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9000749f0 con 0x7fa9001e4580 2024-01-19T04:17:20.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.481+0000 7fa8f6a00640 1 -- 172.21.15.32:0/3769086155 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa8e800cd40 con 0x7fa9001e4580 2024-01-19T04:17:20.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.481+0000 7fa8f6a00640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8d8066530 0x7fa8d80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.481+0000 7fa8f6a00640 1 -- 172.21.15.32:0/3769086155 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa8e8083a90 con 0x7fa9001e4580 2024-01-19T04:17:20.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.481+0000 7fa8fe800640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8d8066530 0x7fa8d80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.481+0000 7fa8fe800640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8d8066530 0x7fa8d80689f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa900156330 tx=0x7fa8f0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.485+0000 7fa8f6a00640 1 -- 172.21.15.32:0/3769086155 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa8e8050a70 con 0x7fa9001e4580 2024-01-19T04:17:20.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.641+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9000c54d0 con 0x7fa9001e4580 2024-01-19T04:17:20.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.641+0000 7fa8f6a00640 1 -- 172.21.15.32:0/3769086155 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa8e8019020 con 0x7fa9001e4580 2024-01-19T04:17:20.646 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8d8066530 msgr2=0x7fa8d80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8d8066530 0x7fa8d80689f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa900156330 tx=0x7fa8f0009190 comp rx=0 tx=0).stop 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9001e4580 msgr2=0x7fa9001ed640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9001e4580 0x7fa9001ed640 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800e840 tx=0x7fa8e800ec40 comp rx=0 tx=0).stop 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 shutdown_connections 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8d8066530 0x7fa8d80689f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa90014ef70 0x7fa9001edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9001e4580 0x7fa9001ed640 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 --2- 172.21.15.32:0/3769086155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8e0006f20 0x7fa9001e4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 >> 172.21.15.32:0/3769086155 conn(0x7fa9000c25a0 msgr2=0x7fa9000c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 shutdown_connections 2024-01-19T04:17:20.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.645+0000 7fa905400640 1 -- 172.21.15.32:0/3769086155 wait complete. 2024-01-19T04:17:20.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:17:20.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0efde00640 1 Processor -- start 2024-01-19T04:17:20.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0efde00640 1 -- start start 2024-01-19T04:17:20.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0efde00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ef80723b0 0x7f0ef8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0efde00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0ef806d440 0x7f0ef80c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0efde00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef80a4ea0 con 0x7f0ef80c2080 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0efde00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef81524a0 con 0x7f0ef806d440 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0efde00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef8152a20 con 0x7f0ef80723b0 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0ef806d440 0x7f0ef80c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0ef806d440 0x7f0ef80c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33796/0 (socket says 172.21.15.32:33796) 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef7400640 1 -- 172.21.15.32:0/1764110930 learned_addr learned my addr 172.21.15.32:0/1764110930 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef6a00640 1 --2- 172.21.15.32:0/1764110930 >> v2:172.21.15.67:3300/0 conn(0x7f0ef80723b0 0x7f0ef8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef7400640 1 -- 172.21.15.32:0/1764110930 >> v2:172.21.15.67:3300/0 conn(0x7f0ef80723b0 msgr2=0x7f0ef8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:20.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef7400640 1 --2- 172.21.15.32:0/1764110930 >> v2:172.21.15.67:3300/0 conn(0x7f0ef80723b0 0x7f0ef8152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef7400640 1 -- 172.21.15.32:0/1764110930 >> v1:172.21.15.67:6789/0 conn(0x7f0ef80c2080 legacy=0x7f0ef8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.817+0000 7f0ef7400640 1 -- 172.21.15.32:0/1764110930 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef81533f0 con 0x7f0ef806d440 2024-01-19T04:17:20.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0ef7400640 1 --2- 172.21.15.32:0/1764110930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef806d440 0x7f0ef80c4e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80a8790 tx=0x7f0ef001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8fe48f59904d90 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0ef5600640 1 -- 172.21.15.32:0/1764110930 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00a5680 con 0x7f0ef806d440 2024-01-19T04:17:20.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0ef5600640 1 -- 172.21.15.32:0/1764110930 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef00a57e0 con 0x7f0ef806d440 2024-01-19T04:17:20.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0ef5600640 1 -- 172.21.15.32:0/1764110930 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00a5b70 con 0x7f0ef806d440 2024-01-19T04:17:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 -- 172.21.15.32:0/1764110930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef806d440 msgr2=0x7f0ef80c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 --2- 172.21.15.32:0/1764110930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef806d440 0x7f0ef80c4e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80a8790 tx=0x7f0ef001c8b0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 -- 172.21.15.32:0/1764110930 shutdown_connections 2024-01-19T04:17:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 --2- 172.21.15.32:0/1764110930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef806d440 0x7f0ef80c4e50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 --2- 172.21.15.32:0/1764110930 >> v2:172.21.15.67:3300/0 conn(0x7f0ef80723b0 0x7f0ef8152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 -- 172.21.15.32:0/1764110930 >> 172.21.15.32:0/1764110930 conn(0x7f0ef80c25a0 msgr2=0x7f0ef80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 -- 172.21.15.32:0/1764110930 shutdown_connections 2024-01-19T04:17:20.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.821+0000 7f0efde00640 1 -- 172.21.15.32:0/1764110930 wait complete. 2024-01-19T04:17:20.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 Processor -- start 2024-01-19T04:17:20.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 -- start start 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ef806d440 0x7f0ef81416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ef80723b0 0x7f0ef81455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef80c2080 0x7f0ef8145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8151a50 con 0x7f0ef80c2080 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef81409d0 con 0x7f0ef806d440 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8150ed0 con 0x7f0ef80723b0 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef80c2080 0x7f0ef8145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef80c2080 0x7f0ef8145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33800/0 (socket says 172.21.15.32:33800) 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 -- 172.21.15.32:0/823804238 learned_addr learned my addr 172.21.15.32:0/823804238 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef6a00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ef806d440 0x7f0ef81416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef6000640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ef80723b0 0x7f0ef81455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 -- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ef80723b0 msgr2=0x7f0ef81455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ef80723b0 0x7f0ef81455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 -- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ef806d440 msgr2=0x7f0ef81416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ef806d440 0x7f0ef81416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 -- 172.21.15.32:0/823804238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0009b30 con 0x7f0ef80c2080 2024-01-19T04:17:20.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0ef7400640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef80c2080 0x7f0ef8145b30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00194c0 tx=0x7f0ef0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0eef400640 1 -- 172.21.15.32:0/823804238 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00b8670 con 0x7f0ef80c2080 2024-01-19T04:17:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0eef400640 1 -- 172.21.15.32:0/823804238 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef00b87d0 con 0x7f0ef80c2080 2024-01-19T04:17:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0eef400640 1 -- 172.21.15.32:0/823804238 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00b8b60 con 0x7f0ef80c2080 2024-01-19T04:17:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef81511b0 con 0x7f0ef80c2080 2024-01-19T04:17:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.825+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef8151770 con 0x7f0ef80c2080 2024-01-19T04:17:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.829+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef8145310 con 0x7f0ef80c2080 2024-01-19T04:17:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.829+0000 7f0eef400640 1 -- 172.21.15.32:0/823804238 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0ef00b8cc0 con 0x7f0ef80c2080 2024-01-19T04:17:20.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.829+0000 7f0eef400640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ed0066500 0x7f0ed00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:20.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.829+0000 7f0eef400640 1 -- 172.21.15.32:0/823804238 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ef011f520 con 0x7f0ef80c2080 2024-01-19T04:17:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.829+0000 7f0ef6a00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ed0066500 0x7f0ed00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.829+0000 7f0ef6a00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ed0066500 0x7f0ed00689c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80079c0 tx=0x7f0ee8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:20.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.833+0000 7f0eef400640 1 -- 172.21.15.32:0/823804238 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0ef8145310 con 0x7f0ef80c2080 2024-01-19T04:17:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f0ef8145310 con 0x7f0ef80c2080 2024-01-19T04:17:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0eef400640 1 -- 172.21.15.32:0/823804238 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7f0ef8145310 con 0x7f0ef80c2080 2024-01-19T04:17:20.995 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:20.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ed0066500 msgr2=0x7f0ed00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ed0066500 0x7f0ed00689c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80079c0 tx=0x7f0ee8008040 comp rx=0 tx=0).stop 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef80c2080 msgr2=0x7f0ef8145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef80c2080 0x7f0ef8145b30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00194c0 tx=0x7f0ef0019650 comp rx=0 tx=0).stop 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 shutdown_connections 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0ed0066500 0x7f0ed00689c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ef80c2080 0x7f0ef8145b30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0ef80723b0 0x7f0ef81455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 --2- 172.21.15.32:0/823804238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ef806d440 0x7f0ef81416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 >> 172.21.15.32:0/823804238 conn(0x7f0ef80c25a0 msgr2=0x7f0ef8144650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 shutdown_connections 2024-01-19T04:17:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:20.993+0000 7f0efde00640 1 -- 172.21.15.32:0/823804238 wait complete. 2024-01-19T04:17:21.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:17:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.157+0000 7fec67800640 1 Processor -- start 2024-01-19T04:17:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.157+0000 7fec67800640 1 -- start start 2024-01-19T04:17:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec67800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec6014fcd0 0x7fec601560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec67800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec600c4130 0x7fec600c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec67800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec601530e0 con 0x7fec6014f8f0 2024-01-19T04:17:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec67800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600c3130 con 0x7fec600c4130 2024-01-19T04:17:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec67800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec601527b0 con 0x7fec6014fcd0 2024-01-19T04:17:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec65800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec600c4130 0x7fec600c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec65800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec600c4130 0x7fec600c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33812/0 (socket says 172.21.15.32:33812) 2024-01-19T04:17:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec65800640 1 -- 172.21.15.32:0/2573297012 learned_addr learned my addr 172.21.15.32:0/2573297012 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec5fe00640 1 --2- 172.21.15.32:0/2573297012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec6014fcd0 0x7fec601560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec65800640 1 -- 172.21.15.32:0/2573297012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec6014fcd0 msgr2=0x7fec601560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec65800640 1 --2- 172.21.15.32:0/2573297012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec6014fcd0 0x7fec601560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec65800640 1 -- 172.21.15.32:0/2573297012 >> v1:172.21.15.67:6789/0 conn(0x7fec6014f8f0 legacy=0x7fec601559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec65800640 1 -- 172.21.15.32:0/2573297012 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60152a90 con 0x7fec600c4130 2024-01-19T04:17:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.161+0000 7fec5fe00640 1 --2- 172.21.15.32:0/2573297012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec6014fcd0 0x7fec601560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec65800640 1 --2- 172.21.15.32:0/2573297012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec600c6bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fec58009e50 tx=0x7fec5801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6586ab1742b7aa2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec5f400640 1 -- 172.21.15.32:0/2573297012 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580a57b0 con 0x7fec600c4130 2024-01-19T04:17:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec5f400640 1 -- 172.21.15.32:0/2573297012 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec580a5910 con 0x7fec600c4130 2024-01-19T04:17:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec5f400640 1 -- 172.21.15.32:0/2573297012 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580a5ca0 con 0x7fec600c4130 2024-01-19T04:17:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 -- 172.21.15.32:0/2573297012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 msgr2=0x7fec600c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 --2- 172.21.15.32:0/2573297012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec600c6bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fec58009e50 tx=0x7fec5801c910 comp rx=0 tx=0).stop 2024-01-19T04:17:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 -- 172.21.15.32:0/2573297012 shutdown_connections 2024-01-19T04:17:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 --2- 172.21.15.32:0/2573297012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec600c6bb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 --2- 172.21.15.32:0/2573297012 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec6014fcd0 0x7fec601560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 -- 172.21.15.32:0/2573297012 >> 172.21.15.32:0/2573297012 conn(0x7fec6006ddb0 msgr2=0x7fec6006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 -- 172.21.15.32:0/2573297012 shutdown_connections 2024-01-19T04:17:21.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 -- 172.21.15.32:0/2573297012 wait complete. 2024-01-19T04:17:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 Processor -- start 2024-01-19T04:17:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.165+0000 7fec67800640 1 -- start start 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec60155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec6014f8f0 0x7fec601ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec600c1560 0x7fec601eea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60156020 con 0x7fec600c4130 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600b4bd0 con 0x7fec6014f8f0 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec600beef0 con 0x7fec600c1560 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec60155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec60155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33828/0 (socket says 172.21.15.32:33828) 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 -- 172.21.15.32:0/1120334605 learned_addr learned my addr 172.21.15.32:0/1120334605 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec5fe00640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec6014f8f0 0x7fec601ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec65800640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec600c1560 0x7fec601eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 -- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec600c1560 msgr2=0x7fec601eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec600c1560 0x7fec601eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 -- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec6014f8f0 msgr2=0x7fec601ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec6014f8f0 0x7fec601ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 -- 172.21.15.32:0/1120334605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009b30 con 0x7fec600c4130 2024-01-19T04:17:21.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec64e00640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec60155580 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c450 tx=0x7fec5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec5cc00640 1 -- 172.21.15.32:0/1120334605 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50012830 con 0x7fec600c4130 2024-01-19T04:17:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec5cc00640 1 -- 172.21.15.32:0/1120334605 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec500129b0 con 0x7fec600c4130 2024-01-19T04:17:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec600bf1d0 con 0x7fec600c4130 2024-01-19T04:17:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec5cc00640 1 -- 172.21.15.32:0/1120334605 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50012d60 con 0x7fec600c4130 2024-01-19T04:17:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec600bf540 con 0x7fec600c4130 2024-01-19T04:17:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec600bed50 con 0x7fec600c4130 2024-01-19T04:17:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.169+0000 7fec5cc00640 1 -- 172.21.15.32:0/1120334605 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fec5001c460 con 0x7fec600c4130 2024-01-19T04:17:21.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.173+0000 7fec5cc00640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fec38066500 0x7fec380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.173+0000 7fec5cc00640 1 -- 172.21.15.32:0/1120334605 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fec50083f70 con 0x7fec600c4130 2024-01-19T04:17:21.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.173+0000 7fec5fe00640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fec38066500 0x7fec380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.173+0000 7fec5fe00640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fec38066500 0x7fec380689c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fec6015d040 tx=0x7fec48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:21.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.177+0000 7fec5cc00640 1 -- 172.21.15.32:0/1120334605 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fec600bed50 con 0x7fec600c4130 2024-01-19T04:17:21.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.349+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fec600bed50 con 0x7fec600c4130 2024-01-19T04:17:21.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.349+0000 7fec5cc00640 1 -- 172.21.15.32:0/1120334605 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) v1 ==== 80+0+0 (secure 0 0 0) 0x7fec600bed50 con 0x7fec600c4130 2024-01-19T04:17:21.352 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:17:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fec38066500 msgr2=0x7fec380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fec38066500 0x7fec380689c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fec6015d040 tx=0x7fec48008040 comp rx=0 tx=0).stop 2024-01-19T04:17:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 msgr2=0x7fec60155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec60155580 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c450 tx=0x7fec5000c910 comp rx=0 tx=0).stop 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 shutdown_connections 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fec38066500 0x7fec380689c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec600c1560 0x7fec601eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec6014f8f0 0x7fec601ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 --2- 172.21.15.32:0/1120334605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec600c4130 0x7fec60155580 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 >> 172.21.15.32:0/1120334605 conn(0x7fec6006ddb0 msgr2=0x7fec600c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 shutdown_connections 2024-01-19T04:17:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.353+0000 7fec67800640 1 -- 172.21.15.32:0/1120334605 wait complete. 2024-01-19T04:17:21.374 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-19T04:17:21.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:21.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:21.401 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:17:21.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:21.401 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T04:17:21.450 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:21.450 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:21.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:17:21.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:17:21.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dfe00640 1 Processor -- start 2024-01-19T04:17:21.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dfe00640 1 -- start start 2024-01-19T04:17:21.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dfe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d8151b00 0x7fe0d80bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dfe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d80c10a0 con 0x7fe0d8066580 2024-01-19T04:17:21.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dfe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d80c1380 con 0x7fe0d80c06f0 2024-01-19T04:17:21.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dfe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8066a40 con 0x7fe0d8151b00 2024-01-19T04:17:21.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dde00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe0d8066580 0x7fe0d815eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59896/0 (socket says 172.21.15.32:59896) 2024-01-19T04:17:21.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dde00640 1 -- 172.21.15.32:0/157466658 learned_addr learned my addr 172.21.15.32:0/157466658 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:21.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dd400640 1 --2- 172.21.15.32:0/157466658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d8151b00 0x7fe0d80bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0d7e00640 1 -- 172.21.15.32:0/157466658 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332571371 0 0) 0x7fe0d80c10a0 con 0x7fe0d8066580 2024-01-19T04:17:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0d7e00640 1 -- 172.21.15.32:0/157466658 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b8003530 con 0x7fe0d8066580 2024-01-19T04:17:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0d7e00640 1 -- 172.21.15.32:0/157466658 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572185975 0 0) 0x7fe0d80c1380 con 0x7fe0d80c06f0 2024-01-19T04:17:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0d7e00640 1 -- 172.21.15.32:0/157466658 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d80c10a0 con 0x7fe0d80c06f0 2024-01-19T04:17:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dd400640 1 -- 172.21.15.32:0/157466658 >> v1:172.21.15.67:6789/0 conn(0x7fe0d80c06f0 legacy=0x7fe0d80c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dd400640 1 -- 172.21.15.32:0/157466658 >> v1:172.21.15.32:6789/0 conn(0x7fe0d8066580 legacy=0x7fe0d815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.685+0000 7fe0dd400640 1 -- 172.21.15.32:0/157466658 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d81585f0 con 0x7fe0d8151b00 2024-01-19T04:17:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.689+0000 7fe0dd400640 1 --2- 172.21.15.32:0/157466658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d8151b00 0x7fe0d80bf830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80097d0 tx=0x7fe0c801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=534eaf5ad87b9d5b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.689+0000 7fe0d7e00640 1 -- 172.21.15.32:0/157466658 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80ab600 con 0x7fe0d8151b00 2024-01-19T04:17:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.689+0000 7fe0d7e00640 1 -- 172.21.15.32:0/157466658 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c80a7050 con 0x7fe0d8151b00 2024-01-19T04:17:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.689+0000 7fe0d7e00640 1 -- 172.21.15.32:0/157466658 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80ab980 con 0x7fe0d8151b00 2024-01-19T04:17:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.689+0000 7fe0dfe00640 1 -- 172.21.15.32:0/157466658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d8151b00 msgr2=0x7fe0d80bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.689+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/157466658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d8151b00 0x7fe0d80bf830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80097d0 tx=0x7fe0c801c350 comp rx=0 tx=0).stop 2024-01-19T04:17:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- 172.21.15.32:0/157466658 shutdown_connections 2024-01-19T04:17:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/157466658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d8151b00 0x7fe0d80bf830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- 172.21.15.32:0/157466658 >> 172.21.15.32:0/157466658 conn(0x7fe0d80c2f00 msgr2=0x7fe0d80c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- 172.21.15.32:0/157466658 shutdown_connections 2024-01-19T04:17:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- 172.21.15.32:0/157466658 wait complete. 2024-01-19T04:17:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 Processor -- start 2024-01-19T04:17:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- start start 2024-01-19T04:17:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0d8066580 0x7fe0d81499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d80c06f0 0x7fe0d81ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0d8151b00 0x7fe0d81ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d81eee30 con 0x7fe0d8066580 2024-01-19T04:17:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8156330 con 0x7fe0d8151b00 2024-01-19T04:17:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dfe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8156bd0 con 0x7fe0d80c06f0 2024-01-19T04:17:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0d8066580 0x7fe0d81499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0d8066580 0x7fe0d81499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33838/0 (socket says 172.21.15.32:33838) 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 -- 172.21.15.32:0/637828180 learned_addr learned my addr 172.21.15.32:0/637828180 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dca00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d80c06f0 0x7fe0d81ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dde00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0d8151b00 0x7fe0d81ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 -- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d80c06f0 msgr2=0x7fe0d81ee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d80c06f0 0x7fe0d81ee3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 -- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0d8151b00 msgr2=0x7fe0d81ee8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0d8151b00 0x7fe0d81ee8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 -- 172.21.15.32:0/637828180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80093b0 con 0x7fe0d8066580 2024-01-19T04:17:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dde00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0d8151b00 0x7fe0d81ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.693+0000 7fe0dd400640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0d8066580 0x7fe0d81499f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8018f60 tx=0x7fe0c80190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0d5600640 1 -- 172.21.15.32:0/637828180 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80b4400 con 0x7fe0d8066580 2024-01-19T04:17:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0d5600640 1 -- 172.21.15.32:0/637828180 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c80b4560 con 0x7fe0d8066580 2024-01-19T04:17:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d814a4f0 con 0x7fe0d8066580 2024-01-19T04:17:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0d5600640 1 -- 172.21.15.32:0/637828180 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80b48f0 con 0x7fe0d8066580 2024-01-19T04:17:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d8156860 con 0x7fe0d8066580 2024-01-19T04:17:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d80749f0 con 0x7fe0d8066580 2024-01-19T04:17:21.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0d5600640 1 -- 172.21.15.32:0/637828180 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe0c80b2040 con 0x7fe0d8066580 2024-01-19T04:17:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0d5600640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0b0066530 0x7fe0b00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.697+0000 7fe0d5600640 1 -- 172.21.15.32:0/637828180 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe0c811de80 con 0x7fe0d8066580 2024-01-19T04:17:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.701+0000 7fe0dca00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0b0066530 0x7fe0b00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.701+0000 7fe0dca00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0b0066530 0x7fe0b00689f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe0d81554b0 tx=0x7fe0c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:21.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.705+0000 7fe0d5600640 1 -- 172.21.15.32:0/637828180 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe0c80eadb0 con 0x7fe0d8066580 2024-01-19T04:17:21.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.901+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe0d8067080 con 0x7fe0d8066580 2024-01-19T04:17:21.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.901+0000 7fe0d5600640 1 -- 172.21.15.32:0/637828180 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+149 (secure 0 0 0) 0x7fe0c80bb0b0 con 0x7fe0d8066580 2024-01-19T04:17:21.904 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:17:21.904 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-19T04:17:21.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0b0066530 msgr2=0x7fe0b00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0b0066530 0x7fe0b00689f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe0d81554b0 tx=0x7fe0c0009040 comp rx=0 tx=0).stop 2024-01-19T04:17:21.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0d8066580 msgr2=0x7fe0d81499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:21.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0d8066580 0x7fe0d81499f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8018f60 tx=0x7fe0c80190f0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 shutdown_connections 2024-01-19T04:17:21.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe0b0066530 0x7fe0b00689f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0d8151b00 0x7fe0d81ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0d80c06f0 0x7fe0d81ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 --2- 172.21.15.32:0/637828180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0d8066580 0x7fe0d81499f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:21.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 >> 172.21.15.32:0/637828180 conn(0x7fe0d80c2f00 msgr2=0x7fe0d814b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:21.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 shutdown_connections 2024-01-19T04:17:21.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:21.905+0000 7fe0dfe00640 1 -- 172.21.15.32:0/637828180 wait complete. 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:17:21.927 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.1fx3RFQBnT 2024-01-19T04:17:21.927 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-01-19T04:17:21.935 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.iYlfCkJpZb 2024-01-19T04:17:21.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /tmp/tmp.1fx3RFQBnT /tmp/tmp.iYlfCkJpZb 2024-01-19T04:17:21.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.iYlfCkJpZb 2024-01-19T04:17:22.118 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.iYlfCkJpZb is 245B 2024-01-19T04:17:22.133 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.iYlfCkJpZb 2024-01-19T04:17:22.142 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDO96llVEZQEhAAxN/8Vv61apt/Z/rdKj0r0g== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-01-19T04:17:22.142 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:17:22.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:22.142 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-01-19T04:17:22.194 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:17:22.194 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:22.195 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42301sec preferred_lft 42301sec 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:1f:1a:e5:73 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:22.196 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:22.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:22.197 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:17:22.255 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-01-19T04:17:22.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:22.258 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-01-19T04:17:22.311 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-01-19T04:17:22.311 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:17:22.311 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-19T04:17:22.311 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:17:22.311 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-19T04:17:22.312 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:17:22.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:22.312 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:17:22.312 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:17:22.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-19T04:17:22.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-19T04:17:22.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-19T04:17:22.312 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:17:22.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:22.404 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:17:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T04:17:22.413 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:17:22.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:22.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-01-19T04:17:22.467 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:17:22.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:22.474 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:22.519 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:17:22.528 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:17:22.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:22.531 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:22.621 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:22.621 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/tmp/tmp.1fx3RFQBnT of=/dev/stdout 2024-01-19T04:17:22.670 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2024-01-19T04:17:22.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:22.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDO96llVEZQEhAAxN/8Vv61apt/Z/rdKj0r0g==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:22.764 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,secret=AQDO96llVEZQEhAAxN/8Vv61apt/Z/rdKj0r0g==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:22.765 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:22.765 INFO:teuthology.orchestra.run.smithi032.stdout:keyring.get_secret failed 2024-01-19T04:17:22.775 INFO:teuthology.orchestra.run.smithi032.stderr:mount.ceph: kernel BUG! 2024-01-19T04:17:22.775 INFO:teuthology.orchestra.run.smithi032.stderr:mount error 13 = Permission denied 2024-01-19T04:17:22.776 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,secret=AQDO96llVEZQEhAAxN/8Vv61apt/Z/rdKj0r0g==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:22.776 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:22.776 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:17:22.776 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: testuser@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs2=/ 2024-01-19T04:17:22.776 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:17:22.779 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-19T04:17:22.780 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-01-19T04:17:22.780 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T04:17:22.780 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:17:22.856 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:17:22.955 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T04:17:22.956 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:22.956 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:22.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:17:22.965 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:22.965 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:22.974 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:22.975 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:23.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e9000640 1 Processor -- start 2024-01-19T04:17:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e9000640 1 -- start start 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e9000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e40a6d30 0x7f49e40c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f49e406fda0 0x7f49e40c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e9000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e41533a0 con 0x7f49e40c6e20 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e9000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e4156380 con 0x7f49e406fda0 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e9000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e414fe40 con 0x7f49e40a6d30 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f49e406fda0 0x7f49e40c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e1e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f49e40c6e20 0x7f49e4152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59912/0 (socket says 172.21.15.32:59912) 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e1e00640 1 -- 172.21.15.32:0/3592351609 learned_addr learned my addr 172.21.15.32:0/3592351609 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:23.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e1400640 1 --2- 172.21.15.32:0/3592351609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e40a6d30 0x7f49e40c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e0a00640 1 -- 172.21.15.32:0/3592351609 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249357843 0 0) 0x7f49d4001120 con 0x7f49e40c6e20 2024-01-19T04:17:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e0a00640 1 -- 172.21.15.32:0/3592351609 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c4003530 con 0x7f49e40c6e20 2024-01-19T04:17:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e2800640 1 -- 172.21.15.32:0/3592351609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e40a6d30 msgr2=0x7f49e40c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e2800640 1 --2- 172.21.15.32:0/3592351609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e40a6d30 0x7f49e40c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e2800640 1 -- 172.21.15.32:0/3592351609 >> v1:172.21.15.32:6789/0 conn(0x7f49e40c6e20 legacy=0x7f49e4152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.169+0000 7f49e2800640 1 -- 172.21.15.32:0/3592351609 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4152800 con 0x7f49e406fda0 2024-01-19T04:17:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e2800640 1 --2- 172.21.15.32:0/3592351609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e406fda0 0x7f49e40c5b40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009d90 tx=0x7f49dc01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da21004df0b8015 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e0a00640 1 -- 172.21.15.32:0/3592351609 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0a58f0 con 0x7f49e406fda0 2024-01-19T04:17:23.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e0a00640 1 -- 172.21.15.32:0/3592351609 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0a5a50 con 0x7f49e406fda0 2024-01-19T04:17:23.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e0a00640 1 -- 172.21.15.32:0/3592351609 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0a5de0 con 0x7f49e406fda0 2024-01-19T04:17:23.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 -- 172.21.15.32:0/3592351609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e406fda0 msgr2=0x7f49e40c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 --2- 172.21.15.32:0/3592351609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e406fda0 0x7f49e40c5b40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009d90 tx=0x7f49dc01c830 comp rx=0 tx=0).stop 2024-01-19T04:17:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 -- 172.21.15.32:0/3592351609 shutdown_connections 2024-01-19T04:17:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 --2- 172.21.15.32:0/3592351609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e406fda0 0x7f49e40c5b40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 --2- 172.21.15.32:0/3592351609 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e40a6d30 0x7f49e40c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 -- 172.21.15.32:0/3592351609 >> 172.21.15.32:0/3592351609 conn(0x7f49e40a9870 msgr2=0x7f49e40a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 -- 172.21.15.32:0/3592351609 shutdown_connections 2024-01-19T04:17:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.173+0000 7f49e9000640 1 -- 172.21.15.32:0/3592351609 wait complete. 2024-01-19T04:17:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 Processor -- start 2024-01-19T04:17:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 -- start start 2024-01-19T04:17:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e406fda0 0x7f49e406c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e40a6d30 0x7f49e4151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e40c6e20 0x7f49e414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e406d800 con 0x7f49e40a6d30 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e406c730 con 0x7f49e40c6e20 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41543f0 con 0x7f49e406fda0 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e40a6d30 0x7f49e4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e40a6d30 0x7f49e4151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33846/0 (socket says 172.21.15.32:33846) 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 -- 172.21.15.32:0/1909171291 learned_addr learned my addr 172.21.15.32:0/1909171291 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1e00640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e406fda0 0x7f49e406c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e2800640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e40c6e20 0x7f49e414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 -- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e406fda0 msgr2=0x7f49e406c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e406fda0 0x7f49e406c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 -- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e40c6e20 msgr2=0x7f49e414ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e40c6e20 0x7f49e414ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 -- 172.21.15.32:0/1909171291 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc009a70 con 0x7f49e40a6d30 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e2800640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e40c6e20 0x7f49e414ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e1400640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e40a6d30 0x7f49e4151490 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00e900 tx=0x7f49cc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49da000640 1 -- 172.21.15.32:0/1909171291 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc009690 con 0x7f49e40a6d30 2024-01-19T04:17:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49da000640 1 -- 172.21.15.32:0/1909171291 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc00ca00 con 0x7f49e40a6d30 2024-01-19T04:17:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49da000640 1 -- 172.21.15.32:0/1909171291 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00cdb0 con 0x7f49e40a6d30 2024-01-19T04:17:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e4154690 con 0x7f49e40a6d30 2024-01-19T04:17:23.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.177+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e4154c50 con 0x7f49e40a6d30 2024-01-19T04:17:23.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.181+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e40749f0 con 0x7f49e40a6d30 2024-01-19T04:17:23.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.181+0000 7f49da000640 1 -- 172.21.15.32:0/1909171291 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f49cc013470 con 0x7f49e40a6d30 2024-01-19T04:17:23.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.181+0000 7f49da000640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49bc066500 0x7f49bc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.181+0000 7f49da000640 1 -- 172.21.15.32:0/1909171291 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f49cc084410 con 0x7f49e40a6d30 2024-01-19T04:17:23.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.181+0000 7f49e1e00640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49bc066500 0x7f49bc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.181+0000 7f49e1e00640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49bc066500 0x7f49bc0689c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005890 tx=0x7f49d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.185+0000 7f49da000640 1 -- 172.21.15.32:0/1909171291 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f49cc051340 con 0x7f49e40a6d30 2024-01-19T04:17:23.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.349+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49e4067b80 con 0x7f49e40a6d30 2024-01-19T04:17:23.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.349+0000 7f49da000640 1 -- 172.21.15.32:0/1909171291 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20185 (secure 0 0 0) 0x7f49cc081ef0 con 0x7f49e40a6d30 2024-01-19T04:17:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:23.352 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":57,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:05.701251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:23.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49bc066500 msgr2=0x7f49bc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49bc066500 0x7f49bc0689c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005890 tx=0x7f49d4009040 comp rx=0 tx=0).stop 2024-01-19T04:17:23.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e40a6d30 msgr2=0x7f49e4151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e40a6d30 0x7f49e4151490 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00e900 tx=0x7f49cc00edc0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 shutdown_connections 2024-01-19T04:17:23.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49bc066500 0x7f49bc0689c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49e40c6e20 0x7f49e414ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49e40a6d30 0x7f49e4151490 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 --2- 172.21.15.32:0/1909171291 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49e406fda0 0x7f49e406c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 >> 172.21.15.32:0/1909171291 conn(0x7f49e40a9870 msgr2=0x7f49e4070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:23.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 shutdown_connections 2024-01-19T04:17:23.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.353+0000 7f49e9000640 1 -- 172.21.15.32:0/1909171291 wait complete. 2024-01-19T04:17:23.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:16:48.753748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:16:49.947198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:17:02.181700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:17:03.077640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:23.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:23.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 Processor -- start 2024-01-19T04:17:23.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 -- start start 2024-01-19T04:17:23.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f887c06cab0 0x7f887c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f887c0c55d0 0x7f887c0c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c154140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c06e5c0 con 0x7f887c0c55d0 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c0c0eb0 con 0x7f887c06cab0 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8882a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0a5330 con 0x7f887c0705b0 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f887c0c55d0 0x7f887c0c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f887c0c55d0 0x7f887c0c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33852/0 (socket says 172.21.15.32:33852) 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 -- 172.21.15.32:0/3253224362 learned_addr learned my addr 172.21.15.32:0/3253224362 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f8880a00640 1 --2- 172.21.15.32:0/3253224362 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887be00640 1 --2- 172.21.15.32:0/3253224362 >> v2:172.21.15.67:3300/0 conn(0x7f887c06cab0 0x7f887c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 -- 172.21.15.32:0/3253224362 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 msgr2=0x7f887c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 --2- 172.21.15.32:0/3253224362 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 -- 172.21.15.32:0/3253224362 >> v2:172.21.15.67:3300/0 conn(0x7f887c06cab0 msgr2=0x7f887c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 --2- 172.21.15.32:0/3253224362 >> v2:172.21.15.67:3300/0 conn(0x7f887c06cab0 0x7f887c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887b400640 1 -- 172.21.15.32:0/3253224362 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c1516f0 con 0x7f887c0c55d0 2024-01-19T04:17:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.517+0000 7f887be00640 1 --2- 172.21.15.32:0/3253224362 >> v2:172.21.15.67:3300/0 conn(0x7f887c06cab0 0x7f887c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:23.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f887b400640 1 --2- 172.21.15.32:0/3253224362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c0c04a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f887c0a8790 tx=0x7f886401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1e8c55c0a60b70 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f887aa00640 1 -- 172.21.15.32:0/3253224362 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640aa5f0 con 0x7f887c0c55d0 2024-01-19T04:17:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f887aa00640 1 -- 172.21.15.32:0/3253224362 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88640aa750 con 0x7f887c0c55d0 2024-01-19T04:17:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f887aa00640 1 -- 172.21.15.32:0/3253224362 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640aaae0 con 0x7f887c0c55d0 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 -- 172.21.15.32:0/3253224362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 msgr2=0x7f887c0c04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 --2- 172.21.15.32:0/3253224362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c0c04a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f887c0a8790 tx=0x7f886401c4d0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 -- 172.21.15.32:0/3253224362 shutdown_connections 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 --2- 172.21.15.32:0/3253224362 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 --2- 172.21.15.32:0/3253224362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c0c04a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 --2- 172.21.15.32:0/3253224362 >> v2:172.21.15.67:3300/0 conn(0x7f887c06cab0 0x7f887c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 -- 172.21.15.32:0/3253224362 >> 172.21.15.32:0/3253224362 conn(0x7f887c0c25a0 msgr2=0x7f887c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 -- 172.21.15.32:0/3253224362 shutdown_connections 2024-01-19T04:17:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.521+0000 7f8882a00640 1 -- 172.21.15.32:0/3253224362 wait complete. 2024-01-19T04:17:23.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 Processor -- start 2024-01-19T04:17:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 -- start start 2024-01-19T04:17:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f887c06cab0 0x7f887c071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c159ed0 con 0x7f887c0c55d0 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c156d60 con 0x7f887c06cab0 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c1ec3b0 con 0x7f887c0705b0 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33854/0 (socket says 172.21.15.32:33854) 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 -- 172.21.15.32:0/3673336851 learned_addr learned my addr 172.21.15.32:0/3673336851 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f887b400640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f887be00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f887c06cab0 0x7f887c071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 -- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 msgr2=0x7f887c1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 -- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f887c06cab0 msgr2=0x7f887c071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f887c06cab0 0x7f887c071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 -- 172.21.15.32:0/3673336851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640094d0 con 0x7f887c0c55d0 2024-01-19T04:17:23.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8880a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c155d30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f887400efc0 tx=0x7f887400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8873e00640 1 -- 172.21.15.32:0/3673336851 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874014480 con 0x7f887c0c55d0 2024-01-19T04:17:23.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8873e00640 1 -- 172.21.15.32:0/3673336851 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887400f040 con 0x7f887c0c55d0 2024-01-19T04:17:23.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8873e00640 1 -- 172.21.15.32:0/3673336851 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874014820 con 0x7f887c0c55d0 2024-01-19T04:17:23.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c156f70 con 0x7f887c0c55d0 2024-01-19T04:17:23.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.525+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c071640 con 0x7f887c0c55d0 2024-01-19T04:17:23.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.529+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c155510 con 0x7f887c0c55d0 2024-01-19T04:17:23.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.529+0000 7f8873e00640 1 -- 172.21.15.32:0/3673336851 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8874014980 con 0x7f887c0c55d0 2024-01-19T04:17:23.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.529+0000 7f8873e00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8854066500 0x7f88540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.529+0000 7f8873e00640 1 -- 172.21.15.32:0/3673336851 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8874084c90 con 0x7f887c0c55d0 2024-01-19T04:17:23.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.529+0000 7f887be00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8854066500 0x7f88540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.529+0000 7f887be00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8854066500 0x7f88540689c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f886c0098d0 tx=0x7f886c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.533+0000 7f8873e00640 1 -- 172.21.15.32:0/3673336851 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f887c155510 con 0x7f887c0c55d0 2024-01-19T04:17:23.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.697+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f887c155510 con 0x7f887c0c55d0 2024-01-19T04:17:23.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.697+0000 7f8873e00640 1 -- 172.21.15.32:0/3673336851 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8874018020 con 0x7f887c0c55d0 2024-01-19T04:17:23.700 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8854066500 msgr2=0x7f88540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8854066500 0x7f88540689c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f886c0098d0 tx=0x7f886c008040 comp rx=0 tx=0).stop 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 msgr2=0x7f887c155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c155d30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f887400efc0 tx=0x7f887400c490 comp rx=0 tx=0).stop 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 shutdown_connections 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8854066500 0x7f88540689c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887c0c55d0 0x7f887c155d30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f887c0705b0 0x7f887c1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 --2- 172.21.15.32:0/3673336851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f887c06cab0 0x7f887c071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 >> 172.21.15.32:0/3673336851 conn(0x7f887c0c25a0 msgr2=0x7f887c0c0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 shutdown_connections 2024-01-19T04:17:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.701+0000 7f8882a00640 1 -- 172.21.15.32:0/3673336851 wait complete. 2024-01-19T04:17:23.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:17:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a6da00640 1 Processor -- start 2024-01-19T04:17:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a6da00640 1 -- start start 2024-01-19T04:17:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a6da00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a680c3230 0x7f5a680c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a6da00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806eeb0 0x7f5a6806f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a6da00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680c6470 con 0x7f5a681565d0 2024-01-19T04:17:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a6da00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a680c6ff0 con 0x7f5a680c3230 2024-01-19T04:17:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a6da00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680c88a0 con 0x7f5a6806eeb0 2024-01-19T04:17:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a680c3230 0x7f5a680c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a67400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806eeb0 0x7f5a6806f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a680c3230 0x7f5a680c3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:49680/0 (socket says 172.21.15.32:49680) 2024-01-19T04:17:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a67400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806eeb0 0x7f5a6806f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:50164/0 (socket says 172.21.15.32:50164) 2024-01-19T04:17:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66000640 1 -- 172.21.15.32:0/2643382943 learned_addr learned my addr 172.21.15.32:0/2643382943 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66a00640 1 --1- 172.21.15.32:0/2643382943 >> v1:172.21.15.67:6789/0 conn(0x7f5a681565d0 0x7f5a680c7db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:43644/0 (socket says 172.21.15.32:43644) 2024-01-19T04:17:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66000640 1 -- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806eeb0 msgr2=0x7f5a6806f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66000640 1 --2- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806eeb0 0x7f5a6806f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66000640 1 -- 172.21.15.32:0/2643382943 >> v1:172.21.15.67:6789/0 conn(0x7f5a681565d0 legacy=0x7f5a680c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a66000640 1 -- 172.21.15.32:0/2643382943 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680c66c0 con 0x7f5a680c3230 2024-01-19T04:17:23.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.865+0000 7f5a67400640 1 --2- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806eeb0 0x7f5a6806f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:23.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a66000640 1 --2- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680c3230 0x7f5a680c3690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009870 tx=0x7f5a5001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83746f8914bdaafc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a65600640 1 -- 172.21.15.32:0/2643382943 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a500ac620 con 0x7f5a680c3230 2024-01-19T04:17:23.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a65600640 1 -- 172.21.15.32:0/2643382943 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a500ac780 con 0x7f5a680c3230 2024-01-19T04:17:23.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a65600640 1 -- 172.21.15.32:0/2643382943 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a500acb10 con 0x7f5a680c3230 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 -- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680c3230 msgr2=0x7f5a680c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 --2- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680c3230 0x7f5a680c3690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009870 tx=0x7f5a5001c4b0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 -- 172.21.15.32:0/2643382943 shutdown_connections 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 --2- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806eeb0 0x7f5a6806f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 --2- 172.21.15.32:0/2643382943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680c3230 0x7f5a680c3690 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 -- 172.21.15.32:0/2643382943 >> 172.21.15.32:0/2643382943 conn(0x7f5a680726d0 msgr2=0x7f5a680663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 -- 172.21.15.32:0/2643382943 shutdown_connections 2024-01-19T04:17:23.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.869+0000 7f5a6da00640 1 -- 172.21.15.32:0/2643382943 wait complete. 2024-01-19T04:17:23.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 Processor -- start 2024-01-19T04:17:23.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 -- start start 2024-01-19T04:17:23.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806eeb0 0x7f5a681eb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c3230 0x7f5a6814e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a681565d0 0x7f5a6814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a681ebc60 con 0x7f5a6806eeb0 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680ab0d0 con 0x7f5a681565d0 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a681550a0 con 0x7f5a680c3230 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806eeb0 0x7f5a681eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806eeb0 0x7f5a681eb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33856/0 (socket says 172.21.15.32:33856) 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 -- 172.21.15.32:0/1614683605 learned_addr learned my addr 172.21.15.32:0/1614683605 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66000640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c3230 0x7f5a6814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a67400640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a681565d0 0x7f5a6814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 -- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c3230 msgr2=0x7f5a6814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c3230 0x7f5a6814e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 -- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a681565d0 msgr2=0x7f5a6814afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a681565d0 0x7f5a6814afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:23.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 -- 172.21.15.32:0/1614683605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009a70 con 0x7f5a6806eeb0 2024-01-19T04:17:23.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a66a00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806eeb0 0x7f5a681eb720 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c370 tx=0x7f5a5800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a5ea00640 1 -- 172.21.15.32:0/1614683605 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a580074e0 con 0x7f5a6806eeb0 2024-01-19T04:17:23.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a5ea00640 1 -- 172.21.15.32:0/1614683605 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58007640 con 0x7f5a6806eeb0 2024-01-19T04:17:23.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a5ea00640 1 -- 172.21.15.32:0/1614683605 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58004a30 con 0x7f5a6806eeb0 2024-01-19T04:17:23.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a500094d0 con 0x7f5a6806eeb0 2024-01-19T04:17:23.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.873+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680aca30 con 0x7f5a6806eeb0 2024-01-19T04:17:23.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.877+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680c2d50 con 0x7f5a6806eeb0 2024-01-19T04:17:23.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.877+0000 7f5a5ea00640 1 -- 172.21.15.32:0/1614683605 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5a58004b90 con 0x7f5a6806eeb0 2024-01-19T04:17:23.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.877+0000 7f5a5ea00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:23.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.877+0000 7f5a5ea00640 1 -- 172.21.15.32:0/1614683605 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5a58083a20 con 0x7f5a6806eeb0 2024-01-19T04:17:23.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.877+0000 7f5a66000640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:23.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.877+0000 7f5a66000640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a500ae000 tx=0x7f5a500a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:23.881+0000 7f5a5ea00640 1 -- 172.21.15.32:0/1614683605 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5a58050950 con 0x7f5a6806eeb0 2024-01-19T04:17:24.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a680749f0 con 0x7f5a6806eeb0 2024-01-19T04:17:24.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a5ea00640 1 -- 172.21.15.32:0/1614683605 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a58053f70 con 0x7f5a6806eeb0 2024-01-19T04:17:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 msgr2=0x7f5a400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a500ae000 tx=0x7f5a500a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806eeb0 msgr2=0x7f5a681eb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806eeb0 0x7f5a681eb720 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c370 tx=0x7f5a5800c770 comp rx=0 tx=0).stop 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 shutdown_connections 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a681565d0 0x7f5a6814afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c3230 0x7f5a6814e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 --2- 172.21.15.32:0/1614683605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806eeb0 0x7f5a681eb720 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 >> 172.21.15.32:0/1614683605 conn(0x7f5a680726d0 msgr2=0x7f5a6806fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 shutdown_connections 2024-01-19T04:17:24.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.041+0000 7f5a6da00640 1 -- 172.21.15.32:0/1614683605 wait complete. 2024-01-19T04:17:24.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:17:24.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.205+0000 7f29ac400640 1 Processor -- start 2024-01-19T04:17:24.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.205+0000 7f29ac400640 1 -- start start 2024-01-19T04:17:24.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29ac400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29a40723b0 0x7f29a4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29ac400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40c2080 0x7f29a4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29ac400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29a406d440 0x7f29a40c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29ac400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a41524a0 con 0x7f29a40723b0 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29ac400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a40a4ea0 con 0x7f29a406d440 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29ac400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4152a20 con 0x7f29a40c2080 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29a40723b0 0x7f29a4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29a40723b0 0x7f29a4152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33864/0 (socket says 172.21.15.32:33864) 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 -- 172.21.15.32:0/1133449977 learned_addr learned my addr 172.21.15.32:0/1133449977 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9000640 1 --2- 172.21.15.32:0/1133449977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40c2080 0x7f29a4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29aa400640 1 --2- 172.21.15.32:0/1133449977 >> v2:172.21.15.67:3300/0 conn(0x7f29a406d440 0x7f29a40c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 -- 172.21.15.32:0/1133449977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40c2080 msgr2=0x7f29a4155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 --2- 172.21.15.32:0/1133449977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40c2080 0x7f29a4155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 -- 172.21.15.32:0/1133449977 >> v2:172.21.15.67:3300/0 conn(0x7f29a406d440 msgr2=0x7f29a40c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 --2- 172.21.15.32:0/1133449977 >> v2:172.21.15.67:3300/0 conn(0x7f29a406d440 0x7f29a40c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9a00640 1 -- 172.21.15.32:0/1133449977 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a41533f0 con 0x7f29a40723b0 2024-01-19T04:17:24.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.209+0000 7f29a9000640 1 --2- 172.21.15.32:0/1133449977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40c2080 0x7f29a4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:24.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29a9a00640 1 --2- 172.21.15.32:0/1133449977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a40723b0 0x7f29a4152eb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f29a406e200 tx=0x7f299401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9037362ff0b29959 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29a3e00640 1 -- 172.21.15.32:0/1133449977 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29940ab600 con 0x7f29a40723b0 2024-01-19T04:17:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29a3e00640 1 -- 172.21.15.32:0/1133449977 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29940a7050 con 0x7f29a40723b0 2024-01-19T04:17:24.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29a3e00640 1 -- 172.21.15.32:0/1133449977 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29940ab980 con 0x7f29a40723b0 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 -- 172.21.15.32:0/1133449977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a40723b0 msgr2=0x7f29a4152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 --2- 172.21.15.32:0/1133449977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a40723b0 0x7f29a4152eb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f29a406e200 tx=0x7f299401c3e0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 -- 172.21.15.32:0/1133449977 shutdown_connections 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 --2- 172.21.15.32:0/1133449977 >> v2:172.21.15.67:3300/0 conn(0x7f29a406d440 0x7f29a40c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 --2- 172.21.15.32:0/1133449977 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40c2080 0x7f29a4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 --2- 172.21.15.32:0/1133449977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a40723b0 0x7f29a4152eb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 -- 172.21.15.32:0/1133449977 >> 172.21.15.32:0/1133449977 conn(0x7f29a40c25a0 msgr2=0x7f29a40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 -- 172.21.15.32:0/1133449977 shutdown_connections 2024-01-19T04:17:24.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 -- 172.21.15.32:0/1133449977 wait complete. 2024-01-19T04:17:24.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 Processor -- start 2024-01-19T04:17:24.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.213+0000 7f29ac400640 1 -- start start 2024-01-19T04:17:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a406d440 0x7f29a414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40723b0 0x7f29a4147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a40c2080 0x7f29a41ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a41f1200 con 0x7f29a406d440 2024-01-19T04:17:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4071f90 con 0x7f29a40c2080 2024-01-19T04:17:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a41f0580 con 0x7f29a40723b0 2024-01-19T04:17:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a406d440 0x7f29a414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a406d440 0x7f29a414c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33866/0 (socket says 172.21.15.32:33866) 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 -- 172.21.15.32:0/3857357452 learned_addr learned my addr 172.21.15.32:0/3857357452 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9000640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40723b0 0x7f29a4147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 -- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40723b0 msgr2=0x7f29a4147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29aa400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a40c2080 0x7f29a41ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40723b0 0x7f29a4147e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 -- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a40c2080 msgr2=0x7f29a41ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a40c2080 0x7f29a41ed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 -- 172.21.15.32:0/3857357452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940094d0 con 0x7f29a406d440 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29aa400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a40c2080 0x7f29a41ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:24.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a9a00640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a406d440 0x7f29a414c310 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f299401cc80 tx=0x7f299401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a1600640 1 -- 172.21.15.32:0/3857357452 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29940b6620 con 0x7f29a406d440 2024-01-19T04:17:24.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a1600640 1 -- 172.21.15.32:0/3857357452 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29940b67a0 con 0x7f29a406d440 2024-01-19T04:17:24.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29a1600640 1 -- 172.21.15.32:0/3857357452 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29940b6b50 con 0x7f29a406d440 2024-01-19T04:17:24.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a41f0860 con 0x7f29a406d440 2024-01-19T04:17:24.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a41f0e20 con 0x7f29a406d440 2024-01-19T04:17:24.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.217+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a40749f0 con 0x7f29a406d440 2024-01-19T04:17:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.221+0000 7f29a1600640 1 -- 172.21.15.32:0/3857357452 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f29940b2040 con 0x7f29a406d440 2024-01-19T04:17:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.221+0000 7f29a1600640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f297c066530 0x7f297c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.221+0000 7f29a1600640 1 -- 172.21.15.32:0/3857357452 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f299411e5e0 con 0x7f29a406d440 2024-01-19T04:17:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.221+0000 7f29a9000640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f297c066530 0x7f297c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.221+0000 7f29a9000640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f297c066530 0x7f297c0689f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29a414c0d0 tx=0x7f298c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.225+0000 7f29a1600640 1 -- 172.21.15.32:0/3857357452 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f29940eb510 con 0x7f29a406d440 2024-01-19T04:17:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.385+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29a4149710 con 0x7f29a406d440 2024-01-19T04:17:24.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.385+0000 7f29a1600640 1 -- 172.21.15.32:0/3857357452 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29940eeb30 con 0x7f29a406d440 2024-01-19T04:17:24.389 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:24.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f297c066530 msgr2=0x7f297c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f297c066530 0x7f297c0689f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29a414c0d0 tx=0x7f298c008040 comp rx=0 tx=0).stop 2024-01-19T04:17:24.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a406d440 msgr2=0x7f29a414c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a406d440 0x7f29a414c310 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f299401cc80 tx=0x7f299401ac20 comp rx=0 tx=0).stop 2024-01-19T04:17:24.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 shutdown_connections 2024-01-19T04:17:24.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f297c066530 0x7f297c0689f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a40c2080 0x7f29a41ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f29a40723b0 0x7f29a4147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 --2- 172.21.15.32:0/3857357452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29a406d440 0x7f29a414c310 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 >> 172.21.15.32:0/3857357452 conn(0x7f29a40c25a0 msgr2=0x7f29a4151690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:24.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 shutdown_connections 2024-01-19T04:17:24.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.389+0000 7f29ac400640 1 -- 172.21.15.32:0/3857357452 wait complete. 2024-01-19T04:17:24.411 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:17:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f672aa00640 1 Processor -- start 2024-01-19T04:17:24.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f672aa00640 1 -- start start 2024-01-19T04:17:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f672aa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67240723b0 0x7f6724152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f672aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f672406d440 0x7f67240c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f672aa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67240a4ea0 con 0x7f67240c2080 2024-01-19T04:17:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f672aa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67241524a0 con 0x7f672406d440 2024-01-19T04:17:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f672aa00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6724152a20 con 0x7f67240723b0 2024-01-19T04:17:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6723400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f67240c2080 0x7f6724155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59928/0 (socket says 172.21.15.32:59928) 2024-01-19T04:17:24.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6728a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f672406d440 0x7f67240c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6723400640 1 -- 172.21.15.32:0/3837787865 learned_addr learned my addr 172.21.15.32:0/3837787865 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:24.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6723e00640 1 --2- 172.21.15.32:0/3837787865 >> v2:172.21.15.67:3300/0 conn(0x7f67240723b0 0x7f6724152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6728a00640 1 -- 172.21.15.32:0/3837787865 >> v2:172.21.15.67:3300/0 conn(0x7f67240723b0 msgr2=0x7f6724152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:24.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6728a00640 1 --2- 172.21.15.32:0/3837787865 >> v2:172.21.15.67:3300/0 conn(0x7f67240723b0 0x7f6724152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6728a00640 1 -- 172.21.15.32:0/3837787865 >> v1:172.21.15.32:6789/0 conn(0x7f67240c2080 legacy=0x7f6724155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6728a00640 1 -- 172.21.15.32:0/3837787865 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67241533f0 con 0x7f672406d440 2024-01-19T04:17:24.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.553+0000 7f6722a00640 1 -- 172.21.15.32:0/3837787865 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341713167 0 0) 0x7f67240a4ea0 con 0x7f67240c2080 2024-01-19T04:17:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f6728a00640 1 --2- 172.21.15.32:0/3837787865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f672406d440 0x7f67240c4e50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f67240a8790 tx=0x7f671c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518e1a054a65b058 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f6722a00640 1 -- 172.21.15.32:0/3837787865 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0a57c0 con 0x7f672406d440 2024-01-19T04:17:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f6722a00640 1 -- 172.21.15.32:0/3837787865 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0a5920 con 0x7f672406d440 2024-01-19T04:17:24.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f6722a00640 1 -- 172.21.15.32:0/3837787865 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0a5cb0 con 0x7f672406d440 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 -- 172.21.15.32:0/3837787865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f672406d440 msgr2=0x7f67240c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 --2- 172.21.15.32:0/3837787865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f672406d440 0x7f67240c4e50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f67240a8790 tx=0x7f671c01c7f0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 -- 172.21.15.32:0/3837787865 shutdown_connections 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 --2- 172.21.15.32:0/3837787865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f672406d440 0x7f67240c4e50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 --2- 172.21.15.32:0/3837787865 >> v2:172.21.15.67:3300/0 conn(0x7f67240723b0 0x7f6724152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 -- 172.21.15.32:0/3837787865 >> 172.21.15.32:0/3837787865 conn(0x7f67240c25a0 msgr2=0x7f67240c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 -- 172.21.15.32:0/3837787865 shutdown_connections 2024-01-19T04:17:24.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.557+0000 7f672aa00640 1 -- 172.21.15.32:0/3837787865 wait complete. 2024-01-19T04:17:24.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 Processor -- start 2024-01-19T04:17:24.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 -- start start 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f672406d440 0x7f67240c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67240723b0 0x7f67241eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67240c2080 0x7f67241eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67240bffb0 con 0x7f67240c2080 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724155730 con 0x7f672406d440 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67241eac20 con 0x7f67240723b0 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67240c2080 0x7f67241eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67240c2080 0x7f67241eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33886/0 (socket says 172.21.15.32:33886) 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 -- 172.21.15.32:0/4161512222 learned_addr learned my addr 172.21.15.32:0/4161512222 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6723400640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67240723b0 0x7f67241eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6723e00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f672406d440 0x7f67240c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 -- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67240723b0 msgr2=0x7f67241eb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67240723b0 0x7f67241eb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 -- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f672406d440 msgr2=0x7f67240c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f672406d440 0x7f67240c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 -- 172.21.15.32:0/4161512222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c009a70 con 0x7f67240c2080 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f6728a00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67240c2080 0x7f67241eb5f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f671c01a420 tx=0x7f671c019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f671be00640 1 -- 172.21.15.32:0/4161512222 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0b9650 con 0x7f67240c2080 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f671be00640 1 -- 172.21.15.32:0/4161512222 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0b97b0 con 0x7f67240c2080 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67241551b0 con 0x7f67240c2080 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f671be00640 1 -- 172.21.15.32:0/4161512222 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0b9b20 con 0x7f67240c2080 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.561+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6724155450 con 0x7f67240c2080 2024-01-19T04:17:24.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.565+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67240749f0 con 0x7f67240c2080 2024-01-19T04:17:24.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.565+0000 7f671be00640 1 -- 172.21.15.32:0/4161512222 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f671c0b9c80 con 0x7f67240c2080 2024-01-19T04:17:24.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.565+0000 7f671be00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f66fc066530 0x7f66fc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.565+0000 7f671be00640 1 -- 172.21.15.32:0/4161512222 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f671c11eff0 con 0x7f67240c2080 2024-01-19T04:17:24.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.565+0000 7f6723e00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f66fc066530 0x7f66fc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.565+0000 7f6723e00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f66fc066530 0x7f66fc0689f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6714009ac0 tx=0x7f6714009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.569+0000 7f671be00640 1 -- 172.21.15.32:0/4161512222 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f671c0ec080 con 0x7f67240c2080 2024-01-19T04:17:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67241ead60 con 0x7f67240c2080 2024-01-19T04:17:24.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f671be00640 1 -- 172.21.15.32:0/4161512222 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7f671c0ef6a0 con 0x7f67240c2080 2024-01-19T04:17:24.731 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f66fc066530 msgr2=0x7f66fc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f66fc066530 0x7f66fc0689f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6714009ac0 tx=0x7f6714009190 comp rx=0 tx=0).stop 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67240c2080 msgr2=0x7f67241eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67240c2080 0x7f67241eb5f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f671c01a420 tx=0x7f671c019590 comp rx=0 tx=0).stop 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 shutdown_connections 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f66fc066530 0x7f66fc0689f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67240c2080 0x7f67241eb5f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67240723b0 0x7f67241eb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 --2- 172.21.15.32:0/4161512222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f672406d440 0x7f67240c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 >> 172.21.15.32:0/4161512222 conn(0x7f67240c25a0 msgr2=0x7f67240a70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.729+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 shutdown_connections 2024-01-19T04:17:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.733+0000 7f672aa00640 1 -- 172.21.15.32:0/4161512222 wait complete. 2024-01-19T04:17:24.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:17:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a3000640 1 Processor -- start 2024-01-19T04:17:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a3000640 1 -- start start 2024-01-19T04:17:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a3000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f119c155150 0x7f119c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a3000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f119c0c6360 0x7f119c0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a3000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c0c2d30 con 0x7f119c151b80 2024-01-19T04:17:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a3000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c0c34a0 con 0x7f119c0c6360 2024-01-19T04:17:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a3000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c155730 con 0x7f119c155150 2024-01-19T04:17:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f119be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f119c151b80 0x7f119c0c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59930/0 (socket says 172.21.15.32:59930) 2024-01-19T04:17:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f119be00640 1 -- 172.21.15.32:0/2890762151 learned_addr learned my addr 172.21.15.32:0/2890762151 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a1000640 1 --2- 172.21.15.32:0/2890762151 >> v2:172.21.15.32:3300/0 conn(0x7f119c0c6360 0x7f119c0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f119b400640 1 --2- 172.21.15.32:0/2890762151 >> v2:172.21.15.67:3300/0 conn(0x7f119c155150 0x7f119c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f119aa00640 1 -- 172.21.15.32:0/2890762151 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704825834 0 0) 0x7f119c0c2d30 con 0x7f119c151b80 2024-01-19T04:17:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f119aa00640 1 -- 172.21.15.32:0/2890762151 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c003530 con 0x7f119c151b80 2024-01-19T04:17:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a1000640 1 -- 172.21.15.32:0/2890762151 >> v2:172.21.15.67:3300/0 conn(0x7f119c155150 msgr2=0x7f119c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a1000640 1 --2- 172.21.15.32:0/2890762151 >> v2:172.21.15.67:3300/0 conn(0x7f119c155150 0x7f119c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a1000640 1 -- 172.21.15.32:0/2890762151 >> v1:172.21.15.32:6789/0 conn(0x7f119c151b80 legacy=0x7f119c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.897+0000 7f11a1000640 1 -- 172.21.15.32:0/2890762151 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c0c3010 con 0x7f119c0c6360 2024-01-19T04:17:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a1000640 1 --2- 172.21.15.32:0/2890762151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c0c6360 0x7f119c0c67b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f119c071ea0 tx=0x7f119401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4f0e61cd37a43a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f119aa00640 1 -- 172.21.15.32:0/2890762151 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940a59a0 con 0x7f119c0c6360 2024-01-19T04:17:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f119aa00640 1 -- 172.21.15.32:0/2890762151 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11940a5b00 con 0x7f119c0c6360 2024-01-19T04:17:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f119aa00640 1 -- 172.21.15.32:0/2890762151 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940a5e90 con 0x7f119c0c6360 2024-01-19T04:17:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 -- 172.21.15.32:0/2890762151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c0c6360 msgr2=0x7f119c0c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 --2- 172.21.15.32:0/2890762151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c0c6360 0x7f119c0c67b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f119c071ea0 tx=0x7f119401c8e0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 -- 172.21.15.32:0/2890762151 shutdown_connections 2024-01-19T04:17:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 --2- 172.21.15.32:0/2890762151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c0c6360 0x7f119c0c67b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 --2- 172.21.15.32:0/2890762151 >> v2:172.21.15.67:3300/0 conn(0x7f119c155150 0x7f119c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 -- 172.21.15.32:0/2890762151 >> 172.21.15.32:0/2890762151 conn(0x7f119c0c7d40 msgr2=0x7f119c0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:24.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 -- 172.21.15.32:0/2890762151 shutdown_connections 2024-01-19T04:17:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.901+0000 7f11a3000640 1 -- 172.21.15.32:0/2890762151 wait complete. 2024-01-19T04:17:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 Processor -- start 2024-01-19T04:17:24.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 -- start start 2024-01-19T04:17:24.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c0c6360 0x7f119c06c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c151b80 0x7f119c1ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f119c155150 0x7f119c1411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c1ecee0 con 0x7f119c151b80 2024-01-19T04:17:24.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c1ed160 con 0x7f119c0c6360 2024-01-19T04:17:24.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c155aa0 con 0x7f119c155150 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c151b80 0x7f119c1ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c151b80 0x7f119c1ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33908/0 (socket says 172.21.15.32:33908) 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 -- 172.21.15.32:0/4165064030 learned_addr learned my addr 172.21.15.32:0/4165064030 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a1000640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f119c155150 0x7f119c1411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119be00640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c0c6360 0x7f119c06c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 -- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f119c155150 msgr2=0x7f119c1411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f119c155150 0x7f119c1411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 -- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c0c6360 msgr2=0x7f119c06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c0c6360 0x7f119c06c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 -- 172.21.15.32:0/4165064030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194009a70 con 0x7f119c151b80 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f119b400640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c151b80 0x7f119c1ed5f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f118400e870 tx=0x7f118400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f1193e00640 1 -- 172.21.15.32:0/4165064030 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184009510 con 0x7f119c151b80 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f1193e00640 1 -- 172.21.15.32:0/4165064030 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400eec0 con 0x7f119c151b80 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c1f1240 con 0x7f119c151b80 2024-01-19T04:17:24.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f1193e00640 1 -- 172.21.15.32:0/4165064030 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400cb40 con 0x7f119c151b80 2024-01-19T04:17:24.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.905+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c156040 con 0x7f119c151b80 2024-01-19T04:17:24.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.909+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c04e980 con 0x7f119c151b80 2024-01-19T04:17:24.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.909+0000 7f1193e00640 1 -- 172.21.15.32:0/4165064030 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f118400ccc0 con 0x7f119c151b80 2024-01-19T04:17:24.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.909+0000 7f1193e00640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1174066500 0x7f11740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:24.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.909+0000 7f1193e00640 1 -- 172.21.15.32:0/4165064030 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f11840843b0 con 0x7f119c151b80 2024-01-19T04:17:24.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.909+0000 7f119be00640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1174066500 0x7f11740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:24.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.909+0000 7f119be00640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1174066500 0x7f11740689c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f118c007fd0 tx=0x7f118c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:24.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:24.913+0000 7f1193e00640 1 -- 172.21.15.32:0/4165064030 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1184051270 con 0x7f119c151b80 2024-01-19T04:17:25.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.073+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f119c0749f0 con 0x7f119c151b80 2024-01-19T04:17:25.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.073+0000 7f1193e00640 1 -- 172.21.15.32:0/4165064030 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1184054890 con 0x7f119c151b80 2024-01-19T04:17:25.077 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1174066500 msgr2=0x7f11740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1174066500 0x7f11740689c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f118c007fd0 tx=0x7f118c009040 comp rx=0 tx=0).stop 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c151b80 msgr2=0x7f119c1ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c151b80 0x7f119c1ed5f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f118400e870 tx=0x7f118400ec70 comp rx=0 tx=0).stop 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 shutdown_connections 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1174066500 0x7f11740689c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f119c155150 0x7f119c1411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f119c151b80 0x7f119c1ed5f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 --2- 172.21.15.32:0/4165064030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c0c6360 0x7f119c06c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 >> 172.21.15.32:0/4165064030 conn(0x7f119c0c7d40 msgr2=0x7f119c073790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 shutdown_connections 2024-01-19T04:17:25.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.077+0000 7f11a3000640 1 -- 172.21.15.32:0/4165064030 wait complete. 2024-01-19T04:17:25.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:17:25.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.237+0000 7fbb59c00640 1 Processor -- start 2024-01-19T04:17:25.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb59c00640 1 -- start start 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb59c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbb540c55e0 0x7fbb54151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c18b0 0x7fbb540a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb59c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb540c1d40 con 0x7fbb54147f90 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb59c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5406c5c0 con 0x7fbb540c55e0 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb59c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540c0810 con 0x7fbb540c18b0 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb52000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbb540c55e0 0x7fbb54151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb52000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbb540c55e0 0x7fbb54151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33924/0 (socket says 172.21.15.32:33924) 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb52000640 1 -- 172.21.15.32:0/3617062250 learned_addr learned my addr 172.21.15.32:0/3617062250 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb53400640 1 --2- 172.21.15.32:0/3617062250 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c18b0 0x7fbb540a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb52000640 1 -- 172.21.15.32:0/3617062250 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c18b0 msgr2=0x7fbb540a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb52000640 1 --2- 172.21.15.32:0/3617062250 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c18b0 0x7fbb540a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb52000640 1 -- 172.21.15.32:0/3617062250 >> v1:172.21.15.67:6789/0 conn(0x7fbb54147f90 legacy=0x7fbb5406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.241+0000 7fbb52000640 1 -- 172.21.15.32:0/3617062250 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540c0af0 con 0x7fbb540c55e0 2024-01-19T04:17:25.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb52000640 1 --2- 172.21.15.32:0/3617062250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb540c55e0 0x7fbb54151350 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009870 tx=0x7fbb3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3461fd53492394c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:25.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb51600640 1 -- 172.21.15.32:0/3617062250 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0ab680 con 0x7fbb540c55e0 2024-01-19T04:17:25.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb51600640 1 -- 172.21.15.32:0/3617062250 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c0ab7e0 con 0x7fbb540c55e0 2024-01-19T04:17:25.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb51600640 1 -- 172.21.15.32:0/3617062250 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0abb70 con 0x7fbb540c55e0 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 -- 172.21.15.32:0/3617062250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb540c55e0 msgr2=0x7fbb54151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3617062250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb540c55e0 0x7fbb54151350 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009870 tx=0x7fbb3c01c480 comp rx=0 tx=0).stop 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 -- 172.21.15.32:0/3617062250 shutdown_connections 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3617062250 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c18b0 0x7fbb540a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3617062250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb540c55e0 0x7fbb54151350 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 -- 172.21.15.32:0/3617062250 >> 172.21.15.32:0/3617062250 conn(0x7fbb540c5b20 msgr2=0x7fbb540c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 -- 172.21.15.32:0/3617062250 shutdown_connections 2024-01-19T04:17:25.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 -- 172.21.15.32:0/3617062250 wait complete. 2024-01-19T04:17:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 Processor -- start 2024-01-19T04:17:25.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.245+0000 7fbb59c00640 1 -- start start 2024-01-19T04:17:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb540c18b0 0x7fbb541edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c55e0 0x7fbb5414d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb54147f90 0x7fbb5414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540a9990 con 0x7fbb54147f90 2024-01-19T04:17:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540a9c70 con 0x7fbb540c18b0 2024-01-19T04:17:25.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5414e2e0 con 0x7fbb540c55e0 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb54147f90 0x7fbb5414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb52000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c55e0 0x7fbb5414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb54147f90 0x7fbb5414dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33936/0 (socket says 172.21.15.32:33936) 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 -- 172.21.15.32:0/3695941066 learned_addr learned my addr 172.21.15.32:0/3695941066 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb52a00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb540c18b0 0x7fbb541edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 -- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c55e0 msgr2=0x7fbb5414d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c55e0 0x7fbb5414d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 -- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb540c18b0 msgr2=0x7fbb541edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb540c18b0 0x7fbb541edae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 -- 172.21.15.32:0/3695941066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0094d0 con 0x7fbb54147f90 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb53400640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb54147f90 0x7fbb5414dda0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c007df0 tx=0x7fbb4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb4aa00640 1 -- 172.21.15.32:0/3695941066 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c014420 con 0x7fbb54147f90 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb4aa00640 1 -- 172.21.15.32:0/3695941066 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0145a0 con 0x7fbb54147f90 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb4aa00640 1 -- 172.21.15.32:0/3695941066 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c014950 con 0x7fbb54147f90 2024-01-19T04:17:25.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5414bbb0 con 0x7fbb54147f90 2024-01-19T04:17:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5414eba0 con 0x7fbb54147f90 2024-01-19T04:17:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.249+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb540c0460 con 0x7fbb54147f90 2024-01-19T04:17:25.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.253+0000 7fbb4aa00640 1 -- 172.21.15.32:0/3695941066 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbb4c014ab0 con 0x7fbb54147f90 2024-01-19T04:17:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.253+0000 7fbb4aa00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbb2c066530 0x7fbb2c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.253+0000 7fbb4aa00640 1 -- 172.21.15.32:0/3695941066 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbb4c084970 con 0x7fbb54147f90 2024-01-19T04:17:25.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.253+0000 7fbb52a00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbb2c066530 0x7fbb2c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.253+0000 7fbb52a00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbb2c066530 0x7fbb2c0689f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001770 tx=0x7fbb44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:25.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.257+0000 7fbb4aa00640 1 -- 172.21.15.32:0/3695941066 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbb4c051950 con 0x7fbb54147f90 2024-01-19T04:17:25.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb540749f0 con 0x7fbb54147f90 2024-01-19T04:17:25.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb4aa00640 1 -- 172.21.15.32:0/3695941066 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb4c054f70 con 0x7fbb54147f90 2024-01-19T04:17:25.431 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:17:25.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbb2c066530 msgr2=0x7fbb2c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbb2c066530 0x7fbb2c0689f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001770 tx=0x7fbb44009040 comp rx=0 tx=0).stop 2024-01-19T04:17:25.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb54147f90 msgr2=0x7fbb5414dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb54147f90 0x7fbb5414dda0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c007df0 tx=0x7fbb4c00e4b0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 shutdown_connections 2024-01-19T04:17:25.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbb2c066530 0x7fbb2c0689f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb54147f90 0x7fbb5414dda0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbb540c55e0 0x7fbb5414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 --2- 172.21.15.32:0/3695941066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb540c18b0 0x7fbb541edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 >> 172.21.15.32:0/3695941066 conn(0x7fbb540c5b20 msgr2=0x7fbb5406c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:25.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 shutdown_connections 2024-01-19T04:17:25.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.429+0000 7fbb59c00640 1 -- 172.21.15.32:0/3695941066 wait complete. 2024-01-19T04:17:25.453 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-19T04:17:25.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:25.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:25.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:17:25.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:25.485 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:17:25.538 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:25.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b9200640 1 Processor -- start 2024-01-19T04:17:25.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b9200640 1 -- start start 2024-01-19T04:17:25.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b4158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b9200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9b4158780 0x7fb9b40a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b9200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b40a78d0 con 0x7fb9b40a7300 2024-01-19T04:17:25.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b9200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b40c48d0 con 0x7fb9b4158780 2024-01-19T04:17:25.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b9200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c4bb0 con 0x7fb9b4151bc0 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b1400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9b4158780 0x7fb9b40a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b1400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9b4158780 0x7fb9b40a6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:49776/0 (socket says 172.21.15.32:49776) 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b1e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b2800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb9b40a7300 0x7fb9b41545b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:43666/0 (socket says 172.21.15.32:43666) 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b1400640 1 -- 172.21.15.32:0/3328317792 learned_addr learned my addr 172.21.15.32:0/3328317792 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.677+0000 7fb9b1400640 1 -- 172.21.15.32:0/3328317792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 msgr2=0x7fb9b4158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b1400640 1 --2- 172.21.15.32:0/3328317792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b4158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b1400640 1 -- 172.21.15.32:0/3328317792 >> v1:172.21.15.67:6789/0 conn(0x7fb9b40a7300 legacy=0x7fb9b41545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b1400640 1 -- 172.21.15.32:0/3328317792 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40c4e90 con 0x7fb9b4158780 2024-01-19T04:17:25.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b0a00640 1 -- 172.21.15.32:0/3328317792 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716822886 0 0) 0x7fb9b40a78d0 con 0x7fb9b40a7300 2024-01-19T04:17:25.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b1400640 1 --2- 172.21.15.32:0/3328317792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b4158780 0x7fb9b40a6dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009870 tx=0x7fb99c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba2602f742b7d99 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:25.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b0a00640 1 -- 172.21.15.32:0/3328317792 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0ab5f0 con 0x7fb9b4158780 2024-01-19T04:17:25.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b0a00640 1 -- 172.21.15.32:0/3328317792 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c0ab750 con 0x7fb9b4158780 2024-01-19T04:17:25.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.681+0000 7fb9b0a00640 1 -- 172.21.15.32:0/3328317792 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0abae0 con 0x7fb9b4158780 2024-01-19T04:17:25.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- 172.21.15.32:0/3328317792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b4158780 msgr2=0x7fb9b40a6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3328317792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b4158780 0x7fb9b40a6dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009870 tx=0x7fb99c01c540 comp rx=0 tx=0).stop 2024-01-19T04:17:25.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- 172.21.15.32:0/3328317792 shutdown_connections 2024-01-19T04:17:25.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3328317792 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b4158780 0x7fb9b40a6dc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3328317792 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b4158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- 172.21.15.32:0/3328317792 >> 172.21.15.32:0/3328317792 conn(0x7fb9b40726d0 msgr2=0x7fb9b40663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:25.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- 172.21.15.32:0/3328317792 shutdown_connections 2024-01-19T04:17:25.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- 172.21.15.32:0/3328317792 wait complete. 2024-01-19T04:17:25.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 Processor -- start 2024-01-19T04:17:25.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- start start 2024-01-19T04:17:25.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b40a7300 0x7fb9b40c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b40abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b4158780 0x7fb9b40ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c7ac0 con 0x7fb9b4158780 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c8320 con 0x7fb9b40a7300 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b9200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c62c0 con 0x7fb9b4151bc0 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b4158780 0x7fb9b40ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b4158780 0x7fb9b40ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33948/0 (socket says 172.21.15.32:33948) 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b2800640 1 -- 172.21.15.32:0/3225383931 learned_addr learned my addr 172.21.15.32:0/3225383931 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b1e00640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b40a7300 0x7fb9b40c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b1400640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b40abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b2800640 1 -- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 msgr2=0x7fb9b40abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.685+0000 7fb9b2800640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b40abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b2800640 1 -- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b40a7300 msgr2=0x7fb9b40c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b2800640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b40a7300 0x7fb9b40c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b2800640 1 -- 172.21.15.32:0/3225383931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c0094d0 con 0x7fb9b4158780 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b1e00640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b40a7300 0x7fb9b40c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b2800640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b4158780 0x7fb9b40ac990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00c780 tx=0x7fb9ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9aa000640 1 -- 172.21.15.32:0/3225383931 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00ce30 con 0x7fb9b4158780 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9aa000640 1 -- 172.21.15.32:0/3225383931 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac00a640 con 0x7fb9b4158780 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9aa000640 1 -- 172.21.15.32:0/3225383931 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00aa30 con 0x7fb9b4158780 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b40c65a0 con 0x7fb9b4158780 2024-01-19T04:17:25.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b40c7fb0 con 0x7fb9b4158780 2024-01-19T04:17:25.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b40749f0 con 0x7fb9b4158780 2024-01-19T04:17:25.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9aa000640 1 -- 172.21.15.32:0/3225383931 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb9ac00ab90 con 0x7fb9b4158780 2024-01-19T04:17:25.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9aa000640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb98c066530 0x7fb98c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:25.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9aa000640 1 -- 172.21.15.32:0/3225383931 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb9ac0835a0 con 0x7fb9b4158780 2024-01-19T04:17:25.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.689+0000 7fb9b1e00640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb98c066530 0x7fb98c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:25.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.693+0000 7fb9b1e00640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb98c066530 0x7fb98c0689f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009f50 tx=0x7fb9a4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:25.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.693+0000 7fb9aa000640 1 -- 172.21.15.32:0/3225383931 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb9ac050620 con 0x7fb9b4158780 2024-01-19T04:17:25.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9b40c8460 con 0x7fb9b4158780 2024-01-19T04:17:25.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9aa000640 1 -- 172.21.15.32:0/3225383931 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6176 (secure 0 0 0) 0x7fb9ac001770 con 0x7fb9b4158780 2024-01-19T04:17:25.895 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:25.895 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:50.950328+0000","modified":"2024-01-19T04:16:54.081170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/246892917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":246892917},{"type":"v1","addr":"172.21.15.67:6837","nonce":246892917}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:25.895 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 36 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb98c066530 msgr2=0x7fb98c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb98c066530 0x7fb98c0689f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009f50 tx=0x7fb9a4009190 comp rx=0 tx=0).stop 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b4158780 msgr2=0x7fb9b40ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b4158780 0x7fb9b40ac990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00c780 tx=0x7fb9ac00cc40 comp rx=0 tx=0).stop 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 shutdown_connections 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb98c066530 0x7fb98c0689f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b4158780 0x7fb9b40ac990 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb9b4151bc0 0x7fb9b40abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 --2- 172.21.15.32:0/3225383931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9b40a7300 0x7fb9b40c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 >> 172.21.15.32:0/3225383931 conn(0x7fb9b40726d0 msgr2=0x7fb9b415f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 shutdown_connections 2024-01-19T04:17:25.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:25.893+0000 7fb9b9200640 1 -- 172.21.15.32:0/3225383931 wait complete. 2024-01-19T04:17:25.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:26.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bf800640 1 Processor -- start 2024-01-19T04:17:26.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bf800640 1 -- start start 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bf800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f03b8151350 0x7f03b80c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bf800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b80c0810 con 0x7f03b80c55e0 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bf800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b80c0af0 con 0x7f03b8147f90 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bf800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b80c1df0 con 0x7f03b8151350 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f03b80c55e0 0x7f03b80a4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59944/0 (socket says 172.21.15.32:59944) 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7e00640 1 -- 172.21.15.32:0/585752015 learned_addr learned my addr 172.21.15.32:0/585752015 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bd800640 1 --2- 172.21.15.32:0/585752015 >> v2:172.21.15.67:3300/0 conn(0x7f03b8151350 0x7f03b80c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732961143 0 0) 0x7f03b80c0810 con 0x7f03b80c55e0 2024-01-19T04:17:26.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0398005740 con 0x7f03b80c55e0 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1546413150 0 0) 0x7f0398005740 con 0x7f03b80c55e0 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 >> v2:172.21.15.67:3300/0 conn(0x7f03b8151350 msgr2=0x7f03b80c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 --2- 172.21.15.32:0/585752015 >> v2:172.21.15.67:3300/0 conn(0x7f03b8151350 0x7f03b80c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 >> v1:172.21.15.67:6789/0 conn(0x7f03b8147f90 legacy=0x7f03b806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b80c0dd0 con 0x7f03b80c55e0 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f03a0001680 con 0x7f03b80c55e0 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 >> v1:172.21.15.32:6789/0 conn(0x7f03b80c55e0 legacy=0x7f03b80a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0398005be0 0x7f0398006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03980069e0 0x7f0398006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f039800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80c1df0 con 0x7f03980073f0 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039800e340 con 0x7f03980069e0 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039800e500 con 0x7f0398005be0 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bd800640 1 --2- 172.21.15.32:0/585752015 >> v2:172.21.15.67:3300/0 conn(0x7f03b8151350 0x7f03b80c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bd800640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f039800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03b7e00640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03980069e0 0x7f0398006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.057+0000 7f03bce00640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0398005be0 0x7f0398006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03bd800640 1 -- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0398005be0 msgr2=0x7f0398006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03bd800640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0398005be0 0x7f0398006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03bd800640 1 -- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03980069e0 msgr2=0x7f0398006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03bd800640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03980069e0 0x7f0398006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03bd800640 1 -- 172.21.15.32:0/585752015 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398005740 con 0x7f03980073f0 2024-01-19T04:17:26.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03bd800640 1 -- 172.21.15.32:0/585752015 reap_dead start 2024-01-19T04:17:26.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03bd800640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f039800dba0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f03b000e320 tx=0x7f03b001ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56e2fd93458969b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b00a5e10 con 0x7f03980073f0 2024-01-19T04:17:26.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b000f040 con 0x7f03980073f0 2024-01-19T04:17:26.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.061+0000 7f03b7400640 1 -- 172.21.15.32:0/585752015 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0003bc0 con 0x7f03980073f0 2024-01-19T04:17:26.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- 172.21.15.32:0/585752015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 msgr2=0x7f039800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f039800dba0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f03b000e320 tx=0x7f03b001ce00 comp rx=0 tx=0).stop 2024-01-19T04:17:26.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- 172.21.15.32:0/585752015 shutdown_connections 2024-01-19T04:17:26.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 --2- 172.21.15.32:0/585752015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f039800dba0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- 172.21.15.32:0/585752015 >> 172.21.15.32:0/585752015 conn(0x7f03b80c5b20 msgr2=0x7f03b80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:26.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- 172.21.15.32:0/585752015 shutdown_connections 2024-01-19T04:17:26.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- 172.21.15.32:0/585752015 wait complete. 2024-01-19T04:17:26.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 Processor -- start 2024-01-19T04:17:26.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- start start 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f03b80c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b8154e40 0x7f03b8145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03b80ab5b0 0x7f03b8145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8146740 con 0x7f03980073f0 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80aa4d0 con 0x7f03b8154e40 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bf800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8146c70 con 0x7f03b80ab5b0 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f03b80c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f03b80c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33958/0 (socket says 172.21.15.32:33958) 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.065+0000 7f03bce00640 1 -- 172.21.15.32:0/424333641 learned_addr learned my addr 172.21.15.32:0/424333641 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bd800640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03b80ab5b0 0x7f03b8145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b7e00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b8154e40 0x7f03b8145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bce00640 1 -- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03b80ab5b0 msgr2=0x7f03b8145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bce00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03b80ab5b0 0x7f03b8145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bce00640 1 -- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b8154e40 msgr2=0x7f03b8145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bce00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b8154e40 0x7f03b8145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bce00640 1 -- 172.21.15.32:0/424333641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8146990 con 0x7f03980073f0 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b7e00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b8154e40 0x7f03b8145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bce00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f03b80c4240 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f03a800f7f0 tx=0x7f03a800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b4c00640 1 -- 172.21.15.32:0/424333641 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80050d0 con 0x7f03980073f0 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b4c00640 1 -- 172.21.15.32:0/424333641 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8005230 con 0x7f03980073f0 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b80a90d0 con 0x7f03980073f0 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b4c00640 1 -- 172.21.15.32:0/424333641 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800d730 con 0x7f03980073f0 2024-01-19T04:17:26.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b81464e0 con 0x7f03980073f0 2024-01-19T04:17:26.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b80749f0 con 0x7f03980073f0 2024-01-19T04:17:26.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b4c00640 1 -- 172.21.15.32:0/424333641 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f03a800d890 con 0x7f03980073f0 2024-01-19T04:17:26.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b4c00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0390066500 0x7f03900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b4c00640 1 -- 172.21.15.32:0/424333641 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f03a8084120 con 0x7f03980073f0 2024-01-19T04:17:26.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.069+0000 7f03b7e00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0390066500 0x7f03900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.073+0000 7f03b7e00640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0390066500 0x7f03900689c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001060 tx=0x7f03a0000ff0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.073+0000 7f03b4c00640 1 -- 172.21.15.32:0/424333641 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f03a8051050 con 0x7f03980073f0 2024-01-19T04:17:26.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.241+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03b80c21d0 con 0x7f03980073f0 2024-01-19T04:17:26.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.241+0000 7f03b4c00640 1 -- 172.21.15.32:0/424333641 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20185 (secure 0 0 0) 0x7f03a8054670 con 0x7f03980073f0 2024-01-19T04:17:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:26.245 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":57,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:05.701251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:26.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0390066500 msgr2=0x7f03900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0390066500 0x7f03900689c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001060 tx=0x7f03a0000ff0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 msgr2=0x7f03b80c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f03b80c4240 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f03a800f7f0 tx=0x7f03a800fcb0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 shutdown_connections 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0390066500 0x7f03900689c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03b80ab5b0 0x7f03b8145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b8154e40 0x7f03b8145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 --2- 172.21.15.32:0/424333641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03980073f0 0x7f03b80c4240 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 >> 172.21.15.32:0/424333641 conn(0x7f03b80c5b20 msgr2=0x7f03b80726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 shutdown_connections 2024-01-19T04:17:26.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.245+0000 7f03bf800640 1 -- 172.21.15.32:0/424333641 wait complete. 2024-01-19T04:17:26.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:16:48.753748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:16:49.947198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:17:02.181700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:17:03.077640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:26.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:26.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.409+0000 7ff38a200640 1 Processor -- start 2024-01-19T04:17:26.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.409+0000 7ff38a200640 1 -- start start 2024-01-19T04:17:26.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.409+0000 7ff38a200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff384072490 0x7ff38406c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff38a200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840beed0 con 0x7ff384155520 2024-01-19T04:17:26.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff38a200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840c3a80 con 0x7ff3840bf360 2024-01-19T04:17:26.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff38a200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38406e0c0 con 0x7ff384072490 2024-01-19T04:17:26.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff383400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff384155520 0x7ff38406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59956/0 (socket says 172.21.15.32:59956) 2024-01-19T04:17:26.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff383400640 1 -- 172.21.15.32:0/902052761 learned_addr learned my addr 172.21.15.32:0/902052761 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:26.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382a00640 1 --2- 172.21.15.32:0/902052761 >> v2:172.21.15.67:3300/0 conn(0x7ff384072490 0x7ff38406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922113438 0 0) 0x7ff3840beed0 con 0x7ff384155520 2024-01-19T04:17:26.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff364003530 con 0x7ff384155520 2024-01-19T04:17:26.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115605881 0 0) 0x7ff3840c3a80 con 0x7ff3840bf360 2024-01-19T04:17:26.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3840beed0 con 0x7ff3840bf360 2024-01-19T04:17:26.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382a00640 1 -- 172.21.15.32:0/902052761 >> v1:172.21.15.67:6789/0 conn(0x7ff3840bf360 legacy=0x7ff3840a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1581718189 0 0) 0x7ff364003530 con 0x7ff384155520 2024-01-19T04:17:26.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382a00640 1 -- 172.21.15.32:0/902052761 >> v1:172.21.15.32:6789/0 conn(0x7ff384155520 legacy=0x7ff38406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.413+0000 7ff382a00640 1 -- 172.21.15.32:0/902052761 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840c3d60 con 0x7ff384072490 2024-01-19T04:17:26.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff382a00640 1 --2- 172.21.15.32:0/902052761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384072490 0x7ff38406c220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0097c0 tx=0x7ff36c01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dafea7509d3e418a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374001680 con 0x7ff384072490 2024-01-19T04:17:26.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c0a7050 con 0x7ff384072490 2024-01-19T04:17:26.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff382000640 1 -- 172.21.15.32:0/902052761 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0ab620 con 0x7ff384072490 2024-01-19T04:17:26.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 -- 172.21.15.32:0/902052761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384072490 msgr2=0x7ff38406c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 --2- 172.21.15.32:0/902052761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384072490 0x7ff38406c220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0097c0 tx=0x7ff36c01c310 comp rx=0 tx=0).stop 2024-01-19T04:17:26.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 -- 172.21.15.32:0/902052761 shutdown_connections 2024-01-19T04:17:26.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 --2- 172.21.15.32:0/902052761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384072490 0x7ff38406c220 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 -- 172.21.15.32:0/902052761 >> 172.21.15.32:0/902052761 conn(0x7ff3840c25a0 msgr2=0x7ff3840c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:26.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 -- 172.21.15.32:0/902052761 shutdown_connections 2024-01-19T04:17:26.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 -- 172.21.15.32:0/902052761 wait complete. 2024-01-19T04:17:26.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 Processor -- start 2024-01-19T04:17:26.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.417+0000 7ff38a200640 1 -- start start 2024-01-19T04:17:26.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff384072490 0x7ff38414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840bf360 0x7ff3841f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384155520 0x7ff3841f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384152200 con 0x7ff3840bf360 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38414dca0 con 0x7ff384155520 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840a4cd0 con 0x7ff384072490 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840bf360 0x7ff3841f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840bf360 0x7ff3841f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33966/0 (socket says 172.21.15.32:33966) 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 -- 172.21.15.32:0/1426347659 learned_addr learned my addr 172.21.15.32:0/1426347659 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff383400640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff384072490 0x7ff38414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff383e00640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384155520 0x7ff3841f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 -- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff384072490 msgr2=0x7ff38414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff384072490 0x7ff38414e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 -- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384155520 msgr2=0x7ff3841f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384155520 0x7ff3841f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 -- 172.21.15.32:0/1426347659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009420 con 0x7ff3840bf360 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff382a00640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840bf360 0x7ff3841f54a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0097c0 tx=0x7ff36c0190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff37b400640 1 -- 172.21.15.32:0/1426347659 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004020 con 0x7ff3840bf360 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff37b400640 1 -- 172.21.15.32:0/1426347659 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c004180 con 0x7ff3840bf360 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff37b400640 1 -- 172.21.15.32:0/1426347659 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0044f0 con 0x7ff3840bf360 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3841f6370 con 0x7ff3840bf360 2024-01-19T04:17:26.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3841f6090 con 0x7ff3840bf360 2024-01-19T04:17:26.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38414dde0 con 0x7ff3840bf360 2024-01-19T04:17:26.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.421+0000 7ff37b400640 1 -- 172.21.15.32:0/1426347659 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff36c0b2040 con 0x7ff3840bf360 2024-01-19T04:17:26.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.425+0000 7ff37b400640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff35c066500 0x7ff35c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.425+0000 7ff37b400640 1 -- 172.21.15.32:0/1426347659 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff36c11dfc0 con 0x7ff3840bf360 2024-01-19T04:17:26.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.425+0000 7ff383400640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff35c066500 0x7ff35c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.425+0000 7ff383400640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff35c066500 0x7ff35c0689c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff374001ec0 tx=0x7ff37400f5a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.429+0000 7ff37b400640 1 -- 172.21.15.32:0/1426347659 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff36c0eaf10 con 0x7ff3840bf360 2024-01-19T04:17:26.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff384155070 con 0x7ff3840bf360 2024-01-19T04:17:26.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff37b400640 1 -- 172.21.15.32:0/1426347659 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff36c0b00a0 con 0x7ff3840bf360 2024-01-19T04:17:26.591 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff35c066500 msgr2=0x7ff35c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff35c066500 0x7ff35c0689c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff374001ec0 tx=0x7ff37400f5a0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840bf360 msgr2=0x7ff3841f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840bf360 0x7ff3841f54a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0097c0 tx=0x7ff36c0190b0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 shutdown_connections 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff35c066500 0x7ff35c0689c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff384155520 0x7ff3841f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3840bf360 0x7ff3841f54a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 --2- 172.21.15.32:0/1426347659 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff384072490 0x7ff38414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 >> 172.21.15.32:0/1426347659 conn(0x7ff3840c25a0 msgr2=0x7ff3840c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:26.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 shutdown_connections 2024-01-19T04:17:26.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.589+0000 7ff38a200640 1 -- 172.21.15.32:0/1426347659 wait complete. 2024-01-19T04:17:26.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:17:26.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5f600640 1 Processor -- start 2024-01-19T04:17:26.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5f600640 1 -- start start 2024-01-19T04:17:26.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5f600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e58151e10 0x7f1e580c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5f600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5806be30 con 0x7f1e58154c50 2024-01-19T04:17:26.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5f600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e581547c0 con 0x7f1e58158620 2024-01-19T04:17:26.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5f600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e58158b20 con 0x7f1e58151e10 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5d600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1e58154c50 0x7f1e581550a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59968/0 (socket says 172.21.15.32:59968) 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5d600640 1 -- 172.21.15.32:0/4250236045 learned_addr learned my addr 172.21.15.32:0/4250236045 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5cc00640 1 --2- 172.21.15.32:0/4250236045 >> v2:172.21.15.67:3300/0 conn(0x7f1e58151e10 0x7f1e580c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e57400640 1 -- 172.21.15.32:0/4250236045 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140169094 0 0) 0x7f1e5806be30 con 0x7f1e58154c50 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e57400640 1 -- 172.21.15.32:0/4250236045 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e38003530 con 0x7f1e58154c50 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.757+0000 7f1e5cc00640 1 -- 172.21.15.32:0/4250236045 >> v1:172.21.15.67:6789/0 conn(0x7f1e58158620 legacy=0x7f1e580bf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e57400640 1 -- 172.21.15.32:0/4250236045 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294163186 0 0) 0x7f1e581547c0 con 0x7f1e58158620 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e5cc00640 1 -- 172.21.15.32:0/4250236045 >> v1:172.21.15.32:6789/0 conn(0x7f1e58154c50 legacy=0x7f1e581550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e5cc00640 1 -- 172.21.15.32:0/4250236045 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5806b870 con 0x7f1e58151e10 2024-01-19T04:17:26.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e5cc00640 1 --2- 172.21.15.32:0/4250236045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151e10 0x7f1e580c28d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e480097c0 tx=0x7f1e4801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9679e3a75ebcead0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e57400640 1 -- 172.21.15.32:0/4250236045 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48004230 con 0x7f1e58151e10 2024-01-19T04:17:26.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e57400640 1 -- 172.21.15.32:0/4250236045 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e480a7050 con 0x7f1e58151e10 2024-01-19T04:17:26.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e57400640 1 -- 172.21.15.32:0/4250236045 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48003620 con 0x7f1e58151e10 2024-01-19T04:17:26.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e5f600640 1 -- 172.21.15.32:0/4250236045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151e10 msgr2=0x7f1e580c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.761+0000 7f1e5f600640 1 --2- 172.21.15.32:0/4250236045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151e10 0x7f1e580c28d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e480097c0 tx=0x7f1e4801c3c0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- 172.21.15.32:0/4250236045 shutdown_connections 2024-01-19T04:17:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 --2- 172.21.15.32:0/4250236045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151e10 0x7f1e580c28d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- 172.21.15.32:0/4250236045 >> 172.21.15.32:0/4250236045 conn(0x7f1e580a8220 msgr2=0x7f1e580a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- 172.21.15.32:0/4250236045 shutdown_connections 2024-01-19T04:17:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- 172.21.15.32:0/4250236045 wait complete. 2024-01-19T04:17:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 Processor -- start 2024-01-19T04:17:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- start start 2024-01-19T04:17:26.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e58151e10 0x7f1e581ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58154c50 0x7f1e580c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58158620 0x7f1e58155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e58153060 con 0x7f1e58158620 2024-01-19T04:17:26.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e58145350 con 0x7f1e58154c50 2024-01-19T04:17:26.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5f600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581ecd90 con 0x7f1e58151e10 2024-01-19T04:17:26.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58158620 0x7f1e58155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e57e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58154c50 0x7f1e580c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5cc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e58151e10 0x7f1e581ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e57e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58154c50 0x7f1e580c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:49836/0 (socket says 172.21.15.32:49836) 2024-01-19T04:17:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e57e00640 1 -- 172.21.15.32:0/257493773 learned_addr learned my addr 172.21.15.32:0/257493773 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5d600640 1 -- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e58151e10 msgr2=0x7f1e581ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5d600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e58151e10 0x7f1e581ed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5d600640 1 -- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58154c50 msgr2=0x7f1e580c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5d600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58154c50 0x7f1e580c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5d600640 1 -- 172.21.15.32:0/257493773 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48009420 con 0x7f1e58158620 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.765+0000 7f1e5cc00640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e58151e10 0x7f1e581ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e5d600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58158620 0x7f1e58155a10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ca50 tx=0x7f1e5000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e54c00640 1 -- 172.21.15.32:0/257493773 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000abb0 con 0x7f1e58158620 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e54c00640 1 -- 172.21.15.32:0/257493773 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5000ad10 con 0x7f1e58158620 2024-01-19T04:17:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e54c00640 1 -- 172.21.15.32:0/257493773 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50012600 con 0x7f1e58158620 2024-01-19T04:17:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e580c5fc0 con 0x7f1e58158620 2024-01-19T04:17:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e581541d0 con 0x7f1e58158620 2024-01-19T04:17:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e581ecf00 con 0x7f1e58158620 2024-01-19T04:17:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.769+0000 7f1e54c00640 1 -- 172.21.15.32:0/257493773 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1e50007070 con 0x7f1e58158620 2024-01-19T04:17:26.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.773+0000 7f1e54c00640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:26.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.773+0000 7f1e54c00640 1 -- 172.21.15.32:0/257493773 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1e50083f10 con 0x7f1e58158620 2024-01-19T04:17:26.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.773+0000 7f1e5cc00640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:26.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.773+0000 7f1e5cc00640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1e480ad000 tx=0x7f1e48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:26.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.777+0000 7f1e54c00640 1 -- 172.21.15.32:0/257493773 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1e50050f90 con 0x7f1e58158620 2024-01-19T04:17:26.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e580749f0 con 0x7f1e58158620 2024-01-19T04:17:26.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e54c00640 1 -- 172.21.15.32:0/257493773 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e500170a0 con 0x7f1e58158620 2024-01-19T04:17:26.939 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:26.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 msgr2=0x7f1e300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1e480ad000 tx=0x7f1e48008040 comp rx=0 tx=0).stop 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58158620 msgr2=0x7f1e58155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58158620 0x7f1e58155a10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ca50 tx=0x7f1e5000cf10 comp rx=0 tx=0).stop 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 shutdown_connections 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58158620 0x7f1e58155a10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58154c50 0x7f1e580c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 --2- 172.21.15.32:0/257493773 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e58151e10 0x7f1e581ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 >> 172.21.15.32:0/257493773 conn(0x7f1e580a8220 msgr2=0x7f1e581510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 shutdown_connections 2024-01-19T04:17:26.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:26.937+0000 7f1e5f600640 1 -- 172.21.15.32:0/257493773 wait complete. 2024-01-19T04:17:26.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:17:27.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f892a200640 1 Processor -- start 2024-01-19T04:17:27.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f892a200640 1 -- start start 2024-01-19T04:17:27.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f892a200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89240c8290 0x7f89240a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f892a200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8924154650 0x7f8924154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f892a200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8924157d60 con 0x7f89240c1bc0 2024-01-19T04:17:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f892a200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8924158040 con 0x7f89240c8290 2024-01-19T04:17:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f892a200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8924158320 con 0x7f8924154650 2024-01-19T04:17:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89240c8290 0x7f89240a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89240c8290 0x7f89240a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33996/0 (socket says 172.21.15.32:33996) 2024-01-19T04:17:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923400640 1 -- 172.21.15.32:0/832078780 learned_addr learned my addr 172.21.15.32:0/832078780 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:27.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923e00640 1 --2- 172.21.15.32:0/832078780 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8924154650 0x7f8924154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923400640 1 -- 172.21.15.32:0/832078780 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8924154650 msgr2=0x7f8924154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:27.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923400640 1 --2- 172.21.15.32:0/832078780 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8924154650 0x7f8924154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923400640 1 -- 172.21.15.32:0/832078780 >> v1:172.21.15.67:6789/0 conn(0x7f89240c1bc0 legacy=0x7f892406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.101+0000 7f8923400640 1 -- 172.21.15.32:0/832078780 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924158600 con 0x7f89240c8290 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f8923400640 1 --2- 172.21.15.32:0/832078780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89240c8290 0x7f89240a7190 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f89140098a0 tx=0x7f891401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bce60bd052fe7f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f8922000640 1 -- 172.21.15.32:0/832078780 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89140ac640 con 0x7f89240c8290 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f8922000640 1 -- 172.21.15.32:0/832078780 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89140ac7a0 con 0x7f89240c8290 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f8922000640 1 -- 172.21.15.32:0/832078780 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89140acb30 con 0x7f89240c8290 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 -- 172.21.15.32:0/832078780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89240c8290 msgr2=0x7f89240a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 --2- 172.21.15.32:0/832078780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89240c8290 0x7f89240a7190 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f89140098a0 tx=0x7f891401c400 comp rx=0 tx=0).stop 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 -- 172.21.15.32:0/832078780 shutdown_connections 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 --2- 172.21.15.32:0/832078780 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8924154650 0x7f8924154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 --2- 172.21.15.32:0/832078780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89240c8290 0x7f89240a7190 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 -- 172.21.15.32:0/832078780 >> 172.21.15.32:0/832078780 conn(0x7f89240726d0 msgr2=0x7f89240663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 -- 172.21.15.32:0/832078780 shutdown_connections 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.105+0000 7f892a200640 1 -- 172.21.15.32:0/832078780 wait complete. 2024-01-19T04:17:27.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 Processor -- start 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 -- start start 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89240c1bc0 0x7f89241514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89240c8290 0x7f89241eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8924154650 0x7f89241f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240a92f0 con 0x7f8924154650 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240a98b0 con 0x7f89240c8290 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240a6e30 con 0x7f89240c1bc0 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8924154650 0x7f89241f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8924154650 0x7f89241f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33998/0 (socket says 172.21.15.32:33998) 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 -- 172.21.15.32:0/4075805539 learned_addr learned my addr 172.21.15.32:0/4075805539 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8922a00640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89240c8290 0x7f89241eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923400640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89240c1bc0 0x7f89241514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 -- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89240c1bc0 msgr2=0x7f89241514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89240c1bc0 0x7f89241514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 -- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89240c8290 msgr2=0x7f89241eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89240c8290 0x7f89241eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 -- 172.21.15.32:0/4075805539 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140094d0 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f8923e00640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8924154650 0x7f89241f0480 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f891c007e40 tx=0x7f891c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f891b400640 1 -- 172.21.15.32:0/4075805539 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c014620 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f891b400640 1 -- 172.21.15.32:0/4075805539 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c00ee90 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f891b400640 1 -- 172.21.15.32:0/4075805539 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0149e0 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89240a7110 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.109+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89241519e0 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.113+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89241efd00 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.113+0000 7f891b400640 1 -- 172.21.15.32:0/4075805539 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f891c014b40 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.113+0000 7f891b400640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f88fc066530 0x7f88fc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.113+0000 7f891b400640 1 -- 172.21.15.32:0/4075805539 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f891c084a10 con 0x7f8924154650 2024-01-19T04:17:27.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.113+0000 7f8923400640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f88fc066530 0x7f88fc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.113+0000 7f8923400640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f88fc066530 0x7f88fc0689f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89140ae000 tx=0x7f89140a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.117+0000 7f891b400640 1 -- 172.21.15.32:0/4075805539 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f891c0519f0 con 0x7f8924154650 2024-01-19T04:17:27.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.277+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89240749f0 con 0x7f8924154650 2024-01-19T04:17:27.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.277+0000 7f891b400640 1 -- 172.21.15.32:0/4075805539 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7f891c055010 con 0x7f8924154650 2024-01-19T04:17:27.281 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:27.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f88fc066530 msgr2=0x7f88fc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f88fc066530 0x7f88fc0689f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89140ae000 tx=0x7f89140a6070 comp rx=0 tx=0).stop 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8924154650 msgr2=0x7f89241f0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8924154650 0x7f89241f0480 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f891c007e40 tx=0x7f891c00e4b0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 shutdown_connections 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f88fc066530 0x7f88fc0689f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8924154650 0x7f89241f0480 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89240c8290 0x7f89241eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 --2- 172.21.15.32:0/4075805539 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f89240c1bc0 0x7f89241514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 >> 172.21.15.32:0/4075805539 conn(0x7f89240726d0 msgr2=0x7f8924152290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 shutdown_connections 2024-01-19T04:17:27.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.281+0000 7f892a200640 1 -- 172.21.15.32:0/4075805539 wait complete. 2024-01-19T04:17:27.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:17:27.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a95400640 1 Processor -- start 2024-01-19T04:17:27.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a95400640 1 -- start start 2024-01-19T04:17:27.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a95400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9a900c8290 0x7f9a900a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a95400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c1bc0 0x7f9a9006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a95400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a90157d60 con 0x7f9a9006fe50 2024-01-19T04:17:27.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a95400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a90158040 con 0x7f9a900c8290 2024-01-19T04:17:27.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a95400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90158320 con 0x7f9a900c1bc0 2024-01-19T04:17:27.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9a900c8290 0x7f9a900a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9a900c8290 0x7f9a900a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34006/0 (socket says 172.21.15.32:34006) 2024-01-19T04:17:27.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8e800640 1 -- 172.21.15.32:0/2313526470 learned_addr learned my addr 172.21.15.32:0/2313526470 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:27.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8de00640 1 --2- 172.21.15.32:0/2313526470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c1bc0 0x7f9a9006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8e800640 1 -- 172.21.15.32:0/2313526470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c1bc0 msgr2=0x7f9a9006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:27.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8e800640 1 --2- 172.21.15.32:0/2313526470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c1bc0 0x7f9a9006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8e800640 1 -- 172.21.15.32:0/2313526470 >> v1:172.21.15.67:6789/0 conn(0x7f9a9006fe50 legacy=0x7f9a90154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:27.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.445+0000 7f9a8e800640 1 -- 172.21.15.32:0/2313526470 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90158600 con 0x7f9a900c8290 2024-01-19T04:17:27.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a8e800640 1 --2- 172.21.15.32:0/2313526470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c8290 0x7f9a900a7190 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009870 tx=0x7f9a8001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd96ccddf86fa1d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a8d400640 1 -- 172.21.15.32:0/2313526470 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ab600 con 0x7f9a900c8290 2024-01-19T04:17:27.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a8d400640 1 -- 172.21.15.32:0/2313526470 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a800a7050 con 0x7f9a900c8290 2024-01-19T04:17:27.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a8d400640 1 -- 172.21.15.32:0/2313526470 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ab980 con 0x7f9a900c8290 2024-01-19T04:17:27.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 -- 172.21.15.32:0/2313526470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c8290 msgr2=0x7f9a900a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 --2- 172.21.15.32:0/2313526470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c8290 0x7f9a900a7190 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009870 tx=0x7f9a8001c470 comp rx=0 tx=0).stop 2024-01-19T04:17:27.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 -- 172.21.15.32:0/2313526470 shutdown_connections 2024-01-19T04:17:27.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 --2- 172.21.15.32:0/2313526470 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c1bc0 0x7f9a9006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 --2- 172.21.15.32:0/2313526470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c8290 0x7f9a900a7190 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 -- 172.21.15.32:0/2313526470 >> 172.21.15.32:0/2313526470 conn(0x7f9a900726d0 msgr2=0x7f9a900663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:27.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 -- 172.21.15.32:0/2313526470 shutdown_connections 2024-01-19T04:17:27.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.449+0000 7f9a95400640 1 -- 172.21.15.32:0/2313526470 wait complete. 2024-01-19T04:17:27.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 Processor -- start 2024-01-19T04:17:27.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 -- start start 2024-01-19T04:17:27.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9006fe50 0x7f9a90156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c1bc0 0x7f9a9014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c8290 0x7f9a900ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9015d040 con 0x7f9a900c1bc0 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a901ed280 con 0x7f9a9006fe50 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a901ed560 con 0x7f9a900c8290 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c1bc0 0x7f9a9014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c1bc0 0x7f9a9014ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34016/0 (socket says 172.21.15.32:34016) 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 -- 172.21.15.32:0/1463301210 learned_addr learned my addr 172.21.15.32:0/1463301210 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8e800640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9006fe50 0x7f9a90156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8f200640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c8290 0x7f9a900ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 -- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c8290 msgr2=0x7f9a900ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c8290 0x7f9a900ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 -- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9006fe50 msgr2=0x7f9a90156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9006fe50 0x7f9a90156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 -- 172.21.15.32:0/1463301210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800094d0 con 0x7f9a900c1bc0 2024-01-19T04:17:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a8de00640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c1bc0 0x7f9a9014ebf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d800 tx=0x7f9a7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a86a00640 1 -- 172.21.15.32:0/1463301210 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800b6c0 con 0x7f9a900c1bc0 2024-01-19T04:17:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a86a00640 1 -- 172.21.15.32:0/1463301210 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7800b860 con 0x7f9a900c1bc0 2024-01-19T04:17:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a901ed840 con 0x7f9a900c1bc0 2024-01-19T04:17:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a86a00640 1 -- 172.21.15.32:0/1463301210 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800bc10 con 0x7f9a900c1bc0 2024-01-19T04:17:27.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.453+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a901ede00 con 0x7f9a900c1bc0 2024-01-19T04:17:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.457+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a901ee020 con 0x7f9a900c1bc0 2024-01-19T04:17:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.457+0000 7f9a86a00640 1 -- 172.21.15.32:0/1463301210 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9a7801e460 con 0x7f9a900c1bc0 2024-01-19T04:17:27.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.457+0000 7f9a86a00640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a68066530 0x7f9a680689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.457+0000 7f9a86a00640 1 -- 172.21.15.32:0/1463301210 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9a78084710 con 0x7f9a900c1bc0 2024-01-19T04:17:27.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.457+0000 7f9a8e800640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a68066530 0x7f9a680689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.461+0000 7f9a8e800640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a68066530 0x7f9a680689f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ad000 tx=0x7f9a800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.461+0000 7f9a86a00640 1 -- 172.21.15.32:0/1463301210 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9a78051660 con 0x7f9a900c1bc0 2024-01-19T04:17:27.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.621+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a900749f0 con 0x7f9a900c1bc0 2024-01-19T04:17:27.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.621+0000 7f9a86a00640 1 -- 172.21.15.32:0/1463301210 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9a78054c80 con 0x7f9a900c1bc0 2024-01-19T04:17:27.626 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a68066530 msgr2=0x7f9a680689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a68066530 0x7f9a680689f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ad000 tx=0x7f9a800a6000 comp rx=0 tx=0).stop 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c1bc0 msgr2=0x7f9a9014ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c1bc0 0x7f9a9014ebf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d800 tx=0x7f9a7800dcc0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 shutdown_connections 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9a68066530 0x7f9a680689f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9a900c8290 0x7f9a900ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a900c1bc0 0x7f9a9014ebf0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 --2- 172.21.15.32:0/1463301210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9006fe50 0x7f9a90156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 >> 172.21.15.32:0/1463301210 conn(0x7f9a900726d0 msgr2=0x7f9a9006c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:27.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 shutdown_connections 2024-01-19T04:17:27.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.625+0000 7f9a95400640 1 -- 172.21.15.32:0/1463301210 wait complete. 2024-01-19T04:17:27.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:17:27.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.789+0000 7f8105a00640 1 Processor -- start 2024-01-19T04:17:27.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.789+0000 7f8105a00640 1 -- start start 2024-01-19T04:17:27.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f8105a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f810014eab0 0x7f81000abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f8105a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100154a00 0x7f8100154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f8105a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81001514b0 con 0x7f8100070e90 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f8105a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8100151790 con 0x7f810014eab0 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f8105a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8100151a70 con 0x7f8100154a00 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80ff400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100154a00 0x7f8100154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80fea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f810014eab0 0x7f81000abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80ff400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100154a00 0x7f8100154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:34176/0 (socket says 172.21.15.32:34176) 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80ff400640 1 -- 172.21.15.32:0/1100564438 learned_addr learned my addr 172.21.15.32:0/1100564438 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:27.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80fe000640 1 --1- 172.21.15.32:0/1100564438 >> v1:172.21.15.67:6789/0 conn(0x7f8100070e90 0x7f8100071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:42466/0 (socket says 172.21.15.32:42466) 2024-01-19T04:17:27.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80ff400640 1 -- 172.21.15.32:0/1100564438 >> v2:172.21.15.67:3300/0 conn(0x7f810014eab0 msgr2=0x7f81000abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:27.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80ff400640 1 --2- 172.21.15.32:0/1100564438 >> v2:172.21.15.67:3300/0 conn(0x7f810014eab0 0x7f81000abd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80ff400640 1 -- 172.21.15.32:0/1100564438 >> v1:172.21.15.67:6789/0 conn(0x7f8100070e90 legacy=0x7f8100071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.793+0000 7f80ff400640 1 -- 172.21.15.32:0/1100564438 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100151d50 con 0x7f8100154a00 2024-01-19T04:17:27.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f80ff400640 1 --2- 172.21.15.32:0/1100564438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100154a00 0x7f8100154e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009870 tx=0x7f80f801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ca7f04038a86b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f80fd600640 1 -- 172.21.15.32:0/1100564438 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80ad640 con 0x7f8100154a00 2024-01-19T04:17:27.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f80fd600640 1 -- 172.21.15.32:0/1100564438 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f80ad7a0 con 0x7f8100154a00 2024-01-19T04:17:27.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f80fd600640 1 -- 172.21.15.32:0/1100564438 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80adb30 con 0x7f8100154a00 2024-01-19T04:17:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 -- 172.21.15.32:0/1100564438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100154a00 msgr2=0x7f8100154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 --2- 172.21.15.32:0/1100564438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100154a00 0x7f8100154e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009870 tx=0x7f80f801c480 comp rx=0 tx=0).stop 2024-01-19T04:17:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 -- 172.21.15.32:0/1100564438 shutdown_connections 2024-01-19T04:17:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 --2- 172.21.15.32:0/1100564438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100154a00 0x7f8100154e30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 --2- 172.21.15.32:0/1100564438 >> v2:172.21.15.67:3300/0 conn(0x7f810014eab0 0x7f81000abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 -- 172.21.15.32:0/1100564438 >> 172.21.15.32:0/1100564438 conn(0x7f810006a6a0 msgr2=0x7f810006aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:27.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 -- 172.21.15.32:0/1100564438 shutdown_connections 2024-01-19T04:17:27.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 -- 172.21.15.32:0/1100564438 wait complete. 2024-01-19T04:17:27.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 Processor -- start 2024-01-19T04:17:27.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.797+0000 7f8105a00640 1 -- start start 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100070e90 0x7f810006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810014eab0 0x7f810014cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8100154a00 0x7f810014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8100153f40 con 0x7f8100154a00 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810014d560 con 0x7f810014eab0 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81001538a0 con 0x7f8100070e90 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8100154a00 0x7f810014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8100154a00 0x7f810014d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56820/0 (socket says 172.21.15.32:56820) 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 -- 172.21.15.32:0/2658055916 learned_addr learned my addr 172.21.15.32:0/2658055916 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80fe000640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810014eab0 0x7f810014cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80fea00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100070e90 0x7f810006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 -- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100070e90 msgr2=0x7f810006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100070e90 0x7f810006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 -- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810014eab0 msgr2=0x7f810014cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810014eab0 0x7f810014cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 -- 172.21.15.32:0/2658055916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80094d0 con 0x7f8100154a00 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80ff400640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8100154a00 0x7f810014d020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f80f80b0040 tx=0x7f80f8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80f6a00640 1 -- 172.21.15.32:0/2658055916 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80b8680 con 0x7f8100154a00 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80f6a00640 1 -- 172.21.15.32:0/2658055916 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f80a6040 con 0x7f8100154a00 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f80f6a00640 1 -- 172.21.15.32:0/2658055916 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80b8a00 con 0x7f8100154a00 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81001ed960 con 0x7f8100154a00 2024-01-19T04:17:27.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81001edc40 con 0x7f8100154a00 2024-01-19T04:17:27.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.801+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81000749f0 con 0x7f8100154a00 2024-01-19T04:17:27.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.805+0000 7f80f6a00640 1 -- 172.21.15.32:0/2658055916 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f80f80b8b60 con 0x7f8100154a00 2024-01-19T04:17:27.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.805+0000 7f80f6a00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f80d8066500 0x7f80d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:27.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.805+0000 7f80f6a00640 1 -- 172.21.15.32:0/2658055916 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f80f811eb40 con 0x7f8100154a00 2024-01-19T04:17:27.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.805+0000 7f80fea00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f80d8066500 0x7f80d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:27.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.805+0000 7f80fea00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f80d8066500 0x7f80d80689c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f80f00113e0 tx=0x7f80f000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:27.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.809+0000 7f80f6a00640 1 -- 172.21.15.32:0/2658055916 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f80f80ebb30 con 0x7f8100154a00 2024-01-19T04:17:27.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.965+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f81000c1bc0 con 0x7f8100154a00 2024-01-19T04:17:27.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.965+0000 7f80f6a00640 1 -- 172.21.15.32:0/2658055916 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7f80f80b20a0 con 0x7f8100154a00 2024-01-19T04:17:27.969 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:27.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f80d8066500 msgr2=0x7f80d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f80d8066500 0x7f80d80689c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f80f00113e0 tx=0x7f80f000b040 comp rx=0 tx=0).stop 2024-01-19T04:17:27.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8100154a00 msgr2=0x7f810014d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:27.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8100154a00 0x7f810014d020 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f80f80b0040 tx=0x7f80f8019220 comp rx=0 tx=0).stop 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 shutdown_connections 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f80d8066500 0x7f80d80689c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8100154a00 0x7f810014d020 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f810014eab0 0x7f810014cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 --2- 172.21.15.32:0/2658055916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8100070e90 0x7f810006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 >> 172.21.15.32:0/2658055916 conn(0x7f810006a6a0 msgr2=0x7f81000c3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 shutdown_connections 2024-01-19T04:17:27.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:27.969+0000 7f8105a00640 1 -- 172.21.15.32:0/2658055916 wait complete. 2024-01-19T04:17:27.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:28.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe82c00640 1 Processor -- start 2024-01-19T04:17:28.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe82c00640 1 -- start start 2024-01-19T04:17:28.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe82c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe7c0a7200 0x7fbe7c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe82c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c0c41f0 0x7fbe7c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe82c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c1547e0 con 0x7fbe7c151de0 2024-01-19T04:17:28.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe82c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c1521c0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe82c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c06f820 con 0x7fbe7c0c41f0 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe80c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c0c41f0 0x7fbe7c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe7b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe7c0a7200 0x7fbe7c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe80c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c0c41f0 0x7fbe7c154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:34190/0 (socket says 172.21.15.32:34190) 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe80c00640 1 -- 172.21.15.32:0/1508190090 learned_addr learned my addr 172.21.15.32:0/1508190090 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe80c00640 1 -- 172.21.15.32:0/1508190090 >> v2:172.21.15.67:3300/0 conn(0x7fbe7c0a7200 msgr2=0x7fbe7c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe80c00640 1 --2- 172.21.15.32:0/1508190090 >> v2:172.21.15.67:3300/0 conn(0x7fbe7c0a7200 0x7fbe7c0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.129+0000 7fbe80c00640 1 -- 172.21.15.32:0/1508190090 >> v1:172.21.15.67:6789/0 conn(0x7fbe7c151de0 legacy=0x7fbe7c0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.133+0000 7fbe80c00640 1 -- 172.21.15.32:0/1508190090 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c06fb00 con 0x7fbe7c0c41f0 2024-01-19T04:17:28.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.133+0000 7fbe80c00640 1 --2- 172.21.15.32:0/1508190090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c0c41f0 0x7fbe7c154c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009e50 tx=0x7fbe7401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3273d4755b344184 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.133+0000 7fbe7aa00640 1 -- 172.21.15.32:0/1508190090 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a5720 con 0x7fbe7c0c41f0 2024-01-19T04:17:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.133+0000 7fbe7aa00640 1 -- 172.21.15.32:0/1508190090 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740a5880 con 0x7fbe7c0c41f0 2024-01-19T04:17:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.133+0000 7fbe7aa00640 1 -- 172.21.15.32:0/1508190090 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a5c10 con 0x7fbe7c0c41f0 2024-01-19T04:17:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.133+0000 7fbe82c00640 1 -- 172.21.15.32:0/1508190090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c0c41f0 msgr2=0x7fbe7c154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.133+0000 7fbe82c00640 1 --2- 172.21.15.32:0/1508190090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c0c41f0 0x7fbe7c154c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009e50 tx=0x7fbe7401c950 comp rx=0 tx=0).stop 2024-01-19T04:17:28.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- 172.21.15.32:0/1508190090 shutdown_connections 2024-01-19T04:17:28.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 --2- 172.21.15.32:0/1508190090 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c0c41f0 0x7fbe7c154c70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 --2- 172.21.15.32:0/1508190090 >> v2:172.21.15.67:3300/0 conn(0x7fbe7c0a7200 0x7fbe7c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- 172.21.15.32:0/1508190090 >> 172.21.15.32:0/1508190090 conn(0x7fbe7c0726d0 msgr2=0x7fbe7c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:28.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- 172.21.15.32:0/1508190090 shutdown_connections 2024-01-19T04:17:28.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- 172.21.15.32:0/1508190090 wait complete. 2024-01-19T04:17:28.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 Processor -- start 2024-01-19T04:17:28.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- start start 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe7c0a7200 0x7fbe7c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe7c0c41f0 0x7fbe7c06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c151de0 0x7fbe7c0aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0a9ca0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0a7f70 con 0x7fbe7c0c41f0 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe82c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0ac210 con 0x7fbe7c151de0 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe7c0a7200 0x7fbe7c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe7c0a7200 0x7fbe7c14df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56832/0 (socket says 172.21.15.32:56832) 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 -- 172.21.15.32:0/3428605629 learned_addr learned my addr 172.21.15.32:0/3428605629 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7b400640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe7c0c41f0 0x7fbe7c06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe80c00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c151de0 0x7fbe7c0aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 -- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c151de0 msgr2=0x7fbe7c0aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c151de0 0x7fbe7c0aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 -- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe7c0c41f0 msgr2=0x7fbe7c06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe7c0c41f0 0x7fbe7c06ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 -- 172.21.15.32:0/3428605629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74009b30 con 0x7fbe7c0a7200 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.137+0000 7fbe7be00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe7c0a7200 0x7fbe7c14df20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c370 tx=0x7fbe6c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe73e00640 1 -- 172.21.15.32:0/3428605629 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0052d0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe73e00640 1 -- 172.21.15.32:0/3428605629 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c005430 con 0x7fbe7c0a7200 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe73e00640 1 -- 172.21.15.32:0/3428605629 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c007260 con 0x7fbe7c0a7200 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c1587e0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c06cfa0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0749f0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe73e00640 1 -- 172.21.15.32:0/3428605629 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbe6c0073c0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe73e00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbe54066500 0x7fbe540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe73e00640 1 -- 172.21.15.32:0/3428605629 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbe6c0834f0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.141+0000 7fbe7b400640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbe54066500 0x7fbe540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.145+0000 7fbe7b400640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbe54066500 0x7fbe540689c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c153fb0 tx=0x7fbe64009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.145+0000 7fbe73e00640 1 -- 172.21.15.32:0/3428605629 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbe6c0504d0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.337+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe7c066ee0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe73e00640 1 -- 172.21.15.32:0/3428605629 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6176 (secure 0 0 0) 0x7fbe6c053af0 con 0x7fbe7c0a7200 2024-01-19T04:17:28.342 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:28.342 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:50.950328+0000","modified":"2024-01-19T04:16:54.081170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/246892917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":246892917},{"type":"v1","addr":"172.21.15.67:6837","nonce":246892917}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:28.342 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 36 2024-01-19T04:17:28.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbe54066500 msgr2=0x7fbe540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbe54066500 0x7fbe540689c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c153fb0 tx=0x7fbe64009190 comp rx=0 tx=0).stop 2024-01-19T04:17:28.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe7c0a7200 msgr2=0x7fbe7c14df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe7c0a7200 0x7fbe7c14df20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c370 tx=0x7fbe6c00c830 comp rx=0 tx=0).stop 2024-01-19T04:17:28.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 shutdown_connections 2024-01-19T04:17:28.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbe54066500 0x7fbe540689c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbe7c151de0 0x7fbe7c0aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe7c0c41f0 0x7fbe7c06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 --2- 172.21.15.32:0/3428605629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe7c0a7200 0x7fbe7c14df20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 >> 172.21.15.32:0/3428605629 conn(0x7fbe7c0726d0 msgr2=0x7fbe7c151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:28.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 shutdown_connections 2024-01-19T04:17:28.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.341+0000 7fbe82c00640 1 -- 172.21.15.32:0/3428605629 wait complete. 2024-01-19T04:17:28.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.501+0000 7f28cfa00640 1 Processor -- start 2024-01-19T04:17:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.501+0000 7f28cfa00640 1 -- start start 2024-01-19T04:17:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.501+0000 7f28cfa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28c80a4ec0 0x7f28c815df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.501+0000 7f28cfa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c8071e80 con 0x7f28c80c04a0 2024-01-19T04:17:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.501+0000 7f28cfa00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80726c0 con 0x7f28c814fb50 2024-01-19T04:17:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.501+0000 7f28cfa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c81535c0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28cda00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28c80a4ec0 0x7f28c815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28c7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f28c80c04a0 0x7f28c80c1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55370/0 (socket says 172.21.15.32:55370) 2024-01-19T04:17:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28c7e00640 1 -- 172.21.15.32:0/1302144679 learned_addr learned my addr 172.21.15.32:0/1302144679 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:28.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28cda00640 1 -- 172.21.15.32:0/1302144679 >> v1:172.21.15.67:6789/0 conn(0x7f28c814fb50 legacy=0x7f28c806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28cda00640 1 -- 172.21.15.32:0/1302144679 >> v1:172.21.15.32:6789/0 conn(0x7f28c80c04a0 legacy=0x7f28c80c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28cda00640 1 -- 172.21.15.32:0/1302144679 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80c0a20 con 0x7f28c80a4ec0 2024-01-19T04:17:28.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28c7400640 1 -- 172.21.15.32:0/1302144679 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094966850 0 0) 0x7f28c8071e80 con 0x7f28c80c04a0 2024-01-19T04:17:28.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28cda00640 1 --2- 172.21.15.32:0/1302144679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c815df10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009d90 tx=0x7f28c001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e9267942170fe4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28c7400640 1 -- 172.21.15.32:0/1302144679 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00a5890 con 0x7f28c80a4ec0 2024-01-19T04:17:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28c7400640 1 -- 172.21.15.32:0/1302144679 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00a59f0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.505+0000 7f28c7400640 1 -- 172.21.15.32:0/1302144679 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00a5d80 con 0x7f28c80a4ec0 2024-01-19T04:17:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- 172.21.15.32:0/1302144679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 msgr2=0x7f28c815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 --2- 172.21.15.32:0/1302144679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c815df10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009d90 tx=0x7f28c001c8c0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- 172.21.15.32:0/1302144679 shutdown_connections 2024-01-19T04:17:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 --2- 172.21.15.32:0/1302144679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c815df10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- 172.21.15.32:0/1302144679 >> 172.21.15.32:0/1302144679 conn(0x7f28c80c5b20 msgr2=0x7f28c80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- 172.21.15.32:0/1302144679 shutdown_connections 2024-01-19T04:17:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- 172.21.15.32:0/1302144679 wait complete. 2024-01-19T04:17:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 Processor -- start 2024-01-19T04:17:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- start start 2024-01-19T04:17:28.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c8141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c80c04a0 0x7f28c813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28c814fb50 0x7f28c81402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c81f1050 con 0x7f28c80a4ec0 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c81407e0 con 0x7f28c80c04a0 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cfa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c806c0e0 con 0x7f28c814fb50 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cd000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c8141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cd000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c8141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56864/0 (socket says 172.21.15.32:56864) 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cd000640 1 -- 172.21.15.32:0/2500293521 learned_addr learned my addr 172.21.15.32:0/2500293521 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28c7e00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c80c04a0 0x7f28c813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.509+0000 7f28cda00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28c814fb50 0x7f28c81402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cd000640 1 -- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28c814fb50 msgr2=0x7f28c81402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cd000640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28c814fb50 0x7f28c81402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cd000640 1 -- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c80c04a0 msgr2=0x7f28c813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cd000640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c80c04a0 0x7f28c813fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cd000640 1 -- 172.21.15.32:0/2500293521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0009a70 con 0x7f28c80a4ec0 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cd000640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c8141170 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f28b800c3c0 tx=0x7f28b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28c4c00640 1 -- 172.21.15.32:0/2500293521 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b80052d0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28c4c00640 1 -- 172.21.15.32:0/2500293521 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8005430 con 0x7f28c80a4ec0 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28c4c00640 1 -- 172.21.15.32:0/2500293521 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8003840 con 0x7f28c80a4ec0 2024-01-19T04:17:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c8148fb0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c8148cd0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c80749f0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28c4c00640 1 -- 172.21.15.32:0/2500293521 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f28b80039a0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28c4c00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f28a0066500 0x7f28a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.513+0000 7f28c4c00640 1 -- 172.21.15.32:0/2500293521 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f28b8083730 con 0x7f28c80a4ec0 2024-01-19T04:17:28.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.517+0000 7f28c7e00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f28a0066500 0x7f28a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.517+0000 7f28c7e00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f28a0066500 0x7f28a00689c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f28c80c69f0 tx=0x7f28b0007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.517+0000 7f28c4c00640 1 -- 172.21.15.32:0/2500293521 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f28b8050680 con 0x7f28c80a4ec0 2024-01-19T04:17:28.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.677+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28c806beb0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28c4c00640 1 -- 172.21.15.32:0/2500293521 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20185 (secure 0 0 0) 0x7f28b8053ca0 con 0x7f28c80a4ec0 2024-01-19T04:17:28.682 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:28.682 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":57,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:05.701251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:28.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f28a0066500 msgr2=0x7f28a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f28a0066500 0x7f28a00689c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f28c80c69f0 tx=0x7f28b0007240 comp rx=0 tx=0).stop 2024-01-19T04:17:28.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 msgr2=0x7f28c8141170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c8141170 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f28b800c3c0 tx=0x7f28b800c880 comp rx=0 tx=0).stop 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 shutdown_connections 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f28a0066500 0x7f28a00689c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f28c814fb50 0x7f28c81402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c80c04a0 0x7f28c813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 --2- 172.21.15.32:0/2500293521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28c80a4ec0 0x7f28c8141170 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 >> 172.21.15.32:0/2500293521 conn(0x7f28c80c5b20 msgr2=0x7f28c806fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 shutdown_connections 2024-01-19T04:17:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.681+0000 7f28cfa00640 1 -- 172.21.15.32:0/2500293521 wait complete. 2024-01-19T04:17:28.704 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T04:17:28.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc4400640 1 Processor -- start 2024-01-19T04:17:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc4400640 1 -- start start 2024-01-19T04:17:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc4400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3bbc0c42b0 0x7f3bbc0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc4400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0c0c90 con 0x7f3bbc0c1120 2024-01-19T04:17:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc4400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc150cb0 con 0x7f3bbc0c5740 2024-01-19T04:17:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc4400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc150f90 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc1a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3bbc0c42b0 0x7f3bbc0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc2400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3bbc0c1120 0x7f3bbc15b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55382/0 (socket says 172.21.15.32:55382) 2024-01-19T04:17:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.845+0000 7f3bc2400640 1 -- 172.21.15.32:0/1779660492 learned_addr learned my addr 172.21.15.32:0/1779660492 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bc1a00640 1 -- 172.21.15.32:0/1779660492 >> v1:172.21.15.67:6789/0 conn(0x7f3bbc0c5740 legacy=0x7f3bbc06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bc1a00640 1 -- 172.21.15.32:0/1779660492 >> v1:172.21.15.32:6789/0 conn(0x7f3bbc0c1120 legacy=0x7f3bbc15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bc1a00640 1 -- 172.21.15.32:0/1779660492 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0c0640 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bbbe00640 1 -- 172.21.15.32:0/1779660492 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056525434 0 0) 0x7f3bbc0c0c90 con 0x7f3bbc0c1120 2024-01-19T04:17:28.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bc1a00640 1 --2- 172.21.15.32:0/1779660492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc0c4690 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0097c0 tx=0x7f3bac01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac7f8e3522c2273 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bbbe00640 1 -- 172.21.15.32:0/1779660492 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0ad660 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bbbe00640 1 -- 172.21.15.32:0/1779660492 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0ad7c0 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bbbe00640 1 -- 172.21.15.32:0/1779660492 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0adb50 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bc4400640 1 -- 172.21.15.32:0/1779660492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 msgr2=0x7f3bbc0c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.849+0000 7f3bc4400640 1 --2- 172.21.15.32:0/1779660492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc0c4690 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0097c0 tx=0x7f3bac01ce20 comp rx=0 tx=0).stop 2024-01-19T04:17:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- 172.21.15.32:0/1779660492 shutdown_connections 2024-01-19T04:17:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 --2- 172.21.15.32:0/1779660492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc0c4690 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- 172.21.15.32:0/1779660492 >> 172.21.15.32:0/1779660492 conn(0x7f3bbc0c5b20 msgr2=0x7f3bbc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- 172.21.15.32:0/1779660492 shutdown_connections 2024-01-19T04:17:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- 172.21.15.32:0/1779660492 wait complete. 2024-01-19T04:17:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 Processor -- start 2024-01-19T04:17:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- start start 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bbc0c1120 0x7f3bbc0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc1f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bbc0c5740 0x7f3bbc1f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0a8940 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0a8be0 con 0x7f3bbc0c1120 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc4400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc150350 con 0x7f3bbc0c5740 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc1f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc1f02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56878/0 (socket says 172.21.15.32:56878) 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 -- 172.21.15.32:0/260600418 learned_addr learned my addr 172.21.15.32:0/260600418 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc2400640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bbc0c5740 0x7f3bbc1f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1a00640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bbc0c1120 0x7f3bbc0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 -- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bbc0c5740 msgr2=0x7f3bbc1f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bbc0c5740 0x7f3bbc1f0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 -- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bbc0c1120 msgr2=0x7f3bbc0bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bbc0c1120 0x7f3bbc0bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 -- 172.21.15.32:0/260600418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009420 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.853+0000 7f3bc1000640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc1f02e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c530 tx=0x7f3ba400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bb9600640 1 -- 172.21.15.32:0/260600418 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4005220 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bb9600640 1 -- 172.21.15.32:0/260600418 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba4005380 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bb9600640 1 -- 172.21.15.32:0/260600418 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4007270 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc1f0d60 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc150880 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc0a8d90 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bb9600640 1 -- 172.21.15.32:0/260600418 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3ba40073d0 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bb9600640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b94066500 0x7f3b940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bb9600640 1 -- 172.21.15.32:0/260600418 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3ba4083920 con 0x7f3bbc0c42b0 2024-01-19T04:17:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.857+0000 7f3bc1a00640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b94066500 0x7f3b940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.861+0000 7f3bc1a00640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b94066500 0x7f3b940689c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0af000 tx=0x7f3bac004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:28.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:28.861+0000 7f3bb9600640 1 -- 172.21.15.32:0/260600418 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3bbc0a8d90 con 0x7f3bbc0c42b0 2024-01-19T04:17:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.053+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bbc0a8d90 con 0x7f3bbc0c42b0 2024-01-19T04:17:29.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.053+0000 7f3bb9600640 1 -- 172.21.15.32:0/260600418 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6176 (secure 0 0 0) 0x7f3bbc0a8d90 con 0x7f3bbc0c42b0 2024-01-19T04:17:29.057 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:29.057 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:50.950328+0000","modified":"2024-01-19T04:16:54.081170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/246892917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":246892917},{"type":"v1","addr":"172.21.15.67:6837","nonce":246892917}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:29.057 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 36 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b94066500 msgr2=0x7f3b940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b94066500 0x7f3b940689c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0af000 tx=0x7f3bac004740 comp rx=0 tx=0).stop 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 msgr2=0x7f3bbc1f02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc1f02e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c530 tx=0x7f3ba400c9f0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 shutdown_connections 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3b94066500 0x7f3b940689c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3bbc0c5740 0x7f3bbc1f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bbc0c42b0 0x7f3bbc1f02e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 --2- 172.21.15.32:0/260600418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bbc0c1120 0x7f3bbc0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 >> 172.21.15.32:0/260600418 conn(0x7f3bbc0c5b20 msgr2=0x7f3bbc0c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 shutdown_connections 2024-01-19T04:17:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.057+0000 7f3bc4400640 1 -- 172.21.15.32:0/260600418 wait complete. 2024-01-19T04:17:29.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:29.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 Processor -- start 2024-01-19T04:17:29.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 -- start start 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6dbc14fb50 0x7f6dbc06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6dbc0a4ec0 0x7f6dbc0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc1535c0 con 0x7f6dbc14fb50 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc071e80 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc3a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0726c0 con 0x7f6dbc0c04a0 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6dbc14fb50 0x7f6dbc06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6dbc14fb50 0x7f6dbc06fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56882/0 (socket says 172.21.15.32:56882) 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 -- 172.21.15.32:0/2565122512 learned_addr learned my addr 172.21.15.32:0/2565122512 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1a00640 1 --2- 172.21.15.32:0/2565122512 >> v2:172.21.15.67:3300/0 conn(0x7f6dbc0a4ec0 0x7f6dbc0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dbbe00640 1 --2- 172.21.15.32:0/2565122512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 -- 172.21.15.32:0/2565122512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc0c04a0 msgr2=0x7f6dbc0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 --2- 172.21.15.32:0/2565122512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 -- 172.21.15.32:0/2565122512 >> v2:172.21.15.67:3300/0 conn(0x7f6dbc0a4ec0 msgr2=0x7f6dbc0c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 --2- 172.21.15.32:0/2565122512 >> v2:172.21.15.67:3300/0 conn(0x7f6dbc0a4ec0 0x7f6dbc0c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.217+0000 7f6dc1000640 1 -- 172.21.15.32:0/2565122512 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0c1cb0 con 0x7f6dbc14fb50 2024-01-19T04:17:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc1000640 1 --2- 172.21.15.32:0/2565122512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc14fb50 0x7f6dbc06fec0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0098a0 tx=0x7f6dac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb24c4fa8976ea0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dbb400640 1 -- 172.21.15.32:0/2565122512 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0a4ea0 con 0x7f6dbc14fb50 2024-01-19T04:17:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dbb400640 1 -- 172.21.15.32:0/2565122512 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac0a7050 con 0x7f6dbc14fb50 2024-01-19T04:17:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dbb400640 1 -- 172.21.15.32:0/2565122512 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0ab820 con 0x7f6dbc14fb50 2024-01-19T04:17:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 -- 172.21.15.32:0/2565122512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc14fb50 msgr2=0x7f6dbc06fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/2565122512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc14fb50 0x7f6dbc06fec0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0098a0 tx=0x7f6dac01c450 comp rx=0 tx=0).stop 2024-01-19T04:17:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 -- 172.21.15.32:0/2565122512 shutdown_connections 2024-01-19T04:17:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/2565122512 >> v2:172.21.15.67:3300/0 conn(0x7f6dbc0a4ec0 0x7f6dbc0c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/2565122512 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/2565122512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc14fb50 0x7f6dbc06fec0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 -- 172.21.15.32:0/2565122512 >> 172.21.15.32:0/2565122512 conn(0x7f6dbc0c5b20 msgr2=0x7f6dbc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 -- 172.21.15.32:0/2565122512 shutdown_connections 2024-01-19T04:17:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.221+0000 7f6dc3a00640 1 -- 172.21.15.32:0/2565122512 wait complete. 2024-01-19T04:17:29.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 Processor -- start 2024-01-19T04:17:29.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 -- start start 2024-01-19T04:17:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc0a4ec0 0x7f6dbc1f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc14fb50 0x7f6dbc1ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc14bc70 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc155390 con 0x7f6dbc0c04a0 2024-01-19T04:17:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc1f07e0 con 0x7f6dbc14fb50 2024-01-19T04:17:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc0a4ec0 0x7f6dbc1f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc0a4ec0 0x7f6dbc1f1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56894/0 (socket says 172.21.15.32:56894) 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 -- 172.21.15.32:0/1799235769 learned_addr learned my addr 172.21.15.32:0/1799235769 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dbbe00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1a00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc14fb50 0x7f6dbc1ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 -- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc14fb50 msgr2=0x7f6dbc1ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc14fb50 0x7f6dbc1ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 -- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dbc0c04a0 msgr2=0x7f6dbc0c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 -- 172.21.15.32:0/1799235769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0094d0 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc1000640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc0a4ec0 0x7f6dbc1f1250 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0ae040 tx=0x7f6dac01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6db8c00640 1 -- 172.21.15.32:0/1799235769 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0b6620 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6db8c00640 1 -- 172.21.15.32:0/1799235769 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac0b6780 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6db8c00640 1 -- 172.21.15.32:0/1799235769 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0b6b10 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc1555e0 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.225+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc1f0d30 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.229+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc1f0f20 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.229+0000 7f6db8c00640 1 -- 172.21.15.32:0/1799235769 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6dac0b2040 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.229+0000 7f6db8c00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d94066530 0x7f6d940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.229+0000 7f6db8c00640 1 -- 172.21.15.32:0/1799235769 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6dac11e400 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.229+0000 7f6dbbe00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d94066530 0x7f6d940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.229+0000 7f6dbbe00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d94066530 0x7f6d940689f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc04eb60 tx=0x7f6da4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.233+0000 7f6db8c00640 1 -- 172.21.15.32:0/1799235769 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6dac0eb3e0 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.425+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dbc0749f0 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.425+0000 7f6db8c00640 1 -- 172.21.15.32:0/1799235769 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6176 (secure 0 0 0) 0x7f6dac0eea00 con 0x7f6dbc0a4ec0 2024-01-19T04:17:29.429 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:29.429 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:16:50.950328+0000","modified":"2024-01-19T04:16:54.081170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5841":{"gid":5841,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/246892917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":246892917},{"type":"v1","addr":"172.21.15.67:6837","nonce":246892917}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:29.429 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 36 2024-01-19T04:17:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d94066530 msgr2=0x7f6d940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d94066530 0x7f6d940689f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc04eb60 tx=0x7f6da4008040 comp rx=0 tx=0).stop 2024-01-19T04:17:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc0a4ec0 msgr2=0x7f6dbc1f1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc0a4ec0 0x7f6dbc1f1250 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0ae040 tx=0x7f6dac01ac90 comp rx=0 tx=0).stop 2024-01-19T04:17:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 shutdown_connections 2024-01-19T04:17:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6d94066530 0x7f6d940689f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6dbc14fb50 0x7f6dbc1ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6dbc0c04a0 0x7f6dbc0c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 --2- 172.21.15.32:0/1799235769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6dbc0a4ec0 0x7f6dbc1f1250 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 >> 172.21.15.32:0/1799235769 conn(0x7f6dbc0c5b20 msgr2=0x7f6dbc0c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 shutdown_connections 2024-01-19T04:17:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.429+0000 7f6dc3a00640 1 -- 172.21.15.32:0/1799235769 wait complete. 2024-01-19T04:17:29.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:29.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f7600640 1 Processor -- start 2024-01-19T04:17:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f7600640 1 -- start start 2024-01-19T04:17:29.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f7600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16f00a6d30 0x7f16f00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f7600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f16f006fda0 0x7f16f00c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f7600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f01533a0 con 0x7f16f00c6e20 2024-01-19T04:17:29.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f7600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f0156380 con 0x7f16f00a6d30 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f7600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f014fe40 con 0x7f16f006fda0 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16efe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16f00a6d30 0x7f16f00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16efe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16f00a6d30 0x7f16f00c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56900/0 (socket says 172.21.15.32:56900) 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16efe00640 1 -- 172.21.15.32:0/3137904261 learned_addr learned my addr 172.21.15.32:0/3137904261 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16f5600640 1 --2- 172.21.15.32:0/3137904261 >> v2:172.21.15.67:3300/0 conn(0x7f16f006fda0 0x7f16f00c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16efe00640 1 -- 172.21.15.32:0/3137904261 >> v2:172.21.15.67:3300/0 conn(0x7f16f006fda0 msgr2=0x7f16f00c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16efe00640 1 --2- 172.21.15.32:0/3137904261 >> v2:172.21.15.67:3300/0 conn(0x7f16f006fda0 0x7f16f00c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16efe00640 1 -- 172.21.15.32:0/3137904261 >> v1:172.21.15.67:6789/0 conn(0x7f16f00c6e20 legacy=0x7f16f0152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.589+0000 7f16efe00640 1 -- 172.21.15.32:0/3137904261 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0152800 con 0x7f16f00a6d30 2024-01-19T04:17:29.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16efe00640 1 --2- 172.21.15.32:0/3137904261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c7200 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f16f006da10 tx=0x7f16d801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0404b513922e9fb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16ef400640 1 -- 172.21.15.32:0/3137904261 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ab670 con 0x7f16f00a6d30 2024-01-19T04:17:29.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16ef400640 1 -- 172.21.15.32:0/3137904261 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d80ab7d0 con 0x7f16f00a6d30 2024-01-19T04:17:29.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16ef400640 1 -- 172.21.15.32:0/3137904261 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80abb60 con 0x7f16f00a6d30 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 -- 172.21.15.32:0/3137904261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 msgr2=0x7f16f00c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 --2- 172.21.15.32:0/3137904261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c7200 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f16f006da10 tx=0x7f16d801c470 comp rx=0 tx=0).stop 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 -- 172.21.15.32:0/3137904261 shutdown_connections 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 --2- 172.21.15.32:0/3137904261 >> v2:172.21.15.67:3300/0 conn(0x7f16f006fda0 0x7f16f00c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 --2- 172.21.15.32:0/3137904261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c7200 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 -- 172.21.15.32:0/3137904261 >> 172.21.15.32:0/3137904261 conn(0x7f16f00a9870 msgr2=0x7f16f00a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 -- 172.21.15.32:0/3137904261 shutdown_connections 2024-01-19T04:17:29.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.593+0000 7f16f7600640 1 -- 172.21.15.32:0/3137904261 wait complete. 2024-01-19T04:17:29.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 Processor -- start 2024-01-19T04:17:29.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 -- start start 2024-01-19T04:17:29.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f006fda0 0x7f16f0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f00c6e20 0x7f16f01f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f014e370 con 0x7f16f00a6d30 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01ed800 con 0x7f16f00c6e20 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0152110 con 0x7f16f006fda0 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56912/0 (socket says 172.21.15.32:56912) 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 -- 172.21.15.32:0/1752331204 learned_addr learned my addr 172.21.15.32:0/1752331204 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f5600640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f00c6e20 0x7f16f01f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f4c00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f006fda0 0x7f16f0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 -- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f006fda0 msgr2=0x7f16f0151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f006fda0 0x7f16f0151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 -- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f00c6e20 msgr2=0x7f16f01f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f00c6e20 0x7f16f01f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 -- 172.21.15.32:0/1752331204 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d80094d0 con 0x7f16f00a6d30 2024-01-19T04:17:29.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f4c00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f006fda0 0x7f16f0151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:29.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16efe00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c4560 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f16d801a0a0 tx=0x7f16d801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16ecc00640 1 -- 172.21.15.32:0/1752331204 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80b4800 con 0x7f16f00a6d30 2024-01-19T04:17:29.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16ecc00640 1 -- 172.21.15.32:0/1752331204 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d80b4960 con 0x7f16f00a6d30 2024-01-19T04:17:29.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f01eced0 con 0x7f16f00a6d30 2024-01-19T04:17:29.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16ecc00640 1 -- 172.21.15.32:0/1752331204 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80b4d10 con 0x7f16f00a6d30 2024-01-19T04:17:29.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.597+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f01ed490 con 0x7f16f00a6d30 2024-01-19T04:17:29.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.601+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f00749f0 con 0x7f16f00a6d30 2024-01-19T04:17:29.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.601+0000 7f16ecc00640 1 -- 172.21.15.32:0/1752331204 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f16d80c7440 con 0x7f16f00a6d30 2024-01-19T04:17:29.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.601+0000 7f16ecc00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16c8066500 0x7f16c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.601+0000 7f16ecc00640 1 -- 172.21.15.32:0/1752331204 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f16d811ecf0 con 0x7f16f00a6d30 2024-01-19T04:17:29.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.601+0000 7f16f4c00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16c8066500 0x7f16c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.601+0000 7f16f4c00640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16c8066500 0x7f16c80689c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f16e0001670 tx=0x7f16e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.605+0000 7f16ecc00640 1 -- 172.21.15.32:0/1752331204 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f16d8123070 con 0x7f16f00a6d30 2024-01-19T04:17:29.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.765+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f0067b80 con 0x7f16f00a6d30 2024-01-19T04:17:29.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16ecc00640 1 -- 172.21.15.32:0/1752331204 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20185 (secure 0 0 0) 0x7f16d80ebd70 con 0x7f16f00a6d30 2024-01-19T04:17:29.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:29.770 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":57,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:05.701251+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:16:48.753748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-19T04:16:49.947198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16c8066500 msgr2=0x7f16c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16c8066500 0x7f16c80689c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f16e0001670 tx=0x7f16e0009040 comp rx=0 tx=0).stop 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 msgr2=0x7f16f00c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c4560 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f16d801a0a0 tx=0x7f16d801acb0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 shutdown_connections 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f16c8066500 0x7f16c80689c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16f00c6e20 0x7f16f01f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16f00a6d30 0x7f16f00c4560 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 --2- 172.21.15.32:0/1752331204 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f16f006fda0 0x7f16f0151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 >> 172.21.15.32:0/1752331204 conn(0x7f16f00a9870 msgr2=0x7f16f014f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 shutdown_connections 2024-01-19T04:17:29.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.769+0000 7f16f7600640 1 -- 172.21.15.32:0/1752331204 wait complete. 2024-01-19T04:17:29.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-19T04:17:29.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa73a00640 1 Processor -- start 2024-01-19T04:17:29.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa73a00640 1 -- start start 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa73a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c14fb20 0x7ffa6c071820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa73a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa6c152c90 0x7ffa6c06f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa73a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0a99e0 con 0x7ffa6c06a6a0 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa73a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0a8d90 con 0x7ffa6c152c90 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa73a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c14ff00 con 0x7ffa6c14fb20 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa72400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa6c152c90 0x7ffa6c06f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa72400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa6c152c90 0x7ffa6c06f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56922/0 (socket says 172.21.15.32:56922) 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa72400640 1 -- 172.21.15.32:0/2964171347 learned_addr learned my addr 172.21.15.32:0/2964171347 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:29.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa71000640 1 --2- 172.21.15.32:0/2964171347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c14fb20 0x7ffa6c071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa72400640 1 -- 172.21.15.32:0/2964171347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c14fb20 msgr2=0x7ffa6c071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:29.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa72400640 1 --2- 172.21.15.32:0/2964171347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c14fb20 0x7ffa6c071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa72400640 1 -- 172.21.15.32:0/2964171347 >> v1:172.21.15.67:6789/0 conn(0x7ffa6c06a6a0 legacy=0x7ffa6c06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa72400640 1 -- 172.21.15.32:0/2964171347 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0a9cc0 con 0x7ffa6c152c90 2024-01-19T04:17:29.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.933+0000 7ffa6be00640 1 -- 172.21.15.32:0/2964171347 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156196691 0 0) 0x7ffa6c0a99e0 con 0x7ffa6c06a6a0 2024-01-19T04:17:29.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa72400640 1 --2- 172.21.15.32:0/2964171347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c152c90 0x7ffa6c06f500 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009e80 tx=0x7ffa6401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b3eba55f9a2722 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa6be00640 1 -- 172.21.15.32:0/2964171347 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640a5700 con 0x7ffa6c152c90 2024-01-19T04:17:29.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa6be00640 1 -- 172.21.15.32:0/2964171347 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa640a5860 con 0x7ffa6c152c90 2024-01-19T04:17:29.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa6be00640 1 -- 172.21.15.32:0/2964171347 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640a5bf0 con 0x7ffa6c152c90 2024-01-19T04:17:29.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 -- 172.21.15.32:0/2964171347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c152c90 msgr2=0x7ffa6c06f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 --2- 172.21.15.32:0/2964171347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c152c90 0x7ffa6c06f500 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009e80 tx=0x7ffa6401c930 comp rx=0 tx=0).stop 2024-01-19T04:17:29.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 -- 172.21.15.32:0/2964171347 shutdown_connections 2024-01-19T04:17:29.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 --2- 172.21.15.32:0/2964171347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c152c90 0x7ffa6c06f500 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 --2- 172.21.15.32:0/2964171347 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c14fb20 0x7ffa6c071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 -- 172.21.15.32:0/2964171347 >> 172.21.15.32:0/2964171347 conn(0x7ffa6c06d6c0 msgr2=0x7ffa6c06dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:29.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 -- 172.21.15.32:0/2964171347 shutdown_connections 2024-01-19T04:17:29.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.937+0000 7ffa73a00640 1 -- 172.21.15.32:0/2964171347 wait complete. 2024-01-19T04:17:29.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 Processor -- start 2024-01-19T04:17:29.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 -- start start 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c06a6a0 0x7ffa6c140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c14fb20 0x7ffa6c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa6c152c90 0x7ffa6c154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c141350 con 0x7ffa6c14fb20 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c140bc0 con 0x7ffa6c152c90 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1f18b0 con 0x7ffa6c06a6a0 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c14fb20 0x7ffa6c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c14fb20 0x7ffa6c154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56936/0 (socket says 172.21.15.32:56936) 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 -- 172.21.15.32:0/1291787622 learned_addr learned my addr 172.21.15.32:0/1291787622 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:29.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa72400640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa6c152c90 0x7ffa6c154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa71000640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c06a6a0 0x7ffa6c140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 -- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c06a6a0 msgr2=0x7ffa6c140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c06a6a0 0x7ffa6c140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 -- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa6c152c90 msgr2=0x7ffa6c154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa6c152c90 0x7ffa6c154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 -- 172.21.15.32:0/1291787622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009b30 con 0x7ffa6c14fb20 2024-01-19T04:17:29.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa63c00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c14fb20 0x7ffa6c154650 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffa54001ec0 tx=0x7ffa5400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa69600640 1 -- 172.21.15.32:0/1291787622 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540054e0 con 0x7ffa6c14fb20 2024-01-19T04:17:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa69600640 1 -- 172.21.15.32:0/1291787622 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54003600 con 0x7ffa6c14fb20 2024-01-19T04:17:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa69600640 1 -- 172.21.15.32:0/1291787622 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540039b0 con 0x7ffa6c14fb20 2024-01-19T04:17:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.941+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c1f1b90 con 0x7ffa6c14fb20 2024-01-19T04:17:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.945+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c0c1d80 con 0x7ffa6c14fb20 2024-01-19T04:17:29.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.945+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c04e980 con 0x7ffa6c14fb20 2024-01-19T04:17:29.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.945+0000 7ffa69600640 1 -- 172.21.15.32:0/1291787622 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ffa54003b10 con 0x7ffa6c14fb20 2024-01-19T04:17:29.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.945+0000 7ffa69600640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffa44066530 0x7ffa440689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:29.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.945+0000 7ffa69600640 1 -- 172.21.15.32:0/1291787622 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffa54083720 con 0x7ffa6c14fb20 2024-01-19T04:17:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.945+0000 7ffa71000640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffa44066530 0x7ffa440689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:29.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.945+0000 7ffa71000640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffa44066530 0x7ffa440689f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009ac0 tx=0x7ffa5c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:29.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:29.949+0000 7ffa69600640 1 -- 172.21.15.32:0/1291787622 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ffa54050700 con 0x7ffa6c14fb20 2024-01-19T04:17:30.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.145+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffa6c0c3ae0 con 0x7ffa6c14fb20 2024-01-19T04:17:30.150 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-01-19T04:17:30.149+0000 7f2af4c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T04:17:30.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.149+0000 7ffa69600640 1 -- 172.21.15.32:0/1291787622 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffa54017090 con 0x7ffa6c14fb20 2024-01-19T04:17:30.152 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffa44066530 msgr2=0x7ffa440689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffa44066530 0x7ffa440689f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009ac0 tx=0x7ffa5c009190 comp rx=0 tx=0).stop 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c14fb20 msgr2=0x7ffa6c154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c14fb20 0x7ffa6c154650 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffa54001ec0 tx=0x7ffa5400c8e0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 shutdown_connections 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffa44066530 0x7ffa440689f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa6c152c90 0x7ffa6c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa6c14fb20 0x7ffa6c154650 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 --2- 172.21.15.32:0/1291787622 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffa6c06a6a0 0x7ffa6c140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 >> 172.21.15.32:0/1291787622 conn(0x7ffa6c06d6c0 msgr2=0x7ffa6c150290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 shutdown_connections 2024-01-19T04:17:30.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.153+0000 7ffa73a00640 1 -- 172.21.15.32:0/1291787622 wait complete. 2024-01-19T04:17:30.163 INFO:tasks.ceph.mds.d.smithi067.stderr: -3063> 2024-01-19T04:16:52.521+0000 7fc52e800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:17:30.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-19T04:17:30.213 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2024-01-19T04:17:30.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ef600640 1 Processor -- start 2024-01-19T04:17:30.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ef600640 1 -- start start 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ef600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c4e50 0x7f72e80c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ef600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72e80c6120 0x7f72e80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ef600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e80c6af0 con 0x7f72e8152620 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ef600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e806ea00 con 0x7f72e80c6120 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ef600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8152bc0 con 0x7f72e80c4e50 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72e7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f72e8152620 0x7f72e806f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55388/0 (socket says 172.21.15.32:55388) 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72e7e00640 1 -- 172.21.15.32:0/3068364885 learned_addr learned my addr 172.21.15.32:0/3068364885 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ed600640 1 --2- 172.21.15.32:0/3068364885 >> v2:172.21.15.67:3300/0 conn(0x7f72e80c6120 0x7f72e80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:30.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ecc00640 1 --2- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c4e50 0x7f72e80c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72e7400640 1 -- 172.21.15.32:0/3068364885 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023968498 0 0) 0x7f72e80c6af0 con 0x7f72e8152620 2024-01-19T04:17:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72e7400640 1 -- 172.21.15.32:0/3068364885 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c8003530 con 0x7f72e8152620 2024-01-19T04:17:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ed600640 1 -- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c4e50 msgr2=0x7f72e80c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ed600640 1 --2- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c4e50 0x7f72e80c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ed600640 1 -- 172.21.15.32:0/3068364885 >> v1:172.21.15.32:6789/0 conn(0x7f72e8152620 legacy=0x7f72e806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ed600640 1 -- 172.21.15.32:0/3068364885 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8152ea0 con 0x7f72e80c6120 2024-01-19T04:17:30.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.317+0000 7f72ecc00640 1 --2- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c4e50 0x7f72e80c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72ed600640 1 --2- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c6120 0x7f72e80c65b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009d90 tx=0x7f72e001f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04e56006caa9437 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:30.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72e7400640 1 -- 172.21.15.32:0/3068364885 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00af600 con 0x7f72e80c6120 2024-01-19T04:17:30.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72e7400640 1 -- 172.21.15.32:0/3068364885 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00ab050 con 0x7f72e80c6120 2024-01-19T04:17:30.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72e7400640 1 -- 172.21.15.32:0/3068364885 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00af980 con 0x7f72e80c6120 2024-01-19T04:17:30.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72ef600640 1 -- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c6120 msgr2=0x7f72e80c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:30.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72ef600640 1 --2- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c6120 0x7f72e80c65b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009d90 tx=0x7f72e001f130 comp rx=0 tx=0).stop 2024-01-19T04:17:30.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72ef600640 1 -- 172.21.15.32:0/3068364885 shutdown_connections 2024-01-19T04:17:30.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72ef600640 1 --2- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c6120 0x7f72e80c65b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.321+0000 7f72ef600640 1 --2- 172.21.15.32:0/3068364885 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c4e50 0x7f72e80c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 -- 172.21.15.32:0/3068364885 >> 172.21.15.32:0/3068364885 conn(0x7f72e80c7d40 msgr2=0x7f72e80c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:30.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 -- 172.21.15.32:0/3068364885 shutdown_connections 2024-01-19T04:17:30.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 -- 172.21.15.32:0/3068364885 wait complete. 2024-01-19T04:17:30.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 Processor -- start 2024-01-19T04:17:30.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 -- start start 2024-01-19T04:17:30.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c4e50 0x7f72e80c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:30.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c6120 0x7f72e814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72e8152620 0x7f72e814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80acbe0 con 0x7f72e8152620 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e814e6d0 con 0x7f72e80c4e50 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ef600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e814eec0 con 0x7f72e80c6120 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72e8152620 0x7f72e814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72e8152620 0x7f72e814b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56944/0 (socket says 172.21.15.32:56944) 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 -- 172.21.15.32:0/4265542167 learned_addr learned my addr 172.21.15.32:0/4265542167 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ecc00640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c4e50 0x7f72e80c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72e7e00640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c6120 0x7f72e814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 -- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c6120 msgr2=0x7f72e814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c6120 0x7f72e814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 -- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c4e50 msgr2=0x7f72e80c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c4e50 0x7f72e80c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 -- 172.21.15.32:0/4265542167 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009420 con 0x7f72e8152620 2024-01-19T04:17:30.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ecc00640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c4e50 0x7f72e80c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:30.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.325+0000 7f72ed600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72e8152620 0x7f72e814b5a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f72e00b2040 tx=0x7f72e001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:30.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72e4c00640 1 -- 172.21.15.32:0/4265542167 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0009450 con 0x7f72e8152620 2024-01-19T04:17:30.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72e4c00640 1 -- 172.21.15.32:0/4265542167 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00b9410 con 0x7f72e8152620 2024-01-19T04:17:30.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e0009a70 con 0x7f72e8152620 2024-01-19T04:17:30.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72e4c00640 1 -- 172.21.15.32:0/4265542167 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00b97c0 con 0x7f72e8152620 2024-01-19T04:17:30.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e81e9ca0 con 0x7f72e8152620 2024-01-19T04:17:30.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e81e9e30 con 0x7f72e8152620 2024-01-19T04:17:30.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72e4c00640 1 -- 172.21.15.32:0/4265542167 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f72e00b6050 con 0x7f72e8152620 2024-01-19T04:17:30.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72e4c00640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f72c0066500 0x7f72c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:30.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72e4c00640 1 -- 172.21.15.32:0/4265542167 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f72e01225e0 con 0x7f72e8152620 2024-01-19T04:17:30.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.329+0000 7f72ecc00640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f72c0066500 0x7f72c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:30.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.333+0000 7f72ecc00640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f72c0066500 0x7f72c00689c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d40 tx=0x7f72d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:30.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.333+0000 7f72e4c00640 1 -- 172.21.15.32:0/4265542167 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f72e00ef560 con 0x7f72e8152620 2024-01-19T04:17:30.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:30.525+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f72e80749f0 con 0x7f72e8152620 2024-01-19T04:17:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72e4c00640 1 -- 172.21.15.32:0/4265542167 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72e00f2b80 con 0x7f72e8152620 2024-01-19T04:17:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f72c0066500 msgr2=0x7f72c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f72c0066500 0x7f72c00689c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d40 tx=0x7f72d8008040 comp rx=0 tx=0).stop 2024-01-19T04:17:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72e8152620 msgr2=0x7f72e814b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72e8152620 0x7f72e814b5a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f72e00b2040 tx=0x7f72e001bed0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 shutdown_connections 2024-01-19T04:17:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f72c0066500 0x7f72c00689c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72e8152620 0x7f72e814b5a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f72e80c6120 0x7f72e814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 --2- 172.21.15.32:0/4265542167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e80c4e50 0x7f72e80c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 >> 172.21.15.32:0/4265542167 conn(0x7f72e80c7d40 msgr2=0x7f72e806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 shutdown_connections 2024-01-19T04:17:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.153+0000 7f72ef600640 1 -- 172.21.15.32:0/4265542167 wait complete. 2024-01-19T04:17:31.181 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-19T04:17:31.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffba5600640 1 Processor -- start 2024-01-19T04:17:31.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffba5600640 1 -- start start 2024-01-19T04:17:31.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffba5600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba00c5cc0 0x7ffba00c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:31.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffba5600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffba006b960 0x7ffba00a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:31.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffba5600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba0158020 con 0x7ffba00c49e0 2024-01-19T04:17:31.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffba5600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba00c73c0 con 0x7ffba006b960 2024-01-19T04:17:31.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffba5600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00c7c60 con 0x7ffba00c5cc0 2024-01-19T04:17:31.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffba006b960 0x7ffba00a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:31.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba00c5cc0 0x7ffba00c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:31.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9ea00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ffba00c49e0 0x7ffba01584b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:42516/0 (socket says 172.21.15.32:42516) 2024-01-19T04:17:31.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9ea00640 1 -- 172.21.15.32:0/3428876405 learned_addr learned my addr 172.21.15.32:0/3428876405 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:31.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9f400640 1 -- 172.21.15.32:0/3428876405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba00c5cc0 msgr2=0x7ffba00c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:31.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9f400640 1 --2- 172.21.15.32:0/3428876405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba00c5cc0 0x7ffba00c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9f400640 1 -- 172.21.15.32:0/3428876405 >> v1:172.21.15.67:6789/0 conn(0x7ffba00c49e0 legacy=0x7ffba01584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:31.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9f400640 1 -- 172.21.15.32:0/3428876405 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00c61d0 con 0x7ffba006b960 2024-01-19T04:17:31.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.329+0000 7ffb9d600640 1 -- 172.21.15.32:0/3428876405 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384617099 0 0) 0x7ffba0158020 con 0x7ffba00c49e0 2024-01-19T04:17:31.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffb9f400640 1 --2- 172.21.15.32:0/3428876405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba006b960 0x7ffba00a6ee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009dc0 tx=0x7ffb9801c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bacac2afc057c1f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:31.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffb9d600640 1 -- 172.21.15.32:0/3428876405 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980a58a0 con 0x7ffba006b960 2024-01-19T04:17:31.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffb9d600640 1 -- 172.21.15.32:0/3428876405 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb980a5a00 con 0x7ffba006b960 2024-01-19T04:17:31.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffb9d600640 1 -- 172.21.15.32:0/3428876405 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980a5d90 con 0x7ffba006b960 2024-01-19T04:17:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 -- 172.21.15.32:0/3428876405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba006b960 msgr2=0x7ffba00a6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 --2- 172.21.15.32:0/3428876405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba006b960 0x7ffba00a6ee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009dc0 tx=0x7ffb9801c7e0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 -- 172.21.15.32:0/3428876405 shutdown_connections 2024-01-19T04:17:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 --2- 172.21.15.32:0/3428876405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba006b960 0x7ffba00a6ee0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 --2- 172.21.15.32:0/3428876405 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba00c5cc0 0x7ffba00c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 -- 172.21.15.32:0/3428876405 >> 172.21.15.32:0/3428876405 conn(0x7ffba00a9af0 msgr2=0x7ffba00a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 -- 172.21.15.32:0/3428876405 shutdown_connections 2024-01-19T04:17:31.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.333+0000 7ffba5600640 1 -- 172.21.15.32:0/3428876405 wait complete. 2024-01-19T04:17:31.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 Processor -- start 2024-01-19T04:17:31.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 -- start start 2024-01-19T04:17:31.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba006b960 0x7ffba006def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:31.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00c49e0 0x7ffba01f0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:31.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffba00c5cc0 0x7ffba01f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:31.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba006f1b0 con 0x7ffba00c5cc0 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba014ef70 con 0x7ffba00c49e0 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0151630 con 0x7ffba006b960 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffba00c5cc0 0x7ffba01f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffba00c5cc0 0x7ffba01f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56948/0 (socket says 172.21.15.32:56948) 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 -- 172.21.15.32:0/3125262376 learned_addr learned my addr 172.21.15.32:0/3125262376 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9ea00640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba006b960 0x7ffba006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9e000640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00c49e0 0x7ffba01f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 -- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba006b960 msgr2=0x7ffba006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba006b960 0x7ffba006def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 -- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00c49e0 msgr2=0x7ffba01f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00c49e0 0x7ffba01f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 -- 172.21.15.32:0/3125262376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009a70 con 0x7ffba00c5cc0 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb9f400640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffba00c5cc0 0x7ffba01f0760 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801ae90 tx=0x7ffb98019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb96a00640 1 -- 172.21.15.32:0/3125262376 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980ad440 con 0x7ffba00c5cc0 2024-01-19T04:17:31.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb96a00640 1 -- 172.21.15.32:0/3125262376 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb980ad5a0 con 0x7ffba00c5cc0 2024-01-19T04:17:31.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba01f0e00 con 0x7ffba00c5cc0 2024-01-19T04:17:31.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffb96a00640 1 -- 172.21.15.32:0/3125262376 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980ad930 con 0x7ffba00c5cc0 2024-01-19T04:17:31.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.337+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba0151bd0 con 0x7ffba00c5cc0 2024-01-19T04:17:31.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.341+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba0068290 con 0x7ffba00c5cc0 2024-01-19T04:17:31.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.341+0000 7ffb96a00640 1 -- 172.21.15.32:0/3125262376 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ffb980ada90 con 0x7ffba00c5cc0 2024-01-19T04:17:31.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.341+0000 7ffb96a00640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffb78066500 0x7ffb780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:31.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.341+0000 7ffb96a00640 1 -- 172.21.15.32:0/3125262376 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6651+0+0 (secure 0 0 0) 0x7ffb9811f350 con 0x7ffba00c5cc0 2024-01-19T04:17:31.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.341+0000 7ffb9ea00640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffb78066500 0x7ffb780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:31.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.341+0000 7ffb9ea00640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffb78066500 0x7ffb780689c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffb90000f70 tx=0x7ffb90007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:31.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.345+0000 7ffb96a00640 1 -- 172.21.15.32:0/3125262376 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ffb980ec2e0 con 0x7ffba00c5cc0 2024-01-19T04:17:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:31.509+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffba014f0e0 con 0x7ffba00c5cc0 2024-01-19T04:17:32.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.152+0000 7ffb96a00640 1 -- 172.21.15.32:0/3125262376 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffb980ef900 con 0x7ffba00c5cc0 2024-01-19T04:17:32.156 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-01-19T04:17:32.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffb78066500 msgr2=0x7ffb780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:32.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffb78066500 0x7ffb780689c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffb90000f70 tx=0x7ffb90007240 comp rx=0 tx=0).stop 2024-01-19T04:17:32.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffba00c5cc0 msgr2=0x7ffba01f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:32.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffba00c5cc0 0x7ffba01f0760 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801ae90 tx=0x7ffb98019580 comp rx=0 tx=0).stop 2024-01-19T04:17:32.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 shutdown_connections 2024-01-19T04:17:32.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ffb78066500 0x7ffb780689c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffba00c5cc0 0x7ffba01f0760 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00c49e0 0x7ffba01f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 --2- 172.21.15.32:0/3125262376 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ffba006b960 0x7ffba006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 >> 172.21.15.32:0/3125262376 conn(0x7ffba00a9af0 msgr2=0x7ffba0073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 shutdown_connections 2024-01-19T04:17:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.156+0000 7ffba5600640 1 -- 172.21.15.32:0/3125262376 wait complete. 2024-01-19T04:17:32.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-19T04:17:32.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f707d400640 1 Processor -- start 2024-01-19T04:17:32.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f707d400640 1 -- start start 2024-01-19T04:17:32.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f707d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7078151dd0 0x7f70780c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:32.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f707d400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70780c6170 0x7f7078154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:32.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f707d400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707806ebf0 con 0x7f70780a75c0 2024-01-19T04:17:32.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f707d400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70780708f0 con 0x7f7078151dd0 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f707d400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707806f600 con 0x7f70780c6170 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7076800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7078151dd0 0x7f70780c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7076800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7078151dd0 0x7f70780c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56962/0 (socket says 172.21.15.32:56962) 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7076800640 1 -- 172.21.15.32:0/198914505 learned_addr learned my addr 172.21.15.32:0/198914505 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7077200640 1 --2- 172.21.15.32:0/198914505 >> v2:172.21.15.67:3300/0 conn(0x7f70780c6170 0x7f7078154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7076800640 1 -- 172.21.15.32:0/198914505 >> v2:172.21.15.67:3300/0 conn(0x7f70780c6170 msgr2=0x7f7078154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7076800640 1 --2- 172.21.15.32:0/198914505 >> v2:172.21.15.67:3300/0 conn(0x7f70780c6170 0x7f7078154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7076800640 1 -- 172.21.15.32:0/198914505 >> v1:172.21.15.67:6789/0 conn(0x7f70780a75c0 legacy=0x7f7078154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7076800640 1 -- 172.21.15.32:0/198914505 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780c74f0 con 0x7f7078151dd0 2024-01-19T04:17:32.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.328+0000 7f7077200640 1 --2- 172.21.15.32:0/198914505 >> v2:172.21.15.67:3300/0 conn(0x7f70780c6170 0x7f7078154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:32.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f7076800640 1 --2- 172.21.15.32:0/198914505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7078151dd0 0x7f70780c5c30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7078071e70 tx=0x7f706801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666e1fb2f60f740e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:32.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f7075400640 1 -- 172.21.15.32:0/198914505 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70680ab5f0 con 0x7f7078151dd0 2024-01-19T04:17:32.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f7075400640 1 -- 172.21.15.32:0/198914505 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70680ab750 con 0x7f7078151dd0 2024-01-19T04:17:32.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f7075400640 1 -- 172.21.15.32:0/198914505 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70680abae0 con 0x7f7078151dd0 2024-01-19T04:17:32.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f707d400640 1 -- 172.21.15.32:0/198914505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7078151dd0 msgr2=0x7f70780c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:32.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f707d400640 1 --2- 172.21.15.32:0/198914505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7078151dd0 0x7f70780c5c30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7078071e70 tx=0x7f706801c500 comp rx=0 tx=0).stop 2024-01-19T04:17:32.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f707d400640 1 -- 172.21.15.32:0/198914505 shutdown_connections 2024-01-19T04:17:32.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f707d400640 1 --2- 172.21.15.32:0/198914505 >> v2:172.21.15.67:3300/0 conn(0x7f70780c6170 0x7f7078154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f707d400640 1 --2- 172.21.15.32:0/198914505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7078151dd0 0x7f70780c5c30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.332+0000 7f707d400640 1 -- 172.21.15.32:0/198914505 >> 172.21.15.32:0/198914505 conn(0x7f70780c7d30 msgr2=0x7f70780c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 -- 172.21.15.32:0/198914505 shutdown_connections 2024-01-19T04:17:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 -- 172.21.15.32:0/198914505 wait complete. 2024-01-19T04:17:32.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 Processor -- start 2024-01-19T04:17:32.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 -- start start 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70780a75c0 0x7f70780c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70780c6170 0x7f70780aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7078151dd0 0x7f70780ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707814b0d0 con 0x7f70780c6170 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078149a90 con 0x7f70780a75c0 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f707d400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70780ad6f0 con 0x7f7078151dd0 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70780c6170 0x7f70780aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70780c6170 0x7f70780aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56968/0 (socket says 172.21.15.32:56968) 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 -- 172.21.15.32:0/2211325554 learned_addr learned my addr 172.21.15.32:0/2211325554 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7076800640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70780a75c0 0x7f70780c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7077200640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7078151dd0 0x7f70780ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 -- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7078151dd0 msgr2=0x7f70780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:32.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7078151dd0 0x7f70780ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 -- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70780a75c0 msgr2=0x7f70780c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70780a75c0 0x7f70780c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 -- 172.21.15.32:0/2211325554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680094d0 con 0x7f70780c6170 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7077200640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7078151dd0 0x7f70780ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f7075e00640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70780c6170 0x7f70780aab50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f706000c340 tx=0x7f706000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f706ea00640 1 -- 172.21.15.32:0/2211325554 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70600052d0 con 0x7f70780c6170 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f706ea00640 1 -- 172.21.15.32:0/2211325554 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7060005430 con 0x7f70780c6170 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.336+0000 7f706ea00640 1 -- 172.21.15.32:0/2211325554 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060007260 con 0x7f70780c6170 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.340+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7078149160 con 0x7f70780c6170 2024-01-19T04:17:32.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.340+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7078149720 con 0x7f70780c6170 2024-01-19T04:17:32.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.340+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707804e980 con 0x7f70780c6170 2024-01-19T04:17:32.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.340+0000 7f706ea00640 1 -- 172.21.15.32:0/2211325554 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f70600073c0 con 0x7f70780c6170 2024-01-19T04:17:32.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.340+0000 7f706ea00640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7050066500 0x7f70500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:32.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.340+0000 7f706ea00640 1 -- 172.21.15.32:0/2211325554 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f70600832b0 con 0x7f70780c6170 2024-01-19T04:17:32.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.340+0000 7f7076800640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7050066500 0x7f70500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:32.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.344+0000 7f7076800640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7050066500 0x7f70500689c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f70680af000 tx=0x7f70680b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:32.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.348+0000 7f706ea00640 1 -- 172.21.15.32:0/2211325554 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7060050490 con 0x7f70780c6170 2024-01-19T04:17:32.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:32.504+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f707815ed00 con 0x7f70780c6170 2024-01-19T04:17:33.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.156+0000 7f706ea00640 1 -- 172.21.15.32:0/2211325554 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7060053ab0 con 0x7f70780c6170 2024-01-19T04:17:33.158 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-01-19T04:17:33.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7050066500 msgr2=0x7f70500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7050066500 0x7f70500689c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f70680af000 tx=0x7f70680b6040 comp rx=0 tx=0).stop 2024-01-19T04:17:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70780c6170 msgr2=0x7f70780aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70780c6170 0x7f70780aab50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f706000c340 tx=0x7f706000c800 comp rx=0 tx=0).stop 2024-01-19T04:17:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 shutdown_connections 2024-01-19T04:17:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7050066500 0x7f70500689c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7078151dd0 0x7f70780ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70780c6170 0x7f70780aab50 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 --2- 172.21.15.32:0/2211325554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70780a75c0 0x7f70780c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 >> 172.21.15.32:0/2211325554 conn(0x7f70780c7d30 msgr2=0x7f70780c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:33.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 shutdown_connections 2024-01-19T04:17:33.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.160+0000 7f707d400640 1 -- 172.21.15.32:0/2211325554 wait complete. 2024-01-19T04:17:33.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:33.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff57d200640 1 Processor -- start 2024-01-19T04:17:33.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff57d200640 1 -- start start 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff57d200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff57814fce0 0x7ff57806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff57d200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5780a6210 0x7ff5780c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff57d200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff578072c60 con 0x7ff57806abe0 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff57d200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff578072320 con 0x7ff57814fce0 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff57d200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff578072910 con 0x7ff5780a6210 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff575e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff57814fce0 0x7ff57806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff576800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff57806abe0 0x7ff5780c2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55398/0 (socket says 172.21.15.32:55398) 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff576800640 1 -- 172.21.15.32:0/436819059 learned_addr learned my addr 172.21.15.32:0/436819059 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:33.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff575400640 1 --2- 172.21.15.32:0/436819059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5780a6210 0x7ff5780c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff575e00640 1 -- 172.21.15.32:0/436819059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5780a6210 msgr2=0x7ff5780c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:33.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff575e00640 1 --2- 172.21.15.32:0/436819059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5780a6210 0x7ff5780c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff575e00640 1 -- 172.21.15.32:0/436819059 >> v1:172.21.15.32:6789/0 conn(0x7ff57806abe0 legacy=0x7ff5780c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.340+0000 7ff575e00640 1 -- 172.21.15.32:0/436819059 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578156670 con 0x7ff57814fce0 2024-01-19T04:17:33.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff575e00640 1 --2- 172.21.15.32:0/436819059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff57814fce0 0x7ff57806a6a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff5680097c0 tx=0x7ff56801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8489d9f6da8f8d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:33.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff574a00640 1 -- 172.21.15.32:0/436819059 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680ab600 con 0x7ff57814fce0 2024-01-19T04:17:33.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff574a00640 1 -- 172.21.15.32:0/436819059 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5680a7050 con 0x7ff57814fce0 2024-01-19T04:17:33.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff574a00640 1 -- 172.21.15.32:0/436819059 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680ab980 con 0x7ff57814fce0 2024-01-19T04:17:33.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 -- 172.21.15.32:0/436819059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff57814fce0 msgr2=0x7ff57806a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 --2- 172.21.15.32:0/436819059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff57814fce0 0x7ff57806a6a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff5680097c0 tx=0x7ff56801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 -- 172.21.15.32:0/436819059 shutdown_connections 2024-01-19T04:17:33.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 --2- 172.21.15.32:0/436819059 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5780a6210 0x7ff5780c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 --2- 172.21.15.32:0/436819059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff57814fce0 0x7ff57806a6a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 -- 172.21.15.32:0/436819059 >> 172.21.15.32:0/436819059 conn(0x7ff5780c6ca0 msgr2=0x7ff5780c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:33.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 -- 172.21.15.32:0/436819059 shutdown_connections 2024-01-19T04:17:33.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.344+0000 7ff57d200640 1 -- 172.21.15.32:0/436819059 wait complete. 2024-01-19T04:17:33.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 Processor -- start 2024-01-19T04:17:33.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 -- start start 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff57806abe0 0x7ff578154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5780a6210 0x7ff57806e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff57814fce0 0x7ff57806e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5781ee0c0 con 0x7ff5780a6210 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57814bd80 con 0x7ff57806abe0 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff578155430 con 0x7ff57814fce0 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5780a6210 0x7ff57806e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5780a6210 0x7ff57806e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56986/0 (socket says 172.21.15.32:56986) 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 -- 172.21.15.32:0/82892054 learned_addr learned my addr 172.21.15.32:0/82892054 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff576800640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff57814fce0 0x7ff57806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575e00640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff57806abe0 0x7ff578154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 -- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff57814fce0 msgr2=0x7ff57806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff57814fce0 0x7ff57806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 -- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff57806abe0 msgr2=0x7ff578154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff57806abe0 0x7ff578154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 -- 172.21.15.32:0/82892054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff568009420 con 0x7ff5780a6210 2024-01-19T04:17:33.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff576800640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff57814fce0 0x7ff57806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:33.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff575400640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5780a6210 0x7ff57806e400 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d800 tx=0x7ff56000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:33.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff56e000640 1 -- 172.21.15.32:0/82892054 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000b6c0 con 0x7ff5780a6210 2024-01-19T04:17:33.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff56e000640 1 -- 172.21.15.32:0/82892054 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56000b820 con 0x7ff5780a6210 2024-01-19T04:17:33.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57814c000 con 0x7ff5780a6210 2024-01-19T04:17:33.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff56e000640 1 -- 172.21.15.32:0/82892054 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000bb90 con 0x7ff5780a6210 2024-01-19T04:17:33.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5781edd50 con 0x7ff5780a6210 2024-01-19T04:17:33.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.348+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5781edf10 con 0x7ff5780a6210 2024-01-19T04:17:33.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.352+0000 7ff56e000640 1 -- 172.21.15.32:0/82892054 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff56000bcf0 con 0x7ff5780a6210 2024-01-19T04:17:33.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.352+0000 7ff56e000640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff550066530 0x7ff5500689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.352+0000 7ff56e000640 1 -- 172.21.15.32:0/82892054 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff560084390 con 0x7ff5780a6210 2024-01-19T04:17:33.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.352+0000 7ff575e00640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff550066530 0x7ff5500689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.352+0000 7ff575e00640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff550066530 0x7ff5500689f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5680ad000 tx=0x7ff5680a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:33.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.356+0000 7ff56e000640 1 -- 172.21.15.32:0/82892054 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff5600515c0 con 0x7ff5780a6210 2024-01-19T04:17:33.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.516+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5780749f0 con 0x7ff5780a6210 2024-01-19T04:17:33.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.516+0000 7ff56e000640 1 -- 172.21.15.32:0/82892054 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16604 (secure 0 0 0) 0x7ff560054be0 con 0x7ff5780a6210 2024-01-19T04:17:33.520 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:33.520 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":60,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:33.157100+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/246892917":"2024-01-20T04:17:30.151066+0000","172.21.15.67:6835/246892917":"2024-01-20T04:17:30.151066+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:33.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff550066530 msgr2=0x7ff5500689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff550066530 0x7ff5500689f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5680ad000 tx=0x7ff5680a4f90 comp rx=0 tx=0).stop 2024-01-19T04:17:33.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5780a6210 msgr2=0x7ff57806e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5780a6210 0x7ff57806e400 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d800 tx=0x7ff56000dcc0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 shutdown_connections 2024-01-19T04:17:33.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff550066530 0x7ff5500689f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff57814fce0 0x7ff57806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5780a6210 0x7ff57806e400 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 --2- 172.21.15.32:0/82892054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff57806abe0 0x7ff578154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 >> 172.21.15.32:0/82892054 conn(0x7ff5780c6ca0 msgr2=0x7ff578151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:33.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 shutdown_connections 2024-01-19T04:17:33.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.520+0000 7ff57d200640 1 -- 172.21.15.32:0/82892054 wait complete. 2024-01-19T04:17:33.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:17:02.181700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:17:03.077640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:33.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:33.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 Processor -- start 2024-01-19T04:17:33.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 -- start start 2024-01-19T04:17:33.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb47c0723b0 0x7fb47c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb47c0c2080 0x7fb47c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c1524a0 con 0x7fb47c0c2080 2024-01-19T04:17:33.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c0a4ea0 con 0x7fb47c0723b0 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb482000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c152a20 con 0x7fb47c06d440 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb47c0c2080 0x7fb47c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb47c0c2080 0x7fb47c155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57000/0 (socket says 172.21.15.32:57000) 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 -- 172.21.15.32:0/4277170058 learned_addr learned my addr 172.21.15.32:0/4277170058 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47be00640 1 --2- 172.21.15.32:0/4277170058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47b400640 1 --2- 172.21.15.32:0/4277170058 >> v2:172.21.15.67:3300/0 conn(0x7fb47c0723b0 0x7fb47c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 -- 172.21.15.32:0/4277170058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 msgr2=0x7fb47c0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 --2- 172.21.15.32:0/4277170058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c0c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 -- 172.21.15.32:0/4277170058 >> v2:172.21.15.67:3300/0 conn(0x7fb47c0723b0 msgr2=0x7fb47c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 --2- 172.21.15.32:0/4277170058 >> v2:172.21.15.67:3300/0 conn(0x7fb47c0723b0 0x7fb47c152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.684+0000 7fb47aa00640 1 -- 172.21.15.32:0/4277170058 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c1533f0 con 0x7fb47c0c2080 2024-01-19T04:17:33.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb47aa00640 1 --2- 172.21.15.32:0/4277170058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0c2080 0x7fb47c155a90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0a8790 tx=0x7fb46401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f655155cbf5257 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:33.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb47a000640 1 -- 172.21.15.32:0/4277170058 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640ab600 con 0x7fb47c0c2080 2024-01-19T04:17:33.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb47a000640 1 -- 172.21.15.32:0/4277170058 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640a7050 con 0x7fb47c0c2080 2024-01-19T04:17:33.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb47a000640 1 -- 172.21.15.32:0/4277170058 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640ab980 con 0x7fb47c0c2080 2024-01-19T04:17:33.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 -- 172.21.15.32:0/4277170058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0c2080 msgr2=0x7fb47c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 --2- 172.21.15.32:0/4277170058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0c2080 0x7fb47c155a90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0a8790 tx=0x7fb46401c3e0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 -- 172.21.15.32:0/4277170058 shutdown_connections 2024-01-19T04:17:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 --2- 172.21.15.32:0/4277170058 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c0c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 --2- 172.21.15.32:0/4277170058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0c2080 0x7fb47c155a90 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 --2- 172.21.15.32:0/4277170058 >> v2:172.21.15.67:3300/0 conn(0x7fb47c0723b0 0x7fb47c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 -- 172.21.15.32:0/4277170058 >> 172.21.15.32:0/4277170058 conn(0x7fb47c0c25a0 msgr2=0x7fb47c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 -- 172.21.15.32:0/4277170058 shutdown_connections 2024-01-19T04:17:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.688+0000 7fb482000640 1 -- 172.21.15.32:0/4277170058 wait complete. 2024-01-19T04:17:33.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 Processor -- start 2024-01-19T04:17:33.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 -- start start 2024-01-19T04:17:33.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0723b0 0x7fb47c14a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb47c0c2080 0x7fb47c0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c1545d0 con 0x7fb47c0723b0 2024-01-19T04:17:33.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c14bbf0 con 0x7fb47c0c2080 2024-01-19T04:17:33.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c155750 con 0x7fb47c06d440 2024-01-19T04:17:33.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0723b0 0x7fb47c14a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0723b0 0x7fb47c14a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57002/0 (socket says 172.21.15.32:57002) 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 -- 172.21.15.32:0/1531577562 learned_addr learned my addr 172.21.15.32:0/1531577562 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47be00640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb47c0c2080 0x7fb47c0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47b400640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 -- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 msgr2=0x7fb47c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 -- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb47c0c2080 msgr2=0x7fb47c0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb47c0c2080 0x7fb47c0700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 -- 172.21.15.32:0/1531577562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640094d0 con 0x7fb47c0723b0 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47b400640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:33.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb47aa00640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0723b0 0x7fb47c14a450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb46401aa90 tx=0x7fb464019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:33.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb473400640 1 -- 172.21.15.32:0/1531577562 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640b6420 con 0x7fb47c0723b0 2024-01-19T04:17:33.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb473400640 1 -- 172.21.15.32:0/1531577562 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640b6580 con 0x7fb47c0723b0 2024-01-19T04:17:33.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb473400640 1 -- 172.21.15.32:0/1531577562 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640b6930 con 0x7fb47c0723b0 2024-01-19T04:17:33.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c155a30 con 0x7fb47c0723b0 2024-01-19T04:17:33.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.692+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c154b00 con 0x7fb47c0723b0 2024-01-19T04:17:33.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.696+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c0749f0 con 0x7fb47c0723b0 2024-01-19T04:17:33.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.696+0000 7fb473400640 1 -- 172.21.15.32:0/1531577562 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb4640b2040 con 0x7fb47c0723b0 2024-01-19T04:17:33.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.696+0000 7fb473400640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb454066530 0x7fb4540689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:33.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.696+0000 7fb473400640 1 -- 172.21.15.32:0/1531577562 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb46411e020 con 0x7fb47c0723b0 2024-01-19T04:17:33.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.696+0000 7fb47b400640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb454066530 0x7fb4540689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:33.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.696+0000 7fb47b400640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb454066530 0x7fb4540689f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009a90 tx=0x7fb46c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:33.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.700+0000 7fb473400640 1 -- 172.21.15.32:0/1531577562 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb4640eb270 con 0x7fb47c0723b0 2024-01-19T04:17:33.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.860+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb47c151310 con 0x7fb47c0723b0 2024-01-19T04:17:33.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb473400640 1 -- 172.21.15.32:0/1531577562 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4640ee890 con 0x7fb47c0723b0 2024-01-19T04:17:33.866 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:33.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb454066530 msgr2=0x7fb4540689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb454066530 0x7fb4540689f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009a90 tx=0x7fb46c008040 comp rx=0 tx=0).stop 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0723b0 msgr2=0x7fb47c14a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0723b0 0x7fb47c14a450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb46401aa90 tx=0x7fb464019180 comp rx=0 tx=0).stop 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 shutdown_connections 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb454066530 0x7fb4540689f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb47c0c2080 0x7fb47c0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb47c0723b0 0x7fb47c14a450 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 --2- 172.21.15.32:0/1531577562 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb47c06d440 0x7fb47c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 >> 172.21.15.32:0/1531577562 conn(0x7fb47c0c25a0 msgr2=0x7fb47c151830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 shutdown_connections 2024-01-19T04:17:33.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:33.864+0000 7fb482000640 1 -- 172.21.15.32:0/1531577562 wait complete. 2024-01-19T04:17:33.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:17:34.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a9000640 1 Processor -- start 2024-01-19T04:17:34.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a9000640 1 -- start start 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87a406cab0 0x7f87a406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a9000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f87a40c55d0 0x7f87a40c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a9000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a40c0eb0 con 0x7f87a40705b0 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a9000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a406e5c0 con 0x7f87a406cab0 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a9000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a40a5330 con 0x7f87a40c55d0 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a1e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87a406cab0 0x7f87a406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a2800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f87a40705b0 0x7f87a4154140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55406/0 (socket says 172.21.15.32:55406) 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a2800640 1 -- 172.21.15.32:0/2557751932 learned_addr learned my addr 172.21.15.32:0/2557751932 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.028+0000 7f87a1400640 1 --2- 172.21.15.32:0/2557751932 >> v2:172.21.15.67:3300/0 conn(0x7f87a40c55d0 0x7f87a40c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a1e00640 1 -- 172.21.15.32:0/2557751932 >> v2:172.21.15.67:3300/0 conn(0x7f87a40c55d0 msgr2=0x7f87a40c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a1e00640 1 --2- 172.21.15.32:0/2557751932 >> v2:172.21.15.67:3300/0 conn(0x7f87a40c55d0 0x7f87a40c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a1e00640 1 -- 172.21.15.32:0/2557751932 >> v1:172.21.15.32:6789/0 conn(0x7f87a40705b0 legacy=0x7f87a4154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a1e00640 1 -- 172.21.15.32:0/2557751932 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a41516f0 con 0x7f87a406cab0 2024-01-19T04:17:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a0a00640 1 -- 172.21.15.32:0/2557751932 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022158138 0 0) 0x7f87a40c0eb0 con 0x7f87a40705b0 2024-01-19T04:17:34.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a1e00640 1 --2- 172.21.15.32:0/2557751932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a406cab0 0x7f87a406ce90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f87a406e470 tx=0x7f879401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86046652fda46201 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a0a00640 1 -- 172.21.15.32:0/2557751932 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940ab610 con 0x7f87a406cab0 2024-01-19T04:17:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a0a00640 1 -- 172.21.15.32:0/2557751932 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87940ab770 con 0x7f87a406cab0 2024-01-19T04:17:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.032+0000 7f87a0a00640 1 -- 172.21.15.32:0/2557751932 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940abb00 con 0x7f87a406cab0 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- 172.21.15.32:0/2557751932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a406cab0 msgr2=0x7f87a406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 --2- 172.21.15.32:0/2557751932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a406cab0 0x7f87a406ce90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f87a406e470 tx=0x7f879401c410 comp rx=0 tx=0).stop 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- 172.21.15.32:0/2557751932 shutdown_connections 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 --2- 172.21.15.32:0/2557751932 >> v2:172.21.15.67:3300/0 conn(0x7f87a40c55d0 0x7f87a40c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 --2- 172.21.15.32:0/2557751932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a406cab0 0x7f87a406ce90 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- 172.21.15.32:0/2557751932 >> 172.21.15.32:0/2557751932 conn(0x7f87a40c25a0 msgr2=0x7f87a40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- 172.21.15.32:0/2557751932 shutdown_connections 2024-01-19T04:17:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- 172.21.15.32:0/2557751932 wait complete. 2024-01-19T04:17:34.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 Processor -- start 2024-01-19T04:17:34.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- start start 2024-01-19T04:17:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87a406cab0 0x7f87a414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a40705b0 0x7f87a41421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87a40c55d0 0x7f87a41ee010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4142710 con 0x7f87a40705b0 2024-01-19T04:17:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4146010 con 0x7f87a406cab0 2024-01-19T04:17:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a9000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4147370 con 0x7f87a40c55d0 2024-01-19T04:17:34.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a40705b0 0x7f87a41421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a40705b0 0x7f87a41421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57024/0 (socket says 172.21.15.32:57024) 2024-01-19T04:17:34.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a1400640 1 -- 172.21.15.32:0/3155955140 learned_addr learned my addr 172.21.15.32:0/3155955140 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:34.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a1e00640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87a406cab0 0x7f87a414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.036+0000 7f87a2800640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87a40c55d0 0x7f87a41ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a1400640 1 -- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87a40c55d0 msgr2=0x7f87a41ee010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a1400640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87a40c55d0 0x7f87a41ee010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a1400640 1 -- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87a406cab0 msgr2=0x7f87a414de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a1400640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87a406cab0 0x7f87a414de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a1400640 1 -- 172.21.15.32:0/3155955140 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794009420 con 0x7f87a40705b0 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a1400640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a40705b0 0x7f87a41421d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f878c00e930 tx=0x7f878c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f879a000640 1 -- 172.21.15.32:0/3155955140 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c009690 con 0x7f87a40705b0 2024-01-19T04:17:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f879a000640 1 -- 172.21.15.32:0/3155955140 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c00ca00 con 0x7f87a40705b0 2024-01-19T04:17:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a4153050 con 0x7f87a40705b0 2024-01-19T04:17:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f879a000640 1 -- 172.21.15.32:0/3155955140 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c00cd70 con 0x7f87a40705b0 2024-01-19T04:17:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a41edaf0 con 0x7f87a40705b0 2024-01-19T04:17:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a40749f0 con 0x7f87a40705b0 2024-01-19T04:17:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f879a000640 1 -- 172.21.15.32:0/3155955140 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f878c013470 con 0x7f87a40705b0 2024-01-19T04:17:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f879a000640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f877c066500 0x7f877c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f879a000640 1 -- 172.21.15.32:0/3155955140 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f878c084070 con 0x7f87a40705b0 2024-01-19T04:17:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.040+0000 7f87a1e00640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f877c066500 0x7f877c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.044+0000 7f87a1e00640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f877c066500 0x7f877c0689c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f87940af000 tx=0x7f87940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.044+0000 7f879a000640 1 -- 172.21.15.32:0/3155955140 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f878c0b54d0 con 0x7f87a40705b0 2024-01-19T04:17:34.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.204+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87a4142850 con 0x7f87a40705b0 2024-01-19T04:17:34.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.204+0000 7f879a000640 1 -- 172.21.15.32:0/3155955140 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v60) v1 ==== 105+0+11 (secure 0 0 0) 0x7f878c051410 con 0x7f87a40705b0 2024-01-19T04:17:34.209 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:34.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f877c066500 msgr2=0x7f877c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f877c066500 0x7f877c0689c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f87940af000 tx=0x7f87940a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:34.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a40705b0 msgr2=0x7f87a41421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a40705b0 0x7f87a41421d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f878c00e930 tx=0x7f878c00edf0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 shutdown_connections 2024-01-19T04:17:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f877c066500 0x7f877c0689c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87a40c55d0 0x7f87a41ee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87a40705b0 0x7f87a41421d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 --2- 172.21.15.32:0/3155955140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87a406cab0 0x7f87a414de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 >> 172.21.15.32:0/3155955140 conn(0x7f87a40c25a0 msgr2=0x7f87a414c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 shutdown_connections 2024-01-19T04:17:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.208+0000 7f87a9000640 1 -- 172.21.15.32:0/3155955140 wait complete. 2024-01-19T04:17:34.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:17:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 Processor -- start 2024-01-19T04:17:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 -- start start 2024-01-19T04:17:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298155520 0x7f629806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6298072490 0x7f629806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62980bf360 0x7f62980a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62980beed0 con 0x7f62980bf360 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62980c3a80 con 0x7f6298072490 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629fa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62980c3d60 con 0x7f6298155520 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62980bf360 0x7f62980a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62980bf360 0x7f62980a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57028/0 (socket says 172.21.15.32:57028) 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 -- 172.21.15.32:0/39677170 learned_addr learned my addr 172.21.15.32:0/39677170 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629d000640 1 --2- 172.21.15.32:0/39677170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298155520 0x7f629806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f6297e00640 1 --2- 172.21.15.32:0/39677170 >> v2:172.21.15.67:3300/0 conn(0x7f6298072490 0x7f629806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 -- 172.21.15.32:0/39677170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298155520 msgr2=0x7f629806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 --2- 172.21.15.32:0/39677170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298155520 0x7f629806c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 -- 172.21.15.32:0/39677170 >> v2:172.21.15.67:3300/0 conn(0x7f6298072490 msgr2=0x7f629806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 --2- 172.21.15.32:0/39677170 >> v2:172.21.15.67:3300/0 conn(0x7f6298072490 0x7f629806d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.372+0000 7f629da00640 1 -- 172.21.15.32:0/39677170 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62980c4040 con 0x7f62980bf360 2024-01-19T04:17:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629da00640 1 --2- 172.21.15.32:0/39677170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f62980a4d10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f62980a8810 tx=0x7f629001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee32614ca25e0c14 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f6297400640 1 -- 172.21.15.32:0/39677170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900a55c0 con 0x7f62980bf360 2024-01-19T04:17:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f6297400640 1 -- 172.21.15.32:0/39677170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62900a5720 con 0x7f62980bf360 2024-01-19T04:17:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f6297400640 1 -- 172.21.15.32:0/39677170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900a5ab0 con 0x7f62980bf360 2024-01-19T04:17:34.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 -- 172.21.15.32:0/39677170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 msgr2=0x7f62980a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 --2- 172.21.15.32:0/39677170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f62980a4d10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f62980a8810 tx=0x7f629001c940 comp rx=0 tx=0).stop 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 -- 172.21.15.32:0/39677170 shutdown_connections 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 --2- 172.21.15.32:0/39677170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f62980a4d10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 --2- 172.21.15.32:0/39677170 >> v2:172.21.15.67:3300/0 conn(0x7f6298072490 0x7f629806d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 --2- 172.21.15.32:0/39677170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298155520 0x7f629806c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 -- 172.21.15.32:0/39677170 >> 172.21.15.32:0/39677170 conn(0x7f62980c25a0 msgr2=0x7f62980c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 -- 172.21.15.32:0/39677170 shutdown_connections 2024-01-19T04:17:34.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.376+0000 7f629fa00640 1 -- 172.21.15.32:0/39677170 wait complete. 2024-01-19T04:17:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 Processor -- start 2024-01-19T04:17:34.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 -- start start 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298072490 0x7f6298071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f629814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6298155520 0x7f62980704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6298072280 con 0x7f62980bf360 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62981ee520 con 0x7f6298155520 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62981ed760 con 0x7f6298072490 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f629814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f629814b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57032/0 (socket says 172.21.15.32:57032) 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 -- 172.21.15.32:0/2541973233 learned_addr learned my addr 172.21.15.32:0/2541973233 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629d000640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298072490 0x7f6298071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629da00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6298155520 0x7f62980704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 -- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298072490 msgr2=0x7f6298071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298072490 0x7f6298071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 -- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6298155520 msgr2=0x7f62980704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6298155520 0x7f62980704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 -- 172.21.15.32:0/2541973233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009b30 con 0x7f62980bf360 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629da00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6298155520 0x7f62980704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6297e00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f629814b880 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f628000d7d0 tx=0x7f628000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6294c00640 1 -- 172.21.15.32:0/2541973233 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62800096a0 con 0x7f62980bf360 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6294c00640 1 -- 172.21.15.32:0/2541973233 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280009800 con 0x7f62980bf360 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62981eda40 con 0x7f62980bf360 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f6294c00640 1 -- 172.21.15.32:0/2541973233 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280009bb0 con 0x7f62980bf360 2024-01-19T04:17:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.380+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62981ee000 con 0x7f62980bf360 2024-01-19T04:17:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.384+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62980749f0 con 0x7f62980bf360 2024-01-19T04:17:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.384+0000 7f6294c00640 1 -- 172.21.15.32:0/2541973233 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6280009d10 con 0x7f62980bf360 2024-01-19T04:17:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.384+0000 7f6294c00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6270066500 0x7f62700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.384+0000 7f6294c00640 1 -- 172.21.15.32:0/2541973233 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f62800844c0 con 0x7f62980bf360 2024-01-19T04:17:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.384+0000 7f629d000640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6270066500 0x7f62700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.388+0000 7f629d000640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6270066500 0x7f62700689c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f628800b930 tx=0x7f6288008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.388+0000 7f6294c00640 1 -- 172.21.15.32:0/2541973233 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6280051660 con 0x7f62980bf360 2024-01-19T04:17:34.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f62980c50e0 con 0x7f62980bf360 2024-01-19T04:17:34.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f6294c00640 1 -- 172.21.15.32:0/2541973233 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v60) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6280054c80 con 0x7f62980bf360 2024-01-19T04:17:34.550 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6270066500 msgr2=0x7f62700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6270066500 0x7f62700689c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f628800b930 tx=0x7f6288008040 comp rx=0 tx=0).stop 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 msgr2=0x7f629814b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f629814b880 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f628000d7d0 tx=0x7f628000dc90 comp rx=0 tx=0).stop 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 shutdown_connections 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6270066500 0x7f62700689c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6298155520 0x7f62980704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62980bf360 0x7f629814b880 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 --2- 172.21.15.32:0/2541973233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6298072490 0x7f6298071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 >> 172.21.15.32:0/2541973233 conn(0x7f62980c25a0 msgr2=0x7f62981546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 shutdown_connections 2024-01-19T04:17:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.548+0000 7f629fa00640 1 -- 172.21.15.32:0/2541973233 wait complete. 2024-01-19T04:17:34.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:34.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cfe000640 1 Processor -- start 2024-01-19T04:17:34.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cfe000640 1 -- start start 2024-01-19T04:17:34.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cfe000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8cf80a6d30 0x7f8cf80c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cfe000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf81533a0 con 0x7f8cf806fda0 2024-01-19T04:17:34.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cfe000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf8152800 con 0x7f8cf80c6e20 2024-01-19T04:17:34.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cfe000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf8156380 con 0x7f8cf80a6d30 2024-01-19T04:17:34.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8cf806fda0 0x7f8cf815cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55420/0 (socket says 172.21.15.32:55420) 2024-01-19T04:17:34.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf7e00640 1 -- 172.21.15.32:0/4126673940 learned_addr learned my addr 172.21.15.32:0/4126673940 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:34.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf6a00640 1 --2- 172.21.15.32:0/4126673940 >> v2:172.21.15.67:3300/0 conn(0x7f8cf80a6d30 0x7f8cf80c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf6000640 1 -- 172.21.15.32:0/4126673940 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293619501 0 0) 0x7f8cf00014a0 con 0x7f8cf806fda0 2024-01-19T04:17:34.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf6000640 1 -- 172.21.15.32:0/4126673940 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd8003530 con 0x7f8cf806fda0 2024-01-19T04:17:34.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf6a00640 1 -- 172.21.15.32:0/4126673940 >> v1:172.21.15.67:6789/0 conn(0x7f8cf80c6e20 legacy=0x7f8cf8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf6000640 1 -- 172.21.15.32:0/4126673940 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365875283 0 0) 0x7f8cf8152800 con 0x7f8cf80c6e20 2024-01-19T04:17:34.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf6a00640 1 -- 172.21.15.32:0/4126673940 >> v1:172.21.15.32:6789/0 conn(0x7f8cf806fda0 legacy=0x7f8cf815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.712+0000 7f8cf6a00640 1 -- 172.21.15.32:0/4126673940 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8156590 con 0x7f8cf80a6d30 2024-01-19T04:17:34.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cf6a00640 1 --2- 172.21.15.32:0/4126673940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf80a6d30 0x7f8cf80c7200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097c0 tx=0x7f8ce001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12881969005bbd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cf6000640 1 -- 172.21.15.32:0/4126673940 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab600 con 0x7f8cf80a6d30 2024-01-19T04:17:34.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cf6000640 1 -- 172.21.15.32:0/4126673940 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce00a7050 con 0x7f8cf80a6d30 2024-01-19T04:17:34.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cf6000640 1 -- 172.21.15.32:0/4126673940 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab960 con 0x7f8cf80a6d30 2024-01-19T04:17:34.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cfe000640 1 -- 172.21.15.32:0/4126673940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf80a6d30 msgr2=0x7f8cf80c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cfe000640 1 --2- 172.21.15.32:0/4126673940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf80a6d30 0x7f8cf80c7200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097c0 tx=0x7f8ce001c3f0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cfe000640 1 -- 172.21.15.32:0/4126673940 shutdown_connections 2024-01-19T04:17:34.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cfe000640 1 --2- 172.21.15.32:0/4126673940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf80a6d30 0x7f8cf80c7200 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cfe000640 1 -- 172.21.15.32:0/4126673940 >> 172.21.15.32:0/4126673940 conn(0x7f8cf80a9870 msgr2=0x7f8cf80a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cfe000640 1 -- 172.21.15.32:0/4126673940 shutdown_connections 2024-01-19T04:17:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.716+0000 7f8cfe000640 1 -- 172.21.15.32:0/4126673940 wait complete. 2024-01-19T04:17:34.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 Processor -- start 2024-01-19T04:17:34.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 -- start start 2024-01-19T04:17:34.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf806fda0 0x7f8cf814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cf80a6d30 0x7f8cf81f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cf80c6e20 0x7f8cf814be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf815dc50 con 0x7f8cf80c6e20 2024-01-19T04:17:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf815c410 con 0x7f8cf806fda0 2024-01-19T04:17:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf815d970 con 0x7f8cf80a6d30 2024-01-19T04:17:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cf80c6e20 0x7f8cf814be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cf80c6e20 0x7f8cf814be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57040/0 (socket says 172.21.15.32:57040) 2024-01-19T04:17:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 -- 172.21.15.32:0/2110342151 learned_addr learned my addr 172.21.15.32:0/2110342151 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf6a00640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cf80a6d30 0x7f8cf81f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7400640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf806fda0 0x7f8cf814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 -- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cf80a6d30 msgr2=0x7f8cf81f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cf80a6d30 0x7f8cf81f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 -- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf806fda0 msgr2=0x7f8cf814ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf806fda0 0x7f8cf814ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 -- 172.21.15.32:0/2110342151 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0009420 con 0x7f8cf80c6e20 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf6a00640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cf80a6d30 0x7f8cf81f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7400640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf806fda0 0x7f8cf814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cf7e00640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cf80c6e20 0x7f8cf814be00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000cb40 tx=0x7f8cf000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cef400640 1 -- 172.21.15.32:0/2110342151 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000aca0 con 0x7f8cf80c6e20 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cef400640 1 -- 172.21.15.32:0/2110342151 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf000ae00 con 0x7f8cf80c6e20 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cef400640 1 -- 172.21.15.32:0/2110342151 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0012620 con 0x7f8cf80c6e20 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf815c6b0 con 0x7f8cf80c6e20 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.720+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf814dd40 con 0x7f8cf80c6e20 2024-01-19T04:17:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.724+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf815c250 con 0x7f8cf80c6e20 2024-01-19T04:17:34.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.724+0000 7f8cef400640 1 -- 172.21.15.32:0/2110342151 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8cf0007070 con 0x7f8cf80c6e20 2024-01-19T04:17:34.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.724+0000 7f8cef400640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cd0066530 0x7f8cd00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:34.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.724+0000 7f8cef400640 1 -- 172.21.15.32:0/2110342151 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f8cf0083db0 con 0x7f8cf80c6e20 2024-01-19T04:17:34.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.724+0000 7f8cf7400640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cd0066530 0x7f8cd00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:34.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.724+0000 7f8cf7400640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cd0066530 0x7f8cd00689f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8000f70 tx=0x7f8ce8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.728+0000 7f8cef400640 1 -- 172.21.15.32:0/2110342151 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8cf0050ff0 con 0x7f8cf80c6e20 2024-01-19T04:17:34.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.924+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cf81533a0 con 0x7f8cf80c6e20 2024-01-19T04:17:34.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.924+0000 7f8cef400640 1 -- 172.21.15.32:0/2110342151 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f8cf81533a0 con 0x7f8cf80c6e20 2024-01-19T04:17:34.929 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:34.929 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3551699011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3551699011},{"type":"v1","addr":"172.21.15.67:6837","nonce":3551699011}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:34.929 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 38 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cd0066530 msgr2=0x7f8cd00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cd0066530 0x7f8cd00689f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8000f70 tx=0x7f8ce8009040 comp rx=0 tx=0).stop 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cf80c6e20 msgr2=0x7f8cf814be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cf80c6e20 0x7f8cf814be00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000cb40 tx=0x7f8cf000a060 comp rx=0 tx=0).stop 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 shutdown_connections 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cd0066530 0x7f8cd00689f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cf80c6e20 0x7f8cf814be00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cf80a6d30 0x7f8cf81f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 --2- 172.21.15.32:0/2110342151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf806fda0 0x7f8cf814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 >> 172.21.15.32:0/2110342151 conn(0x7f8cf80a9870 msgr2=0x7f8cf8070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:34.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 shutdown_connections 2024-01-19T04:17:34.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:34.928+0000 7f8cfe000640 1 -- 172.21.15.32:0/2110342151 wait complete. 2024-01-19T04:17:34.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018f600640 1 Processor -- start 2024-01-19T04:17:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018f600640 1 -- start start 2024-01-19T04:17:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018f600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f018814fb50 0x7f018806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018f600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01880c04a0 0x7f01880c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018f600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0188071e80 con 0x7f01880a4ec0 2024-01-19T04:17:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018f600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01881535c0 con 0x7f01880c04a0 2024-01-19T04:17:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018f600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01880726c0 con 0x7f018814fb50 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f018814fb50 0x7f018806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f0187e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01880c04a0 0x7f01880c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f018814fb50 0x7f018806fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:35088/0 (socket says 172.21.15.32:35088) 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f0187e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01880c04a0 0x7f01880c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57042/0 (socket says 172.21.15.32:57042) 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018cc00640 1 -- 172.21.15.32:0/2040736896 learned_addr learned my addr 172.21.15.32:0/2040736896 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f018d600640 1 --1- 172.21.15.32:0/2040736896 >> v1:172.21.15.67:6789/0 conn(0x7f01880a4ec0 0x7f0188155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:42538/0 (socket says 172.21.15.32:42538) 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f0187e00640 1 -- 172.21.15.32:0/2040736896 >> v2:172.21.15.67:3300/0 conn(0x7f018814fb50 msgr2=0x7f018806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f0187e00640 1 --2- 172.21.15.32:0/2040736896 >> v2:172.21.15.67:3300/0 conn(0x7f018814fb50 0x7f018806fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f0187e00640 1 -- 172.21.15.32:0/2040736896 >> v1:172.21.15.67:6789/0 conn(0x7f01880a4ec0 legacy=0x7f0188155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.088+0000 7f0187e00640 1 -- 172.21.15.32:0/2040736896 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880c0a20 con 0x7f01880c04a0 2024-01-19T04:17:35.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f0187e00640 1 --2- 172.21.15.32:0/2040736896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880c04a0 0x7f01880c1230 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f018806f5f0 tx=0x7f017001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7386d59d64879bd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f0187400640 1 -- 172.21.15.32:0/2040736896 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700ab600 con 0x7f01880c04a0 2024-01-19T04:17:35.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f0187400640 1 -- 172.21.15.32:0/2040736896 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700a7050 con 0x7f01880c04a0 2024-01-19T04:17:35.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f0187400640 1 -- 172.21.15.32:0/2040736896 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700ab980 con 0x7f01880c04a0 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 -- 172.21.15.32:0/2040736896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880c04a0 msgr2=0x7f01880c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 --2- 172.21.15.32:0/2040736896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880c04a0 0x7f01880c1230 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f018806f5f0 tx=0x7f017001c3d0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 -- 172.21.15.32:0/2040736896 shutdown_connections 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 --2- 172.21.15.32:0/2040736896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880c04a0 0x7f01880c1230 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 --2- 172.21.15.32:0/2040736896 >> v2:172.21.15.67:3300/0 conn(0x7f018814fb50 0x7f018806fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 -- 172.21.15.32:0/2040736896 >> 172.21.15.32:0/2040736896 conn(0x7f01880c5b20 msgr2=0x7f01880c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 -- 172.21.15.32:0/2040736896 shutdown_connections 2024-01-19T04:17:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.092+0000 7f018f600640 1 -- 172.21.15.32:0/2040736896 wait complete. 2024-01-19T04:17:35.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 Processor -- start 2024-01-19T04:17:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 -- start start 2024-01-19T04:17:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880a4ec0 0x7f0188150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01880c04a0 0x7f0188150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f018814fb50 0x7f0188148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880a8b50 con 0x7f01880a4ec0 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188150150 con 0x7f01880c04a0 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01881503c0 con 0x7f018814fb50 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880a4ec0 0x7f0188150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880a4ec0 0x7f0188150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57044/0 (socket says 172.21.15.32:57044) 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 -- 172.21.15.32:0/1281222092 learned_addr learned my addr 172.21.15.32:0/1281222092 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f0187e00640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01880c04a0 0x7f0188150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018d600640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f018814fb50 0x7f0188148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 -- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f018814fb50 msgr2=0x7f0188148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f018814fb50 0x7f0188148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 -- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01880c04a0 msgr2=0x7f0188150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01880c04a0 0x7f0188150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 -- 172.21.15.32:0/1281222092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170009420 con 0x7f01880a4ec0 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018cc00640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880a4ec0 0x7f0188150a80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f017800e820 tx=0x7f017800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f0184c00640 1 -- 172.21.15.32:0/1281222092 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178009580 con 0x7f01880a4ec0 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f0184c00640 1 -- 172.21.15.32:0/1281222092 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017800c940 con 0x7f01880a4ec0 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f0184c00640 1 -- 172.21.15.32:0/1281222092 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800ccf0 con 0x7f01880a4ec0 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188147f00 con 0x7f01880a4ec0 2024-01-19T04:17:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.096+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018814a320 con 0x7f01880a4ec0 2024-01-19T04:17:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.100+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188147d60 con 0x7f01880a4ec0 2024-01-19T04:17:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.100+0000 7f0184c00640 1 -- 172.21.15.32:0/1281222092 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0178013470 con 0x7f01880a4ec0 2024-01-19T04:17:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.100+0000 7f0184c00640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0160066500 0x7f01600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.100+0000 7f0184c00640 1 -- 172.21.15.32:0/1281222092 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f0178083f50 con 0x7f01880a4ec0 2024-01-19T04:17:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.100+0000 7f0187e00640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0160066500 0x7f01600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.100+0000 7f0187e00640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0160066500 0x7f01600689c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f01700ad000 tx=0x7f0170008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.104+0000 7f0184c00640 1 -- 172.21.15.32:0/1281222092 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0188147d60 con 0x7f01880a4ec0 2024-01-19T04:17:35.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.268+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0188147d60 con 0x7f01880a4ec0 2024-01-19T04:17:35.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.268+0000 7f0184c00640 1 -- 172.21.15.32:0/1281222092 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f0188147d60 con 0x7f01880a4ec0 2024-01-19T04:17:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:35.272 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":60,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:33.157100+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/246892917":"2024-01-20T04:17:30.151066+0000","172.21.15.67:6835/246892917":"2024-01-20T04:17:30.151066+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0160066500 msgr2=0x7f01600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0160066500 0x7f01600689c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f01700ad000 tx=0x7f0170008040 comp rx=0 tx=0).stop 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880a4ec0 msgr2=0x7f0188150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880a4ec0 0x7f0188150a80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f017800e820 tx=0x7f017800ece0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 shutdown_connections 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0160066500 0x7f01600689c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f018814fb50 0x7f0188148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01880c04a0 0x7f0188150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 --2- 172.21.15.32:0/1281222092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880a4ec0 0x7f0188150a80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 >> 172.21.15.32:0/1281222092 conn(0x7f01880c5b20 msgr2=0x7f0188154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:35.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 shutdown_connections 2024-01-19T04:17:35.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.272+0000 7f018f600640 1 -- 172.21.15.32:0/1281222092 wait complete. 2024-01-19T04:17:35.294 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-19T04:17:35.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9fa0200640 1 Processor -- start 2024-01-19T04:17:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9fa0200640 1 -- start start 2024-01-19T04:17:35.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9fa0200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f9814e970 0x7f9f9814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9fa0200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f980726c0 0x7f9f980c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9fa0200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f980c4e40 con 0x7f9f980c1750 2024-01-19T04:17:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9fa0200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9806f540 con 0x7f9f9814e970 2024-01-19T04:17:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9fa0200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980c24c0 con 0x7f9f980726c0 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9ce00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9f980c1750 0x7f9f98070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55432/0 (socket says 172.21.15.32:55432) 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f9814e970 0x7f9f9814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9ce00640 1 -- 172.21.15.32:0/2922748842 learned_addr learned my addr 172.21.15.32:0/2922748842 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9e200640 1 --2- 172.21.15.32:0/2922748842 >> v2:172.21.15.67:3300/0 conn(0x7f9f980726c0 0x7f9f980c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9d800640 1 -- 172.21.15.32:0/2922748842 >> v2:172.21.15.67:3300/0 conn(0x7f9f980726c0 msgr2=0x7f9f980c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9d800640 1 --2- 172.21.15.32:0/2922748842 >> v2:172.21.15.67:3300/0 conn(0x7f9f980726c0 0x7f9f980c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9d800640 1 -- 172.21.15.32:0/2922748842 >> v1:172.21.15.32:6789/0 conn(0x7f9f980c1750 legacy=0x7f9f98070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9d800640 1 -- 172.21.15.32:0/2922748842 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98158dc0 con 0x7f9f9814e970 2024-01-19T04:17:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.432+0000 7f9f9e200640 1 --2- 172.21.15.32:0/2922748842 >> v2:172.21.15.67:3300/0 conn(0x7f9f980726c0 0x7f9f980c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:35.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9f9d800640 1 --2- 172.21.15.32:0/2922748842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f9814ed50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9f980a6680 tx=0x7f9f8801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212ff09f1ffd904d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9f97e00640 1 -- 172.21.15.32:0/2922748842 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880ac400 con 0x7f9f9814e970 2024-01-19T04:17:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9f97e00640 1 -- 172.21.15.32:0/2922748842 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f880a8050 con 0x7f9f9814e970 2024-01-19T04:17:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9f97e00640 1 -- 172.21.15.32:0/2922748842 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880ac780 con 0x7f9f9814e970 2024-01-19T04:17:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 -- 172.21.15.32:0/2922748842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 msgr2=0x7f9f9814ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 --2- 172.21.15.32:0/2922748842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f9814ed50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9f980a6680 tx=0x7f9f8801c3a0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 -- 172.21.15.32:0/2922748842 shutdown_connections 2024-01-19T04:17:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 --2- 172.21.15.32:0/2922748842 >> v2:172.21.15.67:3300/0 conn(0x7f9f980726c0 0x7f9f980c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 --2- 172.21.15.32:0/2922748842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f9814ed50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 -- 172.21.15.32:0/2922748842 >> 172.21.15.32:0/2922748842 conn(0x7f9f980c6b30 msgr2=0x7f9f980c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:35.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 -- 172.21.15.32:0/2922748842 shutdown_connections 2024-01-19T04:17:35.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.436+0000 7f9fa0200640 1 -- 172.21.15.32:0/2922748842 wait complete. 2024-01-19T04:17:35.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 Processor -- start 2024-01-19T04:17:35.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 -- start start 2024-01-19T04:17:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f980726c0 0x7f9f980bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f980c1750 0x7f9f9814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f98154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980c0350 con 0x7f9f9814e970 2024-01-19T04:17:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980c0630 con 0x7f9f980726c0 2024-01-19T04:17:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f981edc80 con 0x7f9f980c1750 2024-01-19T04:17:35.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f98154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f98154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57064/0 (socket says 172.21.15.32:57064) 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 -- 172.21.15.32:0/1929550663 learned_addr learned my addr 172.21.15.32:0/1929550663 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9d800640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f980726c0 0x7f9f980bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9ce00640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f980c1750 0x7f9f9814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 -- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f980c1750 msgr2=0x7f9f9814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f980c1750 0x7f9f9814a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 -- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f980726c0 msgr2=0x7f9f980bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f980726c0 0x7f9f980bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 -- 172.21.15.32:0/1929550663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009420 con 0x7f9f9814e970 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9ce00640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f980c1750 0x7f9f9814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:35.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f9e200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f98154dd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9f90007ef0 tx=0x7f9f9000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f95600640 1 -- 172.21.15.32:0/1929550663 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90015600 con 0x7f9f9814e970 2024-01-19T04:17:35.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f95600640 1 -- 172.21.15.32:0/1929550663 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9000f040 con 0x7f9f9814e970 2024-01-19T04:17:35.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f981edf60 con 0x7f9f9814e970 2024-01-19T04:17:35.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9f95600640 1 -- 172.21.15.32:0/1929550663 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900159a0 con 0x7f9f9814e970 2024-01-19T04:17:35.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.440+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f980c0050 con 0x7f9f9814e970 2024-01-19T04:17:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.444+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f981ee480 con 0x7f9f9814e970 2024-01-19T04:17:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.444+0000 7f9f95600640 1 -- 172.21.15.32:0/1929550663 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9f9001e3b0 con 0x7f9f9814e970 2024-01-19T04:17:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.444+0000 7f9f95600640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f70066500 0x7f9f700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.444+0000 7f9f95600640 1 -- 172.21.15.32:0/1929550663 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9f900842a0 con 0x7f9f9814e970 2024-01-19T04:17:35.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.444+0000 7f9f9d800640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f70066500 0x7f9f700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.444+0000 7f9f9d800640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f70066500 0x7f9f700689c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9f880ae000 tx=0x7f9f880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.448+0000 7f9f95600640 1 -- 172.21.15.32:0/1929550663 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9f981ee480 con 0x7f9f9814e970 2024-01-19T04:17:35.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.640+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f981ee480 con 0x7f9f9814e970 2024-01-19T04:17:35.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.640+0000 7f9f95600640 1 -- 172.21.15.32:0/1929550663 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f9f981ee480 con 0x7f9f9814e970 2024-01-19T04:17:35.644 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:35.645 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3551699011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3551699011},{"type":"v1","addr":"172.21.15.67:6837","nonce":3551699011}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:35.645 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 38 2024-01-19T04:17:35.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f70066500 msgr2=0x7f9f700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f70066500 0x7f9f700689c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9f880ae000 tx=0x7f9f880a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:35.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 msgr2=0x7f9f98154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f98154dd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9f90007ef0 tx=0x7f9f9000d4a0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 shutdown_connections 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f70066500 0x7f9f700689c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f9814e970 0x7f9f98154dd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f980c1750 0x7f9f9814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 --2- 172.21.15.32:0/1929550663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f980726c0 0x7f9f980bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 >> 172.21.15.32:0/1929550663 conn(0x7f9f980c6b30 msgr2=0x7f9f980a77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 shutdown_connections 2024-01-19T04:17:35.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.644+0000 7f9fa0200640 1 -- 172.21.15.32:0/1929550663 wait complete. 2024-01-19T04:17:35.666 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:35.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faac1800640 1 Processor -- start 2024-01-19T04:17:35.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faac1800640 1 -- start start 2024-01-19T04:17:35.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faac1800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faabc147f90 0x7faabc151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faac1800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faabc0c55e0 0x7faabc0c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faac1800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0c0810 con 0x7faabc06beb0 2024-01-19T04:17:35.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faac1800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0c1df0 con 0x7faabc147f90 2024-01-19T04:17:35.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faac1800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0c0af0 con 0x7faabc0c55e0 2024-01-19T04:17:35.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faabaa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faabc147f90 0x7faabc151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faabaa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faabc147f90 0x7faabc151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57072/0 (socket says 172.21.15.32:57072) 2024-01-19T04:17:35.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faabaa00640 1 -- 172.21.15.32:0/3712441369 learned_addr learned my addr 172.21.15.32:0/3712441369 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:35.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.804+0000 7faaba000640 1 --2- 172.21.15.32:0/3712441369 >> v2:172.21.15.67:3300/0 conn(0x7faabc0c55e0 0x7faabc0c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faabaa00640 1 -- 172.21.15.32:0/3712441369 >> v2:172.21.15.67:3300/0 conn(0x7faabc0c55e0 msgr2=0x7faabc0c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:35.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faabaa00640 1 --2- 172.21.15.32:0/3712441369 >> v2:172.21.15.67:3300/0 conn(0x7faabc0c55e0 0x7faabc0c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faabaa00640 1 -- 172.21.15.32:0/3712441369 >> v1:172.21.15.67:6789/0 conn(0x7faabc06beb0 legacy=0x7faabc0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faabaa00640 1 -- 172.21.15.32:0/3712441369 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0c0dd0 con 0x7faabc147f90 2024-01-19T04:17:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faabaa00640 1 --2- 172.21.15.32:0/3712441369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc151350 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faabc073ee0 tx=0x7faaac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4229009a9b2a869f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faab9600640 1 -- 172.21.15.32:0/3712441369 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0ab640 con 0x7faabc147f90 2024-01-19T04:17:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faab9600640 1 -- 172.21.15.32:0/3712441369 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac0a7070 con 0x7faabc147f90 2024-01-19T04:17:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faab9600640 1 -- 172.21.15.32:0/3712441369 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0ab9c0 con 0x7faabc147f90 2024-01-19T04:17:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faac1800640 1 -- 172.21.15.32:0/3712441369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 msgr2=0x7faabc151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.808+0000 7faac1800640 1 --2- 172.21.15.32:0/3712441369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc151350 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faabc073ee0 tx=0x7faaac01c440 comp rx=0 tx=0).stop 2024-01-19T04:17:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- 172.21.15.32:0/3712441369 shutdown_connections 2024-01-19T04:17:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 --2- 172.21.15.32:0/3712441369 >> v2:172.21.15.67:3300/0 conn(0x7faabc0c55e0 0x7faabc0c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 --2- 172.21.15.32:0/3712441369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc151350 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- 172.21.15.32:0/3712441369 >> 172.21.15.32:0/3712441369 conn(0x7faabc0c5b20 msgr2=0x7faabc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- 172.21.15.32:0/3712441369 shutdown_connections 2024-01-19T04:17:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- 172.21.15.32:0/3712441369 wait complete. 2024-01-19T04:17:35.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 Processor -- start 2024-01-19T04:17:35.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- start start 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faabc06beb0 0x7faabc14ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faabc0c55e0 0x7faabc150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc140910 con 0x7faabc147f90 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc148370 con 0x7faabc0c55e0 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faac1800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc14b5c0 con 0x7faabc06beb0 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc1509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57088/0 (socket says 172.21.15.32:57088) 2024-01-19T04:17:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 -- 172.21.15.32:0/2571315366 learned_addr learned my addr 172.21.15.32:0/2571315366 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:35.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faaba000640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faabc0c55e0 0x7faabc150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabaa00640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faabc06beb0 0x7faabc14ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 -- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faabc06beb0 msgr2=0x7faabc14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faabc06beb0 0x7faabc14ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 -- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faabc0c55e0 msgr2=0x7faabc150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:35.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faabc0c55e0 0x7faabc150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:35.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 -- 172.21.15.32:0/2571315366 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0094d0 con 0x7faabc147f90 2024-01-19T04:17:35.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.812+0000 7faabb400640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc1509b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7faab400c6c0 tx=0x7faab400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faab2a00640 1 -- 172.21.15.32:0/2571315366 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4003b80 con 0x7faabc147f90 2024-01-19T04:17:35.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faab2a00640 1 -- 172.21.15.32:0/2571315366 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4003ce0 con 0x7faabc147f90 2024-01-19T04:17:35.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faab2a00640 1 -- 172.21.15.32:0/2571315366 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40052f0 con 0x7faabc147f90 2024-01-19T04:17:35.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc150ef0 con 0x7faabc147f90 2024-01-19T04:17:35.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc148610 con 0x7faabc147f90 2024-01-19T04:17:35.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc0749f0 con 0x7faabc147f90 2024-01-19T04:17:35.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faab2a00640 1 -- 172.21.15.32:0/2571315366 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faab4005450 con 0x7faabc147f90 2024-01-19T04:17:35.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faab2a00640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa94066500 0x7faa940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:35.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faab2a00640 1 -- 172.21.15.32:0/2571315366 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7faab4083ab0 con 0x7faabc147f90 2024-01-19T04:17:35.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.816+0000 7faabaa00640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa94066500 0x7faa940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:35.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.820+0000 7faabaa00640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa94066500 0x7faa940689c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faaac0af000 tx=0x7faaac0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:35.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:35.820+0000 7faab2a00640 1 -- 172.21.15.32:0/2571315366 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faab4050e30 con 0x7faabc147f90 2024-01-19T04:17:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faabc0c21d0 con 0x7faabc147f90 2024-01-19T04:17:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faab2a00640 1 -- 172.21.15.32:0/2571315366 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4939 (secure 0 0 0) 0x7faab4054450 con 0x7faabc147f90 2024-01-19T04:17:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:36.027 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3551699011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3551699011},{"type":"v1","addr":"172.21.15.67:6837","nonce":3551699011}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:04.095102+0000","modified":"2024-01-19T04:17:07.109183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/2011239289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2011239289},{"type":"v1","addr":"172.21.15.32:6835","nonce":2011239289}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-19T04:17:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 38 2024-01-19T04:17:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa94066500 msgr2=0x7faa940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa94066500 0x7faa940689c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faaac0af000 tx=0x7faaac0b6040 comp rx=0 tx=0).stop 2024-01-19T04:17:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 msgr2=0x7faabc1509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc1509b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7faab400c6c0 tx=0x7faab400cb80 comp rx=0 tx=0).stop 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 shutdown_connections 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa94066500 0x7faa940689c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faabc147f90 0x7faabc1509b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faabc0c55e0 0x7faabc150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 --2- 172.21.15.32:0/2571315366 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faabc06beb0 0x7faabc14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 >> 172.21.15.32:0/2571315366 conn(0x7faabc0c5b20 msgr2=0x7faabc0beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 shutdown_connections 2024-01-19T04:17:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.024+0000 7faac1800640 1 -- 172.21.15.32:0/2571315366 wait complete. 2024-01-19T04:17:36.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:36.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6aa000640 1 Processor -- start 2024-01-19T04:17:36.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6aa000640 1 -- start start 2024-01-19T04:17:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6aa000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb6a40c2be0 0x7fb6a406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6aa000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb6a4072ad0 0x7fb6a4151490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6aa000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a41585c0 con 0x7fb6a406a6a0 2024-01-19T04:17:36.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6aa000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a41547f0 con 0x7fb6a40c2be0 2024-01-19T04:17:36.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6aa000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a40c16b0 con 0x7fb6a4072ad0 2024-01-19T04:17:36.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb6a40c2be0 0x7fb6a406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a3400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb6a406a6a0 0x7fb6a40c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55444/0 (socket says 172.21.15.32:55444) 2024-01-19T04:17:36.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a3400640 1 -- 172.21.15.32:0/3793295484 learned_addr learned my addr 172.21.15.32:0/3793295484 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:36.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a3e00640 1 --2- 172.21.15.32:0/3793295484 >> v2:172.21.15.67:3300/0 conn(0x7fb6a4072ad0 0x7fb6a4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a2a00640 1 -- 172.21.15.32:0/3793295484 >> v2:172.21.15.67:3300/0 conn(0x7fb6a4072ad0 msgr2=0x7fb6a4151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:36.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a2a00640 1 --2- 172.21.15.32:0/3793295484 >> v2:172.21.15.67:3300/0 conn(0x7fb6a4072ad0 0x7fb6a4151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a2a00640 1 -- 172.21.15.32:0/3793295484 >> v1:172.21.15.32:6789/0 conn(0x7fb6a406a6a0 legacy=0x7fb6a40c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a2000640 1 -- 172.21.15.32:0/3793295484 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726384976 0 0) 0x7fb6a41585c0 con 0x7fb6a406a6a0 2024-01-19T04:17:36.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a2a00640 1 -- 172.21.15.32:0/3793295484 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a41549e0 con 0x7fb6a40c2be0 2024-01-19T04:17:36.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.188+0000 7fb6a3e00640 1 --2- 172.21.15.32:0/3793295484 >> v2:172.21.15.67:3300/0 conn(0x7fb6a4072ad0 0x7fb6a4151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:36.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6a2a00640 1 --2- 172.21.15.32:0/3793295484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a40c2be0 0x7fb6a406aa80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40a62c0 tx=0x7fb68c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8778cf1ffb264f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6a2000640 1 -- 172.21.15.32:0/3793295484 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c004230 con 0x7fb6a40c2be0 2024-01-19T04:17:36.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6a2000640 1 -- 172.21.15.32:0/3793295484 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0a7050 con 0x7fb6a40c2be0 2024-01-19T04:17:36.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6a2000640 1 -- 172.21.15.32:0/3793295484 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c003620 con 0x7fb6a40c2be0 2024-01-19T04:17:36.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 -- 172.21.15.32:0/3793295484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a40c2be0 msgr2=0x7fb6a406aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 --2- 172.21.15.32:0/3793295484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a40c2be0 0x7fb6a406aa80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40a62c0 tx=0x7fb68c01c460 comp rx=0 tx=0).stop 2024-01-19T04:17:36.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 -- 172.21.15.32:0/3793295484 shutdown_connections 2024-01-19T04:17:36.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 --2- 172.21.15.32:0/3793295484 >> v2:172.21.15.67:3300/0 conn(0x7fb6a4072ad0 0x7fb6a4151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 --2- 172.21.15.32:0/3793295484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a40c2be0 0x7fb6a406aa80 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 -- 172.21.15.32:0/3793295484 >> 172.21.15.32:0/3793295484 conn(0x7fb6a40c6ca0 msgr2=0x7fb6a40c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:36.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 -- 172.21.15.32:0/3793295484 shutdown_connections 2024-01-19T04:17:36.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.192+0000 7fb6aa000640 1 -- 172.21.15.32:0/3793295484 wait complete. 2024-01-19T04:17:36.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 Processor -- start 2024-01-19T04:17:36.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 -- start start 2024-01-19T04:17:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a406a6a0 0x7fb6a406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a4072ad0 0x7fb6a41f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6a4156570 0x7fb6a414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a406e7c0 con 0x7fb6a4072ad0 2024-01-19T04:17:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a41574f0 con 0x7fb6a406a6a0 2024-01-19T04:17:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a406ea80 con 0x7fb6a4156570 2024-01-19T04:17:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a4072ad0 0x7fb6a41f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a4072ad0 0x7fb6a41f1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57106/0 (socket says 172.21.15.32:57106) 2024-01-19T04:17:36.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 -- 172.21.15.32:0/122677074 learned_addr learned my addr 172.21.15.32:0/122677074 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:36.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a3e00640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6a4156570 0x7fb6a414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a3400640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a406a6a0 0x7fb6a406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 -- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6a4156570 msgr2=0x7fb6a414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6a4156570 0x7fb6a414bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 -- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a406a6a0 msgr2=0x7fb6a406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a406a6a0 0x7fb6a406cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 -- 172.21.15.32:0/122677074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009420 con 0x7fb6a4072ad0 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6a2a00640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a4072ad0 0x7fb6a41f1090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ae040 tx=0x7fb68c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb69b400640 1 -- 172.21.15.32:0/122677074 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c003c70 con 0x7fb6a4072ad0 2024-01-19T04:17:36.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb69b400640 1 -- 172.21.15.32:0/122677074 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c003dd0 con 0x7fb6a4072ad0 2024-01-19T04:17:36.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb69b400640 1 -- 172.21.15.32:0/122677074 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0ab680 con 0x7fb6a4072ad0 2024-01-19T04:17:36.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a406ef10 con 0x7fb6a4072ad0 2024-01-19T04:17:36.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.196+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a41f1bc0 con 0x7fb6a4072ad0 2024-01-19T04:17:36.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.200+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a40749f0 con 0x7fb6a4072ad0 2024-01-19T04:17:36.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.200+0000 7fb69b400640 1 -- 172.21.15.32:0/122677074 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb68c0b2040 con 0x7fb6a4072ad0 2024-01-19T04:17:36.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.200+0000 7fb69b400640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb67c066530 0x7fb67c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.200+0000 7fb69b400640 1 -- 172.21.15.32:0/122677074 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb68c11dcc0 con 0x7fb6a4072ad0 2024-01-19T04:17:36.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.200+0000 7fb6a3400640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb67c066530 0x7fb67c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.200+0000 7fb6a3400640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb67c066530 0x7fb67c0689f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb694007fd0 tx=0x7fb694007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.204+0000 7fb69b400640 1 -- 172.21.15.32:0/122677074 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb68c0eb160 con 0x7fb6a4072ad0 2024-01-19T04:17:36.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.364+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6a406ebc0 con 0x7fb6a4072ad0 2024-01-19T04:17:36.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.364+0000 7fb69b400640 1 -- 172.21.15.32:0/122677074 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16604 (secure 0 0 0) 0x7fb68c0ee780 con 0x7fb6a4072ad0 2024-01-19T04:17:36.368 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:36.368 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":60,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:33.157100+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:17:02.181700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:17:03.077640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/246892917":"2024-01-20T04:17:30.151066+0000","172.21.15.67:6835/246892917":"2024-01-20T04:17:30.151066+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb67c066530 msgr2=0x7fb67c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb67c066530 0x7fb67c0689f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb694007fd0 tx=0x7fb694007d60 comp rx=0 tx=0).stop 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a4072ad0 msgr2=0x7fb6a41f1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a4072ad0 0x7fb6a41f1090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ae040 tx=0x7fb68c019200 comp rx=0 tx=0).stop 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 shutdown_connections 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb67c066530 0x7fb67c0689f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb6a4156570 0x7fb6a414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6a4072ad0 0x7fb6a41f1090 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 --2- 172.21.15.32:0/122677074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a406a6a0 0x7fb6a406cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 >> 172.21.15.32:0/122677074 conn(0x7fb6a40c6ca0 msgr2=0x7fb6a40c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:36.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 shutdown_connections 2024-01-19T04:17:36.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.368+0000 7fb6aa000640 1 -- 172.21.15.32:0/122677074 wait complete. 2024-01-19T04:17:36.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-19T04:17:36.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.528+0000 7f697c400640 1 Processor -- start 2024-01-19T04:17:36.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.528+0000 7f697c400640 1 -- start start 2024-01-19T04:17:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.528+0000 7f697c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69740a4ec0 0x7f697415df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.528+0000 7f697c400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6974071e80 con 0x7f69740c04a0 2024-01-19T04:17:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f697c400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740726c0 con 0x7f697414fb50 2024-01-19T04:17:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f697c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69741535c0 con 0x7f69740a4ec0 2024-01-19T04:17:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f6979000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f69740c04a0 0x7f69740c1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55454/0 (socket says 172.21.15.32:55454) 2024-01-19T04:17:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f6979000640 1 -- 172.21.15.32:0/2239928438 learned_addr learned my addr 172.21.15.32:0/2239928438 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f697a400640 1 --2- 172.21.15.32:0/2239928438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69740a4ec0 0x7f697415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f6973e00640 1 -- 172.21.15.32:0/2239928438 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865750074 0 0) 0x7f6974071e80 con 0x7f69740c04a0 2024-01-19T04:17:36.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f6973e00640 1 -- 172.21.15.32:0/2239928438 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6954003530 con 0x7f69740c04a0 2024-01-19T04:17:36.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f6973e00640 1 -- 172.21.15.32:0/2239928438 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249279971 0 0) 0x7f69740726c0 con 0x7f697414fb50 2024-01-19T04:17:36.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f6973e00640 1 -- 172.21.15.32:0/2239928438 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6974071e80 con 0x7f697414fb50 2024-01-19T04:17:36.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f697a400640 1 -- 172.21.15.32:0/2239928438 >> v1:172.21.15.67:6789/0 conn(0x7f697414fb50 legacy=0x7f697406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f697a400640 1 -- 172.21.15.32:0/2239928438 >> v1:172.21.15.32:6789/0 conn(0x7f69740c04a0 legacy=0x7f69740c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f697a400640 1 -- 172.21.15.32:0/2239928438 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740c0a20 con 0x7f69740a4ec0 2024-01-19T04:17:36.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.532+0000 7f697a400640 1 --2- 172.21.15.32:0/2239928438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69740a4ec0 0x7f697415df10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f696c009dc0 tx=0x7f696c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb44f5d6cbbf96f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f6973e00640 1 -- 172.21.15.32:0/2239928438 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0a58b0 con 0x7f69740a4ec0 2024-01-19T04:17:36.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f6973e00640 1 -- 172.21.15.32:0/2239928438 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c0a5a10 con 0x7f69740a4ec0 2024-01-19T04:17:36.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f6973e00640 1 -- 172.21.15.32:0/2239928438 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0a5da0 con 0x7f69740a4ec0 2024-01-19T04:17:36.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- 172.21.15.32:0/2239928438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69740a4ec0 msgr2=0x7f697415df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 --2- 172.21.15.32:0/2239928438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69740a4ec0 0x7f697415df10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f696c009dc0 tx=0x7f696c01c8e0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- 172.21.15.32:0/2239928438 shutdown_connections 2024-01-19T04:17:36.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 --2- 172.21.15.32:0/2239928438 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f69740a4ec0 0x7f697415df10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- 172.21.15.32:0/2239928438 >> 172.21.15.32:0/2239928438 conn(0x7f69740c5b20 msgr2=0x7f69740c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:36.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- 172.21.15.32:0/2239928438 shutdown_connections 2024-01-19T04:17:36.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- 172.21.15.32:0/2239928438 wait complete. 2024-01-19T04:17:36.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 Processor -- start 2024-01-19T04:17:36.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- start start 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69740a4ec0 0x7f69741f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69740c04a0 0x7f697414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697414fb50 0x7f697414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741453e0 con 0x7f69740c04a0 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697414a5b0 con 0x7f69740a4ec0 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.536+0000 7f697c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697414a890 con 0x7f697414fb50 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69740c04a0 0x7f697414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69740c04a0 0x7f697414ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57116/0 (socket says 172.21.15.32:57116) 2024-01-19T04:17:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 -- 172.21.15.32:0/3339714131 learned_addr learned my addr 172.21.15.32:0/3339714131 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f697a400640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697414fb50 0x7f697414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979a00640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69740a4ec0 0x7f69741f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 -- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697414fb50 msgr2=0x7f697414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697414fb50 0x7f697414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 -- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69740a4ec0 msgr2=0x7f69741f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69740a4ec0 0x7f69741f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 -- 172.21.15.32:0/3339714131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009a70 con 0x7f69740c04a0 2024-01-19T04:17:36.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979a00640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69740a4ec0 0x7f69741f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:36.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6979000640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69740c04a0 0x7f697414ec80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c4d0 tx=0x7f695c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6971600640 1 -- 172.21.15.32:0/3339714131 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c005cf0 con 0x7f69740c04a0 2024-01-19T04:17:36.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6971600640 1 -- 172.21.15.32:0/3339714131 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c005e50 con 0x7f69740c04a0 2024-01-19T04:17:36.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6971600640 1 -- 172.21.15.32:0/3339714131 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0072b0 con 0x7f69740c04a0 2024-01-19T04:17:36.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697414ab70 con 0x7f69740c04a0 2024-01-19T04:17:36.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697414b130 con 0x7f69740c04a0 2024-01-19T04:17:36.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974148be0 con 0x7f69740c04a0 2024-01-19T04:17:36.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.540+0000 7f6971600640 1 -- 172.21.15.32:0/3339714131 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f695c007410 con 0x7f69740c04a0 2024-01-19T04:17:36.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.544+0000 7f6971600640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f694c066500 0x7f694c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.544+0000 7f6971600640 1 -- 172.21.15.32:0/3339714131 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f695c083390 con 0x7f69740c04a0 2024-01-19T04:17:36.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.544+0000 7f6979a00640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f694c066500 0x7f694c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.544+0000 7f6979a00640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f694c066500 0x7f694c0689c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f69640011f0 tx=0x7f6964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.548+0000 7f6971600640 1 -- 172.21.15.32:0/3339714131 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f695c050710 con 0x7f69740c04a0 2024-01-19T04:17:36.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.744+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f69740749f0 con 0x7f69740c04a0 2024-01-19T04:17:36.747 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-01-19T04:17:36.744+0000 7f2af4c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T04:17:36.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.744+0000 7f6971600640 1 -- 172.21.15.32:0/3339714131 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 163+0+0 (secure 0 0 0) 0x7f695c053d30 con 0x7f69740c04a0 2024-01-19T04:17:36.749 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f694c066500 msgr2=0x7f694c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f694c066500 0x7f694c0689c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f69640011f0 tx=0x7f6964009040 comp rx=0 tx=0).stop 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69740c04a0 msgr2=0x7f697414ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69740c04a0 0x7f697414ec80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c4d0 tx=0x7f695c00c990 comp rx=0 tx=0).stop 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 shutdown_connections 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f694c066500 0x7f694c0689c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f697414fb50 0x7f697414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69740c04a0 0x7f697414ec80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 --2- 172.21.15.32:0/3339714131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69740a4ec0 0x7f69741f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 >> 172.21.15.32:0/3339714131 conn(0x7f69740c5b20 msgr2=0x7f697406fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 shutdown_connections 2024-01-19T04:17:36.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.748+0000 7f697c400640 1 -- 172.21.15.32:0/3339714131 wait complete. 2024-01-19T04:17:36.758 INFO:tasks.ceph.mds.c.smithi032.stderr: -2213> 2024-01-19T04:17:07.521+0000 7f3801600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:17:36.775 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-19T04:17:36.804 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-01-19T04:17:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe60a400640 1 Processor -- start 2024-01-19T04:17:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe60a400640 1 -- start start 2024-01-19T04:17:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe60a400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6040c2080 0x7fe604155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe60a400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe6040c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe60a400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6040a4ea0 con 0x7fe6040723b0 2024-01-19T04:17:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe60a400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6041524a0 con 0x7fe6040c2080 2024-01-19T04:17:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe60a400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe604152a20 con 0x7fe60406d440 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe603e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe6040c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe602a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6040c2080 0x7fe604155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe603e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe6040c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:34498/0 (socket says 172.21.15.32:34498) 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.916+0000 7fe603e00640 1 -- 172.21.15.32:0/2833034657 learned_addr learned my addr 172.21.15.32:0/2833034657 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe603e00640 1 -- 172.21.15.32:0/2833034657 >> v2:172.21.15.67:3300/0 conn(0x7fe6040c2080 msgr2=0x7fe604155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe603e00640 1 --2- 172.21.15.32:0/2833034657 >> v2:172.21.15.67:3300/0 conn(0x7fe6040c2080 0x7fe604155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe603e00640 1 -- 172.21.15.32:0/2833034657 >> v1:172.21.15.67:6789/0 conn(0x7fe6040723b0 legacy=0x7fe604152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe603e00640 1 -- 172.21.15.32:0/2833034657 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6040c3430 con 0x7fe60406d440 2024-01-19T04:17:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe602a00640 1 --2- 172.21.15.32:0/2833034657 >> v2:172.21.15.67:3300/0 conn(0x7fe6040c2080 0x7fe604155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:36.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe603e00640 1 --2- 172.21.15.32:0/2833034657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe6040c4e50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009e50 tx=0x7fe5fc01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2705c102396e7be7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe602000640 1 -- 172.21.15.32:0/2833034657 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0a5690 con 0x7fe60406d440 2024-01-19T04:17:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe602000640 1 -- 172.21.15.32:0/2833034657 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc0a57f0 con 0x7fe60406d440 2024-01-19T04:17:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe602000640 1 -- 172.21.15.32:0/2833034657 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0a5b80 con 0x7fe60406d440 2024-01-19T04:17:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe60a400640 1 -- 172.21.15.32:0/2833034657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 msgr2=0x7fe6040c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.920+0000 7fe60a400640 1 --2- 172.21.15.32:0/2833034657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe6040c4e50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009e50 tx=0x7fe5fc01c8c0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- 172.21.15.32:0/2833034657 shutdown_connections 2024-01-19T04:17:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 --2- 172.21.15.32:0/2833034657 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe6040c4e50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 --2- 172.21.15.32:0/2833034657 >> v2:172.21.15.67:3300/0 conn(0x7fe6040c2080 0x7fe604155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- 172.21.15.32:0/2833034657 >> 172.21.15.32:0/2833034657 conn(0x7fe6040c25a0 msgr2=0x7fe6040c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- 172.21.15.32:0/2833034657 shutdown_connections 2024-01-19T04:17:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- 172.21.15.32:0/2833034657 wait complete. 2024-01-19T04:17:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 Processor -- start 2024-01-19T04:17:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- start start 2024-01-19T04:17:36.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe604144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6040723b0 0x7fe6041f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6040c2080 0x7fe6041f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6041f0ed0 con 0x7fe6040723b0 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040716e0 con 0x7fe6040c2080 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe60a400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe604151d30 con 0x7fe60406d440 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6040723b0 0x7fe6041f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6040723b0 0x7fe6041f0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57134/0 (socket says 172.21.15.32:57134) 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 -- 172.21.15.32:0/3179396576 learned_addr learned my addr 172.21.15.32:0/3179396576 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe603e00640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6040c2080 0x7fe6041f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe603400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe604144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 -- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 msgr2=0x7fe604144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe604144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 -- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6040c2080 msgr2=0x7fe6041f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6040c2080 0x7fe6041f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.924+0000 7fe602a00640 1 -- 172.21.15.32:0/3179396576 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec009420 con 0x7fe6040723b0 2024-01-19T04:17:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe602a00640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6040723b0 0x7fe6041f0450 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e960 tx=0x7fe5ec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe5fb400640 1 -- 172.21.15.32:0/3179396576 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00ca00 con 0x7fe6040723b0 2024-01-19T04:17:36.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc009b30 con 0x7fe6040723b0 2024-01-19T04:17:36.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe5fb400640 1 -- 172.21.15.32:0/3179396576 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec00cb60 con 0x7fe6040723b0 2024-01-19T04:17:36.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe5fb400640 1 -- 172.21.15.32:0/3179396576 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec013470 con 0x7fe6040723b0 2024-01-19T04:17:36.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe604071d40 con 0x7fe6040723b0 2024-01-19T04:17:36.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe604151b00 con 0x7fe6040723b0 2024-01-19T04:17:36.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe5fb400640 1 -- 172.21.15.32:0/3179396576 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe5ec0135d0 con 0x7fe6040723b0 2024-01-19T04:17:36.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.928+0000 7fe5fb400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5dc066530 0x7fe5dc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:36.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.932+0000 7fe5fb400640 1 -- 172.21.15.32:0/3179396576 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fe5ec084770 con 0x7fe6040723b0 2024-01-19T04:17:36.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.932+0000 7fe603400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5dc066530 0x7fe5dc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:36.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.932+0000 7fe603400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5dc066530 0x7fe5dc0689f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4001770 tx=0x7fe5f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:36.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:36.932+0000 7fe5fb400640 1 -- 172.21.15.32:0/3179396576 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe5ec051a00 con 0x7fe6040723b0 2024-01-19T04:17:37.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.124+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe604071f60 con 0x7fe6040723b0 2024-01-19T04:17:37.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.748+0000 7fe5fb400640 1 -- 172.21.15.32:0/3179396576 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe5ec055020 con 0x7fe6040723b0 2024-01-19T04:17:37.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5dc066530 msgr2=0x7fe5dc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:37.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5dc066530 0x7fe5dc0689f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4001770 tx=0x7fe5f4009040 comp rx=0 tx=0).stop 2024-01-19T04:17:37.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6040723b0 msgr2=0x7fe6041f0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:37.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6040723b0 0x7fe6041f0450 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e960 tx=0x7fe5ec00ee20 comp rx=0 tx=0).stop 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 shutdown_connections 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe5dc066530 0x7fe5dc0689f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6040c2080 0x7fe6041f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6040723b0 0x7fe6041f0450 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 --2- 172.21.15.32:0/3179396576 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe60406d440 0x7fe604144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 >> 172.21.15.32:0/3179396576 conn(0x7fe6040c25a0 msgr2=0x7fe6040beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 shutdown_connections 2024-01-19T04:17:37.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.752+0000 7fe60a400640 1 -- 172.21.15.32:0/3179396576 wait complete. 2024-01-19T04:17:37.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-19T04:17:37.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766fc00640 1 Processor -- start 2024-01-19T04:17:37.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766fc00640 1 -- start start 2024-01-19T04:17:37.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766fc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f766806bce0 0x7f76680bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:37.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766fc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f76680bfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:37.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766fc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7668155200 con 0x7f76680666a0 2024-01-19T04:17:37.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766fc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680c23b0 con 0x7f766806bce0 2024-01-19T04:17:37.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766fc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680c0320 con 0x7f76680c1b40 2024-01-19T04:17:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766d200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f766806bce0 0x7f76680bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.964+0000 7f766dc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f76680666a0 0x7f766806a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51132/0 (socket says 172.21.15.32:51132) 2024-01-19T04:17:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f766dc00640 1 -- 172.21.15.32:0/1491635159 learned_addr learned my addr 172.21.15.32:0/1491635159 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f7667e00640 1 --2- 172.21.15.32:0/1491635159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f76680bfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f766d200640 1 -- 172.21.15.32:0/1491635159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 msgr2=0x7f76680bfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f766d200640 1 --2- 172.21.15.32:0/1491635159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f76680bfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f766d200640 1 -- 172.21.15.32:0/1491635159 >> v1:172.21.15.32:6789/0 conn(0x7f76680666a0 legacy=0x7f766806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:37.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f766d200640 1 -- 172.21.15.32:0/1491635159 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76681548d0 con 0x7f766806bce0 2024-01-19T04:17:37.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f7667400640 1 -- 172.21.15.32:0/1491635159 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155571597 0 0) 0x7f7668155200 con 0x7f76680666a0 2024-01-19T04:17:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f766d200640 1 --2- 172.21.15.32:0/1491635159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f76680bf8a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f76580097c0 tx=0x7f765801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc337a3cbe81412 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f7667400640 1 -- 172.21.15.32:0/1491635159 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76580ab650 con 0x7f766806bce0 2024-01-19T04:17:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f7667400640 1 -- 172.21.15.32:0/1491635159 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76580ab7b0 con 0x7f766806bce0 2024-01-19T04:17:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.968+0000 7f7667400640 1 -- 172.21.15.32:0/1491635159 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76580abb40 con 0x7f766806bce0 2024-01-19T04:17:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- 172.21.15.32:0/1491635159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 msgr2=0x7f76680bf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 --2- 172.21.15.32:0/1491635159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f76680bf8a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f76580097c0 tx=0x7f765801c450 comp rx=0 tx=0).stop 2024-01-19T04:17:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- 172.21.15.32:0/1491635159 shutdown_connections 2024-01-19T04:17:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 --2- 172.21.15.32:0/1491635159 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f76680bfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 --2- 172.21.15.32:0/1491635159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f76680bf8a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- 172.21.15.32:0/1491635159 >> 172.21.15.32:0/1491635159 conn(0x7f76680c2f70 msgr2=0x7f76680c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- 172.21.15.32:0/1491635159 shutdown_connections 2024-01-19T04:17:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- 172.21.15.32:0/1491635159 wait complete. 2024-01-19T04:17:37.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 Processor -- start 2024-01-19T04:17:37.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- start start 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76680666a0 0x7f76681f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f7668071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f766814a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76681f10e0 con 0x7f766806bce0 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766815a9a0 con 0x7f76680666a0 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766fc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766814b060 con 0x7f76680c1b40 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f7667e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f7668071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f7667e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f7668071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37926/0 (socket says 172.21.15.32:37926) 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f7667e00640 1 -- 172.21.15.32:0/864198906 learned_addr learned my addr 172.21.15.32:0/864198906 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766dc00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f766814a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:37.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.972+0000 7f766d200640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76680666a0 0x7f76681f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:37.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7667e00640 1 -- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 msgr2=0x7f766814a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:37.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7667e00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f766814a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7667e00640 1 -- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76680666a0 msgr2=0x7f76681f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:37.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7667e00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76680666a0 0x7f76681f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:37.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7667e00640 1 -- 172.21.15.32:0/864198906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658009420 con 0x7f766806bce0 2024-01-19T04:17:37.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7667e00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f7668071750 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f765000e870 tx=0x7f765000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:37.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7664c00640 1 -- 172.21.15.32:0/864198906 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650009510 con 0x7f766806bce0 2024-01-19T04:17:37.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7664c00640 1 -- 172.21.15.32:0/864198906 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000eec0 con 0x7f766806bce0 2024-01-19T04:17:37.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7664c00640 1 -- 172.21.15.32:0/864198906 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000cb40 con 0x7f766806bce0 2024-01-19T04:17:37.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76680aba50 con 0x7f766806bce0 2024-01-19T04:17:37.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766815a630 con 0x7f766806bce0 2024-01-19T04:17:37.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766804e980 con 0x7f766806bce0 2024-01-19T04:17:37.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7664c00640 1 -- 172.21.15.32:0/864198906 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f765000cca0 con 0x7f766806bce0 2024-01-19T04:17:37.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7664c00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7640066530 0x7f76400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:37.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f7664c00640 1 -- 172.21.15.32:0/864198906 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f7650083ff0 con 0x7f766806bce0 2024-01-19T04:17:37.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.976+0000 7f766d200640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7640066530 0x7f76400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:37.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.980+0000 7f766d200640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7640066530 0x7f76400689f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f76580af000 tx=0x7f76580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:37.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:37.980+0000 7f7664c00640 1 -- 172.21.15.32:0/864198906 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f76500b54d0 con 0x7f766806bce0 2024-01-19T04:17:38.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.140+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f766806e900 con 0x7f766806bce0 2024-01-19T04:17:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.752+0000 7f7664c00640 1 -- 172.21.15.32:0/864198906 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v62) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7650051220 con 0x7f766806bce0 2024-01-19T04:17:38.757 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_metadata' removed 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7640066530 msgr2=0x7f76400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7640066530 0x7f76400689f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f76580af000 tx=0x7f76580a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 msgr2=0x7f7668071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f7668071750 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f765000e870 tx=0x7f765000ec70 comp rx=0 tx=0).stop 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 shutdown_connections 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7640066530 0x7f76400689f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f76680c1b40 0x7f766814a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f766806bce0 0x7f7668071750 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 --2- 172.21.15.32:0/864198906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76680666a0 0x7f76681f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 >> 172.21.15.32:0/864198906 conn(0x7f76680c2f70 msgr2=0x7f76680c0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:38.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 shutdown_connections 2024-01-19T04:17:38.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.756+0000 7f766fc00640 1 -- 172.21.15.32:0/864198906 wait complete. 2024-01-19T04:17:38.786 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-19T04:17:38.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f618ba00640 1 Processor -- start 2024-01-19T04:17:38.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f618ba00640 1 -- start start 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f618ba00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f61840c20d0 0x7f618406c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f618ba00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61840a4d10 0x7f618406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f618ba00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6184153140 con 0x7f618414f9a0 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f618ba00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6184152530 con 0x7f61840c20d0 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f618ba00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6184152810 con 0x7f61840a4d10 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6183e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f61840c20d0 0x7f618406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6183e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f61840c20d0 0x7f618406c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37928/0 (socket says 172.21.15.32:37928) 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6183e00640 1 -- 172.21.15.32:0/3086748588 learned_addr learned my addr 172.21.15.32:0/3086748588 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:38.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6189a00640 1 --2- 172.21.15.32:0/3086748588 >> v2:172.21.15.67:3300/0 conn(0x7f61840a4d10 0x7f618406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:38.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6183e00640 1 -- 172.21.15.32:0/3086748588 >> v2:172.21.15.67:3300/0 conn(0x7f61840a4d10 msgr2=0x7f618406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:38.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6183e00640 1 --2- 172.21.15.32:0/3086748588 >> v2:172.21.15.67:3300/0 conn(0x7f61840a4d10 0x7f618406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6183e00640 1 -- 172.21.15.32:0/3086748588 >> v1:172.21.15.67:6789/0 conn(0x7f618414f9a0 legacy=0x7f61840720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:38.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.932+0000 7f6183e00640 1 -- 172.21.15.32:0/3086748588 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184152af0 con 0x7f61840c20d0 2024-01-19T04:17:38.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.936+0000 7f6183e00640 1 --2- 172.21.15.32:0/3086748588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61840c20d0 0x7f618406c220 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f61840c0a70 tx=0x7f616c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1029340dc45113 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:38.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.936+0000 7f6183400640 1 -- 172.21.15.32:0/3086748588 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c0ad680 con 0x7f61840c20d0 2024-01-19T04:17:38.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.936+0000 7f6183400640 1 -- 172.21.15.32:0/3086748588 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c0ad7e0 con 0x7f61840c20d0 2024-01-19T04:17:38.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.936+0000 7f6183400640 1 -- 172.21.15.32:0/3086748588 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c0adb70 con 0x7f61840c20d0 2024-01-19T04:17:38.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.936+0000 7f618ba00640 1 -- 172.21.15.32:0/3086748588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61840c20d0 msgr2=0x7f618406c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:38.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.936+0000 7f618ba00640 1 --2- 172.21.15.32:0/3086748588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61840c20d0 0x7f618406c220 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f61840c0a70 tx=0x7f616c01c470 comp rx=0 tx=0).stop 2024-01-19T04:17:38.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- 172.21.15.32:0/3086748588 shutdown_connections 2024-01-19T04:17:38.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 --2- 172.21.15.32:0/3086748588 >> v2:172.21.15.67:3300/0 conn(0x7f61840a4d10 0x7f618406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 --2- 172.21.15.32:0/3086748588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61840c20d0 0x7f618406c220 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- 172.21.15.32:0/3086748588 >> 172.21.15.32:0/3086748588 conn(0x7f61840c5b40 msgr2=0x7f61840c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:38.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- 172.21.15.32:0/3086748588 shutdown_connections 2024-01-19T04:17:38.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- 172.21.15.32:0/3086748588 wait complete. 2024-01-19T04:17:38.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 Processor -- start 2024-01-19T04:17:38.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- start start 2024-01-19T04:17:38.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61840a4d10 0x7f61841ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:38.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61840c20d0 0x7f618415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:38.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f618414f9a0 0x7f61841f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:38.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61840c0260 con 0x7f618414f9a0 2024-01-19T04:17:38.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841f1200 con 0x7f61840c20d0 2024-01-19T04:17:38.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f618ba00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61840ab820 con 0x7f61840a4d10 2024-01-19T04:17:38.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f618414f9a0 0x7f61841f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f618414f9a0 0x7f61841f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37940/0 (socket says 172.21.15.32:37940) 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 -- 172.21.15.32:0/223312334 learned_addr learned my addr 172.21.15.32:0/223312334 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6183e00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61840c20d0 0x7f618415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189000640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61840a4d10 0x7f61841ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 -- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61840a4d10 msgr2=0x7f61841ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61840a4d10 0x7f61841ed7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 -- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61840c20d0 msgr2=0x7f618415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61840c20d0 0x7f618415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 -- 172.21.15.32:0/223312334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0094d0 con 0x7f618414f9a0 2024-01-19T04:17:38.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.940+0000 7f6189a00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f618414f9a0 0x7f61841f1690 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f617c007e40 tx=0x7f617c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:38.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f6180c00640 1 -- 172.21.15.32:0/223312334 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c014620 con 0x7f618414f9a0 2024-01-19T04:17:38.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f6180c00640 1 -- 172.21.15.32:0/223312334 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c00ee90 con 0x7f618414f9a0 2024-01-19T04:17:38.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f6180c00640 1 -- 172.21.15.32:0/223312334 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0149e0 con 0x7f618414f9a0 2024-01-19T04:17:38.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61841edd30 con 0x7f618414f9a0 2024-01-19T04:17:38.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61841f0e90 con 0x7f618414f9a0 2024-01-19T04:17:38.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61841f1390 con 0x7f618414f9a0 2024-01-19T04:17:38.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f6180c00640 1 -- 172.21.15.32:0/223312334 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f617c014b40 con 0x7f618414f9a0 2024-01-19T04:17:38.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f6180c00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f615c066500 0x7f615c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:38.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f6180c00640 1 -- 172.21.15.32:0/223312334 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f617c0845b0 con 0x7f618414f9a0 2024-01-19T04:17:38.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.944+0000 7f6189000640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f615c066500 0x7f615c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:38.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.948+0000 7f6189000640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f615c066500 0x7f615c0689c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6174001770 tx=0x7f6174009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:38.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:38.948+0000 7f6180c00640 1 -- 172.21.15.32:0/223312334 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f617c0519f0 con 0x7f618414f9a0 2024-01-19T04:17:39.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.108+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f618404e980 con 0x7f618414f9a0 2024-01-19T04:17:39.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.756+0000 7f6180c00640 1 -- 172.21.15.32:0/223312334 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v63) v1 ==== 172+0+0 (secure 0 0 0) 0x7f617c055010 con 0x7f618414f9a0 2024-01-19T04:17:39.759 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_data' removed 2024-01-19T04:17:39.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f615c066500 msgr2=0x7f615c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:39.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f615c066500 0x7f615c0689c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6174001770 tx=0x7f6174009040 comp rx=0 tx=0).stop 2024-01-19T04:17:39.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f618414f9a0 msgr2=0x7f61841f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:39.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f618414f9a0 0x7f61841f1690 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f617c007e40 tx=0x7f617c00e4b0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 shutdown_connections 2024-01-19T04:17:39.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f615c066500 0x7f615c0689c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f618414f9a0 0x7f61841f1690 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61840c20d0 0x7f618415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 --2- 172.21.15.32:0/223312334 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61840a4d10 0x7f61841ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 >> 172.21.15.32:0/223312334 conn(0x7f61840c5b40 msgr2=0x7f618406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:39.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 shutdown_connections 2024-01-19T04:17:39.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.760+0000 7f618ba00640 1 -- 172.21.15.32:0/223312334 wait complete. 2024-01-19T04:17:39.785 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-19T04:17:39.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.924+0000 7f9ae3a00640 1 Processor -- start 2024-01-19T04:17:39.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.924+0000 7f9ae3a00640 1 -- start start 2024-01-19T04:17:39.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.924+0000 7f9ae3a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9adc0c55d0 0x7f9adc06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.924+0000 7f9ae3a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9adc0705b0 0x7f9adc15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.924+0000 7f9ae3a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9adc0c0eb0 con 0x7f9adc06cab0 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae3a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc06e5c0 con 0x7f9adc0705b0 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae3a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc0a5330 con 0x7f9adc0c55d0 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9adc06cab0 0x7f9adc0c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51146/0 (socket says 172.21.15.32:51146) 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1000640 1 -- 172.21.15.32:0/2579258379 learned_addr learned my addr 172.21.15.32:0/2579258379 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1a00640 1 --2- 172.21.15.32:0/2579258379 >> v2:172.21.15.32:3300/0 conn(0x7f9adc0705b0 0x7f9adc15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9adbe00640 1 --2- 172.21.15.32:0/2579258379 >> v2:172.21.15.67:3300/0 conn(0x7f9adc0c55d0 0x7f9adc06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9adb400640 1 -- 172.21.15.32:0/2579258379 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297016376 0 0) 0x7f9adc0c0eb0 con 0x7f9adc06cab0 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1a00640 1 -- 172.21.15.32:0/2579258379 >> v2:172.21.15.67:3300/0 conn(0x7f9adc0c55d0 msgr2=0x7f9adc06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1a00640 1 --2- 172.21.15.32:0/2579258379 >> v2:172.21.15.67:3300/0 conn(0x7f9adc0c55d0 0x7f9adc06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1a00640 1 -- 172.21.15.32:0/2579258379 >> v1:172.21.15.32:6789/0 conn(0x7f9adc06cab0 legacy=0x7f9adc0c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:39.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1a00640 1 -- 172.21.15.32:0/2579258379 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc1516f0 con 0x7f9adc0705b0 2024-01-19T04:17:39.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9ae1a00640 1 --2- 172.21.15.32:0/2579258379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc15b4b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9adc06e470 tx=0x7f9ad401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47d194f301fc5cf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:39.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9adb400640 1 -- 172.21.15.32:0/2579258379 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40a59a0 con 0x7f9adc0705b0 2024-01-19T04:17:39.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9adb400640 1 -- 172.21.15.32:0/2579258379 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad40a5b00 con 0x7f9adc0705b0 2024-01-19T04:17:39.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.928+0000 7f9adb400640 1 -- 172.21.15.32:0/2579258379 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40a5e90 con 0x7f9adc0705b0 2024-01-19T04:17:39.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- 172.21.15.32:0/2579258379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 msgr2=0x7f9adc15b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:39.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/2579258379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc15b4b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9adc06e470 tx=0x7f9ad401c8e0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- 172.21.15.32:0/2579258379 shutdown_connections 2024-01-19T04:17:39.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/2579258379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc15b4b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/2579258379 >> v2:172.21.15.67:3300/0 conn(0x7f9adc0c55d0 0x7f9adc06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- 172.21.15.32:0/2579258379 >> 172.21.15.32:0/2579258379 conn(0x7f9adc0c25a0 msgr2=0x7f9adc0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:39.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- 172.21.15.32:0/2579258379 shutdown_connections 2024-01-19T04:17:39.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- 172.21.15.32:0/2579258379 wait complete. 2024-01-19T04:17:39.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 Processor -- start 2024-01-19T04:17:39.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- start start 2024-01-19T04:17:39.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9adc06cab0 0x7f9adc0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:39.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc1f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:39.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9adc0c55d0 0x7f9adc14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:39.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc1ed310 con 0x7f9adc0705b0 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc1565a0 con 0x7f9adc06cab0 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9ae3a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc1edb30 con 0x7f9adc0c55d0 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9adbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc1f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9adbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc1f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37944/0 (socket says 172.21.15.32:37944) 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.932+0000 7f9adbe00640 1 -- 172.21.15.32:0/1954338143 learned_addr learned my addr 172.21.15.32:0/1954338143 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ae1a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9adc0c55d0 0x7f9adc14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ae1000640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9adc06cab0 0x7f9adc0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9adbe00640 1 -- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9adc0c55d0 msgr2=0x7f9adc14ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9adbe00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9adc0c55d0 0x7f9adc14ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9adbe00640 1 -- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9adc06cab0 msgr2=0x7f9adc0bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9adbe00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9adc06cab0 0x7f9adc0bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9adbe00640 1 -- 172.21.15.32:0/1954338143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4009a70 con 0x7f9adc0705b0 2024-01-19T04:17:39.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ae1a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9adc0c55d0 0x7f9adc14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9adbe00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc1f0900 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400e6e0 tx=0x7f9ac400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ad8c00640 1 -- 172.21.15.32:0/1954338143 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400ca30 con 0x7f9adc0705b0 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ad8c00640 1 -- 172.21.15.32:0/1954338143 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac400cb90 con 0x7f9adc0705b0 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ad8c00640 1 -- 172.21.15.32:0/1954338143 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40113f0 con 0x7f9adc0705b0 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc1ed520 con 0x7f9adc0705b0 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc1ed7c0 con 0x7f9adc0705b0 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc0749f0 con 0x7f9adc0705b0 2024-01-19T04:17:39.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ad8c00640 1 -- 172.21.15.32:0/1954338143 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9ac4011550 con 0x7f9adc0705b0 2024-01-19T04:17:39.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.936+0000 7f9ad8c00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ab4066500 0x7f9ab40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:39.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.940+0000 7f9ad8c00640 1 -- 172.21.15.32:0/1954338143 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9ac4083830 con 0x7f9adc0705b0 2024-01-19T04:17:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.940+0000 7f9ae1000640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ab4066500 0x7f9ab40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:39.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.940+0000 7f9ae1000640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ab4066500 0x7f9ab40689c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9acc000f70 tx=0x7f9acc007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:39.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:39.940+0000 7f9ad8c00640 1 -- 172.21.15.32:0/1954338143 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9ac4050e00 con 0x7f9adc0705b0 2024-01-19T04:17:40.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.104+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9adc06d590 con 0x7f9adc0705b0 2024-01-19T04:17:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.108+0000 7f9ad8c00640 1 -- 172.21.15.32:0/1954338143 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ac40160a0 con 0x7f9adc0705b0 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.108+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ab4066500 msgr2=0x7f9ab40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.108+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ab4066500 0x7f9ab40689c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9acc000f70 tx=0x7f9acc007b60 comp rx=0 tx=0).stop 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.108+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 msgr2=0x7f9adc1f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.108+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc1f0900 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400e6e0 tx=0x7f9ac400eba0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 shutdown_connections 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ab4066500 0x7f9ab40689c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9adc0c55d0 0x7f9adc14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9adc0705b0 0x7f9adc1f0900 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 --2- 172.21.15.32:0/1954338143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9adc06cab0 0x7f9adc0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 >> 172.21.15.32:0/1954338143 conn(0x7f9adc0c25a0 msgr2=0x7f9adc153f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 shutdown_connections 2024-01-19T04:17:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.112+0000 7f9ae3a00640 1 -- 172.21.15.32:0/1954338143 wait complete. 2024-01-19T04:17:40.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2024-01-19T04:17:40.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9d02400640 1 Processor -- start 2024-01-19T04:17:40.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9d02400640 1 -- start start 2024-01-19T04:17:40.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9d02400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9d02400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9cfc0c18b0 0x7f9cfc0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9d02400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0c1d10 con 0x7f9cfc147f90 2024-01-19T04:17:40.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9d02400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06c5c0 con 0x7f9cfc0c18b0 2024-01-19T04:17:40.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9d02400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c0810 con 0x7f9cfc0c55e0 2024-01-19T04:17:40.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfaa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfb400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9cfc147f90 0x7f9cfc06beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:49974/0 (socket says 172.21.15.32:49974) 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfb400640 1 -- 172.21.15.32:0/1591584211 learned_addr learned my addr 172.21.15.32:0/1591584211 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfbe00640 1 --2- 172.21.15.32:0/1591584211 >> v2:172.21.15.67:3300/0 conn(0x7f9cfc0c18b0 0x7f9cfc0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfa000640 1 -- 172.21.15.32:0/1591584211 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705544075 0 0) 0x7f9cfc0c1d10 con 0x7f9cfc147f90 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfa000640 1 -- 172.21.15.32:0/1591584211 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cdc003530 con 0x7f9cfc147f90 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfbe00640 1 -- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 msgr2=0x7f9cfc151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfbe00640 1 --2- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfbe00640 1 -- 172.21.15.32:0/1591584211 >> v1:172.21.15.67:6789/0 conn(0x7f9cfc147f90 legacy=0x7f9cfc06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfbe00640 1 -- 172.21.15.32:0/1591584211 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0c0af0 con 0x7f9cfc0c18b0 2024-01-19T04:17:40.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.272+0000 7f9cfaa00640 1 --2- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:40.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9cfbe00640 1 --2- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 0x7f9cfc0a4d10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009d90 tx=0x7f9cf401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e6a13fa33187c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:40.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9cfa000640 1 -- 172.21.15.32:0/1591584211 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40a5950 con 0x7f9cfc0c18b0 2024-01-19T04:17:40.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9cfa000640 1 -- 172.21.15.32:0/1591584211 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40a5ab0 con 0x7f9cfc0c18b0 2024-01-19T04:17:40.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9cfa000640 1 -- 172.21.15.32:0/1591584211 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40a5e40 con 0x7f9cfc0c18b0 2024-01-19T04:17:40.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 -- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 msgr2=0x7f9cfc0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 --2- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 0x7f9cfc0a4d10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009d90 tx=0x7f9cf401c890 comp rx=0 tx=0).stop 2024-01-19T04:17:40.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 -- 172.21.15.32:0/1591584211 shutdown_connections 2024-01-19T04:17:40.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 --2- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 0x7f9cfc0a4d10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 --2- 172.21.15.32:0/1591584211 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 -- 172.21.15.32:0/1591584211 >> 172.21.15.32:0/1591584211 conn(0x7f9cfc0c5b20 msgr2=0x7f9cfc0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:40.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 -- 172.21.15.32:0/1591584211 shutdown_connections 2024-01-19T04:17:40.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.276+0000 7f9d02400640 1 -- 172.21.15.32:0/1591584211 wait complete. 2024-01-19T04:17:40.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 Processor -- start 2024-01-19T04:17:40.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 -- start start 2024-01-19T04:17:40.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 0x7f9cfc0beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cfc147f90 0x7f9cfc14fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc14f2c0 con 0x7f9cfc147f90 2024-01-19T04:17:40.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc155820 con 0x7f9cfc0c18b0 2024-01-19T04:17:40.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc1ee180 con 0x7f9cfc0c55e0 2024-01-19T04:17:40.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cfc147f90 0x7f9cfc14fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cfc147f90 0x7f9cfc14fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37956/0 (socket says 172.21.15.32:37956) 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 -- 172.21.15.32:0/1299217564 learned_addr learned my addr 172.21.15.32:0/1299217564 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfaa00640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfb400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 0x7f9cfc0beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 -- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 msgr2=0x7f9cfc14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc14f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 -- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 msgr2=0x7f9cfc0beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 0x7f9cfc0beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 -- 172.21.15.32:0/1299217564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009420 con 0x7f9cfc147f90 2024-01-19T04:17:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cfbe00640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cfc147f90 0x7f9cfc14fc90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40b0040 tx=0x7f9cf4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cf3400640 1 -- 172.21.15.32:0/1299217564 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40adce0 con 0x7f9cfc147f90 2024-01-19T04:17:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cf3400640 1 -- 172.21.15.32:0/1299217564 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40ade40 con 0x7f9cfc147f90 2024-01-19T04:17:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9cf3400640 1 -- 172.21.15.32:0/1299217564 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40b9670 con 0x7f9cfc147f90 2024-01-19T04:17:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf4009a70 con 0x7f9cfc147f90 2024-01-19T04:17:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.280+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc1ed280 con 0x7f9cfc147f90 2024-01-19T04:17:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.284+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc14f430 con 0x7f9cfc147f90 2024-01-19T04:17:40.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.284+0000 7f9cf3400640 1 -- 172.21.15.32:0/1299217564 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9cf40b97d0 con 0x7f9cfc147f90 2024-01-19T04:17:40.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.284+0000 7f9cf3400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9cd4066500 0x7f9cd40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.284+0000 7f9cf3400640 1 -- 172.21.15.32:0/1299217564 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9cf411f210 con 0x7f9cfc147f90 2024-01-19T04:17:40.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.284+0000 7f9cfb400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9cd4066500 0x7f9cd40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.284+0000 7f9cfb400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9cd4066500 0x7f9cd40689c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9cec007fd0 tx=0x7f9cec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:40.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.288+0000 7f9cf3400640 1 -- 172.21.15.32:0/1299217564 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9cf40ec7f0 con 0x7f9cfc147f90 2024-01-19T04:17:40.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.504+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f9cfc0749f0 con 0x7f9cfc147f90 2024-01-19T04:17:40.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9cf3400640 1 -- 172.21.15.32:0/1299217564 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v174) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9cf4009450 con 0x7f9cfc147f90 2024-01-19T04:17:40.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9cd4066500 msgr2=0x7f9cd40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9cd4066500 0x7f9cd40689c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9cec007fd0 tx=0x7f9cec009040 comp rx=0 tx=0).stop 2024-01-19T04:17:40.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cfc147f90 msgr2=0x7f9cfc14fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cfc147f90 0x7f9cfc14fc90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40b0040 tx=0x7f9cf4019630 comp rx=0 tx=0).stop 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 shutdown_connections 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9cd4066500 0x7f9cd40689c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cfc147f90 0x7f9cfc14fc90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9cfc0c55e0 0x7f9cfc14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 --2- 172.21.15.32:0/1299217564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cfc0c18b0 0x7f9cfc0beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 >> 172.21.15.32:0/1299217564 conn(0x7f9cfc0c5b20 msgr2=0x7f9cfc06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.764+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 shutdown_connections 2024-01-19T04:17:40.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.768+0000 7f9d02400640 1 -- 172.21.15.32:0/1299217564 wait complete. 2024-01-19T04:17:40.790 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2024-01-19T04:17:40.790 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-19T04:17:40.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:40.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74b0800640 1 Processor -- start 2024-01-19T04:17:40.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74b0800640 1 -- start start 2024-01-19T04:17:40.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74b0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a80c35a0 0x7f74a80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74b0800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74a8072620 0x7f74a8071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74b0800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80c19a0 con 0x7f74a814fc70 2024-01-19T04:17:40.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74b0800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8070f60 con 0x7f74a8072620 2024-01-19T04:17:40.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74b0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c3d80 con 0x7f74a80c35a0 2024-01-19T04:17:40.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ae800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74a8072620 0x7f74a8071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ade00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f74a814fc70 0x7f74a806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51160/0 (socket says 172.21.15.32:51160) 2024-01-19T04:17:40.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ade00640 1 -- 172.21.15.32:0/1863063858 learned_addr learned my addr 172.21.15.32:0/1863063858 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:40.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ad400640 1 --2- 172.21.15.32:0/1863063858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a80c35a0 0x7f74a80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ae800640 1 -- 172.21.15.32:0/1863063858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a80c35a0 msgr2=0x7f74a80714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:40.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ae800640 1 --2- 172.21.15.32:0/1863063858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a80c35a0 0x7f74a80714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ae800640 1 -- 172.21.15.32:0/1863063858 >> v1:172.21.15.32:6789/0 conn(0x7f74a814fc70 legacy=0x7f74a806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.936+0000 7f74ae800640 1 -- 172.21.15.32:0/1863063858 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80c3aa0 con 0x7f74a8072620 2024-01-19T04:17:40.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74ae800640 1 --2- 172.21.15.32:0/1863063858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a8071a10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009d90 tx=0x7f74a001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b388a85d53ab48e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:40.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74aca00640 1 -- 172.21.15.32:0/1863063858 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00a5980 con 0x7f74a8072620 2024-01-19T04:17:40.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74aca00640 1 -- 172.21.15.32:0/1863063858 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a00a5ae0 con 0x7f74a8072620 2024-01-19T04:17:40.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74aca00640 1 -- 172.21.15.32:0/1863063858 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00a5e70 con 0x7f74a8072620 2024-01-19T04:17:40.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 -- 172.21.15.32:0/1863063858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 msgr2=0x7f74a8071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 --2- 172.21.15.32:0/1863063858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a8071a10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009d90 tx=0x7f74a001c8c0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 -- 172.21.15.32:0/1863063858 shutdown_connections 2024-01-19T04:17:40.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 --2- 172.21.15.32:0/1863063858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a8071a10 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 --2- 172.21.15.32:0/1863063858 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a80c35a0 0x7f74a80714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 -- 172.21.15.32:0/1863063858 >> 172.21.15.32:0/1863063858 conn(0x7f74a80a88e0 msgr2=0x7f74a80c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 -- 172.21.15.32:0/1863063858 shutdown_connections 2024-01-19T04:17:40.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.940+0000 7f74b0800640 1 -- 172.21.15.32:0/1863063858 wait complete. 2024-01-19T04:17:40.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 Processor -- start 2024-01-19T04:17:40.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 -- start start 2024-01-19T04:17:40.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a813bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a80c35a0 0x7f74a80c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a814fc70 0x7f74a80c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8146010 con 0x7f74a8072620 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a81eadd0 con 0x7f74a80c35a0 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a81eb0b0 con 0x7f74a814fc70 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a813bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a813bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37968/0 (socket says 172.21.15.32:37968) 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 -- 172.21.15.32:0/869246363 learned_addr learned my addr 172.21.15.32:0/869246363 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ad400640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a80c35a0 0x7f74a80c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ae800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a814fc70 0x7f74a80c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 -- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a814fc70 msgr2=0x7f74a80c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a814fc70 0x7f74a80c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 -- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a80c35a0 msgr2=0x7f74a80c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a80c35a0 0x7f74a80c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 -- 172.21.15.32:0/869246363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0009a70 con 0x7f74a8072620 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ae800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a814fc70 0x7f74a80c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74ade00640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a813bda0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f749800c370 tx=0x7f749800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74a6000640 1 -- 172.21.15.32:0/869246363 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498005cf0 con 0x7f74a8072620 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74a6000640 1 -- 172.21.15.32:0/869246363 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498005e50 con 0x7f74a8072620 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74a6000640 1 -- 172.21.15.32:0/869246363 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980072f0 con 0x7f74a8072620 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a81eb390 con 0x7f74a8072620 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.944+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a81eb950 con 0x7f74a8072620 2024-01-19T04:17:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.948+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a80749f0 con 0x7f74a8072620 2024-01-19T04:17:40.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.948+0000 7f74a6000640 1 -- 172.21.15.32:0/869246363 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7498007450 con 0x7f74a8072620 2024-01-19T04:17:40.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.948+0000 7f74a6000640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7480066530 0x7f74800689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:40.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.948+0000 7f74a6000640 1 -- 172.21.15.32:0/869246363 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7498083170 con 0x7f74a8072620 2024-01-19T04:17:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.948+0000 7f74ad400640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7480066530 0x7f74800689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.948+0000 7f74ad400640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7480066530 0x7f74800689f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f74a814f590 tx=0x7f7490008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:40.952+0000 7f74a6000640 1 -- 172.21.15.32:0/869246363 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f74980506a0 con 0x7f74a8072620 2024-01-19T04:17:41.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.112+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74a815cbc0 con 0x7f74a8072620 2024-01-19T04:17:41.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.112+0000 7f74a6000640 1 -- 172.21.15.32:0/869246363 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13020 (secure 0 0 0) 0x7f7498053cc0 con 0x7f74a8072620 2024-01-19T04:17:41.117 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:41.117 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":63,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:39.757891+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6835/2011239289":"2024-01-20T04:17:36.748686+0000","172.21.15.32:6833/2011239289":"2024-01-20T04:17:36.748686+0000","172.21.15.67:6837/246892917":"2024-01-20T04:17:30.151066+0000","172.21.15.67:6835/246892917":"2024-01-20T04:17:30.151066+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:41.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7480066530 msgr2=0x7f74800689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7480066530 0x7f74800689f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f74a814f590 tx=0x7f7490008040 comp rx=0 tx=0).stop 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 msgr2=0x7f74a813bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a813bda0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f749800c370 tx=0x7f749800c830 comp rx=0 tx=0).stop 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 shutdown_connections 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7480066530 0x7f74800689f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f74a814fc70 0x7f74a80c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a80c35a0 0x7f74a80c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 --2- 172.21.15.32:0/869246363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a8072620 0x7f74a813bda0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 >> 172.21.15.32:0/869246363 conn(0x7f74a80a88e0 msgr2=0x7f74a8142b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 shutdown_connections 2024-01-19T04:17:41.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.116+0000 7f74b0800640 1 -- 172.21.15.32:0/869246363 wait complete. 2024-01-19T04:17:41.139 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:41.140 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:41.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32f0000640 1 Processor -- start 2024-01-19T04:17:41.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32f0000640 1 -- start start 2024-01-19T04:17:41.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32f0000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32e80723b0 0x7f32e8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32f0000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32e806d440 0x7f32e80c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32f0000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e80a4ea0 con 0x7f32e80c2080 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32f0000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e81524a0 con 0x7f32e806d440 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32f0000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e8152a20 con 0x7f32e80723b0 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32ee000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32e806d440 0x7f32e80c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32ee000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32e806d440 0x7f32e80c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37976/0 (socket says 172.21.15.32:37976) 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32ee000640 1 -- 172.21.15.32:0/1705741588 learned_addr learned my addr 172.21.15.32:0/1705741588 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32ed600640 1 --2- 172.21.15.32:0/1705741588 >> v2:172.21.15.67:3300/0 conn(0x7f32e80723b0 0x7f32e8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32ee000640 1 -- 172.21.15.32:0/1705741588 >> v2:172.21.15.67:3300/0 conn(0x7f32e80723b0 msgr2=0x7f32e8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.280+0000 7f32ee000640 1 --2- 172.21.15.32:0/1705741588 >> v2:172.21.15.67:3300/0 conn(0x7f32e80723b0 0x7f32e8152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32ee000640 1 -- 172.21.15.32:0/1705741588 >> v1:172.21.15.67:6789/0 conn(0x7f32e80c2080 legacy=0x7f32e8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32ee000640 1 -- 172.21.15.32:0/1705741588 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e81533f0 con 0x7f32e806d440 2024-01-19T04:17:41.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32ee000640 1 --2- 172.21.15.32:0/1705741588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e806d440 0x7f32e80c4e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f32e80a8790 tx=0x7f32e001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652137b63b1dec96 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:41.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32e7e00640 1 -- 172.21.15.32:0/1705741588 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00a5680 con 0x7f32e806d440 2024-01-19T04:17:41.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32e7e00640 1 -- 172.21.15.32:0/1705741588 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e00a57e0 con 0x7f32e806d440 2024-01-19T04:17:41.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32e7e00640 1 -- 172.21.15.32:0/1705741588 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00a5b70 con 0x7f32e806d440 2024-01-19T04:17:41.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32f0000640 1 -- 172.21.15.32:0/1705741588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e806d440 msgr2=0x7f32e80c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.284+0000 7f32f0000640 1 --2- 172.21.15.32:0/1705741588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e806d440 0x7f32e80c4e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f32e80a8790 tx=0x7f32e001c8b0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- 172.21.15.32:0/1705741588 shutdown_connections 2024-01-19T04:17:41.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 --2- 172.21.15.32:0/1705741588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e806d440 0x7f32e80c4e50 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 --2- 172.21.15.32:0/1705741588 >> v2:172.21.15.67:3300/0 conn(0x7f32e80723b0 0x7f32e8152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- 172.21.15.32:0/1705741588 >> 172.21.15.32:0/1705741588 conn(0x7f32e80c25a0 msgr2=0x7f32e80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:41.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- 172.21.15.32:0/1705741588 shutdown_connections 2024-01-19T04:17:41.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- 172.21.15.32:0/1705741588 wait complete. 2024-01-19T04:17:41.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 Processor -- start 2024-01-19T04:17:41.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- start start 2024-01-19T04:17:41.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32e806d440 0x7f32e8145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32e80723b0 0x7f32e80c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e80c2080 0x7f32e81ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8140c10 con 0x7f32e80c2080 2024-01-19T04:17:41.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80abea0 con 0x7f32e80723b0 2024-01-19T04:17:41.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32f0000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e81eecb0 con 0x7f32e806d440 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e80c2080 0x7f32e81ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ecc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32e80723b0 0x7f32e80c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e80c2080 0x7f32e81ee3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37986/0 (socket says 172.21.15.32:37986) 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ed600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32e806d440 0x7f32e8145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 -- 172.21.15.32:0/3443990644 learned_addr learned my addr 172.21.15.32:0/3443990644 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 -- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32e806d440 msgr2=0x7f32e8145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32e806d440 0x7f32e8145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 -- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32e80723b0 msgr2=0x7f32e80c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32e80723b0 0x7f32e80c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.288+0000 7f32ee000640 1 -- 172.21.15.32:0/3443990644 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e0009b30 con 0x7f32e80c2080 2024-01-19T04:17:41.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32ee000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e80c2080 0x7f32e81ee3d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f32e00194c0 tx=0x7f32e0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:41.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32e5600640 1 -- 172.21.15.32:0/3443990644 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00b8670 con 0x7f32e80c2080 2024-01-19T04:17:41.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32e5600640 1 -- 172.21.15.32:0/3443990644 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e00b87d0 con 0x7f32e80c2080 2024-01-19T04:17:41.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32e5600640 1 -- 172.21.15.32:0/3443990644 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00b8b60 con 0x7f32e80c2080 2024-01-19T04:17:41.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e80c5080 con 0x7f32e80c2080 2024-01-19T04:17:41.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e814cc90 con 0x7f32e80c2080 2024-01-19T04:17:41.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e81eee40 con 0x7f32e80c2080 2024-01-19T04:17:41.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32e5600640 1 -- 172.21.15.32:0/3443990644 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f32e00b8cc0 con 0x7f32e80c2080 2024-01-19T04:17:41.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32e5600640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f32c0066500 0x7f32c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.292+0000 7f32e5600640 1 -- 172.21.15.32:0/3443990644 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f32e011ee40 con 0x7f32e80c2080 2024-01-19T04:17:41.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.296+0000 7f32ed600640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f32c0066500 0x7f32c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.296+0000 7f32ed600640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f32c0066500 0x7f32c00689c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f32d80079c0 tx=0x7f32d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:41.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.296+0000 7f32e5600640 1 -- 172.21.15.32:0/3443990644 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f32e00ec4c0 con 0x7f32e80c2080 2024-01-19T04:17:41.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.456+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32e80749f0 con 0x7f32e80c2080 2024-01-19T04:17:41.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.456+0000 7f32e5600640 1 -- 172.21.15.32:0/3443990644 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32e00bc020 con 0x7f32e80c2080 2024-01-19T04:17:41.460 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:41.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f32c0066500 msgr2=0x7f32c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f32c0066500 0x7f32c00689c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f32d80079c0 tx=0x7f32d8008040 comp rx=0 tx=0).stop 2024-01-19T04:17:41.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e80c2080 msgr2=0x7f32e81ee3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e80c2080 0x7f32e81ee3d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f32e00194c0 tx=0x7f32e0019650 comp rx=0 tx=0).stop 2024-01-19T04:17:41.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 shutdown_connections 2024-01-19T04:17:41.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f32c0066500 0x7f32c00689c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e80c2080 0x7f32e81ee3d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32e80723b0 0x7f32e80c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 --2- 172.21.15.32:0/3443990644 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32e806d440 0x7f32e8145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 >> 172.21.15.32:0/3443990644 conn(0x7f32e80c25a0 msgr2=0x7f32e8149cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:41.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 shutdown_connections 2024-01-19T04:17:41.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.460+0000 7f32f0000640 1 -- 172.21.15.32:0/3443990644 wait complete. 2024-01-19T04:17:41.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2024-01-19T04:17:41.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd48000640 1 Processor -- start 2024-01-19T04:17:41.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd48000640 1 -- start start 2024-01-19T04:17:41.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd48000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd4006dd40 0x7fdd4006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd48000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40152cb0 con 0x7fdd4014fc40 2024-01-19T04:17:41.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd48000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4006ad30 con 0x7fdd40153140 2024-01-19T04:17:41.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd48000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4006b010 con 0x7fdd4006dd40 2024-01-19T04:17:41.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd44c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd4006dd40 0x7fdd4006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd45600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdd4014fc40 0x7fdd4006e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51164/0 (socket says 172.21.15.32:51164) 2024-01-19T04:17:41.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd45600640 1 -- 172.21.15.32:0/3163524642 learned_addr learned my addr 172.21.15.32:0/3163524642 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:41.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd44c00640 1 -- 172.21.15.32:0/3163524642 >> v1:172.21.15.67:6789/0 conn(0x7fdd40153140 legacy=0x7fdd400a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd44c00640 1 -- 172.21.15.32:0/3163524642 >> v1:172.21.15.32:6789/0 conn(0x7fdd4014fc40 legacy=0x7fdd4006e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd3fe00640 1 -- 172.21.15.32:0/3163524642 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654477180 0 0) 0x7fdd40152cb0 con 0x7fdd4014fc40 2024-01-19T04:17:41.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.620+0000 7fdd44c00640 1 -- 172.21.15.32:0/3163524642 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40152660 con 0x7fdd4006dd40 2024-01-19T04:17:41.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd44c00640 1 --2- 172.21.15.32:0/3163524642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd4006a6a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdd280097c0 tx=0x7fdd2801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc45915a05870e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:41.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd3fe00640 1 -- 172.21.15.32:0/3163524642 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd280a8050 con 0x7fdd4006dd40 2024-01-19T04:17:41.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd3fe00640 1 -- 172.21.15.32:0/3163524642 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd280ac5f0 con 0x7fdd4006dd40 2024-01-19T04:17:41.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd3fe00640 1 -- 172.21.15.32:0/3163524642 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd280ac980 con 0x7fdd4006dd40 2024-01-19T04:17:41.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd48000640 1 -- 172.21.15.32:0/3163524642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 msgr2=0x7fdd4006a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd48000640 1 --2- 172.21.15.32:0/3163524642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd4006a6a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdd280097c0 tx=0x7fdd2801c480 comp rx=0 tx=0).stop 2024-01-19T04:17:41.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd48000640 1 -- 172.21.15.32:0/3163524642 shutdown_connections 2024-01-19T04:17:41.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd48000640 1 --2- 172.21.15.32:0/3163524642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd4006a6a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd48000640 1 -- 172.21.15.32:0/3163524642 >> 172.21.15.32:0/3163524642 conn(0x7fdd400a8970 msgr2=0x7fdd400a8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:41.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd48000640 1 -- 172.21.15.32:0/3163524642 shutdown_connections 2024-01-19T04:17:41.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.624+0000 7fdd48000640 1 -- 172.21.15.32:0/3163524642 wait complete. 2024-01-19T04:17:41.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 Processor -- start 2024-01-19T04:17:41.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 -- start start 2024-01-19T04:17:41.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd40147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd4014fc40 0x7fdd400bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd40153140 0x7fdd401f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40147ba0 con 0x7fdd4006dd40 2024-01-19T04:17:41.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4014ee60 con 0x7fdd4014fc40 2024-01-19T04:17:41.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd401497f0 con 0x7fdd40153140 2024-01-19T04:17:41.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd40147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd40147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38010/0 (socket says 172.21.15.32:38010) 2024-01-19T04:17:41.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 -- 172.21.15.32:0/1839760441 learned_addr learned my addr 172.21.15.32:0/1839760441 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:41.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd44c00640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd4014fc40 0x7fdd400bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd46000640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd40153140 0x7fdd401f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 -- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd40153140 msgr2=0x7fdd401f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd40153140 0x7fdd401f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 -- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd4014fc40 msgr2=0x7fdd400bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd4014fc40 0x7fdd400bfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 -- 172.21.15.32:0/1839760441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd28009420 con 0x7fdd4006dd40 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd45600640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd40147160 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000c480 tx=0x7fdd3000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd3d600640 1 -- 172.21.15.32:0/1839760441 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd300074e0 con 0x7fdd4006dd40 2024-01-19T04:17:41.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd3d600640 1 -- 172.21.15.32:0/1839760441 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30007660 con 0x7fdd4006dd40 2024-01-19T04:17:41.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4006b620 con 0x7fdd4006dd40 2024-01-19T04:17:41.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd3d600640 1 -- 172.21.15.32:0/1839760441 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30004a30 con 0x7fdd4006dd40 2024-01-19T04:17:41.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd400abcc0 con 0x7fdd4006dd40 2024-01-19T04:17:41.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.628+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd400ab810 con 0x7fdd4006dd40 2024-01-19T04:17:41.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.632+0000 7fdd3d600640 1 -- 172.21.15.32:0/1839760441 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdd30004b90 con 0x7fdd4006dd40 2024-01-19T04:17:41.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.632+0000 7fdd3d600640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd18066500 0x7fdd180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:41.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.632+0000 7fdd3d600640 1 -- 172.21.15.32:0/1839760441 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdd30083080 con 0x7fdd4006dd40 2024-01-19T04:17:41.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.632+0000 7fdd44c00640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd18066500 0x7fdd180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:41.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.632+0000 7fdd44c00640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd18066500 0x7fdd180689c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdd280ae000 tx=0x7fdd280a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:41.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.636+0000 7fdd3d600640 1 -- 172.21.15.32:0/1839760441 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdd300b44d0 con 0x7fdd4006dd40 2024-01-19T04:17:41.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:41.852+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7fdd400749f0 con 0x7fdd4006dd40 2024-01-19T04:17:42.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd3d600640 1 -- 172.21.15.32:0/1839760441 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v176) v1 ==== 162+0+0 (secure 0 0 0) 0x7fdd30018020 con 0x7fdd4006dd40 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd18066500 msgr2=0x7fdd180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd18066500 0x7fdd180689c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdd280ae000 tx=0x7fdd280a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 msgr2=0x7fdd40147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd40147160 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000c480 tx=0x7fdd3000c940 comp rx=0 tx=0).stop 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 shutdown_connections 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdd18066500 0x7fdd180689c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdd40153140 0x7fdd401f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd4014fc40 0x7fdd400bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 --2- 172.21.15.32:0/1839760441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4006dd40 0x7fdd40147160 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 >> 172.21.15.32:0/1839760441 conn(0x7fdd400a8970 msgr2=0x7fdd401506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:42.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 shutdown_connections 2024-01-19T04:17:42.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.772+0000 7fdd48000640 1 -- 172.21.15.32:0/1839760441 wait complete. 2024-01-19T04:17:42.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-19T04:17:42.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.944+0000 7f5e00600640 1 Processor -- start 2024-01-19T04:17:42.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5e00600640 1 -- start start 2024-01-19T04:17:42.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5e00600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5df806f800 0x7f5df8071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:42.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5e00600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df81559d0 0x7f5df80717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:42.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5e00600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df806b5e0 con 0x7f5df806f420 2024-01-19T04:17:42.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5e00600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df8071d10 con 0x7f5df806f800 2024-01-19T04:17:42.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5e00600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8071f20 con 0x7f5df81559d0 2024-01-19T04:17:42.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfd200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5df806f800 0x7f5df8071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:42.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfdc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5df806f420 0x7f5df806a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51166/0 (socket says 172.21.15.32:51166) 2024-01-19T04:17:42.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfdc00640 1 -- 172.21.15.32:0/2373018252 learned_addr learned my addr 172.21.15.32:0/2373018252 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:42.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfe600640 1 --2- 172.21.15.32:0/2373018252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df81559d0 0x7f5df80717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:42.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfd200640 1 -- 172.21.15.32:0/2373018252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df81559d0 msgr2=0x7f5df80717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:42.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfd200640 1 --2- 172.21.15.32:0/2373018252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df81559d0 0x7f5df80717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfd200640 1 -- 172.21.15.32:0/2373018252 >> v1:172.21.15.32:6789/0 conn(0x7f5df806f420 legacy=0x7f5df806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:42.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5dfd200640 1 -- 172.21.15.32:0/2373018252 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80c5d00 con 0x7f5df806f800 2024-01-19T04:17:42.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.948+0000 7f5df7e00640 1 -- 172.21.15.32:0/2373018252 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093457872 0 0) 0x7f5df806b5e0 con 0x7f5df806f420 2024-01-19T04:17:42.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5dfd200640 1 --2- 172.21.15.32:0/2373018252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8071290 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5de00097c0 tx=0x7f5de001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a77428a4d8688bf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:42.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5df7e00640 1 -- 172.21.15.32:0/2373018252 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00ac620 con 0x7f5df806f800 2024-01-19T04:17:42.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5df7e00640 1 -- 172.21.15.32:0/2373018252 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de00ac780 con 0x7f5df806f800 2024-01-19T04:17:42.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5df7e00640 1 -- 172.21.15.32:0/2373018252 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00acb10 con 0x7f5df806f800 2024-01-19T04:17:42.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 -- 172.21.15.32:0/2373018252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 msgr2=0x7f5df8071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:42.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 --2- 172.21.15.32:0/2373018252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8071290 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5de00097c0 tx=0x7f5de001c3c0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 -- 172.21.15.32:0/2373018252 shutdown_connections 2024-01-19T04:17:42.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 --2- 172.21.15.32:0/2373018252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df81559d0 0x7f5df80717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 --2- 172.21.15.32:0/2373018252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8071290 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 -- 172.21.15.32:0/2373018252 >> 172.21.15.32:0/2373018252 conn(0x7f5df80c36c0 msgr2=0x7f5df80c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:42.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 -- 172.21.15.32:0/2373018252 shutdown_connections 2024-01-19T04:17:42.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 -- 172.21.15.32:0/2373018252 wait complete. 2024-01-19T04:17:42.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.952+0000 7f5e00600640 1 Processor -- start 2024-01-19T04:17:42.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 -- start start 2024-01-19T04:17:42.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df806f420 0x7f5df80a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:42.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:42.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df81559d0 0x7f5df80a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:42.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df813f310 con 0x7f5df806f800 2024-01-19T04:17:42.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8154770 con 0x7f5df81559d0 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df813f030 con 0x7f5df806f420 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38034/0 (socket says 172.21.15.32:38034) 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 -- 172.21.15.32:0/2837043513 learned_addr learned my addr 172.21.15.32:0/2837043513 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfdc00640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df806f420 0x7f5df80a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfe600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df81559d0 0x7f5df80a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 -- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df806f420 msgr2=0x7f5df80a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df806f420 0x7f5df80a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 -- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df81559d0 msgr2=0x7f5df80a74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df81559d0 0x7f5df80a74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 -- 172.21.15.32:0/2837043513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de0009420 con 0x7f5df806f800 2024-01-19T04:17:42.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfe600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df81559d0 0x7f5df80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:42.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5dfd200640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8148120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5de0019ff0 tx=0x7f5de0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:42.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5df5600640 1 -- 172.21.15.32:0/2837043513 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00b5410 con 0x7f5df806f800 2024-01-19T04:17:42.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5df5600640 1 -- 172.21.15.32:0/2837043513 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de00b5570 con 0x7f5df806f800 2024-01-19T04:17:42.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df80a6fd0 con 0x7f5df806f800 2024-01-19T04:17:42.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5df5600640 1 -- 172.21.15.32:0/2837043513 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00b5920 con 0x7f5df806f800 2024-01-19T04:17:42.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df81489f0 con 0x7f5df806f800 2024-01-19T04:17:42.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.956+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df804f1d0 con 0x7f5df806f800 2024-01-19T04:17:42.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.960+0000 7f5df5600640 1 -- 172.21.15.32:0/2837043513 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5de00b3040 con 0x7f5df806f800 2024-01-19T04:17:42.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.960+0000 7f5df5600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066530 0x7f5dd00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:42.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.960+0000 7f5df5600640 1 -- 172.21.15.32:0/2837043513 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5de011dee0 con 0x7f5df806f800 2024-01-19T04:17:42.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.960+0000 7f5dfdc00640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066530 0x7f5dd00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.960+0000 7f5dfdc00640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066530 0x7f5dd00689f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5de8000f70 tx=0x7f5de8007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:42.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:42.964+0000 7f5df5600640 1 -- 172.21.15.32:0/2837043513 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5de00eb530 con 0x7f5df806f800 2024-01-19T04:17:43.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.124+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5df80c6840 con 0x7f5df806f800 2024-01-19T04:17:43.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5df5600640 1 -- 172.21.15.32:0/2837043513 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5de00eeb50 con 0x7f5df806f800 2024-01-19T04:17:43.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066530 msgr2=0x7f5dd00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066530 0x7f5dd00689f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5de8000f70 tx=0x7f5de8007df0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 msgr2=0x7f5df8148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8148120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5de0019ff0 tx=0x7f5de0019160 comp rx=0 tx=0).stop 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 shutdown_connections 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5dd0066530 0x7f5dd00689f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df81559d0 0x7f5df80a74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5df806f800 0x7f5df8148120 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 --2- 172.21.15.32:0/2837043513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5df806f420 0x7f5df80a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 >> 172.21.15.32:0/2837043513 conn(0x7f5df80c36c0 msgr2=0x7f5df8071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 shutdown_connections 2024-01-19T04:17:43.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.128+0000 7f5e00600640 1 -- 172.21.15.32:0/2837043513 wait complete. 2024-01-19T04:17:43.153 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T04:17:43.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:17:43.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:17:43.335 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T04:17:43.335 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:43.336 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:43.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:17:43.344 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:43.345 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:43.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:17:43.354 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-19T04:17:43.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b3b000640 1 Processor -- start 2024-01-19T04:17:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b3b000640 1 -- start start 2024-01-19T04:17:43.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b3b000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b3406fda0 0x7f2b340c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b3b000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2b3406eb70 0x7f2b3406f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b3b000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b340c5b40 con 0x7f2b34151f30 2024-01-19T04:17:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b3b000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b341551e0 con 0x7f2b3406eb70 2024-01-19T04:17:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b3b000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34155710 con 0x7f2b3406fda0 2024-01-19T04:17:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b39000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2b3406eb70 0x7f2b3406f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b39000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2b3406eb70 0x7f2b3406f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38044/0 (socket says 172.21.15.32:38044) 2024-01-19T04:17:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b39000640 1 -- 172.21.15.32:0/466836611 learned_addr learned my addr 172.21.15.32:0/466836611 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b33400640 1 --2- 172.21.15.32:0/466836611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b3406fda0 0x7f2b340c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b39000640 1 -- 172.21.15.32:0/466836611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b3406fda0 msgr2=0x7f2b340c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:43.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b39000640 1 --2- 172.21.15.32:0/466836611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b3406fda0 0x7f2b340c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b39000640 1 -- 172.21.15.32:0/466836611 >> v1:172.21.15.67:6789/0 conn(0x7f2b34151f30 legacy=0x7f2b340c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.524+0000 7f2b39000640 1 -- 172.21.15.32:0/466836611 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340c3fa0 con 0x7f2b3406eb70 2024-01-19T04:17:43.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b39000640 1 --2- 172.21.15.32:0/466836611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3406f000 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009e50 tx=0x7f2b2c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486ee164ad64e572 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:43.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b32a00640 1 -- 172.21.15.32:0/466836611 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0a5750 con 0x7f2b3406eb70 2024-01-19T04:17:43.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b32a00640 1 -- 172.21.15.32:0/466836611 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0a58b0 con 0x7f2b3406eb70 2024-01-19T04:17:43.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b32a00640 1 -- 172.21.15.32:0/466836611 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0a5c40 con 0x7f2b3406eb70 2024-01-19T04:17:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 -- 172.21.15.32:0/466836611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 msgr2=0x7f2b3406f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 --2- 172.21.15.32:0/466836611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3406f000 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009e50 tx=0x7f2b2c01c980 comp rx=0 tx=0).stop 2024-01-19T04:17:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 -- 172.21.15.32:0/466836611 shutdown_connections 2024-01-19T04:17:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 --2- 172.21.15.32:0/466836611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3406f000 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 --2- 172.21.15.32:0/466836611 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b3406fda0 0x7f2b340c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 -- 172.21.15.32:0/466836611 >> 172.21.15.32:0/466836611 conn(0x7f2b340a9870 msgr2=0x7f2b340a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 -- 172.21.15.32:0/466836611 shutdown_connections 2024-01-19T04:17:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.528+0000 7f2b3b000640 1 -- 172.21.15.32:0/466836611 wait complete. 2024-01-19T04:17:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 Processor -- start 2024-01-19T04:17:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 -- start start 2024-01-19T04:17:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b3406fda0 0x7f2b3414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b34151f30 0x7f2b34149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b341f07a0 con 0x7f2b3406eb70 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3406c640 con 0x7f2b3406fda0 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3406c8b0 con 0x7f2b34151f30 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38046/0 (socket says 172.21.15.32:38046) 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 -- 172.21.15.32:0/2815435184 learned_addr learned my addr 172.21.15.32:0/2815435184 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b39000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b34151f30 0x7f2b34149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33400640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b3406fda0 0x7f2b3414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 -- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b34151f30 msgr2=0x7f2b34149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b34151f30 0x7f2b34149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 -- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b3406fda0 msgr2=0x7f2b3414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b3406fda0 0x7f2b3414dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 -- 172.21.15.32:0/2815435184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c009b30 con 0x7f2b3406eb70 2024-01-19T04:17:43.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b39000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b34151f30 0x7f2b34149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:43.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33400640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b3406fda0 0x7f2b3414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:43.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b33e00640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3414c550 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c450 tx=0x7f2b2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:43.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b2be00640 1 -- 172.21.15.32:0/2815435184 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240052d0 con 0x7f2b3406eb70 2024-01-19T04:17:43.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b2be00640 1 -- 172.21.15.32:0/2815435184 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24005430 con 0x7f2b3406eb70 2024-01-19T04:17:43.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b2be00640 1 -- 172.21.15.32:0/2815435184 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24007260 con 0x7f2b3406eb70 2024-01-19T04:17:43.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3406cb90 con 0x7f2b3406eb70 2024-01-19T04:17:43.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3406d150 con 0x7f2b3406eb70 2024-01-19T04:17:43.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.532+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b340749f0 con 0x7f2b3406eb70 2024-01-19T04:17:43.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.536+0000 7f2b2be00640 1 -- 172.21.15.32:0/2815435184 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2b240073c0 con 0x7f2b3406eb70 2024-01-19T04:17:43.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.536+0000 7f2b2be00640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b0c066500 0x7f2b0c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.536+0000 7f2b2be00640 1 -- 172.21.15.32:0/2815435184 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2b24083450 con 0x7f2b3406eb70 2024-01-19T04:17:43.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.536+0000 7f2b33400640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b0c066500 0x7f2b0c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.536+0000 7f2b33400640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b0c066500 0x7f2b0c0689c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2b340a8ec0 tx=0x7f2b1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:43.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.540+0000 7f2b2be00640 1 -- 172.21.15.32:0/2815435184 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2b24050a20 con 0x7f2b3406eb70 2024-01-19T04:17:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b34067b80 con 0x7f2b3406eb70 2024-01-19T04:17:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b2be00640 1 -- 172.21.15.32:0/2815435184 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f2b24054040 con 0x7f2b3406eb70 2024-01-19T04:17:43.735 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:43.735 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/1498377136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1498377136},{"type":"v1","addr":"172.21.15.67:6836","nonce":1498377136}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/341594416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":341594416},{"type":"v1","addr":"172.21.15.32:6834","nonce":341594416}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3551699011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":3551699011},{"type":"v1","addr":"172.21.15.67:6837","nonce":3551699011}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3732280146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3732280146},{"type":"v1","addr":"172.21.15.32:6835","nonce":3732280146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[]} 2024-01-19T04:17:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 40 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b0c066500 msgr2=0x7f2b0c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b0c066500 0x7f2b0c0689c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2b340a8ec0 tx=0x7f2b1c008040 comp rx=0 tx=0).stop 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 msgr2=0x7f2b3414c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3414c550 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c450 tx=0x7f2b2400c910 comp rx=0 tx=0).stop 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 shutdown_connections 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b0c066500 0x7f2b0c0689c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b34151f30 0x7f2b34149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b3406fda0 0x7f2b3414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 --2- 172.21.15.32:0/2815435184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b3406eb70 0x7f2b3414c550 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 >> 172.21.15.32:0/2815435184 conn(0x7f2b340a9870 msgr2=0x7f2b340a8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 shutdown_connections 2024-01-19T04:17:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.732+0000 7f2b3b000640 1 -- 172.21.15.32:0/2815435184 wait complete. 2024-01-19T04:17:43.757 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-19T04:17:43.757 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-19T04:17:43.758 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-19T04:17:43.758 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:17:43.758 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-19T04:17:43.758 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-19T04:17:43.758 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-19T04:17:43.758 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:17:43.758 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-19T04:17:43.758 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-19T04:17:43.759 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-19T04:17:43.759 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:17:43.759 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-19T04:17:43.759 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-19T04:17:43.759 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-19T04:17:43.759 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:17:43.773 INFO:tasks.ceph.mds.c:Stopped 2024-01-19T04:17:43.773 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-19T04:17:43.774 INFO:tasks.ceph.mds.a:Stopped 2024-01-19T04:17:43.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-19T04:17:43.775 INFO:tasks.ceph.mds.b:Stopped 2024-01-19T04:17:43.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-19T04:17:43.776 INFO:tasks.ceph.mds.d:Stopped 2024-01-19T04:17:43.776 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-19T04:17:43.819 INFO:tasks.ceph.mds.b:Started 2024-01-19T04:17:43.820 DEBUG:teuthology.parallel:result is None 2024-01-19T04:17:43.820 INFO:tasks.ceph.mds.c:Started 2024-01-19T04:17:43.820 DEBUG:teuthology.parallel:result is None 2024-01-19T04:17:43.821 INFO:tasks.ceph.mds.d:Started 2024-01-19T04:17:43.821 DEBUG:teuthology.parallel:result is None 2024-01-19T04:17:43.822 INFO:tasks.ceph.mds.a:Started 2024-01-19T04:17:43.822 DEBUG:teuthology.parallel:result is None 2024-01-19T04:17:43.822 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-19T04:17:43.907 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-01-19T04:17:43.908 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-01-19T04:17:43.915 INFO:tasks.ceph.mds.b.smithi067.stdout:starting mds.b at 2024-01-19T04:17:43.915 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2024-01-19T04:17:43.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e60200640 1 Processor -- start 2024-01-19T04:17:43.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e60200640 1 -- start start 2024-01-19T04:17:43.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e60200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e580c4b40 0x7f1e5806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e60200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e580c5b40 con 0x7f1e5806fda0 2024-01-19T04:17:43.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e60200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e580c3fa0 con 0x7f1e58151f30 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e60200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e581551e0 con 0x7f1e580c4b40 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e5ce00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1e5806fda0 0x7f1e5806eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51186/0 (socket says 172.21.15.32:51186) 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e5ce00640 1 -- 172.21.15.32:0/3461687986 learned_addr learned my addr 172.21.15.32:0/3461687986 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e5e200640 1 --2- 172.21.15.32:0/3461687986 >> v2:172.21.15.67:3300/0 conn(0x7f1e580c4b40 0x7f1e5806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e57e00640 1 -- 172.21.15.32:0/3461687986 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475555439 0 0) 0x7f1e580c5b40 con 0x7f1e5806fda0 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e57e00640 1 -- 172.21.15.32:0/3461687986 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e38003530 con 0x7f1e5806fda0 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e57e00640 1 -- 172.21.15.32:0/3461687986 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918554606 0 0) 0x7f1e580c3fa0 con 0x7f1e58151f30 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e57e00640 1 -- 172.21.15.32:0/3461687986 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e580c5b40 con 0x7f1e58151f30 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e5e200640 1 -- 172.21.15.32:0/3461687986 >> v1:172.21.15.67:6789/0 conn(0x7f1e58151f30 legacy=0x7f1e580c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e5e200640 1 -- 172.21.15.32:0/3461687986 >> v1:172.21.15.32:6789/0 conn(0x7f1e5806fda0 legacy=0x7f1e5806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.968+0000 7f1e5e200640 1 -- 172.21.15.32:0/3461687986 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e580c4f90 con 0x7f1e580c4b40 2024-01-19T04:17:43.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e5e200640 1 --2- 172.21.15.32:0/3461687986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e580c4b40 0x7f1e5806f280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009d90 tx=0x7f1e5001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ca886010563c68 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:43.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e57e00640 1 -- 172.21.15.32:0/3461687986 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500a5890 con 0x7f1e580c4b40 2024-01-19T04:17:43.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e57e00640 1 -- 172.21.15.32:0/3461687986 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e500a59f0 con 0x7f1e580c4b40 2024-01-19T04:17:43.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e57e00640 1 -- 172.21.15.32:0/3461687986 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500a5d80 con 0x7f1e580c4b40 2024-01-19T04:17:43.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e60200640 1 -- 172.21.15.32:0/3461687986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e580c4b40 msgr2=0x7f1e5806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e60200640 1 --2- 172.21.15.32:0/3461687986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e580c4b40 0x7f1e5806f280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009d90 tx=0x7f1e5001c8c0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e60200640 1 -- 172.21.15.32:0/3461687986 shutdown_connections 2024-01-19T04:17:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e60200640 1 --2- 172.21.15.32:0/3461687986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e580c4b40 0x7f1e5806f280 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e60200640 1 -- 172.21.15.32:0/3461687986 >> 172.21.15.32:0/3461687986 conn(0x7f1e580a9870 msgr2=0x7f1e580a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e60200640 1 -- 172.21.15.32:0/3461687986 shutdown_connections 2024-01-19T04:17:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.972+0000 7f1e60200640 1 -- 172.21.15.32:0/3461687986 wait complete. 2024-01-19T04:17:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 Processor -- start 2024-01-19T04:17:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 -- start start 2024-01-19T04:17:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e5806fda0 0x7f1e58153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e580c4b40 0x7f1e5814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151f30 0x7f1e5814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581f1220 con 0x7f1e580c4b40 2024-01-19T04:17:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581f03c0 con 0x7f1e58151f30 2024-01-19T04:17:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581f0610 con 0x7f1e5806fda0 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e580c4b40 0x7f1e5814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e580c4b40 0x7f1e5814b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38072/0 (socket says 172.21.15.32:38072) 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e5806fda0 0x7f1e58153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5ce00640 1 -- 172.21.15.32:0/1526793048 learned_addr learned my addr 172.21.15.32:0/1526793048 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5e200640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151f30 0x7f1e5814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5d800640 1 -- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151f30 msgr2=0x7f1e5814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5d800640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151f30 0x7f1e5814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5d800640 1 -- 172.21.15.32:0/1526793048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e580c4b40 msgr2=0x7f1e5814b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5d800640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e580c4b40 0x7f1e5814b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5d800640 1 -- 172.21.15.32:0/1526793048 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50009a70 con 0x7f1e5806fda0 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5ce00640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e580c4b40 0x7f1e5814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:43.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e5d800640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e5806fda0 0x7f1e58153620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800c340 tx=0x7f1e48001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:43.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e55600640 1 -- 172.21.15.32:0/1526793048 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480052d0 con 0x7f1e5806fda0 2024-01-19T04:17:43.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e55600640 1 -- 172.21.15.32:0/1526793048 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e48005450 con 0x7f1e5806fda0 2024-01-19T04:17:43.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e581f08f0 con 0x7f1e5806fda0 2024-01-19T04:17:43.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e55600640 1 -- 172.21.15.32:0/1526793048 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48003840 con 0x7f1e5806fda0 2024-01-19T04:17:43.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.976+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e581f0eb0 con 0x7f1e5806fda0 2024-01-19T04:17:43.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.980+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e580749f0 con 0x7f1e5806fda0 2024-01-19T04:17:43.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.980+0000 7f1e55600640 1 -- 172.21.15.32:0/1526793048 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1e480039a0 con 0x7f1e5806fda0 2024-01-19T04:17:43.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.980+0000 7f1e55600640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:43.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.980+0000 7f1e55600640 1 -- 172.21.15.32:0/1526793048 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1e480830c0 con 0x7f1e5806fda0 2024-01-19T04:17:43.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.980+0000 7f1e5ce00640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:43.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.980+0000 7f1e5ce00640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1e580c3920 tx=0x7f1e40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:43.984+0000 7f1e55600640 1 -- 172.21.15.32:0/1526793048 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1e48050610 con 0x7f1e5806fda0 2024-01-19T04:17:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.160+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1e58067b80 con 0x7f1e5806fda0 2024-01-19T04:17:44.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.784+0000 7f1e55600640 1 -- 172.21.15.32:0/1526793048 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1e48053c30 con 0x7f1e5806fda0 2024-01-19T04:17:44.790 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2024-01-19T04:17:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 msgr2=0x7f1e300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1e580c3920 tx=0x7f1e40009040 comp rx=0 tx=0).stop 2024-01-19T04:17:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e5806fda0 msgr2=0x7f1e58153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e5806fda0 0x7f1e58153620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800c340 tx=0x7f1e48001e80 comp rx=0 tx=0).stop 2024-01-19T04:17:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 shutdown_connections 2024-01-19T04:17:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1e30066500 0x7f1e300689c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e58151f30 0x7f1e5814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e580c4b40 0x7f1e5814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 --2- 172.21.15.32:0/1526793048 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1e5806fda0 0x7f1e58153620 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 >> 172.21.15.32:0/1526793048 conn(0x7f1e580a9870 msgr2=0x7f1e5806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 shutdown_connections 2024-01-19T04:17:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.788+0000 7f1e60200640 1 -- 172.21.15.32:0/1526793048 wait complete. 2024-01-19T04:17:44.818 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-19T04:17:44.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.960+0000 7f9b56200640 1 Processor -- start 2024-01-19T04:17:44.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.960+0000 7f9b56200640 1 -- start start 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b56200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9b50155500 0x7f9b500c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b56200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b500c3900 0x7f9b500c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b56200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5006ed70 con 0x7f9b500c6d70 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b56200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5006e400 con 0x7f9b500c3900 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b56200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500c7340 con 0x7f9b50155500 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b500c3900 0x7f9b500c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9b500c6d70 0x7f9b500c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51200/0 (socket says 172.21.15.32:51200) 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4ea00640 1 -- 172.21.15.32:0/3144976585 learned_addr learned my addr 172.21.15.32:0/3144976585 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:44.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4f400640 1 --2- 172.21.15.32:0/3144976585 >> v2:172.21.15.67:3300/0 conn(0x7f9b50155500 0x7f9b500c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:44.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4fe00640 1 -- 172.21.15.32:0/3144976585 >> v2:172.21.15.67:3300/0 conn(0x7f9b50155500 msgr2=0x7f9b500c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:44.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4fe00640 1 --2- 172.21.15.32:0/3144976585 >> v2:172.21.15.67:3300/0 conn(0x7f9b50155500 0x7f9b500c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4fe00640 1 -- 172.21.15.32:0/3144976585 >> v1:172.21.15.32:6789/0 conn(0x7f9b500c6d70 legacy=0x7f9b500c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:44.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4fe00640 1 -- 172.21.15.32:0/3144976585 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5006efc0 con 0x7f9b500c3900 2024-01-19T04:17:44.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4e000640 1 -- 172.21.15.32:0/3144976585 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554629187 0 0) 0x7f9b5006ed70 con 0x7f9b500c6d70 2024-01-19T04:17:44.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4f400640 1 --2- 172.21.15.32:0/3144976585 >> v2:172.21.15.67:3300/0 conn(0x7f9b50155500 0x7f9b500c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:44.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.964+0000 7f9b4fe00640 1 --2- 172.21.15.32:0/3144976585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b500c3900 0x7f9b500c48c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9b500c8de0 tx=0x7f9b4801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a054136bde405138 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:44.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b4e000640 1 -- 172.21.15.32:0/3144976585 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480a5910 con 0x7f9b500c3900 2024-01-19T04:17:44.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b4e000640 1 -- 172.21.15.32:0/3144976585 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b480a5a70 con 0x7f9b500c3900 2024-01-19T04:17:44.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b4e000640 1 -- 172.21.15.32:0/3144976585 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480a5e00 con 0x7f9b500c3900 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- 172.21.15.32:0/3144976585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b500c3900 msgr2=0x7f9b500c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 --2- 172.21.15.32:0/3144976585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b500c3900 0x7f9b500c48c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9b500c8de0 tx=0x7f9b4801c850 comp rx=0 tx=0).stop 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- 172.21.15.32:0/3144976585 shutdown_connections 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 --2- 172.21.15.32:0/3144976585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b500c3900 0x7f9b500c48c0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 --2- 172.21.15.32:0/3144976585 >> v2:172.21.15.67:3300/0 conn(0x7f9b50155500 0x7f9b500c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- 172.21.15.32:0/3144976585 >> 172.21.15.32:0/3144976585 conn(0x7f9b500726d0 msgr2=0x7f9b500663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- 172.21.15.32:0/3144976585 shutdown_connections 2024-01-19T04:17:44.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- 172.21.15.32:0/3144976585 wait complete. 2024-01-19T04:17:44.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 Processor -- start 2024-01-19T04:17:44.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- start start 2024-01-19T04:17:44.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b500c3900 0x7f9b501ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:44.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b500c6d70 0x7f9b501ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:44.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b50155500 0x7f9b5014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:44.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501583d0 con 0x7f9b50155500 2024-01-19T04:17:44.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501ecbf0 con 0x7f9b500c6d70 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.968+0000 7f9b56200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5014f7d0 con 0x7f9b500c3900 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b50155500 0x7f9b5014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b50155500 0x7f9b5014eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38098/0 (socket says 172.21.15.32:38098) 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 -- 172.21.15.32:0/3552518418 learned_addr learned my addr 172.21.15.32:0/3552518418 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4f400640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b500c3900 0x7f9b501ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4ea00640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b500c6d70 0x7f9b501ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 -- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b500c3900 msgr2=0x7f9b501ee060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b500c3900 0x7f9b501ee060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 -- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b500c6d70 msgr2=0x7f9b501ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b500c6d70 0x7f9b501ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 -- 172.21.15.32:0/3552518418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48009a70 con 0x7f9b50155500 2024-01-19T04:17:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b4fe00640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b50155500 0x7f9b5014eb50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9b48019460 tx=0x7f9b480195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b47400640 1 -- 172.21.15.32:0/3552518418 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480a5910 con 0x7f9b50155500 2024-01-19T04:17:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b47400640 1 -- 172.21.15.32:0/3552518418 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b48003ba0 con 0x7f9b50155500 2024-01-19T04:17:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b47400640 1 -- 172.21.15.32:0/3552518418 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480b9660 con 0x7f9b50155500 2024-01-19T04:17:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5014f4f0 con 0x7f9b50155500 2024-01-19T04:17:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b501f0ef0 con 0x7f9b50155500 2024-01-19T04:17:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b500749f0 con 0x7f9b50155500 2024-01-19T04:17:44.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.972+0000 7f9b47400640 1 -- 172.21.15.32:0/3552518418 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9b480b97c0 con 0x7f9b50155500 2024-01-19T04:17:44.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.976+0000 7f9b47400640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9b28066530 0x7f9b280689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:44.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.976+0000 7f9b47400640 1 -- 172.21.15.32:0/3552518418 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b4811ed00 con 0x7f9b50155500 2024-01-19T04:17:44.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.976+0000 7f9b4f400640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9b28066530 0x7f9b280689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:44.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.976+0000 7f9b4f400640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9b28066530 0x7f9b280689f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000ba10 tx=0x7f9b40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:44.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:44.980+0000 7f9b47400640 1 -- 172.21.15.32:0/3552518418 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9b480ec2e0 con 0x7f9b50155500 2024-01-19T04:17:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9b500749f0 con 0x7f9b50155500 2024-01-19T04:17:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b47400640 1 -- 172.21.15.32:0/3552518418 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5081 (secure 0 0 0) 0x7f9b480ef900 con 0x7f9b50155500 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llsgveIhAArI1FfqpAbZbP5H/QNDKrQQ==", 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llsvlALxAADpa3U031IE67W85H0Rma6w==", 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll/F8cKhAAq6nC5ppnbAIpyfxBqU9v+w==", 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.196 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll61LHNhAAOWD4NF6ea4C6MYxR8v55lw==", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAE96llXf/LDxAA6FgZ7EGq0C9TUTaB/CiGAw==", 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAH96llm63KFRAAyoUf8Z0jVpxh86JaeudxpA==", 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAK96ll4IdoGhAAkyqz5g83r8gpFWdpV+JHAw==", 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2024-01-19T04:17:45.199 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAN96ll0o3YHhAAXaXcV6Ew3ARVzOeheB2Qdg==", 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAT96lluolMKhAAhtGB4RrqfaeFoh0Cw+FWcw==", 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAW96llGp39MBAArcnkxmH6H79g0uLV/tbMYg==", 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAZ96ll5MxcNhAAt6AgzeQup4/mAyqV/A4/ug==", 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAd96ll193uABAA/uFXx3ffBrEgBS+jU7LwYA==", 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.202 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q==", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow r", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ==", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow r", 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rw pool=cephfs2_data" 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llHuQFBBAAAEiDpbymhxmIcRRV//whZA==", 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.testuser", 2024-01-19T04:17:45.204 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQDO96llVEZQEhAAxN/8Vv61apt/Z/rdKj0r0g==", 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow rw fsname=cephfs", 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96ll838IHBAAatsDTMrKtOZVb2U6Jkhyvg==", 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:17:45.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAC96llu+oOGBAAAeqd9zD1YxEG+kXxhgkPUA==", 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-01-19T04:17:45.206 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:17:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9b28066530 msgr2=0x7f9b280689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9b28066530 0x7f9b280689f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000ba10 tx=0x7f9b40008040 comp rx=0 tx=0).stop 2024-01-19T04:17:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b50155500 msgr2=0x7f9b5014eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b50155500 0x7f9b5014eb50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9b48019460 tx=0x7f9b480195f0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 shutdown_connections 2024-01-19T04:17:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9b28066530 0x7f9b280689f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b50155500 0x7f9b5014eb50 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b500c6d70 0x7f9b501ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 --2- 172.21.15.32:0/3552518418 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9b500c3900 0x7f9b501ee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 >> 172.21.15.32:0/3552518418 conn(0x7f9b500726d0 msgr2=0x7f9b50153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 shutdown_connections 2024-01-19T04:17:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.192+0000 7f9b56200640 1 -- 172.21.15.32:0/3552518418 wait complete. 2024-01-19T04:17:45.217 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2024-01-19T04:17:45.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 Processor -- start 2024-01-19T04:17:45.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 -- start start 2024-01-19T04:17:45.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f427c0c42b0 0x7f427c0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c0c5740 0x7f427c0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f427c06beb0 0x7f427c154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c150f90 con 0x7f427c0c42b0 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0c1660 con 0x7f427c06beb0 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4281000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c0c90 con 0x7f427c0c5740 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f427c0c42b0 0x7f427c0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f427c0c42b0 0x7f427c0c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38112/0 (socket says 172.21.15.32:38112) 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 -- 172.21.15.32:0/3807557673 learned_addr learned my addr 172.21.15.32:0/3807557673 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279400640 1 --2- 172.21.15.32:0/3807557673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c0c5740 0x7f427c0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f427a800640 1 --2- 172.21.15.32:0/3807557673 >> v2:172.21.15.67:3300/0 conn(0x7f427c06beb0 0x7f427c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 -- 172.21.15.32:0/3807557673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c0c5740 msgr2=0x7f427c0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 --2- 172.21.15.32:0/3807557673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c0c5740 0x7f427c0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 -- 172.21.15.32:0/3807557673 >> v2:172.21.15.67:3300/0 conn(0x7f427c06beb0 msgr2=0x7f427c154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:45.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 --2- 172.21.15.32:0/3807557673 >> v2:172.21.15.67:3300/0 conn(0x7f427c06beb0 0x7f427c154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f4279e00640 1 -- 172.21.15.32:0/3807557673 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c150cb0 con 0x7f427c0c42b0 2024-01-19T04:17:45.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.356+0000 7f427a800640 1 --2- 172.21.15.32:0/3807557673 >> v2:172.21.15.67:3300/0 conn(0x7f427c06beb0 0x7f427c154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:45.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.360+0000 7f4279e00640 1 --2- 172.21.15.32:0/3807557673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c0c4690 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f427c0a77e0 tx=0x7f426c01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9bb58b86ea861d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:45.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.360+0000 7f4278a00640 1 -- 172.21.15.32:0/3807557673 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0ab600 con 0x7f427c0c42b0 2024-01-19T04:17:45.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.360+0000 7f4278a00640 1 -- 172.21.15.32:0/3807557673 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c0a7050 con 0x7f427c0c42b0 2024-01-19T04:17:45.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.360+0000 7f4278a00640 1 -- 172.21.15.32:0/3807557673 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0ab980 con 0x7f427c0c42b0 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.360+0000 7f4281000640 1 -- 172.21.15.32:0/3807557673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 msgr2=0x7f427c0c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.360+0000 7f4281000640 1 --2- 172.21.15.32:0/3807557673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c0c4690 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f427c0a77e0 tx=0x7f426c01c180 comp rx=0 tx=0).stop 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- 172.21.15.32:0/3807557673 shutdown_connections 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 --2- 172.21.15.32:0/3807557673 >> v2:172.21.15.67:3300/0 conn(0x7f427c06beb0 0x7f427c154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 --2- 172.21.15.32:0/3807557673 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c0c5740 0x7f427c0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 --2- 172.21.15.32:0/3807557673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c0c4690 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- 172.21.15.32:0/3807557673 >> 172.21.15.32:0/3807557673 conn(0x7f427c0c5b20 msgr2=0x7f427c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- 172.21.15.32:0/3807557673 shutdown_connections 2024-01-19T04:17:45.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- 172.21.15.32:0/3807557673 wait complete. 2024-01-19T04:17:45.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 Processor -- start 2024-01-19T04:17:45.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- start start 2024-01-19T04:17:45.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c06beb0 0x7f427c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0c5740 0x7f427c14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0a8e30 con 0x7f427c0c42b0 2024-01-19T04:17:45.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0a9ef0 con 0x7f427c0c5740 2024-01-19T04:17:45.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4281000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1edd80 con 0x7f427c06beb0 2024-01-19T04:17:45.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c14ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38114/0 (socket says 172.21.15.32:38114) 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 -- 172.21.15.32:0/4185995675 learned_addr learned my addr 172.21.15.32:0/4185995675 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279e00640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c06beb0 0x7f427c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f427a800640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0c5740 0x7f427c14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 -- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c06beb0 msgr2=0x7f427c0a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c06beb0 0x7f427c0a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 -- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0c5740 msgr2=0x7f427c14b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0c5740 0x7f427c14b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 -- 172.21.15.32:0/4185995675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0094d0 con 0x7f427c0c42b0 2024-01-19T04:17:45.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.364+0000 7f4279400640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c14ae80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f426400e9e0 tx=0x7f426400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:45.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4272000640 1 -- 172.21.15.32:0/4185995675 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640096b0 con 0x7f427c0c42b0 2024-01-19T04:17:45.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4272000640 1 -- 172.21.15.32:0/4185995675 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400c9d0 con 0x7f427c0c42b0 2024-01-19T04:17:45.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0a8ac0 con 0x7f427c0c42b0 2024-01-19T04:17:45.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4272000640 1 -- 172.21.15.32:0/4185995675 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400cd60 con 0x7f427c0c42b0 2024-01-19T04:17:45.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0a9af0 con 0x7f427c0c42b0 2024-01-19T04:17:45.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c1edfa0 con 0x7f427c0c42b0 2024-01-19T04:17:45.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4272000640 1 -- 172.21.15.32:0/4185995675 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4264013470 con 0x7f427c0c42b0 2024-01-19T04:17:45.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4272000640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4254066530 0x7f42540689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4272000640 1 -- 172.21.15.32:0/4185995675 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4264083c70 con 0x7f427c0c42b0 2024-01-19T04:17:45.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.368+0000 7f4279e00640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4254066530 0x7f42540689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.372+0000 7f4279e00640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4254066530 0x7f42540689f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f426c0ad000 tx=0x7f426c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:45.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.372+0000 7f4272000640 1 -- 172.21.15.32:0/4185995675 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f42640513a0 con 0x7f427c0c42b0 2024-01-19T04:17:45.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.588+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f427c0749f0 con 0x7f427c0c42b0 2024-01-19T04:17:45.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4272000640 1 -- 172.21.15.32:0/4185995675 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7f42640549c0 con 0x7f427c0c42b0 2024-01-19T04:17:45.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4254066530 msgr2=0x7f42540689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4254066530 0x7f42540689f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f426c0ad000 tx=0x7f426c0a6000 comp rx=0 tx=0).stop 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 msgr2=0x7f427c14ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c14ae80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f426400e9e0 tx=0x7f426400eea0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 shutdown_connections 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4254066530 0x7f42540689f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427c0c5740 0x7f427c14b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f427c0c42b0 0x7f427c14ae80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 --2- 172.21.15.32:0/4185995675 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f427c06beb0 0x7f427c0a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 >> 172.21.15.32:0/4185995675 conn(0x7f427c0c5b20 msgr2=0x7f427c0beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 shutdown_connections 2024-01-19T04:17:45.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.592+0000 7f4281000640 1 -- 172.21.15.32:0/4185995675 wait complete. 2024-01-19T04:17:45.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:45.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.752+0000 7fd735c00640 1 Processor -- start 2024-01-19T04:17:45.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.752+0000 7fd735c00640 1 -- start start 2024-01-19T04:17:45.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd735c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd730151de0 0x7fd7300c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd735c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd730154c70 0x7fd730155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd735c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7301547e0 con 0x7fd7300a7200 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd735c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7301521c0 con 0x7fd730154c70 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd735c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd730155640 con 0x7fd730151de0 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd730154c70 0x7fd730155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd730154c70 0x7fd730155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38122/0 (socket says 172.21.15.32:38122) 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 -- 172.21.15.32:0/2559320214 learned_addr learned my addr 172.21.15.32:0/2559320214 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72ea00640 1 --2- 172.21.15.32:0/2559320214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd730151de0 0x7fd7300c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 -- 172.21.15.32:0/2559320214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd730151de0 msgr2=0x7fd7300c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 --2- 172.21.15.32:0/2559320214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd730151de0 0x7fd7300c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 -- 172.21.15.32:0/2559320214 >> v1:172.21.15.67:6789/0 conn(0x7fd7300a7200 legacy=0x7fd7300c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 -- 172.21.15.32:0/2559320214 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300c1db0 con 0x7fd730154c70 2024-01-19T04:17:45.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.756+0000 7fd72f400640 1 --2- 172.21.15.32:0/2559320214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730154c70 0x7fd730155100 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd728009e50 tx=0x7fd72801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fe1903ae4151da server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:45.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd72d600640 1 -- 172.21.15.32:0/2559320214 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7280a5720 con 0x7fd730154c70 2024-01-19T04:17:45.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd72d600640 1 -- 172.21.15.32:0/2559320214 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7280a5880 con 0x7fd730154c70 2024-01-19T04:17:45.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd72d600640 1 -- 172.21.15.32:0/2559320214 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7280a5c10 con 0x7fd730154c70 2024-01-19T04:17:45.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- 172.21.15.32:0/2559320214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730154c70 msgr2=0x7fd730155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 --2- 172.21.15.32:0/2559320214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730154c70 0x7fd730155100 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd728009e50 tx=0x7fd72801c950 comp rx=0 tx=0).stop 2024-01-19T04:17:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- 172.21.15.32:0/2559320214 shutdown_connections 2024-01-19T04:17:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 --2- 172.21.15.32:0/2559320214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730154c70 0x7fd730155100 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 --2- 172.21.15.32:0/2559320214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd730151de0 0x7fd7300c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- 172.21.15.32:0/2559320214 >> 172.21.15.32:0/2559320214 conn(0x7fd7300726d0 msgr2=0x7fd7300663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- 172.21.15.32:0/2559320214 shutdown_connections 2024-01-19T04:17:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- 172.21.15.32:0/2559320214 wait complete. 2024-01-19T04:17:45.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 Processor -- start 2024-01-19T04:17:45.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- start start 2024-01-19T04:17:45.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7300a7200 0x7fd7300c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730151de0 0x7fd7301f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd730154c70 0x7fd7301f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300aa9e0 con 0x7fd730151de0 2024-01-19T04:17:45.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7301ee2f0 con 0x7fd730154c70 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.760+0000 7fd735c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300a8060 con 0x7fd7300a7200 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730151de0 0x7fd7301f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7300a7200 0x7fd7300c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730151de0 0x7fd7301f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38130/0 (socket says 172.21.15.32:38130) 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72e000640 1 -- 172.21.15.32:0/1359175533 learned_addr learned my addr 172.21.15.32:0/1359175533 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7300a7200 0x7fd7300c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:48626/0 (socket says 172.21.15.32:48626) 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72f400640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd730154c70 0x7fd7301f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 -- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd730154c70 msgr2=0x7fd7301f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd730154c70 0x7fd7301f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 -- 172.21.15.32:0/1359175533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730151de0 msgr2=0x7fd7301f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730151de0 0x7fd7301f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 -- 172.21.15.32:0/1359175533 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728009b30 con 0x7fd7300a7200 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72e000640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730151de0 0x7fd7301f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:45.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd72ea00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7300a7200 0x7fd7300c7110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd72000d5f0 tx=0x7fd72000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:45.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd726a00640 1 -- 172.21.15.32:0/1359175533 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7200125f0 con 0x7fd7300a7200 2024-01-19T04:17:45.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd726a00640 1 -- 172.21.15.32:0/1359175533 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720012750 con 0x7fd7300a7200 2024-01-19T04:17:45.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd726a00640 1 -- 172.21.15.32:0/1359175533 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720012ae0 con 0x7fd7300a7200 2024-01-19T04:17:45.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7300a77e0 con 0x7fd7300a7200 2024-01-19T04:17:45.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7300a7aa0 con 0x7fd7300a7200 2024-01-19T04:17:45.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7300749f0 con 0x7fd7300a7200 2024-01-19T04:17:45.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.764+0000 7fd726a00640 1 -- 172.21.15.32:0/1359175533 <== mon.2 v2:172.21.15.67:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd720012c40 con 0x7fd7300a7200 2024-01-19T04:17:45.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.768+0000 7fd726a00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd708066500 0x7fd7080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:45.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.768+0000 7fd726a00640 1 -- 172.21.15.32:0/1359175533 <== mon.2 v2:172.21.15.67:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd720083fb0 con 0x7fd7300a7200 2024-01-19T04:17:45.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.768+0000 7fd72e000640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd708066500 0x7fd7080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:45.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.768+0000 7fd72e000640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd708066500 0x7fd7080689c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd7300a92b0 tx=0x7fd718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:45.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.772+0000 7fd726a00640 1 -- 172.21.15.32:0/1359175533 <== mon.2 v2:172.21.15.67:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd7200515b0 con 0x7fd7300a7200 2024-01-19T04:17:45.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7300c4390 con 0x7fd7300a7200 2024-01-19T04:17:45.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd726a00640 1 -- 172.21.15.32:0/1359175533 <== mon.2 v2:172.21.15.67:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+12763 (secure 0 0 0) 0x7fd720054bd0 con 0x7fd7300a7200 2024-01-19T04:17:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:45.935 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":67,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:44.794416+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:45.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd708066500 msgr2=0x7fd7080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd708066500 0x7fd7080689c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd7300a92b0 tx=0x7fd718009040 comp rx=0 tx=0).stop 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7300a7200 msgr2=0x7fd7300c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7300a7200 0x7fd7300c7110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd72000d5f0 tx=0x7fd72000dab0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 shutdown_connections 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd708066500 0x7fd7080689c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd730154c70 0x7fd7301f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd730151de0 0x7fd7301f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 --2- 172.21.15.32:0/1359175533 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd7300a7200 0x7fd7300c7110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 >> 172.21.15.32:0/1359175533 conn(0x7fd7300726d0 msgr2=0x7fd730151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.932+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 shutdown_connections 2024-01-19T04:17:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:45.936+0000 7fd735c00640 1 -- 172.21.15.32:0/1359175533 wait complete. 2024-01-19T04:17:45.957 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:45.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:46.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.096+0000 7fcdbc000640 1 Processor -- start 2024-01-19T04:17:46.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.096+0000 7fcdbc000640 1 -- start start 2024-01-19T04:17:46.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdbc000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb406fdb0 0x7fcdb40701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdbc000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcdb40c27f0 0x7fcdb40c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdbc000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb40a7660 con 0x7fcdb40c7260 2024-01-19T04:17:46.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdbc000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb406ecd0 con 0x7fcdb40c27f0 2024-01-19T04:17:46.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdbc000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4070710 con 0x7fcdb406fdb0 2024-01-19T04:17:46.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdb9600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcdb40c7260 0x7fcdb4152f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51204/0 (socket says 172.21.15.32:51204) 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdb9600640 1 -- 172.21.15.32:0/1465371639 learned_addr learned my addr 172.21.15.32:0/1465371639 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdba000640 1 --2- 172.21.15.32:0/1465371639 >> v2:172.21.15.32:3300/0 conn(0x7fcdb40c27f0 0x7fcdb40c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdb8c00640 1 --2- 172.21.15.32:0/1465371639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb406fdb0 0x7fcdb40701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdb3e00640 1 -- 172.21.15.32:0/1465371639 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842130087 0 0) 0x7fcdb40a7660 con 0x7fcdb40c7260 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdb3e00640 1 -- 172.21.15.32:0/1465371639 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd94003530 con 0x7fcdb40c7260 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdba000640 1 -- 172.21.15.32:0/1465371639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb406fdb0 msgr2=0x7fcdb40701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdba000640 1 --2- 172.21.15.32:0/1465371639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb406fdb0 0x7fcdb40701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdba000640 1 -- 172.21.15.32:0/1465371639 >> v1:172.21.15.32:6789/0 conn(0x7fcdb40c7260 legacy=0x7fcdb4152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.100+0000 7fcdba000640 1 -- 172.21.15.32:0/1465371639 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40c4200 con 0x7fcdb40c27f0 2024-01-19T04:17:46.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdba000640 1 --2- 172.21.15.32:0/1465371639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb40c27f0 0x7fcdb40c2c50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009dc0 tx=0x7fcdac01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745e0517bfca808c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdb3e00640 1 -- 172.21.15.32:0/1465371639 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0a59c0 con 0x7fcdb40c27f0 2024-01-19T04:17:46.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdb3e00640 1 -- 172.21.15.32:0/1465371639 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac0a5b20 con 0x7fcdb40c27f0 2024-01-19T04:17:46.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdb3e00640 1 -- 172.21.15.32:0/1465371639 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0ad440 con 0x7fcdb40c27f0 2024-01-19T04:17:46.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 -- 172.21.15.32:0/1465371639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb40c27f0 msgr2=0x7fcdb40c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 --2- 172.21.15.32:0/1465371639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb40c27f0 0x7fcdb40c2c50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009dc0 tx=0x7fcdac01c900 comp rx=0 tx=0).stop 2024-01-19T04:17:46.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 -- 172.21.15.32:0/1465371639 shutdown_connections 2024-01-19T04:17:46.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 --2- 172.21.15.32:0/1465371639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb40c27f0 0x7fcdb40c2c50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 --2- 172.21.15.32:0/1465371639 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb406fdb0 0x7fcdb40701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 -- 172.21.15.32:0/1465371639 >> 172.21.15.32:0/1465371639 conn(0x7fcdb40c7d00 msgr2=0x7fcdb40c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:46.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 -- 172.21.15.32:0/1465371639 shutdown_connections 2024-01-19T04:17:46.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 -- 172.21.15.32:0/1465371639 wait complete. 2024-01-19T04:17:46.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 Processor -- start 2024-01-19T04:17:46.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.104+0000 7fcdbc000640 1 -- start start 2024-01-19T04:17:46.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb406fdb0 0x7fcdb41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb40c27f0 0x7fcdb4155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb40c7260 0x7fcdb4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40c64c0 con 0x7fcdb406fdb0 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4155690 con 0x7fcdb40c27f0 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb41539b0 con 0x7fcdb40c7260 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb406fdb0 0x7fcdb41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb406fdb0 0x7fcdb41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38144/0 (socket says 172.21.15.32:38144) 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 -- 172.21.15.32:0/3434233796 learned_addr learned my addr 172.21.15.32:0/3434233796 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb8c00640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb40c27f0 0x7fcdb4155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdba000640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb40c7260 0x7fcdb4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 -- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb40c7260 msgr2=0x7fcdb4156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb40c7260 0x7fcdb4156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 -- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb40c27f0 msgr2=0x7fcdb4155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb40c27f0 0x7fcdb4155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 -- 172.21.15.32:0/3434233796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac009a70 con 0x7fcdb406fdb0 2024-01-19T04:17:46.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb8c00640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb40c27f0 0x7fcdb4155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb9600640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb406fdb0 0x7fcdb41505f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c480 tx=0x7fcda400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb1600640 1 -- 172.21.15.32:0/3434233796 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4005cf0 con 0x7fcdb406fdb0 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb1600640 1 -- 172.21.15.32:0/3434233796 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda4005e50 con 0x7fcdb406fdb0 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb4153c20 con 0x7fcdb406fdb0 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb1600640 1 -- 172.21.15.32:0/3434233796 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4007290 con 0x7fcdb406fdb0 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb414ef60 con 0x7fcdb406fdb0 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb40749f0 con 0x7fcdb406fdb0 2024-01-19T04:17:46.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.108+0000 7fcdb1600640 1 -- 172.21.15.32:0/3434233796 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcda40073f0 con 0x7fcdb406fdb0 2024-01-19T04:17:46.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.112+0000 7fcdb1600640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd8c066500 0x7fcd8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.112+0000 7fcdb1600640 1 -- 172.21.15.32:0/3434233796 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcda4083190 con 0x7fcdb406fdb0 2024-01-19T04:17:46.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.112+0000 7fcdb8c00640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd8c066500 0x7fcd8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.112+0000 7fcdb8c00640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd8c066500 0x7fcd8c0689c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcdb41edf90 tx=0x7fcd9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.116+0000 7fcdb1600640 1 -- 172.21.15.32:0/3434233796 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcda4050770 con 0x7fcdb406fdb0 2024-01-19T04:17:46.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.276+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdb4072cf0 con 0x7fcdb406fdb0 2024-01-19T04:17:46.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.276+0000 7fcdb1600640 1 -- 172.21.15.32:0/3434233796 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcda40170a0 con 0x7fcdb406fdb0 2024-01-19T04:17:46.282 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd8c066500 msgr2=0x7fcd8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd8c066500 0x7fcd8c0689c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcdb41edf90 tx=0x7fcd9c008040 comp rx=0 tx=0).stop 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb406fdb0 msgr2=0x7fcdb41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb406fdb0 0x7fcdb41505f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c480 tx=0x7fcda400c940 comp rx=0 tx=0).stop 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 shutdown_connections 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcd8c066500 0x7fcd8c0689c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcdb40c7260 0x7fcdb4156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb40c27f0 0x7fcdb4155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 --2- 172.21.15.32:0/3434233796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcdb406fdb0 0x7fcdb41505f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 >> 172.21.15.32:0/3434233796 conn(0x7fcdb40c7d00 msgr2=0x7fcdb4152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 shutdown_connections 2024-01-19T04:17:46.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.280+0000 7fcdbc000640 1 -- 172.21.15.32:0/3434233796 wait complete. 2024-01-19T04:17:46.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:17:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.440+0000 7fd3efc00640 1 Processor -- start 2024-01-19T04:17:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.440+0000 7fd3efc00640 1 -- start start 2024-01-19T04:17:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.440+0000 7fd3efc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3e8151f10 0x7fd3e81588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.440+0000 7fd3efc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd3e806f550 0x7fd3e80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.440+0000 7fd3efc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e8072d40 con 0x7fd3e81546b0 2024-01-19T04:17:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.440+0000 7fd3efc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e80c3450 con 0x7fd3e806f550 2024-01-19T04:17:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.440+0000 7fd3efc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8072a60 con 0x7fd3e8151f10 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3edc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd3e81546b0 0x7fd3e806bbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51214/0 (socket says 172.21.15.32:51214) 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3edc00640 1 -- 172.21.15.32:0/3225424166 learned_addr learned my addr 172.21.15.32:0/3225424166 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7e00640 1 --2- 172.21.15.32:0/3225424166 >> v2:172.21.15.32:3300/0 conn(0x7fd3e806f550 0x7fd3e80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3ed200640 1 --2- 172.21.15.32:0/3225424166 >> v2:172.21.15.67:3300/0 conn(0x7fd3e8151f10 0x7fd3e81588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7400640 1 -- 172.21.15.32:0/3225424166 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066997198 0 0) 0x7fd3e8072d40 con 0x7fd3e81546b0 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7400640 1 -- 172.21.15.32:0/3225424166 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c8003530 con 0x7fd3e81546b0 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7e00640 1 -- 172.21.15.32:0/3225424166 >> v2:172.21.15.67:3300/0 conn(0x7fd3e8151f10 msgr2=0x7fd3e81588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7e00640 1 --2- 172.21.15.32:0/3225424166 >> v2:172.21.15.67:3300/0 conn(0x7fd3e8151f10 0x7fd3e81588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7e00640 1 -- 172.21.15.32:0/3225424166 >> v1:172.21.15.32:6789/0 conn(0x7fd3e81546b0 legacy=0x7fd3e806bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7e00640 1 -- 172.21.15.32:0/3225424166 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8157dd0 con 0x7fd3e806f550 2024-01-19T04:17:46.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3ed200640 1 --2- 172.21.15.32:0/3225424166 >> v2:172.21.15.67:3300/0 conn(0x7fd3e8151f10 0x7fd3e81588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:46.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.444+0000 7fd3e7e00640 1 --2- 172.21.15.32:0/3225424166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e806f550 0x7fd3e80720f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd3e806b6b0 tx=0x7fd3d001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b897ded592f074c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3e7400640 1 -- 172.21.15.32:0/3225424166 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00ab600 con 0x7fd3e806f550 2024-01-19T04:17:46.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3e7400640 1 -- 172.21.15.32:0/3225424166 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d00a7050 con 0x7fd3e806f550 2024-01-19T04:17:46.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3e7400640 1 -- 172.21.15.32:0/3225424166 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00ab980 con 0x7fd3e806f550 2024-01-19T04:17:46.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- 172.21.15.32:0/3225424166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e806f550 msgr2=0x7fd3e80720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3225424166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e806f550 0x7fd3e80720f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd3e806b6b0 tx=0x7fd3d001c310 comp rx=0 tx=0).stop 2024-01-19T04:17:46.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- 172.21.15.32:0/3225424166 shutdown_connections 2024-01-19T04:17:46.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3225424166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e806f550 0x7fd3e80720f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3225424166 >> v2:172.21.15.67:3300/0 conn(0x7fd3e8151f10 0x7fd3e81588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- 172.21.15.32:0/3225424166 >> 172.21.15.32:0/3225424166 conn(0x7fd3e80c7040 msgr2=0x7fd3e80c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:46.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- 172.21.15.32:0/3225424166 shutdown_connections 2024-01-19T04:17:46.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- 172.21.15.32:0/3225424166 wait complete. 2024-01-19T04:17:46.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 Processor -- start 2024-01-19T04:17:46.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- start start 2024-01-19T04:17:46.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e806f550 0x7fd3e814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3e8151f10 0x7fd3e806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e81546b0 0x7fd3e806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e806df80 con 0x7fd3e81546b0 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e806e260 con 0x7fd3e806f550 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3efc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e806e540 con 0x7fd3e8151f10 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.448+0000 7fd3edc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e81546b0 0x7fd3e806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e81546b0 0x7fd3e806d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38150/0 (socket says 172.21.15.32:38150) 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 -- 172.21.15.32:0/3409348962 learned_addr learned my addr 172.21.15.32:0/3409348962 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3ed200640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e806f550 0x7fd3e814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3e7e00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3e8151f10 0x7fd3e806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 -- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3e8151f10 msgr2=0x7fd3e806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3e8151f10 0x7fd3e806cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 -- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e806f550 msgr2=0x7fd3e814f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e806f550 0x7fd3e814f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 -- 172.21.15.32:0/3409348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009420 con 0x7fd3e81546b0 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3e7e00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3e8151f10 0x7fd3e806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3edc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e81546b0 0x7fd3e806d450 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000caa0 tx=0x7fd3e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3e4c00640 1 -- 172.21.15.32:0/3409348962 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000ac00 con 0x7fd3e81546b0 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3e4c00640 1 -- 172.21.15.32:0/3409348962 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e000ad60 con 0x7fd3e81546b0 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3e4c00640 1 -- 172.21.15.32:0/3409348962 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0012620 con 0x7fd3e81546b0 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e806e820 con 0x7fd3e81546b0 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e815f1f0 con 0x7fd3e81546b0 2024-01-19T04:17:46.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e806cc30 con 0x7fd3e81546b0 2024-01-19T04:17:46.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.452+0000 7fd3e4c00640 1 -- 172.21.15.32:0/3409348962 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd3e0007070 con 0x7fd3e81546b0 2024-01-19T04:17:46.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.456+0000 7fd3e4c00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd3c0066500 0x7fd3c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.456+0000 7fd3e4c00640 1 -- 172.21.15.32:0/3409348962 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3e0083aa0 con 0x7fd3e81546b0 2024-01-19T04:17:46.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.456+0000 7fd3ed200640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd3c0066500 0x7fd3c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.456+0000 7fd3ed200640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd3c0066500 0x7fd3c00689c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009950 tx=0x7fd3d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.460+0000 7fd3e4c00640 1 -- 172.21.15.32:0/3409348962 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd3e806cc30 con 0x7fd3e81546b0 2024-01-19T04:17:46.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd3e806cc30 con 0x7fd3e81546b0 2024-01-19T04:17:46.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3e4c00640 1 -- 172.21.15.32:0/3409348962 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd3e806cc30 con 0x7fd3e81546b0 2024-01-19T04:17:46.623 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:46.623 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-01-19T04:17:46.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:17:46.623 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-01-19T04:17:46.623 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-01-19T04:17:46.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:17:46.623 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-01-19T04:17:46.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd3c0066500 msgr2=0x7fd3c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd3c0066500 0x7fd3c00689c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009950 tx=0x7fd3d8008040 comp rx=0 tx=0).stop 2024-01-19T04:17:46.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e81546b0 msgr2=0x7fd3e806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e81546b0 0x7fd3e806d450 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000caa0 tx=0x7fd3e000cf60 comp rx=0 tx=0).stop 2024-01-19T04:17:46.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 shutdown_connections 2024-01-19T04:17:46.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd3c0066500 0x7fd3c00689c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3e81546b0 0x7fd3e806d450 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd3e8151f10 0x7fd3e806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 --2- 172.21.15.32:0/3409348962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e806f550 0x7fd3e814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 >> 172.21.15.32:0/3409348962 conn(0x7fd3e80c7040 msgr2=0x7fd3e80bc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:46.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 shutdown_connections 2024-01-19T04:17:46.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.620+0000 7fd3efc00640 1 -- 172.21.15.32:0/3409348962 wait complete. 2024-01-19T04:17:46.645 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-19T04:17:46.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-19T04:17:46.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b4e400640 1 Processor -- start 2024-01-19T04:17:46.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b4e400640 1 -- start start 2024-01-19T04:17:46.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b4e400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2b48148eb0 0x7f2b480ac930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b4e400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48152520 con 0x7f2b48153250 2024-01-19T04:17:46.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b4e400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48152dc0 con 0x7f2b480c2950 2024-01-19T04:17:46.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b4e400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480acf10 con 0x7f2b48148eb0 2024-01-19T04:17:46.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b46a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2b48153250 0x7f2b4806eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51230/0 (socket says 172.21.15.32:51230) 2024-01-19T04:17:46.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b46a00640 1 -- 172.21.15.32:0/2274763993 learned_addr learned my addr 172.21.15.32:0/2274763993 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b47400640 1 --2- 172.21.15.32:0/2274763993 >> v2:172.21.15.67:3300/0 conn(0x7f2b48148eb0 0x7f2b480ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081689534 0 0) 0x7f2b48152520 con 0x7f2b48153250 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.788+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b28003530 con 0x7f2b48153250 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353764656 0 0) 0x7f2b28003530 con 0x7f2b48153250 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 >> v2:172.21.15.67:3300/0 conn(0x7f2b48148eb0 msgr2=0x7f2b480ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 --2- 172.21.15.32:0/2274763993 >> v2:172.21.15.67:3300/0 conn(0x7f2b48148eb0 0x7f2b480ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 >> v1:172.21.15.67:6789/0 conn(0x7f2b480c2950 legacy=0x7f2b480c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48152770 con 0x7f2b48153250 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f2b30001680 con 0x7f2b48153250 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 >> v1:172.21.15.32:6789/0 conn(0x7f2b48153250 legacy=0x7f2b4806eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b280039f0 0x7f2b28003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b28005190 0x7f2b2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480acf10 con 0x7f2b280047d0 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800c0c0 con 0x7f2b280039f0 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800c280 con 0x7f2b28005190 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46a00640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b47400640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b280039f0 0x7f2b28003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b4ce00640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b28005190 0x7f2b2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b4ce00640 1 -- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b280039f0 msgr2=0x7f2b28003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b4ce00640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b280039f0 0x7f2b28003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b4ce00640 1 -- 172.21.15.32:0/2274763993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b280047d0 msgr2=0x7f2b28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b4ce00640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b4ce00640 1 -- 172.21.15.32:0/2274763993 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28003530 con 0x7f2b28005190 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b47400640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b280039f0 0x7f2b28003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b46a00640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:46.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.792+0000 7f2b4ce00640 1 -- 172.21.15.32:0/2274763993 reap_dead start 2024-01-19T04:17:46.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4ce00640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b28005190 0x7f2b2800b990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b40001e70 tx=0x7f2b4001c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdedc8251429db5a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40003b80 con 0x7f2b28005190 2024-01-19T04:17:46.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40003d20 con 0x7f2b28005190 2024-01-19T04:17:46.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b46000640 1 -- 172.21.15.32:0/2274763993 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40005310 con 0x7f2b28005190 2024-01-19T04:17:46.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 -- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b28005190 msgr2=0x7f2b2800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b28005190 0x7f2b2800b990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b40001e70 tx=0x7f2b4001c760 comp rx=0 tx=0).stop 2024-01-19T04:17:46.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 -- 172.21.15.32:0/2274763993 shutdown_connections 2024-01-19T04:17:46.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 --2- 172.21.15.32:0/2274763993 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b28005190 0x7f2b2800b990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 -- 172.21.15.32:0/2274763993 >> 172.21.15.32:0/2274763993 conn(0x7f2b480c77f0 msgr2=0x7f2b480c7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:46.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 -- 172.21.15.32:0/2274763993 shutdown_connections 2024-01-19T04:17:46.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 -- 172.21.15.32:0/2274763993 wait complete. 2024-01-19T04:17:46.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 Processor -- start 2024-01-19T04:17:46.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.796+0000 7f2b4e400640 1 -- start start 2024-01-19T04:17:46.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b28005190 0x7f2b48151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b480c1010 0x7f2b48143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b481df720 0x7f2b48144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48154610 con 0x7f2b481df720 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b481538a0 con 0x7f2b28005190 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48153b80 con 0x7f2b480c1010 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b28005190 0x7f2b48151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b481df720 0x7f2b48144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b46a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b480c1010 0x7f2b48143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b28005190 0x7f2b48151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:56162/0 (socket says 172.21.15.32:56162) 2024-01-19T04:17:46.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 -- 172.21.15.32:0/3300181500 learned_addr learned my addr 172.21.15.32:0/3300181500 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:46.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 -- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b480c1010 msgr2=0x7f2b48143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b480c1010 0x7f2b48143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 -- 172.21.15.32:0/3300181500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b481df720 msgr2=0x7f2b48144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b481df720 0x7f2b48144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 -- 172.21.15.32:0/3300181500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b481542a0 con 0x7f2b28005190 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4ce00640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b481df720 0x7f2b48144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b47400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b28005190 0x7f2b48151a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b38011ac0 tx=0x7f2b38011ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b3f400640 1 -- 172.21.15.32:0/3300181500 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3800fb50 con 0x7f2b28005190 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b3f400640 1 -- 172.21.15.32:0/3300181500 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3800fcb0 con 0x7f2b28005190 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b3f400640 1 -- 172.21.15.32:0/3300181500 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38004020 con 0x7f2b28005190 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b48144780 con 0x7f2b28005190 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b481dce10 con 0x7f2b28005190 2024-01-19T04:17:46.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.800+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b48154100 con 0x7f2b28005190 2024-01-19T04:17:46.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.804+0000 7f2b3f400640 1 -- 172.21.15.32:0/3300181500 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2b38004180 con 0x7f2b28005190 2024-01-19T04:17:46.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.804+0000 7f2b3f400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b20066530 0x7f2b200689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:46.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.804+0000 7f2b3f400640 1 -- 172.21.15.32:0/3300181500 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b380840b0 con 0x7f2b28005190 2024-01-19T04:17:46.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.804+0000 7f2b46a00640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b20066530 0x7f2b200689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:46.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.804+0000 7f2b46a00640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b20066530 0x7f2b200689f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2b481e7820 tx=0x7f2b30001480 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:46.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.808+0000 7f2b3f400640 1 -- 172.21.15.32:0/3300181500 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2b48154100 con 0x7f2b28005190 2024-01-19T04:17:46.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:46.972+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2b48154100 con 0x7f2b28005190 2024-01-19T04:17:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.796+0000 7f2b3f400640 1 -- 172.21.15.32:0/3300181500 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2b48154100 con 0x7f2b28005190 2024-01-19T04:17:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-01-19T04:17:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.804+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b20066530 msgr2=0x7f2b200689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.804+0000 7f2b4e400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b20066530 0x7f2b200689f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2b481e7820 tx=0x7f2b30001480 comp rx=0 tx=0).stop 2024-01-19T04:17:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.804+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b28005190 msgr2=0x7f2b48151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.804+0000 7f2b4e400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b28005190 0x7f2b48151a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b38011ac0 tx=0x7f2b38011ec0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 shutdown_connections 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2b20066530 0x7f2b200689f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b481df720 0x7f2b48144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2b480c1010 0x7f2b48143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 --2- 172.21.15.32:0/3300181500 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b28005190 0x7f2b48151a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 >> 172.21.15.32:0/3300181500 conn(0x7f2b480c77f0 msgr2=0x7f2b4806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 shutdown_connections 2024-01-19T04:17:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.808+0000 7f2b4e400640 1 -- 172.21.15.32:0/3300181500 wait complete. 2024-01-19T04:17:47.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:17:47.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01c800640 1 Processor -- start 2024-01-19T04:17:47.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01c800640 1 -- start start 2024-01-19T04:17:47.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01c800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0140c55d0 0x7fe01406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:47.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01c800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe0140705b0 0x7fe01415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:47.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01c800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140c0eb0 con 0x7fe01406cab0 2024-01-19T04:17:47.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01c800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01406e5c0 con 0x7fe0140705b0 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01c800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0140a5330 con 0x7fe0140c55d0 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01a800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe0140705b0 0x7fe01415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe019e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe01406cab0 0x7fe0140c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49466/0 (socket says 172.21.15.32:49466) 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe019e00640 1 -- 172.21.15.32:0/2569520976 learned_addr learned my addr 172.21.15.32:0/2569520976 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe019400640 1 --2- 172.21.15.32:0/2569520976 >> v2:172.21.15.67:3300/0 conn(0x7fe0140c55d0 0x7fe01406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01a800640 1 -- 172.21.15.32:0/2569520976 >> v2:172.21.15.67:3300/0 conn(0x7fe0140c55d0 msgr2=0x7fe01406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01a800640 1 --2- 172.21.15.32:0/2569520976 >> v2:172.21.15.67:3300/0 conn(0x7fe0140c55d0 0x7fe01406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01a800640 1 -- 172.21.15.32:0/2569520976 >> v1:172.21.15.32:6789/0 conn(0x7fe01406cab0 legacy=0x7fe0140c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe01a800640 1 -- 172.21.15.32:0/2569520976 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0141516f0 con 0x7fe0140705b0 2024-01-19T04:17:47.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.984+0000 7fe018a00640 1 -- 172.21.15.32:0/2569520976 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482481735 0 0) 0x7fe0140c0eb0 con 0x7fe01406cab0 2024-01-19T04:17:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01a800640 1 --2- 172.21.15.32:0/2569520976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0140705b0 0x7fe01415b4b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe01406e470 tx=0x7fe00c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bdb6fd317e6e09 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe018a00640 1 -- 172.21.15.32:0/2569520976 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0a59a0 con 0x7fe0140705b0 2024-01-19T04:17:47.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe018a00640 1 -- 172.21.15.32:0/2569520976 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0a5b00 con 0x7fe0140705b0 2024-01-19T04:17:47.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe018a00640 1 -- 172.21.15.32:0/2569520976 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0a5e90 con 0x7fe0140705b0 2024-01-19T04:17:47.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 -- 172.21.15.32:0/2569520976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0140705b0 msgr2=0x7fe01415b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:47.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 --2- 172.21.15.32:0/2569520976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0140705b0 0x7fe01415b4b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe01406e470 tx=0x7fe00c01c8e0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 -- 172.21.15.32:0/2569520976 shutdown_connections 2024-01-19T04:17:47.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 --2- 172.21.15.32:0/2569520976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0140705b0 0x7fe01415b4b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 --2- 172.21.15.32:0/2569520976 >> v2:172.21.15.67:3300/0 conn(0x7fe0140c55d0 0x7fe01406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 -- 172.21.15.32:0/2569520976 >> 172.21.15.32:0/2569520976 conn(0x7fe0140c25a0 msgr2=0x7fe0140c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:47.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 -- 172.21.15.32:0/2569520976 shutdown_connections 2024-01-19T04:17:47.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.988+0000 7fe01c800640 1 -- 172.21.15.32:0/2569520976 wait complete. 2024-01-19T04:17:47.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 Processor -- start 2024-01-19T04:17:47.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 -- start start 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe01406cab0 0x7fe014154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0140705b0 0x7fe014154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0140c55d0 0x7fe014147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0141eaed0 con 0x7fe01406cab0 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014152090 con 0x7fe0140c55d0 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140713a0 con 0x7fe0140705b0 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe01406cab0 0x7fe014154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe01406cab0 0x7fe014154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60578/0 (socket says 172.21.15.32:60578) 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 -- 172.21.15.32:0/1434817553 learned_addr learned my addr 172.21.15.32:0/1434817553 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:47.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019400640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0140705b0 0x7fe014154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:47.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01a800640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0140c55d0 0x7fe014147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:47.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 -- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0140705b0 msgr2=0x7fe014154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:47.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0140705b0 0x7fe014154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 -- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0140c55d0 msgr2=0x7fe014147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:47.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0140c55d0 0x7fe014147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:47.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 -- 172.21.15.32:0/1434817553 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c009a70 con 0x7fe01406cab0 2024-01-19T04:17:47.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe019e00640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe01406cab0 0x7fe014154110 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe0040011f0 tx=0x7fe00400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:47.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe012000640 1 -- 172.21.15.32:0/1434817553 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040074e0 con 0x7fe01406cab0 2024-01-19T04:17:47.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe012000640 1 -- 172.21.15.32:0/1434817553 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004007640 con 0x7fe01406cab0 2024-01-19T04:17:47.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe014154b90 con 0x7fe01406cab0 2024-01-19T04:17:47.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe012000640 1 -- 172.21.15.32:0/1434817553 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004004a10 con 0x7fe01406cab0 2024-01-19T04:17:47.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0141522a0 con 0x7fe01406cab0 2024-01-19T04:17:47.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.992+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0141ee440 con 0x7fe01406cab0 2024-01-19T04:17:47.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.996+0000 7fe012000640 1 -- 172.21.15.32:0/1434817553 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe00401c3b0 con 0x7fe01406cab0 2024-01-19T04:17:48.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.996+0000 7fe012000640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdfec066550 0x7fdfec068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:48.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.996+0000 7fe012000640 1 -- 172.21.15.32:0/1434817553 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe004083400 con 0x7fe01406cab0 2024-01-19T04:17:48.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.996+0000 7fe019400640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdfec066550 0x7fdfec068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:48.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:47.996+0000 7fe019400640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdfec066550 0x7fdfec068a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe0140c2e80 tx=0x7fdffc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:48.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.000+0000 7fe012000640 1 -- 172.21.15.32:0/1434817553 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe004050aa0 con 0x7fe01406cab0 2024-01-19T04:17:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.160+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe0140749f0 con 0x7fe01406cab0 2024-01-19T04:17:48.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.796+0000 7fe012000640 1 -- 172.21.15.32:0/1434817553 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe004018020 con 0x7fe01406cab0 2024-01-19T04:17:48.801 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-01-19T04:17:48.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdfec066550 msgr2=0x7fdfec068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:48.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdfec066550 0x7fdfec068a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe0140c2e80 tx=0x7fdffc008040 comp rx=0 tx=0).stop 2024-01-19T04:17:48.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe01406cab0 msgr2=0x7fe014154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:48.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe01406cab0 0x7fe014154110 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe0040011f0 tx=0x7fe00400c9b0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 shutdown_connections 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdfec066550 0x7fdfec068a10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0140c55d0 0x7fe014147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe0140705b0 0x7fe014154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 --2- 172.21.15.32:0/1434817553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe01406cab0 0x7fe014154110 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 >> 172.21.15.32:0/1434817553 conn(0x7fe0140c25a0 msgr2=0x7fe0140ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 shutdown_connections 2024-01-19T04:17:48.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.800+0000 7fe01c800640 1 -- 172.21.15.32:0/1434817553 wait complete. 2024-01-19T04:17:48.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-19T04:17:48.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6ef1600640 1 Processor -- start 2024-01-19T04:17:48.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6ef1600640 1 -- start start 2024-01-19T04:17:48.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6ef1600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec0723b0 0x7f6eec152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:48.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6ef1600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6eec0c2080 0x7f6eec155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:48.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6ef1600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec0a4ea0 con 0x7f6eec06d440 2024-01-19T04:17:48.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6ef1600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eec1524a0 con 0x7f6eec0c2080 2024-01-19T04:17:48.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6ef1600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec152a20 con 0x7f6eec0723b0 2024-01-19T04:17:48.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.988+0000 7f6eeb400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6eec06d440 0x7f6eec0c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49468/0 (socket says 172.21.15.32:49468) 2024-01-19T04:17:48.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eeb400640 1 -- 172.21.15.32:0/3784071911 learned_addr learned my addr 172.21.15.32:0/3784071911 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eeaa00640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec0723b0 0x7f6eec152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eea000640 1 --2- 172.21.15.32:0/3784071911 >> v2:172.21.15.67:3300/0 conn(0x7f6eec0c2080 0x7f6eec155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657434698 0 0) 0x7f6eec0a4ea0 con 0x7f6eec06d440 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ecc003530 con 0x7f6eec06d440 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533882772 0 0) 0x7f6ecc003530 con 0x7f6eec06d440 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec0723b0 msgr2=0x7f6eec152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec0723b0 0x7f6eec152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 >> v2:172.21.15.67:3300/0 conn(0x7f6eec0c2080 msgr2=0x7f6eec155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 --2- 172.21.15.32:0/3784071911 >> v2:172.21.15.67:3300/0 conn(0x7f6eec0c2080 0x7f6eec155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec1533f0 con 0x7f6eec06d440 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f6ee4001a00 con 0x7f6eec06d440 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 >> v1:172.21.15.32:6789/0 conn(0x7f6eec06d440 legacy=0x7f6eec0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:48.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ecc003980 0x7f6ecc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6ecc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ecc005190 0x7f6ecc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1524a0 con 0x7f6ecc0047d0 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec152a20 con 0x7f6ecc005190 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc00bfb0 con 0x7f6ecc003980 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eeaa00640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec0723b0 0x7f6eec152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eea000640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6ecc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eeb400640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ecc005190 0x7f6ecc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eeaa00640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ecc003980 0x7f6ecc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eea000640 1 -- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ecc003980 msgr2=0x7f6ecc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eea000640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6ecc003980 0x7f6ecc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eea000640 1 -- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ecc005190 msgr2=0x7f6ecc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eea000640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ecc005190 0x7f6ecc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eea000640 1 -- 172.21.15.32:0/3784071911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc003530 con 0x7f6ecc0047d0 2024-01-19T04:17:48.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.992+0000 7f6eeb400640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ecc005190 0x7f6ecc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:48.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6eea000640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6ecc004c50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009ab0 tx=0x7f6ed401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca255efd8ea1a2e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:48.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40a5640 con 0x7f6ecc0047d0 2024-01-19T04:17:48.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40a57a0 con 0x7f6ecc0047d0 2024-01-19T04:17:48.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ee9600640 1 -- 172.21.15.32:0/3784071911 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40a5b50 con 0x7f6ecc0047d0 2024-01-19T04:17:48.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 -- 172.21.15.32:0/3784071911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 msgr2=0x7f6ecc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:48.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 --2- 172.21.15.32:0/3784071911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6ecc004c50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009ab0 tx=0x7f6ed401ca70 comp rx=0 tx=0).stop 2024-01-19T04:17:48.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6eeb400640 1 -- 172.21.15.32:0/3784071911 reap_dead start 2024-01-19T04:17:48.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 -- 172.21.15.32:0/3784071911 shutdown_connections 2024-01-19T04:17:48.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 -- 172.21.15.32:0/3784071911 >> 172.21.15.32:0/3784071911 conn(0x7f6eec0c25a0 msgr2=0x7f6eec0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:48.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 -- 172.21.15.32:0/3784071911 shutdown_connections 2024-01-19T04:17:48.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 -- 172.21.15.32:0/3784071911 wait complete. 2024-01-19T04:17:49.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 Processor -- start 2024-01-19T04:17:49.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:48.996+0000 7f6ef1600640 1 -- start start 2024-01-19T04:17:49.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6eec1f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:49.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6eec14b8c0 0x7f6eec151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:49.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec14d620 0x7f6eec14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:49.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec150ee0 con 0x7f6ecc0047d0 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec159180 con 0x7f6eec14b8c0 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1f0fa0 con 0x7f6eec14d620 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6eec1f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6eec1f0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60582/0 (socket says 172.21.15.32:60582) 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 -- 172.21.15.32:0/2691901107 learned_addr learned my addr 172.21.15.32:0/2691901107 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeb400640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec14d620 0x7f6eec14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eea000640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6eec14b8c0 0x7f6eec151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 -- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec14d620 msgr2=0x7f6eec14a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec14d620 0x7f6eec14a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 -- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6eec14b8c0 msgr2=0x7f6eec151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6eec14b8c0 0x7f6eec151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 -- 172.21.15.32:0/2691901107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec155ae0 con 0x7f6ecc0047d0 2024-01-19T04:17:49.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6eeaa00640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6eec1f0a60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0115f0 tx=0x7f6edc0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:49.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ee2a00640 1 -- 172.21.15.32:0/2691901107 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc015870 con 0x7f6ecc0047d0 2024-01-19T04:17:49.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ee2a00640 1 -- 172.21.15.32:0/2691901107 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc0159d0 con 0x7f6ecc0047d0 2024-01-19T04:17:49.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ee2a00640 1 -- 172.21.15.32:0/2691901107 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc015d80 con 0x7f6ecc0047d0 2024-01-19T04:17:49.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec14b670 con 0x7f6ecc0047d0 2024-01-19T04:17:49.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec14b390 con 0x7f6ecc0047d0 2024-01-19T04:17:49.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.000+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec0749f0 con 0x7f6ecc0047d0 2024-01-19T04:17:49.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.004+0000 7f6ee2a00640 1 -- 172.21.15.32:0/2691901107 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6edc01d400 con 0x7f6ecc0047d0 2024-01-19T04:17:49.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.004+0000 7f6ee2a00640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ec4066530 0x7f6ec40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:49.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.004+0000 7f6ee2a00640 1 -- 172.21.15.32:0/2691901107 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6edc084140 con 0x7f6ecc0047d0 2024-01-19T04:17:49.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.004+0000 7f6eea000640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ec4066530 0x7f6ec40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:49.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.004+0000 7f6eea000640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ec4066530 0x7f6ec40689f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40af000 tx=0x7f6ed40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:49.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.008+0000 7f6ee2a00640 1 -- 172.21.15.32:0/2691901107 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6edc051430 con 0x7f6ecc0047d0 2024-01-19T04:17:49.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.200+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6eec0a74c0 con 0x7f6ecc0047d0 2024-01-19T04:17:49.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.828+0000 7f6ee2a00640 1 -- 172.21.15.32:0/2691901107 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6edc054a50 con 0x7f6ecc0047d0 2024-01-19T04:17:49.834 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 12 and data pool 13 2024-01-19T04:17:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.832+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ec4066530 msgr2=0x7f6ec40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.832+0000 7f6ef1600640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ec4066530 0x7f6ec40689f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40af000 tx=0x7f6ed40046d0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.832+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 msgr2=0x7f6eec1f0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:49.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.832+0000 7f6ef1600640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6eec1f0a60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0115f0 tx=0x7f6edc0119f0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 shutdown_connections 2024-01-19T04:17:49.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ec4066530 0x7f6ec40689f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6eec14d620 0x7f6eec14a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6eec14b8c0 0x7f6eec151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 --2- 172.21.15.32:0/2691901107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ecc0047d0 0x7f6eec1f0a60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:49.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 >> 172.21.15.32:0/2691901107 conn(0x7f6eec0c25a0 msgr2=0x7f6eec0c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:49.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 shutdown_connections 2024-01-19T04:17:49.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:49.836+0000 7f6ef1600640 1 -- 172.21.15.32:0/2691901107 wait complete. 2024-01-19T04:17:49.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:50.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.024+0000 7fb402200640 1 Processor -- start 2024-01-19T04:17:50.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.024+0000 7fb402200640 1 -- start start 2024-01-19T04:17:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb402200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3fc151de0 0x7fb3fc0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb402200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc0a7200 0x7fb3fc0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb402200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc1547e0 con 0x7fb3fc0c41f0 2024-01-19T04:17:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb402200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc1521c0 con 0x7fb3fc151de0 2024-01-19T04:17:50.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb402200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0c1db0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3fbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb3fc0c41f0 0x7fb3fc154c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49482/0 (socket says 172.21.15.32:49482) 2024-01-19T04:17:50.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3fbe00640 1 -- 172.21.15.32:0/1103468728 learned_addr learned my addr 172.21.15.32:0/1103468728 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:50.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3faa00640 1 --2- 172.21.15.32:0/1103468728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc0a7200 0x7fb3fc0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3fb400640 1 --2- 172.21.15.32:0/1103468728 >> v2:172.21.15.67:3300/0 conn(0x7fb3fc151de0 0x7fb3fc0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3fa000640 1 -- 172.21.15.32:0/1103468728 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449487504 0 0) 0x7fb3fc1547e0 con 0x7fb3fc0c41f0 2024-01-19T04:17:50.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3fa000640 1 -- 172.21.15.32:0/1103468728 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc003530 con 0x7fb3fc0c41f0 2024-01-19T04:17:50.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3faa00640 1 -- 172.21.15.32:0/1103468728 >> v2:172.21.15.67:3300/0 conn(0x7fb3fc151de0 msgr2=0x7fb3fc0c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:50.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3faa00640 1 --2- 172.21.15.32:0/1103468728 >> v2:172.21.15.67:3300/0 conn(0x7fb3fc151de0 0x7fb3fc0c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3faa00640 1 -- 172.21.15.32:0/1103468728 >> v1:172.21.15.32:6789/0 conn(0x7fb3fc0c41f0 legacy=0x7fb3fc154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3faa00640 1 -- 172.21.15.32:0/1103468728 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc06f820 con 0x7fb3fc0a7200 2024-01-19T04:17:50.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.028+0000 7fb3fb400640 1 --2- 172.21.15.32:0/1103468728 >> v2:172.21.15.67:3300/0 conn(0x7fb3fc151de0 0x7fb3fc0c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:50.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb3faa00640 1 --2- 172.21.15.32:0/1103468728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc0a7200 0x7fb3fc0c3cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40097c0 tx=0x7fb3e401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6fdcc4c0500663 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb3fa000640 1 -- 172.21.15.32:0/1103468728 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40ac620 con 0x7fb3fc0a7200 2024-01-19T04:17:50.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb3fa000640 1 -- 172.21.15.32:0/1103468728 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e40ac780 con 0x7fb3fc0a7200 2024-01-19T04:17:50.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb3fa000640 1 -- 172.21.15.32:0/1103468728 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40acaf0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 -- 172.21.15.32:0/1103468728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc0a7200 msgr2=0x7fb3fc0c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 --2- 172.21.15.32:0/1103468728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc0a7200 0x7fb3fc0c3cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40097c0 tx=0x7fb3e401c3c0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 -- 172.21.15.32:0/1103468728 shutdown_connections 2024-01-19T04:17:50.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 --2- 172.21.15.32:0/1103468728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc0a7200 0x7fb3fc0c3cb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 --2- 172.21.15.32:0/1103468728 >> v2:172.21.15.67:3300/0 conn(0x7fb3fc151de0 0x7fb3fc0c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 -- 172.21.15.32:0/1103468728 >> 172.21.15.32:0/1103468728 conn(0x7fb3fc0726d0 msgr2=0x7fb3fc0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:50.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 -- 172.21.15.32:0/1103468728 shutdown_connections 2024-01-19T04:17:50.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 -- 172.21.15.32:0/1103468728 wait complete. 2024-01-19T04:17:50.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 Processor -- start 2024-01-19T04:17:50.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.032+0000 7fb402200640 1 -- start start 2024-01-19T04:17:50.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3fc0a7200 0x7fb3fc06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3fc0c41f0 0x7fb3fc1f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc151de0 0x7fb3fc1f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0a8480 con 0x7fb3fc0a7200 2024-01-19T04:17:50.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0a7a10 con 0x7fb3fc0c41f0 2024-01-19T04:17:50.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc1571c0 con 0x7fb3fc151de0 2024-01-19T04:17:50.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3fc0a7200 0x7fb3fc06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3fc0a7200 0x7fb3fc06ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60590/0 (socket says 172.21.15.32:60590) 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 -- 172.21.15.32:0/4278593269 learned_addr learned my addr 172.21.15.32:0/4278593269 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fbe00640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc151de0 0x7fb3fc1f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3faa00640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3fc0c41f0 0x7fb3fc1f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 -- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc151de0 msgr2=0x7fb3fc1f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc151de0 0x7fb3fc1f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 -- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3fc0c41f0 msgr2=0x7fb3fc1f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3fc0c41f0 0x7fb3fc1f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 -- 172.21.15.32:0/4278593269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec009420 con 0x7fb3fc0a7200 2024-01-19T04:17:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3fb400640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3fc0a7200 0x7fb3fc06ca60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00ebe0 tx=0x7fb3ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3f3400640 1 -- 172.21.15.32:0/4278593269 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00eee0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3f3400640 1 -- 172.21.15.32:0/4278593269 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec00cc30 con 0x7fb3fc0a7200 2024-01-19T04:17:50.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb3f3400640 1 -- 172.21.15.32:0/4278593269 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec013470 con 0x7fb3fc0a7200 2024-01-19T04:17:50.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e4009420 con 0x7fb3fc0a7200 2024-01-19T04:17:50.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc0a7be0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.036+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3fc0749f0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.040+0000 7fb3f3400640 1 -- 172.21.15.32:0/4278593269 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb3ec0135d0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.040+0000 7fb3f3400640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3d4066500 0x7fb3d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.040+0000 7fb3f3400640 1 -- 172.21.15.32:0/4278593269 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3ec084150 con 0x7fb3fc0a7200 2024-01-19T04:17:50.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.040+0000 7fb3faa00640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3d4066500 0x7fb3d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.040+0000 7fb3faa00640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3d4066500 0x7fb3d40689c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ae000 tx=0x7fb3e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.044+0000 7fb3f3400640 1 -- 172.21.15.32:0/4278593269 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb3ec0514a0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.204+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3fc0c1650 con 0x7fb3fc0a7200 2024-01-19T04:17:50.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.204+0000 7fb3f3400640 1 -- 172.21.15.32:0/4278593269 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16478 (secure 0 0 0) 0x7fb3ec054ac0 con 0x7fb3fc0a7200 2024-01-19T04:17:50.209 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:50.209 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":70,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:49.203547+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:50.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3d4066500 msgr2=0x7fb3d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3d4066500 0x7fb3d40689c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ae000 tx=0x7fb3e4008040 comp rx=0 tx=0).stop 2024-01-19T04:17:50.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3fc0a7200 msgr2=0x7fb3fc06ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3fc0a7200 0x7fb3fc06ca60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00ebe0 tx=0x7fb3ec00c520 comp rx=0 tx=0).stop 2024-01-19T04:17:50.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 shutdown_connections 2024-01-19T04:17:50.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3d4066500 0x7fb3d40689c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3fc151de0 0x7fb3fc1f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3fc0c41f0 0x7fb3fc1f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 --2- 172.21.15.32:0/4278593269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3fc0a7200 0x7fb3fc06ca60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 >> 172.21.15.32:0/4278593269 conn(0x7fb3fc0726d0 msgr2=0x7fb3fc0acbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:50.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 shutdown_connections 2024-01-19T04:17:50.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.208+0000 7fb402200640 1 -- 172.21.15.32:0/4278593269 wait complete. 2024-01-19T04:17:50.232 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:50.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.368+0000 7f4858800640 1 Processor -- start 2024-01-19T04:17:50.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.368+0000 7f4858800640 1 -- start start 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4858800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f48501520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4858800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48500c1620 0x7f48500c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4858800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500c21c0 con 0x7f485014ee40 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4858800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4850071650 con 0x7f48500c1620 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4858800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4850151c10 con 0x7f48500c56d0 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f48501520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f48501520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:59256/0 (socket says 172.21.15.32:59256) 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 -- 172.21.15.32:0/3778776360 learned_addr learned my addr 172.21.15.32:0/3778776360 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4856800640 1 --2- 172.21.15.32:0/3778776360 >> v2:172.21.15.67:3300/0 conn(0x7f48500c1620 0x7f48500c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4854a00640 1 -- 172.21.15.32:0/3778776360 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237670883 0 0) 0x7f48500c21c0 con 0x7f485014ee40 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4854a00640 1 -- 172.21.15.32:0/3778776360 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4830003530 con 0x7f485014ee40 2024-01-19T04:17:50.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 -- 172.21.15.32:0/3778776360 >> v2:172.21.15.67:3300/0 conn(0x7f48500c1620 msgr2=0x7f48500c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:50.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 --2- 172.21.15.32:0/3778776360 >> v2:172.21.15.67:3300/0 conn(0x7f48500c1620 0x7f48500c1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 -- 172.21.15.32:0/3778776360 >> v1:172.21.15.67:6789/0 conn(0x7f485014ee40 legacy=0x7f4850070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 -- 172.21.15.32:0/3778776360 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500c66a0 con 0x7f48500c56d0 2024-01-19T04:17:50.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.372+0000 7f4855400640 1 --2- 172.21.15.32:0/3778776360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f48501520a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f483801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cd2fd0bcc7aa8b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4854a00640 1 -- 172.21.15.32:0/3778776360 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380ab680 con 0x7f48500c56d0 2024-01-19T04:17:50.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4854a00640 1 -- 172.21.15.32:0/3778776360 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48380ab7e0 con 0x7f48500c56d0 2024-01-19T04:17:50.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4854a00640 1 -- 172.21.15.32:0/3778776360 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380abb70 con 0x7f48500c56d0 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 -- 172.21.15.32:0/3778776360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 msgr2=0x7f48501520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 --2- 172.21.15.32:0/3778776360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f48501520a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f483801c480 comp rx=0 tx=0).stop 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 -- 172.21.15.32:0/3778776360 shutdown_connections 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 --2- 172.21.15.32:0/3778776360 >> v2:172.21.15.67:3300/0 conn(0x7f48500c1620 0x7f48500c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 --2- 172.21.15.32:0/3778776360 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f48501520a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 -- 172.21.15.32:0/3778776360 >> 172.21.15.32:0/3778776360 conn(0x7f48500c6ca0 msgr2=0x7f48500c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 -- 172.21.15.32:0/3778776360 shutdown_connections 2024-01-19T04:17:50.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 -- 172.21.15.32:0/3778776360 wait complete. 2024-01-19T04:17:50.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 Processor -- start 2024-01-19T04:17:50.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 -- start start 2024-01-19T04:17:50.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500c1620 0x7f48500be150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f485015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.376+0000 7f4858800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f485014ee40 0x7f485015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4858800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500b9510 con 0x7f48500c1620 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4858800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48500a6570 con 0x7f485014ee40 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4858800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48500a6850 con 0x7f48500c56d0 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500c1620 0x7f48500be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500c1620 0x7f48500be150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60596/0 (socket says 172.21.15.32:60596) 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 -- 172.21.15.32:0/2976931958 learned_addr learned my addr 172.21.15.32:0/2976931958 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855400640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f485015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4856800640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f485014ee40 0x7f485015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 -- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 msgr2=0x7f485015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f485015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 -- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f485014ee40 msgr2=0x7f485015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f485014ee40 0x7f485015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 -- 172.21.15.32:0/2976931958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380094d0 con 0x7f48500c1620 2024-01-19T04:17:50.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4855e00640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500c1620 0x7f48500be150 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f484000c490 tx=0x7f484000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f484e000640 1 -- 172.21.15.32:0/2976931958 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48400052d0 con 0x7f48500c1620 2024-01-19T04:17:50.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f484e000640 1 -- 172.21.15.32:0/2976931958 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4840005430 con 0x7f48500c1620 2024-01-19T04:17:50.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f484e000640 1 -- 172.21.15.32:0/2976931958 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840012870 con 0x7f48500c1620 2024-01-19T04:17:50.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48500a6b30 con 0x7f48500c1620 2024-01-19T04:17:50.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48500a7440 con 0x7f48500c1620 2024-01-19T04:17:50.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48500a7630 con 0x7f48500c1620 2024-01-19T04:17:50.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.380+0000 7f484e000640 1 -- 172.21.15.32:0/2976931958 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f48400129d0 con 0x7f48500c1620 2024-01-19T04:17:50.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.384+0000 7f484e000640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4828066500 0x7f48280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.384+0000 7f484e000640 1 -- 172.21.15.32:0/2976931958 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4840083840 con 0x7f48500c1620 2024-01-19T04:17:50.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.384+0000 7f4855400640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4828066500 0x7f48280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.384+0000 7f4855400640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4828066500 0x7f48280689c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f48380af000 tx=0x7f48380b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.388+0000 7f484e000640 1 -- 172.21.15.32:0/2976931958 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4840050c20 con 0x7f48500c1620 2024-01-19T04:17:50.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.544+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4850072b00 con 0x7f48500c1620 2024-01-19T04:17:50.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f484e000640 1 -- 172.21.15.32:0/2976931958 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16478 (secure 0 0 0) 0x7f4840054240 con 0x7f48500c1620 2024-01-19T04:17:50.551 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:50.551 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":70,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:49.203547+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:50.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4828066500 msgr2=0x7f48280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4828066500 0x7f48280689c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f48380af000 tx=0x7f48380b6040 comp rx=0 tx=0).stop 2024-01-19T04:17:50.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500c1620 msgr2=0x7f48500be150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500c1620 0x7f48500be150 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f484000c490 tx=0x7f484000c950 comp rx=0 tx=0).stop 2024-01-19T04:17:50.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 shutdown_connections 2024-01-19T04:17:50.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4828066500 0x7f48280689c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f485014ee40 0x7f485015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48500c56d0 0x7f485015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 --2- 172.21.15.32:0/2976931958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500c1620 0x7f48500be150 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 >> 172.21.15.32:0/2976931958 conn(0x7f48500c6ca0 msgr2=0x7f4850070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:50.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 shutdown_connections 2024-01-19T04:17:50.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.548+0000 7f4858800640 1 -- 172.21.15.32:0/2976931958 wait complete. 2024-01-19T04:17:50.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-19T04:17:50.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1669200640 1 Processor -- start 2024-01-19T04:17:50.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1669200640 1 -- start start 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1669200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16640c4360 0x7f166406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1669200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f166406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1669200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166406c6a0 con 0x7f1664151dc0 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1669200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16641521a0 con 0x7f16640c4360 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1669200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1664154cf0 con 0x7f1664070630 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1661400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16640c4360 0x7f166406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1661e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1664151dc0 0x7f16640c1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49494/0 (socket says 172.21.15.32:49494) 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1661e00640 1 -- 172.21.15.32:0/2658680520 learned_addr learned my addr 172.21.15.32:0/2658680520 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:50.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1662800640 1 --2- 172.21.15.32:0/2658680520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f166406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1661400640 1 -- 172.21.15.32:0/2658680520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 msgr2=0x7f166406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:50.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1661400640 1 --2- 172.21.15.32:0/2658680520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f166406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1661400640 1 -- 172.21.15.32:0/2658680520 >> v1:172.21.15.32:6789/0 conn(0x7f1664151dc0 legacy=0x7f16640c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1661400640 1 -- 172.21.15.32:0/2658680520 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664154fd0 con 0x7f16640c4360 2024-01-19T04:17:50.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1660a00640 1 -- 172.21.15.32:0/2658680520 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364636095 0 0) 0x7f166406c6a0 con 0x7f1664151dc0 2024-01-19T04:17:50.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.716+0000 7f1662800640 1 --2- 172.21.15.32:0/2658680520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f166406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:50.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1661400640 1 --2- 172.21.15.32:0/2658680520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166406cb30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f164c0097c0 tx=0x7f164c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf99b333a94b45c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1660a00640 1 -- 172.21.15.32:0/2658680520 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0ab650 con 0x7f16640c4360 2024-01-19T04:17:50.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1660a00640 1 -- 172.21.15.32:0/2658680520 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c0ab7b0 con 0x7f16640c4360 2024-01-19T04:17:50.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1660a00640 1 -- 172.21.15.32:0/2658680520 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0abb40 con 0x7f16640c4360 2024-01-19T04:17:50.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 -- 172.21.15.32:0/2658680520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 msgr2=0x7f166406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 --2- 172.21.15.32:0/2658680520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166406cb30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f164c0097c0 tx=0x7f164c01c450 comp rx=0 tx=0).stop 2024-01-19T04:17:50.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 -- 172.21.15.32:0/2658680520 shutdown_connections 2024-01-19T04:17:50.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 --2- 172.21.15.32:0/2658680520 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f166406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 --2- 172.21.15.32:0/2658680520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166406cb30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 -- 172.21.15.32:0/2658680520 >> 172.21.15.32:0/2658680520 conn(0x7f16640c7d00 msgr2=0x7f16640c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:50.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 -- 172.21.15.32:0/2658680520 shutdown_connections 2024-01-19T04:17:50.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.720+0000 7f1669200640 1 -- 172.21.15.32:0/2658680520 wait complete. 2024-01-19T04:17:50.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 Processor -- start 2024-01-19T04:17:50.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 -- start start 2024-01-19T04:17:50.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f1664150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1664151dc0 0x7f166406e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16640ad860 con 0x7f16640c4360 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16640adb40 con 0x7f1664151dc0 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166406f1a0 con 0x7f1664070630 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166414c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60616/0 (socket says 172.21.15.32:60616) 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 -- 172.21.15.32:0/1740408703 learned_addr learned my addr 172.21.15.32:0/1740408703 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661e00640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f1664150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1662800640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1664151dc0 0x7f166406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 -- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 msgr2=0x7f1664150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f1664150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 -- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1664151dc0 msgr2=0x7f166406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:50.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1664151dc0 0x7f166406e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:50.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 -- 172.21.15.32:0/1740408703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009420 con 0x7f16640c4360 2024-01-19T04:17:50.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1662800640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1664151dc0 0x7f166406e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1661400640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166414c0f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f164c0ad040 tx=0x7f164c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f165a000640 1 -- 172.21.15.32:0/1740408703 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0b5810 con 0x7f16640c4360 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f165a000640 1 -- 172.21.15.32:0/1740408703 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c0b5990 con 0x7f16640c4360 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166406f480 con 0x7f16640c4360 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f165a000640 1 -- 172.21.15.32:0/1740408703 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0b5d40 con 0x7f16640c4360 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166406f7f0 con 0x7f16640c4360 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.724+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166406b900 con 0x7f16640c4360 2024-01-19T04:17:50.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.728+0000 7f165a000640 1 -- 172.21.15.32:0/1740408703 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f164c0bf410 con 0x7f16640c4360 2024-01-19T04:17:50.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.728+0000 7f165a000640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f163c066500 0x7f163c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:50.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.728+0000 7f165a000640 1 -- 172.21.15.32:0/1740408703 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f164c11eea0 con 0x7f16640c4360 2024-01-19T04:17:50.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.728+0000 7f1661e00640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f163c066500 0x7f163c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:50.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.728+0000 7f1661e00640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f163c066500 0x7f163c0689c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1654000f70 tx=0x7f1654007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:50.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.732+0000 7f165a000640 1 -- 172.21.15.32:0/1740408703 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f164c0ec3a0 con 0x7f16640c4360 2024-01-19T04:17:50.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:50.932+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f16640749f0 con 0x7f16640c4360 2024-01-19T04:17:51.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.852+0000 7f165a000640 1 -- 172.21.15.32:0/1740408703 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f164c0ef9c0 con 0x7f16640c4360 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f163c066500 msgr2=0x7f163c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f163c066500 0x7f163c0689c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1654000f70 tx=0x7f1654007df0 comp rx=0 tx=0).stop 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 msgr2=0x7f166414c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166414c0f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f164c0ad040 tx=0x7f164c01ac90 comp rx=0 tx=0).stop 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 shutdown_connections 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f163c066500 0x7f163c0689c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1664151dc0 0x7f166406e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16640c4360 0x7f166414c0f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 --2- 172.21.15.32:0/1740408703 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1664070630 0x7f1664150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 >> 172.21.15.32:0/1740408703 conn(0x7f16640c7d00 msgr2=0x7f16640a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 shutdown_connections 2024-01-19T04:17:51.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:51.856+0000 7f1669200640 1 -- 172.21.15.32:0/1740408703 wait complete. 2024-01-19T04:17:51.882 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T04:17:51.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-19T04:17:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d2a00640 1 Processor -- start 2024-01-19T04:17:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d2a00640 1 -- start start 2024-01-19T04:17:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc0c2080 0x7fa6cc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d2a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa6cc06d440 0x7fa6cc0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d2a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0a4ea0 con 0x7fa6cc0723b0 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d2a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc1524a0 con 0x7fa6cc06d440 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d2a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc152a20 con 0x7fa6cc0c2080 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6cb400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc0c2080 0x7fa6cc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6cb400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc0c2080 0x7fa6cc155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:59300/0 (socket says 172.21.15.32:59300) 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6cb400640 1 -- 172.21.15.32:0/2689194706 learned_addr learned my addr 172.21.15.32:0/2689194706 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.028+0000 7fa6d0a00640 1 --2- 172.21.15.32:0/2689194706 >> v2:172.21.15.67:3300/0 conn(0x7fa6cc06d440 0x7fa6cc0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6cb400640 1 -- 172.21.15.32:0/2689194706 >> v2:172.21.15.67:3300/0 conn(0x7fa6cc06d440 msgr2=0x7fa6cc0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6cb400640 1 --2- 172.21.15.32:0/2689194706 >> v2:172.21.15.67:3300/0 conn(0x7fa6cc06d440 0x7fa6cc0c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6cb400640 1 -- 172.21.15.32:0/2689194706 >> v1:172.21.15.67:6789/0 conn(0x7fa6cc0723b0 legacy=0x7fa6cc152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:52.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6cb400640 1 -- 172.21.15.32:0/2689194706 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0c3430 con 0x7fa6cc0c2080 2024-01-19T04:17:52.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6cb400640 1 --2- 172.21.15.32:0/2689194706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc0c2080 0x7fa6cc155a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009870 tx=0x7fa6b401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e8ad8b9010b0a1c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:52.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6caa00640 1 -- 172.21.15.32:0/2689194706 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40ab600 con 0x7fa6cc0c2080 2024-01-19T04:17:52.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6caa00640 1 -- 172.21.15.32:0/2689194706 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b40a7050 con 0x7fa6cc0c2080 2024-01-19T04:17:52.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.032+0000 7fa6caa00640 1 -- 172.21.15.32:0/2689194706 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40ab980 con 0x7fa6cc0c2080 2024-01-19T04:17:52.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- 172.21.15.32:0/2689194706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc0c2080 msgr2=0x7fa6cc155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:52.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/2689194706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc0c2080 0x7fa6cc155a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009870 tx=0x7fa6b401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- 172.21.15.32:0/2689194706 shutdown_connections 2024-01-19T04:17:52.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/2689194706 >> v2:172.21.15.67:3300/0 conn(0x7fa6cc06d440 0x7fa6cc0c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/2689194706 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc0c2080 0x7fa6cc155a90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- 172.21.15.32:0/2689194706 >> 172.21.15.32:0/2689194706 conn(0x7fa6cc0c25a0 msgr2=0x7fa6cc0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:52.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- 172.21.15.32:0/2689194706 shutdown_connections 2024-01-19T04:17:52.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- 172.21.15.32:0/2689194706 wait complete. 2024-01-19T04:17:52.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 Processor -- start 2024-01-19T04:17:52.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- start start 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc06d440 0x7fa6cc1eb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0723b0 0x7fa6cc1eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6cc0c2080 0x7fa6cc0bed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc155b30 con 0x7fa6cc0723b0 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc1ee8f0 con 0x7fa6cc0c2080 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d2a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc1ebdb0 con 0x7fa6cc06d440 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0723b0 0x7fa6cc1eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0723b0 0x7fa6cc1eed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60622/0 (socket says 172.21.15.32:60622) 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 -- 172.21.15.32:0/1489995332 learned_addr learned my addr 172.21.15.32:0/1489995332 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cbe00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc06d440 0x7fa6cc1eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6d0a00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6cc0c2080 0x7fa6cc0bed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 -- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc06d440 msgr2=0x7fa6cc1eb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:52.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc06d440 0x7fa6cc1eb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 -- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6cc0c2080 msgr2=0x7fa6cc0bed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:52.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6cc0c2080 0x7fa6cc0bed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.036+0000 7fa6cb400640 1 -- 172.21.15.32:0/1489995332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40094d0 con 0x7fa6cc0723b0 2024-01-19T04:17:52.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6cb400640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0723b0 0x7fa6cc1eed80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40ae040 tx=0x7fa6b4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:52.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6c3e00640 1 -- 172.21.15.32:0/1489995332 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40b4420 con 0x7fa6cc0723b0 2024-01-19T04:17:52.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6c3e00640 1 -- 172.21.15.32:0/1489995332 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b40b4580 con 0x7fa6cc0723b0 2024-01-19T04:17:52.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc0a9040 con 0x7fa6cc0723b0 2024-01-19T04:17:52.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6c3e00640 1 -- 172.21.15.32:0/1489995332 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40b4930 con 0x7fa6cc0723b0 2024-01-19T04:17:52.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc155570 con 0x7fa6cc0723b0 2024-01-19T04:17:52.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc0749f0 con 0x7fa6cc0723b0 2024-01-19T04:17:52.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6c3e00640 1 -- 172.21.15.32:0/1489995332 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa6b40b2070 con 0x7fa6cc0723b0 2024-01-19T04:17:52.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6c3e00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6a4066500 0x7fa6a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:52.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.040+0000 7fa6c3e00640 1 -- 172.21.15.32:0/1489995332 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6b411d830 con 0x7fa6cc0723b0 2024-01-19T04:17:52.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.044+0000 7fa6cbe00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6a4066500 0x7fa6a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:52.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.044+0000 7fa6cbe00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6a4066500 0x7fa6a40689c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001770 tx=0x7fa6bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:52.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.048+0000 7fa6c3e00640 1 -- 172.21.15.32:0/1489995332 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa6b40eab70 con 0x7fa6cc0723b0 2024-01-19T04:17:52.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.244+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa6cc0a5860 con 0x7fa6cc0723b0 2024-01-19T04:17:52.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:17:52.578 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:17:52.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.856+0000 7fa6c3e00640 1 -- 172.21.15.32:0/1489995332 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6b40ee190 con 0x7fa6cc0723b0 2024-01-19T04:17:52.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6a4066500 msgr2=0x7fa6a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:52.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6a4066500 0x7fa6a40689c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc001770 tx=0x7fa6bc009040 comp rx=0 tx=0).stop 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0723b0 msgr2=0x7fa6cc1eed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0723b0 0x7fa6cc1eed80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40ae040 tx=0x7fa6b4019190 comp rx=0 tx=0).stop 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 shutdown_connections 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa6a4066500 0x7fa6a40689c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa6cc0c2080 0x7fa6cc0bed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0723b0 0x7fa6cc1eed80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 --2- 172.21.15.32:0/1489995332 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa6cc06d440 0x7fa6cc1eb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 >> 172.21.15.32:0/1489995332 conn(0x7fa6cc0c25a0 msgr2=0x7fa6cc06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 shutdown_connections 2024-01-19T04:17:52.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:52.860+0000 7fa6d2a00640 1 -- 172.21.15.32:0/1489995332 wait complete. 2024-01-19T04:17:52.888 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-19T04:17:52.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:53.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.028+0000 7f32adc00640 1 Processor -- start 2024-01-19T04:17:53.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32adc00640 1 -- start start 2024-01-19T04:17:53.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32adc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a80a7200 0x7f32a80c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32adc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32a80c41f0 0x7f32a8154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32adc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a81547e0 con 0x7f32a8151de0 2024-01-19T04:17:53.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32adc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a81521c0 con 0x7f32a80c41f0 2024-01-19T04:17:53.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32adc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a806f820 con 0x7f32a80a7200 2024-01-19T04:17:53.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a80a7200 0x7f32a80c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32a80c41f0 0x7f32a8154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a6a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32a8151de0 0x7f32a80c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:44432/0 (socket says 172.21.15.32:44432) 2024-01-19T04:17:53.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a6a00640 1 -- 172.21.15.32:0/1842980758 learned_addr learned my addr 172.21.15.32:0/1842980758 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:53.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a7400640 1 -- 172.21.15.32:0/1842980758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a80a7200 msgr2=0x7f32a80c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:53.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a7400640 1 --2- 172.21.15.32:0/1842980758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a80a7200 0x7f32a80c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a7400640 1 -- 172.21.15.32:0/1842980758 >> v1:172.21.15.67:6789/0 conn(0x7f32a8151de0 legacy=0x7f32a80c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.032+0000 7f32a7400640 1 -- 172.21.15.32:0/1842980758 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a806fb00 con 0x7f32a80c41f0 2024-01-19T04:17:53.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32a7400640 1 --2- 172.21.15.32:0/1842980758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80c41f0 0x7f32a8154c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d90 tx=0x7f32a001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57407b38b7b32993 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32a5600640 1 -- 172.21.15.32:0/1842980758 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00a5860 con 0x7f32a80c41f0 2024-01-19T04:17:53.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32a5600640 1 -- 172.21.15.32:0/1842980758 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a00a59c0 con 0x7f32a80c41f0 2024-01-19T04:17:53.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32a5600640 1 -- 172.21.15.32:0/1842980758 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00a5d50 con 0x7f32a80c41f0 2024-01-19T04:17:53.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 -- 172.21.15.32:0/1842980758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80c41f0 msgr2=0x7f32a8154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 --2- 172.21.15.32:0/1842980758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80c41f0 0x7f32a8154c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d90 tx=0x7f32a001c890 comp rx=0 tx=0).stop 2024-01-19T04:17:53.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 -- 172.21.15.32:0/1842980758 shutdown_connections 2024-01-19T04:17:53.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 --2- 172.21.15.32:0/1842980758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80c41f0 0x7f32a8154c70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 --2- 172.21.15.32:0/1842980758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a80a7200 0x7f32a80c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 -- 172.21.15.32:0/1842980758 >> 172.21.15.32:0/1842980758 conn(0x7f32a80726d0 msgr2=0x7f32a80663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:53.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 -- 172.21.15.32:0/1842980758 shutdown_connections 2024-01-19T04:17:53.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.036+0000 7f32adc00640 1 -- 172.21.15.32:0/1842980758 wait complete. 2024-01-19T04:17:53.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 Processor -- start 2024-01-19T04:17:53.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 -- start start 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80a7200 0x7f32a814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32a80c41f0 0x7f32a80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a8151de0 0x7f32a80c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a81561b0 con 0x7f32a80c41f0 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80c6820 con 0x7f32a80a7200 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80c7780 con 0x7f32a8151de0 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32a80c41f0 0x7f32a80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32a80c41f0 0x7f32a80c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60626/0 (socket says 172.21.15.32:60626) 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 -- 172.21.15.32:0/2821954427 learned_addr learned my addr 172.21.15.32:0/2821954427 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6a00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80a7200 0x7f32a814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a7400640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a8151de0 0x7f32a80c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 -- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a8151de0 msgr2=0x7f32a80c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a8151de0 0x7f32a80c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 -- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80a7200 msgr2=0x7f32a814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80a7200 0x7f32a814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 -- 172.21.15.32:0/2821954427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0009a70 con 0x7f32a80c41f0 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32a6000640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32a80c41f0 0x7f32a80c6d00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f329000e930 tx=0x7f329000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f329ea00640 1 -- 172.21.15.32:0/2821954427 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3290009690 con 0x7f32a80c41f0 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f329ea00640 1 -- 172.21.15.32:0/2821954427 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329000ca00 con 0x7f32a80c41f0 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a8151090 con 0x7f32a80c41f0 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f329ea00640 1 -- 172.21.15.32:0/2821954427 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329000cd70 con 0x7f32a80c41f0 2024-01-19T04:17:53.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.040+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a80c8010 con 0x7f32a80c41f0 2024-01-19T04:17:53.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.044+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a80c7b90 con 0x7f32a80c41f0 2024-01-19T04:17:53.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.044+0000 7f329ea00640 1 -- 172.21.15.32:0/2821954427 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3290013470 con 0x7f32a80c41f0 2024-01-19T04:17:53.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.044+0000 7f329ea00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3280066500 0x7f32800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.044+0000 7f329ea00640 1 -- 172.21.15.32:0/2821954427 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3290083fc0 con 0x7f32a80c41f0 2024-01-19T04:17:53.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.044+0000 7f32a6a00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3280066500 0x7f32800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.044+0000 7f32a6a00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3280066500 0x7f32800689c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3298000f70 tx=0x7f3298007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.048+0000 7f329ea00640 1 -- 172.21.15.32:0/2821954427 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f32900b54d0 con 0x7f32a80c41f0 2024-01-19T04:17:53.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.240+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32a8073fd0 con 0x7f32a80c41f0 2024-01-19T04:17:53.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f329ea00640 1 -- 172.21.15.32:0/2821954427 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f32a80c7b90 con 0x7f32a80c41f0 2024-01-19T04:17:53.249 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:53.249 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6564,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:49.203878+0000","modified":"2024-01-19T04:17:52.248717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/208534071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":208534071},{"type":"v1","addr":"172.21.15.67:6837","nonce":208534071}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-01-19T04:17:53.249 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 47 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3280066500 msgr2=0x7f32800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3280066500 0x7f32800689c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3298000f70 tx=0x7f3298007e90 comp rx=0 tx=0).stop 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32a80c41f0 msgr2=0x7f32a80c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32a80c41f0 0x7f32a80c6d00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f329000e930 tx=0x7f329000edf0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 shutdown_connections 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3280066500 0x7f32800689c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f32a8151de0 0x7f32a80c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32a80c41f0 0x7f32a80c6d00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 --2- 172.21.15.32:0/2821954427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32a80a7200 0x7f32a814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 >> 172.21.15.32:0/2821954427 conn(0x7f32a80726d0 msgr2=0x7f32a806d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 shutdown_connections 2024-01-19T04:17:53.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.244+0000 7f32adc00640 1 -- 172.21.15.32:0/2821954427 wait complete. 2024-01-19T04:17:53.269 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:53.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.404+0000 7f85da600640 1 Processor -- start 2024-01-19T04:17:53.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.404+0000 7f85da600640 1 -- start start 2024-01-19T04:17:53.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85da600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f85d4151f10 0x7f85d41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85da600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 0x7f85d4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85da600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d4072d40 con 0x7f85d406f550 2024-01-19T04:17:53.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85da600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d40c3450 con 0x7f85d4151f10 2024-01-19T04:17:53.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85da600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4072800 con 0x7f85d41546b0 2024-01-19T04:17:53.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f85d406f550 0x7f85d40720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49496/0 (socket says 172.21.15.32:49496) 2024-01-19T04:17:53.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2a00640 1 -- 172.21.15.32:0/2710226180 learned_addr learned my addr 172.21.15.32:0/2710226180 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:53.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289899746 0 0) 0x7f85d4072d40 con 0x7f85d406f550 2024-01-19T04:17:53.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b4003530 con 0x7f85d406f550 2024-01-19T04:17:53.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3e00640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 0x7f85d4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3400640 1 --2- 172.21.15.32:0/2710226180 >> v2:172.21.15.67:3300/0 conn(0x7f85d4151f10 0x7f85d41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061509041 0 0) 0x7f85b4003530 con 0x7f85d406f550 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 msgr2=0x7f85d4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 0x7f85d4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 >> v2:172.21.15.67:3300/0 conn(0x7f85d4151f10 msgr2=0x7f85d41588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 --2- 172.21.15.32:0/2710226180 >> v2:172.21.15.67:3300/0 conn(0x7f85d4151f10 0x7f85d41588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d4072a60 con 0x7f85d406f550 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f85bc001680 con 0x7f85d406f550 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 >> v1:172.21.15.32:6789/0 conn(0x7f85d406f550 legacy=0x7f85d40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 0x7f85b4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b4003f00 0x7f85b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85b4004d10 0x7f85b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4072800 con 0x7f85b4004d10 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b400b9f0 con 0x7f85b4003f00 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b400bbb0 con 0x7f85d41546b0 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3e00640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85b4004d10 0x7f85b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3400640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 0x7f85b4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d2a00640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b4003f00 0x7f85b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3e00640 1 -- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 msgr2=0x7f85b4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:53.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3e00640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85d41546b0 0x7f85b4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3e00640 1 -- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b4003f00 msgr2=0x7f85b40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:53.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3e00640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85b4003f00 0x7f85b40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.408+0000 7f85d3e00640 1 -- 172.21.15.32:0/2710226180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4003530 con 0x7f85b4004d10 2024-01-19T04:17:53.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85d3e00640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85b4004d10 0x7f85b4005190 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009fc0 tx=0x7f85cc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e027c9d327d60ef server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0a5930 con 0x7f85b4004d10 2024-01-19T04:17:53.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00f040 con 0x7f85b4004d10 2024-01-19T04:17:53.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85d2000640 1 -- 172.21.15.32:0/2710226180 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0a5cd0 con 0x7f85b4004d10 2024-01-19T04:17:53.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85da600640 1 -- 172.21.15.32:0/2710226180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85b4004d10 msgr2=0x7f85b4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85da600640 1 --2- 172.21.15.32:0/2710226180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85b4004d10 0x7f85b4005190 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009fc0 tx=0x7f85cc01cc30 comp rx=0 tx=0).stop 2024-01-19T04:17:53.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85d3e00640 1 -- 172.21.15.32:0/2710226180 reap_dead start 2024-01-19T04:17:53.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85da600640 1 -- 172.21.15.32:0/2710226180 shutdown_connections 2024-01-19T04:17:53.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85da600640 1 -- 172.21.15.32:0/2710226180 >> 172.21.15.32:0/2710226180 conn(0x7f85d40c7040 msgr2=0x7f85d40c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:53.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85da600640 1 -- 172.21.15.32:0/2710226180 shutdown_connections 2024-01-19T04:17:53.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.412+0000 7f85da600640 1 -- 172.21.15.32:0/2710226180 wait complete. 2024-01-19T04:17:53.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 Processor -- start 2024-01-19T04:17:53.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 -- start start 2024-01-19T04:17:53.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85b4004d10 0x7f85d40a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d40a83e0 0x7f85d4150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d4153800 0x7f85d4151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40be2a0 con 0x7f85d4153800 2024-01-19T04:17:53.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d406e5a0 con 0x7f85d40a83e0 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40c1150 con 0x7f85b4004d10 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d4153800 0x7f85d4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d4153800 0x7f85d4151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60634/0 (socket says 172.21.15.32:60634) 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 -- 172.21.15.32:0/3015627326 learned_addr learned my addr 172.21.15.32:0/3015627326 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3400640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85b4004d10 0x7f85d40a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d2a00640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d40a83e0 0x7f85d4150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 -- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85b4004d10 msgr2=0x7f85d40a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85b4004d10 0x7f85d40a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 -- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d40a83e0 msgr2=0x7f85d4150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d40a83e0 0x7f85d4150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 -- 172.21.15.32:0/3015627326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d406e840 con 0x7f85d4153800 2024-01-19T04:17:53.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85d3e00640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d4153800 0x7f85d4151370 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f85cc002240 tx=0x7f85cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85cb400640 1 -- 172.21.15.32:0/3015627326 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0039a0 con 0x7f85d4153800 2024-01-19T04:17:53.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85cb400640 1 -- 172.21.15.32:0/3015627326 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc003b00 con 0x7f85d4153800 2024-01-19T04:17:53.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85cb400640 1 -- 172.21.15.32:0/3015627326 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc003e70 con 0x7f85d4153800 2024-01-19T04:17:53.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d41f0780 con 0x7f85d4153800 2024-01-19T04:17:53.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.416+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d40c78a0 con 0x7f85d4153800 2024-01-19T04:17:53.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.420+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d4067340 con 0x7f85d4153800 2024-01-19T04:17:53.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.420+0000 7f85cb400640 1 -- 172.21.15.32:0/3015627326 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f85cc0b4040 con 0x7f85d4153800 2024-01-19T04:17:53.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.420+0000 7f85cb400640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f85ac066500 0x7f85ac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.420+0000 7f85cb400640 1 -- 172.21.15.32:0/3015627326 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85cc11d5c0 con 0x7f85d4153800 2024-01-19T04:17:53.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.420+0000 7f85d3400640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f85ac066500 0x7f85ac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.420+0000 7f85d3400640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f85ac066500 0x7f85ac0689c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009ba0 tx=0x7f85c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.424+0000 7f85cb400640 1 -- 172.21.15.32:0/3015627326 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f85cc0ea9a0 con 0x7f85d4153800 2024-01-19T04:17:53.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.584+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85d40749f0 con 0x7f85d4153800 2024-01-19T04:17:53.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.584+0000 7f85cb400640 1 -- 172.21.15.32:0/3015627326 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16465 (secure 0 0 0) 0x7f85cc0edfc0 con 0x7f85d4153800 2024-01-19T04:17:53.589 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":71,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:50.845175+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f85ac066500 msgr2=0x7f85ac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f85ac066500 0x7f85ac0689c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009ba0 tx=0x7f85c4008040 comp rx=0 tx=0).stop 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d4153800 msgr2=0x7f85d4151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d4153800 0x7f85d4151370 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f85cc002240 tx=0x7f85cc009750 comp rx=0 tx=0).stop 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 shutdown_connections 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f85ac066500 0x7f85ac0689c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d4153800 0x7f85d4151370 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d40a83e0 0x7f85d4150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 --2- 172.21.15.32:0/3015627326 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f85b4004d10 0x7f85d40a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 >> 172.21.15.32:0/3015627326 conn(0x7f85d40c7040 msgr2=0x7f85d40c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 shutdown_connections 2024-01-19T04:17:53.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.588+0000 7f85da600640 1 -- 172.21.15.32:0/3015627326 wait complete. 2024-01-19T04:17:53.610 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:17:53.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:17:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3cd400640 1 Processor -- start 2024-01-19T04:17:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3cd400640 1 -- start start 2024-01-19T04:17:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3cd400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3c80c6e20 0x7fb3c80c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3cd400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c81533a0 con 0x7fb3c80a6d30 2024-01-19T04:17:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3cd400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c8152800 con 0x7fb3c806fda0 2024-01-19T04:17:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3cd400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c8156380 con 0x7fb3c80c6e20 2024-01-19T04:17:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3c6800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3c80c6e20 0x7fb3c80c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3c5e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb3c80a6d30 0x7fb3c8152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49500/0 (socket says 172.21.15.32:49500) 2024-01-19T04:17:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3c5e00640 1 -- 172.21.15.32:0/3051382782 learned_addr learned my addr 172.21.15.32:0/3051382782 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3c6800640 1 -- 172.21.15.32:0/3051382782 >> v1:172.21.15.67:6789/0 conn(0x7fb3c806fda0 legacy=0x7fb3c815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3c6800640 1 -- 172.21.15.32:0/3051382782 >> v1:172.21.15.32:6789/0 conn(0x7fb3c80a6d30 legacy=0x7fb3c8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3c5400640 1 -- 172.21.15.32:0/3051382782 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048270254 0 0) 0x7fb3b0001120 con 0x7fb3c80a6d30 2024-01-19T04:17:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.748+0000 7fb3c6800640 1 -- 172.21.15.32:0/3051382782 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8156590 con 0x7fb3c80c6e20 2024-01-19T04:17:53.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3c6800640 1 --2- 172.21.15.32:0/3051382782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c80c6e20 0x7fb3c80c7200 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80097c0 tx=0x7fb3b801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b7adfeef241e71 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3c5400640 1 -- 172.21.15.32:0/3051382782 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80ab600 con 0x7fb3c80c6e20 2024-01-19T04:17:53.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3c5400640 1 -- 172.21.15.32:0/3051382782 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b80a7050 con 0x7fb3c80c6e20 2024-01-19T04:17:53.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3c5400640 1 -- 172.21.15.32:0/3051382782 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80ab980 con 0x7fb3c80c6e20 2024-01-19T04:17:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3cd400640 1 -- 172.21.15.32:0/3051382782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c80c6e20 msgr2=0x7fb3c80c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3cd400640 1 --2- 172.21.15.32:0/3051382782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c80c6e20 0x7fb3c80c7200 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80097c0 tx=0x7fb3b801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3cd400640 1 -- 172.21.15.32:0/3051382782 shutdown_connections 2024-01-19T04:17:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3cd400640 1 --2- 172.21.15.32:0/3051382782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c80c6e20 0x7fb3c80c7200 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3cd400640 1 -- 172.21.15.32:0/3051382782 >> 172.21.15.32:0/3051382782 conn(0x7fb3c80a9870 msgr2=0x7fb3c80a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3cd400640 1 -- 172.21.15.32:0/3051382782 shutdown_connections 2024-01-19T04:17:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.752+0000 7fb3cd400640 1 -- 172.21.15.32:0/3051382782 wait complete. 2024-01-19T04:17:53.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 Processor -- start 2024-01-19T04:17:53.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 -- start start 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c806fda0 0x7fb3c80bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3c80a6d30 0x7fb3c81ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3c80c6e20 0x7fb3c81ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c8154460 con 0x7fb3c806fda0 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c8154ff0 con 0x7fb3c80a6d30 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c81552d0 con 0x7fb3c80c6e20 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c806fda0 0x7fb3c80bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c806fda0 0x7fb3c80bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60650/0 (socket says 172.21.15.32:60650) 2024-01-19T04:17:53.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 -- 172.21.15.32:0/2337845748 learned_addr learned my addr 172.21.15.32:0/2337845748 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c7200640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3c80c6e20 0x7fb3c81ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c5e00640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3c80a6d30 0x7fb3c81ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 -- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3c80c6e20 msgr2=0x7fb3c81ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3c80c6e20 0x7fb3c81ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 -- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3c80a6d30 msgr2=0x7fb3c81ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3c80a6d30 0x7fb3c81ed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 -- 172.21.15.32:0/2337845748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8009420 con 0x7fb3c806fda0 2024-01-19T04:17:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3c6800640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c806fda0 0x7fb3c80bdd90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8019000 tx=0x7fb3b801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3bea00640 1 -- 172.21.15.32:0/2337845748 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80b7450 con 0x7fb3c806fda0 2024-01-19T04:17:53.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3bea00640 1 -- 172.21.15.32:0/2337845748 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b80b75b0 con 0x7fb3c806fda0 2024-01-19T04:17:53.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3bea00640 1 -- 172.21.15.32:0/2337845748 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80b7960 con 0x7fb3c806fda0 2024-01-19T04:17:53.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.756+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c81555b0 con 0x7fb3c806fda0 2024-01-19T04:17:53.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.760+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c80be670 con 0x7fb3c806fda0 2024-01-19T04:17:53.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.760+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c81ece10 con 0x7fb3c806fda0 2024-01-19T04:17:53.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.760+0000 7fb3bea00640 1 -- 172.21.15.32:0/2337845748 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb3b80b7ac0 con 0x7fb3c806fda0 2024-01-19T04:17:53.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.760+0000 7fb3bea00640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3a0066500 0x7fb3a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:53.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.760+0000 7fb3bea00640 1 -- 172.21.15.32:0/2337845748 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3b811e6c0 con 0x7fb3c806fda0 2024-01-19T04:17:53.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.760+0000 7fb3c5e00640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3a0066500 0x7fb3a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:53.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.760+0000 7fb3c5e00640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3a0066500 0x7fb3a00689c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0007fd0 tx=0x7fb3b0007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:53.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.764+0000 7fb3bea00640 1 -- 172.21.15.32:0/2337845748 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb3b80ebb10 con 0x7fb3c806fda0 2024-01-19T04:17:53.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.920+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3c80c7a40 con 0x7fb3a0066500 2024-01-19T04:17:53.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.932+0000 7fb3bea00640 1 -- 172.21.15.32:0/2337845748 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286171 (secure 0 0 0) 0x7fb3c80c7a40 con 0x7fb3a0066500 2024-01-19T04:17:53.937 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:53.939 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:17:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.932+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3a0066500 msgr2=0x7fb3a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.932+0000 7fb3cd400640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3a0066500 0x7fb3a00689c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0007fd0 tx=0x7fb3b0007a20 comp rx=0 tx=0).stop 2024-01-19T04:17:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.932+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c806fda0 msgr2=0x7fb3c80bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.932+0000 7fb3cd400640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c806fda0 0x7fb3c80bdd90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8019000 tx=0x7fb3b801ac30 comp rx=0 tx=0).stop 2024-01-19T04:17:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 shutdown_connections 2024-01-19T04:17:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb3a0066500 0x7fb3a00689c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3c80c6e20 0x7fb3c81ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3c80a6d30 0x7fb3c81ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 --2- 172.21.15.32:0/2337845748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3c806fda0 0x7fb3c80bdd90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 >> 172.21.15.32:0/2337845748 conn(0x7fb3c80a9870 msgr2=0x7fb3c80c3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 shutdown_connections 2024-01-19T04:17:53.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:53.936+0000 7fb3cd400640 1 -- 172.21.15.32:0/2337845748 wait complete. 2024-01-19T04:17:53.957 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-01-19T04:17:52.071671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252928,"kb_used_data":7640,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721792,"statfs":{"total":773094113280,"available":772835115008,"internally_reserved":0,"allocated":7823360,"data_stored":4036300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.271703"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870579+0000","last_change":"2024-01-19T04:17:49.865069+0000","last_active":"2024-01-19T04:17:49.870579+0000","last_peered":"2024-01-19T04:17:49.870579+0000","last_clean":"2024-01-19T04:17:49.870579+0000","last_became_active":"2024-01-19T04:17:49.864458+0000","last_became_peered":"2024-01-19T04:17:49.864458+0000","last_unstale":"2024-01-19T04:17:49.870579+0000","last_undegraded":"2024-01-19T04:17:49.870579+0000","last_fullsized":"2024-01-19T04:17:49.870579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:26:02.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.813808+0000","last_change":"2024-01-19T04:17:48.813808+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.813808+0000","last_undegraded":"2024-01-19T04:17:48.813808+0000","last_fullsized":"2024-01-19T04:17:48.813808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876743+0000","last_change":"2024-01-19T04:17:49.871656+0000","last_active":"2024-01-19T04:17:49.876743+0000","last_peered":"2024-01-19T04:17:49.876743+0000","last_clean":"2024-01-19T04:17:49.876743+0000","last_became_active":"2024-01-19T04:17:49.871224+0000","last_became_peered":"2024-01-19T04:17:49.871224+0000","last_unstale":"2024-01-19T04:17:49.876743+0000","last_undegraded":"2024-01-19T04:17:49.876743+0000","last_fullsized":"2024-01-19T04:17:49.876743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.811783+0000","last_change":"2024-01-19T04:17:48.811783+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.811783+0000","last_undegraded":"2024-01-19T04:17:48.811783+0000","last_fullsized":"2024-01-19T04:17:48.811783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.858698+0000","last_change":"2024-01-19T04:17:49.853083+0000","last_active":"2024-01-19T04:17:49.858698+0000","last_peered":"2024-01-19T04:17:49.858698+0000","last_clean":"2024-01-19T04:17:49.858698+0000","last_became_active":"2024-01-19T04:17:49.852756+0000","last_became_peered":"2024-01-19T04:17:49.852756+0000","last_unstale":"2024-01-19T04:17:49.858698+0000","last_undegraded":"2024-01-19T04:17:49.858698+0000","last_fullsized":"2024-01-19T04:17:49.858698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:29.434185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870952+0000","last_change":"2024-01-19T04:17:49.864286+0000","last_active":"2024-01-19T04:17:49.870952+0000","last_peered":"2024-01-19T04:17:49.870952+0000","last_clean":"2024-01-19T04:17:49.870952+0000","last_became_active":"2024-01-19T04:17:49.864000+0000","last_became_peered":"2024-01-19T04:17:49.864000+0000","last_unstale":"2024-01-19T04:17:49.870952+0000","last_undegraded":"2024-01-19T04:17:49.870952+0000","last_fullsized":"2024-01-19T04:17:49.870952+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:01.541953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.811502+0000","last_change":"2024-01-19T04:17:48.811502+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.811502+0000","last_undegraded":"2024-01-19T04:17:48.811502+0000","last_fullsized":"2024-01-19T04:17:48.811502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.878390+0000","last_change":"2024-01-19T04:17:49.875695+0000","last_active":"2024-01-19T04:17:49.878390+0000","last_peered":"2024-01-19T04:17:49.878390+0000","last_clean":"2024-01-19T04:17:49.878390+0000","last_became_active":"2024-01-19T04:17:49.875390+0000","last_became_peered":"2024-01-19T04:17:49.875390+0000","last_unstale":"2024-01-19T04:17:49.878390+0000","last_undegraded":"2024-01-19T04:17:49.878390+0000","last_fullsized":"2024-01-19T04:17:49.878390+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:38.982225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.877811+0000","last_change":"2024-01-19T04:17:49.872291+0000","last_active":"2024-01-19T04:17:49.877811+0000","last_peered":"2024-01-19T04:17:49.877811+0000","last_clean":"2024-01-19T04:17:49.877811+0000","last_became_active":"2024-01-19T04:17:49.869453+0000","last_became_peered":"2024-01-19T04:17:49.869453+0000","last_unstale":"2024-01-19T04:17:49.877811+0000","last_undegraded":"2024-01-19T04:17:49.877811+0000","last_fullsized":"2024-01-19T04:17:49.877811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:16.430617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876138+0000","last_change":"2024-01-19T04:17:49.871088+0000","last_active":"2024-01-19T04:17:49.876138+0000","last_peered":"2024-01-19T04:17:49.876138+0000","last_clean":"2024-01-19T04:17:49.876138+0000","last_became_active":"2024-01-19T04:17:49.867276+0000","last_became_peered":"2024-01-19T04:17:49.867276+0000","last_unstale":"2024-01-19T04:17:49.876138+0000","last_undegraded":"2024-01-19T04:17:49.876138+0000","last_fullsized":"2024-01-19T04:17:49.876138+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:19.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.814421+0000","last_change":"2024-01-19T04:17:48.814421+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.814421+0000","last_undegraded":"2024-01-19T04:17:48.814421+0000","last_fullsized":"2024-01-19T04:17:48.814421+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.871018+0000","last_change":"2024-01-19T04:17:49.867772+0000","last_active":"2024-01-19T04:17:49.871018+0000","last_peered":"2024-01-19T04:17:49.871018+0000","last_clean":"2024-01-19T04:17:49.871018+0000","last_became_active":"2024-01-19T04:17:49.867020+0000","last_became_peered":"2024-01-19T04:17:49.867020+0000","last_unstale":"2024-01-19T04:17:49.871018+0000","last_undegraded":"2024-01-19T04:17:49.871018+0000","last_fullsized":"2024-01-19T04:17:49.871018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:24.996668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.874231+0000","last_change":"2024-01-19T04:17:49.866863+0000","last_active":"2024-01-19T04:17:49.874231+0000","last_peered":"2024-01-19T04:17:49.874231+0000","last_clean":"2024-01-19T04:17:49.874231+0000","last_became_active":"2024-01-19T04:17:49.866547+0000","last_became_peered":"2024-01-19T04:17:49.866547+0000","last_unstale":"2024-01-19T04:17:49.874231+0000","last_undegraded":"2024-01-19T04:17:49.874231+0000","last_fullsized":"2024-01-19T04:17:49.874231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:38.982225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.810313+0000","last_change":"2024-01-19T04:17:48.810313+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.810313+0000","last_undegraded":"2024-01-19T04:17:48.810313+0000","last_fullsized":"2024-01-19T04:17:48.810313+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:17:48.798275+0000","last_change":"2024-01-19T04:17:48.798275+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.798275+0000","last_undegraded":"2024-01-19T04:17:48.798275+0000","last_fullsized":"2024-01-19T04:17:48.798275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870533+0000","last_change":"2024-01-19T04:17:49.865134+0000","last_active":"2024-01-19T04:17:49.870533+0000","last_peered":"2024-01-19T04:17:49.870533+0000","last_clean":"2024-01-19T04:17:49.870533+0000","last_became_active":"2024-01-19T04:17:49.864792+0000","last_became_peered":"2024-01-19T04:17:49.864792+0000","last_unstale":"2024-01-19T04:17:49.870533+0000","last_undegraded":"2024-01-19T04:17:49.870533+0000","last_fullsized":"2024-01-19T04:17:49.870533+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:16.430617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.859752+0000","last_change":"2024-01-19T04:17:49.856844+0000","last_active":"2024-01-19T04:17:49.859752+0000","last_peered":"2024-01-19T04:17:49.859752+0000","last_clean":"2024-01-19T04:17:49.859752+0000","last_became_active":"2024-01-19T04:17:49.854882+0000","last_became_peered":"2024-01-19T04:17:49.854882+0000","last_unstale":"2024-01-19T04:17:49.859752+0000","last_undegraded":"2024-01-19T04:17:49.859752+0000","last_fullsized":"2024-01-19T04:17:49.859752+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:21.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.808180+0000","last_change":"2024-01-19T04:17:48.808180+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.808180+0000","last_undegraded":"2024-01-19T04:17:48.808180+0000","last_fullsized":"2024-01-19T04:17:48.808180+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.817042+0000","last_change":"2024-01-19T04:17:48.817042+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.817042+0000","last_undegraded":"2024-01-19T04:17:48.817042+0000","last_fullsized":"2024-01-19T04:17:48.817042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.808474+0000","last_change":"2024-01-19T04:17:48.808474+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.808474+0000","last_undegraded":"2024-01-19T04:17:48.808474+0000","last_fullsized":"2024-01-19T04:17:48.808474+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.809701+0000","last_change":"2024-01-19T04:17:48.809701+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.809701+0000","last_undegraded":"2024-01-19T04:17:48.809701+0000","last_fullsized":"2024-01-19T04:17:48.809701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.811766+0000","last_change":"2024-01-19T04:17:48.811766+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.811766+0000","last_undegraded":"2024-01-19T04:17:48.811766+0000","last_fullsized":"2024-01-19T04:17:48.811766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870715+0000","last_change":"2024-01-19T04:17:49.868296+0000","last_active":"2024-01-19T04:17:49.870715+0000","last_peered":"2024-01-19T04:17:49.870715+0000","last_clean":"2024-01-19T04:17:49.870715+0000","last_became_active":"2024-01-19T04:17:49.867461+0000","last_became_peered":"2024-01-19T04:17:49.867461+0000","last_unstale":"2024-01-19T04:17:49.870715+0000","last_undegraded":"2024-01-19T04:17:49.870715+0000","last_fullsized":"2024-01-19T04:17:49.870715+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:01.541953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.809056+0000","last_change":"2024-01-19T04:17:48.809056+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.809056+0000","last_undegraded":"2024-01-19T04:17:48.809056+0000","last_fullsized":"2024-01-19T04:17:48.809056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.811101+0000","last_change":"2024-01-19T04:17:48.811101+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.811101+0000","last_undegraded":"2024-01-19T04:17:48.811101+0000","last_fullsized":"2024-01-19T04:17:48.811101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.878102+0000","last_change":"2024-01-19T04:17:49.874016+0000","last_active":"2024-01-19T04:17:49.878102+0000","last_peered":"2024-01-19T04:17:49.878102+0000","last_clean":"2024-01-19T04:17:49.878102+0000","last_became_active":"2024-01-19T04:17:49.873659+0000","last_became_peered":"2024-01-19T04:17:49.873659+0000","last_unstale":"2024-01-19T04:17:49.878102+0000","last_undegraded":"2024-01-19T04:17:49.878102+0000","last_fullsized":"2024-01-19T04:17:49.878102+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.857333+0000","last_change":"2024-01-19T04:17:49.852565+0000","last_active":"2024-01-19T04:17:49.857333+0000","last_peered":"2024-01-19T04:17:49.857333+0000","last_clean":"2024-01-19T04:17:49.857333+0000","last_became_active":"2024-01-19T04:17:49.852322+0000","last_became_peered":"2024-01-19T04:17:49.852322+0000","last_unstale":"2024-01-19T04:17:49.857333+0000","last_undegraded":"2024-01-19T04:17:49.857333+0000","last_fullsized":"2024-01-19T04:17:49.857333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:41:01.734672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870999+0000","last_change":"2024-01-19T04:17:49.863773+0000","last_active":"2024-01-19T04:17:49.870999+0000","last_peered":"2024-01-19T04:17:49.870999+0000","last_clean":"2024-01-19T04:17:49.870999+0000","last_became_active":"2024-01-19T04:17:49.863395+0000","last_became_peered":"2024-01-19T04:17:49.863395+0000","last_unstale":"2024-01-19T04:17:49.870999+0000","last_undegraded":"2024-01-19T04:17:49.870999+0000","last_fullsized":"2024-01-19T04:17:49.870999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:29.434185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.811970+0000","last_change":"2024-01-19T04:17:48.811970+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.811970+0000","last_undegraded":"2024-01-19T04:17:48.811970+0000","last_fullsized":"2024-01-19T04:17:48.811970+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.811312+0000","last_change":"2024-01-19T04:17:48.811312+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.811312+0000","last_undegraded":"2024-01-19T04:17:48.811312+0000","last_fullsized":"2024-01-19T04:17:48.811312+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.861871+0000","last_change":"2024-01-19T04:17:49.857659+0000","last_active":"2024-01-19T04:17:49.861871+0000","last_peered":"2024-01-19T04:17:49.861871+0000","last_clean":"2024-01-19T04:17:49.861871+0000","last_became_active":"2024-01-19T04:17:49.857365+0000","last_became_peered":"2024-01-19T04:17:49.857365+0000","last_unstale":"2024-01-19T04:17:49.861871+0000","last_undegraded":"2024-01-19T04:17:49.861871+0000","last_fullsized":"2024-01-19T04:17:49.861871+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:55.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.871060+0000","last_change":"2024-01-19T04:17:49.867051+0000","last_active":"2024-01-19T04:17:49.871060+0000","last_peered":"2024-01-19T04:17:49.871060+0000","last_clean":"2024-01-19T04:17:49.871060+0000","last_became_active":"2024-01-19T04:17:49.866731+0000","last_became_peered":"2024-01-19T04:17:49.866731+0000","last_unstale":"2024-01-19T04:17:49.871060+0000","last_undegraded":"2024-01-19T04:17:49.871060+0000","last_fullsized":"2024-01-19T04:17:49.871060+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:55.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.867842+0000","last_change":"2024-01-19T04:17:49.864851+0000","last_active":"2024-01-19T04:17:49.867842+0000","last_peered":"2024-01-19T04:17:49.867842+0000","last_clean":"2024-01-19T04:17:49.867842+0000","last_became_active":"2024-01-19T04:17:49.864521+0000","last_became_peered":"2024-01-19T04:17:49.864521+0000","last_unstale":"2024-01-19T04:17:49.867842+0000","last_undegraded":"2024-01-19T04:17:49.867842+0000","last_fullsized":"2024-01-19T04:17:49.867842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:19.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"70'4","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.875464+0000","last_change":"2024-01-19T04:17:48.825833+0000","last_active":"2024-01-19T04:17:49.875464+0000","last_peered":"2024-01-19T04:17:49.875464+0000","last_clean":"2024-01-19T04:17:49.875464+0000","last_became_active":"2024-01-19T04:17:48.825538+0000","last_became_peered":"2024-01-19T04:17:48.825538+0000","last_unstale":"2024-01-19T04:17:49.875464+0000","last_undegraded":"2024-01-19T04:17:49.875464+0000","last_fullsized":"2024-01-19T04:17:49.875464+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.873041+0000","last_change":"2024-01-19T04:17:49.870363+0000","last_active":"2024-01-19T04:17:49.873041+0000","last_peered":"2024-01-19T04:17:49.873041+0000","last_clean":"2024-01-19T04:17:49.873041+0000","last_became_active":"2024-01-19T04:17:49.867727+0000","last_became_peered":"2024-01-19T04:17:49.867727+0000","last_unstale":"2024-01-19T04:17:49.873041+0000","last_undegraded":"2024-01-19T04:17:49.873041+0000","last_fullsized":"2024-01-19T04:17:49.873041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:20.003637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.867631+0000","last_change":"2024-01-19T04:17:48.820675+0000","last_active":"2024-01-19T04:17:49.867631+0000","last_peered":"2024-01-19T04:17:49.867631+0000","last_clean":"2024-01-19T04:17:49.867631+0000","last_became_active":"2024-01-19T04:17:48.816249+0000","last_became_peered":"2024-01-19T04:17:48.816249+0000","last_unstale":"2024-01-19T04:17:49.867631+0000","last_undegraded":"2024-01-19T04:17:49.867631+0000","last_fullsized":"2024-01-19T04:17:49.867631+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.871034+0000","last_change":"2024-01-19T04:17:49.867990+0000","last_active":"2024-01-19T04:17:49.871034+0000","last_peered":"2024-01-19T04:17:49.871034+0000","last_clean":"2024-01-19T04:17:49.871034+0000","last_became_active":"2024-01-19T04:17:49.867492+0000","last_became_peered":"2024-01-19T04:17:49.867492+0000","last_unstale":"2024-01-19T04:17:49.871034+0000","last_undegraded":"2024-01-19T04:17:49.871034+0000","last_fullsized":"2024-01-19T04:17:49.871034+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:22.337221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.832080+0000","last_change":"2024-01-19T04:17:48.828840+0000","last_active":"2024-01-19T04:17:48.832080+0000","last_peered":"2024-01-19T04:17:48.832080+0000","last_clean":"2024-01-19T04:17:48.832080+0000","last_became_active":"2024-01-19T04:17:48.828585+0000","last_became_peered":"2024-01-19T04:17:48.828585+0000","last_unstale":"2024-01-19T04:17:48.832080+0000","last_undegraded":"2024-01-19T04:17:48.832080+0000","last_fullsized":"2024-01-19T04:17:48.832080+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:20.355098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876761+0000","last_change":"2024-01-19T04:17:49.873318+0000","last_active":"2024-01-19T04:17:49.876761+0000","last_peered":"2024-01-19T04:17:49.876761+0000","last_clean":"2024-01-19T04:17:49.876761+0000","last_became_active":"2024-01-19T04:17:49.873026+0000","last_became_peered":"2024-01-19T04:17:49.873026+0000","last_unstale":"2024-01-19T04:17:49.876761+0000","last_undegraded":"2024-01-19T04:17:49.876761+0000","last_fullsized":"2024-01-19T04:17:49.876761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.831850+0000","last_change":"2024-01-19T04:17:48.829724+0000","last_active":"2024-01-19T04:17:48.831850+0000","last_peered":"2024-01-19T04:17:48.831850+0000","last_clean":"2024-01-19T04:17:48.831850+0000","last_became_active":"2024-01-19T04:17:48.829371+0000","last_became_peered":"2024-01-19T04:17:48.829371+0000","last_unstale":"2024-01-19T04:17:48.831850+0000","last_undegraded":"2024-01-19T04:17:48.831850+0000","last_fullsized":"2024-01-19T04:17:48.831850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:54.388146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.810775+0000","last_change":"2024-01-19T04:17:48.810775+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.810775+0000","last_undegraded":"2024-01-19T04:17:48.810775+0000","last_fullsized":"2024-01-19T04:17:48.810775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.860033+0000","last_change":"2024-01-19T04:17:48.822620+0000","last_active":"2024-01-19T04:17:49.860033+0000","last_peered":"2024-01-19T04:17:49.860033+0000","last_clean":"2024-01-19T04:17:49.860033+0000","last_became_active":"2024-01-19T04:17:48.822278+0000","last_became_peered":"2024-01-19T04:17:48.822278+0000","last_unstale":"2024-01-19T04:17:49.860033+0000","last_undegraded":"2024-01-19T04:17:49.860033+0000","last_fullsized":"2024-01-19T04:17:49.860033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.865691+0000","last_change":"2024-01-19T04:17:49.860631+0000","last_active":"2024-01-19T04:17:49.865691+0000","last_peered":"2024-01-19T04:17:49.865691+0000","last_clean":"2024-01-19T04:17:49.865691+0000","last_became_active":"2024-01-19T04:17:49.855956+0000","last_became_peered":"2024-01-19T04:17:49.855956+0000","last_unstale":"2024-01-19T04:17:49.865691+0000","last_undegraded":"2024-01-19T04:17:49.865691+0000","last_fullsized":"2024-01-19T04:17:49.865691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:01.541953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.857145+0000","last_change":"2024-01-19T04:17:48.818168+0000","last_active":"2024-01-19T04:17:49.857145+0000","last_peered":"2024-01-19T04:17:49.857145+0000","last_clean":"2024-01-19T04:17:49.857145+0000","last_became_active":"2024-01-19T04:17:48.816710+0000","last_became_peered":"2024-01-19T04:17:48.816710+0000","last_unstale":"2024-01-19T04:17:49.857145+0000","last_undegraded":"2024-01-19T04:17:49.857145+0000","last_fullsized":"2024-01-19T04:17:49.857145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.877372+0000","last_change":"2024-01-19T04:17:49.869314+0000","last_active":"2024-01-19T04:17:49.877372+0000","last_peered":"2024-01-19T04:17:49.877372+0000","last_clean":"2024-01-19T04:17:49.877372+0000","last_became_active":"2024-01-19T04:17:49.868926+0000","last_became_peered":"2024-01-19T04:17:49.868926+0000","last_unstale":"2024-01-19T04:17:49.877372+0000","last_undegraded":"2024-01-19T04:17:49.877372+0000","last_fullsized":"2024-01-19T04:17:49.877372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.831687+0000","last_change":"2024-01-19T04:17:48.828497+0000","last_active":"2024-01-19T04:17:48.831687+0000","last_peered":"2024-01-19T04:17:48.831687+0000","last_clean":"2024-01-19T04:17:48.831687+0000","last_became_active":"2024-01-19T04:17:48.828243+0000","last_became_peered":"2024-01-19T04:17:48.828243+0000","last_unstale":"2024-01-19T04:17:48.831687+0000","last_undegraded":"2024-01-19T04:17:48.831687+0000","last_fullsized":"2024-01-19T04:17:48.831687+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:26:01.485194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:17:48.798275+0000","last_change":"2024-01-19T04:17:48.798275+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.798275+0000","last_undegraded":"2024-01-19T04:17:48.798275+0000","last_fullsized":"2024-01-19T04:17:48.798275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.828427+0000","last_change":"2024-01-19T04:17:48.825064+0000","last_active":"2024-01-19T04:17:48.828427+0000","last_peered":"2024-01-19T04:17:48.828427+0000","last_clean":"2024-01-19T04:17:48.828427+0000","last_became_active":"2024-01-19T04:17:48.824540+0000","last_became_peered":"2024-01-19T04:17:48.824540+0000","last_unstale":"2024-01-19T04:17:48.828427+0000","last_undegraded":"2024-01-19T04:17:48.828427+0000","last_fullsized":"2024-01-19T04:17:48.828427+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:08:03.931604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T04:17:48.798275+0000","last_change":"2024-01-19T04:17:48.798275+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.798275+0000","last_undegraded":"2024-01-19T04:17:48.798275+0000","last_fullsized":"2024-01-19T04:17:48.798275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.854140+0000","last_change":"2024-01-19T04:17:48.830083+0000","last_active":"2024-01-19T04:17:49.854140+0000","last_peered":"2024-01-19T04:17:49.854140+0000","last_clean":"2024-01-19T04:17:49.854140+0000","last_became_active":"2024-01-19T04:17:48.829733+0000","last_became_peered":"2024-01-19T04:17:48.829733+0000","last_unstale":"2024-01-19T04:17:49.854140+0000","last_undegraded":"2024-01-19T04:17:49.854140+0000","last_fullsized":"2024-01-19T04:17:49.854140+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.869727+0000","last_change":"2024-01-19T04:17:49.862638+0000","last_active":"2024-01-19T04:17:49.869727+0000","last_peered":"2024-01-19T04:17:49.869727+0000","last_clean":"2024-01-19T04:17:49.869727+0000","last_became_active":"2024-01-19T04:17:49.862288+0000","last_became_peered":"2024-01-19T04:17:49.862288+0000","last_unstale":"2024-01-19T04:17:49.869727+0000","last_undegraded":"2024-01-19T04:17:49.869727+0000","last_fullsized":"2024-01-19T04:17:49.869727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:24.996668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.849411+0000","last_change":"2024-01-19T04:17:48.828142+0000","last_active":"2024-01-19T04:17:49.849411+0000","last_peered":"2024-01-19T04:17:49.849411+0000","last_clean":"2024-01-19T04:17:49.849411+0000","last_became_active":"2024-01-19T04:17:48.827873+0000","last_became_peered":"2024-01-19T04:17:48.827873+0000","last_unstale":"2024-01-19T04:17:49.849411+0000","last_undegraded":"2024-01-19T04:17:49.849411+0000","last_fullsized":"2024-01-19T04:17:49.849411+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.813054+0000","last_change":"2024-01-19T04:17:48.813054+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.813054+0000","last_undegraded":"2024-01-19T04:17:48.813054+0000","last_fullsized":"2024-01-19T04:17:48.813054+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"70'3","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876904+0000","last_change":"2024-01-19T04:17:48.825703+0000","last_active":"2024-01-19T04:17:49.876904+0000","last_peered":"2024-01-19T04:17:49.876904+0000","last_clean":"2024-01-19T04:17:49.876904+0000","last_became_active":"2024-01-19T04:17:48.825410+0000","last_became_peered":"2024-01-19T04:17:48.825410+0000","last_unstale":"2024-01-19T04:17:49.876904+0000","last_undegraded":"2024-01-19T04:17:49.876904+0000","last_fullsized":"2024-01-19T04:17:49.876904+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:59.028381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.865657+0000","last_change":"2024-01-19T04:17:49.859589+0000","last_active":"2024-01-19T04:17:49.865657+0000","last_peered":"2024-01-19T04:17:49.865657+0000","last_clean":"2024-01-19T04:17:49.865657+0000","last_became_active":"2024-01-19T04:17:49.857553+0000","last_became_peered":"2024-01-19T04:17:49.857553+0000","last_unstale":"2024-01-19T04:17:49.865657+0000","last_undegraded":"2024-01-19T04:17:49.865657+0000","last_fullsized":"2024-01-19T04:17:49.865657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:22.337221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"70'6","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.879407+0000","last_change":"2024-01-19T04:17:48.824771+0000","last_active":"2024-01-19T04:17:49.879407+0000","last_peered":"2024-01-19T04:17:49.879407+0000","last_clean":"2024-01-19T04:17:49.879407+0000","last_became_active":"2024-01-19T04:17:48.824480+0000","last_became_peered":"2024-01-19T04:17:48.824480+0000","last_unstale":"2024-01-19T04:17:49.879407+0000","last_undegraded":"2024-01-19T04:17:49.879407+0000","last_fullsized":"2024-01-19T04:17:49.879407+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:20.355098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.817912+0000","last_change":"2024-01-19T04:17:48.817912+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.817912+0000","last_undegraded":"2024-01-19T04:17:48.817912+0000","last_fullsized":"2024-01-19T04:17:48.817912+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.833913+0000","last_change":"2024-01-19T04:17:48.831635+0000","last_active":"2024-01-19T04:17:48.833913+0000","last_peered":"2024-01-19T04:17:48.833913+0000","last_clean":"2024-01-19T04:17:48.833913+0000","last_became_active":"2024-01-19T04:17:48.831278+0000","last_became_peered":"2024-01-19T04:17:48.831278+0000","last_unstale":"2024-01-19T04:17:48.833913+0000","last_undegraded":"2024-01-19T04:17:48.833913+0000","last_fullsized":"2024-01-19T04:17:48.833913+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:52:20.766418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876696+0000","last_change":"2024-01-19T04:17:49.869971+0000","last_active":"2024-01-19T04:17:49.876696+0000","last_peered":"2024-01-19T04:17:49.876696+0000","last_clean":"2024-01-19T04:17:49.876696+0000","last_became_active":"2024-01-19T04:17:49.869655+0000","last_became_peered":"2024-01-19T04:17:49.869655+0000","last_unstale":"2024-01-19T04:17:49.876696+0000","last_undegraded":"2024-01-19T04:17:49.876696+0000","last_fullsized":"2024-01-19T04:17:49.876696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-01-19T04:17:47.806752+0000","last_change":"2024-01-19T04:17:47.806752+0000","last_active":"2024-01-19T04:17:47.795791+0000","last_peered":"2024-01-19T04:17:47.795791+0000","last_clean":"2024-01-19T04:17:47.795791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:47.806752+0000","last_undegraded":"2024-01-19T04:17:47.806752+0000","last_fullsized":"2024-01-19T04:17:47.806752+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.813907+0000","last_change":"2024-01-19T04:17:48.813907+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.813907+0000","last_undegraded":"2024-01-19T04:17:48.813907+0000","last_fullsized":"2024-01-19T04:17:48.813907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.861265+0000","last_change":"2024-01-19T04:17:48.819963+0000","last_active":"2024-01-19T04:17:49.861265+0000","last_peered":"2024-01-19T04:17:49.861265+0000","last_clean":"2024-01-19T04:17:49.861265+0000","last_became_active":"2024-01-19T04:17:48.819675+0000","last_became_peered":"2024-01-19T04:17:48.819675+0000","last_unstale":"2024-01-19T04:17:49.861265+0000","last_undegraded":"2024-01-19T04:17:49.861265+0000","last_fullsized":"2024-01-19T04:17:49.861265+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:54.388146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.812279+0000","last_change":"2024-01-19T04:17:48.812279+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.812279+0000","last_undegraded":"2024-01-19T04:17:48.812279+0000","last_fullsized":"2024-01-19T04:17:48.812279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.829575+0000","last_change":"2024-01-19T04:17:48.827802+0000","last_active":"2024-01-19T04:17:48.829575+0000","last_peered":"2024-01-19T04:17:48.829575+0000","last_clean":"2024-01-19T04:17:48.829575+0000","last_became_active":"2024-01-19T04:17:48.827509+0000","last_became_peered":"2024-01-19T04:17:48.827509+0000","last_unstale":"2024-01-19T04:17:48.829575+0000","last_undegraded":"2024-01-19T04:17:48.829575+0000","last_fullsized":"2024-01-19T04:17:48.829575+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:28.431700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.874643+0000","last_change":"2024-01-19T04:17:49.869335+0000","last_active":"2024-01-19T04:17:49.874643+0000","last_peered":"2024-01-19T04:17:49.874643+0000","last_clean":"2024-01-19T04:17:49.874643+0000","last_became_active":"2024-01-19T04:17:49.869084+0000","last_became_peered":"2024-01-19T04:17:49.869084+0000","last_unstale":"2024-01-19T04:17:49.874643+0000","last_undegraded":"2024-01-19T04:17:49.874643+0000","last_fullsized":"2024-01-19T04:17:49.874643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.872774+0000","last_change":"2024-01-19T04:17:48.827720+0000","last_active":"2024-01-19T04:17:49.872774+0000","last_peered":"2024-01-19T04:17:49.872774+0000","last_clean":"2024-01-19T04:17:49.872774+0000","last_became_active":"2024-01-19T04:17:48.827302+0000","last_became_peered":"2024-01-19T04:17:48.827302+0000","last_unstale":"2024-01-19T04:17:49.872774+0000","last_undegraded":"2024-01-19T04:17:49.872774+0000","last_fullsized":"2024-01-19T04:17:49.872774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870597+0000","last_change":"2024-01-19T04:17:49.864846+0000","last_active":"2024-01-19T04:17:49.870597+0000","last_peered":"2024-01-19T04:17:49.870597+0000","last_clean":"2024-01-19T04:17:49.870597+0000","last_became_active":"2024-01-19T04:17:49.864174+0000","last_became_peered":"2024-01-19T04:17:49.864174+0000","last_unstale":"2024-01-19T04:17:49.870597+0000","last_undegraded":"2024-01-19T04:17:49.870597+0000","last_fullsized":"2024-01-19T04:17:49.870597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:21.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.828622+0000","last_change":"2024-01-19T04:17:48.825969+0000","last_active":"2024-01-19T04:17:48.828622+0000","last_peered":"2024-01-19T04:17:48.828622+0000","last_clean":"2024-01-19T04:17:48.828622+0000","last_became_active":"2024-01-19T04:17:48.825702+0000","last_became_peered":"2024-01-19T04:17:48.825702+0000","last_unstale":"2024-01-19T04:17:48.828622+0000","last_undegraded":"2024-01-19T04:17:48.828622+0000","last_fullsized":"2024-01-19T04:17:48.828622+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:41:00.732188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.865639+0000","last_change":"2024-01-19T04:17:49.858592+0000","last_active":"2024-01-19T04:17:49.865639+0000","last_peered":"2024-01-19T04:17:49.865639+0000","last_clean":"2024-01-19T04:17:49.865639+0000","last_became_active":"2024-01-19T04:17:49.857116+0000","last_became_peered":"2024-01-19T04:17:49.857116+0000","last_unstale":"2024-01-19T04:17:49.865639+0000","last_undegraded":"2024-01-19T04:17:49.865639+0000","last_fullsized":"2024-01-19T04:17:49.865639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:24.996668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.832235+0000","last_change":"2024-01-19T04:17:48.830964+0000","last_active":"2024-01-19T04:17:48.832235+0000","last_peered":"2024-01-19T04:17:48.832235+0000","last_clean":"2024-01-19T04:17:48.832235+0000","last_became_active":"2024-01-19T04:17:48.830676+0000","last_became_peered":"2024-01-19T04:17:48.830676+0000","last_unstale":"2024-01-19T04:17:48.832235+0000","last_undegraded":"2024-01-19T04:17:48.832235+0000","last_fullsized":"2024-01-19T04:17:48.832235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:21.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.808145+0000","last_change":"2024-01-19T04:17:48.808145+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.808145+0000","last_undegraded":"2024-01-19T04:17:48.808145+0000","last_fullsized":"2024-01-19T04:17:48.808145+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-01-19T04:17:47.806166+0000","last_change":"2024-01-19T04:17:47.806166+0000","last_active":"2024-01-19T04:17:47.795791+0000","last_peered":"2024-01-19T04:17:47.795791+0000","last_clean":"2024-01-19T04:17:47.795791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:47.806166+0000","last_undegraded":"2024-01-19T04:17:47.806166+0000","last_fullsized":"2024-01-19T04:17:47.806166+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870225+0000","last_change":"2024-01-19T04:17:49.863061+0000","last_active":"2024-01-19T04:17:49.870225+0000","last_peered":"2024-01-19T04:17:49.870225+0000","last_clean":"2024-01-19T04:17:49.870225+0000","last_became_active":"2024-01-19T04:17:49.862748+0000","last_became_peered":"2024-01-19T04:17:49.862748+0000","last_unstale":"2024-01-19T04:17:49.870225+0000","last_undegraded":"2024-01-19T04:17:49.870225+0000","last_fullsized":"2024-01-19T04:17:49.870225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:22.337221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.834193+0000","last_change":"2024-01-19T04:17:48.831189+0000","last_active":"2024-01-19T04:17:48.834193+0000","last_peered":"2024-01-19T04:17:48.834193+0000","last_clean":"2024-01-19T04:17:48.834193+0000","last_became_active":"2024-01-19T04:17:48.830902+0000","last_became_peered":"2024-01-19T04:17:48.830902+0000","last_unstale":"2024-01-19T04:17:48.834193+0000","last_undegraded":"2024-01-19T04:17:48.834193+0000","last_fullsized":"2024-01-19T04:17:48.834193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:24.872943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.808410+0000","last_change":"2024-01-19T04:17:48.808410+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.808410+0000","last_undegraded":"2024-01-19T04:17:48.808410+0000","last_fullsized":"2024-01-19T04:17:48.808410+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.832124+0000","last_change":"2024-01-19T04:17:48.825930+0000","last_active":"2024-01-19T04:17:48.832124+0000","last_peered":"2024-01-19T04:17:48.832124+0000","last_clean":"2024-01-19T04:17:48.832124+0000","last_became_active":"2024-01-19T04:17:48.825661+0000","last_became_peered":"2024-01-19T04:17:48.825661+0000","last_unstale":"2024-01-19T04:17:48.832124+0000","last_undegraded":"2024-01-19T04:17:48.832124+0000","last_fullsized":"2024-01-19T04:17:48.832124+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:50:23.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.875572+0000","last_change":"2024-01-19T04:17:49.869790+0000","last_active":"2024-01-19T04:17:49.875572+0000","last_peered":"2024-01-19T04:17:49.875572+0000","last_clean":"2024-01-19T04:17:49.875572+0000","last_became_active":"2024-01-19T04:17:49.869425+0000","last_became_peered":"2024-01-19T04:17:49.869425+0000","last_unstale":"2024-01-19T04:17:49.875572+0000","last_undegraded":"2024-01-19T04:17:49.875572+0000","last_fullsized":"2024-01-19T04:17:49.875572+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:20.003637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-01-19T04:17:47.806426+0000","last_change":"2024-01-19T04:17:47.806426+0000","last_active":"2024-01-19T04:17:47.795791+0000","last_peered":"2024-01-19T04:17:47.795791+0000","last_clean":"2024-01-19T04:17:47.795791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:47.806426+0000","last_undegraded":"2024-01-19T04:17:47.806426+0000","last_fullsized":"2024-01-19T04:17:47.806426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.867823+0000","last_change":"2024-01-19T04:17:49.863529+0000","last_active":"2024-01-19T04:17:49.867823+0000","last_peered":"2024-01-19T04:17:49.867823+0000","last_clean":"2024-01-19T04:17:49.867823+0000","last_became_active":"2024-01-19T04:17:49.863271+0000","last_became_peered":"2024-01-19T04:17:49.863271+0000","last_unstale":"2024-01-19T04:17:49.867823+0000","last_undegraded":"2024-01-19T04:17:49.867823+0000","last_fullsized":"2024-01-19T04:17:49.867823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:20.003637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.834486+0000","last_change":"2024-01-19T04:17:48.833146+0000","last_active":"2024-01-19T04:17:48.834486+0000","last_peered":"2024-01-19T04:17:48.834486+0000","last_clean":"2024-01-19T04:17:48.834486+0000","last_became_active":"2024-01-19T04:17:48.832826+0000","last_became_peered":"2024-01-19T04:17:48.832826+0000","last_unstale":"2024-01-19T04:17:48.834486+0000","last_undegraded":"2024-01-19T04:17:48.834486+0000","last_fullsized":"2024-01-19T04:17:48.834486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:32:02.162319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.874131+0000","last_change":"2024-01-19T04:17:49.868872+0000","last_active":"2024-01-19T04:17:49.874131+0000","last_peered":"2024-01-19T04:17:49.874131+0000","last_clean":"2024-01-19T04:17:49.874131+0000","last_became_active":"2024-01-19T04:17:49.867227+0000","last_became_peered":"2024-01-19T04:17:49.867227+0000","last_unstale":"2024-01-19T04:17:49.874131+0000","last_undegraded":"2024-01-19T04:17:49.874131+0000","last_fullsized":"2024-01-19T04:17:49.874131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:09.890421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.834017+0000","last_change":"2024-01-19T04:17:48.832316+0000","last_active":"2024-01-19T04:17:48.834017+0000","last_peered":"2024-01-19T04:17:48.834017+0000","last_clean":"2024-01-19T04:17:48.834017+0000","last_became_active":"2024-01-19T04:17:48.831448+0000","last_became_peered":"2024-01-19T04:17:48.831448+0000","last_unstale":"2024-01-19T04:17:48.834017+0000","last_undegraded":"2024-01-19T04:17:48.834017+0000","last_fullsized":"2024-01-19T04:17:48.834017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:59:18.914377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.878673+0000","last_change":"2024-01-19T04:17:49.873308+0000","last_active":"2024-01-19T04:17:49.878673+0000","last_peered":"2024-01-19T04:17:49.878673+0000","last_clean":"2024-01-19T04:17:49.878673+0000","last_became_active":"2024-01-19T04:17:49.872896+0000","last_became_peered":"2024-01-19T04:17:49.872896+0000","last_unstale":"2024-01-19T04:17:49.878673+0000","last_undegraded":"2024-01-19T04:17:49.878673+0000","last_fullsized":"2024-01-19T04:17:49.878673+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:16.430617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.848227+0000","last_change":"2024-01-19T04:17:48.826005+0000","last_active":"2024-01-19T04:17:49.848227+0000","last_peered":"2024-01-19T04:17:49.848227+0000","last_clean":"2024-01-19T04:17:49.848227+0000","last_became_active":"2024-01-19T04:17:48.825576+0000","last_became_peered":"2024-01-19T04:17:48.825576+0000","last_unstale":"2024-01-19T04:17:49.848227+0000","last_undegraded":"2024-01-19T04:17:49.848227+0000","last_fullsized":"2024-01-19T04:17:49.848227+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:39.977407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.857352+0000","last_change":"2024-01-19T04:17:49.853797+0000","last_active":"2024-01-19T04:17:49.857352+0000","last_peered":"2024-01-19T04:17:49.857352+0000","last_clean":"2024-01-19T04:17:49.857352+0000","last_became_active":"2024-01-19T04:17:49.853513+0000","last_became_peered":"2024-01-19T04:17:49.853513+0000","last_unstale":"2024-01-19T04:17:49.857352+0000","last_undegraded":"2024-01-19T04:17:49.857352+0000","last_fullsized":"2024-01-19T04:17:49.857352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:26:02.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.852740+0000","last_change":"2024-01-19T04:17:48.824215+0000","last_active":"2024-01-19T04:17:49.852740+0000","last_peered":"2024-01-19T04:17:49.852740+0000","last_clean":"2024-01-19T04:17:49.852740+0000","last_became_active":"2024-01-19T04:17:48.823939+0000","last_became_peered":"2024-01-19T04:17:48.823939+0000","last_unstale":"2024-01-19T04:17:49.852740+0000","last_undegraded":"2024-01-19T04:17:49.852740+0000","last_fullsized":"2024-01-19T04:17:49.852740+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.875615+0000","last_change":"2024-01-19T04:17:49.871059+0000","last_active":"2024-01-19T04:17:49.875615+0000","last_peered":"2024-01-19T04:17:49.875615+0000","last_clean":"2024-01-19T04:17:49.875615+0000","last_became_active":"2024-01-19T04:17:49.870787+0000","last_became_peered":"2024-01-19T04:17:49.870787+0000","last_unstale":"2024-01-19T04:17:49.875615+0000","last_undegraded":"2024-01-19T04:17:49.875615+0000","last_fullsized":"2024-01-19T04:17:49.875615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:19.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.831883+0000","last_change":"2024-01-19T04:17:48.829763+0000","last_active":"2024-01-19T04:17:48.831883+0000","last_peered":"2024-01-19T04:17:48.831883+0000","last_clean":"2024-01-19T04:17:48.831883+0000","last_became_active":"2024-01-19T04:17:48.829423+0000","last_became_peered":"2024-01-19T04:17:48.829423+0000","last_unstale":"2024-01-19T04:17:48.831883+0000","last_undegraded":"2024-01-19T04:17:48.831883+0000","last_fullsized":"2024-01-19T04:17:48.831883+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:23.994184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.811988+0000","last_change":"2024-01-19T04:17:48.811988+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.811988+0000","last_undegraded":"2024-01-19T04:17:48.811988+0000","last_fullsized":"2024-01-19T04:17:48.811988+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.842488+0000","last_change":"2024-01-19T04:17:48.818290+0000","last_active":"2024-01-19T04:17:49.842488+0000","last_peered":"2024-01-19T04:17:49.842488+0000","last_clean":"2024-01-19T04:17:49.842488+0000","last_became_active":"2024-01-19T04:17:48.816299+0000","last_became_peered":"2024-01-19T04:17:48.816299+0000","last_unstale":"2024-01-19T04:17:49.842488+0000","last_undegraded":"2024-01-19T04:17:49.842488+0000","last_fullsized":"2024-01-19T04:17:49.842488+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.879081+0000","last_change":"2024-01-19T04:17:49.877548+0000","last_active":"2024-01-19T04:17:49.879081+0000","last_peered":"2024-01-19T04:17:49.879081+0000","last_clean":"2024-01-19T04:17:49.879081+0000","last_became_active":"2024-01-19T04:17:49.877156+0000","last_became_peered":"2024-01-19T04:17:49.877156+0000","last_unstale":"2024-01-19T04:17:49.879081+0000","last_undegraded":"2024-01-19T04:17:49.879081+0000","last_fullsized":"2024-01-19T04:17:49.879081+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.846305+0000","last_change":"2024-01-19T04:17:48.826712+0000","last_active":"2024-01-19T04:17:49.846305+0000","last_peered":"2024-01-19T04:17:49.846305+0000","last_clean":"2024-01-19T04:17:49.846305+0000","last_became_active":"2024-01-19T04:17:48.826457+0000","last_became_peered":"2024-01-19T04:17:48.826457+0000","last_unstale":"2024-01-19T04:17:49.846305+0000","last_undegraded":"2024-01-19T04:17:49.846305+0000","last_fullsized":"2024-01-19T04:17:49.846305+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:55.231352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.868986+0000","last_change":"2024-01-19T04:17:49.862665+0000","last_active":"2024-01-19T04:17:49.868986+0000","last_peered":"2024-01-19T04:17:49.868986+0000","last_clean":"2024-01-19T04:17:49.868986+0000","last_became_active":"2024-01-19T04:17:49.862396+0000","last_became_peered":"2024-01-19T04:17:49.862396+0000","last_unstale":"2024-01-19T04:17:49.868986+0000","last_undegraded":"2024-01-19T04:17:49.868986+0000","last_fullsized":"2024-01-19T04:17:49.868986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:41:01.734672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.842727+0000","last_change":"2024-01-19T04:17:48.826398+0000","last_active":"2024-01-19T04:17:49.842727+0000","last_peered":"2024-01-19T04:17:49.842727+0000","last_clean":"2024-01-19T04:17:49.842727+0000","last_became_active":"2024-01-19T04:17:48.824417+0000","last_became_peered":"2024-01-19T04:17:48.824417+0000","last_unstale":"2024-01-19T04:17:49.842727+0000","last_undegraded":"2024-01-19T04:17:49.842727+0000","last_fullsized":"2024-01-19T04:17:49.842727+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-01-19T04:17:48.812127+0000","last_change":"2024-01-19T04:17:48.812127+0000","last_active":"2024-01-19T04:17:48.798275+0000","last_peered":"2024-01-19T04:17:48.798275+0000","last_clean":"2024-01-19T04:17:48.798275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T04:17:48.812127+0000","last_undegraded":"2024-01-19T04:17:48.812127+0000","last_fullsized":"2024-01-19T04:17:48.812127+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876745+0000","last_change":"2024-01-19T04:17:48.826402+0000","last_active":"2024-01-19T04:17:49.876745+0000","last_peered":"2024-01-19T04:17:49.876745+0000","last_clean":"2024-01-19T04:17:49.876745+0000","last_became_active":"2024-01-19T04:17:48.826139+0000","last_became_peered":"2024-01-19T04:17:48.826139+0000","last_unstale":"2024-01-19T04:17:49.876745+0000","last_undegraded":"2024-01-19T04:17:49.876745+0000","last_fullsized":"2024-01-19T04:17:49.876745+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:15.428133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.817559+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:17:48.817559+0000","last_peered":"2024-01-19T04:17:48.817559+0000","last_clean":"2024-01-19T04:17:48.817559+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:17:48.817559+0000","last_undegraded":"2024-01-19T04:17:48.817559+0000","last_fullsized":"2024-01-19T04:17:48.817559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476775,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1429504,"data_stored":950451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.79200000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.81499999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.65700000000000003}]}]},{"osd":6,"up_from":16,"seq":68719476775,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":360083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.871}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88800000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.127},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0960000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476774,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":360083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98299999999999998,"5min":1.107,"15min":1.107},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.246,"15min":1.246},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.878},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0820000000000001,"5min":1.708,"15min":1.708},"last":0.96199999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476776,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":360083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.54300000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.622}]},{"osd":3,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.381,"15min":1.381},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.095,"15min":1.095},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0940000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.139,"15min":1.139},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1120000000000001,"5min":1.266,"15min":1.266},"last":0.57999999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":353808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54700000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.503},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.63300000000000001,"5min":0.879,"15min":0.879},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95799999999999996,"5min":1.016,"15min":1.016},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.89500000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93000000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.746},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98199999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.66500000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":353808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.317},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66200000000000003,"5min":1.964,"15min":1.964},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":2.827,"15min":2.827},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60299999999999998,"5min":2.343,"15min":2.343},"last":0.5},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":1.665,"15min":1.665},"last":0.433}]},{"osd":4,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.032,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":0.94199999999999995,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.002,"5min":1.198,"15min":1.198},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.55800000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.623},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.67500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.04,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.77100000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":944176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.60999999999999999,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60799999999999998,"5min":3.129,"15min":3.129},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.66700000000000004,"15min":0.69999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.72299999999999998,"15min":0.755},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.61299999999999999,"5min":3.633,"15min":3.633},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.59499999999999997,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93200000000000005,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.96299999999999997,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.629}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89500000000000002,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.004,"15min":1.052},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0469999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":1.034,"15min":1.0860000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97499999999999998,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.96799999999999997,"15min":1.008},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.85099999999999998,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.876,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.75,"5min":1.052,"15min":1.1020000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95099999999999996,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.84999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":823296,"data_stored":353808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54600000000000004,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.77600000000000002,"15min":0.81799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82699999999999996,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.65300000000000002,"15min":0.68300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":5.226,"15min":5.226},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":5.319,"15min":5.319},"last":0.432},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.745,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96599999999999997,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.085,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.01,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.133,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.093,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93999999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.626}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.165,"5min":5.423,"15min":5.423},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1459999999999999,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:17:53.963 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:17:54.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.136+0000 7f86fe600640 1 Processor -- start 2024-01-19T04:17:54.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86fe600640 1 -- start start 2024-01-19T04:17:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86fe600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f86f80c54b0 0x7f86f806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86fe600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80c44f0 con 0x7f86f8155320 2024-01-19T04:17:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86fe600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80c4980 con 0x7f86f8072310 2024-01-19T04:17:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86fe600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f80c3bc0 con 0x7f86f80c54b0 2024-01-19T04:17:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86f6a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f86f80c54b0 0x7f86f806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86f7400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f86f8155320 0x7f86f80a4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49504/0 (socket says 172.21.15.32:49504) 2024-01-19T04:17:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86f7400640 1 -- 172.21.15.32:0/1876850062 learned_addr learned my addr 172.21.15.32:0/1876850062 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86f6a00640 1 -- 172.21.15.32:0/1876850062 >> v1:172.21.15.67:6789/0 conn(0x7f86f8072310 legacy=0x7f86f806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86f6a00640 1 -- 172.21.15.32:0/1876850062 >> v1:172.21.15.32:6789/0 conn(0x7f86f8155320 legacy=0x7f86f80a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.140+0000 7f86f6a00640 1 -- 172.21.15.32:0/1876850062 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80c3ea0 con 0x7f86f80c54b0 2024-01-19T04:17:54.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86f6a00640 1 --2- 172.21.15.32:0/1876850062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f80c54b0 0x7f86f806cc80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f86e00097c0 tx=0x7f86e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59496f35e32429cb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86f6000640 1 -- 172.21.15.32:0/1876850062 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00ab670 con 0x7f86f80c54b0 2024-01-19T04:17:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86f6000640 1 -- 172.21.15.32:0/1876850062 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e00ab7d0 con 0x7f86f80c54b0 2024-01-19T04:17:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86f6000640 1 -- 172.21.15.32:0/1876850062 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00abb60 con 0x7f86f80c54b0 2024-01-19T04:17:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 -- 172.21.15.32:0/1876850062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f80c54b0 msgr2=0x7f86f806cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 --2- 172.21.15.32:0/1876850062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f80c54b0 0x7f86f806cc80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f86e00097c0 tx=0x7f86e001c450 comp rx=0 tx=0).stop 2024-01-19T04:17:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 -- 172.21.15.32:0/1876850062 shutdown_connections 2024-01-19T04:17:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 --2- 172.21.15.32:0/1876850062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f80c54b0 0x7f86f806cc80 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 -- 172.21.15.32:0/1876850062 >> 172.21.15.32:0/1876850062 conn(0x7f86f80c5b20 msgr2=0x7f86f80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 -- 172.21.15.32:0/1876850062 shutdown_connections 2024-01-19T04:17:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 -- 172.21.15.32:0/1876850062 wait complete. 2024-01-19T04:17:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.144+0000 7f86fe600640 1 Processor -- start 2024-01-19T04:17:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 -- start start 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f8072310 0x7f86f8144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86f80c54b0 0x7f86f814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f8155320 0x7f86f8145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f814bde0 con 0x7f86f8072310 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f814c680 con 0x7f86f8155320 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80718b0 con 0x7f86f80c54b0 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f8072310 0x7f86f8144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f8072310 0x7f86f8144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60664/0 (socket says 172.21.15.32:60664) 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 -- 172.21.15.32:0/543796262 learned_addr learned my addr 172.21.15.32:0/543796262 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f6a00640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86f80c54b0 0x7f86f814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7e00640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f8155320 0x7f86f8145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 -- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86f80c54b0 msgr2=0x7f86f814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86f80c54b0 0x7f86f814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 -- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f8155320 msgr2=0x7f86f8145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f8155320 0x7f86f8145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 -- 172.21.15.32:0/543796262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009420 con 0x7f86f8072310 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7e00640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f8155320 0x7f86f8145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86f7400640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f8072310 0x7f86f8144d90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c400 tx=0x7f86e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86ef400640 1 -- 172.21.15.32:0/543796262 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8005cf0 con 0x7f86f8072310 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86ef400640 1 -- 172.21.15.32:0/543796262 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8005e50 con 0x7f86f8072310 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86ef400640 1 -- 172.21.15.32:0/543796262 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80072d0 con 0x7f86f8072310 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f814c030 con 0x7f86f8072310 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f81471b0 con 0x7f86f8072310 2024-01-19T04:17:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.148+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f80749f0 con 0x7f86f8072310 2024-01-19T04:17:54.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.152+0000 7f86ef400640 1 -- 172.21.15.32:0/543796262 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f86e8007430 con 0x7f86f8072310 2024-01-19T04:17:54.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.152+0000 7f86ef400640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f86d0066500 0x7f86d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.152+0000 7f86ef400640 1 -- 172.21.15.32:0/543796262 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86e8083b50 con 0x7f86f8072310 2024-01-19T04:17:54.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.152+0000 7f86f6a00640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f86d0066500 0x7f86d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.152+0000 7f86f6a00640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f86d0066500 0x7f86d00689c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f86e00af000 tx=0x7f86e00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.152+0000 7f86ef400640 1 -- 172.21.15.32:0/543796262 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f86e8050f10 con 0x7f86f8072310 2024-01-19T04:17:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.308+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86f81628e0 con 0x7f86d0066500 2024-01-19T04:17:54.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86ef400640 1 -- 172.21.15.32:0/543796262 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288964 (secure 0 0 0) 0x7f86e00ab9c0 con 0x7f86d0066500 2024-01-19T04:17:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:54.326 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f86d0066500 msgr2=0x7f86d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f86d0066500 0x7f86d00689c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f86e00af000 tx=0x7f86e00a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f8072310 msgr2=0x7f86f8144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f8072310 0x7f86f8144d90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c400 tx=0x7f86e800c8c0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 shutdown_connections 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f86d0066500 0x7f86d00689c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86f8155320 0x7f86f8145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f86f80c54b0 0x7f86f814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 --2- 172.21.15.32:0/543796262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86f8072310 0x7f86f8144d90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.320+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 >> 172.21.15.32:0/543796262 conn(0x7f86f80c5b20 msgr2=0x7f86f8153d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.324+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 shutdown_connections 2024-01-19T04:17:54.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.324+0000 7f86fe600640 1 -- 172.21.15.32:0/543796262 wait complete. 2024-01-19T04:17:54.346 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-01-19T04:17:54.072119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253124,"kb_used_data":7816,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721596,"statfs":{"total":773094113280,"available":772834914304,"internally_reserved":0,"allocated":8003584,"data_stored":4116122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001359"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870579+0000","last_change":"2024-01-19T04:17:49.865069+0000","last_active":"2024-01-19T04:17:49.870579+0000","last_peered":"2024-01-19T04:17:49.870579+0000","last_clean":"2024-01-19T04:17:49.870579+0000","last_became_active":"2024-01-19T04:17:49.864458+0000","last_became_peered":"2024-01-19T04:17:49.864458+0000","last_unstale":"2024-01-19T04:17:49.870579+0000","last_undegraded":"2024-01-19T04:17:49.870579+0000","last_fullsized":"2024-01-19T04:17:49.870579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:26:02.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.021197+0000","last_change":"2024-01-19T04:17:49.873043+0000","last_active":"2024-01-19T04:17:51.021197+0000","last_peered":"2024-01-19T04:17:51.021197+0000","last_clean":"2024-01-19T04:17:51.021197+0000","last_became_active":"2024-01-19T04:17:49.866359+0000","last_became_peered":"2024-01-19T04:17:49.866359+0000","last_unstale":"2024-01-19T04:17:51.021197+0000","last_undegraded":"2024-01-19T04:17:51.021197+0000","last_fullsized":"2024-01-19T04:17:51.021197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:00.030865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876743+0000","last_change":"2024-01-19T04:17:49.871656+0000","last_active":"2024-01-19T04:17:49.876743+0000","last_peered":"2024-01-19T04:17:49.876743+0000","last_clean":"2024-01-19T04:17:49.876743+0000","last_became_active":"2024-01-19T04:17:49.871224+0000","last_became_peered":"2024-01-19T04:17:49.871224+0000","last_unstale":"2024-01-19T04:17:49.876743+0000","last_undegraded":"2024-01-19T04:17:49.876743+0000","last_fullsized":"2024-01-19T04:17:49.876743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020118+0000","last_change":"2024-01-19T04:17:49.855762+0000","last_active":"2024-01-19T04:17:51.020118+0000","last_peered":"2024-01-19T04:17:51.020118+0000","last_clean":"2024-01-19T04:17:51.020118+0000","last_became_active":"2024-01-19T04:17:49.855517+0000","last_became_peered":"2024-01-19T04:17:49.855517+0000","last_unstale":"2024-01-19T04:17:51.020118+0000","last_undegraded":"2024-01-19T04:17:51.020118+0000","last_fullsized":"2024-01-19T04:17:51.020118+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:46.205998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.858698+0000","last_change":"2024-01-19T04:17:49.853083+0000","last_active":"2024-01-19T04:17:49.858698+0000","last_peered":"2024-01-19T04:17:49.858698+0000","last_clean":"2024-01-19T04:17:49.858698+0000","last_became_active":"2024-01-19T04:17:49.852756+0000","last_became_peered":"2024-01-19T04:17:49.852756+0000","last_unstale":"2024-01-19T04:17:49.858698+0000","last_undegraded":"2024-01-19T04:17:49.858698+0000","last_fullsized":"2024-01-19T04:17:49.858698+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:29.434185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870952+0000","last_change":"2024-01-19T04:17:49.864286+0000","last_active":"2024-01-19T04:17:49.870952+0000","last_peered":"2024-01-19T04:17:49.870952+0000","last_clean":"2024-01-19T04:17:49.870952+0000","last_became_active":"2024-01-19T04:17:49.864000+0000","last_became_peered":"2024-01-19T04:17:49.864000+0000","last_unstale":"2024-01-19T04:17:49.870952+0000","last_undegraded":"2024-01-19T04:17:49.870952+0000","last_fullsized":"2024-01-19T04:17:49.870952+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:01.541953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.019566+0000","last_change":"2024-01-19T04:17:49.857274+0000","last_active":"2024-01-19T04:17:51.019566+0000","last_peered":"2024-01-19T04:17:51.019566+0000","last_clean":"2024-01-19T04:17:51.019566+0000","last_became_active":"2024-01-19T04:17:49.857013+0000","last_became_peered":"2024-01-19T04:17:49.857013+0000","last_unstale":"2024-01-19T04:17:51.019566+0000","last_undegraded":"2024-01-19T04:17:51.019566+0000","last_fullsized":"2024-01-19T04:17:51.019566+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:49.777934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.878390+0000","last_change":"2024-01-19T04:17:49.875695+0000","last_active":"2024-01-19T04:17:49.878390+0000","last_peered":"2024-01-19T04:17:49.878390+0000","last_clean":"2024-01-19T04:17:49.878390+0000","last_became_active":"2024-01-19T04:17:49.875390+0000","last_became_peered":"2024-01-19T04:17:49.875390+0000","last_unstale":"2024-01-19T04:17:49.878390+0000","last_undegraded":"2024-01-19T04:17:49.878390+0000","last_fullsized":"2024-01-19T04:17:49.878390+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:38.982225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.877811+0000","last_change":"2024-01-19T04:17:49.872291+0000","last_active":"2024-01-19T04:17:49.877811+0000","last_peered":"2024-01-19T04:17:49.877811+0000","last_clean":"2024-01-19T04:17:49.877811+0000","last_became_active":"2024-01-19T04:17:49.869453+0000","last_became_peered":"2024-01-19T04:17:49.869453+0000","last_unstale":"2024-01-19T04:17:49.877811+0000","last_undegraded":"2024-01-19T04:17:49.877811+0000","last_fullsized":"2024-01-19T04:17:49.877811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:16.430617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876138+0000","last_change":"2024-01-19T04:17:49.871088+0000","last_active":"2024-01-19T04:17:49.876138+0000","last_peered":"2024-01-19T04:17:49.876138+0000","last_clean":"2024-01-19T04:17:49.876138+0000","last_became_active":"2024-01-19T04:17:49.867276+0000","last_became_peered":"2024-01-19T04:17:49.867276+0000","last_unstale":"2024-01-19T04:17:49.876138+0000","last_undegraded":"2024-01-19T04:17:49.876138+0000","last_fullsized":"2024-01-19T04:17:49.876138+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:19.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.021076+0000","last_change":"2024-01-19T04:17:49.862897+0000","last_active":"2024-01-19T04:17:51.021076+0000","last_peered":"2024-01-19T04:17:51.021076+0000","last_clean":"2024-01-19T04:17:51.021076+0000","last_became_active":"2024-01-19T04:17:49.859232+0000","last_became_peered":"2024-01-19T04:17:49.859232+0000","last_unstale":"2024-01-19T04:17:51.021076+0000","last_undegraded":"2024-01-19T04:17:51.021076+0000","last_fullsized":"2024-01-19T04:17:51.021076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:56.233836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.871018+0000","last_change":"2024-01-19T04:17:49.867772+0000","last_active":"2024-01-19T04:17:49.871018+0000","last_peered":"2024-01-19T04:17:49.871018+0000","last_clean":"2024-01-19T04:17:49.871018+0000","last_became_active":"2024-01-19T04:17:49.867020+0000","last_became_peered":"2024-01-19T04:17:49.867020+0000","last_unstale":"2024-01-19T04:17:49.871018+0000","last_undegraded":"2024-01-19T04:17:49.871018+0000","last_fullsized":"2024-01-19T04:17:49.871018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:24.996668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.874231+0000","last_change":"2024-01-19T04:17:49.866863+0000","last_active":"2024-01-19T04:17:49.874231+0000","last_peered":"2024-01-19T04:17:49.874231+0000","last_clean":"2024-01-19T04:17:49.874231+0000","last_became_active":"2024-01-19T04:17:49.866547+0000","last_became_peered":"2024-01-19T04:17:49.866547+0000","last_unstale":"2024-01-19T04:17:49.874231+0000","last_undegraded":"2024-01-19T04:17:49.874231+0000","last_fullsized":"2024-01-19T04:17:49.874231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:38.982225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.019825+0000","last_change":"2024-01-19T04:17:49.859723+0000","last_active":"2024-01-19T04:17:51.019825+0000","last_peered":"2024-01-19T04:17:51.019825+0000","last_clean":"2024-01-19T04:17:51.019825+0000","last_became_active":"2024-01-19T04:17:49.855553+0000","last_became_peered":"2024-01-19T04:17:49.855553+0000","last_unstale":"2024-01-19T04:17:51.019825+0000","last_undegraded":"2024-01-19T04:17:51.019825+0000","last_fullsized":"2024-01-19T04:17:51.019825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:49:38.943773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020045+0000","last_change":"2024-01-19T04:17:49.858285+0000","last_active":"2024-01-19T04:17:51.020045+0000","last_peered":"2024-01-19T04:17:51.020045+0000","last_clean":"2024-01-19T04:17:51.020045+0000","last_became_active":"2024-01-19T04:17:49.857723+0000","last_became_peered":"2024-01-19T04:17:49.857723+0000","last_unstale":"2024-01-19T04:17:51.020045+0000","last_undegraded":"2024-01-19T04:17:51.020045+0000","last_fullsized":"2024-01-19T04:17:51.020045+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870533+0000","last_change":"2024-01-19T04:17:49.865134+0000","last_active":"2024-01-19T04:17:49.870533+0000","last_peered":"2024-01-19T04:17:49.870533+0000","last_clean":"2024-01-19T04:17:49.870533+0000","last_became_active":"2024-01-19T04:17:49.864792+0000","last_became_peered":"2024-01-19T04:17:49.864792+0000","last_unstale":"2024-01-19T04:17:49.870533+0000","last_undegraded":"2024-01-19T04:17:49.870533+0000","last_fullsized":"2024-01-19T04:17:49.870533+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:16.430617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.859752+0000","last_change":"2024-01-19T04:17:49.856844+0000","last_active":"2024-01-19T04:17:49.859752+0000","last_peered":"2024-01-19T04:17:49.859752+0000","last_clean":"2024-01-19T04:17:49.859752+0000","last_became_active":"2024-01-19T04:17:49.854882+0000","last_became_peered":"2024-01-19T04:17:49.854882+0000","last_unstale":"2024-01-19T04:17:49.859752+0000","last_undegraded":"2024-01-19T04:17:49.859752+0000","last_fullsized":"2024-01-19T04:17:49.859752+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:21.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020293+0000","last_change":"2024-01-19T04:17:49.872746+0000","last_active":"2024-01-19T04:17:51.020293+0000","last_peered":"2024-01-19T04:17:51.020293+0000","last_clean":"2024-01-19T04:17:51.020293+0000","last_became_active":"2024-01-19T04:17:49.871233+0000","last_became_peered":"2024-01-19T04:17:49.871233+0000","last_unstale":"2024-01-19T04:17:51.020293+0000","last_undegraded":"2024-01-19T04:17:51.020293+0000","last_fullsized":"2024-01-19T04:17:51.020293+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:54:07.776884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:50.852677+0000","last_change":"2024-01-19T04:17:49.853513+0000","last_active":"2024-01-19T04:17:50.852677+0000","last_peered":"2024-01-19T04:17:50.852677+0000","last_clean":"2024-01-19T04:17:50.852677+0000","last_became_active":"2024-01-19T04:17:49.853240+0000","last_became_peered":"2024-01-19T04:17:49.853240+0000","last_unstale":"2024-01-19T04:17:50.852677+0000","last_undegraded":"2024-01-19T04:17:50.852677+0000","last_fullsized":"2024-01-19T04:17:50.852677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020158+0000","last_change":"2024-01-19T04:17:49.857940+0000","last_active":"2024-01-19T04:17:51.020158+0000","last_peered":"2024-01-19T04:17:51.020158+0000","last_clean":"2024-01-19T04:17:51.020158+0000","last_became_active":"2024-01-19T04:17:49.857618+0000","last_became_peered":"2024-01-19T04:17:49.857618+0000","last_unstale":"2024-01-19T04:17:51.020158+0000","last_undegraded":"2024-01-19T04:17:51.020158+0000","last_fullsized":"2024-01-19T04:17:51.020158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:17:03.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020032+0000","last_change":"2024-01-19T04:17:49.859316+0000","last_active":"2024-01-19T04:17:51.020032+0000","last_peered":"2024-01-19T04:17:51.020032+0000","last_clean":"2024-01-19T04:17:51.020032+0000","last_became_active":"2024-01-19T04:17:49.858093+0000","last_became_peered":"2024-01-19T04:17:49.858093+0000","last_unstale":"2024-01-19T04:17:51.020032+0000","last_undegraded":"2024-01-19T04:17:51.020032+0000","last_fullsized":"2024-01-19T04:17:51.020032+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:43.805224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020857+0000","last_change":"2024-01-19T04:17:49.866954+0000","last_active":"2024-01-19T04:17:51.020857+0000","last_peered":"2024-01-19T04:17:51.020857+0000","last_clean":"2024-01-19T04:17:51.020857+0000","last_became_active":"2024-01-19T04:17:49.866065+0000","last_became_peered":"2024-01-19T04:17:49.866065+0000","last_unstale":"2024-01-19T04:17:51.020857+0000","last_undegraded":"2024-01-19T04:17:51.020857+0000","last_fullsized":"2024-01-19T04:17:51.020857+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:10.031493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870715+0000","last_change":"2024-01-19T04:17:49.868296+0000","last_active":"2024-01-19T04:17:49.870715+0000","last_peered":"2024-01-19T04:17:49.870715+0000","last_clean":"2024-01-19T04:17:49.870715+0000","last_became_active":"2024-01-19T04:17:49.867461+0000","last_became_peered":"2024-01-19T04:17:49.867461+0000","last_unstale":"2024-01-19T04:17:49.870715+0000","last_undegraded":"2024-01-19T04:17:49.870715+0000","last_fullsized":"2024-01-19T04:17:49.870715+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:01.541953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.019555+0000","last_change":"2024-01-19T04:17:49.852860+0000","last_active":"2024-01-19T04:17:51.019555+0000","last_peered":"2024-01-19T04:17:51.019555+0000","last_clean":"2024-01-19T04:17:51.019555+0000","last_became_active":"2024-01-19T04:17:49.852553+0000","last_became_peered":"2024-01-19T04:17:49.852553+0000","last_unstale":"2024-01-19T04:17:51.019555+0000","last_undegraded":"2024-01-19T04:17:51.019555+0000","last_fullsized":"2024-01-19T04:17:51.019555+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:14.754721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.021231+0000","last_change":"2024-01-19T04:17:49.871177+0000","last_active":"2024-01-19T04:17:51.021231+0000","last_peered":"2024-01-19T04:17:51.021231+0000","last_clean":"2024-01-19T04:17:51.021231+0000","last_became_active":"2024-01-19T04:17:49.866601+0000","last_became_peered":"2024-01-19T04:17:49.866601+0000","last_unstale":"2024-01-19T04:17:51.021231+0000","last_undegraded":"2024-01-19T04:17:51.021231+0000","last_fullsized":"2024-01-19T04:17:51.021231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:14.140070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.878102+0000","last_change":"2024-01-19T04:17:49.874016+0000","last_active":"2024-01-19T04:17:49.878102+0000","last_peered":"2024-01-19T04:17:49.878102+0000","last_clean":"2024-01-19T04:17:49.878102+0000","last_became_active":"2024-01-19T04:17:49.873659+0000","last_became_peered":"2024-01-19T04:17:49.873659+0000","last_unstale":"2024-01-19T04:17:49.878102+0000","last_undegraded":"2024-01-19T04:17:49.878102+0000","last_fullsized":"2024-01-19T04:17:49.878102+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.857333+0000","last_change":"2024-01-19T04:17:49.852565+0000","last_active":"2024-01-19T04:17:49.857333+0000","last_peered":"2024-01-19T04:17:49.857333+0000","last_clean":"2024-01-19T04:17:49.857333+0000","last_became_active":"2024-01-19T04:17:49.852322+0000","last_became_peered":"2024-01-19T04:17:49.852322+0000","last_unstale":"2024-01-19T04:17:49.857333+0000","last_undegraded":"2024-01-19T04:17:49.857333+0000","last_fullsized":"2024-01-19T04:17:49.857333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:41:01.734672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870999+0000","last_change":"2024-01-19T04:17:49.863773+0000","last_active":"2024-01-19T04:17:49.870999+0000","last_peered":"2024-01-19T04:17:49.870999+0000","last_clean":"2024-01-19T04:17:49.870999+0000","last_became_active":"2024-01-19T04:17:49.863395+0000","last_became_peered":"2024-01-19T04:17:49.863395+0000","last_unstale":"2024-01-19T04:17:49.870999+0000","last_undegraded":"2024-01-19T04:17:49.870999+0000","last_fullsized":"2024-01-19T04:17:49.870999+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:29.434185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020708+0000","last_change":"2024-01-19T04:17:49.866404+0000","last_active":"2024-01-19T04:17:51.020708+0000","last_peered":"2024-01-19T04:17:51.020708+0000","last_clean":"2024-01-19T04:17:51.020708+0000","last_became_active":"2024-01-19T04:17:49.866097+0000","last_became_peered":"2024-01-19T04:17:49.866097+0000","last_unstale":"2024-01-19T04:17:51.020708+0000","last_undegraded":"2024-01-19T04:17:51.020708+0000","last_fullsized":"2024-01-19T04:17:51.020708+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:27.936090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020998+0000","last_change":"2024-01-19T04:17:49.865607+0000","last_active":"2024-01-19T04:17:51.020998+0000","last_peered":"2024-01-19T04:17:51.020998+0000","last_clean":"2024-01-19T04:17:51.020998+0000","last_became_active":"2024-01-19T04:17:49.862265+0000","last_became_peered":"2024-01-19T04:17:49.862265+0000","last_unstale":"2024-01-19T04:17:51.020998+0000","last_undegraded":"2024-01-19T04:17:51.020998+0000","last_fullsized":"2024-01-19T04:17:51.020998+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:47.108625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.861871+0000","last_change":"2024-01-19T04:17:49.857659+0000","last_active":"2024-01-19T04:17:49.861871+0000","last_peered":"2024-01-19T04:17:49.861871+0000","last_clean":"2024-01-19T04:17:49.861871+0000","last_became_active":"2024-01-19T04:17:49.857365+0000","last_became_peered":"2024-01-19T04:17:49.857365+0000","last_unstale":"2024-01-19T04:17:49.861871+0000","last_undegraded":"2024-01-19T04:17:49.861871+0000","last_fullsized":"2024-01-19T04:17:49.861871+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:55.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.871060+0000","last_change":"2024-01-19T04:17:49.867051+0000","last_active":"2024-01-19T04:17:49.871060+0000","last_peered":"2024-01-19T04:17:49.871060+0000","last_clean":"2024-01-19T04:17:49.871060+0000","last_became_active":"2024-01-19T04:17:49.866731+0000","last_became_peered":"2024-01-19T04:17:49.866731+0000","last_unstale":"2024-01-19T04:17:49.871060+0000","last_undegraded":"2024-01-19T04:17:49.871060+0000","last_fullsized":"2024-01-19T04:17:49.871060+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:55.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.867842+0000","last_change":"2024-01-19T04:17:49.864851+0000","last_active":"2024-01-19T04:17:49.867842+0000","last_peered":"2024-01-19T04:17:49.867842+0000","last_clean":"2024-01-19T04:17:49.867842+0000","last_became_active":"2024-01-19T04:17:49.864521+0000","last_became_peered":"2024-01-19T04:17:49.864521+0000","last_unstale":"2024-01-19T04:17:49.867842+0000","last_undegraded":"2024-01-19T04:17:49.867842+0000","last_fullsized":"2024-01-19T04:17:49.867842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:19.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"70'4","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.875464+0000","last_change":"2024-01-19T04:17:48.825833+0000","last_active":"2024-01-19T04:17:49.875464+0000","last_peered":"2024-01-19T04:17:49.875464+0000","last_clean":"2024-01-19T04:17:49.875464+0000","last_became_active":"2024-01-19T04:17:48.825538+0000","last_became_peered":"2024-01-19T04:17:48.825538+0000","last_unstale":"2024-01-19T04:17:49.875464+0000","last_undegraded":"2024-01-19T04:17:49.875464+0000","last_fullsized":"2024-01-19T04:17:49.875464+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.873041+0000","last_change":"2024-01-19T04:17:49.870363+0000","last_active":"2024-01-19T04:17:49.873041+0000","last_peered":"2024-01-19T04:17:49.873041+0000","last_clean":"2024-01-19T04:17:49.873041+0000","last_became_active":"2024-01-19T04:17:49.867727+0000","last_became_peered":"2024-01-19T04:17:49.867727+0000","last_unstale":"2024-01-19T04:17:49.873041+0000","last_undegraded":"2024-01-19T04:17:49.873041+0000","last_fullsized":"2024-01-19T04:17:49.873041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:20.003637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.867631+0000","last_change":"2024-01-19T04:17:48.820675+0000","last_active":"2024-01-19T04:17:49.867631+0000","last_peered":"2024-01-19T04:17:49.867631+0000","last_clean":"2024-01-19T04:17:49.867631+0000","last_became_active":"2024-01-19T04:17:48.816249+0000","last_became_peered":"2024-01-19T04:17:48.816249+0000","last_unstale":"2024-01-19T04:17:49.867631+0000","last_undegraded":"2024-01-19T04:17:49.867631+0000","last_fullsized":"2024-01-19T04:17:49.867631+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.871034+0000","last_change":"2024-01-19T04:17:49.867990+0000","last_active":"2024-01-19T04:17:49.871034+0000","last_peered":"2024-01-19T04:17:49.871034+0000","last_clean":"2024-01-19T04:17:49.871034+0000","last_became_active":"2024-01-19T04:17:49.867492+0000","last_became_peered":"2024-01-19T04:17:49.867492+0000","last_unstale":"2024-01-19T04:17:49.871034+0000","last_undegraded":"2024-01-19T04:17:49.871034+0000","last_fullsized":"2024-01-19T04:17:49.871034+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:22.337221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.878323+0000","last_change":"2024-01-19T04:17:48.828840+0000","last_active":"2024-01-19T04:17:49.878323+0000","last_peered":"2024-01-19T04:17:49.878323+0000","last_clean":"2024-01-19T04:17:49.878323+0000","last_became_active":"2024-01-19T04:17:48.828585+0000","last_became_peered":"2024-01-19T04:17:48.828585+0000","last_unstale":"2024-01-19T04:17:49.878323+0000","last_undegraded":"2024-01-19T04:17:49.878323+0000","last_fullsized":"2024-01-19T04:17:49.878323+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:08.887937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876761+0000","last_change":"2024-01-19T04:17:49.873318+0000","last_active":"2024-01-19T04:17:49.876761+0000","last_peered":"2024-01-19T04:17:49.876761+0000","last_clean":"2024-01-19T04:17:49.876761+0000","last_became_active":"2024-01-19T04:17:49.873026+0000","last_became_peered":"2024-01-19T04:17:49.873026+0000","last_unstale":"2024-01-19T04:17:49.876761+0000","last_undegraded":"2024-01-19T04:17:49.876761+0000","last_fullsized":"2024-01-19T04:17:49.876761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.877750+0000","last_change":"2024-01-19T04:17:48.829724+0000","last_active":"2024-01-19T04:17:49.877750+0000","last_peered":"2024-01-19T04:17:49.877750+0000","last_clean":"2024-01-19T04:17:49.877750+0000","last_became_active":"2024-01-19T04:17:48.829371+0000","last_became_peered":"2024-01-19T04:17:48.829371+0000","last_unstale":"2024-01-19T04:17:49.877750+0000","last_undegraded":"2024-01-19T04:17:49.877750+0000","last_fullsized":"2024-01-19T04:17:49.877750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:37.979741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.021132+0000","last_change":"2024-01-19T04:17:49.865540+0000","last_active":"2024-01-19T04:17:51.021132+0000","last_peered":"2024-01-19T04:17:51.021132+0000","last_clean":"2024-01-19T04:17:51.021132+0000","last_became_active":"2024-01-19T04:17:49.858951+0000","last_became_peered":"2024-01-19T04:17:49.858951+0000","last_unstale":"2024-01-19T04:17:51.021132+0000","last_undegraded":"2024-01-19T04:17:51.021132+0000","last_fullsized":"2024-01-19T04:17:51.021132+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:40.979891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.860033+0000","last_change":"2024-01-19T04:17:48.822620+0000","last_active":"2024-01-19T04:17:49.860033+0000","last_peered":"2024-01-19T04:17:49.860033+0000","last_clean":"2024-01-19T04:17:49.860033+0000","last_became_active":"2024-01-19T04:17:48.822278+0000","last_became_peered":"2024-01-19T04:17:48.822278+0000","last_unstale":"2024-01-19T04:17:49.860033+0000","last_undegraded":"2024-01-19T04:17:49.860033+0000","last_fullsized":"2024-01-19T04:17:49.860033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.865691+0000","last_change":"2024-01-19T04:17:49.860631+0000","last_active":"2024-01-19T04:17:49.865691+0000","last_peered":"2024-01-19T04:17:49.865691+0000","last_clean":"2024-01-19T04:17:49.865691+0000","last_became_active":"2024-01-19T04:17:49.855956+0000","last_became_peered":"2024-01-19T04:17:49.855956+0000","last_unstale":"2024-01-19T04:17:49.865691+0000","last_undegraded":"2024-01-19T04:17:49.865691+0000","last_fullsized":"2024-01-19T04:17:49.865691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:01.541953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.857145+0000","last_change":"2024-01-19T04:17:48.818168+0000","last_active":"2024-01-19T04:17:49.857145+0000","last_peered":"2024-01-19T04:17:49.857145+0000","last_clean":"2024-01-19T04:17:49.857145+0000","last_became_active":"2024-01-19T04:17:48.816710+0000","last_became_peered":"2024-01-19T04:17:48.816710+0000","last_unstale":"2024-01-19T04:17:49.857145+0000","last_undegraded":"2024-01-19T04:17:49.857145+0000","last_fullsized":"2024-01-19T04:17:49.857145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.877372+0000","last_change":"2024-01-19T04:17:49.869314+0000","last_active":"2024-01-19T04:17:49.877372+0000","last_peered":"2024-01-19T04:17:49.877372+0000","last_clean":"2024-01-19T04:17:49.877372+0000","last_became_active":"2024-01-19T04:17:49.868926+0000","last_became_peered":"2024-01-19T04:17:49.868926+0000","last_unstale":"2024-01-19T04:17:49.877372+0000","last_undegraded":"2024-01-19T04:17:49.877372+0000","last_fullsized":"2024-01-19T04:17:49.877372+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.847464+0000","last_change":"2024-01-19T04:17:48.828497+0000","last_active":"2024-01-19T04:17:49.847464+0000","last_peered":"2024-01-19T04:17:49.847464+0000","last_clean":"2024-01-19T04:17:49.847464+0000","last_became_active":"2024-01-19T04:17:48.828243+0000","last_became_peered":"2024-01-19T04:17:48.828243+0000","last_unstale":"2024-01-19T04:17:49.847464+0000","last_undegraded":"2024-01-19T04:17:49.847464+0000","last_fullsized":"2024-01-19T04:17:49.847464+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:19.001153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020169+0000","last_change":"2024-01-19T04:17:49.858061+0000","last_active":"2024-01-19T04:17:51.020169+0000","last_peered":"2024-01-19T04:17:51.020169+0000","last_clean":"2024-01-19T04:17:51.020169+0000","last_became_active":"2024-01-19T04:17:49.857273+0000","last_became_peered":"2024-01-19T04:17:49.857273+0000","last_unstale":"2024-01-19T04:17:51.020169+0000","last_undegraded":"2024-01-19T04:17:51.020169+0000","last_fullsized":"2024-01-19T04:17:51.020169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:09:22.290458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.845526+0000","last_change":"2024-01-19T04:17:48.825064+0000","last_active":"2024-01-19T04:17:49.845526+0000","last_peered":"2024-01-19T04:17:49.845526+0000","last_clean":"2024-01-19T04:17:49.845526+0000","last_became_active":"2024-01-19T04:17:48.824540+0000","last_became_peered":"2024-01-19T04:17:48.824540+0000","last_unstale":"2024-01-19T04:17:49.845526+0000","last_undegraded":"2024-01-19T04:17:49.845526+0000","last_fullsized":"2024-01-19T04:17:49.845526+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:48.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020746+0000","last_change":"2024-01-19T04:17:49.857761+0000","last_active":"2024-01-19T04:17:51.020746+0000","last_peered":"2024-01-19T04:17:51.020746+0000","last_clean":"2024-01-19T04:17:51.020746+0000","last_became_active":"2024-01-19T04:17:49.857423+0000","last_became_peered":"2024-01-19T04:17:49.857423+0000","last_unstale":"2024-01-19T04:17:51.020746+0000","last_undegraded":"2024-01-19T04:17:51.020746+0000","last_fullsized":"2024-01-19T04:17:51.020746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:02.036657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.854140+0000","last_change":"2024-01-19T04:17:48.830083+0000","last_active":"2024-01-19T04:17:49.854140+0000","last_peered":"2024-01-19T04:17:49.854140+0000","last_clean":"2024-01-19T04:17:49.854140+0000","last_became_active":"2024-01-19T04:17:48.829733+0000","last_became_peered":"2024-01-19T04:17:48.829733+0000","last_unstale":"2024-01-19T04:17:49.854140+0000","last_undegraded":"2024-01-19T04:17:49.854140+0000","last_fullsized":"2024-01-19T04:17:49.854140+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.869727+0000","last_change":"2024-01-19T04:17:49.862638+0000","last_active":"2024-01-19T04:17:49.869727+0000","last_peered":"2024-01-19T04:17:49.869727+0000","last_clean":"2024-01-19T04:17:49.869727+0000","last_became_active":"2024-01-19T04:17:49.862288+0000","last_became_peered":"2024-01-19T04:17:49.862288+0000","last_unstale":"2024-01-19T04:17:49.869727+0000","last_undegraded":"2024-01-19T04:17:49.869727+0000","last_fullsized":"2024-01-19T04:17:49.869727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:24.996668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.849411+0000","last_change":"2024-01-19T04:17:48.828142+0000","last_active":"2024-01-19T04:17:49.849411+0000","last_peered":"2024-01-19T04:17:49.849411+0000","last_clean":"2024-01-19T04:17:49.849411+0000","last_became_active":"2024-01-19T04:17:48.827873+0000","last_became_peered":"2024-01-19T04:17:48.827873+0000","last_unstale":"2024-01-19T04:17:49.849411+0000","last_undegraded":"2024-01-19T04:17:49.849411+0000","last_fullsized":"2024-01-19T04:17:49.849411+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:50.852613+0000","last_change":"2024-01-19T04:17:49.870592+0000","last_active":"2024-01-19T04:17:50.852613+0000","last_peered":"2024-01-19T04:17:50.852613+0000","last_clean":"2024-01-19T04:17:50.852613+0000","last_became_active":"2024-01-19T04:17:49.868939+0000","last_became_peered":"2024-01-19T04:17:49.868939+0000","last_unstale":"2024-01-19T04:17:50.852613+0000","last_undegraded":"2024-01-19T04:17:50.852613+0000","last_fullsized":"2024-01-19T04:17:50.852613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"70'3","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876904+0000","last_change":"2024-01-19T04:17:48.825703+0000","last_active":"2024-01-19T04:17:49.876904+0000","last_peered":"2024-01-19T04:17:49.876904+0000","last_clean":"2024-01-19T04:17:49.876904+0000","last_became_active":"2024-01-19T04:17:48.825410+0000","last_became_peered":"2024-01-19T04:17:48.825410+0000","last_unstale":"2024-01-19T04:17:49.876904+0000","last_undegraded":"2024-01-19T04:17:49.876904+0000","last_fullsized":"2024-01-19T04:17:49.876904+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:59.028381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.865657+0000","last_change":"2024-01-19T04:17:49.859589+0000","last_active":"2024-01-19T04:17:49.865657+0000","last_peered":"2024-01-19T04:17:49.865657+0000","last_clean":"2024-01-19T04:17:49.865657+0000","last_became_active":"2024-01-19T04:17:49.857553+0000","last_became_peered":"2024-01-19T04:17:49.857553+0000","last_unstale":"2024-01-19T04:17:49.865657+0000","last_undegraded":"2024-01-19T04:17:49.865657+0000","last_fullsized":"2024-01-19T04:17:49.865657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:22.337221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"70'6","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.879407+0000","last_change":"2024-01-19T04:17:48.824771+0000","last_active":"2024-01-19T04:17:49.879407+0000","last_peered":"2024-01-19T04:17:49.879407+0000","last_clean":"2024-01-19T04:17:49.879407+0000","last_became_active":"2024-01-19T04:17:48.824480+0000","last_became_peered":"2024-01-19T04:17:48.824480+0000","last_unstale":"2024-01-19T04:17:49.879407+0000","last_undegraded":"2024-01-19T04:17:49.879407+0000","last_fullsized":"2024-01-19T04:17:49.879407+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:20.355098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:50.852248+0000","last_change":"2024-01-19T04:17:49.857760+0000","last_active":"2024-01-19T04:17:50.852248+0000","last_peered":"2024-01-19T04:17:50.852248+0000","last_clean":"2024-01-19T04:17:50.852248+0000","last_became_active":"2024-01-19T04:17:49.857510+0000","last_became_peered":"2024-01-19T04:17:49.857510+0000","last_unstale":"2024-01-19T04:17:50.852248+0000","last_undegraded":"2024-01-19T04:17:50.852248+0000","last_fullsized":"2024-01-19T04:17:50.852248+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876302+0000","last_change":"2024-01-19T04:17:48.831635+0000","last_active":"2024-01-19T04:17:49.876302+0000","last_peered":"2024-01-19T04:17:49.876302+0000","last_clean":"2024-01-19T04:17:49.876302+0000","last_became_active":"2024-01-19T04:17:48.831278+0000","last_became_peered":"2024-01-19T04:17:48.831278+0000","last_unstale":"2024-01-19T04:17:49.876302+0000","last_undegraded":"2024-01-19T04:17:49.876302+0000","last_fullsized":"2024-01-19T04:17:49.876302+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:54:07.418701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876696+0000","last_change":"2024-01-19T04:17:49.869971+0000","last_active":"2024-01-19T04:17:49.876696+0000","last_peered":"2024-01-19T04:17:49.876696+0000","last_clean":"2024-01-19T04:17:49.876696+0000","last_became_active":"2024-01-19T04:17:49.869655+0000","last_became_peered":"2024-01-19T04:17:49.869655+0000","last_unstale":"2024-01-19T04:17:49.876696+0000","last_undegraded":"2024-01-19T04:17:49.876696+0000","last_fullsized":"2024-01-19T04:17:49.876696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.843057+0000","last_change":"2024-01-19T04:17:48.821948+0000","last_active":"2024-01-19T04:17:49.843057+0000","last_peered":"2024-01-19T04:17:49.843057+0000","last_clean":"2024-01-19T04:17:49.843057+0000","last_became_active":"2024-01-19T04:17:48.821641+0000","last_became_peered":"2024-01-19T04:17:48.821641+0000","last_unstale":"2024-01-19T04:17:49.843057+0000","last_undegraded":"2024-01-19T04:17:49.843057+0000","last_fullsized":"2024-01-19T04:17:49.843057+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:08:27.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020996+0000","last_change":"2024-01-19T04:17:49.859758+0000","last_active":"2024-01-19T04:17:51.020996+0000","last_peered":"2024-01-19T04:17:51.020996+0000","last_clean":"2024-01-19T04:17:51.020996+0000","last_became_active":"2024-01-19T04:17:49.859488+0000","last_became_peered":"2024-01-19T04:17:49.859488+0000","last_unstale":"2024-01-19T04:17:51.020996+0000","last_undegraded":"2024-01-19T04:17:51.020996+0000","last_fullsized":"2024-01-19T04:17:51.020996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:45:04.083056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.861265+0000","last_change":"2024-01-19T04:17:48.819963+0000","last_active":"2024-01-19T04:17:49.861265+0000","last_peered":"2024-01-19T04:17:49.861265+0000","last_clean":"2024-01-19T04:17:49.861265+0000","last_became_active":"2024-01-19T04:17:48.819675+0000","last_became_peered":"2024-01-19T04:17:48.819675+0000","last_unstale":"2024-01-19T04:17:49.861265+0000","last_undegraded":"2024-01-19T04:17:49.861265+0000","last_fullsized":"2024-01-19T04:17:49.861265+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:54.388146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020424+0000","last_change":"2024-01-19T04:17:49.872258+0000","last_active":"2024-01-19T04:17:51.020424+0000","last_peered":"2024-01-19T04:17:51.020424+0000","last_clean":"2024-01-19T04:17:51.020424+0000","last_became_active":"2024-01-19T04:17:49.866662+0000","last_became_peered":"2024-01-19T04:17:49.866662+0000","last_unstale":"2024-01-19T04:17:51.020424+0000","last_undegraded":"2024-01-19T04:17:51.020424+0000","last_fullsized":"2024-01-19T04:17:51.020424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:39.241053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"70'8","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.879386+0000","last_change":"2024-01-19T04:17:48.827802+0000","last_active":"2024-01-19T04:17:49.879386+0000","last_peered":"2024-01-19T04:17:49.879386+0000","last_clean":"2024-01-19T04:17:49.879386+0000","last_became_active":"2024-01-19T04:17:48.827509+0000","last_became_peered":"2024-01-19T04:17:48.827509+0000","last_unstale":"2024-01-19T04:17:49.879386+0000","last_undegraded":"2024-01-19T04:17:49.879386+0000","last_fullsized":"2024-01-19T04:17:49.879386+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:00.539469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.874643+0000","last_change":"2024-01-19T04:17:49.869335+0000","last_active":"2024-01-19T04:17:49.874643+0000","last_peered":"2024-01-19T04:17:49.874643+0000","last_clean":"2024-01-19T04:17:49.874643+0000","last_became_active":"2024-01-19T04:17:49.869084+0000","last_became_peered":"2024-01-19T04:17:49.869084+0000","last_unstale":"2024-01-19T04:17:49.874643+0000","last_undegraded":"2024-01-19T04:17:49.874643+0000","last_fullsized":"2024-01-19T04:17:49.874643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.872774+0000","last_change":"2024-01-19T04:17:48.827720+0000","last_active":"2024-01-19T04:17:49.872774+0000","last_peered":"2024-01-19T04:17:49.872774+0000","last_clean":"2024-01-19T04:17:49.872774+0000","last_became_active":"2024-01-19T04:17:48.827302+0000","last_became_peered":"2024-01-19T04:17:48.827302+0000","last_unstale":"2024-01-19T04:17:49.872774+0000","last_undegraded":"2024-01-19T04:17:49.872774+0000","last_fullsized":"2024-01-19T04:17:49.872774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870597+0000","last_change":"2024-01-19T04:17:49.864846+0000","last_active":"2024-01-19T04:17:49.870597+0000","last_peered":"2024-01-19T04:17:49.870597+0000","last_clean":"2024-01-19T04:17:49.870597+0000","last_became_active":"2024-01-19T04:17:49.864174+0000","last_became_peered":"2024-01-19T04:17:49.864174+0000","last_unstale":"2024-01-19T04:17:49.870597+0000","last_undegraded":"2024-01-19T04:17:49.870597+0000","last_fullsized":"2024-01-19T04:17:49.870597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:21.357582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876716+0000","last_change":"2024-01-19T04:17:48.825969+0000","last_active":"2024-01-19T04:17:49.876716+0000","last_peered":"2024-01-19T04:17:49.876716+0000","last_clean":"2024-01-19T04:17:49.876716+0000","last_became_active":"2024-01-19T04:17:48.825702+0000","last_became_peered":"2024-01-19T04:17:48.825702+0000","last_unstale":"2024-01-19T04:17:49.876716+0000","last_undegraded":"2024-01-19T04:17:49.876716+0000","last_fullsized":"2024-01-19T04:17:49.876716+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:15.428133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.865639+0000","last_change":"2024-01-19T04:17:49.858592+0000","last_active":"2024-01-19T04:17:49.865639+0000","last_peered":"2024-01-19T04:17:49.865639+0000","last_clean":"2024-01-19T04:17:49.865639+0000","last_became_active":"2024-01-19T04:17:49.857116+0000","last_became_peered":"2024-01-19T04:17:49.857116+0000","last_unstale":"2024-01-19T04:17:49.865639+0000","last_undegraded":"2024-01-19T04:17:49.865639+0000","last_fullsized":"2024-01-19T04:17:49.865639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:24.996668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.848342+0000","last_change":"2024-01-19T04:17:48.830964+0000","last_active":"2024-01-19T04:17:49.848342+0000","last_peered":"2024-01-19T04:17:49.848342+0000","last_clean":"2024-01-19T04:17:49.848342+0000","last_became_active":"2024-01-19T04:17:48.830676+0000","last_became_peered":"2024-01-19T04:17:48.830676+0000","last_unstale":"2024-01-19T04:17:49.848342+0000","last_undegraded":"2024-01-19T04:17:49.848342+0000","last_fullsized":"2024-01-19T04:17:49.848342+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:11.625353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.019858+0000","last_change":"2024-01-19T04:17:49.858880+0000","last_active":"2024-01-19T04:17:51.019858+0000","last_peered":"2024-01-19T04:17:51.019858+0000","last_clean":"2024-01-19T04:17:51.019858+0000","last_became_active":"2024-01-19T04:17:49.856868+0000","last_became_peered":"2024-01-19T04:17:49.856868+0000","last_unstale":"2024-01-19T04:17:51.019858+0000","last_undegraded":"2024-01-19T04:17:51.019858+0000","last_fullsized":"2024-01-19T04:17:51.019858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:54.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.856367+0000","last_change":"2024-01-19T04:17:48.827089+0000","last_active":"2024-01-19T04:17:49.856367+0000","last_peered":"2024-01-19T04:17:49.856367+0000","last_clean":"2024-01-19T04:17:49.856367+0000","last_became_active":"2024-01-19T04:17:48.826683+0000","last_became_peered":"2024-01-19T04:17:48.826683+0000","last_unstale":"2024-01-19T04:17:49.856367+0000","last_undegraded":"2024-01-19T04:17:49.856367+0000","last_fullsized":"2024-01-19T04:17:49.856367+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:57:37.292333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.870225+0000","last_change":"2024-01-19T04:17:49.863061+0000","last_active":"2024-01-19T04:17:49.870225+0000","last_peered":"2024-01-19T04:17:49.870225+0000","last_clean":"2024-01-19T04:17:49.870225+0000","last_became_active":"2024-01-19T04:17:49.862748+0000","last_became_peered":"2024-01-19T04:17:49.862748+0000","last_unstale":"2024-01-19T04:17:49.870225+0000","last_undegraded":"2024-01-19T04:17:49.870225+0000","last_fullsized":"2024-01-19T04:17:49.870225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:22.337221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.838589+0000","last_change":"2024-01-19T04:17:48.831189+0000","last_active":"2024-01-19T04:17:49.838589+0000","last_peered":"2024-01-19T04:17:49.838589+0000","last_clean":"2024-01-19T04:17:49.838589+0000","last_became_active":"2024-01-19T04:17:48.830902+0000","last_became_peered":"2024-01-19T04:17:48.830902+0000","last_unstale":"2024-01-19T04:17:49.838589+0000","last_undegraded":"2024-01-19T04:17:49.838589+0000","last_fullsized":"2024-01-19T04:17:49.838589+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:00.718052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.019558+0000","last_change":"2024-01-19T04:17:49.868600+0000","last_active":"2024-01-19T04:17:51.019558+0000","last_peered":"2024-01-19T04:17:51.019558+0000","last_clean":"2024-01-19T04:17:51.019558+0000","last_became_active":"2024-01-19T04:17:49.868291+0000","last_became_peered":"2024-01-19T04:17:49.868291+0000","last_unstale":"2024-01-19T04:17:51.019558+0000","last_undegraded":"2024-01-19T04:17:51.019558+0000","last_fullsized":"2024-01-19T04:17:51.019558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:42:11.307285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.838515+0000","last_change":"2024-01-19T04:17:48.825930+0000","last_active":"2024-01-19T04:17:49.838515+0000","last_peered":"2024-01-19T04:17:49.838515+0000","last_clean":"2024-01-19T04:17:49.838515+0000","last_became_active":"2024-01-19T04:17:48.825661+0000","last_became_peered":"2024-01-19T04:17:48.825661+0000","last_unstale":"2024-01-19T04:17:49.838515+0000","last_undegraded":"2024-01-19T04:17:49.838515+0000","last_fullsized":"2024-01-19T04:17:49.838515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:24.692647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.875572+0000","last_change":"2024-01-19T04:17:49.869790+0000","last_active":"2024-01-19T04:17:49.875572+0000","last_peered":"2024-01-19T04:17:49.875572+0000","last_clean":"2024-01-19T04:17:49.875572+0000","last_became_active":"2024-01-19T04:17:49.869425+0000","last_became_peered":"2024-01-19T04:17:49.869425+0000","last_unstale":"2024-01-19T04:17:49.875572+0000","last_undegraded":"2024-01-19T04:17:49.875572+0000","last_fullsized":"2024-01-19T04:17:49.875572+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:20.003637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.843326+0000","last_change":"2024-01-19T04:17:48.818976+0000","last_active":"2024-01-19T04:17:49.843326+0000","last_peered":"2024-01-19T04:17:49.843326+0000","last_clean":"2024-01-19T04:17:49.843326+0000","last_became_active":"2024-01-19T04:17:48.818650+0000","last_became_peered":"2024-01-19T04:17:48.818650+0000","last_unstale":"2024-01-19T04:17:49.843326+0000","last_undegraded":"2024-01-19T04:17:49.843326+0000","last_fullsized":"2024-01-19T04:17:49.843326+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:06:19.196961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.867823+0000","last_change":"2024-01-19T04:17:49.863529+0000","last_active":"2024-01-19T04:17:49.867823+0000","last_peered":"2024-01-19T04:17:49.867823+0000","last_clean":"2024-01-19T04:17:49.867823+0000","last_became_active":"2024-01-19T04:17:49.863271+0000","last_became_peered":"2024-01-19T04:17:49.863271+0000","last_unstale":"2024-01-19T04:17:49.867823+0000","last_undegraded":"2024-01-19T04:17:49.867823+0000","last_fullsized":"2024-01-19T04:17:49.867823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:20.003637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.864547+0000","last_change":"2024-01-19T04:17:48.833146+0000","last_active":"2024-01-19T04:17:49.864547+0000","last_peered":"2024-01-19T04:17:49.864547+0000","last_clean":"2024-01-19T04:17:49.864547+0000","last_became_active":"2024-01-19T04:17:48.832826+0000","last_became_peered":"2024-01-19T04:17:48.832826+0000","last_unstale":"2024-01-19T04:17:49.864547+0000","last_undegraded":"2024-01-19T04:17:49.864547+0000","last_fullsized":"2024-01-19T04:17:49.864547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:42:10.304801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.874131+0000","last_change":"2024-01-19T04:17:49.868872+0000","last_active":"2024-01-19T04:17:49.874131+0000","last_peered":"2024-01-19T04:17:49.874131+0000","last_clean":"2024-01-19T04:17:49.874131+0000","last_became_active":"2024-01-19T04:17:49.867227+0000","last_became_peered":"2024-01-19T04:17:49.867227+0000","last_unstale":"2024-01-19T04:17:49.874131+0000","last_undegraded":"2024-01-19T04:17:49.874131+0000","last_fullsized":"2024-01-19T04:17:49.874131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:09.890421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.021213+0000","last_change":"2024-01-19T04:17:48.832316+0000","last_active":"2024-01-19T04:17:51.021213+0000","last_peered":"2024-01-19T04:17:51.021213+0000","last_clean":"2024-01-19T04:17:51.021213+0000","last_became_active":"2024-01-19T04:17:48.831448+0000","last_became_peered":"2024-01-19T04:17:48.831448+0000","last_unstale":"2024-01-19T04:17:51.021213+0000","last_undegraded":"2024-01-19T04:17:51.021213+0000","last_fullsized":"2024-01-19T04:17:51.021213+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:13.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.878673+0000","last_change":"2024-01-19T04:17:49.873308+0000","last_active":"2024-01-19T04:17:49.878673+0000","last_peered":"2024-01-19T04:17:49.878673+0000","last_clean":"2024-01-19T04:17:49.878673+0000","last_became_active":"2024-01-19T04:17:49.872896+0000","last_became_peered":"2024-01-19T04:17:49.872896+0000","last_unstale":"2024-01-19T04:17:49.878673+0000","last_undegraded":"2024-01-19T04:17:49.878673+0000","last_fullsized":"2024-01-19T04:17:49.878673+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:16.430617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.848227+0000","last_change":"2024-01-19T04:17:48.826005+0000","last_active":"2024-01-19T04:17:49.848227+0000","last_peered":"2024-01-19T04:17:49.848227+0000","last_clean":"2024-01-19T04:17:49.848227+0000","last_became_active":"2024-01-19T04:17:48.825576+0000","last_became_peered":"2024-01-19T04:17:48.825576+0000","last_unstale":"2024-01-19T04:17:49.848227+0000","last_undegraded":"2024-01-19T04:17:49.848227+0000","last_fullsized":"2024-01-19T04:17:49.848227+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:39.977407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.857352+0000","last_change":"2024-01-19T04:17:49.853797+0000","last_active":"2024-01-19T04:17:49.857352+0000","last_peered":"2024-01-19T04:17:49.857352+0000","last_clean":"2024-01-19T04:17:49.857352+0000","last_became_active":"2024-01-19T04:17:49.853513+0000","last_became_peered":"2024-01-19T04:17:49.853513+0000","last_unstale":"2024-01-19T04:17:49.857352+0000","last_undegraded":"2024-01-19T04:17:49.857352+0000","last_fullsized":"2024-01-19T04:17:49.857352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:26:02.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.852740+0000","last_change":"2024-01-19T04:17:48.824215+0000","last_active":"2024-01-19T04:17:49.852740+0000","last_peered":"2024-01-19T04:17:49.852740+0000","last_clean":"2024-01-19T04:17:49.852740+0000","last_became_active":"2024-01-19T04:17:48.823939+0000","last_became_peered":"2024-01-19T04:17:48.823939+0000","last_unstale":"2024-01-19T04:17:49.852740+0000","last_undegraded":"2024-01-19T04:17:49.852740+0000","last_fullsized":"2024-01-19T04:17:49.852740+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.875615+0000","last_change":"2024-01-19T04:17:49.871059+0000","last_active":"2024-01-19T04:17:49.875615+0000","last_peered":"2024-01-19T04:17:49.875615+0000","last_clean":"2024-01-19T04:17:49.875615+0000","last_became_active":"2024-01-19T04:17:49.870787+0000","last_became_peered":"2024-01-19T04:17:49.870787+0000","last_unstale":"2024-01-19T04:17:49.875615+0000","last_undegraded":"2024-01-19T04:17:49.875615+0000","last_fullsized":"2024-01-19T04:17:49.875615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:19.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.847741+0000","last_change":"2024-01-19T04:17:48.829763+0000","last_active":"2024-01-19T04:17:49.847741+0000","last_peered":"2024-01-19T04:17:49.847741+0000","last_clean":"2024-01-19T04:17:49.847741+0000","last_became_active":"2024-01-19T04:17:48.829423+0000","last_became_peered":"2024-01-19T04:17:48.829423+0000","last_unstale":"2024-01-19T04:17:49.847741+0000","last_undegraded":"2024-01-19T04:17:49.847741+0000","last_fullsized":"2024-01-19T04:17:49.847741+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:18.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:50.852487+0000","last_change":"2024-01-19T04:17:49.853592+0000","last_active":"2024-01-19T04:17:50.852487+0000","last_peered":"2024-01-19T04:17:50.852487+0000","last_clean":"2024-01-19T04:17:50.852487+0000","last_became_active":"2024-01-19T04:17:49.853258+0000","last_became_peered":"2024-01-19T04:17:49.853258+0000","last_unstale":"2024-01-19T04:17:50.852487+0000","last_undegraded":"2024-01-19T04:17:50.852487+0000","last_fullsized":"2024-01-19T04:17:50.852487+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.842488+0000","last_change":"2024-01-19T04:17:48.818290+0000","last_active":"2024-01-19T04:17:49.842488+0000","last_peered":"2024-01-19T04:17:49.842488+0000","last_clean":"2024-01-19T04:17:49.842488+0000","last_became_active":"2024-01-19T04:17:48.816299+0000","last_became_peered":"2024-01-19T04:17:48.816299+0000","last_unstale":"2024-01-19T04:17:49.842488+0000","last_undegraded":"2024-01-19T04:17:49.842488+0000","last_fullsized":"2024-01-19T04:17:49.842488+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.879081+0000","last_change":"2024-01-19T04:17:49.877548+0000","last_active":"2024-01-19T04:17:49.879081+0000","last_peered":"2024-01-19T04:17:49.879081+0000","last_clean":"2024-01-19T04:17:49.879081+0000","last_became_active":"2024-01-19T04:17:49.877156+0000","last_became_peered":"2024-01-19T04:17:49.877156+0000","last_unstale":"2024-01-19T04:17:49.879081+0000","last_undegraded":"2024-01-19T04:17:49.879081+0000","last_fullsized":"2024-01-19T04:17:49.879081+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.846305+0000","last_change":"2024-01-19T04:17:48.826712+0000","last_active":"2024-01-19T04:17:49.846305+0000","last_peered":"2024-01-19T04:17:49.846305+0000","last_clean":"2024-01-19T04:17:49.846305+0000","last_became_active":"2024-01-19T04:17:48.826457+0000","last_became_peered":"2024-01-19T04:17:48.826457+0000","last_unstale":"2024-01-19T04:17:49.846305+0000","last_undegraded":"2024-01-19T04:17:49.846305+0000","last_fullsized":"2024-01-19T04:17:49.846305+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:55.231352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.868986+0000","last_change":"2024-01-19T04:17:49.862665+0000","last_active":"2024-01-19T04:17:49.868986+0000","last_peered":"2024-01-19T04:17:49.868986+0000","last_clean":"2024-01-19T04:17:49.868986+0000","last_became_active":"2024-01-19T04:17:49.862396+0000","last_became_peered":"2024-01-19T04:17:49.862396+0000","last_unstale":"2024-01-19T04:17:49.868986+0000","last_undegraded":"2024-01-19T04:17:49.868986+0000","last_fullsized":"2024-01-19T04:17:49.868986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:41:01.734672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.842727+0000","last_change":"2024-01-19T04:17:48.826398+0000","last_active":"2024-01-19T04:17:49.842727+0000","last_peered":"2024-01-19T04:17:49.842727+0000","last_clean":"2024-01-19T04:17:49.842727+0000","last_became_active":"2024-01-19T04:17:48.824417+0000","last_became_peered":"2024-01-19T04:17:48.824417+0000","last_unstale":"2024-01-19T04:17:49.842727+0000","last_undegraded":"2024-01-19T04:17:49.842727+0000","last_fullsized":"2024-01-19T04:17:49.842727+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-19T04:17:51.020623+0000","last_change":"2024-01-19T04:17:49.870926+0000","last_active":"2024-01-19T04:17:51.020623+0000","last_peered":"2024-01-19T04:17:51.020623+0000","last_clean":"2024-01-19T04:17:51.020623+0000","last_became_active":"2024-01-19T04:17:49.870647+0000","last_became_peered":"2024-01-19T04:17:49.870647+0000","last_unstale":"2024-01-19T04:17:51.020623+0000","last_undegraded":"2024-01-19T04:17:51.020623+0000","last_fullsized":"2024-01-19T04:17:51.020623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:01.549284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-19T04:17:49.876745+0000","last_change":"2024-01-19T04:17:48.826402+0000","last_active":"2024-01-19T04:17:49.876745+0000","last_peered":"2024-01-19T04:17:49.876745+0000","last_clean":"2024-01-19T04:17:49.876745+0000","last_became_active":"2024-01-19T04:17:48.826139+0000","last_became_peered":"2024-01-19T04:17:48.826139+0000","last_unstale":"2024-01-19T04:17:49.876745+0000","last_undegraded":"2024-01-19T04:17:49.876745+0000","last_fullsized":"2024-01-19T04:17:49.876745+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:15.428133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-19T04:17:48.817559+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:17:48.817559+0000","last_peered":"2024-01-19T04:17:48.817559+0000","last_clean":"2024-01-19T04:17:48.817559+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:17:48.817559+0000","last_undegraded":"2024-01-19T04:17:48.817559+0000","last_fullsized":"2024-01-19T04:17:48.817559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476775,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1429504,"data_stored":950451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0569999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.79200000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.53500000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":1.228,"15min":1.228},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.024,"5min":1.661,"15min":1.661},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.81499999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.84099999999999997,"15min":0.85599999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":1.49,"15min":1.49},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.628},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1579999999999999,"5min":1.514,"15min":1.514},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:16:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":1.391,"15min":1.391},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0289999999999999,"5min":1.359,"15min":1.359},"last":0.65700000000000003}]}]},{"osd":6,"up_from":16,"seq":68719476775,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":360083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85399999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67600000000000005,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.93500000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.871}]},{"osd":2,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.111,"15min":1.111},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1459999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1220000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88800000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.127},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0720000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:16:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.026,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0960000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476774,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":360083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98299999999999998,"5min":1.107,"15min":1.107},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.246,"15min":1.246},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:16:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.878},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0820000000000001,"5min":1.708,"15min":1.708},"last":0.96199999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476776,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":360083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.54300000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.622}]},{"osd":3,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.381,"15min":1.381},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.095,"15min":1.095},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0940000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.497}]},{"osd":7,"last update":"Fri Jan 19 04:16:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.139,"15min":1.139},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1120000000000001,"5min":1.266,"15min":1.266},"last":0.57999999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":373740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.371},{"interface":"front","average":{"1min":0.439,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54700000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.439}]},{"osd":1,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.503},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.63300000000000001,"5min":0.879,"15min":0.879},"last":0.499},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95799999999999996,"5min":1.016,"15min":1.016},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.89500000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.626,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93000000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.879},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:16:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98199999999999998,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.71799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":373352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.41699999999999998},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":1.964,"15min":1.964},"last":0.5}]},{"osd":2,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55800000000000005,"15min":0.58599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64900000000000002,"5min":2.827,"15min":2.827},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56200000000000006,"5min":2.343,"15min":2.343},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":1.665,"15min":1.665},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.042,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92900000000000005,"5min":1.198,"15min":1.198},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0089999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0600000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.878,"15min":0.93899999999999995},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.67800000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":963560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59499999999999997,"15min":0.627},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.53900000000000003,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.60999999999999999,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60799999999999998,"5min":3.129,"15min":3.129},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.66700000000000004,"15min":0.69999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44}]},{"osd":3,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.72299999999999998,"15min":0.755},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.61299999999999999,"5min":3.633,"15min":3.633},"last":0.498},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.59499999999999997,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93200000000000005,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.96299999999999997,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89500000000000002,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":1.004,"15min":1.052},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0469999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":1.034,"15min":1.0860000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97499999999999998,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.96799999999999997,"15min":1.008},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.85099999999999998,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.876,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75,"5min":1.052,"15min":1.1020000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95099999999999996,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.81100000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":872448,"data_stored":374770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.54600000000000004,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66600000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.77600000000000002,"15min":0.81799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82699999999999996,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.498},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.65300000000000002,"15min":0.68300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78500000000000003,"5min":5.226,"15min":5.226},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72299999999999998,"5min":5.319,"15min":5.319},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.745,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96599999999999997,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.085,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.54900000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.01,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.133,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.093,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.92300000000000004,"15min":0.95199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93999999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:16:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.165,"5min":5.423,"15min":5.423},"last":0.745},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1459999999999999,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:17:54.351 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:17:54.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-19T04:17:54.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.536+0000 7f0e02c00640 1 Processor -- start 2024-01-19T04:17:54.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.536+0000 7f0e02c00640 1 -- start start 2024-01-19T04:17:54.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e02c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc0c1000 0x7f0dfc0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e02c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc06a6a0 con 0x7f0dfc06f5b0 2024-01-19T04:17:54.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e02c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc154e70 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e02c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc155150 con 0x7f0dfc0c1000 2024-01-19T04:17:54.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0dfb400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0dfc06f5b0 0x7f0dfc06ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49518/0 (socket says 172.21.15.32:49518) 2024-01-19T04:17:54.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0dfb400640 1 -- 172.21.15.32:0/3944666460 learned_addr learned my addr 172.21.15.32:0/3944666460 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:54.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e00c00640 1 --2- 172.21.15.32:0/3944666460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc0c1000 0x7f0dfc0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0dfaa00640 1 -- 172.21.15.32:0/3944666460 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219763367 0 0) 0x7f0dfc06a6a0 con 0x7f0dfc06f5b0 2024-01-19T04:17:54.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0dfaa00640 1 -- 172.21.15.32:0/3944666460 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ddc003530 con 0x7f0dfc06f5b0 2024-01-19T04:17:54.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e00c00640 1 -- 172.21.15.32:0/3944666460 >> v1:172.21.15.67:6789/0 conn(0x7f0dfc0c15c0 legacy=0x7f0dfc154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e00c00640 1 -- 172.21.15.32:0/3944666460 >> v1:172.21.15.32:6789/0 conn(0x7f0dfc06f5b0 legacy=0x7f0dfc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0dfaa00640 1 -- 172.21.15.32:0/3944666460 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629474260 0 0) 0x7f0dfc154e70 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.540+0000 7f0e00c00640 1 -- 172.21.15.32:0/3944666460 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc155430 con 0x7f0dfc0c1000 2024-01-19T04:17:54.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e00c00640 1 --2- 172.21.15.32:0/3944666460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc0c1000 0x7f0dfc0c19a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009dc0 tx=0x7f0df401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bae66419ebe67a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0dfaa00640 1 -- 172.21.15.32:0/3944666460 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40a5940 con 0x7f0dfc0c1000 2024-01-19T04:17:54.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0dfaa00640 1 -- 172.21.15.32:0/3944666460 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df40a5aa0 con 0x7f0dfc0c1000 2024-01-19T04:17:54.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0dfaa00640 1 -- 172.21.15.32:0/3944666460 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40a5e30 con 0x7f0dfc0c1000 2024-01-19T04:17:54.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- 172.21.15.32:0/3944666460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc0c1000 msgr2=0x7f0dfc0c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 --2- 172.21.15.32:0/3944666460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc0c1000 0x7f0dfc0c19a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009dc0 tx=0x7f0df401c8e0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- 172.21.15.32:0/3944666460 shutdown_connections 2024-01-19T04:17:54.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 --2- 172.21.15.32:0/3944666460 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc0c1000 0x7f0dfc0c19a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- 172.21.15.32:0/3944666460 >> 172.21.15.32:0/3944666460 conn(0x7f0dfc0c36c0 msgr2=0x7f0dfc0c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:54.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- 172.21.15.32:0/3944666460 shutdown_connections 2024-01-19T04:17:54.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- 172.21.15.32:0/3944666460 wait complete. 2024-01-19T04:17:54.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 Processor -- start 2024-01-19T04:17:54.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- start start 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc06f5b0 0x7f0dfc0aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0c1000 0x7f0dfc1ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dfc0c15c0 0x7f0dfc0aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc1518e0 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc14ff50 con 0x7f0dfc0c1000 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.544+0000 7f0e02c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc1ec910 con 0x7f0dfc06f5b0 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dfc0c15c0 0x7f0dfc0aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dfc0c15c0 0x7f0dfc0aa7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60670/0 (socket says 172.21.15.32:60670) 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 -- 172.21.15.32:0/2991395953 learned_addr learned my addr 172.21.15.32:0/2991395953 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0dfb400640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0c1000 0x7f0dfc1ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0dfbe00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc06f5b0 0x7f0dfc0aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 -- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc06f5b0 msgr2=0x7f0dfc0aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc06f5b0 0x7f0dfc0aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 -- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0c1000 msgr2=0x7f0dfc1ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0c1000 0x7f0dfc1ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 -- 172.21.15.32:0/2991395953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4009a70 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e00c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dfc0c15c0 0x7f0dfc0aa7c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0df40b0040 tx=0x7f0df4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0df3e00640 1 -- 172.21.15.32:0/2991395953 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40add50 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0df3e00640 1 -- 172.21.15.32:0/2991395953 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4009450 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc1ecbb0 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0df3e00640 1 -- 172.21.15.32:0/2991395953 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4003bc0 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc151320 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc04f1d0 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.548+0000 7f0df3e00640 1 -- 172.21.15.32:0/2991395953 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0df40b4050 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.552+0000 7f0df3e00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0dd4066500 0x7f0dd40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.552+0000 7f0df3e00640 1 -- 172.21.15.32:0/2991395953 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0df411f130 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.552+0000 7f0dfbe00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0dd4066500 0x7f0dd40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.552+0000 7f0dfbe00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0dd4066500 0x7f0dd40689c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0dec000f70 tx=0x7f0dec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.556+0000 7f0df3e00640 1 -- 172.21.15.32:0/2991395953 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0df40ec510 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.772+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0dfc0749f0 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.776+0000 7f0df3e00640 1 -- 172.21.15.32:0/2991395953 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0df40efb30 con 0x7f0dfc0c15c0 2024-01-19T04:17:54.780 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-01-19T04:17:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAC96llIsPnOhAArLiZE1sjdY34nxalYwuu/Q== 2024-01-19T04:17:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-01-19T04:17:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-01-19T04:17:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-19T04:17:54.781 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0dd4066500 msgr2=0x7f0dd40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0dd4066500 0x7f0dd40689c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0dec000f70 tx=0x7f0dec009040 comp rx=0 tx=0).stop 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dfc0c15c0 msgr2=0x7f0dfc0aa7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dfc0c15c0 0x7f0dfc0aa7c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0df40b0040 tx=0x7f0df4019680 comp rx=0 tx=0).stop 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 shutdown_connections 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0dd4066500 0x7f0dd40689c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dfc0c15c0 0x7f0dfc0aa7c0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0dfc0c1000 0x7f0dfc1ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 --2- 172.21.15.32:0/2991395953 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0dfc06f5b0 0x7f0dfc0aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 >> 172.21.15.32:0/2991395953 conn(0x7f0dfc0c36c0 msgr2=0x7f0dfc0c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 shutdown_connections 2024-01-19T04:17:54.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.780+0000 7f0e02c00640 1 -- 172.21.15.32:0/2991395953 wait complete. 2024-01-19T04:17:54.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:17:54.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff228600640 1 Processor -- start 2024-01-19T04:17:54.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff228600640 1 -- start start 2024-01-19T04:17:54.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff228600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2200c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff228600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2200a6d30 0x7ff2200c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff228600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2201533a0 con 0x7ff22006fda0 2024-01-19T04:17:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff228600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff220156380 con 0x7ff2200a6d30 2024-01-19T04:17:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff228600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22014fe40 con 0x7ff2200c6e20 2024-01-19T04:17:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff226600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff22006fda0 0x7ff220152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49526/0 (socket says 172.21.15.32:49526) 2024-01-19T04:17:54.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff226600640 1 -- 172.21.15.32:0/3717190575 learned_addr learned my addr 172.21.15.32:0/3717190575 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff225c00640 1 --2- 172.21.15.32:0/3717190575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2200c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff225200640 1 --2- 172.21.15.32:0/3717190575 >> v2:172.21.15.67:3300/0 conn(0x7ff2200a6d30 0x7ff2200c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff21fe00640 1 -- 172.21.15.32:0/3717190575 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112655456 0 0) 0x7ff2180014a0 con 0x7ff22006fda0 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff21fe00640 1 -- 172.21.15.32:0/3717190575 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff200003530 con 0x7ff22006fda0 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff225c00640 1 -- 172.21.15.32:0/3717190575 >> v2:172.21.15.67:3300/0 conn(0x7ff2200a6d30 msgr2=0x7ff2200c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff225c00640 1 --2- 172.21.15.32:0/3717190575 >> v2:172.21.15.67:3300/0 conn(0x7ff2200a6d30 0x7ff2200c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff225c00640 1 -- 172.21.15.32:0/3717190575 >> v1:172.21.15.32:6789/0 conn(0x7ff22006fda0 legacy=0x7ff220152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff225c00640 1 -- 172.21.15.32:0/3717190575 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220152800 con 0x7ff2200c6e20 2024-01-19T04:17:54.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.944+0000 7ff225200640 1 --2- 172.21.15.32:0/3717190575 >> v2:172.21.15.67:3300/0 conn(0x7ff2200a6d30 0x7ff2200c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:54.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.948+0000 7ff225c00640 1 --2- 172.21.15.32:0/3717190575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2200c7200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff2100097c0 tx=0x7ff21001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d8ab2db23b0ed1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.948+0000 7ff21fe00640 1 -- 172.21.15.32:0/3717190575 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100ad660 con 0x7ff2200c6e20 2024-01-19T04:17:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.948+0000 7ff21fe00640 1 -- 172.21.15.32:0/3717190575 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100ad7c0 con 0x7ff2200c6e20 2024-01-19T04:17:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.948+0000 7ff21fe00640 1 -- 172.21.15.32:0/3717190575 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100adb50 con 0x7ff2200c6e20 2024-01-19T04:17:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.948+0000 7ff228600640 1 -- 172.21.15.32:0/3717190575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 msgr2=0x7ff2200c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.948+0000 7ff228600640 1 --2- 172.21.15.32:0/3717190575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2200c7200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff2100097c0 tx=0x7ff21001c360 comp rx=0 tx=0).stop 2024-01-19T04:17:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- 172.21.15.32:0/3717190575 shutdown_connections 2024-01-19T04:17:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 --2- 172.21.15.32:0/3717190575 >> v2:172.21.15.67:3300/0 conn(0x7ff2200a6d30 0x7ff2200c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 --2- 172.21.15.32:0/3717190575 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2200c7200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- 172.21.15.32:0/3717190575 >> 172.21.15.32:0/3717190575 conn(0x7ff2200a9870 msgr2=0x7ff2200a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- 172.21.15.32:0/3717190575 shutdown_connections 2024-01-19T04:17:54.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- 172.21.15.32:0/3717190575 wait complete. 2024-01-19T04:17:54.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 Processor -- start 2024-01-19T04:17:54.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- start start 2024-01-19T04:17:54.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22006fda0 0x7ff2201f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2200a6d30 0x7ff22014e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2201ecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201f0150 con 0x7ff2200a6d30 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22014b020 con 0x7ff22006fda0 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff228600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201f03a0 con 0x7ff2200c6e20 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2200a6d30 0x7ff22014e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2200a6d30 0x7ff22014e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60676/0 (socket says 172.21.15.32:60676) 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 -- 172.21.15.32:0/3852539642 learned_addr learned my addr 172.21.15.32:0/3852539642 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225c00640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22006fda0 0x7ff2201f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff226600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2201ecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 -- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 msgr2=0x7ff2201ecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2201ecbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 -- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22006fda0 msgr2=0x7ff2201f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22006fda0 0x7ff2201f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.952+0000 7ff225200640 1 -- 172.21.15.32:0/3852539642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208009420 con 0x7ff2200a6d30 2024-01-19T04:17:54.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff225200640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2200a6d30 0x7ff22014e580 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff20800e9d0 tx=0x7ff20800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff21d600640 1 -- 172.21.15.32:0/3852539642 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800ca60 con 0x7ff2200a6d30 2024-01-19T04:17:54.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff21d600640 1 -- 172.21.15.32:0/3852539642 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20800cbc0 con 0x7ff2200a6d30 2024-01-19T04:17:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff21d600640 1 -- 172.21.15.32:0/3852539642 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208013470 con 0x7ff2200a6d30 2024-01-19T04:17:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff210009420 con 0x7ff2200a6d30 2024-01-19T04:17:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22014eac0 con 0x7ff2200a6d30 2024-01-19T04:17:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2200749f0 con 0x7ff2200a6d30 2024-01-19T04:17:54.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff21d600640 1 -- 172.21.15.32:0/3852539642 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff2080135d0 con 0x7ff2200a6d30 2024-01-19T04:17:54.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff21d600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff1f8066500 0x7ff1f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:54.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff21d600640 1 -- 172.21.15.32:0/3852539642 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff208083d70 con 0x7ff2200a6d30 2024-01-19T04:17:54.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.956+0000 7ff225c00640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff1f8066500 0x7ff1f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:54.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.960+0000 7ff225c00640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff1f8066500 0x7ff1f80689c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff2100af000 tx=0x7ff2100a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:54.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:54.960+0000 7ff21d600640 1 -- 172.21.15.32:0/3852539642 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff2080510b0 con 0x7ff2200a6d30 2024-01-19T04:17:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.152+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff220067b80 con 0x7ff2200a6d30 2024-01-19T04:17:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.152+0000 7ff21d600640 1 -- 172.21.15.32:0/3852539642 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4934 (secure 0 0 0) 0x7ff2080546d0 con 0x7ff2200a6d30 2024-01-19T04:17:55.156 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:55.156 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6564,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:49.203878+0000","modified":"2024-01-19T04:17:52.248717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/208534071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":208534071},{"type":"v1","addr":"172.21.15.67:6837","nonce":208534071}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-01-19T04:17:55.157 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 47 2024-01-19T04:17:55.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff1f8066500 msgr2=0x7ff1f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff1f8066500 0x7ff1f80689c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff2100af000 tx=0x7ff2100a7000 comp rx=0 tx=0).stop 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2200a6d30 msgr2=0x7ff22014e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2200a6d30 0x7ff22014e580 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff20800e9d0 tx=0x7ff20800ee90 comp rx=0 tx=0).stop 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 shutdown_connections 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff1f8066500 0x7ff1f80689c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff2200c6e20 0x7ff2201ecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2200a6d30 0x7ff22014e580 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 --2- 172.21.15.32:0/3852539642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff22006fda0 0x7ff2201f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 >> 172.21.15.32:0/3852539642 conn(0x7ff2200a9870 msgr2=0x7ff220152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 shutdown_connections 2024-01-19T04:17:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.156+0000 7ff228600640 1 -- 172.21.15.32:0/3852539642 wait complete. 2024-01-19T04:17:55.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T04:17:49.203878+0000', 'modified': '2024-01-19T04:17:52.248717+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6570}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6570': {'gid': 6570, 'name': 'd', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6837/208534071', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6835', 'nonce': 208534071}, {'type': 'v1', 'addr': '172.21.15.67:6837', 'nonce': 208534071}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-19T04:17:55.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-19T04:17:55.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-19T04:17:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faacc600640 1 Processor -- start 2024-01-19T04:17:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faacc600640 1 -- start start 2024-01-19T04:17:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faacc600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faac414fb50 0x7faac406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faacc600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac4071e80 con 0x7faac40a4ec0 2024-01-19T04:17:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faacc600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40726c0 con 0x7faac40c04a0 2024-01-19T04:17:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faacc600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac41535c0 con 0x7faac414fb50 2024-01-19T04:17:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faac9c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faac414fb50 0x7faac406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faaca600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faac40a4ec0 0x7faac415cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49538/0 (socket says 172.21.15.32:49538) 2024-01-19T04:17:55.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faaca600640 1 -- 172.21.15.32:0/1447998851 learned_addr learned my addr 172.21.15.32:0/1447998851 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faac9c00640 1 -- 172.21.15.32:0/1447998851 >> v1:172.21.15.67:6789/0 conn(0x7faac40c04a0 legacy=0x7faac40c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faac9c00640 1 -- 172.21.15.32:0/1447998851 >> v1:172.21.15.32:6789/0 conn(0x7faac40a4ec0 legacy=0x7faac415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faac9c00640 1 -- 172.21.15.32:0/1447998851 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40c0a20 con 0x7faac414fb50 2024-01-19T04:17:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.724+0000 7faac3e00640 1 -- 172.21.15.32:0/1447998851 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848638980 0 0) 0x7faac4071e80 con 0x7faac40a4ec0 2024-01-19T04:17:55.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faac9c00640 1 --2- 172.21.15.32:0/1447998851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac406fec0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faab40097c0 tx=0x7faab401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb6d18790124c57 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faac3e00640 1 -- 172.21.15.32:0/1447998851 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40ab600 con 0x7faac414fb50 2024-01-19T04:17:55.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faac3e00640 1 -- 172.21.15.32:0/1447998851 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab40a7050 con 0x7faac414fb50 2024-01-19T04:17:55.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faac3e00640 1 -- 172.21.15.32:0/1447998851 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40ab980 con 0x7faac414fb50 2024-01-19T04:17:55.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faacc600640 1 -- 172.21.15.32:0/1447998851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 msgr2=0x7faac406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faacc600640 1 --2- 172.21.15.32:0/1447998851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac406fec0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7faab40097c0 tx=0x7faab401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faacc600640 1 -- 172.21.15.32:0/1447998851 shutdown_connections 2024-01-19T04:17:55.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faacc600640 1 --2- 172.21.15.32:0/1447998851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac406fec0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faacc600640 1 -- 172.21.15.32:0/1447998851 >> 172.21.15.32:0/1447998851 conn(0x7faac40c5b20 msgr2=0x7faac40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faacc600640 1 -- 172.21.15.32:0/1447998851 shutdown_connections 2024-01-19T04:17:55.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.728+0000 7faacc600640 1 -- 172.21.15.32:0/1447998851 wait complete. 2024-01-19T04:17:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 Processor -- start 2024-01-19T04:17:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 -- start start 2024-01-19T04:17:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faac40a4ec0 0x7faac4140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faac40c04a0 0x7faac4141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac4142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac41eee60 con 0x7faac414fb50 2024-01-19T04:17:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4146710 con 0x7faac40c04a0 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac41453b0 con 0x7faac40a4ec0 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac4142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac4142e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60698/0 (socket says 172.21.15.32:60698) 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 -- 172.21.15.32:0/125962062 learned_addr learned my addr 172.21.15.32:0/125962062 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faac9200640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faac40c04a0 0x7faac4141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faac9c00640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faac40a4ec0 0x7faac4140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 -- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faac40a4ec0 msgr2=0x7faac4140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faac40a4ec0 0x7faac4140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 -- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faac40c04a0 msgr2=0x7faac4141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faac40c04a0 0x7faac4141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 -- 172.21.15.32:0/125962062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009420 con 0x7faac414fb50 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faaca600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac4142e70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faabc00c780 tx=0x7faabc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faac1600640 1 -- 172.21.15.32:0/125962062 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00ce30 con 0x7faac414fb50 2024-01-19T04:17:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faac1600640 1 -- 172.21.15.32:0/125962062 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc00a640 con 0x7faac414fb50 2024-01-19T04:17:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faac1600640 1 -- 172.21.15.32:0/125962062 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00aa30 con 0x7faac414fb50 2024-01-19T04:17:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac41459a0 con 0x7faac414fb50 2024-01-19T04:17:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.732+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac41406a0 con 0x7faac414fb50 2024-01-19T04:17:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.736+0000 7faac1600640 1 -- 172.21.15.32:0/125962062 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faabc00ab90 con 0x7faac414fb50 2024-01-19T04:17:55.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.736+0000 7faac1600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa9c066530 0x7faa9c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.736+0000 7faac1600640 1 -- 172.21.15.32:0/125962062 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faabc083770 con 0x7faac414fb50 2024-01-19T04:17:55.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.736+0000 7faac9c00640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa9c066530 0x7faa9c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.736+0000 7faacfa4b000 1 Processor -- start 2024-01-19T04:17:55.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.736+0000 7faacfa4b000 1 -- start start 2024-01-19T04:17:55.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.736+0000 7faac9c00640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa9c066530 0x7faa9c0689f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faab40ad000 tx=0x7faab40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6db7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6db7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6e01810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6c15d70 con 0x55b6f6db79a0 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6c11ba0 con 0x55b6f6db82c0 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6c0f0d0 con 0x55b6f6db7080 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6db7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6db7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60706/0 (socket says 172.21.15.32:60706) 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 -- 172.21.15.32:0/2559979832 learned_addr learned my addr 172.21.15.32:0/2559979832 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faaca600640 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6e01810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9c00640 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6db7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 -- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 msgr2=0x55b6f6db7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6db7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 -- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 msgr2=0x55b6f6e01810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6e01810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 -- 172.21.15.32:0/2559979832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6f6901890 con 0x55b6f6db79a0 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faac9200640 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6db7d80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7faaac0015e0 tx=0x7faaac001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a6adb24f12ff7b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faaba000640 1 -- 172.21.15.32:0/2559979832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac001cf0 con 0x55b6f6db79a0 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faaba000640 1 -- 172.21.15.32:0/2559979832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac0052e0 con 0x55b6f6db79a0 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faaba000640 1 -- 172.21.15.32:0/2559979832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac00e740 con 0x55b6f6db79a0 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- 172.21.15.32:0/2559979832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 msgr2=0x55b6f6db7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6db7d80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7faaac0015e0 tx=0x7faaac001aa0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- 172.21.15.32:0/2559979832 shutdown_connections 2024-01-19T04:17:55.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6e01810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6db7d80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 --2- 172.21.15.32:0/2559979832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6db7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- 172.21.15.32:0/2559979832 >> 172.21.15.32:0/2559979832 conn(0x55b6f6dbfd20 msgr2=0x55b6f6df7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- 172.21.15.32:0/2559979832 shutdown_connections 2024-01-19T04:17:55.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- 172.21.15.32:0/2559979832 wait complete. 2024-01-19T04:17:55.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 -- start start 2024-01-19T04:17:55.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.740+0000 7faacfa4b000 1 Processor -- start 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6dbbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6dbc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6dbc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6c0a9c0 con 0x55b6f6db79a0 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6bc2040 con 0x55b6f6db82c0 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6bc7ee0 con 0x55b6f6db7080 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 10 client.0 _ll_register_callbacks cb 0x55b6f6bc51b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6dbc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6dbc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60722/0 (socket says 172.21.15.32:60722) 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 -- 172.21.15.32:0/3994265043 learned_addr learned my addr 172.21.15.32:0/3994265043 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faaca600640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6dbc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9c00640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6dbbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 -- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 msgr2=0x55b6f6dbbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6dbbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 -- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 msgr2=0x55b6f6dbc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6dbc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 -- 172.21.15.32:0/3994265043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac00f040 con 0x55b6f6db79a0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9c00640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6dbbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9200640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6dbc370 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e530 tx=0x7faaac000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e005ddfb424d537b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faab2a00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faab2a00640 1 -- 172.21.15.32:0/3994265043 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac001250 con 0x55b6f6db79a0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faab2a00640 1 -- 172.21.15.32:0/3994265043 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaac001cf0 con 0x55b6f6db79a0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6f6b90e30 con 0x55b6f6db79a0 2024-01-19T04:17:55.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faab2a00640 1 -- 172.21.15.32:0/3994265043 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaac0069f0 con 0x55b6f6db79a0 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 10 client.6711 fetch_fsmap learned FSMap version 47 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55b6f6bca5e0 con 0x55b6f6db79a0 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faab2a00640 1 -- 172.21.15.32:0/3994265043 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6f6b90e30 con 0x55b6f6db79a0 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faab2a00640 1 -- 172.21.15.32:0/3994265043 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faaac006b50 con 0x55b6f6db79a0 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 10 client.6711 fetch_fsmap finished waiting for FSMap version 47 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 10 client.6711 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 20 client.6711 populate_metadata read hostname 'smithi032' 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e09b70 0x55b6f6e0bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 4 client.6711 mds_command: new command op to 6570 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 --> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6f6bc7870 con 0x55b6f6e09b70 2024-01-19T04:17:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9c00640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e09b70 0x55b6f6e0bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faac9c00640 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e09b70 0x55b6f6e0bf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c90b193ccb37654 server_cookie=621e55cee2af2614 in_seq=0 out_seq=0 2024-01-19T04:17:55.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.744+0000 7faab2a00640 10 client.6711 ms_handle_connect on v2:172.21.15.67:6835/208534071 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faab2a00640 1 -- 172.21.15.32:0/3994265043 <== mds.0 v2:172.21.15.67:6835/208534071 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b6f6bc7870 con 0x55b6f6e09b70 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faab2a00640 10 client.6711 handle_command_reply: tid=0 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 client.6711 shutdown 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 msgr2=0x55b6f6dbc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6dbc370 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e530 tx=0x7faaac000ee0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 shutdown_connections 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e09b70 0x55b6f6e0bf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db82c0 0x55b6f6dbc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db79a0 0x55b6f6dbc370 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 --2- 172.21.15.32:0/3994265043 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db7080 0x55b6f6dbbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faab2a00640 0 client.6711 ms_handle_reset on v2:172.21.15.67:6835/208534071 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 >> 172.21.15.32:0/3994265043 conn(0x55b6f6dbfd20 msgr2=0x55b6f6db6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 shutdown_connections 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 1 -- 172.21.15.32:0/3994265043 wait complete. 2024-01-19T04:17:55.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.748+0000 7faacfa4b000 20 client.6711 trim_cache size 0 max 16384 2024-01-19T04:17:55.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 Processor -- start 2024-01-19T04:17:55.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 -- start start 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e0bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e0c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e0c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f68c2940 con 0x55b6f6db7080 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6c07dc0 con 0x55b6f6db79a0 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6c01a40 con 0x55b6f6db82c0 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e0bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e0bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60728/0 (socket says 172.21.15.32:60728) 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 -- 172.21.15.32:0/1831390356 learned_addr learned my addr 172.21.15.32:0/1831390356 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faaca600640 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e0c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9200640 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e0c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 -- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 msgr2=0x55b6f6e0c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e0c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 -- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 msgr2=0x55b6f6e0c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e0c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 -- 172.21.15.32:0/1831390356 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6f6bb08e0 con 0x55b6f6db7080 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faac9c00640 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e0bf60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7faab4097cc0 tx=0x7faab4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd35237ce2ae7fb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faab9600640 1 -- 172.21.15.32:0/1831390356 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40b6800 con 0x55b6f6db7080 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faab9600640 1 -- 172.21.15.32:0/1831390356 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab40bd040 con 0x55b6f6db7080 2024-01-19T04:17:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faab9600640 1 -- 172.21.15.32:0/1831390356 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40b6b60 con 0x55b6f6db7080 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 -- 172.21.15.32:0/1831390356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 msgr2=0x55b6f6e0bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.764+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e0bf60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7faab4097cc0 tx=0x7faab4004740 comp rx=0 tx=0).stop 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- 172.21.15.32:0/1831390356 shutdown_connections 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e0c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e0c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1831390356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e0bf60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- 172.21.15.32:0/1831390356 >> 172.21.15.32:0/1831390356 conn(0x55b6f6dbfd20 msgr2=0x55b6f6df2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- 172.21.15.32:0/1831390356 shutdown_connections 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- 172.21.15.32:0/1831390356 wait complete. 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- start start 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 Processor -- start 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e62140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e62680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6c04cc0 con 0x55b6f6db7080 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6df47d0 con 0x55b6f6db79a0 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6f6dbfac0 con 0x55b6f6db82c0 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 10 client.0 _ll_register_callbacks cb 0x55b6f6bcb0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e61520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e61520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60742/0 (socket says 172.21.15.32:60742) 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 -- 172.21.15.32:0/1023543691 learned_addr learned my addr 172.21.15.32:0/1023543691 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faaca600640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9200640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e62140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 -- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 msgr2=0x55b6f6e62680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e62680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 -- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 msgr2=0x55b6f6e62140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e62140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 -- 172.21.15.32:0/1023543691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac40c0a20 con 0x55b6f6db7080 2024-01-19T04:17:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9200640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e62140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faac9c00640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e61520 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7faab40cc040 tx=0x7faab401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33114ce01d57906e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faab2a00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-01-19T04:17:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faab2a00640 1 -- 172.21.15.32:0/1023543691 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40b68c0 con 0x55b6f6db7080 2024-01-19T04:17:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faab2a00640 1 -- 172.21.15.32:0/1023543691 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faab40b6a20 con 0x55b6f6db7080 2024-01-19T04:17:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6f6db6800 con 0x55b6f6db7080 2024-01-19T04:17:55.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faab2a00640 1 -- 172.21.15.32:0/1023543691 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7faab40b6be0 con 0x55b6f6db7080 2024-01-19T04:17:55.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 10 client.6717 fetch_fsmap learned FSMap version 47 2024-01-19T04:17:55.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55b6f6901cc0 con 0x55b6f6db7080 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faab2a00640 1 -- 172.21.15.32:0/1023543691 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6f6db6800 con 0x55b6f6db7080 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faab2a00640 1 -- 172.21.15.32:0/1023543691 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faab40c2040 con 0x55b6f6db7080 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 10 client.6717 fetch_fsmap finished waiting for FSMap version 47 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 10 client.6717 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 20 client.6717 populate_metadata read hostname 'smithi032' 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e61a60 0x55b6f6e62bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 4 client.6717 mds_command: new command op to 6570 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.768+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 --> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b6f6bbc4f0 con 0x55b6f6e61a60 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faac9200640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e61a60 0x55b6f6e62bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faac9200640 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e61a60 0x55b6f6e62bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1fb91cbce565d3 server_cookie=4fe9b661b1e3f540 in_seq=0 out_seq=0 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faab2a00640 10 client.6717 ms_handle_connect on v2:172.21.15.67:6835/208534071 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faab2a00640 1 -- 172.21.15.32:0/1023543691 <== mds.0 v2:172.21.15.67:6835/208534071 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55b6f6bbc4f0 con 0x55b6f6e61a60 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faab2a00640 10 client.6717 handle_command_reply: tid=0 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 client.6717 shutdown 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 msgr2=0x55b6f6e61520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e61520 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7faab40cc040 tx=0x7faab401ac30 comp rx=0 tx=0).stop 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 shutdown_connections 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55b6f6db82c0 0x55b6f6e62680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:6835/208534071,v1:172.21.15.67:6837/208534071] conn(0x55b6f6e61a60 0x55b6f6e62bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b6f6db79a0 0x55b6f6e62140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 --2- 172.21.15.32:0/1023543691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6f6db7080 0x55b6f6e61520 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faab2a00640 0 client.6717 ms_handle_reset on v2:172.21.15.67:6835/208534071 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 >> 172.21.15.32:0/1023543691 conn(0x55b6f6dbfd20 msgr2=0x55b6f6df2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 shutdown_connections 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 1 -- 172.21.15.32:0/1023543691 wait complete. 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacfa4b000 20 client.6717 trim_cache size 0 max 16384 2024-01-19T04:17:55.779 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "d7445317-ddd8-4205-bf5b-c51cd46cffd9", 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 6570, 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 5.940864565, 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 47, 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 71, 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 71, 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 11.855500744 2024-01-19T04:17:55.780 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa9c066530 msgr2=0x7faa9c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa9c066530 0x7faa9c0689f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faab40ad000 tx=0x7faab40a6000 comp rx=0 tx=0).stop 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 msgr2=0x7faac4142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac4142e70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faabc00c780 tx=0x7faabc00cc40 comp rx=0 tx=0).stop 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 shutdown_connections 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa9c066530 0x7faa9c0689f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faac414fb50 0x7faac4142e70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faac40c04a0 0x7faac4141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 --2- 172.21.15.32:0/125962062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faac40a4ec0 0x7faac4140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 >> 172.21.15.32:0/125962062 conn(0x7faac40c5b20 msgr2=0x7faac41441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.772+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 shutdown_connections 2024-01-19T04:17:55.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.776+0000 7faacc600640 1 -- 172.21.15.32:0/125962062 wait complete. 2024-01-19T04:17:55.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:17:55.798 INFO:tasks.ceph.mds.d.smithi067.stderr:2024-01-19T04:17:55.795+0000 7fba90600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:17:55.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.936+0000 7f38ae200640 1 Processor -- start 2024-01-19T04:17:55.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.936+0000 7f38ae200640 1 -- start start 2024-01-19T04:17:55.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38ae200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38a80c04a0 0x7f38a80c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38ae200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a8071e80 con 0x7f38a80a4ec0 2024-01-19T04:17:55.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38ae200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a80726c0 con 0x7f38a814fb50 2024-01-19T04:17:55.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38ae200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a81535c0 con 0x7f38a80c04a0 2024-01-19T04:17:55.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f38a80a4ec0 0x7f38a815cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49550/0 (socket says 172.21.15.32:49550) 2024-01-19T04:17:55.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a7e00640 1 -- 172.21.15.32:0/178772421 learned_addr learned my addr 172.21.15.32:0/178772421 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6a00640 1 --2- 172.21.15.32:0/178772421 >> v2:172.21.15.67:3300/0 conn(0x7f38a80c04a0 0x7f38a80c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64968911 0 0) 0x7f38a8071e80 con 0x7f38a80a4ec0 2024-01-19T04:17:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3888003530 con 0x7f38a80a4ec0 2024-01-19T04:17:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271323915 0 0) 0x7f38a80726c0 con 0x7f38a814fb50 2024-01-19T04:17:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38a8071e80 con 0x7f38a814fb50 2024-01-19T04:17:55.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 643844726 0 0) 0x7f3888003530 con 0x7f38a80a4ec0 2024-01-19T04:17:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6a00640 1 -- 172.21.15.32:0/178772421 >> v1:172.21.15.67:6789/0 conn(0x7f38a814fb50 legacy=0x7f38a806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6a00640 1 -- 172.21.15.32:0/178772421 >> v1:172.21.15.32:6789/0 conn(0x7f38a80a4ec0 legacy=0x7f38a815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.940+0000 7f38a6a00640 1 -- 172.21.15.32:0/178772421 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a80c0a20 con 0x7f38a80c04a0 2024-01-19T04:17:55.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38a6a00640 1 --2- 172.21.15.32:0/178772421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 0x7f38a80c1230 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f38900097c0 tx=0x7f389001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8b4dd47718657d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0001a00 con 0x7f38a80c04a0 2024-01-19T04:17:55.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38900a7050 con 0x7f38a80c04a0 2024-01-19T04:17:55.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38a6000640 1 -- 172.21.15.32:0/178772421 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900ab620 con 0x7f38a80c04a0 2024-01-19T04:17:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 -- 172.21.15.32:0/178772421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 msgr2=0x7f38a80c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 --2- 172.21.15.32:0/178772421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 0x7f38a80c1230 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f38900097c0 tx=0x7f389001c310 comp rx=0 tx=0).stop 2024-01-19T04:17:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 -- 172.21.15.32:0/178772421 shutdown_connections 2024-01-19T04:17:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 --2- 172.21.15.32:0/178772421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 0x7f38a80c1230 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 -- 172.21.15.32:0/178772421 >> 172.21.15.32:0/178772421 conn(0x7f38a80c5b20 msgr2=0x7f38a80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 -- 172.21.15.32:0/178772421 shutdown_connections 2024-01-19T04:17:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 -- 172.21.15.32:0/178772421 wait complete. 2024-01-19T04:17:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 Processor -- start 2024-01-19T04:17:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.944+0000 7f38ae200640 1 -- start start 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38a80a4ec0 0x7f38a806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 0x7f38a81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38a814fb50 0x7f38a81476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8151840 con 0x7f38a80a4ec0 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8148680 con 0x7f38a80c04a0 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8150fa0 con 0x7f38a814fb50 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38a80a4ec0 0x7f38a806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38a80a4ec0 0x7f38a806d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60750/0 (socket says 172.21.15.32:60750) 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 -- 172.21.15.32:0/2653557916 learned_addr learned my addr 172.21.15.32:0/2653557916 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a6a00640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 0x7f38a81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7e00640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38a814fb50 0x7f38a81476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 -- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38a814fb50 msgr2=0x7f38a81476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38a814fb50 0x7f38a81476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 -- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 msgr2=0x7f38a81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:55.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 0x7f38a81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:55.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 -- 172.21.15.32:0/2653557916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890009420 con 0x7f38a80a4ec0 2024-01-19T04:17:55.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38a7400640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38a80a4ec0 0x7f38a806d4c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f389800c430 tx=0x7f389800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f389f400640 1 -- 172.21.15.32:0/2653557916 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980052d0 con 0x7f38a80a4ec0 2024-01-19T04:17:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f389f400640 1 -- 172.21.15.32:0/2653557916 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3898005450 con 0x7f38a80a4ec0 2024-01-19T04:17:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a8151280 con 0x7f38a80a4ec0 2024-01-19T04:17:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f389f400640 1 -- 172.21.15.32:0/2653557916 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898003840 con 0x7f38a80a4ec0 2024-01-19T04:17:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a8154b70 con 0x7f38a80a4ec0 2024-01-19T04:17:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a81549b0 con 0x7f38a80a4ec0 2024-01-19T04:17:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.948+0000 7f389f400640 1 -- 172.21.15.32:0/2653557916 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f38980039a0 con 0x7f38a80a4ec0 2024-01-19T04:17:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.952+0000 7f389f400640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3880066500 0x7f38800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.952+0000 7f389f400640 1 -- 172.21.15.32:0/2653557916 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3898083570 con 0x7f38a80a4ec0 2024-01-19T04:17:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.952+0000 7f38a6a00640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3880066500 0x7f38800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.952+0000 7f38a6a00640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3880066500 0x7f38800689c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f38900ad000 tx=0x7f3890008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:55.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:55.956+0000 7f389f400640 1 -- 172.21.15.32:0/2653557916 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3898050790 con 0x7f38a80a4ec0 2024-01-19T04:17:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.148+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38a80749f0 con 0x7f38a80a4ec0 2024-01-19T04:17:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.148+0000 7f389f400640 1 -- 172.21.15.32:0/2653557916 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3898017060 con 0x7f38a80a4ec0 2024-01-19T04:17:56.154 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3880066500 msgr2=0x7f38800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3880066500 0x7f38800689c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f38900ad000 tx=0x7f3890008040 comp rx=0 tx=0).stop 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38a80a4ec0 msgr2=0x7f38a806d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38a80a4ec0 0x7f38a806d4c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f389800c430 tx=0x7f389800c8f0 comp rx=0 tx=0).stop 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 shutdown_connections 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3880066500 0x7f38800689c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f38a814fb50 0x7f38a81476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38a80c04a0 0x7f38a81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 --2- 172.21.15.32:0/2653557916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38a80a4ec0 0x7f38a806d4c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:56.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 >> 172.21.15.32:0/2653557916 conn(0x7f38a80c5b20 msgr2=0x7f38a80a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:56.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 shutdown_connections 2024-01-19T04:17:56.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.152+0000 7f38ae200640 1 -- 172.21.15.32:0/2653557916 wait complete. 2024-01-19T04:17:56.175 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:17:56.175 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:17:56.175 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-01-19T04:17:56.176 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-19T04:17:56.176 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:56.176 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:17:56.176 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:17:56.176 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:17:56.176 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:17:56.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.176 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-01-19T04:17:56.185 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:17:56.185 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-19T04:17:56.186 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42267sec preferred_lft 42267sec 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:1f:1a:e5:73 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:17:56.187 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:56.188 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:17:56.188 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:17:56.188 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:17:56.188 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:56.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.189 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:17:56.248 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-01-19T04:17:56.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.250 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-01-19T04:17:56.302 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-01-19T04:17:56.302 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:17:56.303 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-19T04:17:56.303 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:17:56.303 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-19T04:17:56.303 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:17:56.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.303 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:17:56.303 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:17:56.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-19T04:17:56.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-19T04:17:56.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-19T04:17:56.303 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:17:56.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.396 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:17:56.405 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T04:17:56.405 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:17:56.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-01-19T04:17:56.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:56.466 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:56.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:56.518 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:56.569 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-19T04:17:56.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.569 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:56.658 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:56.659 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:56.673 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:56.673 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:56.673 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:17:56.673 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:17:56.673 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:17:56.677 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:17:56.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:17:56.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:56.697 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:17:56.765 INFO:teuthology.orchestra.run.smithi032.stdout:client6547 2024-01-19T04:17:56.765 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:17:56.765 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:56.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:17:56.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.992+0000 7faa6c400640 1 Processor -- start 2024-01-19T04:17:56.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa6c400640 1 -- start start 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa6c400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faa640c5740 0x7faa640c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa6c400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faa640c1120 0x7faa6415b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa6c400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640c0c90 con 0x7faa640c42b0 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa6c400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa64150f90 con 0x7faa640c5740 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa6c400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa64150cb0 con 0x7faa640c1120 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa69a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faa640c42b0 0x7faa6406beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49564/0 (socket says 172.21.15.32:49564) 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa69a00640 1 -- 172.21.15.32:0/2210252317 learned_addr learned my addr 172.21.15.32:0/2210252317 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa69000640 1 --2- 172.21.15.32:0/2210252317 >> v2:172.21.15.32:3300/0 conn(0x7faa640c5740 0x7faa640c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa6a400640 1 --2- 172.21.15.32:0/2210252317 >> v2:172.21.15.67:3300/0 conn(0x7faa640c1120 0x7faa6415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa63e00640 1 -- 172.21.15.32:0/2210252317 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729781611 0 0) 0x7faa640c0c90 con 0x7faa640c42b0 2024-01-19T04:17:57.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa63e00640 1 -- 172.21.15.32:0/2210252317 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa44003530 con 0x7faa640c42b0 2024-01-19T04:17:57.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa69000640 1 -- 172.21.15.32:0/2210252317 >> v2:172.21.15.67:3300/0 conn(0x7faa640c1120 msgr2=0x7faa6415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:57.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa69000640 1 --2- 172.21.15.32:0/2210252317 >> v2:172.21.15.67:3300/0 conn(0x7faa640c1120 0x7faa6415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa69000640 1 -- 172.21.15.32:0/2210252317 >> v1:172.21.15.32:6789/0 conn(0x7faa640c42b0 legacy=0x7faa6406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:57.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:56.996+0000 7faa69000640 1 -- 172.21.15.32:0/2210252317 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640c0640 con 0x7faa640c5740 2024-01-19T04:17:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa69000640 1 --2- 172.21.15.32:0/2210252317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c5740 0x7faa640c4690 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7faa640c1970 tx=0x7faa4c01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c9db40958c0f48 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa63e00640 1 -- 172.21.15.32:0/2210252317 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0ab600 con 0x7faa640c5740 2024-01-19T04:17:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa63e00640 1 -- 172.21.15.32:0/2210252317 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c0a7050 con 0x7faa640c5740 2024-01-19T04:17:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa63e00640 1 -- 172.21.15.32:0/2210252317 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0ab980 con 0x7faa640c5740 2024-01-19T04:17:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 -- 172.21.15.32:0/2210252317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c5740 msgr2=0x7faa640c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 --2- 172.21.15.32:0/2210252317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c5740 0x7faa640c4690 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7faa640c1970 tx=0x7faa4c01ce00 comp rx=0 tx=0).stop 2024-01-19T04:17:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 -- 172.21.15.32:0/2210252317 shutdown_connections 2024-01-19T04:17:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 --2- 172.21.15.32:0/2210252317 >> v2:172.21.15.67:3300/0 conn(0x7faa640c1120 0x7faa6415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 --2- 172.21.15.32:0/2210252317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c5740 0x7faa640c4690 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 -- 172.21.15.32:0/2210252317 >> 172.21.15.32:0/2210252317 conn(0x7faa640c5b20 msgr2=0x7faa640c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 -- 172.21.15.32:0/2210252317 shutdown_connections 2024-01-19T04:17:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.000+0000 7faa6c400640 1 -- 172.21.15.32:0/2210252317 wait complete. 2024-01-19T04:17:57.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 Processor -- start 2024-01-19T04:17:57.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 -- start start 2024-01-19T04:17:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c1120 0x7faa640bf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa640c42b0 0x7faa6414ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa640c5740 0x7faa64145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641eee50 con 0x7faa640c1120 2024-01-19T04:17:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641eeb70 con 0x7faa640c42b0 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64150410 con 0x7faa640c5740 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c1120 0x7faa640bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c1120 0x7faa640bf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60758/0 (socket says 172.21.15.32:60758) 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 -- 172.21.15.32:0/3308476033 learned_addr learned my addr 172.21.15.32:0/3308476033 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69000640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa640c42b0 0x7faa6414ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6a400640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa640c5740 0x7faa64145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 -- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa640c5740 msgr2=0x7faa64145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa640c5740 0x7faa64145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 -- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa640c42b0 msgr2=0x7faa6414ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa640c42b0 0x7faa6414ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 -- 172.21.15.32:0/3308476033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009420 con 0x7faa640c1120 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa69a00640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c1120 0x7faa640bf390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7faa5400c450 tx=0x7faa5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa61600640 1 -- 172.21.15.32:0/3308476033 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54005cf0 con 0x7faa640c1120 2024-01-19T04:17:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa61600640 1 -- 172.21.15.32:0/3308476033 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa54005e50 con 0x7faa640c1120 2024-01-19T04:17:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa641506f0 con 0x7faa640c1120 2024-01-19T04:17:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa61600640 1 -- 172.21.15.32:0/3308476033 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54007290 con 0x7faa640c1120 2024-01-19T04:17:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6414eea0 con 0x7faa640c1120 2024-01-19T04:17:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.004+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64146180 con 0x7faa640c1120 2024-01-19T04:17:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.008+0000 7faa61600640 1 -- 172.21.15.32:0/3308476033 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faa540073f0 con 0x7faa640c1120 2024-01-19T04:17:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.008+0000 7faa61600640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa3c066500 0x7faa3c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.008+0000 7faa61600640 1 -- 172.21.15.32:0/3308476033 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa54083470 con 0x7faa640c1120 2024-01-19T04:17:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.008+0000 7faa69000640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa3c066500 0x7faa3c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:57.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.008+0000 7faa69000640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa3c066500 0x7faa3c0689c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faa64073eb0 tx=0x7faa4c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:57.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.012+0000 7faa61600640 1 -- 172.21.15.32:0/3308476033 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faa54050720 con 0x7faa640c1120 2024-01-19T04:17:57.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.204+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa640749f0 con 0x7faa640c1120 2024-01-19T04:17:57.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.204+0000 7faa61600640 1 -- 172.21.15.32:0/3308476033 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7faa54017070 con 0x7faa640c1120 2024-01-19T04:17:57.208 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:17:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.204+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa3c066500 msgr2=0x7faa3c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.204+0000 7faa6c400640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa3c066500 0x7faa3c0689c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faa64073eb0 tx=0x7faa4c004740 comp rx=0 tx=0).stop 2024-01-19T04:17:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.204+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c1120 msgr2=0x7faa640bf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.204+0000 7faa6c400640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c1120 0x7faa640bf390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7faa5400c450 tx=0x7faa5400c910 comp rx=0 tx=0).stop 2024-01-19T04:17:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 shutdown_connections 2024-01-19T04:17:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faa3c066500 0x7faa3c0689c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faa640c5740 0x7faa64145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa640c42b0 0x7faa6414ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 --2- 172.21.15.32:0/3308476033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa640c1120 0x7faa640bf390 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:57.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 >> 172.21.15.32:0/3308476033 conn(0x7faa640c5b20 msgr2=0x7faa6414a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:57.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 shutdown_connections 2024-01-19T04:17:57.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:57.208+0000 7faa6c400640 1 -- 172.21.15.32:0/3308476033 wait complete. 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:17:57.230 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:17:57.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.231 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:57.241 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42289sec preferred_lft 42289sec 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:57.242 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:17:57.243 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:17:57.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.244 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:17:57.309 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:17:57.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.311 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:17:57.363 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:17:57.363 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:17:57.363 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:17:57.363 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:17:57.363 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:17:57.363 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:17:57.364 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:17:57.364 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:17:57.364 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:17:57.364 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:17:57.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.364 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:17:57.364 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:17:57.364 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:17:57.364 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:17:57.364 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:17:57.364 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:17:57.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.459 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:17:57.468 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:17:57.469 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:17:57.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.469 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:17:57.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:57.533 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:17:57.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:17:57.585 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:57.636 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-19T04:17:57.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:57.727 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:57.728 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:57.741 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:17:57.741 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:17:57.741 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:17:57.741 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:17:57.741 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:17:57.745 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:17:57.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.745 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:17:57.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:17:57.765 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:17:57.823 INFO:teuthology.orchestra.run.smithi067.stdout:client5897 2024-01-19T04:17:57.824 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:17:57.824 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:17:57.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-19T04:17:58.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f400a000640 1 Processor -- start 2024-01-19T04:17:58.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f400a000640 1 -- start start 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f400a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4004151f30 0x7f40040c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f400a000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f400406fda0 0x7f40040c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f400a000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40040c5b40 con 0x7f400406eb70 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f400a000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40041551e0 con 0x7f400406fda0 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f400a000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4004155710 con 0x7f4004151f30 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4002a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f400406fda0 0x7f40040c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4002a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f400406fda0 0x7f40040c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57612/0 (socket says 172.21.15.32:57612) 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4002a00640 1 -- 172.21.15.32:0/1514205596 learned_addr learned my addr 172.21.15.32:0/1514205596 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:58.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4003400640 1 --2- 172.21.15.32:0/1514205596 >> v2:172.21.15.67:3300/0 conn(0x7f4004151f30 0x7f40040c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4002a00640 1 -- 172.21.15.32:0/1514205596 >> v2:172.21.15.67:3300/0 conn(0x7f4004151f30 msgr2=0x7f40040c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:58.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4002a00640 1 --2- 172.21.15.32:0/1514205596 >> v2:172.21.15.67:3300/0 conn(0x7f4004151f30 0x7f40040c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4002a00640 1 -- 172.21.15.32:0/1514205596 >> v1:172.21.15.67:6789/0 conn(0x7f400406eb70 legacy=0x7f400406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.144+0000 7f4002a00640 1 -- 172.21.15.32:0/1514205596 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40040c3fa0 con 0x7f400406fda0 2024-01-19T04:17:58.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.148+0000 7f4002a00640 1 --2- 172.21.15.32:0/1514205596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406fda0 0x7f40040c4970 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4004071b80 tx=0x7f3fec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab0c6a50cc12de8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.148+0000 7f4002000640 1 -- 172.21.15.32:0/1514205596 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0ad680 con 0x7f400406fda0 2024-01-19T04:17:58.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.148+0000 7f4002000640 1 -- 172.21.15.32:0/1514205596 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec0ad7e0 con 0x7f400406fda0 2024-01-19T04:17:58.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.148+0000 7f4002000640 1 -- 172.21.15.32:0/1514205596 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0adb70 con 0x7f400406fda0 2024-01-19T04:17:58.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.148+0000 7f400a000640 1 -- 172.21.15.32:0/1514205596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406fda0 msgr2=0x7f40040c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.148+0000 7f400a000640 1 --2- 172.21.15.32:0/1514205596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406fda0 0x7f40040c4970 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4004071b80 tx=0x7f3fec01c470 comp rx=0 tx=0).stop 2024-01-19T04:17:58.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- 172.21.15.32:0/1514205596 shutdown_connections 2024-01-19T04:17:58.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 --2- 172.21.15.32:0/1514205596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406fda0 0x7f40040c4970 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 --2- 172.21.15.32:0/1514205596 >> v2:172.21.15.67:3300/0 conn(0x7f4004151f30 0x7f40040c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- 172.21.15.32:0/1514205596 >> 172.21.15.32:0/1514205596 conn(0x7f40040a9870 msgr2=0x7f40040a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:58.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- 172.21.15.32:0/1514205596 shutdown_connections 2024-01-19T04:17:58.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- 172.21.15.32:0/1514205596 wait complete. 2024-01-19T04:17:58.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 Processor -- start 2024-01-19T04:17:58.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- start start 2024-01-19T04:17:58.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406eb70 0x7f40041f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f400406fda0 0x7f400406c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4004151f30 0x7f40040bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40041f08a0 con 0x7f400406eb70 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400406bb70 con 0x7f400406fda0 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f400a000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40041ecf90 con 0x7f4004151f30 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4003400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406eb70 0x7f40041f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4002a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f400406fda0 0x7f400406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4003400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406eb70 0x7f40041f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57628/0 (socket says 172.21.15.32:57628) 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4003400640 1 -- 172.21.15.32:0/4130564050 learned_addr learned my addr 172.21.15.32:0/4130564050 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4003e00640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4004151f30 0x7f40040bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4002a00640 1 -- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4004151f30 msgr2=0x7f40040bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4002a00640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4004151f30 0x7f40040bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4002a00640 1 -- 172.21.15.32:0/4130564050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406eb70 msgr2=0x7f40041f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4002a00640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406eb70 0x7f40041f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4002a00640 1 -- 172.21.15.32:0/4130564050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0094d0 con 0x7f400406fda0 2024-01-19T04:17:58.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.152+0000 7f4003400640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406eb70 0x7f40041f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:58.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f4002a00640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f400406fda0 0x7f400406c700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0ac000 tx=0x7f3fec01acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f3ffb400640 1 -- 172.21.15.32:0/4130564050 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0ade60 con 0x7f400406fda0 2024-01-19T04:17:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f3ffb400640 1 -- 172.21.15.32:0/4130564050 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec0b8450 con 0x7f400406fda0 2024-01-19T04:17:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40041f0250 con 0x7f400406fda0 2024-01-19T04:17:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f3ffb400640 1 -- 172.21.15.32:0/4130564050 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0b8800 con 0x7f400406fda0 2024-01-19T04:17:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40041ecc40 con 0x7f400406fda0 2024-01-19T04:17:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40041f0a10 con 0x7f400406fda0 2024-01-19T04:17:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f3ffb400640 1 -- 172.21.15.32:0/4130564050 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3fec0b4070 con 0x7f400406fda0 2024-01-19T04:17:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f3ffb400640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3fdc066500 0x7f3fdc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.156+0000 7f3ffb400640 1 -- 172.21.15.32:0/4130564050 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fec11e6c0 con 0x7f400406fda0 2024-01-19T04:17:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.160+0000 7f4003400640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3fdc066500 0x7f3fdc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.160+0000 7f4003400640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3fdc066500 0x7f3fdc0689c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f40041562d0 tx=0x7f3ff4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.160+0000 7f3ffb400640 1 -- 172.21.15.32:0/4130564050 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3fec0ebba0 con 0x7f400406fda0 2024-01-19T04:17:58.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.376+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f40040749f0 con 0x7f400406fda0 2024-01-19T04:17:58.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.376+0000 7f3ffb400640 1 -- 172.21.15.32:0/4130564050 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7f3fec0ef1c0 con 0x7f400406fda0 2024-01-19T04:17:58.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3fdc066500 msgr2=0x7f3fdc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3fdc066500 0x7f3fdc0689c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f40041562d0 tx=0x7f3ff4008040 comp rx=0 tx=0).stop 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f400406fda0 msgr2=0x7f400406c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f400406fda0 0x7f400406c700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0ac000 tx=0x7f3fec01acb0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 shutdown_connections 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3fdc066500 0x7f3fdc0689c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4004151f30 0x7f40040bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f400406fda0 0x7f400406c700 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 --2- 172.21.15.32:0/4130564050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f400406eb70 0x7f40041f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 >> 172.21.15.32:0/4130564050 conn(0x7f40040a9870 msgr2=0x7f400406ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 shutdown_connections 2024-01-19T04:17:58.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.380+0000 7f400a000640 1 -- 172.21.15.32:0/4130564050 wait complete. 2024-01-19T04:17:58.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:17:58.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9478000640 1 Processor -- start 2024-01-19T04:17:58.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9478000640 1 -- start start 2024-01-19T04:17:58.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9478000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f94700c6e20 0x7f94700c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9478000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f94700c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9478000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94701533a0 con 0x7f947006fda0 2024-01-19T04:17:58.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9478000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9470156380 con 0x7f94700c6e20 2024-01-19T04:17:58.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9478000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947014fe40 con 0x7f94700a6d30 2024-01-19T04:17:58.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9476000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f947006fda0 0x7f9470152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46840/0 (socket says 172.21.15.32:46840) 2024-01-19T04:17:58.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9476000640 1 -- 172.21.15.32:0/3827445997 learned_addr learned my addr 172.21.15.32:0/3827445997 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:58.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9475600640 1 --2- 172.21.15.32:0/3827445997 >> v2:172.21.15.32:3300/0 conn(0x7f94700c6e20 0x7f94700c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f946fe00640 1 -- 172.21.15.32:0/3827445997 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144847466 0 0) 0x7f94680014a0 con 0x7f947006fda0 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9474c00640 1 --2- 172.21.15.32:0/3827445997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f94700c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f946fe00640 1 -- 172.21.15.32:0/3827445997 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9450003530 con 0x7f947006fda0 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9475600640 1 -- 172.21.15.32:0/3827445997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 msgr2=0x7f94700c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9475600640 1 --2- 172.21.15.32:0/3827445997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f94700c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9475600640 1 -- 172.21.15.32:0/3827445997 >> v1:172.21.15.32:6789/0 conn(0x7f947006fda0 legacy=0x7f9470152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9475600640 1 -- 172.21.15.32:0/3827445997 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470152800 con 0x7f94700c6e20 2024-01-19T04:17:58.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.540+0000 7f9474c00640 1 --2- 172.21.15.32:0/3827445997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f94700c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:17:58.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9475600640 1 --2- 172.21.15.32:0/3827445997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94700c6e20 0x7f94700c7200 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94600097c0 tx=0x7f946001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc1c9893025fc5f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f946fe00640 1 -- 172.21.15.32:0/3827445997 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600ad660 con 0x7f94700c6e20 2024-01-19T04:17:58.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f946fe00640 1 -- 172.21.15.32:0/3827445997 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600ad7c0 con 0x7f94700c6e20 2024-01-19T04:17:58.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f946fe00640 1 -- 172.21.15.32:0/3827445997 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600adb50 con 0x7f94700c6e20 2024-01-19T04:17:58.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 -- 172.21.15.32:0/3827445997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94700c6e20 msgr2=0x7f94700c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 --2- 172.21.15.32:0/3827445997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94700c6e20 0x7f94700c7200 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94600097c0 tx=0x7f946001c360 comp rx=0 tx=0).stop 2024-01-19T04:17:58.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 -- 172.21.15.32:0/3827445997 shutdown_connections 2024-01-19T04:17:58.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 --2- 172.21.15.32:0/3827445997 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f94700c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 --2- 172.21.15.32:0/3827445997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94700c6e20 0x7f94700c7200 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 -- 172.21.15.32:0/3827445997 >> 172.21.15.32:0/3827445997 conn(0x7f94700a9870 msgr2=0x7f94700a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:58.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 -- 172.21.15.32:0/3827445997 shutdown_connections 2024-01-19T04:17:58.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.544+0000 7f9478000640 1 -- 172.21.15.32:0/3827445997 wait complete. 2024-01-19T04:17:58.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 Processor -- start 2024-01-19T04:17:58.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 -- start start 2024-01-19T04:17:58.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f947006fda0 0x7f94700bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f9470151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94700c6e20 0x7f9470151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94701510c0 con 0x7f947006fda0 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94701501f0 con 0x7f94700c6e20 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94701504b0 con 0x7f94700a6d30 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f947006fda0 0x7f94700bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f947006fda0 0x7f94700bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57652/0 (socket says 172.21.15.32:57652) 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 -- 172.21.15.32:0/1412163832 learned_addr learned my addr 172.21.15.32:0/1412163832 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9474c00640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f9470151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9476000640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94700c6e20 0x7f9470151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 -- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 msgr2=0x7f9470151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f9470151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 -- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94700c6e20 msgr2=0x7f9470151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94700c6e20 0x7f9470151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 -- 172.21.15.32:0/1412163832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460009420 con 0x7f947006fda0 2024-01-19T04:17:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9475600640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f947006fda0 0x7f94700bdd90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9460019f90 tx=0x7f946001aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f946d600640 1 -- 172.21.15.32:0/1412163832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600b9650 con 0x7f947006fda0 2024-01-19T04:17:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f946d600640 1 -- 172.21.15.32:0/1412163832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600b97d0 con 0x7f947006fda0 2024-01-19T04:17:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9470150790 con 0x7f947006fda0 2024-01-19T04:17:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f946d600640 1 -- 172.21.15.32:0/1412163832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600b9b80 con 0x7f947006fda0 2024-01-19T04:17:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.548+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9470150d50 con 0x7f947006fda0 2024-01-19T04:17:58.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.552+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94700749f0 con 0x7f947006fda0 2024-01-19T04:17:58.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.552+0000 7f946d600640 1 -- 172.21.15.32:0/1412163832 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f94600b9ce0 con 0x7f947006fda0 2024-01-19T04:17:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.552+0000 7f946d600640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9448066500 0x7f94480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.552+0000 7f946d600640 1 -- 172.21.15.32:0/1412163832 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f946011e8b0 con 0x7f947006fda0 2024-01-19T04:17:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.552+0000 7f9474c00640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9448066500 0x7f94480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.556+0000 7f9474c00640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9448066500 0x7f94480689c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f94700c5060 tx=0x7f9458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.556+0000 7f946d600640 1 -- 172.21.15.32:0/1412163832 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f94600ebb70 con 0x7f947006fda0 2024-01-19T04:17:58.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.720+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9470067b80 con 0x7f947006fda0 2024-01-19T04:17:58.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.720+0000 7f946d600640 1 -- 172.21.15.32:0/1412163832 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16465 (secure 0 0 0) 0x7f94600ef190 con 0x7f947006fda0 2024-01-19T04:17:58.724 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:17:58.724 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":71,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:17:50.845175+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:17:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9448066500 msgr2=0x7f94480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9448066500 0x7f94480689c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f94700c5060 tx=0x7f9458008040 comp rx=0 tx=0).stop 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f947006fda0 msgr2=0x7f94700bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f947006fda0 0x7f94700bdd90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9460019f90 tx=0x7f946001aba0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 shutdown_connections 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9448066500 0x7f94480689c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94700c6e20 0x7f9470151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f94700a6d30 0x7f9470151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 --2- 172.21.15.32:0/1412163832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f947006fda0 0x7f94700bdd90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 >> 172.21.15.32:0/1412163832 conn(0x7f94700a9870 msgr2=0x7f947014f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 shutdown_connections 2024-01-19T04:17:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.724+0000 7f9478000640 1 -- 172.21.15.32:0/1412163832 wait complete. 2024-01-19T04:17:58.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:17:47.021907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:17:48.211408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:17:58.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:17:58.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d36200640 1 Processor -- start 2024-01-19T04:17:58.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d36200640 1 -- start start 2024-01-19T04:17:58.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d36200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d300c1540 0x7f1d3006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d36200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d300a7390 0x7f1d3006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d36200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3006fb10 con 0x7f1d30151e80 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d36200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d30155650 con 0x7f1d300c1540 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d36200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3006fd60 con 0x7f1d300a7390 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d300a7390 0x7f1d3006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1d300c1540 0x7f1d3006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d300a7390 0x7f1d3006ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:48570/0 (socket says 172.21.15.32:48570) 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2fe00640 1 -- 172.21.15.32:0/1186381935 learned_addr learned my addr 172.21.15.32:0/1186381935 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2fe00640 1 -- 172.21.15.32:0/1186381935 >> v2:172.21.15.67:3300/0 conn(0x7f1d300c1540 msgr2=0x7f1d3006e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2fe00640 1 --2- 172.21.15.32:0/1186381935 >> v2:172.21.15.67:3300/0 conn(0x7f1d300c1540 0x7f1d3006e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2fe00640 1 -- 172.21.15.32:0/1186381935 >> v1:172.21.15.67:6789/0 conn(0x7f1d30151e80 legacy=0x7f1d300c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2fe00640 1 -- 172.21.15.32:0/1186381935 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30070040 con 0x7f1d300a7390 2024-01-19T04:17:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.888+0000 7f1d2ea00640 1 --2- 172.21.15.32:0/1186381935 >> v2:172.21.15.67:3300/0 conn(0x7f1d300c1540 0x7f1d3006e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:17:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.892+0000 7f1d2fe00640 1 --2- 172.21.15.32:0/1186381935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d300a7390 0x7f1d3006ec30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009e50 tx=0x7f1d2801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c06874df1216b8a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.892+0000 7f1d2e000640 1 -- 172.21.15.32:0/1186381935 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280a5640 con 0x7f1d300a7390 2024-01-19T04:17:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.892+0000 7f1d2e000640 1 -- 172.21.15.32:0/1186381935 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d280a57a0 con 0x7f1d300a7390 2024-01-19T04:17:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.892+0000 7f1d2e000640 1 -- 172.21.15.32:0/1186381935 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280a5b30 con 0x7f1d300a7390 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.892+0000 7f1d36200640 1 -- 172.21.15.32:0/1186381935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d300a7390 msgr2=0x7f1d3006ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.892+0000 7f1d36200640 1 --2- 172.21.15.32:0/1186381935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d300a7390 0x7f1d3006ec30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009e50 tx=0x7f1d2801c980 comp rx=0 tx=0).stop 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- 172.21.15.32:0/1186381935 shutdown_connections 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 --2- 172.21.15.32:0/1186381935 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d300a7390 0x7f1d3006ec30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 --2- 172.21.15.32:0/1186381935 >> v2:172.21.15.67:3300/0 conn(0x7f1d300c1540 0x7f1d3006e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- 172.21.15.32:0/1186381935 >> 172.21.15.32:0/1186381935 conn(0x7f1d300726d0 msgr2=0x7f1d300663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- 172.21.15.32:0/1186381935 shutdown_connections 2024-01-19T04:17:58.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- 172.21.15.32:0/1186381935 wait complete. 2024-01-19T04:17:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 Processor -- start 2024-01-19T04:17:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- start start 2024-01-19T04:17:58.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d300a7390 0x7f1d3006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d300c1540 0x7f1d3014c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d30151e80 0x7f1d3014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300a9070 con 0x7f1d300a7390 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300a7aa0 con 0x7f1d300c1540 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d36200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30158830 con 0x7f1d30151e80 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d300a7390 0x7f1d3006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d300a7390 0x7f1d3006c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57654/0 (socket says 172.21.15.32:57654) 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 -- 172.21.15.32:0/3572483916 learned_addr learned my addr 172.21.15.32:0/3572483916 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2fe00640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d30151e80 0x7f1d3014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2ea00640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d300c1540 0x7f1d3014c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 -- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d30151e80 msgr2=0x7f1d3014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d30151e80 0x7f1d3014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 -- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d300c1540 msgr2=0x7f1d3014c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:58.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d300c1540 0x7f1d3014c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 -- 172.21.15.32:0/3572483916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18009420 con 0x7f1d300a7390 2024-01-19T04:17:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2fe00640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d30151e80 0x7f1d3014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.896+0000 7f1d2f400640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d300a7390 0x7f1d3006c1d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c450 tx=0x7f1d2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d27400640 1 -- 172.21.15.32:0/3572483916 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d200052d0 con 0x7f1d300a7390 2024-01-19T04:17:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d27400640 1 -- 172.21.15.32:0/3572483916 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d20005430 con 0x7f1d300a7390 2024-01-19T04:17:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d28009b30 con 0x7f1d300a7390 2024-01-19T04:17:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d27400640 1 -- 172.21.15.32:0/3572483916 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20007260 con 0x7f1d300a7390 2024-01-19T04:17:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d300aa870 con 0x7f1d300a7390 2024-01-19T04:17:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d300a7c30 con 0x7f1d300a7390 2024-01-19T04:17:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d27400640 1 -- 172.21.15.32:0/3572483916 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1d200073c0 con 0x7f1d300a7390 2024-01-19T04:17:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d27400640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d08066500 0x7f1d080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d27400640 1 -- 172.21.15.32:0/3572483916 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d20083790 con 0x7f1d300a7390 2024-01-19T04:17:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.900+0000 7f1d2ea00640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d08066500 0x7f1d080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.904+0000 7f1d2ea00640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d08066500 0x7f1d080689c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1d301eadb0 tx=0x7f1d18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:58.904+0000 7f1d27400640 1 -- 172.21.15.32:0/3572483916 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1d20050a20 con 0x7f1d300a7390 2024-01-19T04:17:59.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.064+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d300749f0 con 0x7f1d300a7390 2024-01-19T04:17:59.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.064+0000 7f1d27400640 1 -- 172.21.15.32:0/3572483916 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d20054040 con 0x7f1d300a7390 2024-01-19T04:17:59.068 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:17:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d08066500 msgr2=0x7f1d080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d08066500 0x7f1d080689c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1d301eadb0 tx=0x7f1d18008040 comp rx=0 tx=0).stop 2024-01-19T04:17:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d300a7390 msgr2=0x7f1d3006c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d300a7390 0x7f1d3006c1d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c450 tx=0x7f1d2000c910 comp rx=0 tx=0).stop 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 shutdown_connections 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d08066500 0x7f1d080689c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1d30151e80 0x7f1d3014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d300c1540 0x7f1d3014c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 --2- 172.21.15.32:0/3572483916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d300a7390 0x7f1d3006c1d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 >> 172.21.15.32:0/3572483916 conn(0x7f1d300726d0 msgr2=0x7f1d300c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 shutdown_connections 2024-01-19T04:17:59.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.068+0000 7f1d36200640 1 -- 172.21.15.32:0/3572483916 wait complete. 2024-01-19T04:17:59.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:17:59.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8769e00640 1 Processor -- start 2024-01-19T04:17:59.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8769e00640 1 -- start start 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8769e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f87640c2080 0x7f8764155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8769e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f876406d440 0x7f87640c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8769e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640a4ea0 con 0x7f87640723b0 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8769e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87641524a0 con 0x7f87640c2080 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8769e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8764152a20 con 0x7f876406d440 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8763400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f876406d440 0x7f87640c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8762000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f87640c2080 0x7f8764155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8762a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f87640723b0 0x7f8764152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:35494/0 (socket says 172.21.15.32:35494) 2024-01-19T04:17:59.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8763400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f876406d440 0x7f87640c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:48588/0 (socket says 172.21.15.32:48588) 2024-01-19T04:17:59.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8762a00640 1 -- 172.21.15.32:0/1237418949 learned_addr learned my addr 172.21.15.32:0/1237418949 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:59.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8762000640 1 -- 172.21.15.32:0/1237418949 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f876406d440 msgr2=0x7f87640c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:59.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8762000640 1 --2- 172.21.15.32:0/1237418949 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f876406d440 0x7f87640c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8762000640 1 -- 172.21.15.32:0/1237418949 >> v1:172.21.15.67:6789/0 conn(0x7f87640723b0 legacy=0x7f8764152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.232+0000 7f8762000640 1 -- 172.21.15.32:0/1237418949 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640c3430 con 0x7f87640c2080 2024-01-19T04:17:59.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8762000640 1 --2- 172.21.15.32:0/1237418949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87640c2080 0x7f8764155a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f874c0097c0 tx=0x7f874c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dab8bc5dc1f2682 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8761600640 1 -- 172.21.15.32:0/1237418949 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0ab600 con 0x7f87640c2080 2024-01-19T04:17:59.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8761600640 1 -- 172.21.15.32:0/1237418949 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c0a7050 con 0x7f87640c2080 2024-01-19T04:17:59.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8761600640 1 -- 172.21.15.32:0/1237418949 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0ab980 con 0x7f87640c2080 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 -- 172.21.15.32:0/1237418949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87640c2080 msgr2=0x7f8764155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 --2- 172.21.15.32:0/1237418949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87640c2080 0x7f8764155a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f874c0097c0 tx=0x7f874c01c330 comp rx=0 tx=0).stop 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 -- 172.21.15.32:0/1237418949 shutdown_connections 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 --2- 172.21.15.32:0/1237418949 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f876406d440 0x7f87640c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 --2- 172.21.15.32:0/1237418949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87640c2080 0x7f8764155a90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 -- 172.21.15.32:0/1237418949 >> 172.21.15.32:0/1237418949 conn(0x7f87640c25a0 msgr2=0x7f87640c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 -- 172.21.15.32:0/1237418949 shutdown_connections 2024-01-19T04:17:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.236+0000 7f8769e00640 1 -- 172.21.15.32:0/1237418949 wait complete. 2024-01-19T04:17:59.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 Processor -- start 2024-01-19T04:17:59.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 -- start start 2024-01-19T04:17:59.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f876406d440 0x7f87641f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87640723b0 0x7f87640c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87640c2080 0x7f8764154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876414ef20 con 0x7f87640c2080 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87641f1540 con 0x7f876406d440 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87641540a0 con 0x7f87640723b0 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87640c2080 0x7f8764154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87640c2080 0x7f8764154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57664/0 (socket says 172.21.15.32:57664) 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 -- 172.21.15.32:0/1871226593 learned_addr learned my addr 172.21.15.32:0/1871226593 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8762a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f876406d440 0x7f87641f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8762000640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87640723b0 0x7f87640c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 -- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87640723b0 msgr2=0x7f87640c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87640723b0 0x7f87640c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 -- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f876406d440 msgr2=0x7f87641f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f876406d440 0x7f87641f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 -- 172.21.15.32:0/1871226593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c009420 con 0x7f87640c2080 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8763400640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87640c2080 0x7f8764154530 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f875c00efc0 tx=0x7f875c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f875b400640 1 -- 172.21.15.32:0/1871226593 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c009b20 con 0x7f87640c2080 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f875b400640 1 -- 172.21.15.32:0/1871226593 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00f040 con 0x7f87640c2080 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f875b400640 1 -- 172.21.15.32:0/1871226593 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0146c0 con 0x7f87640c2080 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640c4bb0 con 0x7f87640c2080 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.240+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876414f6e0 con 0x7f87640c2080 2024-01-19T04:17:59.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.244+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8764154210 con 0x7f87640c2080 2024-01-19T04:17:59.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.244+0000 7f875b400640 1 -- 172.21.15.32:0/1871226593 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f875c014820 con 0x7f87640c2080 2024-01-19T04:17:59.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.244+0000 7f875b400640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f873c066500 0x7f873c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.244+0000 7f875b400640 1 -- 172.21.15.32:0/1871226593 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f875c084aa0 con 0x7f87640c2080 2024-01-19T04:17:59.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.244+0000 7f8762a00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f873c066500 0x7f873c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.244+0000 7f8762a00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f873c066500 0x7f873c0689c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8754000f70 tx=0x7f8754007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.248+0000 7f875b400640 1 -- 172.21.15.32:0/1871226593 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f875c051e80 con 0x7f87640c2080 2024-01-19T04:17:59.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8764155f50 con 0x7f87640c2080 2024-01-19T04:17:59.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f875b400640 1 -- 172.21.15.32:0/1871226593 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f875c0180a0 con 0x7f87640c2080 2024-01-19T04:17:59.411 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:17:59.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f873c066500 msgr2=0x7f873c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f873c066500 0x7f873c0689c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8754000f70 tx=0x7f8754007e90 comp rx=0 tx=0).stop 2024-01-19T04:17:59.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87640c2080 msgr2=0x7f8764154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87640c2080 0x7f8764154530 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f875c00efc0 tx=0x7f875c00c490 comp rx=0 tx=0).stop 2024-01-19T04:17:59.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 shutdown_connections 2024-01-19T04:17:59.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f873c066500 0x7f873c0689c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87640c2080 0x7f8764154530 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f87640723b0 0x7f87640c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 --2- 172.21.15.32:0/1871226593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f876406d440 0x7f87641f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 >> 172.21.15.32:0/1871226593 conn(0x7f87640c25a0 msgr2=0x7f8764151920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 shutdown_connections 2024-01-19T04:17:59.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.408+0000 7f8769e00640 1 -- 172.21.15.32:0/1871226593 wait complete. 2024-01-19T04:17:59.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:17:59.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f047d000640 1 Processor -- start 2024-01-19T04:17:59.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f047d000640 1 -- start start 2024-01-19T04:17:59.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f047d000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04780c6f80 0x7f04780c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f047d000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04781524e0 0x7f0478152920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f047d000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780c6cc0 con 0x7f04780c2820 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f047d000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0478155a50 con 0x7f04780c6f80 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f047d000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780c40b0 con 0x7f04781524e0 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0475e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04780c6f80 0x7f04780c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0476800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f04780c2820 0x7f04780c2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46844/0 (socket says 172.21.15.32:46844) 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0476800640 1 -- 172.21.15.32:0/531274896 learned_addr learned my addr 172.21.15.32:0/531274896 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0475400640 1 --2- 172.21.15.32:0/531274896 >> v2:172.21.15.67:3300/0 conn(0x7f04781524e0 0x7f0478152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0475e00640 1 -- 172.21.15.32:0/531274896 >> v2:172.21.15.67:3300/0 conn(0x7f04781524e0 msgr2=0x7f0478152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:59.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0475e00640 1 --2- 172.21.15.32:0/531274896 >> v2:172.21.15.67:3300/0 conn(0x7f04781524e0 0x7f0478152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0475e00640 1 -- 172.21.15.32:0/531274896 >> v1:172.21.15.32:6789/0 conn(0x7f04780c2820 legacy=0x7f04780c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0475e00640 1 -- 172.21.15.32:0/531274896 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478155d10 con 0x7f04780c6f80 2024-01-19T04:17:59.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.576+0000 7f0474a00640 1 -- 172.21.15.32:0/531274896 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184952797 0 0) 0x7f04780c6cc0 con 0x7f04780c2820 2024-01-19T04:17:59.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f0475e00640 1 --2- 172.21.15.32:0/531274896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c6f80 0x7f04780c7360 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f04781559b0 tx=0x7f046801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae6f3fa959f78ff server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f0474a00640 1 -- 172.21.15.32:0/531274896 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680a7070 con 0x7f04780c6f80 2024-01-19T04:17:59.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f0474a00640 1 -- 172.21.15.32:0/531274896 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04680ab430 con 0x7f04780c6f80 2024-01-19T04:17:59.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f0474a00640 1 -- 172.21.15.32:0/531274896 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680ab7c0 con 0x7f04780c6f80 2024-01-19T04:17:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 -- 172.21.15.32:0/531274896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c6f80 msgr2=0x7f04780c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 --2- 172.21.15.32:0/531274896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c6f80 0x7f04780c7360 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f04781559b0 tx=0x7f046801c430 comp rx=0 tx=0).stop 2024-01-19T04:17:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 -- 172.21.15.32:0/531274896 shutdown_connections 2024-01-19T04:17:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 --2- 172.21.15.32:0/531274896 >> v2:172.21.15.67:3300/0 conn(0x7f04781524e0 0x7f0478152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 --2- 172.21.15.32:0/531274896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c6f80 0x7f04780c7360 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 -- 172.21.15.32:0/531274896 >> 172.21.15.32:0/531274896 conn(0x7f04780663f0 msgr2=0x7f0478066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:59.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 -- 172.21.15.32:0/531274896 shutdown_connections 2024-01-19T04:17:59.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.580+0000 7f047d000640 1 -- 172.21.15.32:0/531274896 wait complete. 2024-01-19T04:17:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 Processor -- start 2024-01-19T04:17:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 -- start start 2024-01-19T04:17:59.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c2820 0x7f047806b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04780c6f80 0x7f04780c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04781524e0 0x7f04781490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047806e020 con 0x7f04780c2820 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047806dd10 con 0x7f04780c6f80 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047806bcd0 con 0x7f04781524e0 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c2820 0x7f047806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c2820 0x7f047806b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57678/0 (socket says 172.21.15.32:57678) 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 -- 172.21.15.32:0/2503461008 learned_addr learned my addr 172.21.15.32:0/2503461008 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475400640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04780c6f80 0x7f04780c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0476800640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04781524e0 0x7f04781490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 -- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04781524e0 msgr2=0x7f04781490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04781524e0 0x7f04781490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 -- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04780c6f80 msgr2=0x7f04780c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04780c6f80 0x7f04780c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 -- 172.21.15.32:0/2503461008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0468009420 con 0x7f04780c2820 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0476800640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04781524e0 0x7f04781490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f0475e00640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c2820 0x7f047806b790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f04680ad040 tx=0x7f046801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f046e000640 1 -- 172.21.15.32:0/2503461008 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680bf610 con 0x7f04780c2820 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f046e000640 1 -- 172.21.15.32:0/2503461008 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04680bf790 con 0x7f04780c2820 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047806fdd0 con 0x7f04780c2820 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f046e000640 1 -- 172.21.15.32:0/2503461008 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680bfb40 con 0x7f04780c2820 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047806fad0 con 0x7f04780c2820 2024-01-19T04:17:59.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.584+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04780749f0 con 0x7f04780c2820 2024-01-19T04:17:59.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.588+0000 7f046e000640 1 -- 172.21.15.32:0/2503461008 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f04680b5400 con 0x7f04780c2820 2024-01-19T04:17:59.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.588+0000 7f046e000640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0450066500 0x7f04500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.588+0000 7f046e000640 1 -- 172.21.15.32:0/2503461008 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f046811e960 con 0x7f04780c2820 2024-01-19T04:17:59.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.588+0000 7f0475400640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0450066500 0x7f04500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.588+0000 7f0475400640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0450066500 0x7f04500689c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f047815d570 tx=0x7f0460009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.592+0000 7f046e000640 1 -- 172.21.15.32:0/2503461008 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f04680ebc10 con 0x7f04780c2820 2024-01-19T04:17:59.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04780702f0 con 0x7f04780c2820 2024-01-19T04:17:59.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f046e000640 1 -- 172.21.15.32:0/2503461008 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04680ef230 con 0x7f04780c2820 2024-01-19T04:17:59.755 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:17:59.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0450066500 msgr2=0x7f04500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0450066500 0x7f04500689c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f047815d570 tx=0x7f0460009190 comp rx=0 tx=0).stop 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c2820 msgr2=0x7f047806b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c2820 0x7f047806b790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f04680ad040 tx=0x7f046801ac70 comp rx=0 tx=0).stop 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 shutdown_connections 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0450066500 0x7f04500689c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f04781524e0 0x7f04781490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04780c6f80 0x7f04780c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 --2- 172.21.15.32:0/2503461008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04780c2820 0x7f047806b790 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 >> 172.21.15.32:0/2503461008 conn(0x7f04780663f0 msgr2=0x7f04780667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 shutdown_connections 2024-01-19T04:17:59.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.752+0000 7f047d000640 1 -- 172.21.15.32:0/2503461008 wait complete. 2024-01-19T04:17:59.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T04:17:59.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.916+0000 7f5567e00640 1 Processor -- start 2024-01-19T04:17:59.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.916+0000 7f5567e00640 1 -- start start 2024-01-19T04:17:59.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5567e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5567e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55600c04a0 0x7f55600c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5567e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5560071e80 con 0x7f55600a4ec0 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5567e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55601535c0 con 0x7f55600c04a0 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5567e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600726c0 con 0x7f556014fb50 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5564a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55600c04a0 0x7f55600c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5565e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f55600a4ec0 0x7f5560155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46858/0 (socket says 172.21.15.32:46858) 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5565e00640 1 -- 172.21.15.32:0/2399212696 learned_addr learned my addr 172.21.15.32:0/2399212696 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:17:59.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5565400640 1 --2- 172.21.15.32:0/2399212696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5564a00640 1 -- 172.21.15.32:0/2399212696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 msgr2=0x7f556006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:17:59.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5564a00640 1 --2- 172.21.15.32:0/2399212696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5564a00640 1 -- 172.21.15.32:0/2399212696 >> v1:172.21.15.32:6789/0 conn(0x7f55600a4ec0 legacy=0x7f5560155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5564a00640 1 -- 172.21.15.32:0/2399212696 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600c0a20 con 0x7f55600c04a0 2024-01-19T04:17:59.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f555fe00640 1 -- 172.21.15.32:0/2399212696 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723538642 0 0) 0x7f5560071e80 con 0x7f55600a4ec0 2024-01-19T04:17:59.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.920+0000 7f5565400640 1 --2- 172.21.15.32:0/2399212696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:17:59.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5564a00640 1 --2- 172.21.15.32:0/2399212696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600c1230 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f55480097f0 tx=0x7f554801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652d3c0ee4d077b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f555fe00640 1 -- 172.21.15.32:0/2399212696 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480ab600 con 0x7f55600c04a0 2024-01-19T04:17:59.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f555fe00640 1 -- 172.21.15.32:0/2399212696 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55480a7050 con 0x7f55600c04a0 2024-01-19T04:17:59.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f555fe00640 1 -- 172.21.15.32:0/2399212696 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480ab980 con 0x7f55600c04a0 2024-01-19T04:17:59.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 -- 172.21.15.32:0/2399212696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 msgr2=0x7f55600c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 --2- 172.21.15.32:0/2399212696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600c1230 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f55480097f0 tx=0x7f554801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 -- 172.21.15.32:0/2399212696 shutdown_connections 2024-01-19T04:17:59.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 --2- 172.21.15.32:0/2399212696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600c1230 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 --2- 172.21.15.32:0/2399212696 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 -- 172.21.15.32:0/2399212696 >> 172.21.15.32:0/2399212696 conn(0x7f55600c5b20 msgr2=0x7f55600c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:17:59.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 -- 172.21.15.32:0/2399212696 shutdown_connections 2024-01-19T04:17:59.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 -- 172.21.15.32:0/2399212696 wait complete. 2024-01-19T04:17:59.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 Processor -- start 2024-01-19T04:17:59.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.924+0000 7f5567e00640 1 -- start start 2024-01-19T04:17:59.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55600a4ec0 0x7f556014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55601ed110 con 0x7f55600c04a0 2024-01-19T04:17:59.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600c6050 con 0x7f55600a4ec0 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55601f1090 con 0x7f556014fb50 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57706/0 (socket says 172.21.15.32:57706) 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 -- 172.21.15.32:0/2331757404 learned_addr learned my addr 172.21.15.32:0/2331757404 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 -- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 msgr2=0x7f556014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 -- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55600a4ec0 msgr2=0x7f556014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55600a4ec0 0x7f556014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:17:59.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 -- 172.21.15.32:0/2331757404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548009420 con 0x7f55600c04a0 2024-01-19T04:17:59.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5564a00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600a9f50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f554801a020 tx=0x7f5548019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f555d600640 1 -- 172.21.15.32:0/2331757404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480b4610 con 0x7f55600c04a0 2024-01-19T04:17:59.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f555d600640 1 -- 172.21.15.32:0/2331757404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55480abe90 con 0x7f55600c04a0 2024-01-19T04:17:59.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f555d600640 1 -- 172.21.15.32:0/2331757404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480b49d0 con 0x7f55600c04a0 2024-01-19T04:17:59.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55601f1370 con 0x7f55600c04a0 2024-01-19T04:17:59.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55601ed5e0 con 0x7f55600c04a0 2024-01-19T04:17:59.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55600749f0 con 0x7f55600c04a0 2024-01-19T04:17:59.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.928+0000 7f555d600640 1 -- 172.21.15.32:0/2331757404 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f55480b2040 con 0x7f55600c04a0 2024-01-19T04:17:59.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.932+0000 7f555d600640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5538066500 0x7f55380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:17:59.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.932+0000 7f555d600640 1 -- 172.21.15.32:0/2331757404 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f554811dff0 con 0x7f55600c04a0 2024-01-19T04:17:59.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.932+0000 7f5565400640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5538066500 0x7f55380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:17:59.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.932+0000 7f5565400640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5538066500 0x7f55380689c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5550006e90 tx=0x7f5550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:17:59.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:17:59.936+0000 7f555d600640 1 -- 172.21.15.32:0/2331757404 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f554814f4d0 con 0x7f55600c04a0 2024-01-19T04:18:00.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.140+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f556015d0b0 con 0x7f55600c04a0 2024-01-19T04:18:00.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.140+0000 7f555d600640 1 -- 172.21.15.32:0/2331757404 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) v1 ==== 84+0+209 (secure 0 0 0) 0x7f55480eb2c0 con 0x7f55600c04a0 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 12, 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "cephfs_metadata" 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 13, 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "cephfs_data" 2024-01-19T04:18:00.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-01-19T04:18:00.145 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-01-19T04:18:00.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.140+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5538066500 msgr2=0x7f55380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:00.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.140+0000 7f5567e00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5538066500 0x7f55380689c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5550006e90 tx=0x7f5550008040 comp rx=0 tx=0).stop 2024-01-19T04:18:00.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.140+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 msgr2=0x7f55600a9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:00.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.140+0000 7f5567e00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600a9f50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f554801a020 tx=0x7f5548019190 comp rx=0 tx=0).stop 2024-01-19T04:18:00.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 shutdown_connections 2024-01-19T04:18:00.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5538066500 0x7f55380689c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f556014fb50 0x7f556014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55600c04a0 0x7f55600a9f50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 --2- 172.21.15.32:0/2331757404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55600a4ec0 0x7f556014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 >> 172.21.15.32:0/2331757404 conn(0x7f55600c5b20 msgr2=0x7f55600beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:00.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 shutdown_connections 2024-01-19T04:18:00.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.144+0000 7f5567e00640 1 -- 172.21.15.32:0/2331757404 wait complete. 2024-01-19T04:18:00.167 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-19T04:18:00.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-19T04:18:00.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.308+0000 7f7e6d800640 1 Processor -- start 2024-01-19T04:18:00.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.308+0000 7f7e6d800640 1 -- start start 2024-01-19T04:18:00.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e6d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e680c49e0 0x7f7e680c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:00.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e6d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7e680c5cc0 0x7f7e681584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e6d800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e6806b960 0x7f7e681589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e6d800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680c73c0 con 0x7f7e680c5cc0 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e6d800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680c7c60 con 0x7f7e6806b960 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e6d800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68158020 con 0x7f7e680c49e0 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7e680c5cc0 0x7f7e681584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7e680c5cc0 0x7f7e681584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57712/0 (socket says 172.21.15.32:57712) 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 -- 172.21.15.32:0/924371523 learned_addr learned my addr 172.21.15.32:0/924371523 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66a00640 1 --2- 172.21.15.32:0/924371523 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e680c49e0 0x7f7e680c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:00.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e67400640 1 --2- 172.21.15.32:0/924371523 >> v2:172.21.15.67:3300/0 conn(0x7f7e6806b960 0x7f7e681589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:00.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 -- 172.21.15.32:0/924371523 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e680c49e0 msgr2=0x7f7e680c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:00.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 --2- 172.21.15.32:0/924371523 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e680c49e0 0x7f7e680c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 -- 172.21.15.32:0/924371523 >> v2:172.21.15.67:3300/0 conn(0x7f7e6806b960 msgr2=0x7f7e681589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:00.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 --2- 172.21.15.32:0/924371523 >> v2:172.21.15.67:3300/0 conn(0x7f7e6806b960 0x7f7e681589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.312+0000 7f7e66000640 1 -- 172.21.15.32:0/924371523 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680c61d0 con 0x7f7e680c5cc0 2024-01-19T04:18:00.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e66000640 1 --2- 172.21.15.32:0/924371523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e681584b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7e680c25f0 tx=0x7f7e5001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc39e46e88cd701 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:00.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e65600640 1 -- 172.21.15.32:0/924371523 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500ab600 con 0x7f7e680c5cc0 2024-01-19T04:18:00.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e65600640 1 -- 172.21.15.32:0/924371523 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e500a7050 con 0x7f7e680c5cc0 2024-01-19T04:18:00.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e65600640 1 -- 172.21.15.32:0/924371523 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500ab980 con 0x7f7e680c5cc0 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 -- 172.21.15.32:0/924371523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 msgr2=0x7f7e681584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 --2- 172.21.15.32:0/924371523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e681584b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7e680c25f0 tx=0x7f7e5001c3b0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 -- 172.21.15.32:0/924371523 shutdown_connections 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 --2- 172.21.15.32:0/924371523 >> v2:172.21.15.67:3300/0 conn(0x7f7e6806b960 0x7f7e681589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 --2- 172.21.15.32:0/924371523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e681584b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 --2- 172.21.15.32:0/924371523 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e680c49e0 0x7f7e680c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 -- 172.21.15.32:0/924371523 >> 172.21.15.32:0/924371523 conn(0x7f7e680a9af0 msgr2=0x7f7e680a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:00.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 -- 172.21.15.32:0/924371523 shutdown_connections 2024-01-19T04:18:00.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 -- 172.21.15.32:0/924371523 wait complete. 2024-01-19T04:18:00.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 Processor -- start 2024-01-19T04:18:00.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.316+0000 7f7e6d800640 1 -- start start 2024-01-19T04:18:00.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e6806b960 0x7f7e6814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:00.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e680c49e0 0x7f7e680ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:00.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e68155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:00.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680ab8f0 con 0x7f7e680c5cc0 2024-01-19T04:18:00.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6814f910 con 0x7f7e680c49e0 2024-01-19T04:18:00.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6814fbf0 con 0x7f7e6806b960 2024-01-19T04:18:00.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e67400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e68155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:00.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e6806b960 0x7f7e6814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:00.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e680c49e0 0x7f7e680ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:00.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e6806b960 0x7f7e6814ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:48632/0 (socket says 172.21.15.32:48632) 2024-01-19T04:18:00.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66a00640 1 -- 172.21.15.32:0/2120324981 learned_addr learned my addr 172.21.15.32:0/2120324981 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:00.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e67400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e68155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57720/0 (socket says 172.21.15.32:57720) 2024-01-19T04:18:00.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66000640 1 -- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e6806b960 msgr2=0x7f7e6814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:00.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66000640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e6806b960 0x7f7e6814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66000640 1 -- 172.21.15.32:0/2120324981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 msgr2=0x7f7e68155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:00.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66000640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e68155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66000640 1 -- 172.21.15.32:0/2120324981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500094d0 con 0x7f7e680c49e0 2024-01-19T04:18:00.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e67400640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e68155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:00.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e66000640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e680c49e0 0x7f7e680ab3b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7e500ab000 tx=0x7f7e5001abf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:00.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e5ea00640 1 -- 172.21.15.32:0/2120324981 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500b6420 con 0x7f7e680c49e0 2024-01-19T04:18:00.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e5ea00640 1 -- 172.21.15.32:0/2120324981 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e500b65a0 con 0x7f7e680c49e0 2024-01-19T04:18:00.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e5ea00640 1 -- 172.21.15.32:0/2120324981 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500b6950 con 0x7f7e680c49e0 2024-01-19T04:18:00.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e681f1030 con 0x7f7e680c49e0 2024-01-19T04:18:00.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68155980 con 0x7f7e680c49e0 2024-01-19T04:18:00.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68068290 con 0x7f7e680c49e0 2024-01-19T04:18:00.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.320+0000 7f7e5ea00640 1 -- 172.21.15.32:0/2120324981 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7e500b2040 con 0x7f7e680c49e0 2024-01-19T04:18:00.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.324+0000 7f7e5ea00640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7e40066530 0x7f7e400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:00.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.324+0000 7f7e5ea00640 1 -- 172.21.15.32:0/2120324981 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e5011e000 con 0x7f7e680c49e0 2024-01-19T04:18:00.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.324+0000 7f7e66a00640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7e40066530 0x7f7e400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:00.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.324+0000 7f7e66a00640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7e40066530 0x7f7e400689f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009c60 tx=0x7f7e58009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:00.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.328+0000 7f7e5ea00640 1 -- 172.21.15.32:0/2120324981 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7e500eb340 con 0x7f7e680c49e0 2024-01-19T04:18:00.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.484+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7e681f1220 con 0x7f7e680c49e0 2024-01-19T04:18:00.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.892+0000 7f7e5ea00640 1 -- 172.21.15.32:0/2120324981 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v72) v1 ==== 140+0+0 (secure 0 0 0) 0x7f7e500ee960 con 0x7f7e680c49e0 2024-01-19T04:18:00.895 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_metadata' created 2024-01-19T04:18:00.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7e40066530 msgr2=0x7f7e400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:00.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7e40066530 0x7f7e400689f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009c60 tx=0x7f7e58009190 comp rx=0 tx=0).stop 2024-01-19T04:18:00.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e680c49e0 msgr2=0x7f7e680ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:00.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e680c49e0 0x7f7e680ab3b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7e500ab000 tx=0x7f7e5001abf0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 shutdown_connections 2024-01-19T04:18:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7e40066530 0x7f7e400689f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e680c5cc0 0x7f7e68155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e680c49e0 0x7f7e680ab3b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 --2- 172.21.15.32:0/2120324981 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7e6806b960 0x7f7e6814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:00.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.896+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 >> 172.21.15.32:0/2120324981 conn(0x7f7e680a9af0 msgr2=0x7f7e6815e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.900+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 shutdown_connections 2024-01-19T04:18:00.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:00.900+0000 7f7e6d800640 1 -- 172.21.15.32:0/2120324981 wait complete. 2024-01-19T04:18:00.926 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T04:18:01.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4aba200640 1 Processor -- start 2024-01-19T04:18:01.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4aba200640 1 -- start start 2024-01-19T04:18:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4aba200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c4e50 0x7f4ab40c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4aba200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4ab40c6120 0x7f4ab40c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4aba200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab40c6af0 con 0x7f4ab4152620 2024-01-19T04:18:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4aba200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab406ea00 con 0x7f4ab40c6120 2024-01-19T04:18:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4aba200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4152bc0 con 0x7f4ab40c4e50 2024-01-19T04:18:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab2a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4ab4152620 0x7f4ab406f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46860/0 (socket says 172.21.15.32:46860) 2024-01-19T04:18:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab2a00640 1 -- 172.21.15.32:0/1810750919 learned_addr learned my addr 172.21.15.32:0/1810750919 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab3e00640 1 --2- 172.21.15.32:0/1810750919 >> v2:172.21.15.67:3300/0 conn(0x7f4ab40c6120 0x7f4ab40c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab3400640 1 --2- 172.21.15.32:0/1810750919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c4e50 0x7f4ab40c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab2000640 1 -- 172.21.15.32:0/1810750919 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547940906 0 0) 0x7f4ab40c6af0 con 0x7f4ab4152620 2024-01-19T04:18:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab2000640 1 -- 172.21.15.32:0/1810750919 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a94003530 con 0x7f4ab4152620 2024-01-19T04:18:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab3400640 1 -- 172.21.15.32:0/1810750919 >> v2:172.21.15.67:3300/0 conn(0x7f4ab40c6120 msgr2=0x7f4ab40c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab3400640 1 --2- 172.21.15.32:0/1810750919 >> v2:172.21.15.67:3300/0 conn(0x7f4ab40c6120 0x7f4ab40c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab3400640 1 -- 172.21.15.32:0/1810750919 >> v1:172.21.15.32:6789/0 conn(0x7f4ab4152620 legacy=0x7f4ab406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:01.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab3400640 1 -- 172.21.15.32:0/1810750919 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4152ea0 con 0x7f4ab40c4e50 2024-01-19T04:18:01.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.072+0000 7f4ab3e00640 1 --2- 172.21.15.32:0/1810750919 >> v2:172.21.15.67:3300/0 conn(0x7f4ab40c6120 0x7f4ab40c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:01.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4ab3400640 1 --2- 172.21.15.32:0/1810750919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c4e50 0x7f4ab40c75a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40097c0 tx=0x7f4aa401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46f1764411524b06 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:01.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4ab2000640 1 -- 172.21.15.32:0/1810750919 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40a8970 con 0x7f4ab40c4e50 2024-01-19T04:18:01.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4ab2000640 1 -- 172.21.15.32:0/1810750919 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa40a8ad0 con 0x7f4ab40c4e50 2024-01-19T04:18:01.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4ab2000640 1 -- 172.21.15.32:0/1810750919 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40a8e40 con 0x7f4ab40c4e50 2024-01-19T04:18:01.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 -- 172.21.15.32:0/1810750919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c4e50 msgr2=0x7f4ab40c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:01.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 --2- 172.21.15.32:0/1810750919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c4e50 0x7f4ab40c75a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40097c0 tx=0x7f4aa401ec70 comp rx=0 tx=0).stop 2024-01-19T04:18:01.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 -- 172.21.15.32:0/1810750919 shutdown_connections 2024-01-19T04:18:01.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 --2- 172.21.15.32:0/1810750919 >> v2:172.21.15.67:3300/0 conn(0x7f4ab40c6120 0x7f4ab40c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 --2- 172.21.15.32:0/1810750919 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c4e50 0x7f4ab40c75a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 -- 172.21.15.32:0/1810750919 >> 172.21.15.32:0/1810750919 conn(0x7f4ab40c7d40 msgr2=0x7f4ab40c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:01.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 -- 172.21.15.32:0/1810750919 shutdown_connections 2024-01-19T04:18:01.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.076+0000 7f4aba200640 1 -- 172.21.15.32:0/1810750919 wait complete. 2024-01-19T04:18:01.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 Processor -- start 2024-01-19T04:18:01.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 -- start start 2024-01-19T04:18:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab40c4e50 0x7f4ab414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c6120 0x7f4ab40accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ab4152620 0x7f4ab414af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab414d0d0 con 0x7f4ab40c4e50 2024-01-19T04:18:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40ac840 con 0x7f4ab4152620 2024-01-19T04:18:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab406d390 con 0x7f4ab40c6120 2024-01-19T04:18:01.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab40c4e50 0x7f4ab414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:01.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab40c4e50 0x7f4ab414c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57724/0 (socket says 172.21.15.32:57724) 2024-01-19T04:18:01.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 -- 172.21.15.32:0/497932053 learned_addr learned my addr 172.21.15.32:0/497932053 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:01.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3e00640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ab4152620 0x7f4ab414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:01.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab2a00640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c6120 0x7f4ab40accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 -- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c6120 msgr2=0x7f4ab40accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c6120 0x7f4ab40accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 -- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ab4152620 msgr2=0x7f4ab414af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ab4152620 0x7f4ab414af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 -- 172.21.15.32:0/497932053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac009a70 con 0x7f4ab40c4e50 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4ab3400640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab40c4e50 0x7f4ab414c250 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40b3040 tx=0x7f4aa401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aab400640 1 -- 172.21.15.32:0/497932053 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40bd070 con 0x7f4ab40c4e50 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aab400640 1 -- 172.21.15.32:0/497932053 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4006e20 con 0x7f4ab40c4e50 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa4009420 con 0x7f4ab40c4e50 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aab400640 1 -- 172.21.15.32:0/497932053 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40b0d80 con 0x7f4ab40c4e50 2024-01-19T04:18:01.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.080+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab406cdd0 con 0x7f4ab40c4e50 2024-01-19T04:18:01.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.084+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab40749f0 con 0x7f4ab40c4e50 2024-01-19T04:18:01.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.084+0000 7f4aab400640 1 -- 172.21.15.32:0/497932053 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4aa40b7040 con 0x7f4ab40c4e50 2024-01-19T04:18:01.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.084+0000 7f4aab400640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a8c066500 0x7f4a8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:01.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.084+0000 7f4aab400640 1 -- 172.21.15.32:0/497932053 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f4aa4121b00 con 0x7f4ab40c4e50 2024-01-19T04:18:01.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.084+0000 7f4ab2a00640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a8c066500 0x7f4a8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:01.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.088+0000 7f4ab2a00640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a8c066500 0x7f4a8c0689c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c007fd0 tx=0x7f4a9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:01.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.088+0000 7f4aab400640 1 -- 172.21.15.32:0/497932053 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4aa40eede0 con 0x7f4ab40c4e50 2024-01-19T04:18:01.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.248+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4ab40c4660 con 0x7f4ab40c4e50 2024-01-19T04:18:01.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.896+0000 7f4aab400640 1 -- 172.21.15.32:0/497932053 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v73) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4aa40f2400 con 0x7f4ab40c4e50 2024-01-19T04:18:01.899 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_data' created 2024-01-19T04:18:01.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.896+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a8c066500 msgr2=0x7f4a8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.896+0000 7f4aba200640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a8c066500 0x7f4a8c0689c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c007fd0 tx=0x7f4a9c009040 comp rx=0 tx=0).stop 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.896+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab40c4e50 msgr2=0x7f4ab414c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.896+0000 7f4aba200640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab40c4e50 0x7f4ab414c250 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40b3040 tx=0x7f4aa401ba10 comp rx=0 tx=0).stop 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 shutdown_connections 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4a8c066500 0x7f4a8c0689c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ab4152620 0x7f4ab414af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ab40c6120 0x7f4ab40accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 --2- 172.21.15.32:0/497932053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab40c4e50 0x7f4ab414c250 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:01.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 >> 172.21.15.32:0/497932053 conn(0x7f4ab40c7d40 msgr2=0x7f4ab40c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:01.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 shutdown_connections 2024-01-19T04:18:01.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:01.900+0000 7f4aba200640 1 -- 172.21.15.32:0/497932053 wait complete. 2024-01-19T04:18:01.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-19T04:18:02.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55bc00640 1 Processor -- start 2024-01-19T04:18:02.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55bc00640 1 -- start start 2024-01-19T04:18:02.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55bc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe554151fc0 0x7fe5540a9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55bc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5540c35b0 con 0x7fe554158370 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55bc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5540a9520 con 0x7fe55406f8d0 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55bc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5541523a0 con 0x7fe554151fc0 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55a600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe554158370 0x7fe55415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46864/0 (socket says 172.21.15.32:46864) 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe55a600640 1 -- 172.21.15.32:0/3263521463 learned_addr learned my addr 172.21.15.32:0/3263521463 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe559200640 1 --2- 172.21.15.32:0/3263521463 >> v2:172.21.15.67:3300/0 conn(0x7fe554151fc0 0x7fe5540a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe553e00640 1 -- 172.21.15.32:0/3263521463 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612038967 0 0) 0x7fe5540c35b0 con 0x7fe554158370 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe553e00640 1 -- 172.21.15.32:0/3263521463 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe534003530 con 0x7fe554158370 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe553e00640 1 -- 172.21.15.32:0/3263521463 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504979073 0 0) 0x7fe5540a9520 con 0x7fe55406f8d0 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.092+0000 7fe553e00640 1 -- 172.21.15.32:0/3263521463 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5540c35b0 con 0x7fe55406f8d0 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe559200640 1 -- 172.21.15.32:0/3263521463 >> v1:172.21.15.67:6789/0 conn(0x7fe55406f8d0 legacy=0x7fe554157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe559200640 1 -- 172.21.15.32:0/3263521463 >> v1:172.21.15.32:6789/0 conn(0x7fe554158370 legacy=0x7fe55415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:02.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe559200640 1 -- 172.21.15.32:0/3263521463 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540a8f60 con 0x7fe554151fc0 2024-01-19T04:18:02.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe559200640 1 --2- 172.21.15.32:0/3263521463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 0x7fe5540a9900 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe5440097c0 tx=0x7fe54401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dddde66eaf1c188 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:02.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe553e00640 1 -- 172.21.15.32:0/3263521463 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544004230 con 0x7fe554151fc0 2024-01-19T04:18:02.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe553e00640 1 -- 172.21.15.32:0/3263521463 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5440a7050 con 0x7fe554151fc0 2024-01-19T04:18:02.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe553e00640 1 -- 172.21.15.32:0/3263521463 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544003620 con 0x7fe554151fc0 2024-01-19T04:18:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe55bc00640 1 -- 172.21.15.32:0/3263521463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 msgr2=0x7fe5540a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.096+0000 7fe55bc00640 1 --2- 172.21.15.32:0/3263521463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 0x7fe5540a9900 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe5440097c0 tx=0x7fe54401c330 comp rx=0 tx=0).stop 2024-01-19T04:18:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- 172.21.15.32:0/3263521463 shutdown_connections 2024-01-19T04:18:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 --2- 172.21.15.32:0/3263521463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 0x7fe5540a9900 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- 172.21.15.32:0/3263521463 >> 172.21.15.32:0/3263521463 conn(0x7fe5540c7390 msgr2=0x7fe5540c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- 172.21.15.32:0/3263521463 shutdown_connections 2024-01-19T04:18:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- 172.21.15.32:0/3263521463 wait complete. 2024-01-19T04:18:02.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 Processor -- start 2024-01-19T04:18:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- start start 2024-01-19T04:18:02.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe55406f8d0 0x7fe554146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:02.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 0x7fe55414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:02.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe554158370 0x7fe554142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:02.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55414fb90 con 0x7fe55406f8d0 2024-01-19T04:18:02.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55414f8b0 con 0x7fe554151fc0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55bc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540abfe0 con 0x7fe554158370 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe55406f8d0 0x7fe554146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe55406f8d0 0x7fe554146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57728/0 (socket says 172.21.15.32:57728) 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 -- 172.21.15.32:0/443329484 learned_addr learned my addr 172.21.15.32:0/443329484 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe54be00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 0x7fe55414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe55a600640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe554158370 0x7fe554142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 -- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe554158370 msgr2=0x7fe554142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe554158370 0x7fe554142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 -- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 msgr2=0x7fe55414b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 0x7fe55414b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.100+0000 7fe559200640 1 -- 172.21.15.32:0/443329484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe544009420 con 0x7fe55406f8d0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe559200640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe55406f8d0 0x7fe554146c00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe5440ae040 tx=0x7fe5440190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe551600640 1 -- 172.21.15.32:0/443329484 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544003af0 con 0x7fe55406f8d0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe551600640 1 -- 172.21.15.32:0/443329484 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe544003c50 con 0x7fe55406f8d0 2024-01-19T04:18:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5540ac2c0 con 0x7fe55406f8d0 2024-01-19T04:18:02.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe551600640 1 -- 172.21.15.32:0/443329484 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5440ab440 con 0x7fe55406f8d0 2024-01-19T04:18:02.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55414b6a0 con 0x7fe55406f8d0 2024-01-19T04:18:02.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5540ac7e0 con 0x7fe55406f8d0 2024-01-19T04:18:02.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe551600640 1 -- 172.21.15.32:0/443329484 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe5440b2040 con 0x7fe55406f8d0 2024-01-19T04:18:02.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe551600640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe52c066500 0x7fe52c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:02.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe551600640 1 -- 172.21.15.32:0/443329484 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fe54411e2f0 con 0x7fe55406f8d0 2024-01-19T04:18:02.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.104+0000 7fe54be00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe52c066500 0x7fe52c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:02.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.108+0000 7fe54be00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe52c066500 0x7fe52c0689c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe5540c2770 tx=0x7fe53c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:02.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.108+0000 7fe551600640 1 -- 172.21.15.32:0/443329484 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe5440eb330 con 0x7fe55406f8d0 2024-01-19T04:18:02.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.308+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fe5540ac7e0 con 0x7fe55406f8d0 2024-01-19T04:18:02.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.896+0000 7fe551600640 1 -- 172.21.15.32:0/443329484 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v48) v1 ==== 177+0+0 (secure 0 0 0) 0x7fe5540ac7e0 con 0x7fe55406f8d0 2024-01-19T04:18:02.901 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 14 and data pool 15 2024-01-19T04:18:02.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe52c066500 msgr2=0x7fe52c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:02.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe52c066500 0x7fe52c0689c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe5540c2770 tx=0x7fe53c009040 comp rx=0 tx=0).stop 2024-01-19T04:18:02.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe55406f8d0 msgr2=0x7fe554146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:02.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe55406f8d0 0x7fe554146c00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe5440ae040 tx=0x7fe5440190d0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 shutdown_connections 2024-01-19T04:18:02.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe52c066500 0x7fe52c0689c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe554158370 0x7fe554142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe554151fc0 0x7fe55414b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 --2- 172.21.15.32:0/443329484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe55406f8d0 0x7fe554146c00 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:02.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.900+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 >> 172.21.15.32:0/443329484 conn(0x7fe5540c7390 msgr2=0x7fe5540a84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:02.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.904+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 shutdown_connections 2024-01-19T04:18:02.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:02.904+0000 7fe55bc00640 1 -- 172.21.15.32:0/443329484 wait complete. 2024-01-19T04:18:02.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:03.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2db2000640 1 Processor -- start 2024-01-19T04:18:03.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2db2000640 1 -- start start 2024-01-19T04:18:03.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2db2000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2dac151f30 0x7f2dac0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2db2000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0c5b40 con 0x7f2dac06eb70 2024-01-19T04:18:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2db2000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0c3fa0 con 0x7f2dac06fda0 2024-01-19T04:18:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2db2000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac1551e0 con 0x7f2dac151f30 2024-01-19T04:18:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2dab400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2dac151f30 0x7f2dac0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2dabe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2dac06eb70 0x7f2dac06efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46868/0 (socket says 172.21.15.32:46868) 2024-01-19T04:18:03.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2dabe00640 1 -- 172.21.15.32:0/3851884909 learned_addr learned my addr 172.21.15.32:0/3851884909 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2dab400640 1 -- 172.21.15.32:0/3851884909 >> v1:172.21.15.67:6789/0 conn(0x7f2dac06fda0 legacy=0x7f2dac0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2dab400640 1 -- 172.21.15.32:0/3851884909 >> v1:172.21.15.32:6789/0 conn(0x7f2dac06eb70 legacy=0x7f2dac06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2daa000640 1 -- 172.21.15.32:0/3851884909 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099420947 0 0) 0x7f2dac0c5b40 con 0x7f2dac06eb70 2024-01-19T04:18:03.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.100+0000 7f2dab400640 1 -- 172.21.15.32:0/3851884909 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac155710 con 0x7f2dac151f30 2024-01-19T04:18:03.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2dab400640 1 --2- 172.21.15.32:0/3851884909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac0c4430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0097c0 tx=0x7f2d9c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0501daff695d83 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2daa000640 1 -- 172.21.15.32:0/3851884909 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0ab600 con 0x7f2dac151f30 2024-01-19T04:18:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2daa000640 1 -- 172.21.15.32:0/3851884909 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c0a7050 con 0x7f2dac151f30 2024-01-19T04:18:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2daa000640 1 -- 172.21.15.32:0/3851884909 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0ab980 con 0x7f2dac151f30 2024-01-19T04:18:03.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2db2000640 1 -- 172.21.15.32:0/3851884909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 msgr2=0x7f2dac0c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2db2000640 1 --2- 172.21.15.32:0/3851884909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac0c4430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0097c0 tx=0x7f2d9c01c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2db2000640 1 -- 172.21.15.32:0/3851884909 shutdown_connections 2024-01-19T04:18:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2db2000640 1 --2- 172.21.15.32:0/3851884909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac0c4430 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.104+0000 7f2db2000640 1 -- 172.21.15.32:0/3851884909 >> 172.21.15.32:0/3851884909 conn(0x7f2dac0a9870 msgr2=0x7f2dac0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 -- 172.21.15.32:0/3851884909 shutdown_connections 2024-01-19T04:18:03.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 -- 172.21.15.32:0/3851884909 wait complete. 2024-01-19T04:18:03.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 Processor -- start 2024-01-19T04:18:03.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 -- start start 2024-01-19T04:18:03.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dac06eb70 0x7f2dac158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dac06fda0 0x7f2dac0ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac1eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0bd340 con 0x7f2dac151f30 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac157b70 con 0x7f2dac06fda0 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac1f09d0 con 0x7f2dac06eb70 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac1eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac1eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57760/0 (socket says 172.21.15.32:57760) 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 -- 172.21.15.32:0/3015814343 learned_addr learned my addr 172.21.15.32:0/3015814343 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dab400640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dac06eb70 0x7f2dac158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2daaa00640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dac06fda0 0x7f2dac0ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 -- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dac06eb70 msgr2=0x7f2dac158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dac06eb70 0x7f2dac158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 -- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dac06fda0 msgr2=0x7f2dac0ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dac06fda0 0x7f2dac0ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 -- 172.21.15.32:0/3015814343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c009420 con 0x7f2dac151f30 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2dabe00640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac1eff40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c7a0 tx=0x7f2da400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2da3400640 1 -- 172.21.15.32:0/3015814343 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400a640 con 0x7f2dac151f30 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2da3400640 1 -- 172.21.15.32:0/3015814343 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400a7a0 con 0x7f2dac151f30 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2da3400640 1 -- 172.21.15.32:0/3015814343 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400abd0 con 0x7f2dac151f30 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.108+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac150190 con 0x7f2dac151f30 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.112+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac1583e0 con 0x7f2dac151f30 2024-01-19T04:18:03.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.112+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac158620 con 0x7f2dac151f30 2024-01-19T04:18:03.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.112+0000 7f2da3400640 1 -- 172.21.15.32:0/3015814343 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2da400ad30 con 0x7f2dac151f30 2024-01-19T04:18:03.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.112+0000 7f2da3400640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d84066530 0x7f2d840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.112+0000 7f2da3400640 1 -- 172.21.15.32:0/3015814343 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2da40834e0 con 0x7f2dac151f30 2024-01-19T04:18:03.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.112+0000 7f2dab400640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d84066530 0x7f2d840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.116+0000 7f2dab400640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d84066530 0x7f2d840689f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0ad000 tx=0x7f2d9c0a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.116+0000 7f2da3400640 1 -- 172.21.15.32:0/3015814343 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2dac158620 con 0x7f2dac151f30 2024-01-19T04:18:03.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.276+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2dac158620 con 0x7f2dac151f30 2024-01-19T04:18:03.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2da3400640 1 -- 172.21.15.32:0/3015814343 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+20132 (secure 0 0 0) 0x7f2dac158620 con 0x7f2dac151f30 2024-01-19T04:18:03.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:03.283 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":74,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:02.312747+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d84066530 msgr2=0x7f2d840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d84066530 0x7f2d840689f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0ad000 tx=0x7f2d9c0a4f90 comp rx=0 tx=0).stop 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 msgr2=0x7f2dac1eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac1eff40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c7a0 tx=0x7f2da400cc60 comp rx=0 tx=0).stop 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 shutdown_connections 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d84066530 0x7f2d840689f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dac151f30 0x7f2dac1eff40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dac06fda0 0x7f2dac0ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 --2- 172.21.15.32:0/3015814343 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2dac06eb70 0x7f2dac158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 >> 172.21.15.32:0/3015814343 conn(0x7f2dac0a9870 msgr2=0x7f2dac0c4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:03.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 shutdown_connections 2024-01-19T04:18:03.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.280+0000 7f2db2000640 1 -- 172.21.15.32:0/3015814343 wait complete. 2024-01-19T04:18:03.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1fa00640 1 Processor -- start 2024-01-19T04:18:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1fa00640 1 -- start start 2024-01-19T04:18:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1fa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb180c04a0 0x7fcb180c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1fa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb18071e80 con 0x7fcb180a4ec0 2024-01-19T04:18:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1fa00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb180726c0 con 0x7fcb1814fb50 2024-01-19T04:18:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1fa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb181535c0 con 0x7fcb180c04a0 2024-01-19T04:18:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb17e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb180c04a0 0x7fcb180c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1da00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcb180a4ec0 0x7fcb1815cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46876/0 (socket says 172.21.15.32:46876) 2024-01-19T04:18:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb1da00640 1 -- 172.21.15.32:0/3948930010 learned_addr learned my addr 172.21.15.32:0/3948930010 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb17e00640 1 -- 172.21.15.32:0/3948930010 >> v1:172.21.15.67:6789/0 conn(0x7fcb1814fb50 legacy=0x7fcb1806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb17e00640 1 -- 172.21.15.32:0/3948930010 >> v1:172.21.15.32:6789/0 conn(0x7fcb180a4ec0 legacy=0x7fcb1815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb17e00640 1 -- 172.21.15.32:0/3948930010 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180c0a20 con 0x7fcb180c04a0 2024-01-19T04:18:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.444+0000 7fcb17400640 1 -- 172.21.15.32:0/3948930010 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078518230 0 0) 0x7fcb18071e80 con 0x7fcb180a4ec0 2024-01-19T04:18:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb17e00640 1 --2- 172.21.15.32:0/3948930010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb180c1230 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcb000097c0 tx=0x7fcb0001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c271da4c7acf47 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb17400640 1 -- 172.21.15.32:0/3948930010 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000ab600 con 0x7fcb180c04a0 2024-01-19T04:18:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb17400640 1 -- 172.21.15.32:0/3948930010 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb000a7050 con 0x7fcb180c04a0 2024-01-19T04:18:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb17400640 1 -- 172.21.15.32:0/3948930010 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000ab980 con 0x7fcb180c04a0 2024-01-19T04:18:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb1fa00640 1 -- 172.21.15.32:0/3948930010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 msgr2=0x7fcb180c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/3948930010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb180c1230 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcb000097c0 tx=0x7fcb0001c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb1fa00640 1 -- 172.21.15.32:0/3948930010 shutdown_connections 2024-01-19T04:18:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/3948930010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb180c1230 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb1fa00640 1 -- 172.21.15.32:0/3948930010 >> 172.21.15.32:0/3948930010 conn(0x7fcb180c5b20 msgr2=0x7fcb180c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb1fa00640 1 -- 172.21.15.32:0/3948930010 shutdown_connections 2024-01-19T04:18:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.448+0000 7fcb1fa00640 1 -- 172.21.15.32:0/3948930010 wait complete. 2024-01-19T04:18:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 Processor -- start 2024-01-19T04:18:03.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 -- start start 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180a4ec0 0x7fcb181eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb181460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1814fb50 0x7fcb180a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181ef350 con 0x7fcb180c04a0 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181ee780 con 0x7fcb1814fb50 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181eea20 con 0x7fcb180a4ec0 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb181460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb181460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57784/0 (socket says 172.21.15.32:57784) 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 -- 172.21.15.32:0/1045487830 learned_addr learned my addr 172.21.15.32:0/1045487830 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1da00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1814fb50 0x7fcb180a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1d000640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180a4ec0 0x7fcb181eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 -- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180a4ec0 msgr2=0x7fcb181eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180a4ec0 0x7fcb181eb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 -- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1814fb50 msgr2=0x7fcb180a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1814fb50 0x7fcb180a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 -- 172.21.15.32:0/1045487830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00009420 con 0x7fcb180c04a0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1da00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1814fb50 0x7fcb180a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb17e00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb181460c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcb00019000 tx=0x7fcb0001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb14c00640 1 -- 172.21.15.32:0/1045487830 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000b7650 con 0x7fcb180c04a0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb14c00640 1 -- 172.21.15.32:0/1045487830 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb000abe90 con 0x7fcb180c04a0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb14c00640 1 -- 172.21.15.32:0/1045487830 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000b7a10 con 0x7fcb180c04a0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb181eed00 con 0x7fcb180c04a0 2024-01-19T04:18:03.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.452+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb18146600 con 0x7fcb180c04a0 2024-01-19T04:18:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.456+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb180749f0 con 0x7fcb180c04a0 2024-01-19T04:18:03.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.456+0000 7fcb14c00640 1 -- 172.21.15.32:0/1045487830 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcb000b7b70 con 0x7fcb180c04a0 2024-01-19T04:18:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.456+0000 7fcb14c00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcaf0066530 0x7fcaf00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.456+0000 7fcb14c00640 1 -- 172.21.15.32:0/1045487830 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcb0011eb10 con 0x7fcb180c04a0 2024-01-19T04:18:03.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.456+0000 7fcb1d000640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcaf0066530 0x7fcaf00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.456+0000 7fcb1d000640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcaf0066530 0x7fcaf00689f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007fd0 tx=0x7fcb08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.460+0000 7fcb14c00640 1 -- 172.21.15.32:0/1045487830 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcb000ebb60 con 0x7fcb180c04a0 2024-01-19T04:18:03.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.620+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb1814f760 con 0x7fcb180c04a0 2024-01-19T04:18:03.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb14c00640 1 -- 172.21.15.32:0/1045487830 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+20132 (secure 0 0 0) 0x7fcb000b0090 con 0x7fcb180c04a0 2024-01-19T04:18:03.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:03.628 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":74,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:02.312747+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:03.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcaf0066530 msgr2=0x7fcaf00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcaf0066530 0x7fcaf00689f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007fd0 tx=0x7fcb08009040 comp rx=0 tx=0).stop 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 msgr2=0x7fcb181460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb181460c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcb00019000 tx=0x7fcb0001ac30 comp rx=0 tx=0).stop 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 shutdown_connections 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcaf0066530 0x7fcaf00689f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb1814fb50 0x7fcb180a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb180c04a0 0x7fcb181460c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 --2- 172.21.15.32:0/1045487830 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb180a4ec0 0x7fcb181eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 >> 172.21.15.32:0/1045487830 conn(0x7fcb180c5b20 msgr2=0x7fcb180c0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 shutdown_connections 2024-01-19T04:18:03.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.624+0000 7fcb1fa00640 1 -- 172.21.15.32:0/1045487830 wait complete. 2024-01-19T04:18:03.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-19T04:18:03.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d68200640 1 Processor -- start 2024-01-19T04:18:03.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d68200640 1 -- start start 2024-01-19T04:18:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d68200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2d600705b0 0x7f2d6006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d68200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d600c0eb0 con 0x7f2d600c55d0 2024-01-19T04:18:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d68200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d600a5330 con 0x7f2d6006cab0 2024-01-19T04:18:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d68200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6006e5c0 con 0x7f2d600705b0 2024-01-19T04:18:03.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2d600c55d0 0x7f2d601594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46880/0 (socket says 172.21.15.32:46880) 2024-01-19T04:18:03.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 -- 172.21.15.32:0/3612328976 learned_addr learned my addr 172.21.15.32:0/3612328976 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:03.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d66200640 1 --2- 172.21.15.32:0/3612328976 >> v2:172.21.15.67:3300/0 conn(0x7f2d600705b0 0x7f2d6006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221624830 0 0) 0x7f2d600c0eb0 con 0x7f2d600c55d0 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d40003530 con 0x7f2d600c55d0 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772036555 0 0) 0x7f2d600a5330 con 0x7f2d6006cab0 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d600c0eb0 con 0x7f2d6006cab0 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2217068827 0 0) 0x7f2d40003530 con 0x7f2d600c55d0 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 >> v2:172.21.15.67:3300/0 conn(0x7f2d600705b0 msgr2=0x7f2d6006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 --2- 172.21.15.32:0/3612328976 >> v2:172.21.15.67:3300/0 conn(0x7f2d600705b0 0x7f2d6006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 >> v1:172.21.15.67:6789/0 conn(0x7f2d6006cab0 legacy=0x7f2d600c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d601516f0 con 0x7f2d600c55d0 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f2d48001680 con 0x7f2d600c55d0 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 >> v1:172.21.15.32:6789/0 conn(0x7f2d600c55d0 legacy=0x7f2d601594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d40003b60 0x7f2d40003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d40005190 0x7f2d4000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6006e5c0 con 0x7f2d400047d0 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4000e270 con 0x7f2d40003b60 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4000e430 con 0x7f2d40005190 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d65800640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d40003b60 0x7f2d40003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d66200640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d40005190 0x7f2d4000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 -- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d40005190 msgr2=0x7f2d4000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d40005190 0x7f2d4000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 -- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d40003b60 msgr2=0x7f2d40003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d40003b60 0x7f2d40003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d64e00640 1 -- 172.21.15.32:0/3612328976 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40003530 con 0x7f2d400047d0 2024-01-19T04:18:03.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.792+0000 7f2d66200640 1 -- 172.21.15.32:0/3612328976 reap_dead start 2024-01-19T04:18:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d64e00640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d40004c50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2d48007f90 tx=0x7f2d4801caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4773f99303f618 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48005ba0 con 0x7f2d400047d0 2024-01-19T04:18:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d48005d00 con 0x7f2d400047d0 2024-01-19T04:18:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d5fe00640 1 -- 172.21.15.32:0/3612328976 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480a59d0 con 0x7f2d400047d0 2024-01-19T04:18:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d68200640 1 -- 172.21.15.32:0/3612328976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 msgr2=0x7f2d40004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d68200640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d40004c50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2d48007f90 tx=0x7f2d4801caa0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d68200640 1 -- 172.21.15.32:0/3612328976 shutdown_connections 2024-01-19T04:18:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d68200640 1 --2- 172.21.15.32:0/3612328976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d40004c50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d68200640 1 -- 172.21.15.32:0/3612328976 >> 172.21.15.32:0/3612328976 conn(0x7f2d600c25a0 msgr2=0x7f2d600c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:03.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d68200640 1 -- 172.21.15.32:0/3612328976 shutdown_connections 2024-01-19T04:18:03.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.796+0000 7f2d68200640 1 -- 172.21.15.32:0/3612328976 wait complete. 2024-01-19T04:18:03.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 Processor -- start 2024-01-19T04:18:03.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 -- start start 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d601eb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d601ede20 0x7f2d600bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d601499e0 0x7f2d601ea710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6014c990 con 0x7f2d400047d0 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601ee320 con 0x7f2d601ede20 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6014e800 con 0x7f2d601499e0 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d601eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d601eb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57802/0 (socket says 172.21.15.32:57802) 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 -- 172.21.15.32:0/3736818851 learned_addr learned my addr 172.21.15.32:0/3736818851 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d66200640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d601499e0 0x7f2d601ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d64e00640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d601ede20 0x7f2d600bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 -- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d601499e0 msgr2=0x7f2d601ea710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d601499e0 0x7f2d601ea710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 -- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d601ede20 msgr2=0x7f2d600bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d601ede20 0x7f2d600bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 -- 172.21.15.32:0/3736818851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6014eae0 con 0x7f2d400047d0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d65800640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d601eb310 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f2d50011450 tx=0x7f2d50011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d5d600640 1 -- 172.21.15.32:0/3736818851 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50006bf0 con 0x7f2d400047d0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d5d600640 1 -- 172.21.15.32:0/3736818851 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50006d70 con 0x7f2d400047d0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d5d600640 1 -- 172.21.15.32:0/3736818851 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50007290 con 0x7f2d400047d0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d601ea1f0 con 0x7f2d400047d0 2024-01-19T04:18:03.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.800+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d600bf670 con 0x7f2d400047d0 2024-01-19T04:18:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.804+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d600c3040 con 0x7f2d400047d0 2024-01-19T04:18:03.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.804+0000 7f2d5d600640 1 -- 172.21.15.32:0/3736818851 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2d500073f0 con 0x7f2d400047d0 2024-01-19T04:18:03.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.804+0000 7f2d5d600640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d38066530 0x7f2d380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:03.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.804+0000 7f2d5d600640 1 -- 172.21.15.32:0/3736818851 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2d50086c90 con 0x7f2d400047d0 2024-01-19T04:18:03.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.804+0000 7f2d64e00640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d38066530 0x7f2d380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:03.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.804+0000 7f2d64e00640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d38066530 0x7f2d380689f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2d480ab000 tx=0x7f2d480b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:03.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:03.808+0000 7f2d5d600640 1 -- 172.21.15.32:0/3736818851 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2d50053bc0 con 0x7f2d400047d0 2024-01-19T04:18:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.008+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2d600749f0 con 0x7f2d400047d0 2024-01-19T04:18:04.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d5d600640 1 -- 172.21.15.32:0/3736818851 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 119+0+0 (secure 0 0 0) 0x7f2d500571e0 con 0x7f2d400047d0 2024-01-19T04:18:04.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d38066530 msgr2=0x7f2d380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:04.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d38066530 0x7f2d380689f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2d480ab000 tx=0x7f2d480b1040 comp rx=0 tx=0).stop 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 msgr2=0x7f2d601eb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d601eb310 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f2d50011450 tx=0x7f2d50011850 comp rx=0 tx=0).stop 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 shutdown_connections 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2d38066530 0x7f2d380689f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2d601499e0 0x7f2d601ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d601ede20 0x7f2d600bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 --2- 172.21.15.32:0/3736818851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d400047d0 0x7f2d601eb310 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.928+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 >> 172.21.15.32:0/3736818851 conn(0x7f2d600c25a0 msgr2=0x7f2d600c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:04.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.932+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 shutdown_connections 2024-01-19T04:18:04.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:04.932+0000 7f2d68200640 1 -- 172.21.15.32:0/3736818851 wait complete. 2024-01-19T04:18:04.959 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T04:18:04.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-19T04:18:05.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.104+0000 7f5b7be00640 1 Processor -- start 2024-01-19T04:18:05.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.104+0000 7f5b7be00640 1 -- start start 2024-01-19T04:18:05.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b7be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5b74152620 0x7f5b740c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:05.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b7be00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b74152bc0 con 0x7f5b740c4e50 2024-01-19T04:18:05.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b7be00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b74152ea0 con 0x7f5b740c6120 2024-01-19T04:18:05.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b7be00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7406ea00 con 0x7f5b74152620 2024-01-19T04:18:05.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b79400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5b740c4e50 0x7f5b7406f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46886/0 (socket says 172.21.15.32:46886) 2024-01-19T04:18:05.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b79400640 1 -- 172.21.15.32:0/2389898981 learned_addr learned my addr 172.21.15.32:0/2389898981 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:05.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b78a00640 1 --2- 172.21.15.32:0/2389898981 >> v2:172.21.15.67:3300/0 conn(0x7f5b74152620 0x7f5b740c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641677807 0 0) 0x7f5b74152bc0 con 0x7f5b740c4e50 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b54003530 con 0x7f5b740c4e50 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277719920 0 0) 0x7f5b74152ea0 con 0x7f5b740c6120 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b74152bc0 con 0x7f5b740c6120 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133154604 0 0) 0x7f5b54003530 con 0x7f5b740c4e50 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b78a00640 1 -- 172.21.15.32:0/2389898981 >> v1:172.21.15.67:6789/0 conn(0x7f5b740c6120 legacy=0x7f5b740c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b78a00640 1 -- 172.21.15.32:0/2389898981 >> v1:172.21.15.32:6789/0 conn(0x7f5b740c4e50 legacy=0x7f5b7406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:05.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.108+0000 7f5b78a00640 1 -- 172.21.15.32:0/2389898981 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74153180 con 0x7f5b74152620 2024-01-19T04:18:05.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b78a00640 1 --2- 172.21.15.32:0/2389898981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b74152620 0x7f5b740c75a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0097c0 tx=0x7f5b5c01eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e62d9d15e09526f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:05.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64001680 con 0x7f5b74152620 2024-01-19T04:18:05.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c0a8610 con 0x7f5b74152620 2024-01-19T04:18:05.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b73e00640 1 -- 172.21.15.32:0/2389898981 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0a89a0 con 0x7f5b74152620 2024-01-19T04:18:05.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 -- 172.21.15.32:0/2389898981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b74152620 msgr2=0x7f5b740c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:05.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2389898981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b74152620 0x7f5b740c75a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0097c0 tx=0x7f5b5c01eb90 comp rx=0 tx=0).stop 2024-01-19T04:18:05.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 -- 172.21.15.32:0/2389898981 shutdown_connections 2024-01-19T04:18:05.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2389898981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b74152620 0x7f5b740c75a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:05.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 -- 172.21.15.32:0/2389898981 >> 172.21.15.32:0/2389898981 conn(0x7f5b740c7d40 msgr2=0x7f5b740c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:05.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 -- 172.21.15.32:0/2389898981 shutdown_connections 2024-01-19T04:18:05.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 -- 172.21.15.32:0/2389898981 wait complete. 2024-01-19T04:18:05.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 Processor -- start 2024-01-19T04:18:05.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.112+0000 7f5b7be00640 1 -- start start 2024-01-19T04:18:05.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b740c4e50 0x7f5b740c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:05.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b740c6120 0x7f5b740ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:05.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b74152620 0x7f5b7414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:05.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b741e7e50 con 0x7f5b740c4e50 2024-01-19T04:18:05.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b741e8130 con 0x7f5b740c6120 2024-01-19T04:18:05.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b741e8410 con 0x7f5b74152620 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b740c4e50 0x7f5b740c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b740c4e50 0x7f5b740c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57814/0 (socket says 172.21.15.32:57814) 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 -- 172.21.15.32:0/2235264089 learned_addr learned my addr 172.21.15.32:0/2235264089 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b78a00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b740c6120 0x7f5b740ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79e00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b74152620 0x7f5b7414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 -- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b74152620 msgr2=0x7f5b7414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b74152620 0x7f5b7414a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 -- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b740c6120 msgr2=0x7f5b740ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b740c6120 0x7f5b740ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 -- 172.21.15.32:0/2235264089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009420 con 0x7f5b740c4e50 2024-01-19T04:18:05.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b79400640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b740c4e50 0x7f5b740c38f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c750 tx=0x7f5b6400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:05.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b71600640 1 -- 172.21.15.32:0/2235264089 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64005af0 con 0x7f5b740c4e50 2024-01-19T04:18:05.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b71600640 1 -- 172.21.15.32:0/2235264089 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b64005c50 con 0x7f5b740c4e50 2024-01-19T04:18:05.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b71600640 1 -- 172.21.15.32:0/2235264089 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64007070 con 0x7f5b740c4e50 2024-01-19T04:18:05.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b741e86f0 con 0x7f5b740c4e50 2024-01-19T04:18:05.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b740adad0 con 0x7f5b740c4e50 2024-01-19T04:18:05.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b740749f0 con 0x7f5b740c4e50 2024-01-19T04:18:05.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.116+0000 7f5b71600640 1 -- 172.21.15.32:0/2235264089 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5b640071d0 con 0x7f5b740c4e50 2024-01-19T04:18:05.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.120+0000 7f5b71600640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b4c066500 0x7f5b4c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:05.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.120+0000 7f5b71600640 1 -- 172.21.15.32:0/2235264089 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5b64083fc0 con 0x7f5b740c4e50 2024-01-19T04:18:05.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.120+0000 7f5b78a00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b4c066500 0x7f5b4c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:05.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.120+0000 7f5b78a00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b4c066500 0x7f5b4c0689c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b2000 tx=0x7f5b5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:05.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.124+0000 7f5b71600640 1 -- 172.21.15.32:0/2235264089 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5b64050ef0 con 0x7f5b740c4e50 2024-01-19T04:18:05.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.316+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5b740c6d90 con 0x7f5b740c4e50 2024-01-19T04:18:05.796 INFO:tasks.ceph.mds.a.smithi032.stderr:2024-01-19T04:18:05.796+0000 7f8794600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:18:05.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.928+0000 7f5b71600640 1 -- 172.21.15.32:0/2235264089 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5b64054510 con 0x7f5b740c4e50 2024-01-19T04:18:05.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b4c066500 msgr2=0x7f5b4c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:05.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b4c066500 0x7f5b4c0689c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0b2000 tx=0x7f5b5c008040 comp rx=0 tx=0).stop 2024-01-19T04:18:05.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b740c4e50 msgr2=0x7f5b740c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:05.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b740c4e50 0x7f5b740c38f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c750 tx=0x7f5b6400cc10 comp rx=0 tx=0).stop 2024-01-19T04:18:05.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 shutdown_connections 2024-01-19T04:18:05.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5b4c066500 0x7f5b4c0689c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:05.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5b74152620 0x7f5b7414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:05.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b740c6120 0x7f5b740ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:05.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 --2- 172.21.15.32:0/2235264089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b740c4e50 0x7f5b740c38f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:05.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 >> 172.21.15.32:0/2235264089 conn(0x7f5b740c7d40 msgr2=0x7f5b74151ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:05.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 shutdown_connections 2024-01-19T04:18:05.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:05.932+0000 7f5b7be00640 1 -- 172.21.15.32:0/2235264089 wait complete. 2024-01-19T04:18:05.959 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-19T04:18:05.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:06.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.100+0000 7fd733200640 1 Processor -- start 2024-01-19T04:18:06.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.100+0000 7fd733200640 1 -- start start 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd733200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd72c151de0 0x7fd72c0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd733200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd733200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c1547e0 con 0x7fd72c0a7200 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd733200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c1521c0 con 0x7fd72c151de0 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd733200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c155640 con 0x7fd72c154c70 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd72be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd72c151de0 0x7fd72c0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd731200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd72b400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd72c0a7200 0x7fd72c0c3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:35562/0 (socket says 172.21.15.32:35562) 2024-01-19T04:18:06.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd72b400640 1 -- 172.21.15.32:0/1219652325 learned_addr learned my addr 172.21.15.32:0/1219652325 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:06.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd72be00640 1 -- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 msgr2=0x7fd72c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:06.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd72be00640 1 --2- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd72be00640 1 -- 172.21.15.32:0/1219652325 >> v1:172.21.15.67:6789/0 conn(0x7fd72c0a7200 legacy=0x7fd72c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd72be00640 1 -- 172.21.15.32:0/1219652325 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0c1db0 con 0x7fd72c151de0 2024-01-19T04:18:06.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.104+0000 7fd731200640 1 --2- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:06.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd72be00640 1 --2- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 0x7fd72c0c1870 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0097c0 tx=0x7fd71c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8180635321f27f5f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd72aa00640 1 -- 172.21.15.32:0/1219652325 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0ab600 con 0x7fd72c151de0 2024-01-19T04:18:06.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd72aa00640 1 -- 172.21.15.32:0/1219652325 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0a7050 con 0x7fd72c151de0 2024-01-19T04:18:06.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd72aa00640 1 -- 172.21.15.32:0/1219652325 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0ab980 con 0x7fd72c151de0 2024-01-19T04:18:06.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 -- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 msgr2=0x7fd72c0c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 --2- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 0x7fd72c0c1870 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0097c0 tx=0x7fd71c01c3c0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 -- 172.21.15.32:0/1219652325 shutdown_connections 2024-01-19T04:18:06.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 --2- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 --2- 172.21.15.32:0/1219652325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 0x7fd72c0c1870 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 -- 172.21.15.32:0/1219652325 >> 172.21.15.32:0/1219652325 conn(0x7fd72c0726d0 msgr2=0x7fd72c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:06.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 -- 172.21.15.32:0/1219652325 shutdown_connections 2024-01-19T04:18:06.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 -- 172.21.15.32:0/1219652325 wait complete. 2024-01-19T04:18:06.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 Processor -- start 2024-01-19T04:18:06.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.108+0000 7fd733200640 1 -- start start 2024-01-19T04:18:06.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd72c0a7200 0x7fd72c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 0x7fd72c0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c0ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c157850 con 0x7fd72c0a7200 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c1f1a10 con 0x7fd72c151de0 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c1f14b0 con 0x7fd72c154c70 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd72c0a7200 0x7fd72c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd72c0a7200 0x7fd72c155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57828/0 (socket says 172.21.15.32:57828) 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 -- 172.21.15.32:0/1044398050 learned_addr learned my addr 172.21.15.32:0/1044398050 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 0x7fd72c0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd731200640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c0ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 -- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 msgr2=0x7fd72c0ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c0ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 -- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 msgr2=0x7fd72c0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 0x7fd72c0abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 -- 172.21.15.32:0/1044398050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724009a70 con 0x7fd72c0a7200 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd72be00640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd72c0a7200 0x7fd72c155aa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd71c019ff0 tx=0x7fd71c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd723e00640 1 -- 172.21.15.32:0/1044398050 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0b4600 con 0x7fd72c0a7200 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd723e00640 1 -- 172.21.15.32:0/1044398050 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0b4760 con 0x7fd72c0a7200 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c009420 con 0x7fd72c0a7200 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd723e00640 1 -- 172.21.15.32:0/1044398050 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0b4b10 con 0x7fd72c0a7200 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c1f1730 con 0x7fd72c0a7200 2024-01-19T04:18:06.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.112+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c0749f0 con 0x7fd72c0a7200 2024-01-19T04:18:06.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.116+0000 7fd723e00640 1 -- 172.21.15.32:0/1044398050 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd71c0b2040 con 0x7fd72c0a7200 2024-01-19T04:18:06.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.116+0000 7fd723e00640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd704066500 0x7fd7040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.116+0000 7fd723e00640 1 -- 172.21.15.32:0/1044398050 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd71c11dd90 con 0x7fd72c0a7200 2024-01-19T04:18:06.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.116+0000 7fd72b400640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd704066500 0x7fd7040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.116+0000 7fd72b400640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd704066500 0x7fd7040689c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0aa7e0 tx=0x7fd714007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.120+0000 7fd723e00640 1 -- 172.21.15.32:0/1044398050 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd71c0eacf0 con 0x7fd72c0a7200 2024-01-19T04:18:06.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.316+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd72c0a6d30 con 0x7fd72c0a7200 2024-01-19T04:18:06.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.316+0000 7fd723e00640 1 -- 172.21.15.32:0/1044398050 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6178 (secure 0 0 0) 0x7fd71c0b8090 con 0x7fd72c0a7200 2024-01-19T04:18:06.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:06.321 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:49.203878+0000","modified":"2024-01-19T04:17:52.248717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/208534071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":208534071},{"type":"v1","addr":"172.21.15.67:6837","nonce":208534071}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:06.321 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 52 2024-01-19T04:18:06.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd704066500 msgr2=0x7fd7040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd704066500 0x7fd7040689c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0aa7e0 tx=0x7fd714007e90 comp rx=0 tx=0).stop 2024-01-19T04:18:06.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd72c0a7200 msgr2=0x7fd72c155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd72c0a7200 0x7fd72c155aa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd71c019ff0 tx=0x7fd71c019160 comp rx=0 tx=0).stop 2024-01-19T04:18:06.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 shutdown_connections 2024-01-19T04:18:06.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd704066500 0x7fd7040689c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd72c154c70 0x7fd72c0ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd72c151de0 0x7fd72c0abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 --2- 172.21.15.32:0/1044398050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd72c0a7200 0x7fd72c155aa0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 >> 172.21.15.32:0/1044398050 conn(0x7fd72c0726d0 msgr2=0x7fd72c151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:06.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 shutdown_connections 2024-01-19T04:18:06.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.320+0000 7fd733200640 1 -- 172.21.15.32:0/1044398050 wait complete. 2024-01-19T04:18:06.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:06.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c3a00640 1 Processor -- start 2024-01-19T04:18:06.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c3a00640 1 -- start start 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c3a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0c6e20 0x7f53bc0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c3a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53bc06fda0 0x7f53bc0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c3a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53bc1533a0 con 0x7f53bc0a6d30 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c3a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53bc156380 con 0x7f53bc06fda0 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c3a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc14fe40 con 0x7f53bc0c6e20 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53bbe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f53bc0a6d30 0x7f53bc152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46892/0 (socket says 172.21.15.32:46892) 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53bbe00640 1 -- 172.21.15.32:0/1487983099 learned_addr learned my addr 172.21.15.32:0/1487983099 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c1a00640 1 --2- 172.21.15.32:0/1487983099 >> v2:172.21.15.67:3300/0 conn(0x7f53bc06fda0 0x7f53bc0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c1000640 1 --2- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0c6e20 0x7f53bc0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53bb400640 1 -- 172.21.15.32:0/1487983099 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511854475 0 0) 0x7f53a4001120 con 0x7f53bc0a6d30 2024-01-19T04:18:06.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53bb400640 1 -- 172.21.15.32:0/1487983099 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f539c003530 con 0x7f53bc0a6d30 2024-01-19T04:18:06.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c1a00640 1 -- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0c6e20 msgr2=0x7f53bc0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:06.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c1a00640 1 --2- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0c6e20 0x7f53bc0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c1a00640 1 -- 172.21.15.32:0/1487983099 >> v1:172.21.15.32:6789/0 conn(0x7f53bc0a6d30 legacy=0x7f53bc152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c1a00640 1 -- 172.21.15.32:0/1487983099 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc152800 con 0x7f53bc06fda0 2024-01-19T04:18:06.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.480+0000 7f53c1000640 1 --2- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0c6e20 0x7f53bc0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:06.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c1a00640 1 --2- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 0x7f53bc0c5b40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009d90 tx=0x7f53b401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff7009522b621f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53bb400640 1 -- 172.21.15.32:0/1487983099 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40a58f0 con 0x7f53bc06fda0 2024-01-19T04:18:06.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53bb400640 1 -- 172.21.15.32:0/1487983099 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40a5a50 con 0x7f53bc06fda0 2024-01-19T04:18:06.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53bb400640 1 -- 172.21.15.32:0/1487983099 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40a5de0 con 0x7f53bc06fda0 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c3a00640 1 -- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 msgr2=0x7f53bc0c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 0x7f53bc0c5b40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009d90 tx=0x7f53b401c830 comp rx=0 tx=0).stop 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c3a00640 1 -- 172.21.15.32:0/1487983099 shutdown_connections 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 0x7f53bc0c5b40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1487983099 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0c6e20 0x7f53bc0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c3a00640 1 -- 172.21.15.32:0/1487983099 >> 172.21.15.32:0/1487983099 conn(0x7f53bc0a9870 msgr2=0x7f53bc0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.484+0000 7f53c3a00640 1 -- 172.21.15.32:0/1487983099 shutdown_connections 2024-01-19T04:18:06.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 -- 172.21.15.32:0/1487983099 wait complete. 2024-01-19T04:18:06.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 Processor -- start 2024-01-19T04:18:06.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 -- start start 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 0x7f53bc15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0a6d30 0x7f53bc0c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53bc0c6e20 0x7f53bc14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc06d5d0 con 0x7f53bc0c6e20 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0bf360 con 0x7f53bc06fda0 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c3a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc15b170 con 0x7f53bc0a6d30 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53bc0c6e20 0x7f53bc14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53bc0c6e20 0x7f53bc14ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57834/0 (socket says 172.21.15.32:57834) 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 -- 172.21.15.32:0/1447066960 learned_addr learned my addr 172.21.15.32:0/1447066960 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:06.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53bbe00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0a6d30 0x7f53bc0c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1000640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 0x7f53bc15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 -- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0a6d30 msgr2=0x7f53bc0c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0a6d30 0x7f53bc0c1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 -- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 msgr2=0x7f53bc15c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 0x7f53bc15c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 -- 172.21.15.32:0/1447066960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009420 con 0x7f53bc0c6e20 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.488+0000 7f53c1a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53bc0c6e20 0x7f53bc14ef50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b0040 tx=0x7f53b40195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53b8c00640 1 -- 172.21.15.32:0/1447066960 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40b9860 con 0x7f53bc0c6e20 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53b8c00640 1 -- 172.21.15.32:0/1447066960 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40b99c0 con 0x7f53bc0c6e20 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b4009a70 con 0x7f53bc0c6e20 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53b8c00640 1 -- 172.21.15.32:0/1447066960 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40b9d70 con 0x7f53bc0c6e20 2024-01-19T04:18:06.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53bc06cf10 con 0x7f53bc0c6e20 2024-01-19T04:18:06.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53bc06d710 con 0x7f53bc0c6e20 2024-01-19T04:18:06.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53b8c00640 1 -- 172.21.15.32:0/1447066960 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f53b40ad440 con 0x7f53bc0c6e20 2024-01-19T04:18:06.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53b8c00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5394066530 0x7f53940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53b8c00640 1 -- 172.21.15.32:0/1447066960 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f53b411f080 con 0x7f53bc0c6e20 2024-01-19T04:18:06.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53c1000640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5394066530 0x7f53940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.492+0000 7f53c1000640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5394066530 0x7f53940689f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f53bc1f1210 tx=0x7f53ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.496+0000 7f53b8c00640 1 -- 172.21.15.32:0/1447066960 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f53b41504d0 con 0x7f53bc0c6e20 2024-01-19T04:18:06.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.656+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53bc0749f0 con 0x7f53bc0c6e20 2024-01-19T04:18:06.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53b8c00640 1 -- 172.21.15.32:0/1447066960 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7f53bc06d710 con 0x7f53bc0c6e20 2024-01-19T04:18:06.663 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:06.663 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:06.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5394066530 msgr2=0x7f53940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5394066530 0x7f53940689f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f53bc1f1210 tx=0x7f53ac008040 comp rx=0 tx=0).stop 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53bc0c6e20 msgr2=0x7f53bc14ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53bc0c6e20 0x7f53bc14ef50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b0040 tx=0x7f53b40195d0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 shutdown_connections 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5394066530 0x7f53940689f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53bc0c6e20 0x7f53bc14ef50 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53bc0a6d30 0x7f53bc0c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 --2- 172.21.15.32:0/1447066960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53bc06fda0 0x7f53bc15c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 >> 172.21.15.32:0/1447066960 conn(0x7f53bc0a9870 msgr2=0x7f53bc0a88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 shutdown_connections 2024-01-19T04:18:06.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.660+0000 7f53c3a00640 1 -- 172.21.15.32:0/1447066960 wait complete. 2024-01-19T04:18:06.686 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T04:18:06.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:18:06.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f28400640 1 Processor -- start 2024-01-19T04:18:06.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f28400640 1 -- start start 2024-01-19T04:18:06.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f28400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f200a4ec0 0x7f6f2015df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f28400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f20071e80 con 0x7f6f2014fb50 2024-01-19T04:18:06.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f28400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f200726c0 con 0x7f6f200c04a0 2024-01-19T04:18:06.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f28400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f201535c0 con 0x7f6f200a4ec0 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f25a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6f2014fb50 0x7f6f2006fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46908/0 (socket says 172.21.15.32:46908) 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f25a00640 1 -- 172.21.15.32:0/1491830006 learned_addr learned my addr 172.21.15.32:0/1491830006 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f26400640 1 --2- 172.21.15.32:0/1491830006 >> v2:172.21.15.32:3300/0 conn(0x7f6f200a4ec0 0x7f6f2015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f1fe00640 1 -- 172.21.15.32:0/1491830006 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795920294 0 0) 0x7f6f20071e80 con 0x7f6f2014fb50 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f1fe00640 1 -- 172.21.15.32:0/1491830006 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f00003530 con 0x7f6f2014fb50 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f26400640 1 -- 172.21.15.32:0/1491830006 >> v1:172.21.15.67:6789/0 conn(0x7f6f200c04a0 legacy=0x7f6f200c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f26400640 1 -- 172.21.15.32:0/1491830006 >> v1:172.21.15.32:6789/0 conn(0x7f6f2014fb50 legacy=0x7f6f2006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.824+0000 7f6f26400640 1 -- 172.21.15.32:0/1491830006 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200c0a20 con 0x7f6f200a4ec0 2024-01-19T04:18:06.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f26400640 1 --2- 172.21.15.32:0/1491830006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f2015df10 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009d90 tx=0x7f6f1801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748febbdd73e1ebb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f1fe00640 1 -- 172.21.15.32:0/1491830006 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180a5890 con 0x7f6f200a4ec0 2024-01-19T04:18:06.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f1fe00640 1 -- 172.21.15.32:0/1491830006 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f180a59f0 con 0x7f6f200a4ec0 2024-01-19T04:18:06.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f1fe00640 1 -- 172.21.15.32:0/1491830006 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180a5d80 con 0x7f6f200a4ec0 2024-01-19T04:18:06.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f28400640 1 -- 172.21.15.32:0/1491830006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 msgr2=0x7f6f2015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f28400640 1 --2- 172.21.15.32:0/1491830006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f2015df10 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009d90 tx=0x7f6f1801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f28400640 1 -- 172.21.15.32:0/1491830006 shutdown_connections 2024-01-19T04:18:06.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f28400640 1 --2- 172.21.15.32:0/1491830006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f2015df10 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f28400640 1 -- 172.21.15.32:0/1491830006 >> 172.21.15.32:0/1491830006 conn(0x7f6f200c5b20 msgr2=0x7f6f200c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:06.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f28400640 1 -- 172.21.15.32:0/1491830006 shutdown_connections 2024-01-19T04:18:06.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.828+0000 7f6f28400640 1 -- 172.21.15.32:0/1491830006 wait complete. 2024-01-19T04:18:06.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 Processor -- start 2024-01-19T04:18:06.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 -- start start 2024-01-19T04:18:06.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f20146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f200c04a0 0x7f6f201ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f2014fb50 0x7f6f201eb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200ab600 con 0x7f6f200a4ec0 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f201ead50 con 0x7f6f200c04a0 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f201ec700 con 0x7f6f2014fb50 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f20146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f20146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57858/0 (socket says 172.21.15.32:57858) 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 -- 172.21.15.32:0/1788075869 learned_addr learned my addr 172.21.15.32:0/1788075869 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25000640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f200c04a0 0x7f6f201ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f26400640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f2014fb50 0x7f6f201eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 -- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f2014fb50 msgr2=0x7f6f201eb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f2014fb50 0x7f6f201eb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 -- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f200c04a0 msgr2=0x7f6f201ec1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f200c04a0 0x7f6f201ec1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 -- 172.21.15.32:0/1788075869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009a70 con 0x7f6f200a4ec0 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f25a00640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f20146630 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c3c0 tx=0x7f6f1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f1d600640 1 -- 172.21.15.32:0/1788075869 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10005cf0 con 0x7f6f200a4ec0 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f1d600640 1 -- 172.21.15.32:0/1788075869 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f10005e50 con 0x7f6f200a4ec0 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f201ebc80 con 0x7f6f200a4ec0 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.832+0000 7f6f1d600640 1 -- 172.21.15.32:0/1788075869 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100072f0 con 0x7f6f200a4ec0 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.836+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f201ef050 con 0x7f6f200a4ec0 2024-01-19T04:18:06.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.836+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f200749f0 con 0x7f6f200a4ec0 2024-01-19T04:18:06.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.836+0000 7f6f1d600640 1 -- 172.21.15.32:0/1788075869 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6f10007450 con 0x7f6f200a4ec0 2024-01-19T04:18:06.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.836+0000 7f6f1d600640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ef8066500 0x7f6ef80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:06.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.836+0000 7f6f1d600640 1 -- 172.21.15.32:0/1788075869 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6f10083760 con 0x7f6f200a4ec0 2024-01-19T04:18:06.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.836+0000 7f6f25000640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ef8066500 0x7f6ef80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:06.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.840+0000 7f6f25000640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ef8066500 0x7f6ef80689c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6f2015e1d0 tx=0x7f6f08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:06.840+0000 7f6f1d600640 1 -- 172.21.15.32:0/1788075869 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6f10050740 con 0x7f6f200a4ec0 2024-01-19T04:18:07.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.000+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f200720b0 con 0x7f6ef8066500 2024-01-19T04:18:07.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.016+0000 7f6f1d600640 1 -- 172.21.15.32:0/1788075869 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527679 (secure 0 0 0) 0x7f6f080014f0 con 0x7f6ef8066500 2024-01-19T04:18:07.025 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:07.029 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ef8066500 msgr2=0x7f6ef80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ef8066500 0x7f6ef80689c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6f2015e1d0 tx=0x7f6f08009040 comp rx=0 tx=0).stop 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 msgr2=0x7f6f20146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f20146630 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c3c0 tx=0x7f6f1000c880 comp rx=0 tx=0).stop 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 shutdown_connections 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6ef8066500 0x7f6ef80689c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f2014fb50 0x7f6f201eb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f200c04a0 0x7f6f201ec1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 --2- 172.21.15.32:0/1788075869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f200a4ec0 0x7f6f20146630 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 >> 172.21.15.32:0/1788075869 conn(0x7f6f200c5b20 msgr2=0x7f6f2014ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:07.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 shutdown_connections 2024-01-19T04:18:07.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.020+0000 7f6f28400640 1 -- 172.21.15.32:0/1788075869 wait complete. 2024-01-19T04:18:07.046 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-01-19T04:18:06.075526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":329,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257784,"kb_used_data":8316,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716936,"statfs":{"total":773094113280,"available":772830142464,"internally_reserved":0,"allocated":8515584,"data_stored":4369463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.181436"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947122+0000","last_change":"2024-01-19T04:18:02.928052+0000","last_active":"2024-01-19T04:18:02.947122+0000","last_peered":"2024-01-19T04:18:02.947122+0000","last_clean":"2024-01-19T04:18:02.947122+0000","last_became_active":"2024-01-19T04:18:02.927750+0000","last_became_peered":"2024-01-19T04:18:02.927750+0000","last_unstale":"2024-01-19T04:18:02.947122+0000","last_undegraded":"2024-01-19T04:18:02.947122+0000","last_fullsized":"2024-01-19T04:18:02.947122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:52.076469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914198+0000","last_change":"2024-01-19T04:17:49.865069+0000","last_active":"2024-01-19T04:18:02.914198+0000","last_peered":"2024-01-19T04:18:02.914198+0000","last_clean":"2024-01-19T04:18:02.914198+0000","last_became_active":"2024-01-19T04:17:49.864458+0000","last_became_peered":"2024-01-19T04:17:49.864458+0000","last_unstale":"2024-01-19T04:18:02.914198+0000","last_undegraded":"2024-01-19T04:18:02.914198+0000","last_fullsized":"2024-01-19T04:18:02.914198+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939500+0000","last_change":"2024-01-19T04:18:02.932391+0000","last_active":"2024-01-19T04:18:02.939500+0000","last_peered":"2024-01-19T04:18:02.939500+0000","last_clean":"2024-01-19T04:18:02.939500+0000","last_became_active":"2024-01-19T04:18:02.932117+0000","last_became_peered":"2024-01-19T04:18:02.932117+0000","last_unstale":"2024-01-19T04:18:02.939500+0000","last_undegraded":"2024-01-19T04:18:02.939500+0000","last_fullsized":"2024-01-19T04:18:02.939500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:55:18.662479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903423+0000","last_change":"2024-01-19T04:17:49.873043+0000","last_active":"2024-01-19T04:18:01.903423+0000","last_peered":"2024-01-19T04:18:01.903423+0000","last_clean":"2024-01-19T04:18:01.903423+0000","last_became_active":"2024-01-19T04:17:49.866359+0000","last_became_peered":"2024-01-19T04:17:49.866359+0000","last_unstale":"2024-01-19T04:18:01.903423+0000","last_undegraded":"2024-01-19T04:18:01.903423+0000","last_fullsized":"2024-01-19T04:18:01.903423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:00.030865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934233+0000","last_change":"2024-01-19T04:18:02.922952+0000","last_active":"2024-01-19T04:18:02.934233+0000","last_peered":"2024-01-19T04:18:02.934233+0000","last_clean":"2024-01-19T04:18:02.934233+0000","last_became_active":"2024-01-19T04:18:02.922650+0000","last_became_peered":"2024-01-19T04:18:02.922650+0000","last_unstale":"2024-01-19T04:18:02.934233+0000","last_undegraded":"2024-01-19T04:18:02.934233+0000","last_fullsized":"2024-01-19T04:18:02.934233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:14.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916937+0000","last_change":"2024-01-19T04:17:49.871656+0000","last_active":"2024-01-19T04:18:02.916937+0000","last_peered":"2024-01-19T04:18:02.916937+0000","last_clean":"2024-01-19T04:18:02.916937+0000","last_became_active":"2024-01-19T04:17:49.871224+0000","last_became_peered":"2024-01-19T04:17:49.871224+0000","last_unstale":"2024-01-19T04:18:02.916937+0000","last_undegraded":"2024-01-19T04:18:02.916937+0000","last_fullsized":"2024-01-19T04:18:02.916937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928417+0000","last_change":"2024-01-19T04:18:02.934241+0000","last_active":"2024-01-19T04:18:03.928417+0000","last_peered":"2024-01-19T04:18:03.928417+0000","last_clean":"2024-01-19T04:18:03.928417+0000","last_became_active":"2024-01-19T04:18:02.933394+0000","last_became_peered":"2024-01-19T04:18:02.933394+0000","last_unstale":"2024-01-19T04:18:03.928417+0000","last_undegraded":"2024-01-19T04:18:03.928417+0000","last_fullsized":"2024-01-19T04:18:03.928417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:19:22.693098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.921537+0000","last_change":"2024-01-19T04:17:49.855762+0000","last_active":"2024-01-19T04:18:01.921537+0000","last_peered":"2024-01-19T04:18:01.921537+0000","last_clean":"2024-01-19T04:18:01.921537+0000","last_became_active":"2024-01-19T04:17:49.855517+0000","last_became_peered":"2024-01-19T04:17:49.855517+0000","last_unstale":"2024-01-19T04:18:01.921537+0000","last_undegraded":"2024-01-19T04:18:01.921537+0000","last_fullsized":"2024-01-19T04:18:01.921537+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:46.205998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929843+0000","last_change":"2024-01-19T04:18:02.923872+0000","last_active":"2024-01-19T04:18:03.929843+0000","last_peered":"2024-01-19T04:18:03.929843+0000","last_clean":"2024-01-19T04:18:03.929843+0000","last_became_active":"2024-01-19T04:18:02.923519+0000","last_became_peered":"2024-01-19T04:18:02.923519+0000","last_unstale":"2024-01-19T04:18:03.929843+0000","last_undegraded":"2024-01-19T04:18:03.929843+0000","last_fullsized":"2024-01-19T04:18:03.929843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:24:09.078909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909075+0000","last_change":"2024-01-19T04:17:49.853083+0000","last_active":"2024-01-19T04:18:02.909075+0000","last_peered":"2024-01-19T04:18:02.909075+0000","last_clean":"2024-01-19T04:18:02.909075+0000","last_became_active":"2024-01-19T04:17:49.852756+0000","last_became_peered":"2024-01-19T04:17:49.852756+0000","last_unstale":"2024-01-19T04:18:02.909075+0000","last_undegraded":"2024-01-19T04:18:02.909075+0000","last_fullsized":"2024-01-19T04:18:02.909075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927337+0000","last_change":"2024-01-19T04:18:02.927421+0000","last_active":"2024-01-19T04:18:03.927337+0000","last_peered":"2024-01-19T04:18:03.927337+0000","last_clean":"2024-01-19T04:18:03.927337+0000","last_became_active":"2024-01-19T04:18:02.927137+0000","last_became_peered":"2024-01-19T04:18:02.927137+0000","last_unstale":"2024-01-19T04:18:03.927337+0000","last_undegraded":"2024-01-19T04:18:03.927337+0000","last_fullsized":"2024-01-19T04:18:03.927337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:32:20.281699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917635+0000","last_change":"2024-01-19T04:17:49.864286+0000","last_active":"2024-01-19T04:18:02.917635+0000","last_peered":"2024-01-19T04:18:02.917635+0000","last_clean":"2024-01-19T04:18:02.917635+0000","last_became_active":"2024-01-19T04:17:49.864000+0000","last_became_peered":"2024-01-19T04:17:49.864000+0000","last_unstale":"2024-01-19T04:18:02.917635+0000","last_undegraded":"2024-01-19T04:18:02.917635+0000","last_fullsized":"2024-01-19T04:18:02.917635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198965+0000","last_change":"2024-01-19T04:18:02.931721+0000","last_active":"2024-01-19T04:18:04.198965+0000","last_peered":"2024-01-19T04:18:04.198965+0000","last_clean":"2024-01-19T04:18:04.198965+0000","last_became_active":"2024-01-19T04:18:02.931459+0000","last_became_peered":"2024-01-19T04:18:02.931459+0000","last_unstale":"2024-01-19T04:18:04.198965+0000","last_undegraded":"2024-01-19T04:18:04.198965+0000","last_fullsized":"2024-01-19T04:18:04.198965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:49.474100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.916533+0000","last_change":"2024-01-19T04:17:49.857274+0000","last_active":"2024-01-19T04:18:01.916533+0000","last_peered":"2024-01-19T04:18:01.916533+0000","last_clean":"2024-01-19T04:18:01.916533+0000","last_became_active":"2024-01-19T04:17:49.857013+0000","last_became_peered":"2024-01-19T04:17:49.857013+0000","last_unstale":"2024-01-19T04:18:01.916533+0000","last_undegraded":"2024-01-19T04:18:01.916533+0000","last_fullsized":"2024-01-19T04:18:01.916533+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:49.777934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929742+0000","last_change":"2024-01-19T04:18:02.931560+0000","last_active":"2024-01-19T04:18:03.929742+0000","last_peered":"2024-01-19T04:18:03.929742+0000","last_clean":"2024-01-19T04:18:03.929742+0000","last_became_active":"2024-01-19T04:18:02.931272+0000","last_became_peered":"2024-01-19T04:18:02.931272+0000","last_unstale":"2024-01-19T04:18:03.929742+0000","last_undegraded":"2024-01-19T04:18:03.929742+0000","last_fullsized":"2024-01-19T04:18:03.929742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:00:55.557395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915012+0000","last_change":"2024-01-19T04:17:49.875695+0000","last_active":"2024-01-19T04:18:02.915012+0000","last_peered":"2024-01-19T04:18:02.915012+0000","last_clean":"2024-01-19T04:18:02.915012+0000","last_became_active":"2024-01-19T04:17:49.875390+0000","last_became_peered":"2024-01-19T04:17:49.875390+0000","last_unstale":"2024-01-19T04:18:02.915012+0000","last_undegraded":"2024-01-19T04:18:02.915012+0000","last_fullsized":"2024-01-19T04:18:02.915012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930088+0000","last_change":"2024-01-19T04:18:02.921962+0000","last_active":"2024-01-19T04:18:03.930088+0000","last_peered":"2024-01-19T04:18:03.930088+0000","last_clean":"2024-01-19T04:18:03.930088+0000","last_became_active":"2024-01-19T04:18:02.921683+0000","last_became_peered":"2024-01-19T04:18:02.921683+0000","last_unstale":"2024-01-19T04:18:03.930088+0000","last_undegraded":"2024-01-19T04:18:03.930088+0000","last_fullsized":"2024-01-19T04:18:03.930088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:41:50.780485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915748+0000","last_change":"2024-01-19T04:17:49.872291+0000","last_active":"2024-01-19T04:18:02.915748+0000","last_peered":"2024-01-19T04:18:02.915748+0000","last_clean":"2024-01-19T04:18:02.915748+0000","last_became_active":"2024-01-19T04:17:49.869453+0000","last_became_peered":"2024-01-19T04:17:49.869453+0000","last_unstale":"2024-01-19T04:18:02.915748+0000","last_undegraded":"2024-01-19T04:18:02.915748+0000","last_fullsized":"2024-01-19T04:18:02.915748+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199594+0000","last_change":"2024-01-19T04:18:02.935909+0000","last_active":"2024-01-19T04:18:04.199594+0000","last_peered":"2024-01-19T04:18:04.199594+0000","last_clean":"2024-01-19T04:18:04.199594+0000","last_became_active":"2024-01-19T04:18:02.935337+0000","last_became_peered":"2024-01-19T04:18:02.935337+0000","last_unstale":"2024-01-19T04:18:04.199594+0000","last_undegraded":"2024-01-19T04:18:04.199594+0000","last_fullsized":"2024-01-19T04:18:04.199594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:23.408554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.912841+0000","last_change":"2024-01-19T04:17:49.871088+0000","last_active":"2024-01-19T04:18:02.912841+0000","last_peered":"2024-01-19T04:18:02.912841+0000","last_clean":"2024-01-19T04:18:02.912841+0000","last_became_active":"2024-01-19T04:17:49.867276+0000","last_became_peered":"2024-01-19T04:17:49.867276+0000","last_unstale":"2024-01-19T04:18:02.912841+0000","last_undegraded":"2024-01-19T04:18:02.912841+0000","last_fullsized":"2024-01-19T04:18:02.912841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200505+0000","last_change":"2024-01-19T04:18:02.926938+0000","last_active":"2024-01-19T04:18:04.200505+0000","last_peered":"2024-01-19T04:18:04.200505+0000","last_clean":"2024-01-19T04:18:04.200505+0000","last_became_active":"2024-01-19T04:18:02.926662+0000","last_became_peered":"2024-01-19T04:18:02.926662+0000","last_unstale":"2024-01-19T04:18:04.200505+0000","last_undegraded":"2024-01-19T04:18:04.200505+0000","last_fullsized":"2024-01-19T04:18:04.200505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:05.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903099+0000","last_change":"2024-01-19T04:17:49.862897+0000","last_active":"2024-01-19T04:18:01.903099+0000","last_peered":"2024-01-19T04:18:01.903099+0000","last_clean":"2024-01-19T04:18:01.903099+0000","last_became_active":"2024-01-19T04:17:49.859232+0000","last_became_peered":"2024-01-19T04:17:49.859232+0000","last_unstale":"2024-01-19T04:18:01.903099+0000","last_undegraded":"2024-01-19T04:18:01.903099+0000","last_fullsized":"2024-01-19T04:18:01.903099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:56.233836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199851+0000","last_change":"2024-01-19T04:18:02.929284+0000","last_active":"2024-01-19T04:18:04.199851+0000","last_peered":"2024-01-19T04:18:04.199851+0000","last_clean":"2024-01-19T04:18:04.199851+0000","last_became_active":"2024-01-19T04:18:02.928936+0000","last_became_peered":"2024-01-19T04:18:02.928936+0000","last_unstale":"2024-01-19T04:18:04.199851+0000","last_undegraded":"2024-01-19T04:18:04.199851+0000","last_fullsized":"2024-01-19T04:18:04.199851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:24:09.078909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913355+0000","last_change":"2024-01-19T04:17:49.867772+0000","last_active":"2024-01-19T04:18:02.913355+0000","last_peered":"2024-01-19T04:18:02.913355+0000","last_clean":"2024-01-19T04:18:02.913355+0000","last_became_active":"2024-01-19T04:17:49.867020+0000","last_became_peered":"2024-01-19T04:17:49.867020+0000","last_unstale":"2024-01-19T04:18:02.913355+0000","last_undegraded":"2024-01-19T04:18:02.913355+0000","last_fullsized":"2024-01-19T04:18:02.913355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939245+0000","last_change":"2024-01-19T04:18:02.930986+0000","last_active":"2024-01-19T04:18:02.939245+0000","last_peered":"2024-01-19T04:18:02.939245+0000","last_clean":"2024-01-19T04:18:02.939245+0000","last_became_active":"2024-01-19T04:18:02.928172+0000","last_became_peered":"2024-01-19T04:18:02.928172+0000","last_unstale":"2024-01-19T04:18:02.939245+0000","last_undegraded":"2024-01-19T04:18:02.939245+0000","last_fullsized":"2024-01-19T04:18:02.939245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:17:18.572725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911602+0000","last_change":"2024-01-19T04:17:49.866863+0000","last_active":"2024-01-19T04:18:02.911602+0000","last_peered":"2024-01-19T04:18:02.911602+0000","last_clean":"2024-01-19T04:18:02.911602+0000","last_became_active":"2024-01-19T04:17:49.866547+0000","last_became_peered":"2024-01-19T04:17:49.866547+0000","last_unstale":"2024-01-19T04:18:02.911602+0000","last_undegraded":"2024-01-19T04:18:02.911602+0000","last_fullsized":"2024-01-19T04:18:02.911602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:57:18.950160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929425+0000","last_change":"2024-01-19T04:18:02.936220+0000","last_active":"2024-01-19T04:18:03.929425+0000","last_peered":"2024-01-19T04:18:03.929425+0000","last_clean":"2024-01-19T04:18:03.929425+0000","last_became_active":"2024-01-19T04:18:02.935916+0000","last_became_peered":"2024-01-19T04:18:02.935916+0000","last_unstale":"2024-01-19T04:18:03.929425+0000","last_undegraded":"2024-01-19T04:18:03.929425+0000","last_fullsized":"2024-01-19T04:18:03.929425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:53:12.159567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.920793+0000","last_change":"2024-01-19T04:17:49.859723+0000","last_active":"2024-01-19T04:18:01.920793+0000","last_peered":"2024-01-19T04:18:01.920793+0000","last_clean":"2024-01-19T04:18:01.920793+0000","last_became_active":"2024-01-19T04:17:49.855553+0000","last_became_peered":"2024-01-19T04:17:49.855553+0000","last_unstale":"2024-01-19T04:18:01.920793+0000","last_undegraded":"2024-01-19T04:18:01.920793+0000","last_fullsized":"2024-01-19T04:18:01.920793+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:49:38.943773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939677+0000","last_change":"2024-01-19T04:18:02.930437+0000","last_active":"2024-01-19T04:18:02.939677+0000","last_peered":"2024-01-19T04:18:02.939677+0000","last_clean":"2024-01-19T04:18:02.939677+0000","last_became_active":"2024-01-19T04:18:02.930140+0000","last_became_peered":"2024-01-19T04:18:02.930140+0000","last_unstale":"2024-01-19T04:18:02.939677+0000","last_undegraded":"2024-01-19T04:18:02.939677+0000","last_fullsized":"2024-01-19T04:18:02.939677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:26.001599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.911538+0000","last_change":"2024-01-19T04:17:49.858285+0000","last_active":"2024-01-19T04:18:01.911538+0000","last_peered":"2024-01-19T04:18:01.911538+0000","last_clean":"2024-01-19T04:18:01.911538+0000","last_became_active":"2024-01-19T04:17:49.857723+0000","last_became_peered":"2024-01-19T04:17:49.857723+0000","last_unstale":"2024-01-19T04:18:01.911538+0000","last_undegraded":"2024-01-19T04:18:01.911538+0000","last_fullsized":"2024-01-19T04:18:01.911538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934176+0000","last_change":"2024-01-19T04:18:02.929863+0000","last_active":"2024-01-19T04:18:02.934176+0000","last_peered":"2024-01-19T04:18:02.934176+0000","last_clean":"2024-01-19T04:18:02.934176+0000","last_became_active":"2024-01-19T04:18:02.929256+0000","last_became_peered":"2024-01-19T04:18:02.929256+0000","last_unstale":"2024-01-19T04:18:02.934176+0000","last_undegraded":"2024-01-19T04:18:02.934176+0000","last_fullsized":"2024-01-19T04:18:02.934176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:13.125109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908153+0000","last_change":"2024-01-19T04:17:49.865134+0000","last_active":"2024-01-19T04:18:02.908153+0000","last_peered":"2024-01-19T04:18:02.908153+0000","last_clean":"2024-01-19T04:18:02.908153+0000","last_became_active":"2024-01-19T04:17:49.864792+0000","last_became_peered":"2024-01-19T04:17:49.864792+0000","last_unstale":"2024-01-19T04:18:02.908153+0000","last_undegraded":"2024-01-19T04:18:02.908153+0000","last_fullsized":"2024-01-19T04:18:02.908153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.943554+0000","last_change":"2024-01-19T04:18:02.935587+0000","last_active":"2024-01-19T04:18:02.943554+0000","last_peered":"2024-01-19T04:18:02.943554+0000","last_clean":"2024-01-19T04:18:02.943554+0000","last_became_active":"2024-01-19T04:18:02.935323+0000","last_became_peered":"2024-01-19T04:18:02.935323+0000","last_unstale":"2024-01-19T04:18:02.943554+0000","last_undegraded":"2024-01-19T04:18:02.943554+0000","last_fullsized":"2024-01-19T04:18:02.943554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:45:11.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.912021+0000","last_change":"2024-01-19T04:17:49.856844+0000","last_active":"2024-01-19T04:18:02.912021+0000","last_peered":"2024-01-19T04:18:02.912021+0000","last_clean":"2024-01-19T04:18:02.912021+0000","last_became_active":"2024-01-19T04:17:49.854882+0000","last_became_peered":"2024-01-19T04:17:49.854882+0000","last_unstale":"2024-01-19T04:18:02.912021+0000","last_undegraded":"2024-01-19T04:18:02.912021+0000","last_fullsized":"2024-01-19T04:18:02.912021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199819+0000","last_change":"2024-01-19T04:18:02.922713+0000","last_active":"2024-01-19T04:18:04.199819+0000","last_peered":"2024-01-19T04:18:04.199819+0000","last_clean":"2024-01-19T04:18:04.199819+0000","last_became_active":"2024-01-19T04:18:02.922415+0000","last_became_peered":"2024-01-19T04:18:02.922415+0000","last_unstale":"2024-01-19T04:18:04.199819+0000","last_undegraded":"2024-01-19T04:18:04.199819+0000","last_fullsized":"2024-01-19T04:18:04.199819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:10.425113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.918645+0000","last_change":"2024-01-19T04:17:49.872746+0000","last_active":"2024-01-19T04:18:01.918645+0000","last_peered":"2024-01-19T04:18:01.918645+0000","last_clean":"2024-01-19T04:18:01.918645+0000","last_became_active":"2024-01-19T04:17:49.871233+0000","last_became_peered":"2024-01-19T04:17:49.871233+0000","last_unstale":"2024-01-19T04:18:01.918645+0000","last_undegraded":"2024-01-19T04:18:01.918645+0000","last_fullsized":"2024-01-19T04:18:01.918645+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:54:07.776884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928398+0000","last_change":"2024-01-19T04:18:02.929196+0000","last_active":"2024-01-19T04:18:03.928398+0000","last_peered":"2024-01-19T04:18:03.928398+0000","last_clean":"2024-01-19T04:18:03.928398+0000","last_became_active":"2024-01-19T04:18:02.928696+0000","last_became_peered":"2024-01-19T04:18:02.928696+0000","last_unstale":"2024-01-19T04:18:03.928398+0000","last_undegraded":"2024-01-19T04:18:03.928398+0000","last_fullsized":"2024-01-19T04:18:03.928398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:46.282369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921545+0000","last_change":"2024-01-19T04:17:49.853513+0000","last_active":"2024-01-19T04:18:02.921545+0000","last_peered":"2024-01-19T04:18:02.921545+0000","last_clean":"2024-01-19T04:18:02.921545+0000","last_became_active":"2024-01-19T04:17:49.853240+0000","last_became_peered":"2024-01-19T04:17:49.853240+0000","last_unstale":"2024-01-19T04:18:02.921545+0000","last_undegraded":"2024-01-19T04:18:02.921545+0000","last_fullsized":"2024-01-19T04:18:02.921545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934106+0000","last_change":"2024-01-19T04:18:02.927104+0000","last_active":"2024-01-19T04:18:02.934106+0000","last_peered":"2024-01-19T04:18:02.934106+0000","last_clean":"2024-01-19T04:18:02.934106+0000","last_became_active":"2024-01-19T04:18:02.926691+0000","last_became_peered":"2024-01-19T04:18:02.926691+0000","last_unstale":"2024-01-19T04:18:02.934106+0000","last_undegraded":"2024-01-19T04:18:02.934106+0000","last_fullsized":"2024-01-19T04:18:02.934106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:06.549435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.921577+0000","last_change":"2024-01-19T04:17:49.857940+0000","last_active":"2024-01-19T04:18:01.921577+0000","last_peered":"2024-01-19T04:18:01.921577+0000","last_clean":"2024-01-19T04:18:01.921577+0000","last_became_active":"2024-01-19T04:17:49.857618+0000","last_became_peered":"2024-01-19T04:17:49.857618+0000","last_unstale":"2024-01-19T04:18:01.921577+0000","last_undegraded":"2024-01-19T04:18:01.921577+0000","last_fullsized":"2024-01-19T04:18:01.921577+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:17:03.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927482+0000","last_change":"2024-01-19T04:18:02.929159+0000","last_active":"2024-01-19T04:18:03.927482+0000","last_peered":"2024-01-19T04:18:03.927482+0000","last_clean":"2024-01-19T04:18:03.927482+0000","last_became_active":"2024-01-19T04:18:02.928745+0000","last_became_peered":"2024-01-19T04:18:02.928745+0000","last_unstale":"2024-01-19T04:18:03.927482+0000","last_undegraded":"2024-01-19T04:18:03.927482+0000","last_fullsized":"2024-01-19T04:18:03.927482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:23.835750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.921507+0000","last_change":"2024-01-19T04:17:49.859316+0000","last_active":"2024-01-19T04:18:01.921507+0000","last_peered":"2024-01-19T04:18:01.921507+0000","last_clean":"2024-01-19T04:18:01.921507+0000","last_became_active":"2024-01-19T04:17:49.858093+0000","last_became_peered":"2024-01-19T04:17:49.858093+0000","last_unstale":"2024-01-19T04:18:01.921507+0000","last_undegraded":"2024-01-19T04:18:01.921507+0000","last_fullsized":"2024-01-19T04:18:01.921507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:43.805224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929746+0000","last_change":"2024-01-19T04:18:02.933633+0000","last_active":"2024-01-19T04:18:03.929746+0000","last_peered":"2024-01-19T04:18:03.929746+0000","last_clean":"2024-01-19T04:18:03.929746+0000","last_became_active":"2024-01-19T04:18:02.930330+0000","last_became_peered":"2024-01-19T04:18:02.930330+0000","last_unstale":"2024-01-19T04:18:03.929746+0000","last_undegraded":"2024-01-19T04:18:03.929746+0000","last_fullsized":"2024-01-19T04:18:03.929746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:52:50.129815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902401+0000","last_change":"2024-01-19T04:17:49.866954+0000","last_active":"2024-01-19T04:18:01.902401+0000","last_peered":"2024-01-19T04:18:01.902401+0000","last_clean":"2024-01-19T04:18:01.902401+0000","last_became_active":"2024-01-19T04:17:49.866065+0000","last_became_peered":"2024-01-19T04:17:49.866065+0000","last_unstale":"2024-01-19T04:18:01.902401+0000","last_undegraded":"2024-01-19T04:18:01.902401+0000","last_fullsized":"2024-01-19T04:18:01.902401+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:10.031493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939917+0000","last_change":"2024-01-19T04:18:02.931652+0000","last_active":"2024-01-19T04:18:02.939917+0000","last_peered":"2024-01-19T04:18:02.939917+0000","last_clean":"2024-01-19T04:18:02.939917+0000","last_became_active":"2024-01-19T04:18:02.931322+0000","last_became_peered":"2024-01-19T04:18:02.931322+0000","last_unstale":"2024-01-19T04:18:02.939917+0000","last_undegraded":"2024-01-19T04:18:02.939917+0000","last_fullsized":"2024-01-19T04:18:02.939917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:45.079562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911410+0000","last_change":"2024-01-19T04:17:49.868296+0000","last_active":"2024-01-19T04:18:02.911410+0000","last_peered":"2024-01-19T04:18:02.911410+0000","last_clean":"2024-01-19T04:18:02.911410+0000","last_became_active":"2024-01-19T04:17:49.867461+0000","last_became_peered":"2024-01-19T04:17:49.867461+0000","last_unstale":"2024-01-19T04:18:02.911410+0000","last_undegraded":"2024-01-19T04:18:02.911410+0000","last_fullsized":"2024-01-19T04:18:02.911410+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927522+0000","last_change":"2024-01-19T04:18:02.925158+0000","last_active":"2024-01-19T04:18:03.927522+0000","last_peered":"2024-01-19T04:18:03.927522+0000","last_clean":"2024-01-19T04:18:03.927522+0000","last_became_active":"2024-01-19T04:18:02.924898+0000","last_became_peered":"2024-01-19T04:18:02.924898+0000","last_unstale":"2024-01-19T04:18:03.927522+0000","last_undegraded":"2024-01-19T04:18:03.927522+0000","last_fullsized":"2024-01-19T04:18:03.927522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:11.345369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.915926+0000","last_change":"2024-01-19T04:17:49.852860+0000","last_active":"2024-01-19T04:18:01.915926+0000","last_peered":"2024-01-19T04:18:01.915926+0000","last_clean":"2024-01-19T04:18:01.915926+0000","last_became_active":"2024-01-19T04:17:49.852553+0000","last_became_peered":"2024-01-19T04:17:49.852553+0000","last_unstale":"2024-01-19T04:18:01.915926+0000","last_undegraded":"2024-01-19T04:18:01.915926+0000","last_fullsized":"2024-01-19T04:18:01.915926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:14.754721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930448+0000","last_change":"2024-01-19T04:18:02.943210+0000","last_active":"2024-01-19T04:18:03.930448+0000","last_peered":"2024-01-19T04:18:03.930448+0000","last_clean":"2024-01-19T04:18:03.930448+0000","last_became_active":"2024-01-19T04:18:02.942677+0000","last_became_peered":"2024-01-19T04:18:02.942677+0000","last_unstale":"2024-01-19T04:18:03.930448+0000","last_undegraded":"2024-01-19T04:18:03.930448+0000","last_fullsized":"2024-01-19T04:18:03.930448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:11.345369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903292+0000","last_change":"2024-01-19T04:17:49.871177+0000","last_active":"2024-01-19T04:18:01.903292+0000","last_peered":"2024-01-19T04:18:01.903292+0000","last_clean":"2024-01-19T04:18:01.903292+0000","last_became_active":"2024-01-19T04:17:49.866601+0000","last_became_peered":"2024-01-19T04:17:49.866601+0000","last_unstale":"2024-01-19T04:18:01.903292+0000","last_undegraded":"2024-01-19T04:18:01.903292+0000","last_fullsized":"2024-01-19T04:18:01.903292+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:14.140070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199642+0000","last_change":"2024-01-19T04:18:02.928862+0000","last_active":"2024-01-19T04:18:04.199642+0000","last_peered":"2024-01-19T04:18:04.199642+0000","last_clean":"2024-01-19T04:18:04.199642+0000","last_became_active":"2024-01-19T04:18:02.927181+0000","last_became_peered":"2024-01-19T04:18:02.927181+0000","last_unstale":"2024-01-19T04:18:04.199642+0000","last_undegraded":"2024-01-19T04:18:04.199642+0000","last_fullsized":"2024-01-19T04:18:04.199642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:53:12.159567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916891+0000","last_change":"2024-01-19T04:17:49.874016+0000","last_active":"2024-01-19T04:18:02.916891+0000","last_peered":"2024-01-19T04:18:02.916891+0000","last_clean":"2024-01-19T04:18:02.916891+0000","last_became_active":"2024-01-19T04:17:49.873659+0000","last_became_peered":"2024-01-19T04:17:49.873659+0000","last_unstale":"2024-01-19T04:18:02.916891+0000","last_undegraded":"2024-01-19T04:18:02.916891+0000","last_fullsized":"2024-01-19T04:18:02.916891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:19:01.792971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200805+0000","last_change":"2024-01-19T04:18:02.931936+0000","last_active":"2024-01-19T04:18:04.200805+0000","last_peered":"2024-01-19T04:18:04.200805+0000","last_clean":"2024-01-19T04:18:04.200805+0000","last_became_active":"2024-01-19T04:18:02.931639+0000","last_became_peered":"2024-01-19T04:18:02.931639+0000","last_unstale":"2024-01-19T04:18:04.200805+0000","last_undegraded":"2024-01-19T04:18:04.200805+0000","last_fullsized":"2024-01-19T04:18:04.200805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:52:50.129815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909438+0000","last_change":"2024-01-19T04:17:49.852565+0000","last_active":"2024-01-19T04:18:02.909438+0000","last_peered":"2024-01-19T04:18:02.909438+0000","last_clean":"2024-01-19T04:18:02.909438+0000","last_became_active":"2024-01-19T04:17:49.852322+0000","last_became_peered":"2024-01-19T04:17:49.852322+0000","last_unstale":"2024-01-19T04:18:02.909438+0000","last_undegraded":"2024-01-19T04:18:02.909438+0000","last_fullsized":"2024-01-19T04:18:02.909438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928568+0000","last_change":"2024-01-19T04:18:02.934034+0000","last_active":"2024-01-19T04:18:03.928568+0000","last_peered":"2024-01-19T04:18:03.928568+0000","last_clean":"2024-01-19T04:18:03.928568+0000","last_became_active":"2024-01-19T04:18:02.932871+0000","last_became_peered":"2024-01-19T04:18:02.932871+0000","last_unstale":"2024-01-19T04:18:03.928568+0000","last_undegraded":"2024-01-19T04:18:03.928568+0000","last_fullsized":"2024-01-19T04:18:03.928568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:15:52.145695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913367+0000","last_change":"2024-01-19T04:17:49.863773+0000","last_active":"2024-01-19T04:18:02.913367+0000","last_peered":"2024-01-19T04:18:02.913367+0000","last_clean":"2024-01-19T04:18:02.913367+0000","last_became_active":"2024-01-19T04:17:49.863395+0000","last_became_peered":"2024-01-19T04:17:49.863395+0000","last_unstale":"2024-01-19T04:18:02.913367+0000","last_undegraded":"2024-01-19T04:18:02.913367+0000","last_fullsized":"2024-01-19T04:18:02.913367+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934272+0000","last_change":"2024-01-19T04:18:02.926574+0000","last_active":"2024-01-19T04:18:02.934272+0000","last_peered":"2024-01-19T04:18:02.934272+0000","last_clean":"2024-01-19T04:18:02.934272+0000","last_became_active":"2024-01-19T04:18:02.926297+0000","last_became_peered":"2024-01-19T04:18:02.926297+0000","last_unstale":"2024-01-19T04:18:02.934272+0000","last_undegraded":"2024-01-19T04:18:02.934272+0000","last_fullsized":"2024-01-19T04:18:02.934272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:46:09.144032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902950+0000","last_change":"2024-01-19T04:17:49.866404+0000","last_active":"2024-01-19T04:18:01.902950+0000","last_peered":"2024-01-19T04:18:01.902950+0000","last_clean":"2024-01-19T04:18:01.902950+0000","last_became_active":"2024-01-19T04:17:49.866097+0000","last_became_peered":"2024-01-19T04:17:49.866097+0000","last_unstale":"2024-01-19T04:18:01.902950+0000","last_undegraded":"2024-01-19T04:18:01.902950+0000","last_fullsized":"2024-01-19T04:18:01.902950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:27.936090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.946770+0000","last_change":"2024-01-19T04:18:02.926102+0000","last_active":"2024-01-19T04:18:02.946770+0000","last_peered":"2024-01-19T04:18:02.946770+0000","last_clean":"2024-01-19T04:18:02.946770+0000","last_became_active":"2024-01-19T04:18:02.925838+0000","last_became_peered":"2024-01-19T04:18:02.925838+0000","last_unstale":"2024-01-19T04:18:02.946770+0000","last_undegraded":"2024-01-19T04:18:02.946770+0000","last_fullsized":"2024-01-19T04:18:02.946770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:29.524861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902503+0000","last_change":"2024-01-19T04:17:49.865607+0000","last_active":"2024-01-19T04:18:01.902503+0000","last_peered":"2024-01-19T04:18:01.902503+0000","last_clean":"2024-01-19T04:18:01.902503+0000","last_became_active":"2024-01-19T04:17:49.862265+0000","last_became_peered":"2024-01-19T04:17:49.862265+0000","last_unstale":"2024-01-19T04:18:01.902503+0000","last_undegraded":"2024-01-19T04:18:01.902503+0000","last_fullsized":"2024-01-19T04:18:01.902503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:47.108625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927892+0000","last_change":"2024-01-19T04:18:02.937135+0000","last_active":"2024-01-19T04:18:03.927892+0000","last_peered":"2024-01-19T04:18:03.927892+0000","last_clean":"2024-01-19T04:18:03.927892+0000","last_became_active":"2024-01-19T04:18:02.936830+0000","last_became_peered":"2024-01-19T04:18:02.936830+0000","last_unstale":"2024-01-19T04:18:03.927892+0000","last_undegraded":"2024-01-19T04:18:03.927892+0000","last_fullsized":"2024-01-19T04:18:03.927892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:15:33.620586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908573+0000","last_change":"2024-01-19T04:17:49.857659+0000","last_active":"2024-01-19T04:18:02.908573+0000","last_peered":"2024-01-19T04:18:02.908573+0000","last_clean":"2024-01-19T04:18:02.908573+0000","last_became_active":"2024-01-19T04:17:49.857365+0000","last_became_peered":"2024-01-19T04:17:49.857365+0000","last_unstale":"2024-01-19T04:18:02.908573+0000","last_undegraded":"2024-01-19T04:18:02.908573+0000","last_fullsized":"2024-01-19T04:18:02.908573+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:09.890421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934139+0000","last_change":"2024-01-19T04:18:02.923180+0000","last_active":"2024-01-19T04:18:02.934139+0000","last_peered":"2024-01-19T04:18:02.934139+0000","last_clean":"2024-01-19T04:18:02.934139+0000","last_became_active":"2024-01-19T04:18:02.922828+0000","last_became_peered":"2024-01-19T04:18:02.922828+0000","last_unstale":"2024-01-19T04:18:02.934139+0000","last_undegraded":"2024-01-19T04:18:02.934139+0000","last_fullsized":"2024-01-19T04:18:02.934139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:00.202869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913241+0000","last_change":"2024-01-19T04:17:49.867051+0000","last_active":"2024-01-19T04:18:02.913241+0000","last_peered":"2024-01-19T04:18:02.913241+0000","last_clean":"2024-01-19T04:18:02.913241+0000","last_became_active":"2024-01-19T04:17:49.866731+0000","last_became_peered":"2024-01-19T04:17:49.866731+0000","last_unstale":"2024-01-19T04:18:02.913241+0000","last_undegraded":"2024-01-19T04:18:02.913241+0000","last_fullsized":"2024-01-19T04:18:02.913241+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.946850+0000","last_change":"2024-01-19T04:18:02.923641+0000","last_active":"2024-01-19T04:18:02.946850+0000","last_peered":"2024-01-19T04:18:02.946850+0000","last_clean":"2024-01-19T04:18:02.946850+0000","last_became_active":"2024-01-19T04:18:02.922977+0000","last_became_peered":"2024-01-19T04:18:02.922977+0000","last_unstale":"2024-01-19T04:18:02.946850+0000","last_undegraded":"2024-01-19T04:18:02.946850+0000","last_fullsized":"2024-01-19T04:18:02.946850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:33.097881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928336+0000","last_change":"2024-01-19T04:18:01.927465+0000","last_active":"2024-01-19T04:18:03.928336+0000","last_peered":"2024-01-19T04:18:03.928336+0000","last_clean":"2024-01-19T04:18:03.928336+0000","last_became_active":"2024-01-19T04:18:01.926814+0000","last_became_peered":"2024-01-19T04:18:01.926814+0000","last_unstale":"2024-01-19T04:18:03.928336+0000","last_undegraded":"2024-01-19T04:18:03.928336+0000","last_fullsized":"2024-01-19T04:18:03.928336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:24:43.828655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909743+0000","last_change":"2024-01-19T04:17:49.864851+0000","last_active":"2024-01-19T04:18:02.909743+0000","last_peered":"2024-01-19T04:18:02.909743+0000","last_clean":"2024-01-19T04:18:02.909743+0000","last_became_active":"2024-01-19T04:17:49.864521+0000","last_became_peered":"2024-01-19T04:17:49.864521+0000","last_unstale":"2024-01-19T04:18:02.909743+0000","last_undegraded":"2024-01-19T04:18:02.909743+0000","last_fullsized":"2024-01-19T04:18:02.909743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"70'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914466+0000","last_change":"2024-01-19T04:17:48.825833+0000","last_active":"2024-01-19T04:18:02.914466+0000","last_peered":"2024-01-19T04:18:02.914466+0000","last_clean":"2024-01-19T04:18:02.914466+0000","last_became_active":"2024-01-19T04:17:48.825538+0000","last_became_peered":"2024-01-19T04:17:48.825538+0000","last_unstale":"2024-01-19T04:18:02.914466+0000","last_undegraded":"2024-01-19T04:18:02.914466+0000","last_fullsized":"2024-01-19T04:18:02.914466+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199844+0000","last_change":"2024-01-19T04:18:02.931774+0000","last_active":"2024-01-19T04:18:04.199844+0000","last_peered":"2024-01-19T04:18:04.199844+0000","last_clean":"2024-01-19T04:18:04.199844+0000","last_became_active":"2024-01-19T04:18:02.928427+0000","last_became_peered":"2024-01-19T04:18:02.928427+0000","last_unstale":"2024-01-19T04:18:04.199844+0000","last_undegraded":"2024-01-19T04:18:04.199844+0000","last_fullsized":"2024-01-19T04:18:04.199844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:49.474100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927938+0000","last_change":"2024-01-19T04:18:01.926749+0000","last_active":"2024-01-19T04:18:03.927938+0000","last_peered":"2024-01-19T04:18:03.927938+0000","last_clean":"2024-01-19T04:18:03.927938+0000","last_became_active":"2024-01-19T04:18:01.925465+0000","last_became_peered":"2024-01-19T04:18:01.925465+0000","last_unstale":"2024-01-19T04:18:03.927938+0000","last_undegraded":"2024-01-19T04:18:03.927938+0000","last_fullsized":"2024-01-19T04:18:03.927938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:09:24.825742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914284+0000","last_change":"2024-01-19T04:17:49.870363+0000","last_active":"2024-01-19T04:18:02.914284+0000","last_peered":"2024-01-19T04:18:02.914284+0000","last_clean":"2024-01-19T04:18:02.914284+0000","last_became_active":"2024-01-19T04:17:49.867727+0000","last_became_peered":"2024-01-19T04:17:49.867727+0000","last_unstale":"2024-01-19T04:18:02.914284+0000","last_undegraded":"2024-01-19T04:18:02.914284+0000","last_fullsized":"2024-01-19T04:18:02.914284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909939+0000","last_change":"2024-01-19T04:17:48.820675+0000","last_active":"2024-01-19T04:18:02.909939+0000","last_peered":"2024-01-19T04:18:02.909939+0000","last_clean":"2024-01-19T04:18:02.909939+0000","last_became_active":"2024-01-19T04:17:48.816249+0000","last_became_peered":"2024-01-19T04:17:48.816249+0000","last_unstale":"2024-01-19T04:18:02.909939+0000","last_undegraded":"2024-01-19T04:18:02.909939+0000","last_fullsized":"2024-01-19T04:18:02.909939+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.944568+0000","last_change":"2024-01-19T04:18:02.940150+0000","last_active":"2024-01-19T04:18:02.944568+0000","last_peered":"2024-01-19T04:18:02.944568+0000","last_clean":"2024-01-19T04:18:02.944568+0000","last_became_active":"2024-01-19T04:18:02.939837+0000","last_became_peered":"2024-01-19T04:18:02.939837+0000","last_unstale":"2024-01-19T04:18:02.944568+0000","last_undegraded":"2024-01-19T04:18:02.944568+0000","last_fullsized":"2024-01-19T04:18:02.944568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:41:14.828916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"74'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928251+0000","last_change":"2024-01-19T04:18:01.928789+0000","last_active":"2024-01-19T04:18:03.928251+0000","last_peered":"2024-01-19T04:18:03.928251+0000","last_clean":"2024-01-19T04:18:03.928251+0000","last_became_active":"2024-01-19T04:18:01.928296+0000","last_became_peered":"2024-01-19T04:18:01.928296+0000","last_unstale":"2024-01-19T04:18:03.928251+0000","last_undegraded":"2024-01-19T04:18:03.928251+0000","last_fullsized":"2024-01-19T04:18:03.928251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:09.419485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913487+0000","last_change":"2024-01-19T04:17:49.867990+0000","last_active":"2024-01-19T04:18:02.913487+0000","last_peered":"2024-01-19T04:18:02.913487+0000","last_clean":"2024-01-19T04:18:02.913487+0000","last_became_active":"2024-01-19T04:17:49.867492+0000","last_became_peered":"2024-01-19T04:17:49.867492+0000","last_unstale":"2024-01-19T04:18:02.913487+0000","last_undegraded":"2024-01-19T04:18:02.913487+0000","last_fullsized":"2024-01-19T04:18:02.913487+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"70'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921784+0000","last_change":"2024-01-19T04:17:48.828840+0000","last_active":"2024-01-19T04:18:02.921784+0000","last_peered":"2024-01-19T04:18:02.921784+0000","last_clean":"2024-01-19T04:18:02.921784+0000","last_became_active":"2024-01-19T04:17:48.828585+0000","last_became_peered":"2024-01-19T04:17:48.828585+0000","last_unstale":"2024-01-19T04:18:02.921784+0000","last_undegraded":"2024-01-19T04:18:02.921784+0000","last_fullsized":"2024-01-19T04:18:02.921784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:08.887937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934433+0000","last_change":"2024-01-19T04:18:02.926349+0000","last_active":"2024-01-19T04:18:02.934433+0000","last_peered":"2024-01-19T04:18:02.934433+0000","last_clean":"2024-01-19T04:18:02.934433+0000","last_became_active":"2024-01-19T04:18:02.925960+0000","last_became_peered":"2024-01-19T04:18:02.925960+0000","last_unstale":"2024-01-19T04:18:02.934433+0000","last_undegraded":"2024-01-19T04:18:02.934433+0000","last_fullsized":"2024-01-19T04:18:02.934433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:43:17.917877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930196+0000","last_change":"2024-01-19T04:18:01.922734+0000","last_active":"2024-01-19T04:18:03.930196+0000","last_peered":"2024-01-19T04:18:03.930196+0000","last_clean":"2024-01-19T04:18:03.930196+0000","last_became_active":"2024-01-19T04:18:01.922380+0000","last_became_peered":"2024-01-19T04:18:01.922380+0000","last_unstale":"2024-01-19T04:18:03.930196+0000","last_undegraded":"2024-01-19T04:18:03.930196+0000","last_fullsized":"2024-01-19T04:18:03.930196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:03.436450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917420+0000","last_change":"2024-01-19T04:17:49.873318+0000","last_active":"2024-01-19T04:18:02.917420+0000","last_peered":"2024-01-19T04:18:02.917420+0000","last_clean":"2024-01-19T04:18:02.917420+0000","last_became_active":"2024-01-19T04:17:49.873026+0000","last_became_peered":"2024-01-19T04:17:49.873026+0000","last_unstale":"2024-01-19T04:18:02.917420+0000","last_undegraded":"2024-01-19T04:18:02.917420+0000","last_fullsized":"2024-01-19T04:18:02.917420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:44.021386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"70'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.922701+0000","last_change":"2024-01-19T04:17:48.829724+0000","last_active":"2024-01-19T04:18:02.922701+0000","last_peered":"2024-01-19T04:18:02.922701+0000","last_clean":"2024-01-19T04:18:02.922701+0000","last_became_active":"2024-01-19T04:17:48.829371+0000","last_became_peered":"2024-01-19T04:17:48.829371+0000","last_unstale":"2024-01-19T04:18:02.922701+0000","last_undegraded":"2024-01-19T04:18:02.922701+0000","last_fullsized":"2024-01-19T04:18:02.922701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:37.979741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.936920+0000","last_change":"2024-01-19T04:18:02.928268+0000","last_active":"2024-01-19T04:18:02.936920+0000","last_peered":"2024-01-19T04:18:02.936920+0000","last_clean":"2024-01-19T04:18:02.936920+0000","last_became_active":"2024-01-19T04:18:02.928011+0000","last_became_peered":"2024-01-19T04:18:02.928011+0000","last_unstale":"2024-01-19T04:18:02.936920+0000","last_undegraded":"2024-01-19T04:18:02.936920+0000","last_fullsized":"2024-01-19T04:18:02.936920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:24:41.766331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198154+0000","last_change":"2024-01-19T04:18:01.926918+0000","last_active":"2024-01-19T04:18:04.198154+0000","last_peered":"2024-01-19T04:18:04.198154+0000","last_clean":"2024-01-19T04:18:04.198154+0000","last_became_active":"2024-01-19T04:18:01.926642+0000","last_became_peered":"2024-01-19T04:18:01.926642+0000","last_unstale":"2024-01-19T04:18:04.198154+0000","last_undegraded":"2024-01-19T04:18:04.198154+0000","last_fullsized":"2024-01-19T04:18:04.198154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:55:13.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902675+0000","last_change":"2024-01-19T04:17:49.865540+0000","last_active":"2024-01-19T04:18:01.902675+0000","last_peered":"2024-01-19T04:18:01.902675+0000","last_clean":"2024-01-19T04:18:01.902675+0000","last_became_active":"2024-01-19T04:17:49.858951+0000","last_became_peered":"2024-01-19T04:17:49.858951+0000","last_unstale":"2024-01-19T04:18:01.902675+0000","last_undegraded":"2024-01-19T04:18:01.902675+0000","last_fullsized":"2024-01-19T04:18:01.902675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:40.979891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909293+0000","last_change":"2024-01-19T04:17:48.822620+0000","last_active":"2024-01-19T04:18:02.909293+0000","last_peered":"2024-01-19T04:18:02.909293+0000","last_clean":"2024-01-19T04:18:02.909293+0000","last_became_active":"2024-01-19T04:17:48.822278+0000","last_became_peered":"2024-01-19T04:17:48.822278+0000","last_unstale":"2024-01-19T04:18:02.909293+0000","last_undegraded":"2024-01-19T04:18:02.909293+0000","last_fullsized":"2024-01-19T04:18:02.909293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197842+0000","last_change":"2024-01-19T04:18:02.924033+0000","last_active":"2024-01-19T04:18:04.197842+0000","last_peered":"2024-01-19T04:18:04.197842+0000","last_clean":"2024-01-19T04:18:04.197842+0000","last_became_active":"2024-01-19T04:18:02.923767+0000","last_became_peered":"2024-01-19T04:18:02.923767+0000","last_unstale":"2024-01-19T04:18:04.197842+0000","last_undegraded":"2024-01-19T04:18:04.197842+0000","last_fullsized":"2024-01-19T04:18:04.197842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:09:25.831369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.906084+0000","last_change":"2024-01-19T04:18:01.922795+0000","last_active":"2024-01-19T04:18:02.906084+0000","last_peered":"2024-01-19T04:18:02.906084+0000","last_clean":"2024-01-19T04:18:02.906084+0000","last_became_active":"2024-01-19T04:18:01.922539+0000","last_became_peered":"2024-01-19T04:18:01.922539+0000","last_unstale":"2024-01-19T04:18:02.906084+0000","last_undegraded":"2024-01-19T04:18:02.906084+0000","last_fullsized":"2024-01-19T04:18:02.906084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:17:07.479247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908980+0000","last_change":"2024-01-19T04:17:49.860631+0000","last_active":"2024-01-19T04:18:02.908980+0000","last_peered":"2024-01-19T04:18:02.908980+0000","last_clean":"2024-01-19T04:18:02.908980+0000","last_became_active":"2024-01-19T04:17:49.855956+0000","last_became_peered":"2024-01-19T04:17:49.855956+0000","last_unstale":"2024-01-19T04:18:02.908980+0000","last_undegraded":"2024-01-19T04:18:02.908980+0000","last_fullsized":"2024-01-19T04:18:02.908980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908649+0000","last_change":"2024-01-19T04:17:48.818168+0000","last_active":"2024-01-19T04:18:02.908649+0000","last_peered":"2024-01-19T04:18:02.908649+0000","last_clean":"2024-01-19T04:18:02.908649+0000","last_became_active":"2024-01-19T04:17:48.816710+0000","last_became_peered":"2024-01-19T04:17:48.816710+0000","last_unstale":"2024-01-19T04:18:02.908649+0000","last_undegraded":"2024-01-19T04:18:02.908649+0000","last_fullsized":"2024-01-19T04:18:02.908649+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198241+0000","last_change":"2024-01-19T04:18:02.930057+0000","last_active":"2024-01-19T04:18:04.198241+0000","last_peered":"2024-01-19T04:18:04.198241+0000","last_clean":"2024-01-19T04:18:04.198241+0000","last_became_active":"2024-01-19T04:18:02.929766+0000","last_became_peered":"2024-01-19T04:18:02.929766+0000","last_unstale":"2024-01-19T04:18:04.198241+0000","last_undegraded":"2024-01-19T04:18:04.198241+0000","last_fullsized":"2024-01-19T04:18:04.198241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:12.610657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947664+0000","last_change":"2024-01-19T04:18:01.923533+0000","last_active":"2024-01-19T04:18:02.947664+0000","last_peered":"2024-01-19T04:18:02.947664+0000","last_clean":"2024-01-19T04:18:02.947664+0000","last_became_active":"2024-01-19T04:18:01.923266+0000","last_became_peered":"2024-01-19T04:18:01.923266+0000","last_unstale":"2024-01-19T04:18:02.947664+0000","last_undegraded":"2024-01-19T04:18:02.947664+0000","last_fullsized":"2024-01-19T04:18:02.947664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:33.446199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911006+0000","last_change":"2024-01-19T04:17:49.869314+0000","last_active":"2024-01-19T04:18:02.911006+0000","last_peered":"2024-01-19T04:18:02.911006+0000","last_clean":"2024-01-19T04:18:02.911006+0000","last_became_active":"2024-01-19T04:17:49.868926+0000","last_became_peered":"2024-01-19T04:17:49.868926+0000","last_unstale":"2024-01-19T04:18:02.911006+0000","last_undegraded":"2024-01-19T04:18:02.911006+0000","last_fullsized":"2024-01-19T04:18:02.911006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917725+0000","last_change":"2024-01-19T04:17:48.828497+0000","last_active":"2024-01-19T04:18:02.917725+0000","last_peered":"2024-01-19T04:18:02.917725+0000","last_clean":"2024-01-19T04:18:02.917725+0000","last_became_active":"2024-01-19T04:17:48.828243+0000","last_became_peered":"2024-01-19T04:17:48.828243+0000","last_unstale":"2024-01-19T04:18:02.917725+0000","last_undegraded":"2024-01-19T04:18:02.917725+0000","last_fullsized":"2024-01-19T04:18:02.917725+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:19.001153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929882+0000","last_change":"2024-01-19T04:18:02.920463+0000","last_active":"2024-01-19T04:18:03.929882+0000","last_peered":"2024-01-19T04:18:03.929882+0000","last_clean":"2024-01-19T04:18:03.929882+0000","last_became_active":"2024-01-19T04:18:02.920162+0000","last_became_peered":"2024-01-19T04:18:02.920162+0000","last_unstale":"2024-01-19T04:18:03.929882+0000","last_undegraded":"2024-01-19T04:18:03.929882+0000","last_fullsized":"2024-01-19T04:18:03.929882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:10.841034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927738+0000","last_change":"2024-01-19T04:18:01.925519+0000","last_active":"2024-01-19T04:18:03.927738+0000","last_peered":"2024-01-19T04:18:03.927738+0000","last_clean":"2024-01-19T04:18:03.927738+0000","last_became_active":"2024-01-19T04:18:01.925202+0000","last_became_peered":"2024-01-19T04:18:01.925202+0000","last_unstale":"2024-01-19T04:18:03.927738+0000","last_undegraded":"2024-01-19T04:18:03.927738+0000","last_fullsized":"2024-01-19T04:18:03.927738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:03.436450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.911622+0000","last_change":"2024-01-19T04:17:49.858061+0000","last_active":"2024-01-19T04:18:01.911622+0000","last_peered":"2024-01-19T04:18:01.911622+0000","last_clean":"2024-01-19T04:18:01.911622+0000","last_became_active":"2024-01-19T04:17:49.857273+0000","last_became_peered":"2024-01-19T04:17:49.857273+0000","last_unstale":"2024-01-19T04:18:01.911622+0000","last_undegraded":"2024-01-19T04:18:01.911622+0000","last_fullsized":"2024-01-19T04:18:01.911622+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:09:22.290458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902845+0000","last_change":"2024-01-19T04:17:48.825064+0000","last_active":"2024-01-19T04:18:01.902845+0000","last_peered":"2024-01-19T04:18:01.902845+0000","last_clean":"2024-01-19T04:18:01.902845+0000","last_became_active":"2024-01-19T04:17:48.824540+0000","last_became_peered":"2024-01-19T04:17:48.824540+0000","last_unstale":"2024-01-19T04:18:01.902845+0000","last_undegraded":"2024-01-19T04:18:01.902845+0000","last_fullsized":"2024-01-19T04:18:01.902845+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:48.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199031+0000","last_change":"2024-01-19T04:18:02.935518+0000","last_active":"2024-01-19T04:18:04.199031+0000","last_peered":"2024-01-19T04:18:04.199031+0000","last_clean":"2024-01-19T04:18:04.199031+0000","last_became_active":"2024-01-19T04:18:02.935175+0000","last_became_peered":"2024-01-19T04:18:02.935175+0000","last_unstale":"2024-01-19T04:18:04.199031+0000","last_undegraded":"2024-01-19T04:18:04.199031+0000","last_fullsized":"2024-01-19T04:18:04.199031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:05.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"74'3","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930461+0000","last_change":"2024-01-19T04:18:01.925505+0000","last_active":"2024-01-19T04:18:03.930461+0000","last_peered":"2024-01-19T04:18:03.930461+0000","last_clean":"2024-01-19T04:18:03.930461+0000","last_became_active":"2024-01-19T04:18:01.925249+0000","last_became_peered":"2024-01-19T04:18:01.925249+0000","last_unstale":"2024-01-19T04:18:03.930461+0000","last_undegraded":"2024-01-19T04:18:03.930461+0000","last_fullsized":"2024-01-19T04:18:03.930461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:30.941043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.914955+0000","last_change":"2024-01-19T04:17:49.857761+0000","last_active":"2024-01-19T04:18:01.914955+0000","last_peered":"2024-01-19T04:18:01.914955+0000","last_clean":"2024-01-19T04:18:01.914955+0000","last_became_active":"2024-01-19T04:17:49.857423+0000","last_became_peered":"2024-01-19T04:17:49.857423+0000","last_unstale":"2024-01-19T04:18:01.914955+0000","last_undegraded":"2024-01-19T04:18:01.914955+0000","last_fullsized":"2024-01-19T04:18:01.914955+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:02.036657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914570+0000","last_change":"2024-01-19T04:17:48.830083+0000","last_active":"2024-01-19T04:18:02.914570+0000","last_peered":"2024-01-19T04:18:02.914570+0000","last_clean":"2024-01-19T04:18:02.914570+0000","last_became_active":"2024-01-19T04:17:48.829733+0000","last_became_peered":"2024-01-19T04:17:48.829733+0000","last_unstale":"2024-01-19T04:18:02.914570+0000","last_undegraded":"2024-01-19T04:18:02.914570+0000","last_fullsized":"2024-01-19T04:18:02.914570+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930112+0000","last_change":"2024-01-19T04:18:02.935577+0000","last_active":"2024-01-19T04:18:03.930112+0000","last_peered":"2024-01-19T04:18:03.930112+0000","last_clean":"2024-01-19T04:18:03.930112+0000","last_became_active":"2024-01-19T04:18:02.934941+0000","last_became_peered":"2024-01-19T04:18:02.934941+0000","last_unstale":"2024-01-19T04:18:03.930112+0000","last_undegraded":"2024-01-19T04:18:03.930112+0000","last_fullsized":"2024-01-19T04:18:03.930112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:32:20.281699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"74'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199713+0000","last_change":"2024-01-19T04:18:01.927206+0000","last_active":"2024-01-19T04:18:04.199713+0000","last_peered":"2024-01-19T04:18:04.199713+0000","last_clean":"2024-01-19T04:18:04.199713+0000","last_became_active":"2024-01-19T04:18:01.926934+0000","last_became_peered":"2024-01-19T04:18:01.926934+0000","last_unstale":"2024-01-19T04:18:04.199713+0000","last_undegraded":"2024-01-19T04:18:04.199713+0000","last_fullsized":"2024-01-19T04:18:04.199713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:55:13.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915848+0000","last_change":"2024-01-19T04:17:49.862638+0000","last_active":"2024-01-19T04:18:02.915848+0000","last_peered":"2024-01-19T04:18:02.915848+0000","last_clean":"2024-01-19T04:18:02.915848+0000","last_became_active":"2024-01-19T04:17:49.862288+0000","last_became_peered":"2024-01-19T04:17:49.862288+0000","last_unstale":"2024-01-19T04:18:02.915848+0000","last_undegraded":"2024-01-19T04:18:02.915848+0000","last_fullsized":"2024-01-19T04:18:02.915848+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913940+0000","last_change":"2024-01-19T04:17:48.828142+0000","last_active":"2024-01-19T04:18:02.913940+0000","last_peered":"2024-01-19T04:18:02.913940+0000","last_clean":"2024-01-19T04:18:02.913940+0000","last_became_active":"2024-01-19T04:17:48.827873+0000","last_became_peered":"2024-01-19T04:17:48.827873+0000","last_unstale":"2024-01-19T04:18:02.913940+0000","last_undegraded":"2024-01-19T04:18:02.913940+0000","last_fullsized":"2024-01-19T04:18:02.913940+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928117+0000","last_change":"2024-01-19T04:18:02.930483+0000","last_active":"2024-01-19T04:18:03.928117+0000","last_peered":"2024-01-19T04:18:03.928117+0000","last_clean":"2024-01-19T04:18:03.928117+0000","last_became_active":"2024-01-19T04:18:02.930228+0000","last_became_peered":"2024-01-19T04:18:02.930228+0000","last_unstale":"2024-01-19T04:18:03.928117+0000","last_undegraded":"2024-01-19T04:18:03.928117+0000","last_fullsized":"2024-01-19T04:18:03.928117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:06:16.796216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.907626+0000","last_change":"2024-01-19T04:18:01.913629+0000","last_active":"2024-01-19T04:18:02.907626+0000","last_peered":"2024-01-19T04:18:02.907626+0000","last_clean":"2024-01-19T04:18:02.907626+0000","last_became_active":"2024-01-19T04:18:01.913363+0000","last_became_peered":"2024-01-19T04:18:01.913363+0000","last_unstale":"2024-01-19T04:18:02.907626+0000","last_undegraded":"2024-01-19T04:18:02.907626+0000","last_fullsized":"2024-01-19T04:18:02.907626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:34.425837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.922617+0000","last_change":"2024-01-19T04:17:49.870592+0000","last_active":"2024-01-19T04:18:02.922617+0000","last_peered":"2024-01-19T04:18:02.922617+0000","last_clean":"2024-01-19T04:18:02.922617+0000","last_became_active":"2024-01-19T04:17:49.868939+0000","last_became_peered":"2024-01-19T04:17:49.868939+0000","last_unstale":"2024-01-19T04:18:02.922617+0000","last_undegraded":"2024-01-19T04:18:02.922617+0000","last_fullsized":"2024-01-19T04:18:02.922617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"70'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913488+0000","last_change":"2024-01-19T04:17:48.825703+0000","last_active":"2024-01-19T04:18:02.913488+0000","last_peered":"2024-01-19T04:18:02.913488+0000","last_clean":"2024-01-19T04:18:02.913488+0000","last_became_active":"2024-01-19T04:17:48.825410+0000","last_became_peered":"2024-01-19T04:17:48.825410+0000","last_unstale":"2024-01-19T04:18:02.913488+0000","last_undegraded":"2024-01-19T04:18:02.913488+0000","last_fullsized":"2024-01-19T04:18:02.913488+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:59.028381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200581+0000","last_change":"2024-01-19T04:18:02.922893+0000","last_active":"2024-01-19T04:18:04.200581+0000","last_peered":"2024-01-19T04:18:04.200581+0000","last_clean":"2024-01-19T04:18:04.200581+0000","last_became_active":"2024-01-19T04:18:02.922514+0000","last_became_peered":"2024-01-19T04:18:02.922514+0000","last_unstale":"2024-01-19T04:18:04.200581+0000","last_undegraded":"2024-01-19T04:18:04.200581+0000","last_fullsized":"2024-01-19T04:18:04.200581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:49:07.769865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916214+0000","last_change":"2024-01-19T04:18:01.929737+0000","last_active":"2024-01-19T04:18:02.916214+0000","last_peered":"2024-01-19T04:18:02.916214+0000","last_clean":"2024-01-19T04:18:02.916214+0000","last_became_active":"2024-01-19T04:18:01.928808+0000","last_became_peered":"2024-01-19T04:18:01.928808+0000","last_unstale":"2024-01-19T04:18:02.916214+0000","last_undegraded":"2024-01-19T04:18:02.916214+0000","last_fullsized":"2024-01-19T04:18:02.916214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:24:52.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909533+0000","last_change":"2024-01-19T04:17:49.859589+0000","last_active":"2024-01-19T04:18:02.909533+0000","last_peered":"2024-01-19T04:18:02.909533+0000","last_clean":"2024-01-19T04:18:02.909533+0000","last_became_active":"2024-01-19T04:17:49.857553+0000","last_became_peered":"2024-01-19T04:17:49.857553+0000","last_unstale":"2024-01-19T04:18:02.909533+0000","last_undegraded":"2024-01-19T04:18:02.909533+0000","last_fullsized":"2024-01-19T04:18:02.909533+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"71'8","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914293+0000","last_change":"2024-01-19T04:17:48.824771+0000","last_active":"2024-01-19T04:18:02.914293+0000","last_peered":"2024-01-19T04:18:02.914293+0000","last_clean":"2024-01-19T04:18:02.914293+0000","last_became_active":"2024-01-19T04:17:48.824480+0000","last_became_peered":"2024-01-19T04:17:48.824480+0000","last_unstale":"2024-01-19T04:18:02.914293+0000","last_undegraded":"2024-01-19T04:18:02.914293+0000","last_fullsized":"2024-01-19T04:18:02.914293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:20.355098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197484+0000","last_change":"2024-01-19T04:18:02.922428+0000","last_active":"2024-01-19T04:18:04.197484+0000","last_peered":"2024-01-19T04:18:04.197484+0000","last_clean":"2024-01-19T04:18:04.197484+0000","last_became_active":"2024-01-19T04:18:02.920551+0000","last_became_peered":"2024-01-19T04:18:02.920551+0000","last_unstale":"2024-01-19T04:18:04.197484+0000","last_undegraded":"2024-01-19T04:18:04.197484+0000","last_fullsized":"2024-01-19T04:18:04.197484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:50:59.579012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197949+0000","last_change":"2024-01-19T04:18:01.924322+0000","last_active":"2024-01-19T04:18:04.197949+0000","last_peered":"2024-01-19T04:18:04.197949+0000","last_clean":"2024-01-19T04:18:04.197949+0000","last_became_active":"2024-01-19T04:18:01.923624+0000","last_became_peered":"2024-01-19T04:18:01.923624+0000","last_unstale":"2024-01-19T04:18:04.197949+0000","last_undegraded":"2024-01-19T04:18:04.197949+0000","last_fullsized":"2024-01-19T04:18:04.197949+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:15:30.969121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914355+0000","last_change":"2024-01-19T04:17:49.857760+0000","last_active":"2024-01-19T04:18:02.914355+0000","last_peered":"2024-01-19T04:18:02.914355+0000","last_clean":"2024-01-19T04:18:02.914355+0000","last_became_active":"2024-01-19T04:17:49.857510+0000","last_became_peered":"2024-01-19T04:17:49.857510+0000","last_unstale":"2024-01-19T04:18:02.914355+0000","last_undegraded":"2024-01-19T04:18:02.914355+0000","last_fullsized":"2024-01-19T04:18:02.914355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"70'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903130+0000","last_change":"2024-01-19T04:17:48.831635+0000","last_active":"2024-01-19T04:18:01.903130+0000","last_peered":"2024-01-19T04:18:01.903130+0000","last_clean":"2024-01-19T04:18:01.903130+0000","last_became_active":"2024-01-19T04:17:48.831278+0000","last_became_peered":"2024-01-19T04:17:48.831278+0000","last_unstale":"2024-01-19T04:18:01.903130+0000","last_undegraded":"2024-01-19T04:18:01.903130+0000","last_fullsized":"2024-01-19T04:18:01.903130+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:54:07.418701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.941039+0000","last_change":"2024-01-19T04:18:02.932713+0000","last_active":"2024-01-19T04:18:02.941039+0000","last_peered":"2024-01-19T04:18:02.941039+0000","last_clean":"2024-01-19T04:18:02.941039+0000","last_became_active":"2024-01-19T04:18:02.932445+0000","last_became_peered":"2024-01-19T04:18:02.932445+0000","last_unstale":"2024-01-19T04:18:02.941039+0000","last_undegraded":"2024-01-19T04:18:02.941039+0000","last_fullsized":"2024-01-19T04:18:02.941039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:41.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"74'8","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.948419+0000","last_change":"2024-01-19T04:18:01.918250+0000","last_active":"2024-01-19T04:18:02.948419+0000","last_peered":"2024-01-19T04:18:02.948419+0000","last_clean":"2024-01-19T04:18:02.948419+0000","last_became_active":"2024-01-19T04:18:01.917924+0000","last_became_peered":"2024-01-19T04:18:01.917924+0000","last_unstale":"2024-01-19T04:18:02.948419+0000","last_undegraded":"2024-01-19T04:18:02.948419+0000","last_fullsized":"2024-01-19T04:18:02.948419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:37.085285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911718+0000","last_change":"2024-01-19T04:17:49.869971+0000","last_active":"2024-01-19T04:18:02.911718+0000","last_peered":"2024-01-19T04:18:02.911718+0000","last_clean":"2024-01-19T04:18:02.911718+0000","last_became_active":"2024-01-19T04:17:49.869655+0000","last_became_peered":"2024-01-19T04:17:49.869655+0000","last_unstale":"2024-01-19T04:18:02.911718+0000","last_undegraded":"2024-01-19T04:18:02.911718+0000","last_fullsized":"2024-01-19T04:18:02.911718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:01:02.137182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.913711+0000","last_change":"2024-01-19T04:17:48.821948+0000","last_active":"2024-01-19T04:18:01.913711+0000","last_peered":"2024-01-19T04:18:01.913711+0000","last_clean":"2024-01-19T04:18:01.913711+0000","last_became_active":"2024-01-19T04:17:48.821641+0000","last_became_peered":"2024-01-19T04:17:48.821641+0000","last_unstale":"2024-01-19T04:18:01.913711+0000","last_undegraded":"2024-01-19T04:18:01.913711+0000","last_fullsized":"2024-01-19T04:18:01.913711+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:08:27.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.935700+0000","last_change":"2024-01-19T04:18:02.924344+0000","last_active":"2024-01-19T04:18:02.935700+0000","last_peered":"2024-01-19T04:18:02.935700+0000","last_clean":"2024-01-19T04:18:02.935700+0000","last_became_active":"2024-01-19T04:18:02.924124+0000","last_became_peered":"2024-01-19T04:18:02.924124+0000","last_unstale":"2024-01-19T04:18:02.935700+0000","last_undegraded":"2024-01-19T04:18:02.935700+0000","last_fullsized":"2024-01-19T04:18:02.935700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:33.530016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.944692+0000","last_change":"2024-01-19T04:18:01.927089+0000","last_active":"2024-01-19T04:18:02.944692+0000","last_peered":"2024-01-19T04:18:02.944692+0000","last_clean":"2024-01-19T04:18:02.944692+0000","last_became_active":"2024-01-19T04:18:01.925011+0000","last_became_peered":"2024-01-19T04:18:01.925011+0000","last_unstale":"2024-01-19T04:18:02.944692+0000","last_undegraded":"2024-01-19T04:18:02.944692+0000","last_fullsized":"2024-01-19T04:18:02.944692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:40.024706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902743+0000","last_change":"2024-01-19T04:17:49.859758+0000","last_active":"2024-01-19T04:18:01.902743+0000","last_peered":"2024-01-19T04:18:01.902743+0000","last_clean":"2024-01-19T04:18:01.902743+0000","last_became_active":"2024-01-19T04:17:49.859488+0000","last_became_peered":"2024-01-19T04:17:49.859488+0000","last_unstale":"2024-01-19T04:18:01.902743+0000","last_undegraded":"2024-01-19T04:18:01.902743+0000","last_fullsized":"2024-01-19T04:18:01.902743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:45:04.083056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.918361+0000","last_change":"2024-01-19T04:17:48.819963+0000","last_active":"2024-01-19T04:18:02.918361+0000","last_peered":"2024-01-19T04:18:02.918361+0000","last_clean":"2024-01-19T04:18:02.918361+0000","last_became_active":"2024-01-19T04:17:48.819675+0000","last_became_peered":"2024-01-19T04:17:48.819675+0000","last_unstale":"2024-01-19T04:18:02.918361+0000","last_undegraded":"2024-01-19T04:18:02.918361+0000","last_fullsized":"2024-01-19T04:18:02.918361+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:54.388146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947592+0000","last_change":"2024-01-19T04:18:02.936679+0000","last_active":"2024-01-19T04:18:02.947592+0000","last_peered":"2024-01-19T04:18:02.947592+0000","last_clean":"2024-01-19T04:18:02.947592+0000","last_became_active":"2024-01-19T04:18:02.936391+0000","last_became_peered":"2024-01-19T04:18:02.936391+0000","last_unstale":"2024-01-19T04:18:02.947592+0000","last_undegraded":"2024-01-19T04:18:02.947592+0000","last_fullsized":"2024-01-19T04:18:02.947592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:25.722081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916608+0000","last_change":"2024-01-19T04:18:01.931150+0000","last_active":"2024-01-19T04:18:02.916608+0000","last_peered":"2024-01-19T04:18:02.916608+0000","last_clean":"2024-01-19T04:18:02.916608+0000","last_became_active":"2024-01-19T04:18:01.930796+0000","last_became_peered":"2024-01-19T04:18:01.930796+0000","last_unstale":"2024-01-19T04:18:02.916608+0000","last_undegraded":"2024-01-19T04:18:02.916608+0000","last_fullsized":"2024-01-19T04:18:02.916608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:51.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902233+0000","last_change":"2024-01-19T04:17:49.872258+0000","last_active":"2024-01-19T04:18:01.902233+0000","last_peered":"2024-01-19T04:18:01.902233+0000","last_clean":"2024-01-19T04:18:01.902233+0000","last_became_active":"2024-01-19T04:17:49.866662+0000","last_became_peered":"2024-01-19T04:17:49.866662+0000","last_unstale":"2024-01-19T04:18:01.902233+0000","last_undegraded":"2024-01-19T04:18:01.902233+0000","last_fullsized":"2024-01-19T04:18:01.902233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:39.241053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"70'8","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915150+0000","last_change":"2024-01-19T04:17:48.827802+0000","last_active":"2024-01-19T04:18:02.915150+0000","last_peered":"2024-01-19T04:18:02.915150+0000","last_clean":"2024-01-19T04:18:02.915150+0000","last_became_active":"2024-01-19T04:17:48.827509+0000","last_became_peered":"2024-01-19T04:17:48.827509+0000","last_unstale":"2024-01-19T04:18:02.915150+0000","last_undegraded":"2024-01-19T04:18:02.915150+0000","last_fullsized":"2024-01-19T04:18:02.915150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:00.539469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198034+0000","last_change":"2024-01-19T04:18:02.925483+0000","last_active":"2024-01-19T04:18:04.198034+0000","last_peered":"2024-01-19T04:18:04.198034+0000","last_clean":"2024-01-19T04:18:04.198034+0000","last_became_active":"2024-01-19T04:18:02.925197+0000","last_became_peered":"2024-01-19T04:18:02.925197+0000","last_unstale":"2024-01-19T04:18:04.198034+0000","last_undegraded":"2024-01-19T04:18:04.198034+0000","last_fullsized":"2024-01-19T04:18:04.198034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:07.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199587+0000","last_change":"2024-01-19T04:18:01.927046+0000","last_active":"2024-01-19T04:18:04.199587+0000","last_peered":"2024-01-19T04:18:04.199587+0000","last_clean":"2024-01-19T04:18:04.199587+0000","last_became_active":"2024-01-19T04:18:01.925979+0000","last_became_peered":"2024-01-19T04:18:01.925979+0000","last_unstale":"2024-01-19T04:18:04.199587+0000","last_undegraded":"2024-01-19T04:18:04.199587+0000","last_fullsized":"2024-01-19T04:18:04.199587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:03:27.238058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916992+0000","last_change":"2024-01-19T04:17:49.869335+0000","last_active":"2024-01-19T04:18:02.916992+0000","last_peered":"2024-01-19T04:18:02.916992+0000","last_clean":"2024-01-19T04:18:02.916992+0000","last_became_active":"2024-01-19T04:17:49.869084+0000","last_became_peered":"2024-01-19T04:17:49.869084+0000","last_unstale":"2024-01-19T04:18:02.916992+0000","last_undegraded":"2024-01-19T04:18:02.916992+0000","last_fullsized":"2024-01-19T04:18:02.916992+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:48:09.363160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914744+0000","last_change":"2024-01-19T04:17:48.827720+0000","last_active":"2024-01-19T04:18:02.914744+0000","last_peered":"2024-01-19T04:18:02.914744+0000","last_clean":"2024-01-19T04:18:02.914744+0000","last_became_active":"2024-01-19T04:17:48.827302+0000","last_became_peered":"2024-01-19T04:17:48.827302+0000","last_unstale":"2024-01-19T04:18:02.914744+0000","last_undegraded":"2024-01-19T04:18:02.914744+0000","last_fullsized":"2024-01-19T04:18:02.914744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930280+0000","last_change":"2024-01-19T04:18:02.935831+0000","last_active":"2024-01-19T04:18:03.930280+0000","last_peered":"2024-01-19T04:18:03.930280+0000","last_clean":"2024-01-19T04:18:03.930280+0000","last_became_active":"2024-01-19T04:18:02.935320+0000","last_became_peered":"2024-01-19T04:18:02.935320+0000","last_unstale":"2024-01-19T04:18:03.930280+0000","last_undegraded":"2024-01-19T04:18:03.930280+0000","last_fullsized":"2024-01-19T04:18:03.930280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:23.835750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928415+0000","last_change":"2024-01-19T04:18:01.917184+0000","last_active":"2024-01-19T04:18:03.928415+0000","last_peered":"2024-01-19T04:18:03.928415+0000","last_clean":"2024-01-19T04:18:03.928415+0000","last_became_active":"2024-01-19T04:18:01.916891+0000","last_became_peered":"2024-01-19T04:18:01.916891+0000","last_unstale":"2024-01-19T04:18:03.928415+0000","last_undegraded":"2024-01-19T04:18:03.928415+0000","last_fullsized":"2024-01-19T04:18:03.928415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:43:04.920800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914369+0000","last_change":"2024-01-19T04:17:49.864846+0000","last_active":"2024-01-19T04:18:02.914369+0000","last_peered":"2024-01-19T04:18:02.914369+0000","last_clean":"2024-01-19T04:18:02.914369+0000","last_became_active":"2024-01-19T04:17:49.864174+0000","last_became_peered":"2024-01-19T04:17:49.864174+0000","last_unstale":"2024-01-19T04:18:02.914369+0000","last_undegraded":"2024-01-19T04:18:02.914369+0000","last_fullsized":"2024-01-19T04:18:02.914369+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"70'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.923076+0000","last_change":"2024-01-19T04:17:48.825969+0000","last_active":"2024-01-19T04:18:02.923076+0000","last_peered":"2024-01-19T04:18:02.923076+0000","last_clean":"2024-01-19T04:18:02.923076+0000","last_became_active":"2024-01-19T04:17:48.825702+0000","last_became_peered":"2024-01-19T04:17:48.825702+0000","last_unstale":"2024-01-19T04:18:02.923076+0000","last_undegraded":"2024-01-19T04:18:02.923076+0000","last_fullsized":"2024-01-19T04:18:02.923076+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:15.428133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200506+0000","last_change":"2024-01-19T04:18:02.938187+0000","last_active":"2024-01-19T04:18:04.200506+0000","last_peered":"2024-01-19T04:18:04.200506+0000","last_clean":"2024-01-19T04:18:04.200506+0000","last_became_active":"2024-01-19T04:18:02.937836+0000","last_became_peered":"2024-01-19T04:18:02.937836+0000","last_unstale":"2024-01-19T04:18:04.200506+0000","last_undegraded":"2024-01-19T04:18:04.200506+0000","last_fullsized":"2024-01-19T04:18:04.200506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:00:55.557395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200148+0000","last_change":"2024-01-19T04:18:01.920743+0000","last_active":"2024-01-19T04:18:04.200148+0000","last_peered":"2024-01-19T04:18:04.200148+0000","last_clean":"2024-01-19T04:18:04.200148+0000","last_became_active":"2024-01-19T04:18:01.920441+0000","last_became_peered":"2024-01-19T04:18:01.920441+0000","last_unstale":"2024-01-19T04:18:04.200148+0000","last_undegraded":"2024-01-19T04:18:04.200148+0000","last_fullsized":"2024-01-19T04:18:04.200148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:06.783775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909591+0000","last_change":"2024-01-19T04:17:49.858592+0000","last_active":"2024-01-19T04:18:02.909591+0000","last_peered":"2024-01-19T04:18:02.909591+0000","last_clean":"2024-01-19T04:18:02.909591+0000","last_became_active":"2024-01-19T04:17:49.857116+0000","last_became_peered":"2024-01-19T04:17:49.857116+0000","last_unstale":"2024-01-19T04:18:02.909591+0000","last_undegraded":"2024-01-19T04:18:02.909591+0000","last_fullsized":"2024-01-19T04:18:02.909591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.922806+0000","last_change":"2024-01-19T04:17:48.830964+0000","last_active":"2024-01-19T04:18:02.922806+0000","last_peered":"2024-01-19T04:18:02.922806+0000","last_clean":"2024-01-19T04:18:02.922806+0000","last_became_active":"2024-01-19T04:17:48.830676+0000","last_became_peered":"2024-01-19T04:17:48.830676+0000","last_unstale":"2024-01-19T04:18:02.922806+0000","last_undegraded":"2024-01-19T04:18:02.922806+0000","last_fullsized":"2024-01-19T04:18:02.922806+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:11.625353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.937294+0000","last_change":"2024-01-19T04:18:02.926855+0000","last_active":"2024-01-19T04:18:02.937294+0000","last_peered":"2024-01-19T04:18:02.937294+0000","last_clean":"2024-01-19T04:18:02.937294+0000","last_became_active":"2024-01-19T04:18:02.926589+0000","last_became_peered":"2024-01-19T04:18:02.926589+0000","last_unstale":"2024-01-19T04:18:02.937294+0000","last_undegraded":"2024-01-19T04:18:02.937294+0000","last_fullsized":"2024-01-19T04:18:02.937294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:54.074135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198080+0000","last_change":"2024-01-19T04:18:01.928737+0000","last_active":"2024-01-19T04:18:04.198080+0000","last_peered":"2024-01-19T04:18:04.198080+0000","last_clean":"2024-01-19T04:18:04.198080+0000","last_became_active":"2024-01-19T04:18:01.928470+0000","last_became_peered":"2024-01-19T04:18:01.928470+0000","last_unstale":"2024-01-19T04:18:04.198080+0000","last_undegraded":"2024-01-19T04:18:04.198080+0000","last_fullsized":"2024-01-19T04:18:04.198080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:53.847378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.920866+0000","last_change":"2024-01-19T04:17:49.858880+0000","last_active":"2024-01-19T04:18:01.920866+0000","last_peered":"2024-01-19T04:18:01.920866+0000","last_clean":"2024-01-19T04:18:01.920866+0000","last_became_active":"2024-01-19T04:17:49.856868+0000","last_became_peered":"2024-01-19T04:17:49.856868+0000","last_unstale":"2024-01-19T04:18:01.920866+0000","last_undegraded":"2024-01-19T04:18:01.920866+0000","last_fullsized":"2024-01-19T04:18:01.920866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:54.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"70'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.909166+0000","last_change":"2024-01-19T04:17:48.827089+0000","last_active":"2024-01-19T04:18:01.909166+0000","last_peered":"2024-01-19T04:18:01.909166+0000","last_clean":"2024-01-19T04:18:01.909166+0000","last_became_active":"2024-01-19T04:17:48.826683+0000","last_became_peered":"2024-01-19T04:17:48.826683+0000","last_unstale":"2024-01-19T04:18:01.909166+0000","last_undegraded":"2024-01-19T04:18:01.909166+0000","last_fullsized":"2024-01-19T04:18:01.909166+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:57:37.292333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197631+0000","last_change":"2024-01-19T04:18:02.925453+0000","last_active":"2024-01-19T04:18:04.197631+0000","last_peered":"2024-01-19T04:18:04.197631+0000","last_clean":"2024-01-19T04:18:04.197631+0000","last_became_active":"2024-01-19T04:18:02.925115+0000","last_became_peered":"2024-01-19T04:18:02.925115+0000","last_unstale":"2024-01-19T04:18:04.197631+0000","last_undegraded":"2024-01-19T04:18:04.197631+0000","last_fullsized":"2024-01-19T04:18:04.197631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:23.408554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927309+0000","last_change":"2024-01-19T04:18:01.924668+0000","last_active":"2024-01-19T04:18:03.927309+0000","last_peered":"2024-01-19T04:18:03.927309+0000","last_clean":"2024-01-19T04:18:03.927309+0000","last_became_active":"2024-01-19T04:18:01.924406+0000","last_became_peered":"2024-01-19T04:18:01.924406+0000","last_unstale":"2024-01-19T04:18:03.927309+0000","last_undegraded":"2024-01-19T04:18:03.927309+0000","last_fullsized":"2024-01-19T04:18:03.927309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:12.882007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915958+0000","last_change":"2024-01-19T04:17:49.863061+0000","last_active":"2024-01-19T04:18:02.915958+0000","last_peered":"2024-01-19T04:18:02.915958+0000","last_clean":"2024-01-19T04:18:02.915958+0000","last_became_active":"2024-01-19T04:17:49.862748+0000","last_became_peered":"2024-01-19T04:17:49.862748+0000","last_unstale":"2024-01-19T04:18:02.915958+0000","last_undegraded":"2024-01-19T04:18:02.915958+0000","last_fullsized":"2024-01-19T04:18:02.915958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.920956+0000","last_change":"2024-01-19T04:17:48.831189+0000","last_active":"2024-01-19T04:18:01.920956+0000","last_peered":"2024-01-19T04:18:01.920956+0000","last_clean":"2024-01-19T04:18:01.920956+0000","last_became_active":"2024-01-19T04:17:48.830902+0000","last_became_peered":"2024-01-19T04:17:48.830902+0000","last_unstale":"2024-01-19T04:18:01.920956+0000","last_undegraded":"2024-01-19T04:18:01.920956+0000","last_fullsized":"2024-01-19T04:18:01.920956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:00.718052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934160+0000","last_change":"2024-01-19T04:18:02.926417+0000","last_active":"2024-01-19T04:18:02.934160+0000","last_peered":"2024-01-19T04:18:02.934160+0000","last_clean":"2024-01-19T04:18:02.934160+0000","last_became_active":"2024-01-19T04:18:02.926144+0000","last_became_peered":"2024-01-19T04:18:02.926144+0000","last_unstale":"2024-01-19T04:18:02.934160+0000","last_undegraded":"2024-01-19T04:18:02.934160+0000","last_fullsized":"2024-01-19T04:18:02.934160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:09.328080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927919+0000","last_change":"2024-01-19T04:18:01.927501+0000","last_active":"2024-01-19T04:18:03.927919+0000","last_peered":"2024-01-19T04:18:03.927919+0000","last_clean":"2024-01-19T04:18:03.927919+0000","last_became_active":"2024-01-19T04:18:01.927208+0000","last_became_peered":"2024-01-19T04:18:01.927208+0000","last_unstale":"2024-01-19T04:18:03.927919+0000","last_undegraded":"2024-01-19T04:18:03.927919+0000","last_fullsized":"2024-01-19T04:18:03.927919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:34.641792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.916012+0000","last_change":"2024-01-19T04:17:49.868600+0000","last_active":"2024-01-19T04:18:01.916012+0000","last_peered":"2024-01-19T04:18:01.916012+0000","last_clean":"2024-01-19T04:18:01.916012+0000","last_became_active":"2024-01-19T04:17:49.868291+0000","last_became_peered":"2024-01-19T04:17:49.868291+0000","last_unstale":"2024-01-19T04:18:01.916012+0000","last_undegraded":"2024-01-19T04:18:01.916012+0000","last_fullsized":"2024-01-19T04:18:01.916012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:42:11.307285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.916674+0000","last_change":"2024-01-19T04:17:48.825930+0000","last_active":"2024-01-19T04:18:01.916674+0000","last_peered":"2024-01-19T04:18:01.916674+0000","last_clean":"2024-01-19T04:18:01.916674+0000","last_became_active":"2024-01-19T04:17:48.825661+0000","last_became_peered":"2024-01-19T04:17:48.825661+0000","last_unstale":"2024-01-19T04:18:01.916674+0000","last_undegraded":"2024-01-19T04:18:01.916674+0000","last_fullsized":"2024-01-19T04:18:01.916674+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:24.692647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.944770+0000","last_change":"2024-01-19T04:18:02.943217+0000","last_active":"2024-01-19T04:18:02.944770+0000","last_peered":"2024-01-19T04:18:02.944770+0000","last_clean":"2024-01-19T04:18:02.944770+0000","last_became_active":"2024-01-19T04:18:02.942211+0000","last_became_peered":"2024-01-19T04:18:02.942211+0000","last_unstale":"2024-01-19T04:18:02.944770+0000","last_undegraded":"2024-01-19T04:18:02.944770+0000","last_fullsized":"2024-01-19T04:18:02.944770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:42.528428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198351+0000","last_change":"2024-01-19T04:18:01.918277+0000","last_active":"2024-01-19T04:18:04.198351+0000","last_peered":"2024-01-19T04:18:04.198351+0000","last_clean":"2024-01-19T04:18:04.198351+0000","last_became_active":"2024-01-19T04:18:01.918001+0000","last_became_peered":"2024-01-19T04:18:01.918001+0000","last_unstale":"2024-01-19T04:18:04.198351+0000","last_undegraded":"2024-01-19T04:18:04.198351+0000","last_fullsized":"2024-01-19T04:18:04.198351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:01:14.225799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.918275+0000","last_change":"2024-01-19T04:17:49.869790+0000","last_active":"2024-01-19T04:18:02.918275+0000","last_peered":"2024-01-19T04:18:02.918275+0000","last_clean":"2024-01-19T04:18:02.918275+0000","last_became_active":"2024-01-19T04:17:49.869425+0000","last_became_peered":"2024-01-19T04:17:49.869425+0000","last_unstale":"2024-01-19T04:18:02.918275+0000","last_undegraded":"2024-01-19T04:18:02.918275+0000","last_fullsized":"2024-01-19T04:18:02.918275+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.917018+0000","last_change":"2024-01-19T04:17:48.818976+0000","last_active":"2024-01-19T04:18:01.917018+0000","last_peered":"2024-01-19T04:18:01.917018+0000","last_clean":"2024-01-19T04:18:01.917018+0000","last_became_active":"2024-01-19T04:17:48.818650+0000","last_became_peered":"2024-01-19T04:17:48.818650+0000","last_unstale":"2024-01-19T04:18:01.917018+0000","last_undegraded":"2024-01-19T04:18:01.917018+0000","last_fullsized":"2024-01-19T04:18:01.917018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:06:19.196961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.946870+0000","last_change":"2024-01-19T04:18:02.923838+0000","last_active":"2024-01-19T04:18:02.946870+0000","last_peered":"2024-01-19T04:18:02.946870+0000","last_clean":"2024-01-19T04:18:02.946870+0000","last_became_active":"2024-01-19T04:18:02.923366+0000","last_became_peered":"2024-01-19T04:18:02.923366+0000","last_unstale":"2024-01-19T04:18:02.946870+0000","last_undegraded":"2024-01-19T04:18:02.946870+0000","last_fullsized":"2024-01-19T04:18:02.946870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:32.839187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928129+0000","last_change":"2024-01-19T04:18:01.931313+0000","last_active":"2024-01-19T04:18:03.928129+0000","last_peered":"2024-01-19T04:18:03.928129+0000","last_clean":"2024-01-19T04:18:03.928129+0000","last_became_active":"2024-01-19T04:18:01.926362+0000","last_became_peered":"2024-01-19T04:18:01.926362+0000","last_unstale":"2024-01-19T04:18:03.928129+0000","last_undegraded":"2024-01-19T04:18:03.928129+0000","last_fullsized":"2024-01-19T04:18:03.928129+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:50:58.573385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909895+0000","last_change":"2024-01-19T04:17:49.863529+0000","last_active":"2024-01-19T04:18:02.909895+0000","last_peered":"2024-01-19T04:18:02.909895+0000","last_clean":"2024-01-19T04:18:02.909895+0000","last_became_active":"2024-01-19T04:17:49.863271+0000","last_became_peered":"2024-01-19T04:17:49.863271+0000","last_unstale":"2024-01-19T04:18:02.909895+0000","last_undegraded":"2024-01-19T04:18:02.909895+0000","last_fullsized":"2024-01-19T04:18:02.909895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"70'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903389+0000","last_change":"2024-01-19T04:17:48.833146+0000","last_active":"2024-01-19T04:18:01.903389+0000","last_peered":"2024-01-19T04:18:01.903389+0000","last_clean":"2024-01-19T04:18:01.903389+0000","last_became_active":"2024-01-19T04:17:48.832826+0000","last_became_peered":"2024-01-19T04:17:48.832826+0000","last_unstale":"2024-01-19T04:18:01.903389+0000","last_undegraded":"2024-01-19T04:18:01.903389+0000","last_fullsized":"2024-01-19T04:18:01.903389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:42:10.304801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199502+0000","last_change":"2024-01-19T04:18:02.928155+0000","last_active":"2024-01-19T04:18:04.199502+0000","last_peered":"2024-01-19T04:18:04.199502+0000","last_clean":"2024-01-19T04:18:04.199502+0000","last_became_active":"2024-01-19T04:18:02.927913+0000","last_became_peered":"2024-01-19T04:18:02.927913+0000","last_unstale":"2024-01-19T04:18:04.199502+0000","last_undegraded":"2024-01-19T04:18:04.199502+0000","last_fullsized":"2024-01-19T04:18:04.199502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:49:07.769865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199327+0000","last_change":"2024-01-19T04:18:01.928786+0000","last_active":"2024-01-19T04:18:04.199327+0000","last_peered":"2024-01-19T04:18:04.199327+0000","last_clean":"2024-01-19T04:18:04.199327+0000","last_became_active":"2024-01-19T04:18:01.927607+0000","last_became_peered":"2024-01-19T04:18:01.927607+0000","last_unstale":"2024-01-19T04:18:04.199327+0000","last_undegraded":"2024-01-19T04:18:04.199327+0000","last_fullsized":"2024-01-19T04:18:04.199327+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:11.605030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917248+0000","last_change":"2024-01-19T04:17:49.868872+0000","last_active":"2024-01-19T04:18:02.917248+0000","last_peered":"2024-01-19T04:18:02.917248+0000","last_clean":"2024-01-19T04:18:02.917248+0000","last_became_active":"2024-01-19T04:17:49.867227+0000","last_became_peered":"2024-01-19T04:17:49.867227+0000","last_unstale":"2024-01-19T04:18:02.917248+0000","last_undegraded":"2024-01-19T04:18:02.917248+0000","last_fullsized":"2024-01-19T04:18:02.917248+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:41.758761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"71'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903668+0000","last_change":"2024-01-19T04:17:48.832316+0000","last_active":"2024-01-19T04:18:01.903668+0000","last_peered":"2024-01-19T04:18:01.903668+0000","last_clean":"2024-01-19T04:18:01.903668+0000","last_became_active":"2024-01-19T04:17:48.831448+0000","last_became_peered":"2024-01-19T04:17:48.831448+0000","last_unstale":"2024-01-19T04:18:01.903668+0000","last_undegraded":"2024-01-19T04:18:01.903668+0000","last_fullsized":"2024-01-19T04:18:01.903668+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:13.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928239+0000","last_change":"2024-01-19T04:18:02.934481+0000","last_active":"2024-01-19T04:18:03.928239+0000","last_peered":"2024-01-19T04:18:03.928239+0000","last_clean":"2024-01-19T04:18:03.928239+0000","last_became_active":"2024-01-19T04:18:02.933720+0000","last_became_peered":"2024-01-19T04:18:02.933720+0000","last_unstale":"2024-01-19T04:18:03.928239+0000","last_undegraded":"2024-01-19T04:18:03.928239+0000","last_fullsized":"2024-01-19T04:18:03.928239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:09:41.427578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198784+0000","last_change":"2024-01-19T04:18:01.925256+0000","last_active":"2024-01-19T04:18:04.198784+0000","last_peered":"2024-01-19T04:18:04.198784+0000","last_clean":"2024-01-19T04:18:04.198784+0000","last_became_active":"2024-01-19T04:18:01.924788+0000","last_became_peered":"2024-01-19T04:18:01.924788+0000","last_unstale":"2024-01-19T04:18:04.198784+0000","last_undegraded":"2024-01-19T04:18:04.198784+0000","last_fullsized":"2024-01-19T04:18:04.198784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:48:21.451777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913504+0000","last_change":"2024-01-19T04:17:49.873308+0000","last_active":"2024-01-19T04:18:02.913504+0000","last_peered":"2024-01-19T04:18:02.913504+0000","last_clean":"2024-01-19T04:18:02.913504+0000","last_became_active":"2024-01-19T04:17:49.872896+0000","last_became_peered":"2024-01-19T04:17:49.872896+0000","last_unstale":"2024-01-19T04:18:02.913504+0000","last_undegraded":"2024-01-19T04:18:02.913504+0000","last_fullsized":"2024-01-19T04:18:02.913504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:44.021386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913609+0000","last_change":"2024-01-19T04:17:48.826005+0000","last_active":"2024-01-19T04:18:02.913609+0000","last_peered":"2024-01-19T04:18:02.913609+0000","last_clean":"2024-01-19T04:18:02.913609+0000","last_became_active":"2024-01-19T04:17:48.825576+0000","last_became_peered":"2024-01-19T04:17:48.825576+0000","last_unstale":"2024-01-19T04:18:02.913609+0000","last_undegraded":"2024-01-19T04:18:02.913609+0000","last_fullsized":"2024-01-19T04:18:02.913609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:39.977407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947464+0000","last_change":"2024-01-19T04:18:02.933870+0000","last_active":"2024-01-19T04:18:02.947464+0000","last_peered":"2024-01-19T04:18:02.947464+0000","last_clean":"2024-01-19T04:18:02.947464+0000","last_became_active":"2024-01-19T04:18:02.933602+0000","last_became_peered":"2024-01-19T04:18:02.933602+0000","last_unstale":"2024-01-19T04:18:02.947464+0000","last_undegraded":"2024-01-19T04:18:02.947464+0000","last_fullsized":"2024-01-19T04:18:02.947464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:22.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928649+0000","last_change":"2024-01-19T04:18:01.934770+0000","last_active":"2024-01-19T04:18:03.928649+0000","last_peered":"2024-01-19T04:18:03.928649+0000","last_clean":"2024-01-19T04:18:03.928649+0000","last_became_active":"2024-01-19T04:18:01.934480+0000","last_became_peered":"2024-01-19T04:18:01.934480+0000","last_unstale":"2024-01-19T04:18:03.928649+0000","last_undegraded":"2024-01-19T04:18:03.928649+0000","last_fullsized":"2024-01-19T04:18:03.928649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.402927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909616+0000","last_change":"2024-01-19T04:17:49.853797+0000","last_active":"2024-01-19T04:18:02.909616+0000","last_peered":"2024-01-19T04:18:02.909616+0000","last_clean":"2024-01-19T04:18:02.909616+0000","last_became_active":"2024-01-19T04:17:49.853513+0000","last_became_peered":"2024-01-19T04:17:49.853513+0000","last_unstale":"2024-01-19T04:18:02.909616+0000","last_undegraded":"2024-01-19T04:18:02.909616+0000","last_fullsized":"2024-01-19T04:18:02.909616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913590+0000","last_change":"2024-01-19T04:17:48.824215+0000","last_active":"2024-01-19T04:18:02.913590+0000","last_peered":"2024-01-19T04:18:02.913590+0000","last_clean":"2024-01-19T04:18:02.913590+0000","last_became_active":"2024-01-19T04:17:48.823939+0000","last_became_peered":"2024-01-19T04:17:48.823939+0000","last_unstale":"2024-01-19T04:18:02.913590+0000","last_undegraded":"2024-01-19T04:18:02.913590+0000","last_fullsized":"2024-01-19T04:18:02.913590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.927076+0000","last_change":"2024-01-19T04:18:02.920688+0000","last_active":"2024-01-19T04:18:02.927076+0000","last_peered":"2024-01-19T04:18:02.927076+0000","last_clean":"2024-01-19T04:18:02.927076+0000","last_became_active":"2024-01-19T04:18:02.919719+0000","last_became_peered":"2024-01-19T04:18:02.919719+0000","last_unstale":"2024-01-19T04:18:02.927076+0000","last_undegraded":"2024-01-19T04:18:02.927076+0000","last_fullsized":"2024-01-19T04:18:02.927076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:45:17.177300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915279+0000","last_change":"2024-01-19T04:18:01.932112+0000","last_active":"2024-01-19T04:18:02.915279+0000","last_peered":"2024-01-19T04:18:02.915279+0000","last_clean":"2024-01-19T04:18:02.915279+0000","last_became_active":"2024-01-19T04:18:01.931852+0000","last_became_peered":"2024-01-19T04:18:01.931852+0000","last_unstale":"2024-01-19T04:18:02.915279+0000","last_undegraded":"2024-01-19T04:18:02.915279+0000","last_fullsized":"2024-01-19T04:18:02.915279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:08:44.795847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917732+0000","last_change":"2024-01-19T04:17:49.871059+0000","last_active":"2024-01-19T04:18:02.917732+0000","last_peered":"2024-01-19T04:18:02.917732+0000","last_clean":"2024-01-19T04:18:02.917732+0000","last_became_active":"2024-01-19T04:17:49.870787+0000","last_became_peered":"2024-01-19T04:17:49.870787+0000","last_unstale":"2024-01-19T04:18:02.917732+0000","last_undegraded":"2024-01-19T04:18:02.917732+0000","last_fullsized":"2024-01-19T04:18:02.917732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921795+0000","last_change":"2024-01-19T04:17:48.829763+0000","last_active":"2024-01-19T04:18:02.921795+0000","last_peered":"2024-01-19T04:18:02.921795+0000","last_clean":"2024-01-19T04:18:02.921795+0000","last_became_active":"2024-01-19T04:17:48.829423+0000","last_became_peered":"2024-01-19T04:17:48.829423+0000","last_unstale":"2024-01-19T04:18:02.921795+0000","last_undegraded":"2024-01-19T04:18:02.921795+0000","last_fullsized":"2024-01-19T04:18:02.921795+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:18.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197718+0000","last_change":"2024-01-19T04:18:02.928494+0000","last_active":"2024-01-19T04:18:04.197718+0000","last_peered":"2024-01-19T04:18:04.197718+0000","last_clean":"2024-01-19T04:18:04.197718+0000","last_became_active":"2024-01-19T04:18:02.927013+0000","last_became_peered":"2024-01-19T04:18:02.927013+0000","last_unstale":"2024-01-19T04:18:04.197718+0000","last_undegraded":"2024-01-19T04:18:04.197718+0000","last_fullsized":"2024-01-19T04:18:04.197718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:10.425113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915840+0000","last_change":"2024-01-19T04:18:01.918315+0000","last_active":"2024-01-19T04:18:02.915840+0000","last_peered":"2024-01-19T04:18:02.915840+0000","last_clean":"2024-01-19T04:18:02.915840+0000","last_became_active":"2024-01-19T04:18:01.918035+0000","last_became_peered":"2024-01-19T04:18:01.918035+0000","last_unstale":"2024-01-19T04:18:02.915840+0000","last_undegraded":"2024-01-19T04:18:02.915840+0000","last_fullsized":"2024-01-19T04:18:02.915840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:22.120110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921565+0000","last_change":"2024-01-19T04:17:49.853592+0000","last_active":"2024-01-19T04:18:02.921565+0000","last_peered":"2024-01-19T04:18:02.921565+0000","last_clean":"2024-01-19T04:18:02.921565+0000","last_became_active":"2024-01-19T04:17:49.853258+0000","last_became_peered":"2024-01-19T04:17:49.853258+0000","last_unstale":"2024-01-19T04:18:02.921565+0000","last_undegraded":"2024-01-19T04:18:02.921565+0000","last_fullsized":"2024-01-19T04:18:02.921565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908765+0000","last_change":"2024-01-19T04:17:48.818290+0000","last_active":"2024-01-19T04:18:02.908765+0000","last_peered":"2024-01-19T04:18:02.908765+0000","last_clean":"2024-01-19T04:18:02.908765+0000","last_became_active":"2024-01-19T04:17:48.816299+0000","last_became_peered":"2024-01-19T04:17:48.816299+0000","last_unstale":"2024-01-19T04:18:02.908765+0000","last_undegraded":"2024-01-19T04:18:02.908765+0000","last_fullsized":"2024-01-19T04:18:02.908765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.940375+0000","last_change":"2024-01-19T04:18:02.930110+0000","last_active":"2024-01-19T04:18:02.940375+0000","last_peered":"2024-01-19T04:18:02.940375+0000","last_clean":"2024-01-19T04:18:02.940375+0000","last_became_active":"2024-01-19T04:18:02.929615+0000","last_became_peered":"2024-01-19T04:18:02.929615+0000","last_unstale":"2024-01-19T04:18:02.940375+0000","last_undegraded":"2024-01-19T04:18:02.940375+0000","last_fullsized":"2024-01-19T04:18:02.940375+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:27.234314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927738+0000","last_change":"2024-01-19T04:18:01.929019+0000","last_active":"2024-01-19T04:18:03.927738+0000","last_peered":"2024-01-19T04:18:03.927738+0000","last_clean":"2024-01-19T04:18:03.927738+0000","last_became_active":"2024-01-19T04:18:01.928692+0000","last_became_peered":"2024-01-19T04:18:01.928692+0000","last_unstale":"2024-01-19T04:18:03.927738+0000","last_undegraded":"2024-01-19T04:18:03.927738+0000","last_fullsized":"2024-01-19T04:18:03.927738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:30.941043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911113+0000","last_change":"2024-01-19T04:17:49.877548+0000","last_active":"2024-01-19T04:18:02.911113+0000","last_peered":"2024-01-19T04:18:02.911113+0000","last_clean":"2024-01-19T04:18:02.911113+0000","last_became_active":"2024-01-19T04:17:49.877156+0000","last_became_peered":"2024-01-19T04:17:49.877156+0000","last_unstale":"2024-01-19T04:18:02.911113+0000","last_undegraded":"2024-01-19T04:18:02.911113+0000","last_fullsized":"2024-01-19T04:18:02.911113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911746+0000","last_change":"2024-01-19T04:17:48.826712+0000","last_active":"2024-01-19T04:18:02.911746+0000","last_peered":"2024-01-19T04:18:02.911746+0000","last_clean":"2024-01-19T04:18:02.911746+0000","last_became_active":"2024-01-19T04:17:48.826457+0000","last_became_peered":"2024-01-19T04:17:48.826457+0000","last_unstale":"2024-01-19T04:18:02.911746+0000","last_undegraded":"2024-01-19T04:18:02.911746+0000","last_fullsized":"2024-01-19T04:18:02.911746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:55.231352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198028+0000","last_change":"2024-01-19T04:18:02.921273+0000","last_active":"2024-01-19T04:18:04.198028+0000","last_peered":"2024-01-19T04:18:04.198028+0000","last_clean":"2024-01-19T04:18:04.198028+0000","last_became_active":"2024-01-19T04:18:02.917630+0000","last_became_peered":"2024-01-19T04:18:02.917630+0000","last_unstale":"2024-01-19T04:18:04.198028+0000","last_undegraded":"2024-01-19T04:18:04.198028+0000","last_fullsized":"2024-01-19T04:18:04.198028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:43:05.926427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197935+0000","last_change":"2024-01-19T04:18:01.931340+0000","last_active":"2024-01-19T04:18:04.197935+0000","last_peered":"2024-01-19T04:18:04.197935+0000","last_clean":"2024-01-19T04:18:04.197935+0000","last_became_active":"2024-01-19T04:18:01.931097+0000","last_became_peered":"2024-01-19T04:18:01.931097+0000","last_unstale":"2024-01-19T04:18:04.197935+0000","last_undegraded":"2024-01-19T04:18:04.197935+0000","last_fullsized":"2024-01-19T04:18:04.197935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:06.783775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911503+0000","last_change":"2024-01-19T04:17:49.862665+0000","last_active":"2024-01-19T04:18:02.911503+0000","last_peered":"2024-01-19T04:18:02.911503+0000","last_clean":"2024-01-19T04:18:02.911503+0000","last_became_active":"2024-01-19T04:17:49.862396+0000","last_became_peered":"2024-01-19T04:17:49.862396+0000","last_unstale":"2024-01-19T04:18:02.911503+0000","last_undegraded":"2024-01-19T04:18:02.911503+0000","last_fullsized":"2024-01-19T04:18:02.911503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908239+0000","last_change":"2024-01-19T04:17:48.826398+0000","last_active":"2024-01-19T04:18:02.908239+0000","last_peered":"2024-01-19T04:18:02.908239+0000","last_clean":"2024-01-19T04:18:02.908239+0000","last_became_active":"2024-01-19T04:17:48.824417+0000","last_became_peered":"2024-01-19T04:17:48.824417+0000","last_unstale":"2024-01-19T04:18:02.908239+0000","last_undegraded":"2024-01-19T04:18:02.908239+0000","last_fullsized":"2024-01-19T04:18:02.908239+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.942337+0000","last_change":"2024-01-19T04:18:02.939162+0000","last_active":"2024-01-19T04:18:02.942337+0000","last_peered":"2024-01-19T04:18:02.942337+0000","last_clean":"2024-01-19T04:18:02.942337+0000","last_became_active":"2024-01-19T04:18:02.938377+0000","last_became_peered":"2024-01-19T04:18:02.938377+0000","last_unstale":"2024-01-19T04:18:02.942337+0000","last_undegraded":"2024-01-19T04:18:02.942337+0000","last_fullsized":"2024-01-19T04:18:02.942337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:12:01.215395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930147+0000","last_change":"2024-01-19T04:18:01.928794+0000","last_active":"2024-01-19T04:18:03.930147+0000","last_peered":"2024-01-19T04:18:03.930147+0000","last_clean":"2024-01-19T04:18:03.930147+0000","last_became_active":"2024-01-19T04:18:01.928502+0000","last_became_peered":"2024-01-19T04:18:01.928502+0000","last_unstale":"2024-01-19T04:18:03.930147+0000","last_undegraded":"2024-01-19T04:18:03.930147+0000","last_fullsized":"2024-01-19T04:18:03.930147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:12.882007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902607+0000","last_change":"2024-01-19T04:17:49.870926+0000","last_active":"2024-01-19T04:18:01.902607+0000","last_peered":"2024-01-19T04:18:01.902607+0000","last_clean":"2024-01-19T04:18:01.902607+0000","last_became_active":"2024-01-19T04:17:49.870647+0000","last_became_peered":"2024-01-19T04:17:49.870647+0000","last_unstale":"2024-01-19T04:18:01.902607+0000","last_undegraded":"2024-01-19T04:18:01.902607+0000","last_fullsized":"2024-01-19T04:18:01.902607+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:01.549284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917634+0000","last_change":"2024-01-19T04:17:48.826402+0000","last_active":"2024-01-19T04:18:02.917634+0000","last_peered":"2024-01-19T04:18:02.917634+0000","last_clean":"2024-01-19T04:18:02.917634+0000","last_became_active":"2024-01-19T04:17:48.826139+0000","last_became_peered":"2024-01-19T04:17:48.826139+0000","last_unstale":"2024-01-19T04:18:02.917634+0000","last_undegraded":"2024-01-19T04:18:02.917634+0000","last_fullsized":"2024-01-19T04:18:02.917634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:15.428133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911212+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:18:02.911212+0000","last_peered":"2024-01-19T04:18:02.911212+0000","last_clean":"2024-01-19T04:18:02.911212+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:18:02.911212+0000","last_undegraded":"2024-01-19T04:18:02.911212+0000","last_fullsized":"2024-01-19T04:18:02.911212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476778,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":992299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.036,"15min":1.036},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":1.228,"15min":1.228},"last":1.3340000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.626}]},{"osd":2,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84699999999999998,"5min":1.661,"15min":1.661},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81399999999999995,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.274}]},{"osd":3,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.78000000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.23},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.86699999999999999,"5min":1.49,"15min":1.49},"last":1.0069999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.133},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.746},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.51600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":1.514,"15min":1.514},"last":1.1990000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.65300000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0069999999999999,"5min":1.391,"15min":1.391},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":1.359,"15min":1.359},"last":1.161}]}]},{"osd":6,"up_from":16,"seq":68719476778,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":403095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.498},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66300000000000003,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.754}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476777,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":404948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.012}]},{"osd":1,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.98199999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96399999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83199999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.014,"15min":1.014},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67100000000000004,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.624,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80800000000000005,"5min":1.107,"15min":1.107},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94899999999999995,"5min":1.246,"15min":1.246},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.86599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.708,"15min":1.708},"last":0.71699999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476779,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":403485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":0.997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84999999999999998,"5min":1.25,"15min":1.25},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.147,"15min":1.147},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97699999999999998,"5min":1.175,"15min":1.175},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0469999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":1.224,"15min":1.224},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0700000000000001,"5min":1.381,"15min":1.381},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.119,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.753}]},{"osd":7,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.139,"15min":1.139},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1830000000000001,"5min":1.266,"15min":1.266},"last":0.88100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":395208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64000000000000001,"5min":0.879,"15min":0.879},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.57299999999999995},"min":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81599999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71599999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3480000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.135,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.98499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2789999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2350000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.085,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.085}]}]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":394786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.41699999999999998},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":1.964,"15min":1.964},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55800000000000005,"15min":0.58599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64900000000000002,"5min":2.827,"15min":2.827},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56200000000000006,"5min":2.343,"15min":2.343},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":1.665,"15min":1.665},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.042,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92900000000000005,"5min":1.198,"15min":1.198},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0089999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0600000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.878,"15min":0.93899999999999995},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.70999999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1499136,"data_stored":985576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.54500000000000004,"15min":0.60999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":2.1030000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.56299999999999994,"15min":0.621},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56899999999999995,"5min":3.129,"15min":3.129},"last":2.548}]},{"osd":2,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.624,"15min":0.68600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66400000000000003,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":1.407},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58499999999999996,"15min":0.64500000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68000000000000005,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":2.7930000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.73699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.63800000000000001,"5min":3.633,"15min":3.633},"last":2.6360000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.64500000000000002,"15min":0.72699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":3.0670000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89000000000000001,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.88300000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":2.7160000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.90100000000000002,"15min":0.98599999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":2.1459999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91900000000000004,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93200000000000005,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":1.488},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":1.032},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94599999999999995,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":2.6779999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.95699999999999996,"15min":1.0600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88700000000000001,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":1.45},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91400000000000003,"15min":0.98999999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":2.7549999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.97899999999999998},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":2.181},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.98599999999999999,"15min":1.0800000000000001},"min":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94399999999999995,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":1.534}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":897024,"data_stored":390066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.52700000000000002,"15min":0.57299999999999995},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1359999999999999,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.373,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.70799999999999996,"15min":0.79500000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.67100000000000004},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.8759999999999999,"5min":5.226,"15min":5.226},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67400000000000004,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.972,"5min":5.319,"15min":5.319},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66100000000000003,"15min":0.72699999999999998},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.1759999999999999,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.432}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88,"15min":0.93799999999999994},"min":{"1min":0.49099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.085,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.51800000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.669,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.629}]},{"osd":6,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9319999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.498},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.93899999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2170000000000001,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3129999999999999,"5min":5.423,"15min":5.423},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.97699999999999998,"15min":1.0609999999999999},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.022,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:18:07.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:18:07.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb41c00640 1 Processor -- start 2024-01-19T04:18:07.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb41c00640 1 -- start start 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb41c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb3c0a6d30 0x7fcb3c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb41c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcb3c06fda0 0x7fcb3c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb41c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c1533a0 con 0x7fcb3c0c6e20 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb41c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c156380 con 0x7fcb3c0a6d30 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb41c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c14fe40 con 0x7fcb3c06fda0 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcb3c0c6e20 0x7fcb3c152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46920/0 (socket says 172.21.15.32:46920) 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3aa00640 1 -- 172.21.15.32:0/3051171204 learned_addr learned my addr 172.21.15.32:0/3051171204 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3a000640 1 --2- 172.21.15.32:0/3051171204 >> v2:172.21.15.32:3300/0 conn(0x7fcb3c0a6d30 0x7fcb3c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3b400640 1 --2- 172.21.15.32:0/3051171204 >> v2:172.21.15.67:3300/0 conn(0x7fcb3c06fda0 0x7fcb3c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3a000640 1 -- 172.21.15.32:0/3051171204 >> v2:172.21.15.67:3300/0 conn(0x7fcb3c06fda0 msgr2=0x7fcb3c0c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:07.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3a000640 1 --2- 172.21.15.32:0/3051171204 >> v2:172.21.15.67:3300/0 conn(0x7fcb3c06fda0 0x7fcb3c0c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3a000640 1 -- 172.21.15.32:0/3051171204 >> v1:172.21.15.32:6789/0 conn(0x7fcb3c0c6e20 legacy=0x7fcb3c152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb3a000640 1 -- 172.21.15.32:0/3051171204 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c152800 con 0x7fcb3c0a6d30 2024-01-19T04:18:07.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.228+0000 7fcb39600640 1 -- 172.21.15.32:0/3051171204 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931371833 0 0) 0x7fcb2c001120 con 0x7fcb3c0c6e20 2024-01-19T04:18:07.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb3a000640 1 --2- 172.21.15.32:0/3051171204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c0a6d30 0x7fcb3c0c7200 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c06da10 tx=0x7fcb2401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125660d80086dae6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:07.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb39600640 1 -- 172.21.15.32:0/3051171204 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240ab600 con 0x7fcb3c0a6d30 2024-01-19T04:18:07.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb39600640 1 -- 172.21.15.32:0/3051171204 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240a7050 con 0x7fcb3c0a6d30 2024-01-19T04:18:07.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb39600640 1 -- 172.21.15.32:0/3051171204 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240ab980 con 0x7fcb3c0a6d30 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 -- 172.21.15.32:0/3051171204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c0a6d30 msgr2=0x7fcb3c0c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3051171204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c0a6d30 0x7fcb3c0c7200 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c06da10 tx=0x7fcb2401c3d0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 -- 172.21.15.32:0/3051171204 shutdown_connections 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3051171204 >> v2:172.21.15.67:3300/0 conn(0x7fcb3c06fda0 0x7fcb3c0c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3051171204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c0a6d30 0x7fcb3c0c7200 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 -- 172.21.15.32:0/3051171204 >> 172.21.15.32:0/3051171204 conn(0x7fcb3c0a9870 msgr2=0x7fcb3c0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 -- 172.21.15.32:0/3051171204 shutdown_connections 2024-01-19T04:18:07.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.232+0000 7fcb41c00640 1 -- 172.21.15.32:0/3051171204 wait complete. 2024-01-19T04:18:07.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 Processor -- start 2024-01-19T04:18:07.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 -- start start 2024-01-19T04:18:07.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c06fda0 0x7fcb3c1ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb3c0a6d30 0x7fcb3c14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c0c6e20 0x7fcb3c148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c1edd40 con 0x7fcb3c06fda0 2024-01-19T04:18:07.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c14b9c0 con 0x7fcb3c0c6e20 2024-01-19T04:18:07.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c14bca0 con 0x7fcb3c0a6d30 2024-01-19T04:18:07.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c06fda0 0x7fcb3c1ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c06fda0 0x7fcb3c1ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57870/0 (socket says 172.21.15.32:57870) 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 -- 172.21.15.32:0/3443197088 learned_addr learned my addr 172.21.15.32:0/3443197088 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3b400640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c0c6e20 0x7fcb3c148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3a000640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb3c0a6d30 0x7fcb3c14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 -- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb3c0a6d30 msgr2=0x7fcb3c14d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb3c0a6d30 0x7fcb3c14d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 -- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c0c6e20 msgr2=0x7fcb3c148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c0c6e20 0x7fcb3c148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 -- 172.21.15.32:0/3443197088 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24009420 con 0x7fcb3c06fda0 2024-01-19T04:18:07.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb3aa00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c06fda0 0x7fcb3c1ed760 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00c480 tx=0x7fcb2c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:07.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb32a00640 1 -- 172.21.15.32:0/3443197088 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0074e0 con 0x7fcb3c06fda0 2024-01-19T04:18:07.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb32a00640 1 -- 172.21.15.32:0/3443197088 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c007660 con 0x7fcb3c06fda0 2024-01-19T04:18:07.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb32a00640 1 -- 172.21.15.32:0/3443197088 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c004a30 con 0x7fcb3c06fda0 2024-01-19T04:18:07.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c0a8f70 con 0x7fcb3c06fda0 2024-01-19T04:18:07.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.236+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c148a40 con 0x7fcb3c06fda0 2024-01-19T04:18:07.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.240+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c0a9490 con 0x7fcb3c06fda0 2024-01-19T04:18:07.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.240+0000 7fcb32a00640 1 -- 172.21.15.32:0/3443197088 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcb2c004b90 con 0x7fcb3c06fda0 2024-01-19T04:18:07.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.240+0000 7fcb32a00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcb14066530 0x7fcb140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.240+0000 7fcb32a00640 1 -- 172.21.15.32:0/3443197088 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcb2c0834a0 con 0x7fcb3c06fda0 2024-01-19T04:18:07.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.240+0000 7fcb3a000640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcb14066530 0x7fcb140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.240+0000 7fcb3a000640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcb14066530 0x7fcb140689f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ad000 tx=0x7fcb24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:07.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.244+0000 7fcb32a00640 1 -- 172.21.15.32:0/3443197088 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcb3c0a9490 con 0x7fcb3c06fda0 2024-01-19T04:18:07.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.400+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb3c1533a0 con 0x7fcb14066530 2024-01-19T04:18:07.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.412+0000 7fcb32a00640 1 -- 172.21.15.32:0/3443197088 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527679 (secure 0 0 0) 0x7fcb3c1533a0 con 0x7fcb14066530 2024-01-19T04:18:07.426 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:07.431 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:18:07.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcb14066530 msgr2=0x7fcb140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcb14066530 0x7fcb140689f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ad000 tx=0x7fcb24008040 comp rx=0 tx=0).stop 2024-01-19T04:18:07.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c06fda0 msgr2=0x7fcb3c1ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c06fda0 0x7fcb3c1ed760 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00c480 tx=0x7fcb2c00c940 comp rx=0 tx=0).stop 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 shutdown_connections 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fcb14066530 0x7fcb140689f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c0c6e20 0x7fcb3c148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fcb3c0a6d30 0x7fcb3c14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 --2- 172.21.15.32:0/3443197088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3c06fda0 0x7fcb3c1ed760 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 >> 172.21.15.32:0/3443197088 conn(0x7fcb3c0a9870 msgr2=0x7fcb3c14e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 shutdown_connections 2024-01-19T04:18:07.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.420+0000 7fcb41c00640 1 -- 172.21.15.32:0/3443197088 wait complete. 2024-01-19T04:18:07.443 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-01-19T04:18:06.075526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":329,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257784,"kb_used_data":8316,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716936,"statfs":{"total":773094113280,"available":772830142464,"internally_reserved":0,"allocated":8515584,"data_stored":4369463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.181436"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947122+0000","last_change":"2024-01-19T04:18:02.928052+0000","last_active":"2024-01-19T04:18:02.947122+0000","last_peered":"2024-01-19T04:18:02.947122+0000","last_clean":"2024-01-19T04:18:02.947122+0000","last_became_active":"2024-01-19T04:18:02.927750+0000","last_became_peered":"2024-01-19T04:18:02.927750+0000","last_unstale":"2024-01-19T04:18:02.947122+0000","last_undegraded":"2024-01-19T04:18:02.947122+0000","last_fullsized":"2024-01-19T04:18:02.947122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:52.076469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914198+0000","last_change":"2024-01-19T04:17:49.865069+0000","last_active":"2024-01-19T04:18:02.914198+0000","last_peered":"2024-01-19T04:18:02.914198+0000","last_clean":"2024-01-19T04:18:02.914198+0000","last_became_active":"2024-01-19T04:17:49.864458+0000","last_became_peered":"2024-01-19T04:17:49.864458+0000","last_unstale":"2024-01-19T04:18:02.914198+0000","last_undegraded":"2024-01-19T04:18:02.914198+0000","last_fullsized":"2024-01-19T04:18:02.914198+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939500+0000","last_change":"2024-01-19T04:18:02.932391+0000","last_active":"2024-01-19T04:18:02.939500+0000","last_peered":"2024-01-19T04:18:02.939500+0000","last_clean":"2024-01-19T04:18:02.939500+0000","last_became_active":"2024-01-19T04:18:02.932117+0000","last_became_peered":"2024-01-19T04:18:02.932117+0000","last_unstale":"2024-01-19T04:18:02.939500+0000","last_undegraded":"2024-01-19T04:18:02.939500+0000","last_fullsized":"2024-01-19T04:18:02.939500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:55:18.662479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903423+0000","last_change":"2024-01-19T04:17:49.873043+0000","last_active":"2024-01-19T04:18:01.903423+0000","last_peered":"2024-01-19T04:18:01.903423+0000","last_clean":"2024-01-19T04:18:01.903423+0000","last_became_active":"2024-01-19T04:17:49.866359+0000","last_became_peered":"2024-01-19T04:17:49.866359+0000","last_unstale":"2024-01-19T04:18:01.903423+0000","last_undegraded":"2024-01-19T04:18:01.903423+0000","last_fullsized":"2024-01-19T04:18:01.903423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:00.030865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934233+0000","last_change":"2024-01-19T04:18:02.922952+0000","last_active":"2024-01-19T04:18:02.934233+0000","last_peered":"2024-01-19T04:18:02.934233+0000","last_clean":"2024-01-19T04:18:02.934233+0000","last_became_active":"2024-01-19T04:18:02.922650+0000","last_became_peered":"2024-01-19T04:18:02.922650+0000","last_unstale":"2024-01-19T04:18:02.934233+0000","last_undegraded":"2024-01-19T04:18:02.934233+0000","last_fullsized":"2024-01-19T04:18:02.934233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:14.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916937+0000","last_change":"2024-01-19T04:17:49.871656+0000","last_active":"2024-01-19T04:18:02.916937+0000","last_peered":"2024-01-19T04:18:02.916937+0000","last_clean":"2024-01-19T04:18:02.916937+0000","last_became_active":"2024-01-19T04:17:49.871224+0000","last_became_peered":"2024-01-19T04:17:49.871224+0000","last_unstale":"2024-01-19T04:18:02.916937+0000","last_undegraded":"2024-01-19T04:18:02.916937+0000","last_fullsized":"2024-01-19T04:18:02.916937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928417+0000","last_change":"2024-01-19T04:18:02.934241+0000","last_active":"2024-01-19T04:18:03.928417+0000","last_peered":"2024-01-19T04:18:03.928417+0000","last_clean":"2024-01-19T04:18:03.928417+0000","last_became_active":"2024-01-19T04:18:02.933394+0000","last_became_peered":"2024-01-19T04:18:02.933394+0000","last_unstale":"2024-01-19T04:18:03.928417+0000","last_undegraded":"2024-01-19T04:18:03.928417+0000","last_fullsized":"2024-01-19T04:18:03.928417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:19:22.693098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.921537+0000","last_change":"2024-01-19T04:17:49.855762+0000","last_active":"2024-01-19T04:18:01.921537+0000","last_peered":"2024-01-19T04:18:01.921537+0000","last_clean":"2024-01-19T04:18:01.921537+0000","last_became_active":"2024-01-19T04:17:49.855517+0000","last_became_peered":"2024-01-19T04:17:49.855517+0000","last_unstale":"2024-01-19T04:18:01.921537+0000","last_undegraded":"2024-01-19T04:18:01.921537+0000","last_fullsized":"2024-01-19T04:18:01.921537+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:56:46.205998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929843+0000","last_change":"2024-01-19T04:18:02.923872+0000","last_active":"2024-01-19T04:18:03.929843+0000","last_peered":"2024-01-19T04:18:03.929843+0000","last_clean":"2024-01-19T04:18:03.929843+0000","last_became_active":"2024-01-19T04:18:02.923519+0000","last_became_peered":"2024-01-19T04:18:02.923519+0000","last_unstale":"2024-01-19T04:18:03.929843+0000","last_undegraded":"2024-01-19T04:18:03.929843+0000","last_fullsized":"2024-01-19T04:18:03.929843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:24:09.078909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909075+0000","last_change":"2024-01-19T04:17:49.853083+0000","last_active":"2024-01-19T04:18:02.909075+0000","last_peered":"2024-01-19T04:18:02.909075+0000","last_clean":"2024-01-19T04:18:02.909075+0000","last_became_active":"2024-01-19T04:17:49.852756+0000","last_became_peered":"2024-01-19T04:17:49.852756+0000","last_unstale":"2024-01-19T04:18:02.909075+0000","last_undegraded":"2024-01-19T04:18:02.909075+0000","last_fullsized":"2024-01-19T04:18:02.909075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927337+0000","last_change":"2024-01-19T04:18:02.927421+0000","last_active":"2024-01-19T04:18:03.927337+0000","last_peered":"2024-01-19T04:18:03.927337+0000","last_clean":"2024-01-19T04:18:03.927337+0000","last_became_active":"2024-01-19T04:18:02.927137+0000","last_became_peered":"2024-01-19T04:18:02.927137+0000","last_unstale":"2024-01-19T04:18:03.927337+0000","last_undegraded":"2024-01-19T04:18:03.927337+0000","last_fullsized":"2024-01-19T04:18:03.927337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:32:20.281699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917635+0000","last_change":"2024-01-19T04:17:49.864286+0000","last_active":"2024-01-19T04:18:02.917635+0000","last_peered":"2024-01-19T04:18:02.917635+0000","last_clean":"2024-01-19T04:18:02.917635+0000","last_became_active":"2024-01-19T04:17:49.864000+0000","last_became_peered":"2024-01-19T04:17:49.864000+0000","last_unstale":"2024-01-19T04:18:02.917635+0000","last_undegraded":"2024-01-19T04:18:02.917635+0000","last_fullsized":"2024-01-19T04:18:02.917635+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198965+0000","last_change":"2024-01-19T04:18:02.931721+0000","last_active":"2024-01-19T04:18:04.198965+0000","last_peered":"2024-01-19T04:18:04.198965+0000","last_clean":"2024-01-19T04:18:04.198965+0000","last_became_active":"2024-01-19T04:18:02.931459+0000","last_became_peered":"2024-01-19T04:18:02.931459+0000","last_unstale":"2024-01-19T04:18:04.198965+0000","last_undegraded":"2024-01-19T04:18:04.198965+0000","last_fullsized":"2024-01-19T04:18:04.198965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:49.474100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.916533+0000","last_change":"2024-01-19T04:17:49.857274+0000","last_active":"2024-01-19T04:18:01.916533+0000","last_peered":"2024-01-19T04:18:01.916533+0000","last_clean":"2024-01-19T04:18:01.916533+0000","last_became_active":"2024-01-19T04:17:49.857013+0000","last_became_peered":"2024-01-19T04:17:49.857013+0000","last_unstale":"2024-01-19T04:18:01.916533+0000","last_undegraded":"2024-01-19T04:18:01.916533+0000","last_fullsized":"2024-01-19T04:18:01.916533+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:49.777934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929742+0000","last_change":"2024-01-19T04:18:02.931560+0000","last_active":"2024-01-19T04:18:03.929742+0000","last_peered":"2024-01-19T04:18:03.929742+0000","last_clean":"2024-01-19T04:18:03.929742+0000","last_became_active":"2024-01-19T04:18:02.931272+0000","last_became_peered":"2024-01-19T04:18:02.931272+0000","last_unstale":"2024-01-19T04:18:03.929742+0000","last_undegraded":"2024-01-19T04:18:03.929742+0000","last_fullsized":"2024-01-19T04:18:03.929742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:00:55.557395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915012+0000","last_change":"2024-01-19T04:17:49.875695+0000","last_active":"2024-01-19T04:18:02.915012+0000","last_peered":"2024-01-19T04:18:02.915012+0000","last_clean":"2024-01-19T04:18:02.915012+0000","last_became_active":"2024-01-19T04:17:49.875390+0000","last_became_peered":"2024-01-19T04:17:49.875390+0000","last_unstale":"2024-01-19T04:18:02.915012+0000","last_undegraded":"2024-01-19T04:18:02.915012+0000","last_fullsized":"2024-01-19T04:18:02.915012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930088+0000","last_change":"2024-01-19T04:18:02.921962+0000","last_active":"2024-01-19T04:18:03.930088+0000","last_peered":"2024-01-19T04:18:03.930088+0000","last_clean":"2024-01-19T04:18:03.930088+0000","last_became_active":"2024-01-19T04:18:02.921683+0000","last_became_peered":"2024-01-19T04:18:02.921683+0000","last_unstale":"2024-01-19T04:18:03.930088+0000","last_undegraded":"2024-01-19T04:18:03.930088+0000","last_fullsized":"2024-01-19T04:18:03.930088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:41:50.780485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915748+0000","last_change":"2024-01-19T04:17:49.872291+0000","last_active":"2024-01-19T04:18:02.915748+0000","last_peered":"2024-01-19T04:18:02.915748+0000","last_clean":"2024-01-19T04:18:02.915748+0000","last_became_active":"2024-01-19T04:17:49.869453+0000","last_became_peered":"2024-01-19T04:17:49.869453+0000","last_unstale":"2024-01-19T04:18:02.915748+0000","last_undegraded":"2024-01-19T04:18:02.915748+0000","last_fullsized":"2024-01-19T04:18:02.915748+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199594+0000","last_change":"2024-01-19T04:18:02.935909+0000","last_active":"2024-01-19T04:18:04.199594+0000","last_peered":"2024-01-19T04:18:04.199594+0000","last_clean":"2024-01-19T04:18:04.199594+0000","last_became_active":"2024-01-19T04:18:02.935337+0000","last_became_peered":"2024-01-19T04:18:02.935337+0000","last_unstale":"2024-01-19T04:18:04.199594+0000","last_undegraded":"2024-01-19T04:18:04.199594+0000","last_fullsized":"2024-01-19T04:18:04.199594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:23.408554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.912841+0000","last_change":"2024-01-19T04:17:49.871088+0000","last_active":"2024-01-19T04:18:02.912841+0000","last_peered":"2024-01-19T04:18:02.912841+0000","last_clean":"2024-01-19T04:18:02.912841+0000","last_became_active":"2024-01-19T04:17:49.867276+0000","last_became_peered":"2024-01-19T04:17:49.867276+0000","last_unstale":"2024-01-19T04:18:02.912841+0000","last_undegraded":"2024-01-19T04:18:02.912841+0000","last_fullsized":"2024-01-19T04:18:02.912841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200505+0000","last_change":"2024-01-19T04:18:02.926938+0000","last_active":"2024-01-19T04:18:04.200505+0000","last_peered":"2024-01-19T04:18:04.200505+0000","last_clean":"2024-01-19T04:18:04.200505+0000","last_became_active":"2024-01-19T04:18:02.926662+0000","last_became_peered":"2024-01-19T04:18:02.926662+0000","last_unstale":"2024-01-19T04:18:04.200505+0000","last_undegraded":"2024-01-19T04:18:04.200505+0000","last_fullsized":"2024-01-19T04:18:04.200505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:05.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903099+0000","last_change":"2024-01-19T04:17:49.862897+0000","last_active":"2024-01-19T04:18:01.903099+0000","last_peered":"2024-01-19T04:18:01.903099+0000","last_clean":"2024-01-19T04:18:01.903099+0000","last_became_active":"2024-01-19T04:17:49.859232+0000","last_became_peered":"2024-01-19T04:17:49.859232+0000","last_unstale":"2024-01-19T04:18:01.903099+0000","last_undegraded":"2024-01-19T04:18:01.903099+0000","last_fullsized":"2024-01-19T04:18:01.903099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:56.233836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199851+0000","last_change":"2024-01-19T04:18:02.929284+0000","last_active":"2024-01-19T04:18:04.199851+0000","last_peered":"2024-01-19T04:18:04.199851+0000","last_clean":"2024-01-19T04:18:04.199851+0000","last_became_active":"2024-01-19T04:18:02.928936+0000","last_became_peered":"2024-01-19T04:18:02.928936+0000","last_unstale":"2024-01-19T04:18:04.199851+0000","last_undegraded":"2024-01-19T04:18:04.199851+0000","last_fullsized":"2024-01-19T04:18:04.199851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:24:09.078909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913355+0000","last_change":"2024-01-19T04:17:49.867772+0000","last_active":"2024-01-19T04:18:02.913355+0000","last_peered":"2024-01-19T04:18:02.913355+0000","last_clean":"2024-01-19T04:18:02.913355+0000","last_became_active":"2024-01-19T04:17:49.867020+0000","last_became_peered":"2024-01-19T04:17:49.867020+0000","last_unstale":"2024-01-19T04:18:02.913355+0000","last_undegraded":"2024-01-19T04:18:02.913355+0000","last_fullsized":"2024-01-19T04:18:02.913355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939245+0000","last_change":"2024-01-19T04:18:02.930986+0000","last_active":"2024-01-19T04:18:02.939245+0000","last_peered":"2024-01-19T04:18:02.939245+0000","last_clean":"2024-01-19T04:18:02.939245+0000","last_became_active":"2024-01-19T04:18:02.928172+0000","last_became_peered":"2024-01-19T04:18:02.928172+0000","last_unstale":"2024-01-19T04:18:02.939245+0000","last_undegraded":"2024-01-19T04:18:02.939245+0000","last_fullsized":"2024-01-19T04:18:02.939245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:17:18.572725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911602+0000","last_change":"2024-01-19T04:17:49.866863+0000","last_active":"2024-01-19T04:18:02.911602+0000","last_peered":"2024-01-19T04:18:02.911602+0000","last_clean":"2024-01-19T04:18:02.911602+0000","last_became_active":"2024-01-19T04:17:49.866547+0000","last_became_peered":"2024-01-19T04:17:49.866547+0000","last_unstale":"2024-01-19T04:18:02.911602+0000","last_undegraded":"2024-01-19T04:18:02.911602+0000","last_fullsized":"2024-01-19T04:18:02.911602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:57:18.950160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929425+0000","last_change":"2024-01-19T04:18:02.936220+0000","last_active":"2024-01-19T04:18:03.929425+0000","last_peered":"2024-01-19T04:18:03.929425+0000","last_clean":"2024-01-19T04:18:03.929425+0000","last_became_active":"2024-01-19T04:18:02.935916+0000","last_became_peered":"2024-01-19T04:18:02.935916+0000","last_unstale":"2024-01-19T04:18:03.929425+0000","last_undegraded":"2024-01-19T04:18:03.929425+0000","last_fullsized":"2024-01-19T04:18:03.929425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:53:12.159567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.920793+0000","last_change":"2024-01-19T04:17:49.859723+0000","last_active":"2024-01-19T04:18:01.920793+0000","last_peered":"2024-01-19T04:18:01.920793+0000","last_clean":"2024-01-19T04:18:01.920793+0000","last_became_active":"2024-01-19T04:17:49.855553+0000","last_became_peered":"2024-01-19T04:17:49.855553+0000","last_unstale":"2024-01-19T04:18:01.920793+0000","last_undegraded":"2024-01-19T04:18:01.920793+0000","last_fullsized":"2024-01-19T04:18:01.920793+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:49:38.943773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939677+0000","last_change":"2024-01-19T04:18:02.930437+0000","last_active":"2024-01-19T04:18:02.939677+0000","last_peered":"2024-01-19T04:18:02.939677+0000","last_clean":"2024-01-19T04:18:02.939677+0000","last_became_active":"2024-01-19T04:18:02.930140+0000","last_became_peered":"2024-01-19T04:18:02.930140+0000","last_unstale":"2024-01-19T04:18:02.939677+0000","last_undegraded":"2024-01-19T04:18:02.939677+0000","last_fullsized":"2024-01-19T04:18:02.939677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:33:26.001599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.911538+0000","last_change":"2024-01-19T04:17:49.858285+0000","last_active":"2024-01-19T04:18:01.911538+0000","last_peered":"2024-01-19T04:18:01.911538+0000","last_clean":"2024-01-19T04:18:01.911538+0000","last_became_active":"2024-01-19T04:17:49.857723+0000","last_became_peered":"2024-01-19T04:17:49.857723+0000","last_unstale":"2024-01-19T04:18:01.911538+0000","last_undegraded":"2024-01-19T04:18:01.911538+0000","last_fullsized":"2024-01-19T04:18:01.911538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:21:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934176+0000","last_change":"2024-01-19T04:18:02.929863+0000","last_active":"2024-01-19T04:18:02.934176+0000","last_peered":"2024-01-19T04:18:02.934176+0000","last_clean":"2024-01-19T04:18:02.934176+0000","last_became_active":"2024-01-19T04:18:02.929256+0000","last_became_peered":"2024-01-19T04:18:02.929256+0000","last_unstale":"2024-01-19T04:18:02.934176+0000","last_undegraded":"2024-01-19T04:18:02.934176+0000","last_fullsized":"2024-01-19T04:18:02.934176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:13.125109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908153+0000","last_change":"2024-01-19T04:17:49.865134+0000","last_active":"2024-01-19T04:18:02.908153+0000","last_peered":"2024-01-19T04:18:02.908153+0000","last_clean":"2024-01-19T04:18:02.908153+0000","last_became_active":"2024-01-19T04:17:49.864792+0000","last_became_peered":"2024-01-19T04:17:49.864792+0000","last_unstale":"2024-01-19T04:18:02.908153+0000","last_undegraded":"2024-01-19T04:18:02.908153+0000","last_fullsized":"2024-01-19T04:18:02.908153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.943554+0000","last_change":"2024-01-19T04:18:02.935587+0000","last_active":"2024-01-19T04:18:02.943554+0000","last_peered":"2024-01-19T04:18:02.943554+0000","last_clean":"2024-01-19T04:18:02.943554+0000","last_became_active":"2024-01-19T04:18:02.935323+0000","last_became_peered":"2024-01-19T04:18:02.935323+0000","last_unstale":"2024-01-19T04:18:02.943554+0000","last_undegraded":"2024-01-19T04:18:02.943554+0000","last_fullsized":"2024-01-19T04:18:02.943554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:45:11.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.912021+0000","last_change":"2024-01-19T04:17:49.856844+0000","last_active":"2024-01-19T04:18:02.912021+0000","last_peered":"2024-01-19T04:18:02.912021+0000","last_clean":"2024-01-19T04:18:02.912021+0000","last_became_active":"2024-01-19T04:17:49.854882+0000","last_became_peered":"2024-01-19T04:17:49.854882+0000","last_unstale":"2024-01-19T04:18:02.912021+0000","last_undegraded":"2024-01-19T04:18:02.912021+0000","last_fullsized":"2024-01-19T04:18:02.912021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199819+0000","last_change":"2024-01-19T04:18:02.922713+0000","last_active":"2024-01-19T04:18:04.199819+0000","last_peered":"2024-01-19T04:18:04.199819+0000","last_clean":"2024-01-19T04:18:04.199819+0000","last_became_active":"2024-01-19T04:18:02.922415+0000","last_became_peered":"2024-01-19T04:18:02.922415+0000","last_unstale":"2024-01-19T04:18:04.199819+0000","last_undegraded":"2024-01-19T04:18:04.199819+0000","last_fullsized":"2024-01-19T04:18:04.199819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:10.425113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.918645+0000","last_change":"2024-01-19T04:17:49.872746+0000","last_active":"2024-01-19T04:18:01.918645+0000","last_peered":"2024-01-19T04:18:01.918645+0000","last_clean":"2024-01-19T04:18:01.918645+0000","last_became_active":"2024-01-19T04:17:49.871233+0000","last_became_peered":"2024-01-19T04:17:49.871233+0000","last_unstale":"2024-01-19T04:18:01.918645+0000","last_undegraded":"2024-01-19T04:18:01.918645+0000","last_fullsized":"2024-01-19T04:18:01.918645+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:54:07.776884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928398+0000","last_change":"2024-01-19T04:18:02.929196+0000","last_active":"2024-01-19T04:18:03.928398+0000","last_peered":"2024-01-19T04:18:03.928398+0000","last_clean":"2024-01-19T04:18:03.928398+0000","last_became_active":"2024-01-19T04:18:02.928696+0000","last_became_peered":"2024-01-19T04:18:02.928696+0000","last_unstale":"2024-01-19T04:18:03.928398+0000","last_undegraded":"2024-01-19T04:18:03.928398+0000","last_fullsized":"2024-01-19T04:18:03.928398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:52:46.282369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921545+0000","last_change":"2024-01-19T04:17:49.853513+0000","last_active":"2024-01-19T04:18:02.921545+0000","last_peered":"2024-01-19T04:18:02.921545+0000","last_clean":"2024-01-19T04:18:02.921545+0000","last_became_active":"2024-01-19T04:17:49.853240+0000","last_became_peered":"2024-01-19T04:17:49.853240+0000","last_unstale":"2024-01-19T04:18:02.921545+0000","last_undegraded":"2024-01-19T04:18:02.921545+0000","last_fullsized":"2024-01-19T04:18:02.921545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934106+0000","last_change":"2024-01-19T04:18:02.927104+0000","last_active":"2024-01-19T04:18:02.934106+0000","last_peered":"2024-01-19T04:18:02.934106+0000","last_clean":"2024-01-19T04:18:02.934106+0000","last_became_active":"2024-01-19T04:18:02.926691+0000","last_became_peered":"2024-01-19T04:18:02.926691+0000","last_unstale":"2024-01-19T04:18:02.934106+0000","last_undegraded":"2024-01-19T04:18:02.934106+0000","last_fullsized":"2024-01-19T04:18:02.934106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:06.549435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.921577+0000","last_change":"2024-01-19T04:17:49.857940+0000","last_active":"2024-01-19T04:18:01.921577+0000","last_peered":"2024-01-19T04:18:01.921577+0000","last_clean":"2024-01-19T04:18:01.921577+0000","last_became_active":"2024-01-19T04:17:49.857618+0000","last_became_peered":"2024-01-19T04:17:49.857618+0000","last_unstale":"2024-01-19T04:18:01.921577+0000","last_undegraded":"2024-01-19T04:18:01.921577+0000","last_fullsized":"2024-01-19T04:18:01.921577+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:17:03.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927482+0000","last_change":"2024-01-19T04:18:02.929159+0000","last_active":"2024-01-19T04:18:03.927482+0000","last_peered":"2024-01-19T04:18:03.927482+0000","last_clean":"2024-01-19T04:18:03.927482+0000","last_became_active":"2024-01-19T04:18:02.928745+0000","last_became_peered":"2024-01-19T04:18:02.928745+0000","last_unstale":"2024-01-19T04:18:03.927482+0000","last_undegraded":"2024-01-19T04:18:03.927482+0000","last_fullsized":"2024-01-19T04:18:03.927482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:23.835750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.921507+0000","last_change":"2024-01-19T04:17:49.859316+0000","last_active":"2024-01-19T04:18:01.921507+0000","last_peered":"2024-01-19T04:18:01.921507+0000","last_clean":"2024-01-19T04:18:01.921507+0000","last_became_active":"2024-01-19T04:17:49.858093+0000","last_became_peered":"2024-01-19T04:17:49.858093+0000","last_unstale":"2024-01-19T04:18:01.921507+0000","last_undegraded":"2024-01-19T04:18:01.921507+0000","last_fullsized":"2024-01-19T04:18:01.921507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:43.805224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929746+0000","last_change":"2024-01-19T04:18:02.933633+0000","last_active":"2024-01-19T04:18:03.929746+0000","last_peered":"2024-01-19T04:18:03.929746+0000","last_clean":"2024-01-19T04:18:03.929746+0000","last_became_active":"2024-01-19T04:18:02.930330+0000","last_became_peered":"2024-01-19T04:18:02.930330+0000","last_unstale":"2024-01-19T04:18:03.929746+0000","last_undegraded":"2024-01-19T04:18:03.929746+0000","last_fullsized":"2024-01-19T04:18:03.929746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:52:50.129815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902401+0000","last_change":"2024-01-19T04:17:49.866954+0000","last_active":"2024-01-19T04:18:01.902401+0000","last_peered":"2024-01-19T04:18:01.902401+0000","last_clean":"2024-01-19T04:18:01.902401+0000","last_became_active":"2024-01-19T04:17:49.866065+0000","last_became_peered":"2024-01-19T04:17:49.866065+0000","last_unstale":"2024-01-19T04:18:01.902401+0000","last_undegraded":"2024-01-19T04:18:01.902401+0000","last_fullsized":"2024-01-19T04:18:01.902401+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:10.031493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.939917+0000","last_change":"2024-01-19T04:18:02.931652+0000","last_active":"2024-01-19T04:18:02.939917+0000","last_peered":"2024-01-19T04:18:02.939917+0000","last_clean":"2024-01-19T04:18:02.939917+0000","last_became_active":"2024-01-19T04:18:02.931322+0000","last_became_peered":"2024-01-19T04:18:02.931322+0000","last_unstale":"2024-01-19T04:18:02.939917+0000","last_undegraded":"2024-01-19T04:18:02.939917+0000","last_fullsized":"2024-01-19T04:18:02.939917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:45.079562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911410+0000","last_change":"2024-01-19T04:17:49.868296+0000","last_active":"2024-01-19T04:18:02.911410+0000","last_peered":"2024-01-19T04:18:02.911410+0000","last_clean":"2024-01-19T04:18:02.911410+0000","last_became_active":"2024-01-19T04:17:49.867461+0000","last_became_peered":"2024-01-19T04:17:49.867461+0000","last_unstale":"2024-01-19T04:18:02.911410+0000","last_undegraded":"2024-01-19T04:18:02.911410+0000","last_fullsized":"2024-01-19T04:18:02.911410+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927522+0000","last_change":"2024-01-19T04:18:02.925158+0000","last_active":"2024-01-19T04:18:03.927522+0000","last_peered":"2024-01-19T04:18:03.927522+0000","last_clean":"2024-01-19T04:18:03.927522+0000","last_became_active":"2024-01-19T04:18:02.924898+0000","last_became_peered":"2024-01-19T04:18:02.924898+0000","last_unstale":"2024-01-19T04:18:03.927522+0000","last_undegraded":"2024-01-19T04:18:03.927522+0000","last_fullsized":"2024-01-19T04:18:03.927522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:11.345369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.915926+0000","last_change":"2024-01-19T04:17:49.852860+0000","last_active":"2024-01-19T04:18:01.915926+0000","last_peered":"2024-01-19T04:18:01.915926+0000","last_clean":"2024-01-19T04:18:01.915926+0000","last_became_active":"2024-01-19T04:17:49.852553+0000","last_became_peered":"2024-01-19T04:17:49.852553+0000","last_unstale":"2024-01-19T04:18:01.915926+0000","last_undegraded":"2024-01-19T04:18:01.915926+0000","last_fullsized":"2024-01-19T04:18:01.915926+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:14.754721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930448+0000","last_change":"2024-01-19T04:18:02.943210+0000","last_active":"2024-01-19T04:18:03.930448+0000","last_peered":"2024-01-19T04:18:03.930448+0000","last_clean":"2024-01-19T04:18:03.930448+0000","last_became_active":"2024-01-19T04:18:02.942677+0000","last_became_peered":"2024-01-19T04:18:02.942677+0000","last_unstale":"2024-01-19T04:18:03.930448+0000","last_undegraded":"2024-01-19T04:18:03.930448+0000","last_fullsized":"2024-01-19T04:18:03.930448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:12:11.345369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903292+0000","last_change":"2024-01-19T04:17:49.871177+0000","last_active":"2024-01-19T04:18:01.903292+0000","last_peered":"2024-01-19T04:18:01.903292+0000","last_clean":"2024-01-19T04:18:01.903292+0000","last_became_active":"2024-01-19T04:17:49.866601+0000","last_became_peered":"2024-01-19T04:17:49.866601+0000","last_unstale":"2024-01-19T04:18:01.903292+0000","last_undegraded":"2024-01-19T04:18:01.903292+0000","last_fullsized":"2024-01-19T04:18:01.903292+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:14.140070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199642+0000","last_change":"2024-01-19T04:18:02.928862+0000","last_active":"2024-01-19T04:18:04.199642+0000","last_peered":"2024-01-19T04:18:04.199642+0000","last_clean":"2024-01-19T04:18:04.199642+0000","last_became_active":"2024-01-19T04:18:02.927181+0000","last_became_peered":"2024-01-19T04:18:02.927181+0000","last_unstale":"2024-01-19T04:18:04.199642+0000","last_undegraded":"2024-01-19T04:18:04.199642+0000","last_fullsized":"2024-01-19T04:18:04.199642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:53:12.159567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916891+0000","last_change":"2024-01-19T04:17:49.874016+0000","last_active":"2024-01-19T04:18:02.916891+0000","last_peered":"2024-01-19T04:18:02.916891+0000","last_clean":"2024-01-19T04:18:02.916891+0000","last_became_active":"2024-01-19T04:17:49.873659+0000","last_became_peered":"2024-01-19T04:17:49.873659+0000","last_unstale":"2024-01-19T04:18:02.916891+0000","last_undegraded":"2024-01-19T04:18:02.916891+0000","last_fullsized":"2024-01-19T04:18:02.916891+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:19:01.792971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200805+0000","last_change":"2024-01-19T04:18:02.931936+0000","last_active":"2024-01-19T04:18:04.200805+0000","last_peered":"2024-01-19T04:18:04.200805+0000","last_clean":"2024-01-19T04:18:04.200805+0000","last_became_active":"2024-01-19T04:18:02.931639+0000","last_became_peered":"2024-01-19T04:18:02.931639+0000","last_unstale":"2024-01-19T04:18:04.200805+0000","last_undegraded":"2024-01-19T04:18:04.200805+0000","last_fullsized":"2024-01-19T04:18:04.200805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:52:50.129815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909438+0000","last_change":"2024-01-19T04:17:49.852565+0000","last_active":"2024-01-19T04:18:02.909438+0000","last_peered":"2024-01-19T04:18:02.909438+0000","last_clean":"2024-01-19T04:18:02.909438+0000","last_became_active":"2024-01-19T04:17:49.852322+0000","last_became_peered":"2024-01-19T04:17:49.852322+0000","last_unstale":"2024-01-19T04:18:02.909438+0000","last_undegraded":"2024-01-19T04:18:02.909438+0000","last_fullsized":"2024-01-19T04:18:02.909438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928568+0000","last_change":"2024-01-19T04:18:02.934034+0000","last_active":"2024-01-19T04:18:03.928568+0000","last_peered":"2024-01-19T04:18:03.928568+0000","last_clean":"2024-01-19T04:18:03.928568+0000","last_became_active":"2024-01-19T04:18:02.932871+0000","last_became_peered":"2024-01-19T04:18:02.932871+0000","last_unstale":"2024-01-19T04:18:03.928568+0000","last_undegraded":"2024-01-19T04:18:03.928568+0000","last_fullsized":"2024-01-19T04:18:03.928568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:15:52.145695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913367+0000","last_change":"2024-01-19T04:17:49.863773+0000","last_active":"2024-01-19T04:18:02.913367+0000","last_peered":"2024-01-19T04:18:02.913367+0000","last_clean":"2024-01-19T04:18:02.913367+0000","last_became_active":"2024-01-19T04:17:49.863395+0000","last_became_peered":"2024-01-19T04:17:49.863395+0000","last_unstale":"2024-01-19T04:18:02.913367+0000","last_undegraded":"2024-01-19T04:18:02.913367+0000","last_fullsized":"2024-01-19T04:18:02.913367+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934272+0000","last_change":"2024-01-19T04:18:02.926574+0000","last_active":"2024-01-19T04:18:02.934272+0000","last_peered":"2024-01-19T04:18:02.934272+0000","last_clean":"2024-01-19T04:18:02.934272+0000","last_became_active":"2024-01-19T04:18:02.926297+0000","last_became_peered":"2024-01-19T04:18:02.926297+0000","last_unstale":"2024-01-19T04:18:02.934272+0000","last_undegraded":"2024-01-19T04:18:02.934272+0000","last_fullsized":"2024-01-19T04:18:02.934272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:46:09.144032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902950+0000","last_change":"2024-01-19T04:17:49.866404+0000","last_active":"2024-01-19T04:18:01.902950+0000","last_peered":"2024-01-19T04:18:01.902950+0000","last_clean":"2024-01-19T04:18:01.902950+0000","last_became_active":"2024-01-19T04:17:49.866097+0000","last_became_peered":"2024-01-19T04:17:49.866097+0000","last_unstale":"2024-01-19T04:18:01.902950+0000","last_undegraded":"2024-01-19T04:18:01.902950+0000","last_fullsized":"2024-01-19T04:18:01.902950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:27.936090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.946770+0000","last_change":"2024-01-19T04:18:02.926102+0000","last_active":"2024-01-19T04:18:02.946770+0000","last_peered":"2024-01-19T04:18:02.946770+0000","last_clean":"2024-01-19T04:18:02.946770+0000","last_became_active":"2024-01-19T04:18:02.925838+0000","last_became_peered":"2024-01-19T04:18:02.925838+0000","last_unstale":"2024-01-19T04:18:02.946770+0000","last_undegraded":"2024-01-19T04:18:02.946770+0000","last_fullsized":"2024-01-19T04:18:02.946770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:29.524861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902503+0000","last_change":"2024-01-19T04:17:49.865607+0000","last_active":"2024-01-19T04:18:01.902503+0000","last_peered":"2024-01-19T04:18:01.902503+0000","last_clean":"2024-01-19T04:18:01.902503+0000","last_became_active":"2024-01-19T04:17:49.862265+0000","last_became_peered":"2024-01-19T04:17:49.862265+0000","last_unstale":"2024-01-19T04:18:01.902503+0000","last_undegraded":"2024-01-19T04:18:01.902503+0000","last_fullsized":"2024-01-19T04:18:01.902503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:15:47.108625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927892+0000","last_change":"2024-01-19T04:18:02.937135+0000","last_active":"2024-01-19T04:18:03.927892+0000","last_peered":"2024-01-19T04:18:03.927892+0000","last_clean":"2024-01-19T04:18:03.927892+0000","last_became_active":"2024-01-19T04:18:02.936830+0000","last_became_peered":"2024-01-19T04:18:02.936830+0000","last_unstale":"2024-01-19T04:18:03.927892+0000","last_undegraded":"2024-01-19T04:18:03.927892+0000","last_fullsized":"2024-01-19T04:18:03.927892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:15:33.620586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908573+0000","last_change":"2024-01-19T04:17:49.857659+0000","last_active":"2024-01-19T04:18:02.908573+0000","last_peered":"2024-01-19T04:18:02.908573+0000","last_clean":"2024-01-19T04:18:02.908573+0000","last_became_active":"2024-01-19T04:17:49.857365+0000","last_became_peered":"2024-01-19T04:17:49.857365+0000","last_unstale":"2024-01-19T04:18:02.908573+0000","last_undegraded":"2024-01-19T04:18:02.908573+0000","last_fullsized":"2024-01-19T04:18:02.908573+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:09.890421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934139+0000","last_change":"2024-01-19T04:18:02.923180+0000","last_active":"2024-01-19T04:18:02.934139+0000","last_peered":"2024-01-19T04:18:02.934139+0000","last_clean":"2024-01-19T04:18:02.934139+0000","last_became_active":"2024-01-19T04:18:02.922828+0000","last_became_peered":"2024-01-19T04:18:02.922828+0000","last_unstale":"2024-01-19T04:18:02.934139+0000","last_undegraded":"2024-01-19T04:18:02.934139+0000","last_fullsized":"2024-01-19T04:18:02.934139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:16:00.202869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913241+0000","last_change":"2024-01-19T04:17:49.867051+0000","last_active":"2024-01-19T04:18:02.913241+0000","last_peered":"2024-01-19T04:18:02.913241+0000","last_clean":"2024-01-19T04:18:02.913241+0000","last_became_active":"2024-01-19T04:17:49.866731+0000","last_became_peered":"2024-01-19T04:17:49.866731+0000","last_unstale":"2024-01-19T04:18:02.913241+0000","last_undegraded":"2024-01-19T04:18:02.913241+0000","last_fullsized":"2024-01-19T04:18:02.913241+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:12.627837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.946850+0000","last_change":"2024-01-19T04:18:02.923641+0000","last_active":"2024-01-19T04:18:02.946850+0000","last_peered":"2024-01-19T04:18:02.946850+0000","last_clean":"2024-01-19T04:18:02.946850+0000","last_became_active":"2024-01-19T04:18:02.922977+0000","last_became_peered":"2024-01-19T04:18:02.922977+0000","last_unstale":"2024-01-19T04:18:02.946850+0000","last_undegraded":"2024-01-19T04:18:02.946850+0000","last_fullsized":"2024-01-19T04:18:02.946850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:33.097881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928336+0000","last_change":"2024-01-19T04:18:01.927465+0000","last_active":"2024-01-19T04:18:03.928336+0000","last_peered":"2024-01-19T04:18:03.928336+0000","last_clean":"2024-01-19T04:18:03.928336+0000","last_became_active":"2024-01-19T04:18:01.926814+0000","last_became_peered":"2024-01-19T04:18:01.926814+0000","last_unstale":"2024-01-19T04:18:03.928336+0000","last_undegraded":"2024-01-19T04:18:03.928336+0000","last_fullsized":"2024-01-19T04:18:03.928336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:24:43.828655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909743+0000","last_change":"2024-01-19T04:17:49.864851+0000","last_active":"2024-01-19T04:18:02.909743+0000","last_peered":"2024-01-19T04:18:02.909743+0000","last_clean":"2024-01-19T04:18:02.909743+0000","last_became_active":"2024-01-19T04:17:49.864521+0000","last_became_peered":"2024-01-19T04:17:49.864521+0000","last_unstale":"2024-01-19T04:18:02.909743+0000","last_undegraded":"2024-01-19T04:18:02.909743+0000","last_fullsized":"2024-01-19T04:18:02.909743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"70'4","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914466+0000","last_change":"2024-01-19T04:17:48.825833+0000","last_active":"2024-01-19T04:18:02.914466+0000","last_peered":"2024-01-19T04:18:02.914466+0000","last_clean":"2024-01-19T04:18:02.914466+0000","last_became_active":"2024-01-19T04:17:48.825538+0000","last_became_peered":"2024-01-19T04:17:48.825538+0000","last_unstale":"2024-01-19T04:18:02.914466+0000","last_undegraded":"2024-01-19T04:18:02.914466+0000","last_fullsized":"2024-01-19T04:18:02.914466+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199844+0000","last_change":"2024-01-19T04:18:02.931774+0000","last_active":"2024-01-19T04:18:04.199844+0000","last_peered":"2024-01-19T04:18:04.199844+0000","last_clean":"2024-01-19T04:18:04.199844+0000","last_became_active":"2024-01-19T04:18:02.928427+0000","last_became_peered":"2024-01-19T04:18:02.928427+0000","last_unstale":"2024-01-19T04:18:04.199844+0000","last_undegraded":"2024-01-19T04:18:04.199844+0000","last_fullsized":"2024-01-19T04:18:04.199844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:20:49.474100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927938+0000","last_change":"2024-01-19T04:18:01.926749+0000","last_active":"2024-01-19T04:18:03.927938+0000","last_peered":"2024-01-19T04:18:03.927938+0000","last_clean":"2024-01-19T04:18:03.927938+0000","last_became_active":"2024-01-19T04:18:01.925465+0000","last_became_peered":"2024-01-19T04:18:01.925465+0000","last_unstale":"2024-01-19T04:18:03.927938+0000","last_undegraded":"2024-01-19T04:18:03.927938+0000","last_fullsized":"2024-01-19T04:18:03.927938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:09:24.825742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914284+0000","last_change":"2024-01-19T04:17:49.870363+0000","last_active":"2024-01-19T04:18:02.914284+0000","last_peered":"2024-01-19T04:18:02.914284+0000","last_clean":"2024-01-19T04:18:02.914284+0000","last_became_active":"2024-01-19T04:17:49.867727+0000","last_became_peered":"2024-01-19T04:17:49.867727+0000","last_unstale":"2024-01-19T04:18:02.914284+0000","last_undegraded":"2024-01-19T04:18:02.914284+0000","last_fullsized":"2024-01-19T04:18:02.914284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909939+0000","last_change":"2024-01-19T04:17:48.820675+0000","last_active":"2024-01-19T04:18:02.909939+0000","last_peered":"2024-01-19T04:18:02.909939+0000","last_clean":"2024-01-19T04:18:02.909939+0000","last_became_active":"2024-01-19T04:17:48.816249+0000","last_became_peered":"2024-01-19T04:17:48.816249+0000","last_unstale":"2024-01-19T04:18:02.909939+0000","last_undegraded":"2024-01-19T04:18:02.909939+0000","last_fullsized":"2024-01-19T04:18:02.909939+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.944568+0000","last_change":"2024-01-19T04:18:02.940150+0000","last_active":"2024-01-19T04:18:02.944568+0000","last_peered":"2024-01-19T04:18:02.944568+0000","last_clean":"2024-01-19T04:18:02.944568+0000","last_became_active":"2024-01-19T04:18:02.939837+0000","last_became_peered":"2024-01-19T04:18:02.939837+0000","last_unstale":"2024-01-19T04:18:02.944568+0000","last_undegraded":"2024-01-19T04:18:02.944568+0000","last_fullsized":"2024-01-19T04:18:02.944568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:41:14.828916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"74'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928251+0000","last_change":"2024-01-19T04:18:01.928789+0000","last_active":"2024-01-19T04:18:03.928251+0000","last_peered":"2024-01-19T04:18:03.928251+0000","last_clean":"2024-01-19T04:18:03.928251+0000","last_became_active":"2024-01-19T04:18:01.928296+0000","last_became_peered":"2024-01-19T04:18:01.928296+0000","last_unstale":"2024-01-19T04:18:03.928251+0000","last_undegraded":"2024-01-19T04:18:03.928251+0000","last_fullsized":"2024-01-19T04:18:03.928251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:09.419485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913487+0000","last_change":"2024-01-19T04:17:49.867990+0000","last_active":"2024-01-19T04:18:02.913487+0000","last_peered":"2024-01-19T04:18:02.913487+0000","last_clean":"2024-01-19T04:18:02.913487+0000","last_became_active":"2024-01-19T04:17:49.867492+0000","last_became_peered":"2024-01-19T04:17:49.867492+0000","last_unstale":"2024-01-19T04:18:02.913487+0000","last_undegraded":"2024-01-19T04:18:02.913487+0000","last_fullsized":"2024-01-19T04:18:02.913487+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"70'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921784+0000","last_change":"2024-01-19T04:17:48.828840+0000","last_active":"2024-01-19T04:18:02.921784+0000","last_peered":"2024-01-19T04:18:02.921784+0000","last_clean":"2024-01-19T04:18:02.921784+0000","last_became_active":"2024-01-19T04:17:48.828585+0000","last_became_peered":"2024-01-19T04:17:48.828585+0000","last_unstale":"2024-01-19T04:18:02.921784+0000","last_undegraded":"2024-01-19T04:18:02.921784+0000","last_fullsized":"2024-01-19T04:18:02.921784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:08.887937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934433+0000","last_change":"2024-01-19T04:18:02.926349+0000","last_active":"2024-01-19T04:18:02.934433+0000","last_peered":"2024-01-19T04:18:02.934433+0000","last_clean":"2024-01-19T04:18:02.934433+0000","last_became_active":"2024-01-19T04:18:02.925960+0000","last_became_peered":"2024-01-19T04:18:02.925960+0000","last_unstale":"2024-01-19T04:18:02.934433+0000","last_undegraded":"2024-01-19T04:18:02.934433+0000","last_fullsized":"2024-01-19T04:18:02.934433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:43:17.917877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930196+0000","last_change":"2024-01-19T04:18:01.922734+0000","last_active":"2024-01-19T04:18:03.930196+0000","last_peered":"2024-01-19T04:18:03.930196+0000","last_clean":"2024-01-19T04:18:03.930196+0000","last_became_active":"2024-01-19T04:18:01.922380+0000","last_became_peered":"2024-01-19T04:18:01.922380+0000","last_unstale":"2024-01-19T04:18:03.930196+0000","last_undegraded":"2024-01-19T04:18:03.930196+0000","last_fullsized":"2024-01-19T04:18:03.930196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:03.436450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917420+0000","last_change":"2024-01-19T04:17:49.873318+0000","last_active":"2024-01-19T04:18:02.917420+0000","last_peered":"2024-01-19T04:18:02.917420+0000","last_clean":"2024-01-19T04:18:02.917420+0000","last_became_active":"2024-01-19T04:17:49.873026+0000","last_became_peered":"2024-01-19T04:17:49.873026+0000","last_unstale":"2024-01-19T04:18:02.917420+0000","last_undegraded":"2024-01-19T04:18:02.917420+0000","last_fullsized":"2024-01-19T04:18:02.917420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:44.021386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"70'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.922701+0000","last_change":"2024-01-19T04:17:48.829724+0000","last_active":"2024-01-19T04:18:02.922701+0000","last_peered":"2024-01-19T04:18:02.922701+0000","last_clean":"2024-01-19T04:18:02.922701+0000","last_became_active":"2024-01-19T04:17:48.829371+0000","last_became_peered":"2024-01-19T04:17:48.829371+0000","last_unstale":"2024-01-19T04:18:02.922701+0000","last_undegraded":"2024-01-19T04:18:02.922701+0000","last_fullsized":"2024-01-19T04:18:02.922701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:52:37.979741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.936920+0000","last_change":"2024-01-19T04:18:02.928268+0000","last_active":"2024-01-19T04:18:02.936920+0000","last_peered":"2024-01-19T04:18:02.936920+0000","last_clean":"2024-01-19T04:18:02.936920+0000","last_became_active":"2024-01-19T04:18:02.928011+0000","last_became_peered":"2024-01-19T04:18:02.928011+0000","last_unstale":"2024-01-19T04:18:02.936920+0000","last_undegraded":"2024-01-19T04:18:02.936920+0000","last_fullsized":"2024-01-19T04:18:02.936920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:24:41.766331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198154+0000","last_change":"2024-01-19T04:18:01.926918+0000","last_active":"2024-01-19T04:18:04.198154+0000","last_peered":"2024-01-19T04:18:04.198154+0000","last_clean":"2024-01-19T04:18:04.198154+0000","last_became_active":"2024-01-19T04:18:01.926642+0000","last_became_peered":"2024-01-19T04:18:01.926642+0000","last_unstale":"2024-01-19T04:18:04.198154+0000","last_undegraded":"2024-01-19T04:18:04.198154+0000","last_fullsized":"2024-01-19T04:18:04.198154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:55:13.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902675+0000","last_change":"2024-01-19T04:17:49.865540+0000","last_active":"2024-01-19T04:18:01.902675+0000","last_peered":"2024-01-19T04:18:01.902675+0000","last_clean":"2024-01-19T04:18:01.902675+0000","last_became_active":"2024-01-19T04:17:49.858951+0000","last_became_peered":"2024-01-19T04:17:49.858951+0000","last_unstale":"2024-01-19T04:18:01.902675+0000","last_undegraded":"2024-01-19T04:18:01.902675+0000","last_fullsized":"2024-01-19T04:18:01.902675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:40.979891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909293+0000","last_change":"2024-01-19T04:17:48.822620+0000","last_active":"2024-01-19T04:18:02.909293+0000","last_peered":"2024-01-19T04:18:02.909293+0000","last_clean":"2024-01-19T04:18:02.909293+0000","last_became_active":"2024-01-19T04:17:48.822278+0000","last_became_peered":"2024-01-19T04:17:48.822278+0000","last_unstale":"2024-01-19T04:18:02.909293+0000","last_undegraded":"2024-01-19T04:18:02.909293+0000","last_fullsized":"2024-01-19T04:18:02.909293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197842+0000","last_change":"2024-01-19T04:18:02.924033+0000","last_active":"2024-01-19T04:18:04.197842+0000","last_peered":"2024-01-19T04:18:04.197842+0000","last_clean":"2024-01-19T04:18:04.197842+0000","last_became_active":"2024-01-19T04:18:02.923767+0000","last_became_peered":"2024-01-19T04:18:02.923767+0000","last_unstale":"2024-01-19T04:18:04.197842+0000","last_undegraded":"2024-01-19T04:18:04.197842+0000","last_fullsized":"2024-01-19T04:18:04.197842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:09:25.831369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.906084+0000","last_change":"2024-01-19T04:18:01.922795+0000","last_active":"2024-01-19T04:18:02.906084+0000","last_peered":"2024-01-19T04:18:02.906084+0000","last_clean":"2024-01-19T04:18:02.906084+0000","last_became_active":"2024-01-19T04:18:01.922539+0000","last_became_peered":"2024-01-19T04:18:01.922539+0000","last_unstale":"2024-01-19T04:18:02.906084+0000","last_undegraded":"2024-01-19T04:18:02.906084+0000","last_fullsized":"2024-01-19T04:18:02.906084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:17:07.479247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908980+0000","last_change":"2024-01-19T04:17:49.860631+0000","last_active":"2024-01-19T04:18:02.908980+0000","last_peered":"2024-01-19T04:18:02.908980+0000","last_clean":"2024-01-19T04:18:02.908980+0000","last_became_active":"2024-01-19T04:17:49.855956+0000","last_became_peered":"2024-01-19T04:17:49.855956+0000","last_unstale":"2024-01-19T04:18:02.908980+0000","last_undegraded":"2024-01-19T04:18:02.908980+0000","last_fullsized":"2024-01-19T04:18:02.908980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:55:32.345948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908649+0000","last_change":"2024-01-19T04:17:48.818168+0000","last_active":"2024-01-19T04:18:02.908649+0000","last_peered":"2024-01-19T04:18:02.908649+0000","last_clean":"2024-01-19T04:18:02.908649+0000","last_became_active":"2024-01-19T04:17:48.816710+0000","last_became_peered":"2024-01-19T04:17:48.816710+0000","last_unstale":"2024-01-19T04:18:02.908649+0000","last_undegraded":"2024-01-19T04:18:02.908649+0000","last_fullsized":"2024-01-19T04:18:02.908649+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198241+0000","last_change":"2024-01-19T04:18:02.930057+0000","last_active":"2024-01-19T04:18:04.198241+0000","last_peered":"2024-01-19T04:18:04.198241+0000","last_clean":"2024-01-19T04:18:04.198241+0000","last_became_active":"2024-01-19T04:18:02.929766+0000","last_became_peered":"2024-01-19T04:18:02.929766+0000","last_unstale":"2024-01-19T04:18:04.198241+0000","last_undegraded":"2024-01-19T04:18:04.198241+0000","last_fullsized":"2024-01-19T04:18:04.198241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:12.610657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"74'1","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947664+0000","last_change":"2024-01-19T04:18:01.923533+0000","last_active":"2024-01-19T04:18:02.947664+0000","last_peered":"2024-01-19T04:18:02.947664+0000","last_clean":"2024-01-19T04:18:02.947664+0000","last_became_active":"2024-01-19T04:18:01.923266+0000","last_became_peered":"2024-01-19T04:18:01.923266+0000","last_unstale":"2024-01-19T04:18:02.947664+0000","last_undegraded":"2024-01-19T04:18:02.947664+0000","last_fullsized":"2024-01-19T04:18:02.947664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:33.446199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911006+0000","last_change":"2024-01-19T04:17:49.869314+0000","last_active":"2024-01-19T04:18:02.911006+0000","last_peered":"2024-01-19T04:18:02.911006+0000","last_clean":"2024-01-19T04:18:02.911006+0000","last_became_active":"2024-01-19T04:17:49.868926+0000","last_became_peered":"2024-01-19T04:17:49.868926+0000","last_unstale":"2024-01-19T04:18:02.911006+0000","last_undegraded":"2024-01-19T04:18:02.911006+0000","last_fullsized":"2024-01-19T04:18:02.911006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917725+0000","last_change":"2024-01-19T04:17:48.828497+0000","last_active":"2024-01-19T04:18:02.917725+0000","last_peered":"2024-01-19T04:18:02.917725+0000","last_clean":"2024-01-19T04:18:02.917725+0000","last_became_active":"2024-01-19T04:17:48.828243+0000","last_became_peered":"2024-01-19T04:17:48.828243+0000","last_unstale":"2024-01-19T04:18:02.917725+0000","last_undegraded":"2024-01-19T04:18:02.917725+0000","last_fullsized":"2024-01-19T04:18:02.917725+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:19.001153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.929882+0000","last_change":"2024-01-19T04:18:02.920463+0000","last_active":"2024-01-19T04:18:03.929882+0000","last_peered":"2024-01-19T04:18:03.929882+0000","last_clean":"2024-01-19T04:18:03.929882+0000","last_became_active":"2024-01-19T04:18:02.920162+0000","last_became_peered":"2024-01-19T04:18:02.920162+0000","last_unstale":"2024-01-19T04:18:03.929882+0000","last_undegraded":"2024-01-19T04:18:03.929882+0000","last_fullsized":"2024-01-19T04:18:03.929882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:15:10.841034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927738+0000","last_change":"2024-01-19T04:18:01.925519+0000","last_active":"2024-01-19T04:18:03.927738+0000","last_peered":"2024-01-19T04:18:03.927738+0000","last_clean":"2024-01-19T04:18:03.927738+0000","last_became_active":"2024-01-19T04:18:01.925202+0000","last_became_peered":"2024-01-19T04:18:01.925202+0000","last_unstale":"2024-01-19T04:18:03.927738+0000","last_undegraded":"2024-01-19T04:18:03.927738+0000","last_fullsized":"2024-01-19T04:18:03.927738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:03.436450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.911622+0000","last_change":"2024-01-19T04:17:49.858061+0000","last_active":"2024-01-19T04:18:01.911622+0000","last_peered":"2024-01-19T04:18:01.911622+0000","last_clean":"2024-01-19T04:18:01.911622+0000","last_became_active":"2024-01-19T04:17:49.857273+0000","last_became_peered":"2024-01-19T04:17:49.857273+0000","last_unstale":"2024-01-19T04:18:01.911622+0000","last_undegraded":"2024-01-19T04:18:01.911622+0000","last_fullsized":"2024-01-19T04:18:01.911622+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:09:22.290458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902845+0000","last_change":"2024-01-19T04:17:48.825064+0000","last_active":"2024-01-19T04:18:01.902845+0000","last_peered":"2024-01-19T04:18:01.902845+0000","last_clean":"2024-01-19T04:18:01.902845+0000","last_became_active":"2024-01-19T04:17:48.824540+0000","last_became_peered":"2024-01-19T04:17:48.824540+0000","last_unstale":"2024-01-19T04:18:01.902845+0000","last_undegraded":"2024-01-19T04:18:01.902845+0000","last_fullsized":"2024-01-19T04:18:01.902845+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:48.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199031+0000","last_change":"2024-01-19T04:18:02.935518+0000","last_active":"2024-01-19T04:18:04.199031+0000","last_peered":"2024-01-19T04:18:04.199031+0000","last_clean":"2024-01-19T04:18:04.199031+0000","last_became_active":"2024-01-19T04:18:02.935175+0000","last_became_peered":"2024-01-19T04:18:02.935175+0000","last_unstale":"2024-01-19T04:18:04.199031+0000","last_undegraded":"2024-01-19T04:18:04.199031+0000","last_fullsized":"2024-01-19T04:18:04.199031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:05.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"74'3","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930461+0000","last_change":"2024-01-19T04:18:01.925505+0000","last_active":"2024-01-19T04:18:03.930461+0000","last_peered":"2024-01-19T04:18:03.930461+0000","last_clean":"2024-01-19T04:18:03.930461+0000","last_became_active":"2024-01-19T04:18:01.925249+0000","last_became_peered":"2024-01-19T04:18:01.925249+0000","last_unstale":"2024-01-19T04:18:03.930461+0000","last_undegraded":"2024-01-19T04:18:03.930461+0000","last_fullsized":"2024-01-19T04:18:03.930461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:30.941043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.914955+0000","last_change":"2024-01-19T04:17:49.857761+0000","last_active":"2024-01-19T04:18:01.914955+0000","last_peered":"2024-01-19T04:18:01.914955+0000","last_clean":"2024-01-19T04:18:01.914955+0000","last_became_active":"2024-01-19T04:17:49.857423+0000","last_became_peered":"2024-01-19T04:17:49.857423+0000","last_unstale":"2024-01-19T04:18:01.914955+0000","last_undegraded":"2024-01-19T04:18:01.914955+0000","last_fullsized":"2024-01-19T04:18:01.914955+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:02.036657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914570+0000","last_change":"2024-01-19T04:17:48.830083+0000","last_active":"2024-01-19T04:18:02.914570+0000","last_peered":"2024-01-19T04:18:02.914570+0000","last_clean":"2024-01-19T04:18:02.914570+0000","last_became_active":"2024-01-19T04:17:48.829733+0000","last_became_peered":"2024-01-19T04:17:48.829733+0000","last_unstale":"2024-01-19T04:18:02.914570+0000","last_undegraded":"2024-01-19T04:18:02.914570+0000","last_fullsized":"2024-01-19T04:18:02.914570+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:44:57.313115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930112+0000","last_change":"2024-01-19T04:18:02.935577+0000","last_active":"2024-01-19T04:18:03.930112+0000","last_peered":"2024-01-19T04:18:03.930112+0000","last_clean":"2024-01-19T04:18:03.930112+0000","last_became_active":"2024-01-19T04:18:02.934941+0000","last_became_peered":"2024-01-19T04:18:02.934941+0000","last_unstale":"2024-01-19T04:18:03.930112+0000","last_undegraded":"2024-01-19T04:18:03.930112+0000","last_fullsized":"2024-01-19T04:18:03.930112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:32:20.281699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"74'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199713+0000","last_change":"2024-01-19T04:18:01.927206+0000","last_active":"2024-01-19T04:18:04.199713+0000","last_peered":"2024-01-19T04:18:04.199713+0000","last_clean":"2024-01-19T04:18:04.199713+0000","last_became_active":"2024-01-19T04:18:01.926934+0000","last_became_peered":"2024-01-19T04:18:01.926934+0000","last_unstale":"2024-01-19T04:18:04.199713+0000","last_undegraded":"2024-01-19T04:18:04.199713+0000","last_fullsized":"2024-01-19T04:18:04.199713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:55:13.548675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915848+0000","last_change":"2024-01-19T04:17:49.862638+0000","last_active":"2024-01-19T04:18:02.915848+0000","last_peered":"2024-01-19T04:18:02.915848+0000","last_clean":"2024-01-19T04:18:02.915848+0000","last_became_active":"2024-01-19T04:17:49.862288+0000","last_became_peered":"2024-01-19T04:17:49.862288+0000","last_unstale":"2024-01-19T04:18:02.915848+0000","last_undegraded":"2024-01-19T04:18:02.915848+0000","last_fullsized":"2024-01-19T04:18:02.915848+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913940+0000","last_change":"2024-01-19T04:17:48.828142+0000","last_active":"2024-01-19T04:18:02.913940+0000","last_peered":"2024-01-19T04:18:02.913940+0000","last_clean":"2024-01-19T04:18:02.913940+0000","last_became_active":"2024-01-19T04:17:48.827873+0000","last_became_peered":"2024-01-19T04:17:48.827873+0000","last_unstale":"2024-01-19T04:18:02.913940+0000","last_undegraded":"2024-01-19T04:18:02.913940+0000","last_fullsized":"2024-01-19T04:18:02.913940+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928117+0000","last_change":"2024-01-19T04:18:02.930483+0000","last_active":"2024-01-19T04:18:03.928117+0000","last_peered":"2024-01-19T04:18:03.928117+0000","last_clean":"2024-01-19T04:18:03.928117+0000","last_became_active":"2024-01-19T04:18:02.930228+0000","last_became_peered":"2024-01-19T04:18:02.930228+0000","last_unstale":"2024-01-19T04:18:03.928117+0000","last_undegraded":"2024-01-19T04:18:03.928117+0000","last_fullsized":"2024-01-19T04:18:03.928117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:06:16.796216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.907626+0000","last_change":"2024-01-19T04:18:01.913629+0000","last_active":"2024-01-19T04:18:02.907626+0000","last_peered":"2024-01-19T04:18:02.907626+0000","last_clean":"2024-01-19T04:18:02.907626+0000","last_became_active":"2024-01-19T04:18:01.913363+0000","last_became_peered":"2024-01-19T04:18:01.913363+0000","last_unstale":"2024-01-19T04:18:02.907626+0000","last_undegraded":"2024-01-19T04:18:02.907626+0000","last_fullsized":"2024-01-19T04:18:02.907626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:25:34.425837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.922617+0000","last_change":"2024-01-19T04:17:49.870592+0000","last_active":"2024-01-19T04:18:02.922617+0000","last_peered":"2024-01-19T04:18:02.922617+0000","last_clean":"2024-01-19T04:18:02.922617+0000","last_became_active":"2024-01-19T04:17:49.868939+0000","last_became_peered":"2024-01-19T04:17:49.868939+0000","last_unstale":"2024-01-19T04:18:02.922617+0000","last_undegraded":"2024-01-19T04:18:02.922617+0000","last_fullsized":"2024-01-19T04:18:02.922617+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"70'3","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913488+0000","last_change":"2024-01-19T04:17:48.825703+0000","last_active":"2024-01-19T04:18:02.913488+0000","last_peered":"2024-01-19T04:18:02.913488+0000","last_clean":"2024-01-19T04:18:02.913488+0000","last_became_active":"2024-01-19T04:17:48.825410+0000","last_became_peered":"2024-01-19T04:17:48.825410+0000","last_unstale":"2024-01-19T04:18:02.913488+0000","last_undegraded":"2024-01-19T04:18:02.913488+0000","last_fullsized":"2024-01-19T04:18:02.913488+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:27:59.028381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200581+0000","last_change":"2024-01-19T04:18:02.922893+0000","last_active":"2024-01-19T04:18:04.200581+0000","last_peered":"2024-01-19T04:18:04.200581+0000","last_clean":"2024-01-19T04:18:04.200581+0000","last_became_active":"2024-01-19T04:18:02.922514+0000","last_became_peered":"2024-01-19T04:18:02.922514+0000","last_unstale":"2024-01-19T04:18:04.200581+0000","last_undegraded":"2024-01-19T04:18:04.200581+0000","last_fullsized":"2024-01-19T04:18:04.200581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:49:07.769865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916214+0000","last_change":"2024-01-19T04:18:01.929737+0000","last_active":"2024-01-19T04:18:02.916214+0000","last_peered":"2024-01-19T04:18:02.916214+0000","last_clean":"2024-01-19T04:18:02.916214+0000","last_became_active":"2024-01-19T04:18:01.928808+0000","last_became_peered":"2024-01-19T04:18:01.928808+0000","last_unstale":"2024-01-19T04:18:02.916214+0000","last_undegraded":"2024-01-19T04:18:02.916214+0000","last_fullsized":"2024-01-19T04:18:02.916214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:24:52.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909533+0000","last_change":"2024-01-19T04:17:49.859589+0000","last_active":"2024-01-19T04:18:02.909533+0000","last_peered":"2024-01-19T04:18:02.909533+0000","last_clean":"2024-01-19T04:18:02.909533+0000","last_became_active":"2024-01-19T04:17:49.857553+0000","last_became_peered":"2024-01-19T04:17:49.857553+0000","last_unstale":"2024-01-19T04:18:02.909533+0000","last_undegraded":"2024-01-19T04:18:02.909533+0000","last_fullsized":"2024-01-19T04:18:02.909533+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"71'8","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914293+0000","last_change":"2024-01-19T04:17:48.824771+0000","last_active":"2024-01-19T04:18:02.914293+0000","last_peered":"2024-01-19T04:18:02.914293+0000","last_clean":"2024-01-19T04:18:02.914293+0000","last_became_active":"2024-01-19T04:17:48.824480+0000","last_became_peered":"2024-01-19T04:17:48.824480+0000","last_unstale":"2024-01-19T04:18:02.914293+0000","last_undegraded":"2024-01-19T04:18:02.914293+0000","last_fullsized":"2024-01-19T04:18:02.914293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:17:20.355098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197484+0000","last_change":"2024-01-19T04:18:02.922428+0000","last_active":"2024-01-19T04:18:04.197484+0000","last_peered":"2024-01-19T04:18:04.197484+0000","last_clean":"2024-01-19T04:18:04.197484+0000","last_became_active":"2024-01-19T04:18:02.920551+0000","last_became_peered":"2024-01-19T04:18:02.920551+0000","last_unstale":"2024-01-19T04:18:04.197484+0000","last_undegraded":"2024-01-19T04:18:04.197484+0000","last_fullsized":"2024-01-19T04:18:04.197484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:50:59.579012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197949+0000","last_change":"2024-01-19T04:18:01.924322+0000","last_active":"2024-01-19T04:18:04.197949+0000","last_peered":"2024-01-19T04:18:04.197949+0000","last_clean":"2024-01-19T04:18:04.197949+0000","last_became_active":"2024-01-19T04:18:01.923624+0000","last_became_peered":"2024-01-19T04:18:01.923624+0000","last_unstale":"2024-01-19T04:18:04.197949+0000","last_undegraded":"2024-01-19T04:18:04.197949+0000","last_fullsized":"2024-01-19T04:18:04.197949+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:15:30.969121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914355+0000","last_change":"2024-01-19T04:17:49.857760+0000","last_active":"2024-01-19T04:18:02.914355+0000","last_peered":"2024-01-19T04:18:02.914355+0000","last_clean":"2024-01-19T04:18:02.914355+0000","last_became_active":"2024-01-19T04:17:49.857510+0000","last_became_peered":"2024-01-19T04:17:49.857510+0000","last_unstale":"2024-01-19T04:18:02.914355+0000","last_undegraded":"2024-01-19T04:18:02.914355+0000","last_fullsized":"2024-01-19T04:18:02.914355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"70'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903130+0000","last_change":"2024-01-19T04:17:48.831635+0000","last_active":"2024-01-19T04:18:01.903130+0000","last_peered":"2024-01-19T04:18:01.903130+0000","last_clean":"2024-01-19T04:18:01.903130+0000","last_became_active":"2024-01-19T04:17:48.831278+0000","last_became_peered":"2024-01-19T04:17:48.831278+0000","last_unstale":"2024-01-19T04:18:01.903130+0000","last_undegraded":"2024-01-19T04:18:01.903130+0000","last_fullsized":"2024-01-19T04:18:01.903130+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:54:07.418701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.941039+0000","last_change":"2024-01-19T04:18:02.932713+0000","last_active":"2024-01-19T04:18:02.941039+0000","last_peered":"2024-01-19T04:18:02.941039+0000","last_clean":"2024-01-19T04:18:02.941039+0000","last_became_active":"2024-01-19T04:18:02.932445+0000","last_became_peered":"2024-01-19T04:18:02.932445+0000","last_unstale":"2024-01-19T04:18:02.941039+0000","last_undegraded":"2024-01-19T04:18:02.941039+0000","last_fullsized":"2024-01-19T04:18:02.941039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:41.858289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"74'8","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.948419+0000","last_change":"2024-01-19T04:18:01.918250+0000","last_active":"2024-01-19T04:18:02.948419+0000","last_peered":"2024-01-19T04:18:02.948419+0000","last_clean":"2024-01-19T04:18:02.948419+0000","last_became_active":"2024-01-19T04:18:01.917924+0000","last_became_peered":"2024-01-19T04:18:01.917924+0000","last_unstale":"2024-01-19T04:18:02.948419+0000","last_undegraded":"2024-01-19T04:18:02.948419+0000","last_fullsized":"2024-01-19T04:18:02.948419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:50:37.085285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911718+0000","last_change":"2024-01-19T04:17:49.869971+0000","last_active":"2024-01-19T04:18:02.911718+0000","last_peered":"2024-01-19T04:18:02.911718+0000","last_clean":"2024-01-19T04:18:02.911718+0000","last_became_active":"2024-01-19T04:17:49.869655+0000","last_became_peered":"2024-01-19T04:17:49.869655+0000","last_unstale":"2024-01-19T04:18:02.911718+0000","last_undegraded":"2024-01-19T04:18:02.911718+0000","last_fullsized":"2024-01-19T04:18:02.911718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:01:02.137182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.913711+0000","last_change":"2024-01-19T04:17:48.821948+0000","last_active":"2024-01-19T04:18:01.913711+0000","last_peered":"2024-01-19T04:18:01.913711+0000","last_clean":"2024-01-19T04:18:01.913711+0000","last_became_active":"2024-01-19T04:17:48.821641+0000","last_became_peered":"2024-01-19T04:17:48.821641+0000","last_unstale":"2024-01-19T04:18:01.913711+0000","last_undegraded":"2024-01-19T04:18:01.913711+0000","last_fullsized":"2024-01-19T04:18:01.913711+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:08:27.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.935700+0000","last_change":"2024-01-19T04:18:02.924344+0000","last_active":"2024-01-19T04:18:02.935700+0000","last_peered":"2024-01-19T04:18:02.935700+0000","last_clean":"2024-01-19T04:18:02.935700+0000","last_became_active":"2024-01-19T04:18:02.924124+0000","last_became_peered":"2024-01-19T04:18:02.924124+0000","last_unstale":"2024-01-19T04:18:02.935700+0000","last_undegraded":"2024-01-19T04:18:02.935700+0000","last_fullsized":"2024-01-19T04:18:02.935700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:33.530016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"74'2","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.944692+0000","last_change":"2024-01-19T04:18:01.927089+0000","last_active":"2024-01-19T04:18:02.944692+0000","last_peered":"2024-01-19T04:18:02.944692+0000","last_clean":"2024-01-19T04:18:02.944692+0000","last_became_active":"2024-01-19T04:18:01.925011+0000","last_became_peered":"2024-01-19T04:18:01.925011+0000","last_unstale":"2024-01-19T04:18:02.944692+0000","last_undegraded":"2024-01-19T04:18:02.944692+0000","last_fullsized":"2024-01-19T04:18:02.944692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:40.024706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902743+0000","last_change":"2024-01-19T04:17:49.859758+0000","last_active":"2024-01-19T04:18:01.902743+0000","last_peered":"2024-01-19T04:18:01.902743+0000","last_clean":"2024-01-19T04:18:01.902743+0000","last_became_active":"2024-01-19T04:17:49.859488+0000","last_became_peered":"2024-01-19T04:17:49.859488+0000","last_unstale":"2024-01-19T04:18:01.902743+0000","last_undegraded":"2024-01-19T04:18:01.902743+0000","last_fullsized":"2024-01-19T04:18:01.902743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:45:04.083056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.918361+0000","last_change":"2024-01-19T04:17:48.819963+0000","last_active":"2024-01-19T04:18:02.918361+0000","last_peered":"2024-01-19T04:18:02.918361+0000","last_clean":"2024-01-19T04:18:02.918361+0000","last_became_active":"2024-01-19T04:17:48.819675+0000","last_became_peered":"2024-01-19T04:17:48.819675+0000","last_unstale":"2024-01-19T04:18:02.918361+0000","last_undegraded":"2024-01-19T04:18:02.918361+0000","last_fullsized":"2024-01-19T04:18:02.918361+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:54.388146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947592+0000","last_change":"2024-01-19T04:18:02.936679+0000","last_active":"2024-01-19T04:18:02.947592+0000","last_peered":"2024-01-19T04:18:02.947592+0000","last_clean":"2024-01-19T04:18:02.947592+0000","last_became_active":"2024-01-19T04:18:02.936391+0000","last_became_peered":"2024-01-19T04:18:02.936391+0000","last_unstale":"2024-01-19T04:18:02.947592+0000","last_undegraded":"2024-01-19T04:18:02.947592+0000","last_fullsized":"2024-01-19T04:18:02.947592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:25.722081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916608+0000","last_change":"2024-01-19T04:18:01.931150+0000","last_active":"2024-01-19T04:18:02.916608+0000","last_peered":"2024-01-19T04:18:02.916608+0000","last_clean":"2024-01-19T04:18:02.916608+0000","last_became_active":"2024-01-19T04:18:01.930796+0000","last_became_peered":"2024-01-19T04:18:01.930796+0000","last_unstale":"2024-01-19T04:18:02.916608+0000","last_undegraded":"2024-01-19T04:18:02.916608+0000","last_fullsized":"2024-01-19T04:18:02.916608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:51.329669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902233+0000","last_change":"2024-01-19T04:17:49.872258+0000","last_active":"2024-01-19T04:18:01.902233+0000","last_peered":"2024-01-19T04:18:01.902233+0000","last_clean":"2024-01-19T04:18:01.902233+0000","last_became_active":"2024-01-19T04:17:49.866662+0000","last_became_peered":"2024-01-19T04:17:49.866662+0000","last_unstale":"2024-01-19T04:18:01.902233+0000","last_undegraded":"2024-01-19T04:18:01.902233+0000","last_fullsized":"2024-01-19T04:18:01.902233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:39.241053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"70'8","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915150+0000","last_change":"2024-01-19T04:17:48.827802+0000","last_active":"2024-01-19T04:18:02.915150+0000","last_peered":"2024-01-19T04:18:02.915150+0000","last_clean":"2024-01-19T04:18:02.915150+0000","last_became_active":"2024-01-19T04:17:48.827509+0000","last_became_peered":"2024-01-19T04:17:48.827509+0000","last_unstale":"2024-01-19T04:18:02.915150+0000","last_undegraded":"2024-01-19T04:18:02.915150+0000","last_fullsized":"2024-01-19T04:18:02.915150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:02:00.539469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198034+0000","last_change":"2024-01-19T04:18:02.925483+0000","last_active":"2024-01-19T04:18:04.198034+0000","last_peered":"2024-01-19T04:18:04.198034+0000","last_clean":"2024-01-19T04:18:04.198034+0000","last_became_active":"2024-01-19T04:18:02.925197+0000","last_became_peered":"2024-01-19T04:18:02.925197+0000","last_unstale":"2024-01-19T04:18:04.198034+0000","last_undegraded":"2024-01-19T04:18:04.198034+0000","last_fullsized":"2024-01-19T04:18:04.198034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:07.789402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199587+0000","last_change":"2024-01-19T04:18:01.927046+0000","last_active":"2024-01-19T04:18:04.199587+0000","last_peered":"2024-01-19T04:18:04.199587+0000","last_clean":"2024-01-19T04:18:04.199587+0000","last_became_active":"2024-01-19T04:18:01.925979+0000","last_became_peered":"2024-01-19T04:18:01.925979+0000","last_unstale":"2024-01-19T04:18:04.199587+0000","last_undegraded":"2024-01-19T04:18:04.199587+0000","last_fullsized":"2024-01-19T04:18:04.199587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:03:27.238058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.916992+0000","last_change":"2024-01-19T04:17:49.869335+0000","last_active":"2024-01-19T04:18:02.916992+0000","last_peered":"2024-01-19T04:18:02.916992+0000","last_clean":"2024-01-19T04:18:02.916992+0000","last_became_active":"2024-01-19T04:17:49.869084+0000","last_became_peered":"2024-01-19T04:17:49.869084+0000","last_unstale":"2024-01-19T04:18:02.916992+0000","last_undegraded":"2024-01-19T04:18:02.916992+0000","last_fullsized":"2024-01-19T04:18:02.916992+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:48:09.363160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914744+0000","last_change":"2024-01-19T04:17:48.827720+0000","last_active":"2024-01-19T04:18:02.914744+0000","last_peered":"2024-01-19T04:18:02.914744+0000","last_clean":"2024-01-19T04:18:02.914744+0000","last_became_active":"2024-01-19T04:17:48.827302+0000","last_became_peered":"2024-01-19T04:17:48.827302+0000","last_unstale":"2024-01-19T04:18:02.914744+0000","last_undegraded":"2024-01-19T04:18:02.914744+0000","last_fullsized":"2024-01-19T04:18:02.914744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:11:47.118667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930280+0000","last_change":"2024-01-19T04:18:02.935831+0000","last_active":"2024-01-19T04:18:03.930280+0000","last_peered":"2024-01-19T04:18:03.930280+0000","last_clean":"2024-01-19T04:18:03.930280+0000","last_became_active":"2024-01-19T04:18:02.935320+0000","last_became_peered":"2024-01-19T04:18:02.935320+0000","last_unstale":"2024-01-19T04:18:03.930280+0000","last_undegraded":"2024-01-19T04:18:03.930280+0000","last_fullsized":"2024-01-19T04:18:03.930280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:16:23.835750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928415+0000","last_change":"2024-01-19T04:18:01.917184+0000","last_active":"2024-01-19T04:18:03.928415+0000","last_peered":"2024-01-19T04:18:03.928415+0000","last_clean":"2024-01-19T04:18:03.928415+0000","last_became_active":"2024-01-19T04:18:01.916891+0000","last_became_peered":"2024-01-19T04:18:01.916891+0000","last_unstale":"2024-01-19T04:18:03.928415+0000","last_undegraded":"2024-01-19T04:18:03.928415+0000","last_fullsized":"2024-01-19T04:18:03.928415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:43:04.920800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.914369+0000","last_change":"2024-01-19T04:17:49.864846+0000","last_active":"2024-01-19T04:18:02.914369+0000","last_peered":"2024-01-19T04:18:02.914369+0000","last_clean":"2024-01-19T04:18:02.914369+0000","last_became_active":"2024-01-19T04:17:49.864174+0000","last_became_peered":"2024-01-19T04:17:49.864174+0000","last_unstale":"2024-01-19T04:18:02.914369+0000","last_undegraded":"2024-01-19T04:18:02.914369+0000","last_fullsized":"2024-01-19T04:18:02.914369+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:50:11.483763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"70'2","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.923076+0000","last_change":"2024-01-19T04:17:48.825969+0000","last_active":"2024-01-19T04:18:02.923076+0000","last_peered":"2024-01-19T04:18:02.923076+0000","last_clean":"2024-01-19T04:18:02.923076+0000","last_became_active":"2024-01-19T04:17:48.825702+0000","last_became_peered":"2024-01-19T04:17:48.825702+0000","last_unstale":"2024-01-19T04:18:02.923076+0000","last_undegraded":"2024-01-19T04:18:02.923076+0000","last_fullsized":"2024-01-19T04:18:02.923076+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:15.428133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200506+0000","last_change":"2024-01-19T04:18:02.938187+0000","last_active":"2024-01-19T04:18:04.200506+0000","last_peered":"2024-01-19T04:18:04.200506+0000","last_clean":"2024-01-19T04:18:04.200506+0000","last_became_active":"2024-01-19T04:18:02.937836+0000","last_became_peered":"2024-01-19T04:18:02.937836+0000","last_unstale":"2024-01-19T04:18:04.200506+0000","last_undegraded":"2024-01-19T04:18:04.200506+0000","last_fullsized":"2024-01-19T04:18:04.200506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:00:55.557395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.200148+0000","last_change":"2024-01-19T04:18:01.920743+0000","last_active":"2024-01-19T04:18:04.200148+0000","last_peered":"2024-01-19T04:18:04.200148+0000","last_clean":"2024-01-19T04:18:04.200148+0000","last_became_active":"2024-01-19T04:18:01.920441+0000","last_became_peered":"2024-01-19T04:18:01.920441+0000","last_unstale":"2024-01-19T04:18:04.200148+0000","last_undegraded":"2024-01-19T04:18:04.200148+0000","last_fullsized":"2024-01-19T04:18:04.200148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:06.783775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909591+0000","last_change":"2024-01-19T04:17:49.858592+0000","last_active":"2024-01-19T04:18:02.909591+0000","last_peered":"2024-01-19T04:18:02.909591+0000","last_clean":"2024-01-19T04:18:02.909591+0000","last_became_active":"2024-01-19T04:17:49.857116+0000","last_became_peered":"2024-01-19T04:17:49.857116+0000","last_unstale":"2024-01-19T04:18:02.909591+0000","last_undegraded":"2024-01-19T04:18:02.909591+0000","last_fullsized":"2024-01-19T04:18:02.909591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:50.560401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.922806+0000","last_change":"2024-01-19T04:17:48.830964+0000","last_active":"2024-01-19T04:18:02.922806+0000","last_peered":"2024-01-19T04:18:02.922806+0000","last_clean":"2024-01-19T04:18:02.922806+0000","last_became_active":"2024-01-19T04:17:48.830676+0000","last_became_peered":"2024-01-19T04:17:48.830676+0000","last_unstale":"2024-01-19T04:18:02.922806+0000","last_undegraded":"2024-01-19T04:18:02.922806+0000","last_fullsized":"2024-01-19T04:18:02.922806+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:14:11.625353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.937294+0000","last_change":"2024-01-19T04:18:02.926855+0000","last_active":"2024-01-19T04:18:02.937294+0000","last_peered":"2024-01-19T04:18:02.937294+0000","last_clean":"2024-01-19T04:18:02.937294+0000","last_became_active":"2024-01-19T04:18:02.926589+0000","last_became_peered":"2024-01-19T04:18:02.926589+0000","last_unstale":"2024-01-19T04:18:02.937294+0000","last_undegraded":"2024-01-19T04:18:02.937294+0000","last_fullsized":"2024-01-19T04:18:02.937294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:54.074135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198080+0000","last_change":"2024-01-19T04:18:01.928737+0000","last_active":"2024-01-19T04:18:04.198080+0000","last_peered":"2024-01-19T04:18:04.198080+0000","last_clean":"2024-01-19T04:18:04.198080+0000","last_became_active":"2024-01-19T04:18:01.928470+0000","last_became_peered":"2024-01-19T04:18:01.928470+0000","last_unstale":"2024-01-19T04:18:04.198080+0000","last_undegraded":"2024-01-19T04:18:04.198080+0000","last_fullsized":"2024-01-19T04:18:04.198080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:53.847378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.920866+0000","last_change":"2024-01-19T04:17:49.858880+0000","last_active":"2024-01-19T04:18:01.920866+0000","last_peered":"2024-01-19T04:18:01.920866+0000","last_clean":"2024-01-19T04:18:01.920866+0000","last_became_active":"2024-01-19T04:17:49.856868+0000","last_became_peered":"2024-01-19T04:17:49.856868+0000","last_unstale":"2024-01-19T04:18:01.920866+0000","last_undegraded":"2024-01-19T04:18:01.920866+0000","last_fullsized":"2024-01-19T04:18:01.920866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:02:54.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"70'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.909166+0000","last_change":"2024-01-19T04:17:48.827089+0000","last_active":"2024-01-19T04:18:01.909166+0000","last_peered":"2024-01-19T04:18:01.909166+0000","last_clean":"2024-01-19T04:18:01.909166+0000","last_became_active":"2024-01-19T04:17:48.826683+0000","last_became_peered":"2024-01-19T04:17:48.826683+0000","last_unstale":"2024-01-19T04:18:01.909166+0000","last_undegraded":"2024-01-19T04:18:01.909166+0000","last_fullsized":"2024-01-19T04:18:01.909166+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:57:37.292333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197631+0000","last_change":"2024-01-19T04:18:02.925453+0000","last_active":"2024-01-19T04:18:04.197631+0000","last_peered":"2024-01-19T04:18:04.197631+0000","last_clean":"2024-01-19T04:18:04.197631+0000","last_became_active":"2024-01-19T04:18:02.925115+0000","last_became_peered":"2024-01-19T04:18:02.925115+0000","last_unstale":"2024-01-19T04:18:04.197631+0000","last_undegraded":"2024-01-19T04:18:04.197631+0000","last_fullsized":"2024-01-19T04:18:04.197631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:23.408554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927309+0000","last_change":"2024-01-19T04:18:01.924668+0000","last_active":"2024-01-19T04:18:03.927309+0000","last_peered":"2024-01-19T04:18:03.927309+0000","last_clean":"2024-01-19T04:18:03.927309+0000","last_became_active":"2024-01-19T04:18:01.924406+0000","last_became_peered":"2024-01-19T04:18:01.924406+0000","last_unstale":"2024-01-19T04:18:03.927309+0000","last_undegraded":"2024-01-19T04:18:03.927309+0000","last_fullsized":"2024-01-19T04:18:03.927309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:12.882007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915958+0000","last_change":"2024-01-19T04:17:49.863061+0000","last_active":"2024-01-19T04:18:02.915958+0000","last_peered":"2024-01-19T04:18:02.915958+0000","last_clean":"2024-01-19T04:18:02.915958+0000","last_became_active":"2024-01-19T04:17:49.862748+0000","last_became_peered":"2024-01-19T04:17:49.862748+0000","last_unstale":"2024-01-19T04:18:02.915958+0000","last_undegraded":"2024-01-19T04:18:02.915958+0000","last_fullsized":"2024-01-19T04:18:02.915958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:42:46.143048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.920956+0000","last_change":"2024-01-19T04:17:48.831189+0000","last_active":"2024-01-19T04:18:01.920956+0000","last_peered":"2024-01-19T04:18:01.920956+0000","last_clean":"2024-01-19T04:18:01.920956+0000","last_became_active":"2024-01-19T04:17:48.830902+0000","last_became_peered":"2024-01-19T04:17:48.830902+0000","last_unstale":"2024-01-19T04:18:01.920956+0000","last_undegraded":"2024-01-19T04:18:01.920956+0000","last_fullsized":"2024-01-19T04:18:01.920956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:30:00.718052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.934160+0000","last_change":"2024-01-19T04:18:02.926417+0000","last_active":"2024-01-19T04:18:02.934160+0000","last_peered":"2024-01-19T04:18:02.934160+0000","last_clean":"2024-01-19T04:18:02.934160+0000","last_became_active":"2024-01-19T04:18:02.926144+0000","last_became_peered":"2024-01-19T04:18:02.926144+0000","last_unstale":"2024-01-19T04:18:02.934160+0000","last_undegraded":"2024-01-19T04:18:02.934160+0000","last_fullsized":"2024-01-19T04:18:02.934160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:47:09.328080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927919+0000","last_change":"2024-01-19T04:18:01.927501+0000","last_active":"2024-01-19T04:18:03.927919+0000","last_peered":"2024-01-19T04:18:03.927919+0000","last_clean":"2024-01-19T04:18:03.927919+0000","last_became_active":"2024-01-19T04:18:01.927208+0000","last_became_peered":"2024-01-19T04:18:01.927208+0000","last_unstale":"2024-01-19T04:18:03.927919+0000","last_undegraded":"2024-01-19T04:18:03.927919+0000","last_fullsized":"2024-01-19T04:18:03.927919+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:34:34.641792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.916012+0000","last_change":"2024-01-19T04:17:49.868600+0000","last_active":"2024-01-19T04:18:01.916012+0000","last_peered":"2024-01-19T04:18:01.916012+0000","last_clean":"2024-01-19T04:18:01.916012+0000","last_became_active":"2024-01-19T04:17:49.868291+0000","last_became_peered":"2024-01-19T04:17:49.868291+0000","last_unstale":"2024-01-19T04:18:01.916012+0000","last_undegraded":"2024-01-19T04:18:01.916012+0000","last_fullsized":"2024-01-19T04:18:01.916012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:42:11.307285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.916674+0000","last_change":"2024-01-19T04:17:48.825930+0000","last_active":"2024-01-19T04:18:01.916674+0000","last_peered":"2024-01-19T04:18:01.916674+0000","last_clean":"2024-01-19T04:18:01.916674+0000","last_became_active":"2024-01-19T04:17:48.825661+0000","last_became_peered":"2024-01-19T04:17:48.825661+0000","last_unstale":"2024-01-19T04:18:01.916674+0000","last_undegraded":"2024-01-19T04:18:01.916674+0000","last_fullsized":"2024-01-19T04:18:01.916674+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:24.692647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.944770+0000","last_change":"2024-01-19T04:18:02.943217+0000","last_active":"2024-01-19T04:18:02.944770+0000","last_peered":"2024-01-19T04:18:02.944770+0000","last_clean":"2024-01-19T04:18:02.944770+0000","last_became_active":"2024-01-19T04:18:02.942211+0000","last_became_peered":"2024-01-19T04:18:02.942211+0000","last_unstale":"2024-01-19T04:18:02.944770+0000","last_undegraded":"2024-01-19T04:18:02.944770+0000","last_fullsized":"2024-01-19T04:18:02.944770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:26:42.528428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198351+0000","last_change":"2024-01-19T04:18:01.918277+0000","last_active":"2024-01-19T04:18:04.198351+0000","last_peered":"2024-01-19T04:18:04.198351+0000","last_clean":"2024-01-19T04:18:04.198351+0000","last_became_active":"2024-01-19T04:18:01.918001+0000","last_became_peered":"2024-01-19T04:18:01.918001+0000","last_unstale":"2024-01-19T04:18:04.198351+0000","last_undegraded":"2024-01-19T04:18:04.198351+0000","last_fullsized":"2024-01-19T04:18:04.198351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:01:14.225799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.918275+0000","last_change":"2024-01-19T04:17:49.869790+0000","last_active":"2024-01-19T04:18:02.918275+0000","last_peered":"2024-01-19T04:18:02.918275+0000","last_clean":"2024-01-19T04:18:02.918275+0000","last_became_active":"2024-01-19T04:17:49.869425+0000","last_became_peered":"2024-01-19T04:17:49.869425+0000","last_unstale":"2024-01-19T04:18:02.918275+0000","last_undegraded":"2024-01-19T04:18:02.918275+0000","last_fullsized":"2024-01-19T04:18:02.918275+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:32:33.392019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.917018+0000","last_change":"2024-01-19T04:17:48.818976+0000","last_active":"2024-01-19T04:18:01.917018+0000","last_peered":"2024-01-19T04:18:01.917018+0000","last_clean":"2024-01-19T04:18:01.917018+0000","last_became_active":"2024-01-19T04:17:48.818650+0000","last_became_peered":"2024-01-19T04:17:48.818650+0000","last_unstale":"2024-01-19T04:18:01.917018+0000","last_undegraded":"2024-01-19T04:18:01.917018+0000","last_fullsized":"2024-01-19T04:18:01.917018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:06:19.196961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.946870+0000","last_change":"2024-01-19T04:18:02.923838+0000","last_active":"2024-01-19T04:18:02.946870+0000","last_peered":"2024-01-19T04:18:02.946870+0000","last_clean":"2024-01-19T04:18:02.946870+0000","last_became_active":"2024-01-19T04:18:02.923366+0000","last_became_peered":"2024-01-19T04:18:02.923366+0000","last_unstale":"2024-01-19T04:18:02.946870+0000","last_undegraded":"2024-01-19T04:18:02.946870+0000","last_fullsized":"2024-01-19T04:18:02.946870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:32.839187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928129+0000","last_change":"2024-01-19T04:18:01.931313+0000","last_active":"2024-01-19T04:18:03.928129+0000","last_peered":"2024-01-19T04:18:03.928129+0000","last_clean":"2024-01-19T04:18:03.928129+0000","last_became_active":"2024-01-19T04:18:01.926362+0000","last_became_peered":"2024-01-19T04:18:01.926362+0000","last_unstale":"2024-01-19T04:18:03.928129+0000","last_undegraded":"2024-01-19T04:18:03.928129+0000","last_fullsized":"2024-01-19T04:18:03.928129+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:50:58.573385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909895+0000","last_change":"2024-01-19T04:17:49.863529+0000","last_active":"2024-01-19T04:18:02.909895+0000","last_peered":"2024-01-19T04:18:02.909895+0000","last_clean":"2024-01-19T04:18:02.909895+0000","last_became_active":"2024-01-19T04:17:49.863271+0000","last_became_peered":"2024-01-19T04:17:49.863271+0000","last_unstale":"2024-01-19T04:18:02.909895+0000","last_undegraded":"2024-01-19T04:18:02.909895+0000","last_fullsized":"2024-01-19T04:18:02.909895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:10:52.250052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"70'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903389+0000","last_change":"2024-01-19T04:17:48.833146+0000","last_active":"2024-01-19T04:18:01.903389+0000","last_peered":"2024-01-19T04:18:01.903389+0000","last_clean":"2024-01-19T04:18:01.903389+0000","last_became_active":"2024-01-19T04:17:48.832826+0000","last_became_peered":"2024-01-19T04:17:48.832826+0000","last_unstale":"2024-01-19T04:18:01.903389+0000","last_undegraded":"2024-01-19T04:18:01.903389+0000","last_fullsized":"2024-01-19T04:18:01.903389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:42:10.304801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199502+0000","last_change":"2024-01-19T04:18:02.928155+0000","last_active":"2024-01-19T04:18:04.199502+0000","last_peered":"2024-01-19T04:18:04.199502+0000","last_clean":"2024-01-19T04:18:04.199502+0000","last_became_active":"2024-01-19T04:18:02.927913+0000","last_became_peered":"2024-01-19T04:18:02.927913+0000","last_unstale":"2024-01-19T04:18:04.199502+0000","last_undegraded":"2024-01-19T04:18:04.199502+0000","last_fullsized":"2024-01-19T04:18:04.199502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:49:07.769865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.199327+0000","last_change":"2024-01-19T04:18:01.928786+0000","last_active":"2024-01-19T04:18:04.199327+0000","last_peered":"2024-01-19T04:18:04.199327+0000","last_clean":"2024-01-19T04:18:04.199327+0000","last_became_active":"2024-01-19T04:18:01.927607+0000","last_became_peered":"2024-01-19T04:18:01.927607+0000","last_unstale":"2024-01-19T04:18:04.199327+0000","last_undegraded":"2024-01-19T04:18:04.199327+0000","last_fullsized":"2024-01-19T04:18:04.199327+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:11.605030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917248+0000","last_change":"2024-01-19T04:17:49.868872+0000","last_active":"2024-01-19T04:18:02.917248+0000","last_peered":"2024-01-19T04:18:02.917248+0000","last_clean":"2024-01-19T04:18:02.917248+0000","last_became_active":"2024-01-19T04:17:49.867227+0000","last_became_peered":"2024-01-19T04:17:49.867227+0000","last_unstale":"2024-01-19T04:18:02.917248+0000","last_undegraded":"2024-01-19T04:18:02.917248+0000","last_fullsized":"2024-01-19T04:18:02.917248+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:07:41.758761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"71'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.903668+0000","last_change":"2024-01-19T04:17:48.832316+0000","last_active":"2024-01-19T04:18:01.903668+0000","last_peered":"2024-01-19T04:18:01.903668+0000","last_clean":"2024-01-19T04:18:01.903668+0000","last_became_active":"2024-01-19T04:17:48.831448+0000","last_became_peered":"2024-01-19T04:17:48.831448+0000","last_unstale":"2024-01-19T04:18:01.903668+0000","last_undegraded":"2024-01-19T04:18:01.903668+0000","last_fullsized":"2024-01-19T04:18:01.903668+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:08:13.752237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928239+0000","last_change":"2024-01-19T04:18:02.934481+0000","last_active":"2024-01-19T04:18:03.928239+0000","last_peered":"2024-01-19T04:18:03.928239+0000","last_clean":"2024-01-19T04:18:03.928239+0000","last_became_active":"2024-01-19T04:18:02.933720+0000","last_became_peered":"2024-01-19T04:18:02.933720+0000","last_unstale":"2024-01-19T04:18:03.928239+0000","last_undegraded":"2024-01-19T04:18:03.928239+0000","last_fullsized":"2024-01-19T04:18:03.928239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:09:41.427578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198784+0000","last_change":"2024-01-19T04:18:01.925256+0000","last_active":"2024-01-19T04:18:04.198784+0000","last_peered":"2024-01-19T04:18:04.198784+0000","last_clean":"2024-01-19T04:18:04.198784+0000","last_became_active":"2024-01-19T04:18:01.924788+0000","last_became_peered":"2024-01-19T04:18:01.924788+0000","last_unstale":"2024-01-19T04:18:04.198784+0000","last_undegraded":"2024-01-19T04:18:04.198784+0000","last_fullsized":"2024-01-19T04:18:04.198784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:48:21.451777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913504+0000","last_change":"2024-01-19T04:17:49.873308+0000","last_active":"2024-01-19T04:18:02.913504+0000","last_peered":"2024-01-19T04:18:02.913504+0000","last_clean":"2024-01-19T04:18:02.913504+0000","last_became_active":"2024-01-19T04:17:49.872896+0000","last_became_peered":"2024-01-19T04:17:49.872896+0000","last_unstale":"2024-01-19T04:18:02.913504+0000","last_undegraded":"2024-01-19T04:18:02.913504+0000","last_fullsized":"2024-01-19T04:18:02.913504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:58:44.021386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913609+0000","last_change":"2024-01-19T04:17:48.826005+0000","last_active":"2024-01-19T04:18:02.913609+0000","last_peered":"2024-01-19T04:18:02.913609+0000","last_clean":"2024-01-19T04:18:02.913609+0000","last_became_active":"2024-01-19T04:17:48.825576+0000","last_became_peered":"2024-01-19T04:17:48.825576+0000","last_unstale":"2024-01-19T04:18:02.913609+0000","last_undegraded":"2024-01-19T04:18:02.913609+0000","last_fullsized":"2024-01-19T04:18:02.913609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:57:39.977407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.947464+0000","last_change":"2024-01-19T04:18:02.933870+0000","last_active":"2024-01-19T04:18:02.947464+0000","last_peered":"2024-01-19T04:18:02.947464+0000","last_clean":"2024-01-19T04:18:02.947464+0000","last_became_active":"2024-01-19T04:18:02.933602+0000","last_became_peered":"2024-01-19T04:18:02.933602+0000","last_unstale":"2024-01-19T04:18:02.947464+0000","last_undegraded":"2024-01-19T04:18:02.947464+0000","last_fullsized":"2024-01-19T04:18:02.947464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:22.984665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.928649+0000","last_change":"2024-01-19T04:18:01.934770+0000","last_active":"2024-01-19T04:18:03.928649+0000","last_peered":"2024-01-19T04:18:03.928649+0000","last_clean":"2024-01-19T04:18:03.928649+0000","last_became_active":"2024-01-19T04:18:01.934480+0000","last_became_peered":"2024-01-19T04:18:01.934480+0000","last_unstale":"2024-01-19T04:18:03.928649+0000","last_undegraded":"2024-01-19T04:18:03.928649+0000","last_fullsized":"2024-01-19T04:18:03.928649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T04:47:22.402927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.909616+0000","last_change":"2024-01-19T04:17:49.853797+0000","last_active":"2024-01-19T04:18:02.909616+0000","last_peered":"2024-01-19T04:18:02.909616+0000","last_clean":"2024-01-19T04:18:02.909616+0000","last_became_active":"2024-01-19T04:17:49.853513+0000","last_became_peered":"2024-01-19T04:17:49.853513+0000","last_unstale":"2024-01-19T04:18:02.909616+0000","last_undegraded":"2024-01-19T04:18:02.909616+0000","last_fullsized":"2024-01-19T04:18:02.909616+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.913590+0000","last_change":"2024-01-19T04:17:48.824215+0000","last_active":"2024-01-19T04:18:02.913590+0000","last_peered":"2024-01-19T04:18:02.913590+0000","last_clean":"2024-01-19T04:18:02.913590+0000","last_became_active":"2024-01-19T04:17:48.823939+0000","last_became_peered":"2024-01-19T04:17:48.823939+0000","last_unstale":"2024-01-19T04:18:02.913590+0000","last_undegraded":"2024-01-19T04:18:02.913590+0000","last_fullsized":"2024-01-19T04:18:02.913590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:21:30.982834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.927076+0000","last_change":"2024-01-19T04:18:02.920688+0000","last_active":"2024-01-19T04:18:02.927076+0000","last_peered":"2024-01-19T04:18:02.927076+0000","last_clean":"2024-01-19T04:18:02.927076+0000","last_became_active":"2024-01-19T04:18:02.919719+0000","last_became_peered":"2024-01-19T04:18:02.919719+0000","last_unstale":"2024-01-19T04:18:02.927076+0000","last_undegraded":"2024-01-19T04:18:02.927076+0000","last_fullsized":"2024-01-19T04:18:02.927076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:45:17.177300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915279+0000","last_change":"2024-01-19T04:18:01.932112+0000","last_active":"2024-01-19T04:18:02.915279+0000","last_peered":"2024-01-19T04:18:02.915279+0000","last_clean":"2024-01-19T04:18:02.915279+0000","last_became_active":"2024-01-19T04:18:01.931852+0000","last_became_peered":"2024-01-19T04:18:01.931852+0000","last_unstale":"2024-01-19T04:18:02.915279+0000","last_undegraded":"2024-01-19T04:18:02.915279+0000","last_fullsized":"2024-01-19T04:18:02.915279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:08:44.795847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917732+0000","last_change":"2024-01-19T04:17:49.871059+0000","last_active":"2024-01-19T04:18:02.917732+0000","last_peered":"2024-01-19T04:18:02.917732+0000","last_clean":"2024-01-19T04:18:02.917732+0000","last_became_active":"2024-01-19T04:17:49.870787+0000","last_became_peered":"2024-01-19T04:17:49.870787+0000","last_unstale":"2024-01-19T04:18:02.917732+0000","last_undegraded":"2024-01-19T04:18:02.917732+0000","last_fullsized":"2024-01-19T04:18:02.917732+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921795+0000","last_change":"2024-01-19T04:17:48.829763+0000","last_active":"2024-01-19T04:18:02.921795+0000","last_peered":"2024-01-19T04:18:02.921795+0000","last_clean":"2024-01-19T04:18:02.921795+0000","last_became_active":"2024-01-19T04:17:48.829423+0000","last_became_peered":"2024-01-19T04:17:48.829423+0000","last_unstale":"2024-01-19T04:18:02.921795+0000","last_undegraded":"2024-01-19T04:18:02.921795+0000","last_fullsized":"2024-01-19T04:18:02.921795+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:04:18.742459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197718+0000","last_change":"2024-01-19T04:18:02.928494+0000","last_active":"2024-01-19T04:18:04.197718+0000","last_peered":"2024-01-19T04:18:04.197718+0000","last_clean":"2024-01-19T04:18:04.197718+0000","last_became_active":"2024-01-19T04:18:02.927013+0000","last_became_peered":"2024-01-19T04:18:02.927013+0000","last_unstale":"2024-01-19T04:18:04.197718+0000","last_undegraded":"2024-01-19T04:18:04.197718+0000","last_fullsized":"2024-01-19T04:18:04.197718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:24:10.425113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.915840+0000","last_change":"2024-01-19T04:18:01.918315+0000","last_active":"2024-01-19T04:18:02.915840+0000","last_peered":"2024-01-19T04:18:02.915840+0000","last_clean":"2024-01-19T04:18:02.915840+0000","last_became_active":"2024-01-19T04:18:01.918035+0000","last_became_peered":"2024-01-19T04:18:01.918035+0000","last_unstale":"2024-01-19T04:18:02.915840+0000","last_undegraded":"2024-01-19T04:18:02.915840+0000","last_fullsized":"2024-01-19T04:18:02.915840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:27:22.120110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.921565+0000","last_change":"2024-01-19T04:17:49.853592+0000","last_active":"2024-01-19T04:18:02.921565+0000","last_peered":"2024-01-19T04:18:02.921565+0000","last_clean":"2024-01-19T04:18:02.921565+0000","last_became_active":"2024-01-19T04:17:49.853258+0000","last_became_peered":"2024-01-19T04:17:49.853258+0000","last_unstale":"2024-01-19T04:18:02.921565+0000","last_undegraded":"2024-01-19T04:18:02.921565+0000","last_fullsized":"2024-01-19T04:18:02.921565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:29:36.585805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908765+0000","last_change":"2024-01-19T04:17:48.818290+0000","last_active":"2024-01-19T04:18:02.908765+0000","last_peered":"2024-01-19T04:18:02.908765+0000","last_clean":"2024-01-19T04:18:02.908765+0000","last_became_active":"2024-01-19T04:17:48.816299+0000","last_became_peered":"2024-01-19T04:17:48.816299+0000","last_unstale":"2024-01-19T04:18:02.908765+0000","last_undegraded":"2024-01-19T04:18:02.908765+0000","last_fullsized":"2024-01-19T04:18:02.908765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:13.137586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.940375+0000","last_change":"2024-01-19T04:18:02.930110+0000","last_active":"2024-01-19T04:18:02.940375+0000","last_peered":"2024-01-19T04:18:02.940375+0000","last_clean":"2024-01-19T04:18:02.940375+0000","last_became_active":"2024-01-19T04:18:02.929615+0000","last_became_peered":"2024-01-19T04:18:02.929615+0000","last_unstale":"2024-01-19T04:18:02.940375+0000","last_undegraded":"2024-01-19T04:18:02.940375+0000","last_fullsized":"2024-01-19T04:18:02.940375+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:27.234314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.927738+0000","last_change":"2024-01-19T04:18:01.929019+0000","last_active":"2024-01-19T04:18:03.927738+0000","last_peered":"2024-01-19T04:18:03.927738+0000","last_clean":"2024-01-19T04:18:03.927738+0000","last_became_active":"2024-01-19T04:18:01.928692+0000","last_became_peered":"2024-01-19T04:18:01.928692+0000","last_unstale":"2024-01-19T04:18:03.927738+0000","last_undegraded":"2024-01-19T04:18:03.927738+0000","last_fullsized":"2024-01-19T04:18:03.927738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:30.941043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911113+0000","last_change":"2024-01-19T04:17:49.877548+0000","last_active":"2024-01-19T04:18:02.911113+0000","last_peered":"2024-01-19T04:18:02.911113+0000","last_clean":"2024-01-19T04:18:02.911113+0000","last_became_active":"2024-01-19T04:17:49.877156+0000","last_became_peered":"2024-01-19T04:17:49.877156+0000","last_unstale":"2024-01-19T04:18:02.911113+0000","last_undegraded":"2024-01-19T04:18:02.911113+0000","last_fullsized":"2024-01-19T04:18:02.911113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:26.768523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911746+0000","last_change":"2024-01-19T04:17:48.826712+0000","last_active":"2024-01-19T04:18:02.911746+0000","last_peered":"2024-01-19T04:18:02.911746+0000","last_clean":"2024-01-19T04:18:02.911746+0000","last_became_active":"2024-01-19T04:17:48.826457+0000","last_became_peered":"2024-01-19T04:17:48.826457+0000","last_unstale":"2024-01-19T04:18:02.911746+0000","last_undegraded":"2024-01-19T04:18:02.911746+0000","last_fullsized":"2024-01-19T04:18:02.911746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:46:55.231352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.198028+0000","last_change":"2024-01-19T04:18:02.921273+0000","last_active":"2024-01-19T04:18:04.198028+0000","last_peered":"2024-01-19T04:18:04.198028+0000","last_clean":"2024-01-19T04:18:04.198028+0000","last_became_active":"2024-01-19T04:18:02.917630+0000","last_became_peered":"2024-01-19T04:18:02.917630+0000","last_unstale":"2024-01-19T04:18:04.198028+0000","last_undegraded":"2024-01-19T04:18:04.198028+0000","last_fullsized":"2024-01-19T04:18:04.198028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:43:05.926427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:04.197935+0000","last_change":"2024-01-19T04:18:01.931340+0000","last_active":"2024-01-19T04:18:04.197935+0000","last_peered":"2024-01-19T04:18:04.197935+0000","last_clean":"2024-01-19T04:18:04.197935+0000","last_became_active":"2024-01-19T04:18:01.931097+0000","last_became_peered":"2024-01-19T04:18:01.931097+0000","last_unstale":"2024-01-19T04:18:04.197935+0000","last_undegraded":"2024-01-19T04:18:04.197935+0000","last_fullsized":"2024-01-19T04:18:04.197935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:31:06.783775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911503+0000","last_change":"2024-01-19T04:17:49.862665+0000","last_active":"2024-01-19T04:18:02.911503+0000","last_peered":"2024-01-19T04:18:02.911503+0000","last_clean":"2024-01-19T04:18:02.911503+0000","last_became_active":"2024-01-19T04:17:49.862396+0000","last_became_peered":"2024-01-19T04:17:49.862396+0000","last_unstale":"2024-01-19T04:18:02.911503+0000","last_undegraded":"2024-01-19T04:18:02.911503+0000","last_fullsized":"2024-01-19T04:18:02.911503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:01:31.016854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.908239+0000","last_change":"2024-01-19T04:17:48.826398+0000","last_active":"2024-01-19T04:18:02.908239+0000","last_peered":"2024-01-19T04:18:02.908239+0000","last_clean":"2024-01-19T04:18:02.908239+0000","last_became_active":"2024-01-19T04:17:48.824417+0000","last_became_peered":"2024-01-19T04:17:48.824417+0000","last_unstale":"2024-01-19T04:18:02.908239+0000","last_undegraded":"2024-01-19T04:18:02.908239+0000","last_fullsized":"2024-01-19T04:18:02.908239+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:06:27.761561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.942337+0000","last_change":"2024-01-19T04:18:02.939162+0000","last_active":"2024-01-19T04:18:02.942337+0000","last_peered":"2024-01-19T04:18:02.942337+0000","last_clean":"2024-01-19T04:18:02.942337+0000","last_became_active":"2024-01-19T04:18:02.938377+0000","last_became_peered":"2024-01-19T04:18:02.938377+0000","last_unstale":"2024-01-19T04:18:02.942337+0000","last_undegraded":"2024-01-19T04:18:02.942337+0000","last_fullsized":"2024-01-19T04:18:02.942337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:01.892519+0000","last_clean_scrub_stamp":"2024-01-19T04:18:01.892519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:12:01.215395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-19T04:18:03.930147+0000","last_change":"2024-01-19T04:18:01.928794+0000","last_active":"2024-01-19T04:18:03.930147+0000","last_peered":"2024-01-19T04:18:03.930147+0000","last_clean":"2024-01-19T04:18:03.930147+0000","last_became_active":"2024-01-19T04:18:01.928502+0000","last_became_peered":"2024-01-19T04:18:01.928502+0000","last_unstale":"2024-01-19T04:18:03.930147+0000","last_undegraded":"2024-01-19T04:18:03.930147+0000","last_fullsized":"2024-01-19T04:18:03.930147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:18:00.886892+0000","last_clean_scrub_stamp":"2024-01-19T04:18:00.886892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:38:12.882007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-19T04:18:01.902607+0000","last_change":"2024-01-19T04:17:49.870926+0000","last_active":"2024-01-19T04:18:01.902607+0000","last_peered":"2024-01-19T04:18:01.902607+0000","last_clean":"2024-01-19T04:18:01.902607+0000","last_became_active":"2024-01-19T04:17:49.870647+0000","last_became_peered":"2024-01-19T04:17:49.870647+0000","last_unstale":"2024-01-19T04:18:01.902607+0000","last_undegraded":"2024-01-19T04:18:01.902607+0000","last_fullsized":"2024-01-19T04:18:01.902607+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:48.798275+0000","last_clean_scrub_stamp":"2024-01-19T04:17:48.798275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:28:01.549284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"70'1","reported_seq":17,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.917634+0000","last_change":"2024-01-19T04:17:48.826402+0000","last_active":"2024-01-19T04:18:02.917634+0000","last_peered":"2024-01-19T04:18:02.917634+0000","last_clean":"2024-01-19T04:18:02.917634+0000","last_became_active":"2024-01-19T04:17:48.826139+0000","last_became_peered":"2024-01-19T04:17:48.826139+0000","last_unstale":"2024-01-19T04:18:02.917634+0000","last_undegraded":"2024-01-19T04:18:02.917634+0000","last_fullsized":"2024-01-19T04:18:02.917634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:17:47.795791+0000","last_clean_scrub_stamp":"2024-01-19T04:17:47.795791+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:01:15.428133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":209,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-19T04:18:02.911212+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:18:02.911212+0000","last_peered":"2024-01-19T04:18:02.911212+0000","last_clean":"2024-01-19T04:18:02.911212+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:18:02.911212+0000","last_undegraded":"2024-01-19T04:18:02.911212+0000","last_fullsized":"2024-01-19T04:18:02.911212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476778,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":992299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.036,"15min":1.036},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":1.228,"15min":1.228},"last":1.3340000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.626}]},{"osd":2,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84699999999999998,"5min":1.661,"15min":1.661},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81399999999999995,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.274}]},{"osd":3,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.78000000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.23},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.86699999999999999,"5min":1.49,"15min":1.49},"last":1.0069999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.133},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.746},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.51600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":1.514,"15min":1.514},"last":1.1990000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.65300000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0069999999999999,"5min":1.391,"15min":1.391},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":1.359,"15min":1.359},"last":1.161}]}]},{"osd":6,"up_from":16,"seq":68719476778,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":403095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.498},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66300000000000003,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.754}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476777,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":404948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.012}]},{"osd":1,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.98199999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96399999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83199999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.014,"15min":1.014},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67100000000000004,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.624,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80800000000000005,"5min":1.107,"15min":1.107},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94899999999999995,"5min":1.246,"15min":1.246},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.86599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.708,"15min":1.708},"last":0.71699999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476779,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":929792,"data_stored":403485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":0.997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84999999999999998,"5min":1.25,"15min":1.25},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.147,"15min":1.147},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97699999999999998,"5min":1.175,"15min":1.175},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0469999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":1.224,"15min":1.224},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0700000000000001,"5min":1.381,"15min":1.381},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.119,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.753}]},{"osd":7,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.139,"15min":1.139},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1830000000000001,"5min":1.266,"15min":1.266},"last":0.88100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":395208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64000000000000001,"5min":0.879,"15min":0.879},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.57299999999999995},"min":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81599999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71599999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3480000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.135,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.98499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2789999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2350000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.085,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.085}]}]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":394786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.41699999999999998},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":1.964,"15min":1.964},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55800000000000005,"15min":0.58599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64900000000000002,"5min":2.827,"15min":2.827},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56200000000000006,"5min":2.343,"15min":2.343},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":1.665,"15min":1.665},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.042,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92900000000000005,"5min":1.198,"15min":1.198},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0089999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0600000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.878,"15min":0.93899999999999995},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.70999999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1499136,"data_stored":985576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.54500000000000004,"15min":0.60999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":2.1030000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.56299999999999994,"15min":0.621},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56899999999999995,"5min":3.129,"15min":3.129},"last":2.548}]},{"osd":2,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.624,"15min":0.68600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66400000000000003,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":1.407},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58499999999999996,"15min":0.64500000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68000000000000005,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":2.7930000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.73699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.63800000000000001,"5min":3.633,"15min":3.633},"last":2.6360000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.64500000000000002,"15min":0.72699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":3.0670000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89000000000000001,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.88300000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":2.7160000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.90100000000000002,"15min":0.98599999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":2.1459999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91900000000000004,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93200000000000005,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":1.488},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":1.032},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94599999999999995,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":2.6779999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.95699999999999996,"15min":1.0600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88700000000000001,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":1.45},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91400000000000003,"15min":0.98999999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":2.7549999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.97899999999999998},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":2.181},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.98599999999999999,"15min":1.0800000000000001},"min":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94399999999999995,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":1.534}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":897024,"data_stored":390066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.52700000000000002,"15min":0.57299999999999995},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1359999999999999,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.373,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.70799999999999996,"15min":0.79500000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.67100000000000004},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.8759999999999999,"5min":5.226,"15min":5.226},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67400000000000004,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.972,"5min":5.319,"15min":5.319},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66100000000000003,"15min":0.72699999999999998},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.1759999999999999,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.432}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88,"15min":0.93799999999999994},"min":{"1min":0.49099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.085,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.51800000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.669,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.629}]},{"osd":6,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9319999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.498},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.93899999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2170000000000001,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3129999999999999,"5min":5.423,"15min":5.423},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.97699999999999998,"15min":1.0609999999999999},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.022,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:18:07.451 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T04:18:07.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-19T04:18:07.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.632+0000 7f84da600640 1 Processor -- start 2024-01-19T04:18:07.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.632+0000 7f84da600640 1 -- start start 2024-01-19T04:18:07.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84da600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40c55d0 0x7f84d406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84da600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40c0eb0 con 0x7f84d406cab0 2024-01-19T04:18:07.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84da600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40a5330 con 0x7f84d40705b0 2024-01-19T04:18:07.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84da600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d406e5c0 con 0x7f84d40c55d0 2024-01-19T04:18:07.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d3400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f84d406cab0 0x7f84d40c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46936/0 (socket says 172.21.15.32:46936) 2024-01-19T04:18:07.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d3400640 1 -- 172.21.15.32:0/1403549567 learned_addr learned my addr 172.21.15.32:0/1403549567 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:07.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2a00640 1 --2- 172.21.15.32:0/1403549567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40c55d0 0x7f84d406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2000640 1 -- 172.21.15.32:0/1403549567 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022118641 0 0) 0x7f84d40c0eb0 con 0x7f84d406cab0 2024-01-19T04:18:07.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2000640 1 -- 172.21.15.32:0/1403549567 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b4003530 con 0x7f84d406cab0 2024-01-19T04:18:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2000640 1 -- 172.21.15.32:0/1403549567 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405834270 0 0) 0x7f84d40a5330 con 0x7f84d40705b0 2024-01-19T04:18:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2000640 1 -- 172.21.15.32:0/1403549567 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d40c0eb0 con 0x7f84d40705b0 2024-01-19T04:18:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2a00640 1 -- 172.21.15.32:0/1403549567 >> v1:172.21.15.67:6789/0 conn(0x7f84d40705b0 legacy=0x7f84d415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2a00640 1 -- 172.21.15.32:0/1403549567 >> v1:172.21.15.32:6789/0 conn(0x7f84d406cab0 legacy=0x7f84d40c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.636+0000 7f84d2a00640 1 -- 172.21.15.32:0/1403549567 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d41516f0 con 0x7f84d40c55d0 2024-01-19T04:18:07.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84d2a00640 1 --2- 172.21.15.32:0/1403549567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40c55d0 0x7f84d406ce90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00a990 tx=0x7f84bc01d860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d1b8f522482e25 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:07.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84d2000640 1 -- 172.21.15.32:0/1403549567 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0a6910 con 0x7f84d40c55d0 2024-01-19T04:18:07.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84d2000640 1 -- 172.21.15.32:0/1403549567 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc0a6a70 con 0x7f84d40c55d0 2024-01-19T04:18:07.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84d2000640 1 -- 172.21.15.32:0/1403549567 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0a6e00 con 0x7f84d40c55d0 2024-01-19T04:18:07.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 -- 172.21.15.32:0/1403549567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40c55d0 msgr2=0x7f84d406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 --2- 172.21.15.32:0/1403549567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40c55d0 0x7f84d406ce90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00a990 tx=0x7f84bc01d860 comp rx=0 tx=0).stop 2024-01-19T04:18:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 -- 172.21.15.32:0/1403549567 shutdown_connections 2024-01-19T04:18:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 --2- 172.21.15.32:0/1403549567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40c55d0 0x7f84d406ce90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 -- 172.21.15.32:0/1403549567 >> 172.21.15.32:0/1403549567 conn(0x7f84d40c25a0 msgr2=0x7f84d40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 -- 172.21.15.32:0/1403549567 shutdown_connections 2024-01-19T04:18:07.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 -- 172.21.15.32:0/1403549567 wait complete. 2024-01-19T04:18:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 Processor -- start 2024-01-19T04:18:07.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.640+0000 7f84da600640 1 -- start start 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d406cab0 0x7f84d41ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40705b0 0x7f84d4153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84d40c55d0 0x7f84d40a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d41524e0 con 0x7f84d406cab0 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d41527c0 con 0x7f84d40c55d0 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4152aa0 con 0x7f84d40705b0 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d406cab0 0x7f84d41ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d406cab0 0x7f84d41ed820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57872/0 (socket says 172.21.15.32:57872) 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 -- 172.21.15.32:0/2220775237 learned_addr learned my addr 172.21.15.32:0/2220775237 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d2a00640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40705b0 0x7f84d4153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3e00640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84d40c55d0 0x7f84d40a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 -- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40705b0 msgr2=0x7f84d4153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40705b0 0x7f84d4153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 -- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84d40c55d0 msgr2=0x7f84d40a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84d40c55d0 0x7f84d40a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 -- 172.21.15.32:0/2220775237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc00a5c0 con 0x7f84d406cab0 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84d3400640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d406cab0 0x7f84d41ed820 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c500 tx=0x7f84c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84cb400640 1 -- 172.21.15.32:0/2220775237 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4005db0 con 0x7f84d406cab0 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84cb400640 1 -- 172.21.15.32:0/2220775237 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c40070f0 con 0x7f84d406cab0 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d4152d80 con 0x7f84d406cab0 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84cb400640 1 -- 172.21.15.32:0/2220775237 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4007480 con 0x7f84d406cab0 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d40a96d0 con 0x7f84d406cab0 2024-01-19T04:18:07.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.644+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d40749f0 con 0x7f84d406cab0 2024-01-19T04:18:07.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.648+0000 7f84cb400640 1 -- 172.21.15.32:0/2220775237 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f84c40075e0 con 0x7f84d406cab0 2024-01-19T04:18:07.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.648+0000 7f84cb400640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f84ac066500 0x7f84ac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:07.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.648+0000 7f84cb400640 1 -- 172.21.15.32:0/2220775237 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f84c4083790 con 0x7f84d406cab0 2024-01-19T04:18:07.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.648+0000 7f84d2a00640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f84ac066500 0x7f84ac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:07.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.648+0000 7f84d2a00640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f84ac066500 0x7f84ac0689c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0b0000 tx=0x7f84bc0a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:07.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.652+0000 7f84cb400640 1 -- 172.21.15.32:0/2220775237 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f84c4050810 con 0x7f84d406cab0 2024-01-19T04:18:07.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.872+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f84d406d590 con 0x7f84d406cab0 2024-01-19T04:18:07.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.872+0000 7f84cb400640 1 -- 172.21.15.32:0/2220775237 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7f84c40170e0 con 0x7f84d406cab0 2024-01-19T04:18:07.876 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-01-19T04:18:07.877 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAD96llFTHyAhAA5AhmCZMhIL4JMhc/19a3ZQ== 2024-01-19T04:18:07.877 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-01-19T04:18:07.877 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-01-19T04:18:07.877 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-19T04:18:07.877 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.1 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f84ac066500 msgr2=0x7f84ac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f84ac066500 0x7f84ac0689c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0b0000 tx=0x7f84bc0a8070 comp rx=0 tx=0).stop 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d406cab0 msgr2=0x7f84d41ed820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d406cab0 0x7f84d41ed820 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c500 tx=0x7f84c400c9c0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 shutdown_connections 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f84ac066500 0x7f84ac0689c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84d40c55d0 0x7f84d40a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f84d40705b0 0x7f84d4153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 --2- 172.21.15.32:0/2220775237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84d406cab0 0x7f84d41ed820 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 >> 172.21.15.32:0/2220775237 conn(0x7f84d40c25a0 msgr2=0x7f84d4150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 shutdown_connections 2024-01-19T04:18:07.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:07.876+0000 7f84da600640 1 -- 172.21.15.32:0/2220775237 wait complete. 2024-01-19T04:18:07.900 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:07.901 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:07.910 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:07.910 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:07.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:08.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0f400640 1 Processor -- start 2024-01-19T04:18:08.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0f400640 1 -- start start 2024-01-19T04:18:08.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9d080c5740 0x7f9d080c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c1120 0x7f9d0815b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0f400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d080c0c90 con 0x7f9d080c42b0 2024-01-19T04:18:08.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0f400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d08150f90 con 0x7f9d080c5740 2024-01-19T04:18:08.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0f400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08150cb0 con 0x7f9d080c1120 2024-01-19T04:18:08.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0ca00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9d080c42b0 0x7f9d0806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35750/0 (socket says 172.21.15.32:35750) 2024-01-19T04:18:08.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0ca00640 1 -- 172.21.15.32:0/2531649769 learned_addr learned my addr 172.21.15.32:0/2531649769 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:08.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0d400640 1 --2- 172.21.15.32:0/2531649769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c1120 0x7f9d0815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d07e00640 1 --2- 172.21.15.32:0/2531649769 >> v2:172.21.15.67:3300/0 conn(0x7f9d080c5740 0x7f9d080c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d07400640 1 -- 172.21.15.32:0/2531649769 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941070195 0 0) 0x7f9d080c0c90 con 0x7f9d080c42b0 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d07400640 1 -- 172.21.15.32:0/2531649769 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce8005740 con 0x7f9d080c42b0 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d07400640 1 -- 172.21.15.32:0/2531649769 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687257713 0 0) 0x7f9ce8005740 con 0x7f9d080c42b0 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0d400640 1 -- 172.21.15.32:0/2531649769 >> v2:172.21.15.67:3300/0 conn(0x7f9d080c5740 msgr2=0x7f9d080c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0d400640 1 --2- 172.21.15.32:0/2531649769 >> v2:172.21.15.67:3300/0 conn(0x7f9d080c5740 0x7f9d080c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0d400640 1 -- 172.21.15.32:0/2531649769 >> v1:172.21.15.32:6789/0 conn(0x7f9d080c42b0 legacy=0x7f9d0806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d0d400640 1 -- 172.21.15.32:0/2531649769 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080c0640 con 0x7f9d080c1120 2024-01-19T04:18:08.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.104+0000 7f9d07e00640 1 --2- 172.21.15.32:0/2531649769 >> v2:172.21.15.67:3300/0 conn(0x7f9d080c5740 0x7f9d080c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:08.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0d400640 1 --2- 172.21.15.32:0/2531649769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c1120 0x7f9d0815b440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9d00008330 tx=0x7f9d0001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498dc6104f56c2ab server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d07400640 1 -- 172.21.15.32:0/2531649769 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8001680 con 0x7f9d080c1120 2024-01-19T04:18:08.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d07400640 1 -- 172.21.15.32:0/2531649769 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0000a0d0 con 0x7f9d080c1120 2024-01-19T04:18:08.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d07400640 1 -- 172.21.15.32:0/2531649769 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000a5540 con 0x7f9d080c1120 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 -- 172.21.15.32:0/2531649769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c1120 msgr2=0x7f9d0815b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2531649769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c1120 0x7f9d0815b440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9d00008330 tx=0x7f9d0001c800 comp rx=0 tx=0).stop 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 -- 172.21.15.32:0/2531649769 shutdown_connections 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2531649769 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c1120 0x7f9d0815b440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2531649769 >> v2:172.21.15.67:3300/0 conn(0x7f9d080c5740 0x7f9d080c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 -- 172.21.15.32:0/2531649769 >> 172.21.15.32:0/2531649769 conn(0x7f9d080c5b20 msgr2=0x7f9d080c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 -- 172.21.15.32:0/2531649769 shutdown_connections 2024-01-19T04:18:08.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.108+0000 7f9d0f400640 1 -- 172.21.15.32:0/2531649769 wait complete. 2024-01-19T04:18:08.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 Processor -- start 2024-01-19T04:18:08.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 -- start start 2024-01-19T04:18:08.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d080c1120 0x7f9d081f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d080c42b0 0x7f9d08072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c5740 0x7f9d081eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080ab040 con 0x7f9d080c42b0 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080aa860 con 0x7f9d080c1120 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08146f30 con 0x7f9d080c5740 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d080c42b0 0x7f9d08072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d080c42b0 0x7f9d08072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58290/0 (socket says 172.21.15.32:58290) 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 -- 172.21.15.32:0/2268057580 learned_addr learned my addr 172.21.15.32:0/2268057580 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0d400640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c5740 0x7f9d081eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0ca00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d080c1120 0x7f9d081f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 -- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c5740 msgr2=0x7f9d081eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c5740 0x7f9d081eddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 -- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d080c1120 msgr2=0x7f9d081f0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d080c1120 0x7f9d081f0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 -- 172.21.15.32:0/2268057580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009420 con 0x7f9d080c42b0 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0ca00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d080c1120 0x7f9d081f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d07e00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d080c42b0 0x7f9d08072590 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000ebe0 tx=0x7f9cf000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d04c00640 1 -- 172.21.15.32:0/2268057580 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000eee0 con 0x7f9d080c42b0 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d04c00640 1 -- 172.21.15.32:0/2268057580 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000cc30 con 0x7f9d080c42b0 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d04c00640 1 -- 172.21.15.32:0/2268057580 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0013470 con 0x7f9d080c42b0 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0000aa90 con 0x7f9d080c42b0 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d080aab20 con 0x7f9d080c42b0 2024-01-19T04:18:08.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.112+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d080749f0 con 0x7f9d080c42b0 2024-01-19T04:18:08.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.116+0000 7f9d04c00640 1 -- 172.21.15.32:0/2268057580 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9cf00135d0 con 0x7f9d080c42b0 2024-01-19T04:18:08.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.116+0000 7f9d04c00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ce0066500 0x7f9ce00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.116+0000 7f9d04c00640 1 -- 172.21.15.32:0/2268057580 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9cf00844c0 con 0x7f9d080c42b0 2024-01-19T04:18:08.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.116+0000 7f9d0ca00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ce0066500 0x7f9ce00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.116+0000 7f9d0ca00640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ce0066500 0x7f9ce00689c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8007a10 tx=0x7f9cf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.120+0000 7f9d04c00640 1 -- 172.21.15.32:0/2268057580 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9cf00514a0 con 0x7f9d080c42b0 2024-01-19T04:18:08.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.280+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d080c5210 con 0x7f9d080c42b0 2024-01-19T04:18:08.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d04c00640 1 -- 172.21.15.32:0/2268057580 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7f9cf0054ac0 con 0x7f9d080c42b0 2024-01-19T04:18:08.286 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:08.287 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ce0066500 msgr2=0x7f9ce00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ce0066500 0x7f9ce00689c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8007a10 tx=0x7f9cf8009040 comp rx=0 tx=0).stop 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d080c42b0 msgr2=0x7f9d08072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d080c42b0 0x7f9d08072590 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000ebe0 tx=0x7f9cf000c520 comp rx=0 tx=0).stop 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 shutdown_connections 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9ce0066500 0x7f9ce00689c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9d080c5740 0x7f9d081eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d080c42b0 0x7f9d08072590 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 --2- 172.21.15.32:0/2268057580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d080c1120 0x7f9d081f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 >> 172.21.15.32:0/2268057580 conn(0x7f9d080c5b20 msgr2=0x7f9d080c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 shutdown_connections 2024-01-19T04:18:08.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.284+0000 7f9d0f400640 1 -- 172.21.15.32:0/2268057580 wait complete. 2024-01-19T04:18:08.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:17:47.021907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:17:48.211408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:18:00.535616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:18:01.296998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:18:08.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:18:08.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.448+0000 7fee71c00640 1 Processor -- start 2024-01-19T04:18:08.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.448+0000 7fee71c00640 1 -- start start 2024-01-19T04:18:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee71c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c0aa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee71c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c0c3170 con 0x7fee6c0c54f0 2024-01-19T04:18:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee71c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c0c2520 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee71c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0c60a0 con 0x7fee6c0c2090 2024-01-19T04:18:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee6a000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fee6c0c54f0 0x7fee6c0aa080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35758/0 (socket says 172.21.15.32:35758) 2024-01-19T04:18:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee6a000640 1 -- 172.21.15.32:0/1291345252 learned_addr learned my addr 172.21.15.32:0/1291345252 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:08.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee6b400640 1 --2- 172.21.15.32:0/1291345252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c0aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee69600640 1 -- 172.21.15.32:0/1291345252 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650941607 0 0) 0x7fee6c0c3170 con 0x7fee6c0c54f0 2024-01-19T04:18:08.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee69600640 1 -- 172.21.15.32:0/1291345252 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c005740 con 0x7fee6c0c54f0 2024-01-19T04:18:08.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee69600640 1 -- 172.21.15.32:0/1291345252 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513503850 0 0) 0x7fee6c0c2520 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee69600640 1 -- 172.21.15.32:0/1291345252 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee6c0c3170 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee6b400640 1 -- 172.21.15.32:0/1291345252 >> v1:172.21.15.67:6789/0 conn(0x7fee6c0c1cb0 legacy=0x7fee6c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee6b400640 1 -- 172.21.15.32:0/1291345252 >> v1:172.21.15.32:6789/0 conn(0x7fee6c0c54f0 legacy=0x7fee6c0aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.452+0000 7fee6b400640 1 -- 172.21.15.32:0/1291345252 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0aacd0 con 0x7fee6c0c2090 2024-01-19T04:18:08.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee6b400640 1 --2- 172.21.15.32:0/1291345252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c0aa790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fee64009dc0 tx=0x7fee6401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afb247630413906 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee69600640 1 -- 172.21.15.32:0/1291345252 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640a5820 con 0x7fee6c0c2090 2024-01-19T04:18:08.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee69600640 1 -- 172.21.15.32:0/1291345252 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee640a5980 con 0x7fee6c0c2090 2024-01-19T04:18:08.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee69600640 1 -- 172.21.15.32:0/1291345252 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640a5d10 con 0x7fee6c0c2090 2024-01-19T04:18:08.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 -- 172.21.15.32:0/1291345252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 msgr2=0x7fee6c0aa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 --2- 172.21.15.32:0/1291345252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c0aa790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fee64009dc0 tx=0x7fee6401c970 comp rx=0 tx=0).stop 2024-01-19T04:18:08.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 -- 172.21.15.32:0/1291345252 shutdown_connections 2024-01-19T04:18:08.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 --2- 172.21.15.32:0/1291345252 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c0aa790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 -- 172.21.15.32:0/1291345252 >> 172.21.15.32:0/1291345252 conn(0x7fee6c0c36c0 msgr2=0x7fee6c0c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:08.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 -- 172.21.15.32:0/1291345252 shutdown_connections 2024-01-19T04:18:08.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 -- 172.21.15.32:0/1291345252 wait complete. 2024-01-19T04:18:08.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 Processor -- start 2024-01-19T04:18:08.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 -- start start 2024-01-19T04:18:08.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.456+0000 7fee71c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee6c0c1cb0 0x7fee6c0bf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6c0c54f0 0x7fee6c0bc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0c0d00 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0bff00 con 0x7fee6c0c54f0 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0c0110 con 0x7fee6c0c2090 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee6c0c1cb0 0x7fee6c0bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee6c0c1cb0 0x7fee6c0bf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58296/0 (socket says 172.21.15.32:58296) 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 -- 172.21.15.32:0/4012372513 learned_addr learned my addr 172.21.15.32:0/4012372513 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6a000640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6b400640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6c0c54f0 0x7fee6c0bc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 -- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 msgr2=0x7fee6c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c14abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 -- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6c0c54f0 msgr2=0x7fee6c0bc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6c0c54f0 0x7fee6c0bc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 -- 172.21.15.32:0/4012372513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64009a70 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee6aa00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee6c0c1cb0 0x7fee6c0bf410 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c500 tx=0x7fee5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee62a00640 1 -- 172.21.15.32:0/4012372513 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0052d0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee62a00640 1 -- 172.21.15.32:0/4012372513 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c005470 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee62a00640 1 -- 172.21.15.32:0/4012372513 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c003840 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c0c03d0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c0c0990 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c04f1d0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.460+0000 7fee62a00640 1 -- 172.21.15.32:0/4012372513 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fee5c0039a0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.464+0000 7fee62a00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee44066500 0x7fee440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.464+0000 7fee62a00640 1 -- 172.21.15.32:0/4012372513 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fee5c0836b0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.464+0000 7fee6a000640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee44066500 0x7fee440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.464+0000 7fee6a000640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee44066500 0x7fee440689c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0a5ea0 tx=0x7fee54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.468+0000 7fee62a00640 1 -- 172.21.15.32:0/4012372513 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fee5c0506b0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.624+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee6c0749f0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.624+0000 7fee62a00640 1 -- 172.21.15.32:0/4012372513 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee5c053cd0 con 0x7fee6c0c1cb0 2024-01-19T04:18:08.629 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:18:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee44066500 msgr2=0x7fee440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee44066500 0x7fee440689c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0a5ea0 tx=0x7fee54009040 comp rx=0 tx=0).stop 2024-01-19T04:18:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee6c0c1cb0 msgr2=0x7fee6c0bf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee6c0c1cb0 0x7fee6c0bf410 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c500 tx=0x7fee5c00c9c0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 shutdown_connections 2024-01-19T04:18:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fee44066500 0x7fee440689c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee6c0c54f0 0x7fee6c0bc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fee6c0c2090 0x7fee6c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 --2- 172.21.15.32:0/4012372513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee6c0c1cb0 0x7fee6c0bf410 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 >> 172.21.15.32:0/4012372513 conn(0x7fee6c0c36c0 msgr2=0x7fee6c154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:08.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 shutdown_connections 2024-01-19T04:18:08.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.628+0000 7fee71c00640 1 -- 172.21.15.32:0/4012372513 wait complete. 2024-01-19T04:18:08.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:18:08.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.792+0000 7ff340a00640 1 Processor -- start 2024-01-19T04:18:08.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.792+0000 7ff340a00640 1 -- start start 2024-01-19T04:18:08.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff340a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3380723b0 0x7ff338152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff340a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33806d440 0x7ff3380c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff340a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380a4ea0 con 0x7ff3380c2080 2024-01-19T04:18:08.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff340a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3381524a0 con 0x7ff33806d440 2024-01-19T04:18:08.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff340a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff338152a20 con 0x7ff3380723b0 2024-01-19T04:18:08.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33806d440 0x7ff3380c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3380723b0 0x7ff338152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33806d440 0x7ff3380c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:53068/0 (socket says 172.21.15.32:53068) 2024-01-19T04:18:08.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3380723b0 0x7ff338152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:37306/0 (socket says 172.21.15.32:37306) 2024-01-19T04:18:08.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33ea00640 1 -- 172.21.15.32:0/2775713905 learned_addr learned my addr 172.21.15.32:0/2775713905 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:08.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33d600640 1 --1- 172.21.15.32:0/2775713905 >> v1:172.21.15.67:6789/0 conn(0x7ff3380c2080 0x7ff338155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:46630/0 (socket says 172.21.15.32:46630) 2024-01-19T04:18:08.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33ea00640 1 -- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3380723b0 msgr2=0x7ff338152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:08.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33ea00640 1 --2- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3380723b0 0x7ff338152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33ea00640 1 -- 172.21.15.32:0/2775713905 >> v1:172.21.15.67:6789/0 conn(0x7ff3380c2080 legacy=0x7ff338155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33ea00640 1 -- 172.21.15.32:0/2775713905 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3381533f0 con 0x7ff33806d440 2024-01-19T04:18:08.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.796+0000 7ff33e000640 1 --2- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3380723b0 0x7ff338152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:08.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff33ea00640 1 --2- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33806d440 0x7ff3380c4e50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff330009e50 tx=0x7ff33001c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d563f6b6d6286146 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff33cc00640 1 -- 172.21.15.32:0/2775713905 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3300a56c0 con 0x7ff33806d440 2024-01-19T04:18:08.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff33cc00640 1 -- 172.21.15.32:0/2775713905 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3300a5820 con 0x7ff33806d440 2024-01-19T04:18:08.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff33cc00640 1 -- 172.21.15.32:0/2775713905 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3300a5bb0 con 0x7ff33806d440 2024-01-19T04:18:08.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 -- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33806d440 msgr2=0x7ff3380c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 --2- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33806d440 0x7ff3380c4e50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff330009e50 tx=0x7ff33001c8f0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 -- 172.21.15.32:0/2775713905 shutdown_connections 2024-01-19T04:18:08.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 --2- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33806d440 0x7ff3380c4e50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 --2- 172.21.15.32:0/2775713905 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff3380723b0 0x7ff338152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 -- 172.21.15.32:0/2775713905 >> 172.21.15.32:0/2775713905 conn(0x7ff3380c25a0 msgr2=0x7ff3380c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:08.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 -- 172.21.15.32:0/2775713905 shutdown_connections 2024-01-19T04:18:08.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 -- 172.21.15.32:0/2775713905 wait complete. 2024-01-19T04:18:08.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 Processor -- start 2024-01-19T04:18:08.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.800+0000 7ff340a00640 1 -- start start 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff33806d440 0x7ff338145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3380723b0 0x7ff338150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3380c2080 0x7ff33814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381522b0 con 0x7ff3380723b0 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381f0f30 con 0x7ff3380c2080 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff338071480 con 0x7ff33806d440 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3380723b0 0x7ff338150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3380723b0 0x7ff338150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58300/0 (socket says 172.21.15.32:58300) 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 -- 172.21.15.32:0/3095586913 learned_addr learned my addr 172.21.15.32:0/3095586913 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33ea00640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3380c2080 0x7ff33814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33e000640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff33806d440 0x7ff338145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 -- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff33806d440 msgr2=0x7ff338145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff33806d440 0x7ff338145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 -- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3380c2080 msgr2=0x7ff33814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3380c2080 0x7ff33814aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 -- 172.21.15.32:0/3095586913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328009420 con 0x7ff3380723b0 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff33d600640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3380723b0 0x7ff338150590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c460 tx=0x7ff32000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff336000640 1 -- 172.21.15.32:0/3095586913 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320007480 con 0x7ff3380723b0 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff336000640 1 -- 172.21.15.32:0/3095586913 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3200075e0 con 0x7ff3380723b0 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff336000640 1 -- 172.21.15.32:0/3095586913 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320004a30 con 0x7ff3380723b0 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff330009b30 con 0x7ff3380723b0 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3381f0bc0 con 0x7ff3380723b0 2024-01-19T04:18:08.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.804+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3380749f0 con 0x7ff3380723b0 2024-01-19T04:18:08.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.808+0000 7ff336000640 1 -- 172.21.15.32:0/3095586913 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff320004b90 con 0x7ff3380723b0 2024-01-19T04:18:08.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.808+0000 7ff336000640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff310066530 0x7ff3100689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:08.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.808+0000 7ff336000640 1 -- 172.21.15.32:0/3095586913 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff320083200 con 0x7ff3380723b0 2024-01-19T04:18:08.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.808+0000 7ff33e000640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff310066530 0x7ff3100689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:08.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.808+0000 7ff33e000640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff310066530 0x7ff3100689f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff328009c50 tx=0x7ff328009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:08.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.812+0000 7ff336000640 1 -- 172.21.15.32:0/3095586913 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff320050280 con 0x7ff3380723b0 2024-01-19T04:18:08.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3380abe30 con 0x7ff3380723b0 2024-01-19T04:18:08.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff336000640 1 -- 172.21.15.32:0/3095586913 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3200538a0 con 0x7ff3380723b0 2024-01-19T04:18:08.991 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:08.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff310066530 msgr2=0x7ff3100689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff310066530 0x7ff3100689f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff328009c50 tx=0x7ff328009190 comp rx=0 tx=0).stop 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3380723b0 msgr2=0x7ff338150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3380723b0 0x7ff338150590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c460 tx=0x7ff32000c920 comp rx=0 tx=0).stop 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 shutdown_connections 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff310066530 0x7ff3100689f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3380c2080 0x7ff33814aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3380723b0 0x7ff338150590 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 --2- 172.21.15.32:0/3095586913 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff33806d440 0x7ff338145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 >> 172.21.15.32:0/3095586913 conn(0x7ff3380c25a0 msgr2=0x7ff3380c3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 shutdown_connections 2024-01-19T04:18:08.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:08.988+0000 7ff340a00640 1 -- 172.21.15.32:0/3095586913 wait complete. 2024-01-19T04:18:09.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:18:09.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.152+0000 7f6593800640 1 Processor -- start 2024-01-19T04:18:09.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.152+0000 7f6593800640 1 -- start start 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6593800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f658c155520 0x7f658c06c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6593800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6593800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f658c0bf360 0x7f658c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6593800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0beed0 con 0x7f658c0bf360 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6593800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0c3a80 con 0x7f658c155520 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6593800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c3d60 con 0x7f658c072490 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f658c0bf360 0x7f658c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f658c0bf360 0x7f658c0a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58304/0 (socket says 172.21.15.32:58304) 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 -- 172.21.15.32:0/3764199923 learned_addr learned my addr 172.21.15.32:0/3764199923 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6590e00640 1 --2- 172.21.15.32:0/3764199923 >> v2:172.21.15.67:3300/0 conn(0x7f658c155520 0x7f658c06c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f658be00640 1 --2- 172.21.15.32:0/3764199923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 -- 172.21.15.32:0/3764199923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 msgr2=0x7f658c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:09.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 --2- 172.21.15.32:0/3764199923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c06d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 -- 172.21.15.32:0/3764199923 >> v2:172.21.15.67:3300/0 conn(0x7f658c155520 msgr2=0x7f658c06c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:09.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 --2- 172.21.15.32:0/3764199923 >> v2:172.21.15.67:3300/0 conn(0x7f658c155520 0x7f658c06c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 -- 172.21.15.32:0/3764199923 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0c4040 con 0x7f658c0bf360 2024-01-19T04:18:09.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6590e00640 1 --2- 172.21.15.32:0/3764199923 >> v2:172.21.15.67:3300/0 conn(0x7f658c155520 0x7f658c06c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:09.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.156+0000 7f6591800640 1 --2- 172.21.15.32:0/3764199923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c0bf360 0x7f658c0a4d10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f658c0a8790 tx=0x7f658401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dff6e37413d5780 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f658b400640 1 -- 172.21.15.32:0/3764199923 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840a55c0 con 0x7f658c0bf360 2024-01-19T04:18:09.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f658b400640 1 -- 172.21.15.32:0/3764199923 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65840a5720 con 0x7f658c0bf360 2024-01-19T04:18:09.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f658b400640 1 -- 172.21.15.32:0/3764199923 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840a5ab0 con 0x7f658c0bf360 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 -- 172.21.15.32:0/3764199923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c0bf360 msgr2=0x7f658c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 --2- 172.21.15.32:0/3764199923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c0bf360 0x7f658c0a4d10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f658c0a8790 tx=0x7f658401c940 comp rx=0 tx=0).stop 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 -- 172.21.15.32:0/3764199923 shutdown_connections 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 --2- 172.21.15.32:0/3764199923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c0bf360 0x7f658c0a4d10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 --2- 172.21.15.32:0/3764199923 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c06d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 --2- 172.21.15.32:0/3764199923 >> v2:172.21.15.67:3300/0 conn(0x7f658c155520 0x7f658c06c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 -- 172.21.15.32:0/3764199923 >> 172.21.15.32:0/3764199923 conn(0x7f658c0c25a0 msgr2=0x7f658c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 -- 172.21.15.32:0/3764199923 shutdown_connections 2024-01-19T04:18:09.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 -- 172.21.15.32:0/3764199923 wait complete. 2024-01-19T04:18:09.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 Processor -- start 2024-01-19T04:18:09.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 -- start start 2024-01-19T04:18:09.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c0a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.160+0000 7f6593800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658c0bf360 0x7f658c14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6593800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c155520 0x7f658c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6593800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0a8c60 con 0x7f658c155520 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6593800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0a5d50 con 0x7f658c0bf360 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6593800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c14e380 con 0x7f658c072490 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c155520 0x7f658c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c155520 0x7f658c0a61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58312/0 (socket says 172.21.15.32:58312) 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 -- 172.21.15.32:0/1293886765 learned_addr learned my addr 172.21.15.32:0/1293886765 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f658be00640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658c0bf360 0x7f658c14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6590e00640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c0a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 -- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 msgr2=0x7f658c0a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c0a6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 -- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658c0bf360 msgr2=0x7f658c14d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658c0bf360 0x7f658c14d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 -- 172.21.15.32:0/1293886765 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6584009b30 con 0x7f658c155520 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6591800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c155520 0x7f658c0a61e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f65840af040 tx=0x7f65840196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6588c00640 1 -- 172.21.15.32:0/1293886765 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840b8670 con 0x7f658c155520 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6588c00640 1 -- 172.21.15.32:0/1293886765 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65840b87d0 con 0x7f658c155520 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c1edf60 con 0x7f658c155520 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6588c00640 1 -- 172.21.15.32:0/1293886765 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840b8b80 con 0x7f658c155520 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c0a59e0 con 0x7f658c155520 2024-01-19T04:18:09.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c0a5ee0 con 0x7f658c155520 2024-01-19T04:18:09.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.164+0000 7f6588c00640 1 -- 172.21.15.32:0/1293886765 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f65840b8ce0 con 0x7f658c155520 2024-01-19T04:18:09.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.168+0000 7f6588c00640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6564066500 0x7f65640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.168+0000 7f6588c00640 1 -- 172.21.15.32:0/1293886765 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f658411f530 con 0x7f658c155520 2024-01-19T04:18:09.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.168+0000 7f6590e00640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6564066500 0x7f65640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.168+0000 7f6590e00640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6564066500 0x7f65640689c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f657c0045f0 tx=0x7f657c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.172+0000 7f6588c00640 1 -- 172.21.15.32:0/1293886765 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f65840ec510 con 0x7f658c155520 2024-01-19T04:18:09.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.332+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f658c0749f0 con 0x7f658c155520 2024-01-19T04:18:09.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.332+0000 7f6588c00640 1 -- 172.21.15.32:0/1293886765 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6584009510 con 0x7f658c155520 2024-01-19T04:18:09.336 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:09.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6564066500 msgr2=0x7f65640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6564066500 0x7f65640689c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f657c0045f0 tx=0x7f657c008040 comp rx=0 tx=0).stop 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c155520 msgr2=0x7f658c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c155520 0x7f658c0a61e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f65840af040 tx=0x7f65840196e0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 shutdown_connections 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6564066500 0x7f65640689c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658c155520 0x7f658c0a61e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658c0bf360 0x7f658c14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 --2- 172.21.15.32:0/1293886765 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f658c072490 0x7f658c0a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 >> 172.21.15.32:0/1293886765 conn(0x7f658c0c25a0 msgr2=0x7f658c1537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 shutdown_connections 2024-01-19T04:18:09.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.336+0000 7f6593800640 1 -- 172.21.15.32:0/1293886765 wait complete. 2024-01-19T04:18:09.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:18:09.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fc200640 1 Processor -- start 2024-01-19T04:18:09.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fc200640 1 -- start start 2024-01-19T04:18:09.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fc200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96f40c6830 0x7f96f40c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fc200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f4152bc0 con 0x7f96f4152620 2024-01-19T04:18:09.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fc200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f4152ea0 con 0x7f96f40c4e50 2024-01-19T04:18:09.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fc200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f406ea00 con 0x7f96f40c6830 2024-01-19T04:18:09.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96f8e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f96f4152620 0x7f96f40c6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35770/0 (socket says 172.21.15.32:35770) 2024-01-19T04:18:09.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96f8e00640 1 -- 172.21.15.32:0/2882155331 learned_addr learned my addr 172.21.15.32:0/2882155331 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:09.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fa200640 1 --2- 172.21.15.32:0/2882155331 >> v2:172.21.15.67:3300/0 conn(0x7f96f40c6830 0x7f96f40c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96f3e00640 1 -- 172.21.15.32:0/2882155331 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547538086 0 0) 0x7f96f4152bc0 con 0x7f96f4152620 2024-01-19T04:18:09.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96f3e00640 1 -- 172.21.15.32:0/2882155331 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d4003530 con 0x7f96f4152620 2024-01-19T04:18:09.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96f3e00640 1 -- 172.21.15.32:0/2882155331 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870053308 0 0) 0x7f96d4003530 con 0x7f96f4152620 2024-01-19T04:18:09.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fa200640 1 -- 172.21.15.32:0/2882155331 >> v1:172.21.15.67:6789/0 conn(0x7f96f40c4e50 legacy=0x7f96f406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fa200640 1 -- 172.21.15.32:0/2882155331 >> v1:172.21.15.32:6789/0 conn(0x7f96f4152620 legacy=0x7f96f40c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.500+0000 7f96fa200640 1 -- 172.21.15.32:0/2882155331 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4153180 con 0x7f96f40c6830 2024-01-19T04:18:09.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fa200640 1 --2- 172.21.15.32:0/2882155331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f40c6830 0x7f96f40c75a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009d90 tx=0x7f96ec01c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3f7bfa46cb1aae8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96f3e00640 1 -- 172.21.15.32:0/2882155331 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc001680 con 0x7f96f40c6830 2024-01-19T04:18:09.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96f3e00640 1 -- 172.21.15.32:0/2882155331 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec0a5650 con 0x7f96f40c6830 2024-01-19T04:18:09.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96f3e00640 1 -- 172.21.15.32:0/2882155331 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0a59e0 con 0x7f96f40c6830 2024-01-19T04:18:09.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fc200640 1 -- 172.21.15.32:0/2882155331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f40c6830 msgr2=0x7f96f40c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fc200640 1 --2- 172.21.15.32:0/2882155331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f40c6830 0x7f96f40c75a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009d90 tx=0x7f96ec01c7b0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fc200640 1 -- 172.21.15.32:0/2882155331 shutdown_connections 2024-01-19T04:18:09.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fc200640 1 --2- 172.21.15.32:0/2882155331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f40c6830 0x7f96f40c75a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fc200640 1 -- 172.21.15.32:0/2882155331 >> 172.21.15.32:0/2882155331 conn(0x7f96f40c7d40 msgr2=0x7f96f40c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:09.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fc200640 1 -- 172.21.15.32:0/2882155331 shutdown_connections 2024-01-19T04:18:09.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.504+0000 7f96fc200640 1 -- 172.21.15.32:0/2882155331 wait complete. 2024-01-19T04:18:09.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 Processor -- start 2024-01-19T04:18:09.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 -- start start 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96f40c4e50 0x7f96f40ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f40c6830 0x7f96f40c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f4152620 0x7f96f41ed340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f406d1a0 con 0x7f96f40c6830 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41e9d70 con 0x7f96f4152620 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40adbf0 con 0x7f96f40c4e50 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f40c6830 0x7f96f40c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f40c6830 0x7f96f40c13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58314/0 (socket says 172.21.15.32:58314) 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 -- 172.21.15.32:0/444852067 learned_addr learned my addr 172.21.15.32:0/444852067 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fa200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f4152620 0x7f96f41ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f9800640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96f40c4e50 0x7f96f40ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 -- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96f40c4e50 msgr2=0x7f96f40ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96f40c4e50 0x7f96f40ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 -- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f4152620 msgr2=0x7f96f41ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f4152620 0x7f96f41ed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 -- 172.21.15.32:0/444852067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec009a70 con 0x7f96f40c6830 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fa200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f4152620 0x7f96f41ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f8e00640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f40c6830 0x7f96f40c13d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c500 tx=0x7f96dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f1600640 1 -- 172.21.15.32:0/444852067 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc007560 con 0x7f96f40c6830 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f1600640 1 -- 172.21.15.32:0/444852067 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc0047f0 con 0x7f96f40c6830 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f41ea030 con 0x7f96f40c6830 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96f1600640 1 -- 172.21.15.32:0/444852067 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0076c0 con 0x7f96f40c6830 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.508+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f41ea5f0 con 0x7f96f40c6830 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.512+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f41ea810 con 0x7f96f40c6830 2024-01-19T04:18:09.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.512+0000 7f96f1600640 1 -- 172.21.15.32:0/444852067 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96dc004be0 con 0x7f96f40c6830 2024-01-19T04:18:09.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.512+0000 7f96f1600640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96cc066500 0x7f96cc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.512+0000 7f96f1600640 1 -- 172.21.15.32:0/444852067 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f96dc083840 con 0x7f96f40c6830 2024-01-19T04:18:09.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.512+0000 7f96f9800640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96cc066500 0x7f96cc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.512+0000 7f96f9800640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96cc066500 0x7f96cc0689c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f96e4010270 tx=0x7f96e400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.516+0000 7f96f1600640 1 -- 172.21.15.32:0/444852067 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f96dc050770 con 0x7f96f40c6830 2024-01-19T04:18:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96f40749f0 con 0x7f96f40c6830 2024-01-19T04:18:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96f1600640 1 -- 172.21.15.32:0/444852067 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7f96dc018020 con 0x7f96f40c6830 2024-01-19T04:18:09.679 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:09.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96cc066500 msgr2=0x7f96cc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96cc066500 0x7f96cc0689c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f96e4010270 tx=0x7f96e400b040 comp rx=0 tx=0).stop 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f40c6830 msgr2=0x7f96f40c13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f40c6830 0x7f96f40c13d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c500 tx=0x7f96dc00c9c0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 shutdown_connections 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96cc066500 0x7f96cc0689c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96f4152620 0x7f96f41ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f40c6830 0x7f96f40c13d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 --2- 172.21.15.32:0/444852067 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96f40c4e50 0x7f96f40ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 >> 172.21.15.32:0/444852067 conn(0x7f96f40c7d40 msgr2=0x7f96f414f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 shutdown_connections 2024-01-19T04:18:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.676+0000 7f96fc200640 1 -- 172.21.15.32:0/444852067 wait complete. 2024-01-19T04:18:09.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:18:09.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02e5e00640 1 Processor -- start 2024-01-19T04:18:09.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02e5e00640 1 -- start start 2024-01-19T04:18:09.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02e5e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f02e014eb90 0x7f02e01549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02e5e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f02e00720b0 0x7f02e0154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02e5e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e0072730 con 0x7f02e006c670 2024-01-19T04:18:09.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02e5e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e0072a10 con 0x7f02e014eb90 2024-01-19T04:18:09.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02e5e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e014ef70 con 0x7f02e00720b0 2024-01-19T04:18:09.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02dea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f02e014eb90 0x7f02e01549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02dea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f02e014eb90 0x7f02e01549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58324/0 (socket says 172.21.15.32:58324) 2024-01-19T04:18:09.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02dea00640 1 -- 172.21.15.32:0/2774810171 learned_addr learned my addr 172.21.15.32:0/2774810171 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:09.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02df400640 1 --2- 172.21.15.32:0/2774810171 >> v2:172.21.15.67:3300/0 conn(0x7f02e00720b0 0x7f02e0154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02dea00640 1 -- 172.21.15.32:0/2774810171 >> v2:172.21.15.67:3300/0 conn(0x7f02e00720b0 msgr2=0x7f02e0154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:09.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02dea00640 1 --2- 172.21.15.32:0/2774810171 >> v2:172.21.15.67:3300/0 conn(0x7f02e00720b0 0x7f02e0154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02dea00640 1 -- 172.21.15.32:0/2774810171 >> v1:172.21.15.67:6789/0 conn(0x7f02e006c670 legacy=0x7f02e00719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.844+0000 7f02dea00640 1 -- 172.21.15.32:0/2774810171 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0155580 con 0x7f02e014eb90 2024-01-19T04:18:09.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02dea00640 1 --2- 172.21.15.32:0/2774810171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e014eb90 0x7f02e01549d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f02e00c3430 tx=0x7f02d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa8cc00e730d399 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02dd600640 1 -- 172.21.15.32:0/2774810171 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00ab600 con 0x7f02e014eb90 2024-01-19T04:18:09.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02dd600640 1 -- 172.21.15.32:0/2774810171 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d00a7050 con 0x7f02e014eb90 2024-01-19T04:18:09.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02dd600640 1 -- 172.21.15.32:0/2774810171 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00ab980 con 0x7f02e014eb90 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 -- 172.21.15.32:0/2774810171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e014eb90 msgr2=0x7f02e01549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2774810171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e014eb90 0x7f02e01549d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f02e00c3430 tx=0x7f02d001c3e0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 -- 172.21.15.32:0/2774810171 shutdown_connections 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2774810171 >> v2:172.21.15.67:3300/0 conn(0x7f02e00720b0 0x7f02e0154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2774810171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e014eb90 0x7f02e01549d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 -- 172.21.15.32:0/2774810171 >> 172.21.15.32:0/2774810171 conn(0x7f02e00c25a0 msgr2=0x7f02e00c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 -- 172.21.15.32:0/2774810171 shutdown_connections 2024-01-19T04:18:09.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.848+0000 7f02e5e00640 1 -- 172.21.15.32:0/2774810171 wait complete. 2024-01-19T04:18:09.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 Processor -- start 2024-01-19T04:18:09.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 -- start start 2024-01-19T04:18:09.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e006c670 0x7f02e015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e00720b0 0x7f02e0149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02e014eb90 0x7f02e014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0153c20 con 0x7f02e006c670 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0151bd0 con 0x7f02e00720b0 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01ed5d0 con 0x7f02e014eb90 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e006c670 0x7f02e015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e006c670 0x7f02e015a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58340/0 (socket says 172.21.15.32:58340) 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 -- 172.21.15.32:0/2145922413 learned_addr learned my addr 172.21.15.32:0/2145922413 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02de000640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e00720b0 0x7f02e0149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02df400640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02e014eb90 0x7f02e014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 -- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02e014eb90 msgr2=0x7f02e014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02e014eb90 0x7f02e014a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 -- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e00720b0 msgr2=0x7f02e0149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e00720b0 0x7f02e0149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:09.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 -- 172.21.15.32:0/2145922413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00094d0 con 0x7f02e006c670 2024-01-19T04:18:09.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02dea00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e006c670 0x7f02e015a340 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f02d0018ff0 tx=0x7f02d0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02d7400640 1 -- 172.21.15.32:0/2145922413 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00b4420 con 0x7f02e006c670 2024-01-19T04:18:09.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02d7400640 1 -- 172.21.15.32:0/2145922413 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d00b4580 con 0x7f02e006c670 2024-01-19T04:18:09.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02d7400640 1 -- 172.21.15.32:0/2145922413 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00b4910 con 0x7f02e006c670 2024-01-19T04:18:09.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e01536f0 con 0x7f02e006c670 2024-01-19T04:18:09.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.852+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e00c0b50 con 0x7f02e006c670 2024-01-19T04:18:09.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.856+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e00749f0 con 0x7f02e006c670 2024-01-19T04:18:09.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.856+0000 7f02d7400640 1 -- 172.21.15.32:0/2145922413 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f02d00b2070 con 0x7f02e006c670 2024-01-19T04:18:09.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.856+0000 7f02d7400640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f02b8066500 0x7f02b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:09.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.856+0000 7f02d7400640 1 -- 172.21.15.32:0/2145922413 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f02d011d960 con 0x7f02e006c670 2024-01-19T04:18:09.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.856+0000 7f02de000640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f02b8066500 0x7f02b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:09.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.856+0000 7f02de000640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f02b8066500 0x7f02b80689c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f02e00a6400 tx=0x7f02c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:09.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:09.860+0000 7f02d7400640 1 -- 172.21.15.32:0/2145922413 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f02d00ea8b0 con 0x7f02e006c670 2024-01-19T04:18:10.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.028+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f02e00c0af0 con 0x7f02e006c670 2024-01-19T04:18:10.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.028+0000 7f02d7400640 1 -- 172.21.15.32:0/2145922413 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f02d00eded0 con 0x7f02e006c670 2024-01-19T04:18:10.033 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:10.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f02b8066500 msgr2=0x7f02b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f02b8066500 0x7f02b80689c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f02e00a6400 tx=0x7f02c8009040 comp rx=0 tx=0).stop 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e006c670 msgr2=0x7f02e015a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e006c670 0x7f02e015a340 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f02d0018ff0 tx=0x7f02d0019180 comp rx=0 tx=0).stop 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 shutdown_connections 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f02b8066500 0x7f02b80689c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f02e014eb90 0x7f02e014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e00720b0 0x7f02e0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 --2- 172.21.15.32:0/2145922413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02e006c670 0x7f02e015a340 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 >> 172.21.15.32:0/2145922413 conn(0x7f02e00c25a0 msgr2=0x7f02e006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 shutdown_connections 2024-01-19T04:18:10.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.032+0000 7f02e5e00640 1 -- 172.21.15.32:0/2145922413 wait complete. 2024-01-19T04:18:10.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:18:10.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.192+0000 7fc52d800640 1 Processor -- start 2024-01-19T04:18:10.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc52d800640 1 -- start start 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc52d800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc528151de0 0x7fc5280c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc52d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc528155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc52d800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5281547e0 con 0x7fc5280a7200 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc52d800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5281521c0 con 0x7fc528151de0 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc52d800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc528155640 con 0x7fc528154c70 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc526000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc5280a7200 0x7fc5280c3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35786/0 (socket says 172.21.15.32:35786) 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc526000640 1 -- 172.21.15.32:0/3204963879 learned_addr learned my addr 172.21.15.32:0/3204963879 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc527400640 1 --2- 172.21.15.32:0/3204963879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc528155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc526a00640 1 --2- 172.21.15.32:0/3204963879 >> v2:172.21.15.67:3300/0 conn(0x7fc528151de0 0x7fc5280c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc525600640 1 -- 172.21.15.32:0/3204963879 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329701140 0 0) 0x7fc5281547e0 con 0x7fc5280a7200 2024-01-19T04:18:10.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc525600640 1 -- 172.21.15.32:0/3204963879 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc508003530 con 0x7fc5280a7200 2024-01-19T04:18:10.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc527400640 1 -- 172.21.15.32:0/3204963879 >> v2:172.21.15.67:3300/0 conn(0x7fc528151de0 msgr2=0x7fc5280c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:10.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc527400640 1 --2- 172.21.15.32:0/3204963879 >> v2:172.21.15.67:3300/0 conn(0x7fc528151de0 0x7fc5280c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc527400640 1 -- 172.21.15.32:0/3204963879 >> v1:172.21.15.32:6789/0 conn(0x7fc5280a7200 legacy=0x7fc5280c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.196+0000 7fc527400640 1 -- 172.21.15.32:0/3204963879 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280c1db0 con 0x7fc528154c70 2024-01-19T04:18:10.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc527400640 1 --2- 172.21.15.32:0/3204963879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc528155100 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc520009d90 tx=0x7fc52001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d797e42e8baf2e93 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:10.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc525600640 1 -- 172.21.15.32:0/3204963879 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200a5860 con 0x7fc528154c70 2024-01-19T04:18:10.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc525600640 1 -- 172.21.15.32:0/3204963879 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5200a59c0 con 0x7fc528154c70 2024-01-19T04:18:10.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc525600640 1 -- 172.21.15.32:0/3204963879 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200a5d50 con 0x7fc528154c70 2024-01-19T04:18:10.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 -- 172.21.15.32:0/3204963879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 msgr2=0x7fc528155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 --2- 172.21.15.32:0/3204963879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc528155100 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc520009d90 tx=0x7fc52001c890 comp rx=0 tx=0).stop 2024-01-19T04:18:10.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 -- 172.21.15.32:0/3204963879 shutdown_connections 2024-01-19T04:18:10.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 --2- 172.21.15.32:0/3204963879 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc528155100 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 --2- 172.21.15.32:0/3204963879 >> v2:172.21.15.67:3300/0 conn(0x7fc528151de0 0x7fc5280c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 -- 172.21.15.32:0/3204963879 >> 172.21.15.32:0/3204963879 conn(0x7fc5280726d0 msgr2=0x7fc5280663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:10.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 -- 172.21.15.32:0/3204963879 shutdown_connections 2024-01-19T04:18:10.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.200+0000 7fc52d800640 1 -- 172.21.15.32:0/3204963879 wait complete. 2024-01-19T04:18:10.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 Processor -- start 2024-01-19T04:18:10.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 -- start start 2024-01-19T04:18:10.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5280a7200 0x7fc52814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc528151de0 0x7fc5281ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc5281ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281ed9d0 con 0x7fc5280a7200 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280a9370 con 0x7fc528151de0 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280a9650 con 0x7fc528154c70 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5280a7200 0x7fc52814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5280a7200 0x7fc52814eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58352/0 (socket says 172.21.15.32:58352) 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 -- 172.21.15.32:0/1893235658 learned_addr learned my addr 172.21.15.32:0/1893235658 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526000640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc528151de0 0x7fc5281ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc527400640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc5281ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 -- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 msgr2=0x7fc5281ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc5281ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 -- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc528151de0 msgr2=0x7fc5281ecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc528151de0 0x7fc5281ecc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 -- 172.21.15.32:0/1893235658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc520009a70 con 0x7fc5280a7200 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc526a00640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5280a7200 0x7fc52814eb50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc51800e930 tx=0x7fc51800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc51ea00640 1 -- 172.21.15.32:0/1893235658 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518009690 con 0x7fc5280a7200 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc51ea00640 1 -- 172.21.15.32:0/1893235658 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800ca00 con 0x7fc5280a7200 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc51ea00640 1 -- 172.21.15.32:0/1893235658 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800cd70 con 0x7fc5280a7200 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5280a9930 con 0x7fc5280a7200 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc528153af0 con 0x7fc5280a7200 2024-01-19T04:18:10.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.204+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5280749f0 con 0x7fc5280a7200 2024-01-19T04:18:10.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.208+0000 7fc51ea00640 1 -- 172.21.15.32:0/1893235658 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc518013470 con 0x7fc5280a7200 2024-01-19T04:18:10.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.208+0000 7fc51ea00640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc500066530 0x7fc5000689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.208+0000 7fc51ea00640 1 -- 172.21.15.32:0/1893235658 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc518084390 con 0x7fc5280a7200 2024-01-19T04:18:10.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.208+0000 7fc526000640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc500066530 0x7fc5000689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.208+0000 7fc526000640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc500066530 0x7fc5000689f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc510007fd0 tx=0x7fc510009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:10.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.212+0000 7fc51ea00640 1 -- 172.21.15.32:0/1893235658 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc518051430 con 0x7fc5280a7200 2024-01-19T04:18:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.380+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc5280c6dc0 con 0x7fc5280a7200 2024-01-19T04:18:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.380+0000 7fc51ea00640 1 -- 172.21.15.32:0/1893235658 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc518054a50 con 0x7fc5280a7200 2024-01-19T04:18:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc500066530 msgr2=0x7fc5000689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc500066530 0x7fc5000689f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc510007fd0 tx=0x7fc510009040 comp rx=0 tx=0).stop 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5280a7200 msgr2=0x7fc52814eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5280a7200 0x7fc52814eb50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc51800e930 tx=0x7fc51800edf0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 shutdown_connections 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc500066530 0x7fc5000689f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc528154c70 0x7fc5281ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc528151de0 0x7fc5281ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 --2- 172.21.15.32:0/1893235658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5280a7200 0x7fc52814eb50 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 >> 172.21.15.32:0/1893235658 conn(0x7fc5280726d0 msgr2=0x7fc5280c37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 shutdown_connections 2024-01-19T04:18:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.384+0000 7fc52d800640 1 -- 172.21.15.32:0/1893235658 wait complete. 2024-01-19T04:18:10.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-19T04:18:10.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:10.407 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:10.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:18:10.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:10.437 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:18:10.490 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:10.490 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:10.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:18:10.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:18:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c2a600640 1 Processor -- start 2024-01-19T04:18:10.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c2a600640 1 -- start start 2024-01-19T04:18:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c2a600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3c240a7000 0x7f3c240a7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c2a600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c24151fe0 con 0x7f3c2406f810 2024-01-19T04:18:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c2a600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c24157b30 con 0x7f3c2406fbf0 2024-01-19T04:18:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c2a600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240c1970 con 0x7f3c240a7000 2024-01-19T04:18:10.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c23400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3c2406f810 0x7f3c241545b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35798/0 (socket says 172.21.15.32:35798) 2024-01-19T04:18:10.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c23400640 1 -- 172.21.15.32:0/2252565713 learned_addr learned my addr 172.21.15.32:0/2252565713 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:10.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22a00640 1 --2- 172.21.15.32:0/2252565713 >> v2:172.21.15.67:3300/0 conn(0x7f3c240a7000 0x7f3c240a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706407932 0 0) 0x7f3c14001120 con 0x7f3c2406f810 2024-01-19T04:18:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c04003530 con 0x7f3c2406f810 2024-01-19T04:18:10.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343470718 0 0) 0x7f3c24157b30 con 0x7f3c2406fbf0 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c14001120 con 0x7f3c2406fbf0 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1175145701 0 0) 0x7f3c04003530 con 0x7f3c2406f810 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 >> v2:172.21.15.67:3300/0 conn(0x7f3c240a7000 msgr2=0x7f3c240a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 --2- 172.21.15.32:0/2252565713 >> v2:172.21.15.67:3300/0 conn(0x7f3c240a7000 0x7f3c240a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 >> v1:172.21.15.67:6789/0 conn(0x7f3c2406fbf0 legacy=0x7f3c2415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c241580f0 con 0x7f3c2406f810 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f3c14001810 con 0x7f3c2406f810 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 >> v1:172.21.15.32:6789/0 conn(0x7f3c2406f810 legacy=0x7f3c241545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c04003b10 0x7f3c04003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040047d0 0x7f3c04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240c1970 con 0x7f3c04005190 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0400c0c0 con 0x7f3c040047d0 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0400c280 con 0x7f3c04003b10 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c23e00640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c22a00640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040047d0 0x7f3c04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.680+0000 7f3c23400640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c04003b10 0x7f3c04003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c23e00640 1 -- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c04003b10 msgr2=0x7f3c04003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c23e00640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c04003b10 0x7f3c04003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c23e00640 1 -- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040047d0 msgr2=0x7f3c04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c23e00640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040047d0 0x7f3c04004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c23e00640 1 -- 172.21.15.32:0/2252565713 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04003530 con 0x7f3c04005190 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c23e00640 1 -- 172.21.15.32:0/2252565713 reap_dead start 2024-01-19T04:18:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c23e00640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c0400b990 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001fd0 tx=0x7f3c1c01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed27f83d0198be08 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a8c70 con 0x7f3c04005190 2024-01-19T04:18:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0a8dd0 con 0x7f3c04005190 2024-01-19T04:18:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c22000640 1 -- 172.21.15.32:0/2252565713 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c003bc0 con 0x7f3c04005190 2024-01-19T04:18:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c2a600640 1 -- 172.21.15.32:0/2252565713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 msgr2=0x7f3c0400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.684+0000 7f3c2a600640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c0400b990 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001fd0 tx=0x7f3c1c01f050 comp rx=0 tx=0).stop 2024-01-19T04:18:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- 172.21.15.32:0/2252565713 shutdown_connections 2024-01-19T04:18:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 --2- 172.21.15.32:0/2252565713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c0400b990 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- 172.21.15.32:0/2252565713 >> 172.21.15.32:0/2252565713 conn(0x7f3c240726d0 msgr2=0x7f3c240663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- 172.21.15.32:0/2252565713 shutdown_connections 2024-01-19T04:18:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- 172.21.15.32:0/2252565713 wait complete. 2024-01-19T04:18:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 Processor -- start 2024-01-19T04:18:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- start start 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c241ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c240a7e80 0x7f3c240ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c24156910 0x7f3c24156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240a9560 con 0x7f3c04005190 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c241ea670 con 0x7f3c240a7e80 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c2a600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240abe00 con 0x7f3c24156910 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c241ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c241ea130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58372/0 (socket says 172.21.15.32:58372) 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 -- 172.21.15.32:0/54097708 learned_addr learned my addr 172.21.15.32:0/54097708 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23e00640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c24156910 0x7f3c24156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c22a00640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c240a7e80 0x7f3c240ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 -- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c24156910 msgr2=0x7f3c24156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c24156910 0x7f3c24156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 -- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c240a7e80 msgr2=0x7f3c240ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c240a7e80 0x7f3c240ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.688+0000 7f3c23400640 1 -- 172.21.15.32:0/54097708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240a7660 con 0x7f3c04005190 2024-01-19T04:18:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c23400640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c241ea130 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3c14007090 tx=0x7f3c14007490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c1b400640 1 -- 172.21.15.32:0/54097708 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400f7b0 con 0x7f3c04005190 2024-01-19T04:18:10.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c1b400640 1 -- 172.21.15.32:0/54097708 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1400f930 con 0x7f3c04005190 2024-01-19T04:18:10.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c240a8390 con 0x7f3c04005190 2024-01-19T04:18:10.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c1b400640 1 -- 172.21.15.32:0/54097708 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400fce0 con 0x7f3c04005190 2024-01-19T04:18:10.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240a7900 con 0x7f3c04005190 2024-01-19T04:18:10.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c240749f0 con 0x7f3c04005190 2024-01-19T04:18:10.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c1b400640 1 -- 172.21.15.32:0/54097708 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3c1401e5c0 con 0x7f3c04005190 2024-01-19T04:18:10.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c1b400640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bfc066500 0x7f3bfc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:10.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c1b400640 1 -- 172.21.15.32:0/54097708 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3c14083c50 con 0x7f3c04005190 2024-01-19T04:18:10.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.692+0000 7f3c22a00640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bfc066500 0x7f3bfc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.696+0000 7f3c22a00640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bfc066500 0x7f3bfc0689c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406c370 tx=0x7f3c0c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:10.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.696+0000 7f3c1b400640 1 -- 172.21.15.32:0/54097708 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3c14089020 con 0x7f3c04005190 2024-01-19T04:18:10.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c24151fe0 con 0x7f3c04005190 2024-01-19T04:18:10.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c1b400640 1 -- 172.21.15.32:0/54097708 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+149 (secure 0 0 0) 0x7f3c24151fe0 con 0x7f3c04005190 2024-01-19T04:18:10.895 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:18:10.895 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-19T04:18:10.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bfc066500 msgr2=0x7f3bfc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bfc066500 0x7f3bfc0689c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406c370 tx=0x7f3c0c009190 comp rx=0 tx=0).stop 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 msgr2=0x7f3c241ea130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c241ea130 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3c14007090 tx=0x7f3c14007490 comp rx=0 tx=0).stop 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 shutdown_connections 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3bfc066500 0x7f3bfc0689c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3c24156910 0x7f3c24156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c240a7e80 0x7f3c240ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 --2- 172.21.15.32:0/54097708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c04005190 0x7f3c241ea130 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 >> 172.21.15.32:0/54097708 conn(0x7f3c240726d0 msgr2=0x7f3c240c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 shutdown_connections 2024-01-19T04:18:10.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:10.892+0000 7f3c2a600640 1 -- 172.21.15.32:0/54097708 wait complete. 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T04:18:10.917 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:18:10.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:10.918 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42275sec preferred_lft 42275sec 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:18:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:10.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:10.933 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:18:10.996 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:18:10.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:10.998 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:18:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:18:11.057 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:18:11.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.057 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:18:11.057 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:18:11.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:18:11.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:18:11.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:18:11.057 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:18:11.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.151 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:18:11.160 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:18:11.161 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:18:11.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.162 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:18:11.226 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:18:11.226 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:11.277 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:18:11.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:18:11.277 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:11.328 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2024-01-19T04:18:11.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.328 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:11.420 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:11.421 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:18:11.435 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:11.435 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:18:11.435 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:18:11.435 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 1@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs2=/ 2024-01-19T04:18:11.435 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:18:11.440 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:18:11.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.440 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:11.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.462 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:18:11.523 INFO:teuthology.orchestra.run.smithi067.stdout:client6733 2024-01-19T04:18:11.523 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:11.523 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:11.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.573 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2024-01-19T04:18:11.589 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:11.590 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2024-01-19T04:18:11.648 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:18:11.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:11.648 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2024-01-19T04:18:11.667 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:11.667 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2024-01-19T04:18:11.726 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:11.726 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2024-01-19T04:18:11.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0069e00640 1 Processor -- start 2024-01-19T04:18:11.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0069e00640 1 -- start start 2024-01-19T04:18:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0069e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f006406d440 0x7f00640c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0069e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640a4ea0 con 0x7f00640723b0 2024-01-19T04:18:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0069e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0064152a20 con 0x7f00640c2080 2024-01-19T04:18:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0069e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00641524a0 con 0x7f006406d440 2024-01-19T04:18:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0062a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f00640723b0 0x7f0064152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35812/0 (socket says 172.21.15.32:35812) 2024-01-19T04:18:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.876+0000 7f0062a00640 1 -- 172.21.15.32:0/3341407441 learned_addr learned my addr 172.21.15.32:0/3341407441 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281771807 0 0) 0x7f00640a4ea0 con 0x7f00640723b0 2024-01-19T04:18:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0044003530 con 0x7f00640723b0 2024-01-19T04:18:11.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0063400640 1 --2- 172.21.15.32:0/3341407441 >> v2:172.21.15.67:3300/0 conn(0x7f006406d440 0x7f00640c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73924153 0 0) 0x7f0044003530 con 0x7f00640723b0 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 >> v2:172.21.15.67:3300/0 conn(0x7f006406d440 msgr2=0x7f00640c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 --2- 172.21.15.32:0/3341407441 >> v2:172.21.15.67:3300/0 conn(0x7f006406d440 0x7f00640c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 >> v1:172.21.15.67:6789/0 conn(0x7f00640c2080 legacy=0x7f0064155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640c3430 con 0x7f00640723b0 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f0054001680 con 0x7f00640723b0 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 >> v1:172.21.15.32:6789/0 conn(0x7f00640723b0 legacy=0x7f0064152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044003980 0x7f0044003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00440047d0 0x7f0044004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0044005390 0x7f004400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00641524a0 con 0x7f00440047d0 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004400c220 con 0x7f0044003980 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004400c3e0 con 0x7f0044005390 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062000640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00440047d0 0x7f0044004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062a00640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044003980 0x7f0044003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0063400640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0044005390 0x7f004400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062000640 1 -- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0044005390 msgr2=0x7f004400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062000640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0044005390 0x7f004400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062000640 1 -- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044003980 msgr2=0x7f0044003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062000640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044003980 0x7f0044003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062000640 1 -- 172.21.15.32:0/3341407441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044003530 con 0x7f00440047d0 2024-01-19T04:18:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0063400640 1 -- 172.21.15.32:0/3341407441 reap_dead start 2024-01-19T04:18:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.880+0000 7f0062000640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00440047d0 0x7f0044004c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f004c001750 tx=0x7f004c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628aeaac923fc8b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c0052d0 con 0x7f00440047d0 2024-01-19T04:18:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c0a7050 con 0x7f00440047d0 2024-01-19T04:18:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0061600640 1 -- 172.21.15.32:0/3341407441 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c003600 con 0x7f00440047d0 2024-01-19T04:18:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- 172.21.15.32:0/3341407441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00440047d0 msgr2=0x7f0044004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00440047d0 0x7f0044004c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f004c001750 tx=0x7f004c01c370 comp rx=0 tx=0).stop 2024-01-19T04:18:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- 172.21.15.32:0/3341407441 shutdown_connections 2024-01-19T04:18:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 --2- 172.21.15.32:0/3341407441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00440047d0 0x7f0044004c50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- 172.21.15.32:0/3341407441 >> 172.21.15.32:0/3341407441 conn(0x7f00640c25a0 msgr2=0x7f00640c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- 172.21.15.32:0/3341407441 shutdown_connections 2024-01-19T04:18:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- 172.21.15.32:0/3341407441 wait complete. 2024-01-19T04:18:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 Processor -- start 2024-01-19T04:18:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- start start 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00440047d0 0x7f00641ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00641de2e0 0x7f00640a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00640ab550 0x7f00641df8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640a9090 con 0x7f00640ab550 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00641df440 con 0x7f00440047d0 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.884+0000 7f0069e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00641de830 con 0x7f00641de2e0 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00640ab550 0x7f00641df8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00640ab550 0x7f00641df8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58396/0 (socket says 172.21.15.32:58396) 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 -- 172.21.15.32:0/1567723062 learned_addr learned my addr 172.21.15.32:0/1567723062 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:11.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0062a00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00440047d0 0x7f00641ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0062000640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00641de2e0 0x7f00640a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 -- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00641de2e0 msgr2=0x7f00640a8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00641de2e0 0x7f00640a8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 -- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00440047d0 msgr2=0x7f00641ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00440047d0 0x7f00641ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 -- 172.21.15.32:0/1567723062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00641deb10 con 0x7f00640ab550 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0062000640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00641de2e0 0x7f00640a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0063400640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00640ab550 0x7f00641df8d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f00640c5ab0 tx=0x7f005c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f005b400640 1 -- 172.21.15.32:0/1567723062 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c009e70 con 0x7f00640ab550 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f005b400640 1 -- 172.21.15.32:0/1567723062 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c00f050 con 0x7f00640ab550 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f005b400640 1 -- 172.21.15.32:0/1567723062 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c014670 con 0x7f00640ab550 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00641dedf0 con 0x7f00640ab550 2024-01-19T04:18:11.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640ab9d0 con 0x7f00640ab550 2024-01-19T04:18:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00640749f0 con 0x7f00640ab550 2024-01-19T04:18:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.888+0000 7f005b400640 1 -- 172.21.15.32:0/1567723062 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f005c0149e0 con 0x7f00640ab550 2024-01-19T04:18:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.892+0000 7f005b400640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f003c066500 0x7f003c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.892+0000 7f005b400640 1 -- 172.21.15.32:0/1567723062 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f005c084970 con 0x7f00640ab550 2024-01-19T04:18:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.892+0000 7f0062a00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f003c066500 0x7f003c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.892+0000 7f0062a00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f003c066500 0x7f003c0689c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0054001130 tx=0x7f0054001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:11.896+0000 7f005b400640 1 -- 172.21.15.32:0/1567723062 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f005c0518a0 con 0x7f00640ab550 2024-01-19T04:18:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.108+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7f0064155870 con 0x7f00640ab550 2024-01-19T04:18:12.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.108+0000 7f005b400640 1 -- 172.21.15.32:0/1567723062 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v21) v1 ==== 272+0+0 (secure 0 0 0) 0x7f005c054ec0 con 0x7f00640ab550 2024-01-19T04:18:12.114 INFO:teuthology.orchestra.run.smithi032.stderr:added key for client.testuser 2024-01-19T04:18:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f003c066500 msgr2=0x7f003c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f003c066500 0x7f003c0689c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0054001130 tx=0x7f0054001e50 comp rx=0 tx=0).stop 2024-01-19T04:18:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00640ab550 msgr2=0x7f00641df8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00640ab550 0x7f00641df8d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f00640c5ab0 tx=0x7f005c007700 comp rx=0 tx=0).stop 2024-01-19T04:18:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 shutdown_connections 2024-01-19T04:18:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f003c066500 0x7f003c0689c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00640ab550 0x7f00641df8d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f00641de2e0 0x7f00640a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 --2- 172.21.15.32:0/1567723062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00440047d0 0x7f00641ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 >> 172.21.15.32:0/1567723062 conn(0x7f00640c25a0 msgr2=0x7f00640a5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 shutdown_connections 2024-01-19T04:18:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.112+0000 7f0069e00640 1 -- 172.21.15.32:0/1567723062 wait complete. 2024-01-19T04:18:12.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2024-01-19T04:18:12.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 Processor -- start 2024-01-19T04:18:12.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 -- start start 2024-01-19T04:18:12.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f48e00c6e20 0x7f48e00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00a6d30 0x7f48e00c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48e006fda0 0x7f48e0152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e0156380 con 0x7f48e006fda0 2024-01-19T04:18:12.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e014fe40 con 0x7f48e00c6e20 2024-01-19T04:18:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e7c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0152800 con 0x7f48e00a6d30 2024-01-19T04:18:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48e006fda0 0x7f48e0152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48e006fda0 0x7f48e0152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58400/0 (socket says 172.21.15.32:58400) 2024-01-19T04:18:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 -- 172.21.15.32:0/1470522319 learned_addr learned my addr 172.21.15.32:0/1470522319 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5200640 1 --2- 172.21.15.32:0/1470522319 >> v2:172.21.15.67:3300/0 conn(0x7f48e00c6e20 0x7f48e00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48dfe00640 1 --2- 172.21.15.32:0/1470522319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00a6d30 0x7f48e00c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 -- 172.21.15.32:0/1470522319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00a6d30 msgr2=0x7f48e00c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 --2- 172.21.15.32:0/1470522319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00a6d30 0x7f48e00c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 -- 172.21.15.32:0/1470522319 >> v2:172.21.15.67:3300/0 conn(0x7f48e00c6e20 msgr2=0x7f48e00c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 --2- 172.21.15.32:0/1470522319 >> v2:172.21.15.67:3300/0 conn(0x7f48e00c6e20 0x7f48e00c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.276+0000 7f48e5c00640 1 -- 172.21.15.32:0/1470522319 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0156590 con 0x7f48e006fda0 2024-01-19T04:18:12.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e5c00640 1 --2- 172.21.15.32:0/1470522319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e006fda0 0x7f48e0152c90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f48e00c57c0 tx=0x7f48d801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef01313eb29733a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48df400640 1 -- 172.21.15.32:0/1470522319 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80a5710 con 0x7f48e006fda0 2024-01-19T04:18:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48df400640 1 -- 172.21.15.32:0/1470522319 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d80a5870 con 0x7f48e006fda0 2024-01-19T04:18:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48df400640 1 -- 172.21.15.32:0/1470522319 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80a5c00 con 0x7f48e006fda0 2024-01-19T04:18:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 -- 172.21.15.32:0/1470522319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e006fda0 msgr2=0x7f48e0152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 --2- 172.21.15.32:0/1470522319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e006fda0 0x7f48e0152c90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f48e00c57c0 tx=0x7f48d801c8b0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 -- 172.21.15.32:0/1470522319 shutdown_connections 2024-01-19T04:18:12.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 --2- 172.21.15.32:0/1470522319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e006fda0 0x7f48e0152c90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 --2- 172.21.15.32:0/1470522319 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00a6d30 0x7f48e00c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 --2- 172.21.15.32:0/1470522319 >> v2:172.21.15.67:3300/0 conn(0x7f48e00c6e20 0x7f48e00c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 -- 172.21.15.32:0/1470522319 >> 172.21.15.32:0/1470522319 conn(0x7f48e00a9870 msgr2=0x7f48e00a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:12.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 -- 172.21.15.32:0/1470522319 shutdown_connections 2024-01-19T04:18:12.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.280+0000 7f48e7c00640 1 -- 172.21.15.32:0/1470522319 wait complete. 2024-01-19T04:18:12.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 Processor -- start 2024-01-19T04:18:12.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 -- start start 2024-01-19T04:18:12.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48e006fda0 0x7f48e01f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e00a6d30 0x7f48e014e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00c6e20 0x7f48e01ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e006cdf0 con 0x7f48e00a6d30 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e014ec30 con 0x7f48e006fda0 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e006bfc0 con 0x7f48e00c6e20 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e00a6d30 0x7f48e014e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e00a6d30 0x7f48e014e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58404/0 (socket says 172.21.15.32:58404) 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 -- 172.21.15.32:0/138529714 learned_addr learned my addr 172.21.15.32:0/138529714 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e5200640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48e006fda0 0x7f48e01f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e5c00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00c6e20 0x7f48e01ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 -- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00c6e20 msgr2=0x7f48e01ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00c6e20 0x7f48e01ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 -- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48e006fda0 msgr2=0x7f48e01f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48e006fda0 0x7f48e01f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 -- 172.21.15.32:0/138529714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d8009b30 con 0x7f48e00a6d30 2024-01-19T04:18:12.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dfe00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e00a6d30 0x7f48e014e6f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f48c8006e90 tx=0x7f48c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dcc00640 1 -- 172.21.15.32:0/138529714 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800b6c0 con 0x7f48e00a6d30 2024-01-19T04:18:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dcc00640 1 -- 172.21.15.32:0/138529714 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c800b840 con 0x7f48e00a6d30 2024-01-19T04:18:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48dcc00640 1 -- 172.21.15.32:0/138529714 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800bbf0 con 0x7f48e00a6d30 2024-01-19T04:18:12.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e006c2a0 con 0x7f48e00a6d30 2024-01-19T04:18:12.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.284+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e01f0190 con 0x7f48e00a6d30 2024-01-19T04:18:12.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.288+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00749f0 con 0x7f48e00a6d30 2024-01-19T04:18:12.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.288+0000 7f48dcc00640 1 -- 172.21.15.32:0/138529714 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f48c800bd50 con 0x7f48e00a6d30 2024-01-19T04:18:12.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.288+0000 7f48dcc00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f48b8066500 0x7f48b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.288+0000 7f48dcc00640 1 -- 172.21.15.32:0/138529714 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f48c80845b0 con 0x7f48e00a6d30 2024-01-19T04:18:12.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.288+0000 7f48e5200640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f48b8066500 0x7f48b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.288+0000 7f48e5200640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f48b8066500 0x7f48b80689c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48e00a7ac0 tx=0x7f48d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:12.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.292+0000 7f48dcc00640 1 -- 172.21.15.32:0/138529714 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f48c8051590 con 0x7f48e00a6d30 2024-01-19T04:18:12.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f48e0067b80 con 0x7f48e00a6d30 2024-01-19T04:18:12.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48dcc00640 1 -- 172.21.15.32:0/138529714 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+226 (secure 0 0 0) 0x7f48c8054bb0 con 0x7f48e00a6d30 2024-01-19T04:18:12.511 INFO:teuthology.orchestra.run.smithi032.stdout:[client.testuser] 2024-01-19T04:18:12.511 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q== 2024-01-19T04:18:12.511 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2024-01-19T04:18:12.511 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-01-19T04:18:12.512 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-19T04:18:12.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f48b8066500 msgr2=0x7f48b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f48b8066500 0x7f48b80689c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48e00a7ac0 tx=0x7f48d0008040 comp rx=0 tx=0).stop 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e00a6d30 msgr2=0x7f48e014e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e00a6d30 0x7f48e014e6f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f48c8006e90 tx=0x7f48c800dc60 comp rx=0 tx=0).stop 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 shutdown_connections 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f48b8066500 0x7f48b80689c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f48e00c6e20 0x7f48e01ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48e00a6d30 0x7f48e014e6f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 --2- 172.21.15.32:0/138529714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48e006fda0 0x7f48e01f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 >> 172.21.15.32:0/138529714 conn(0x7f48e00a9870 msgr2=0x7f48e00a9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 shutdown_connections 2024-01-19T04:18:12.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.508+0000 7f48e7c00640 1 -- 172.21.15.32:0/138529714 wait complete. 2024-01-19T04:18:12.533 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-19T04:18:12.533 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-01-19T04:18:12.542 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.79iTGdPOcI 2024-01-19T04:18:12.542 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:12.542 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/tmp/tmp.79iTGdPOcI 2024-01-19T04:18:12.593 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:12.594 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:12.646 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:12.646 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:12.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:12.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 Processor -- start 2024-01-19T04:18:12.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 -- start start 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1ce80a7260 0x7f1ce80c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce80c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ce8158710 0x7f1ce80c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce8158cb0 con 0x7f1ce8158710 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80c6200 con 0x7f1ce80a7260 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ced800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80c3360 con 0x7f1ce8155ca0 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ce8158710 0x7f1ce80c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ce8158710 0x7f1ce80c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58406/0 (socket says 172.21.15.32:58406) 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 -- 172.21.15.32:0/528441185 learned_addr learned my addr 172.21.15.32:0/528441185 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/528441185 >> v2:172.21.15.67:3300/0 conn(0x7f1ce80a7260 0x7f1ce80c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce6000640 1 --2- 172.21.15.32:0/528441185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce80c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 -- 172.21.15.32:0/528441185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 msgr2=0x7f1ce80c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:12.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 --2- 172.21.15.32:0/528441185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce80c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 -- 172.21.15.32:0/528441185 >> v2:172.21.15.67:3300/0 conn(0x7f1ce80a7260 msgr2=0x7f1ce80c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:12.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 --2- 172.21.15.32:0/528441185 >> v2:172.21.15.67:3300/0 conn(0x7f1ce80a7260 0x7f1ce80c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce7400640 1 -- 172.21.15.32:0/528441185 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80c75f0 con 0x7f1ce8158710 2024-01-19T04:18:12.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.880+0000 7f1ce6000640 1 --2- 172.21.15.32:0/528441185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:12.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ce7400640 1 --2- 172.21.15.32:0/528441185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce8158710 0x7f1ce80c45f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8073eb0 tx=0x7f1ce001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b45f485ce5ab55e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:12.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ce5600640 1 -- 172.21.15.32:0/528441185 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00a5820 con 0x7f1ce8158710 2024-01-19T04:18:12.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ce5600640 1 -- 172.21.15.32:0/528441185 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce00a5980 con 0x7f1ce8158710 2024-01-19T04:18:12.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ce5600640 1 -- 172.21.15.32:0/528441185 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00a5d10 con 0x7f1ce8158710 2024-01-19T04:18:12.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 -- 172.21.15.32:0/528441185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce8158710 msgr2=0x7f1ce80c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 --2- 172.21.15.32:0/528441185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce8158710 0x7f1ce80c45f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8073eb0 tx=0x7f1ce001c9a0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 -- 172.21.15.32:0/528441185 shutdown_connections 2024-01-19T04:18:12.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 --2- 172.21.15.32:0/528441185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce8158710 0x7f1ce80c45f0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 --2- 172.21.15.32:0/528441185 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 --2- 172.21.15.32:0/528441185 >> v2:172.21.15.67:3300/0 conn(0x7f1ce80a7260 0x7f1ce80c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 -- 172.21.15.32:0/528441185 >> 172.21.15.32:0/528441185 conn(0x7f1ce80a99f0 msgr2=0x7f1ce80a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:12.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 -- 172.21.15.32:0/528441185 shutdown_connections 2024-01-19T04:18:12.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.884+0000 7f1ced800640 1 -- 172.21.15.32:0/528441185 wait complete. 2024-01-19T04:18:12.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 Processor -- start 2024-01-19T04:18:12.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 -- start start 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80a7260 0x7f1ce814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce81ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8158710 0x7f1ce81ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce815a020 con 0x7f1ce80a7260 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80acb00 con 0x7f1ce8158710 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8150e60 con 0x7f1ce8155ca0 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80a7260 0x7f1ce814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80a7260 0x7f1ce814fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58418/0 (socket says 172.21.15.32:58418) 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 -- 172.21.15.32:0/1736287170 learned_addr learned my addr 172.21.15.32:0/1736287170 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6000640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce81ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce7400640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8158710 0x7f1ce81ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 -- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 msgr2=0x7f1ce81ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce81ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 -- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8158710 msgr2=0x7f1ce81ed970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8158710 0x7f1ce81ed970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 -- 172.21.15.32:0/1736287170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009b30 con 0x7f1ce80a7260 2024-01-19T04:18:12.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80a7260 0x7f1ce814fb40 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800e8b0 tx=0x7f1cd800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:12.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1cdea00640 1 -- 172.21.15.32:0/1736287170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800c940 con 0x7f1ce80a7260 2024-01-19T04:18:12.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1cdea00640 1 -- 172.21.15.32:0/1736287170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd800caa0 con 0x7f1ce80a7260 2024-01-19T04:18:12.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1cdea00640 1 -- 172.21.15.32:0/1736287170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800ce30 con 0x7f1ce80a7260 2024-01-19T04:18:12.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.888+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8151140 con 0x7f1ce80a7260 2024-01-19T04:18:12.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.892+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80ad030 con 0x7f1ce80a7260 2024-01-19T04:18:12.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.892+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce80749f0 con 0x7f1ce80a7260 2024-01-19T04:18:12.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.892+0000 7f1cdea00640 1 -- 172.21.15.32:0/1736287170 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1cd8013470 con 0x7f1ce80a7260 2024-01-19T04:18:12.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.892+0000 7f1cdea00640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1cc0066500 0x7f1cc00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:12.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.892+0000 7f1cdea00640 1 -- 172.21.15.32:0/1736287170 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1cd8084340 con 0x7f1ce80a7260 2024-01-19T04:18:12.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.892+0000 7f1ce6000640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1cc0066500 0x7f1cc00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:12.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.892+0000 7f1ce6000640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1cc0066500 0x7f1cc00689c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8070160 tx=0x7f1cd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:12.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:12.896+0000 7f1cdea00640 1 -- 172.21.15.32:0/1736287170 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1cd8051310 con 0x7f1ce80a7260 2024-01-19T04:18:13.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.056+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce81519b0 con 0x7f1ce80a7260 2024-01-19T04:18:13.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1cdea00640 1 -- 172.21.15.32:0/1736287170 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7f1cd8059e60 con 0x7f1ce80a7260 2024-01-19T04:18:13.062 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:13.062 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:13.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1cc0066500 msgr2=0x7f1cc00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1cc0066500 0x7f1cc00689c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8070160 tx=0x7f1cd0008040 comp rx=0 tx=0).stop 2024-01-19T04:18:13.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80a7260 msgr2=0x7f1ce814fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80a7260 0x7f1ce814fb40 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800e8b0 tx=0x7f1cd800ed70 comp rx=0 tx=0).stop 2024-01-19T04:18:13.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 shutdown_connections 2024-01-19T04:18:13.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1cc0066500 0x7f1cc00689c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8158710 0x7f1ce81ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1ce8155ca0 0x7f1ce81ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 --2- 172.21.15.32:0/1736287170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80a7260 0x7f1ce814fb40 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 >> 172.21.15.32:0/1736287170 conn(0x7f1ce80a99f0 msgr2=0x7f1ce8155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:13.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 shutdown_connections 2024-01-19T04:18:13.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.060+0000 7f1ced800640 1 -- 172.21.15.32:0/1736287170 wait complete. 2024-01-19T04:18:13.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:17:47.021907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:17:48.211408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:18:00.535616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:18:01.296998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:18:13.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:18:13.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.224+0000 7eff81e00640 1 Processor -- start 2024-01-19T04:18:13.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.224+0000 7eff81e00640 1 -- start start 2024-01-19T04:18:13.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.224+0000 7eff81e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff7c0c4e50 0x7eff7c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.224+0000 7eff81e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c0c6120 0x7eff7c0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.224+0000 7eff81e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7c152bc0 con 0x7eff7c152620 2024-01-19T04:18:13.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.224+0000 7eff81e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7c06ea00 con 0x7eff7c0c4e50 2024-01-19T04:18:13.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.224+0000 7eff81e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c152ea0 con 0x7eff7c0c6120 2024-01-19T04:18:13.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c0c6120 0x7eff7c0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7aa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7eff7c0c4e50 0x7eff7c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c0c6120 0x7eff7c0c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:37444/0 (socket says 172.21.15.32:37444) 2024-01-19T04:18:13.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 -- 172.21.15.32:0/1188477676 learned_addr learned my addr 172.21.15.32:0/1188477676 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:13.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7a000640 1 --1- 172.21.15.32:0/1188477676 >> v1:172.21.15.67:6789/0 conn(0x7eff7c152620 0x7eff7c06f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:46668/0 (socket says 172.21.15.32:46668) 2024-01-19T04:18:13.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 -- 172.21.15.32:0/1188477676 >> v2:172.21.15.67:3300/0 conn(0x7eff7c0c4e50 msgr2=0x7eff7c0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:13.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 --2- 172.21.15.32:0/1188477676 >> v2:172.21.15.67:3300/0 conn(0x7eff7c0c4e50 0x7eff7c0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 -- 172.21.15.32:0/1188477676 >> v1:172.21.15.67:6789/0 conn(0x7eff7c152620 legacy=0x7eff7c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 -- 172.21.15.32:0/1188477676 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c153180 con 0x7eff7c0c6120 2024-01-19T04:18:13.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7aa00640 1 --2- 172.21.15.32:0/1188477676 >> v2:172.21.15.67:3300/0 conn(0x7eff7c0c4e50 0x7eff7c0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:13.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff7b400640 1 --2- 172.21.15.32:0/1188477676 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c0c6120 0x7eff7c0c6590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff74009e50 tx=0x7eff7401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=165127bffacd160b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff79600640 1 -- 172.21.15.32:0/1188477676 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740af400 con 0x7eff7c0c6120 2024-01-19T04:18:13.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff79600640 1 -- 172.21.15.32:0/1188477676 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740ab050 con 0x7eff7c0c6120 2024-01-19T04:18:13.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.228+0000 7eff79600640 1 -- 172.21.15.32:0/1188477676 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740af780 con 0x7eff7c0c6120 2024-01-19T04:18:13.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- 172.21.15.32:0/1188477676 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c0c6120 msgr2=0x7eff7c0c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 --2- 172.21.15.32:0/1188477676 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c0c6120 0x7eff7c0c6590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff74009e50 tx=0x7eff7401f1f0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- 172.21.15.32:0/1188477676 shutdown_connections 2024-01-19T04:18:13.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 --2- 172.21.15.32:0/1188477676 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c0c6120 0x7eff7c0c6590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 --2- 172.21.15.32:0/1188477676 >> v2:172.21.15.67:3300/0 conn(0x7eff7c0c4e50 0x7eff7c0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- 172.21.15.32:0/1188477676 >> 172.21.15.32:0/1188477676 conn(0x7eff7c0c7d40 msgr2=0x7eff7c0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:13.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- 172.21.15.32:0/1188477676 shutdown_connections 2024-01-19T04:18:13.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- 172.21.15.32:0/1188477676 wait complete. 2024-01-19T04:18:13.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 Processor -- start 2024-01-19T04:18:13.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- start start 2024-01-19T04:18:13.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff7c0c4e50 0x7eff7c149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff7c0c6120 0x7eff7c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c152620 0x7eff7c147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c145c50 con 0x7eff7c0c6120 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c148d30 con 0x7eff7c0c4e50 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff81e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c1492f0 con 0x7eff7c152620 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff7a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff7c0c6120 0x7eff7c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff7a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff7c0c6120 0x7eff7c14e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58434/0 (socket says 172.21.15.32:58434) 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.232+0000 7eff7a000640 1 -- 172.21.15.32:0/2209263197 learned_addr learned my addr 172.21.15.32:0/2209263197 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7aa00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff7c0c4e50 0x7eff7c149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7b400640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c152620 0x7eff7c147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7a000640 1 -- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c152620 msgr2=0x7eff7c147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7a000640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c152620 0x7eff7c147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7a000640 1 -- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff7c0c4e50 msgr2=0x7eff7c149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7a000640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff7c0c4e50 0x7eff7c149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7a000640 1 -- 172.21.15.32:0/2209263197 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c009420 con 0x7eff7c0c6120 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7aa00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff7c0c4e50 0x7eff7c149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff7a000640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff7c0c6120 0x7eff7c14e250 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c3a0 tx=0x7eff6400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff73400640 1 -- 172.21.15.32:0/2209263197 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640074e0 con 0x7eff7c0c6120 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff73400640 1 -- 172.21.15.32:0/2209263197 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64007640 con 0x7eff7c0c6120 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff74009b30 con 0x7eff7c0c6120 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff73400640 1 -- 172.21.15.32:0/2209263197 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64004a30 con 0x7eff7c0c6120 2024-01-19T04:18:13.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c149bd0 con 0x7eff7c0c6120 2024-01-19T04:18:13.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c149480 con 0x7eff7c0c6120 2024-01-19T04:18:13.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.236+0000 7eff73400640 1 -- 172.21.15.32:0/2209263197 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7eff64004b90 con 0x7eff7c0c6120 2024-01-19T04:18:13.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.240+0000 7eff73400640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff54066500 0x7eff540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.240+0000 7eff73400640 1 -- 172.21.15.32:0/2209263197 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7eff64083bb0 con 0x7eff7c0c6120 2024-01-19T04:18:13.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.240+0000 7eff7aa00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff54066500 0x7eff540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.240+0000 7eff7aa00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff54066500 0x7eff540689c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff7c070310 tx=0x7eff6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.240+0000 7eff73400640 1 -- 172.21.15.32:0/2209263197 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7eff64050ae0 con 0x7eff7c0c6120 2024-01-19T04:18:13.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.400+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff7c1556a0 con 0x7eff7c0c6120 2024-01-19T04:18:13.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.400+0000 7eff73400640 1 -- 172.21.15.32:0/2209263197 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff64054100 con 0x7eff7c0c6120 2024-01-19T04:18:13.408 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff54066500 msgr2=0x7eff540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff54066500 0x7eff540689c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff7c070310 tx=0x7eff6c008040 comp rx=0 tx=0).stop 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff7c0c6120 msgr2=0x7eff7c14e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff7c0c6120 0x7eff7c14e250 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c3a0 tx=0x7eff6400c860 comp rx=0 tx=0).stop 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 shutdown_connections 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7eff54066500 0x7eff540689c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7eff7c152620 0x7eff7c147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff7c0c6120 0x7eff7c14e250 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 --2- 172.21.15.32:0/2209263197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff7c0c4e50 0x7eff7c149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 >> 172.21.15.32:0/2209263197 conn(0x7eff7c0c7d40 msgr2=0x7eff7c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:13.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 shutdown_connections 2024-01-19T04:18:13.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.404+0000 7eff81e00640 1 -- 172.21.15.32:0/2209263197 wait complete. 2024-01-19T04:18:13.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:18:13.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da7a00640 1 Processor -- start 2024-01-19T04:18:13.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da7a00640 1 -- start start 2024-01-19T04:18:13.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da7a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1da0155150 0x7f1da0157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da7a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00c2d30 con 0x7f1da0151b80 2024-01-19T04:18:13.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da7a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00c3010 con 0x7f1da00c6360 2024-01-19T04:18:13.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da7a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da00c34a0 con 0x7f1da0155150 2024-01-19T04:18:13.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da5000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1da0151b80 0x7f1da00c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35816/0 (socket says 172.21.15.32:35816) 2024-01-19T04:18:13.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.568+0000 7f1da5000640 1 -- 172.21.15.32:0/503535042 learned_addr learned my addr 172.21.15.32:0/503535042 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9fe00640 1 --2- 172.21.15.32:0/503535042 >> v2:172.21.15.67:3300/0 conn(0x7f1da0155150 0x7f1da0157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603870321 0 0) 0x7f1da00c2d30 con 0x7f1da0151b80 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d80003530 con 0x7f1da0151b80 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733979759 0 0) 0x7f1da00c3010 con 0x7f1da00c6360 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da00c2d30 con 0x7f1da00c6360 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816486185 0 0) 0x7f1d80003530 con 0x7f1da0151b80 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9fe00640 1 -- 172.21.15.32:0/503535042 >> v1:172.21.15.67:6789/0 conn(0x7f1da00c6360 legacy=0x7f1da00c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9fe00640 1 -- 172.21.15.32:0/503535042 >> v1:172.21.15.32:6789/0 conn(0x7f1da0151b80 legacy=0x7f1da00c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9fe00640 1 -- 172.21.15.32:0/503535042 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00c7700 con 0x7f1da0155150 2024-01-19T04:18:13.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9fe00640 1 --2- 172.21.15.32:0/503535042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da0155150 0x7f1da0157cc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1d880097c0 tx=0x7f1d8801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491c597ea3feaa1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90001680 con 0x7f1da0155150 2024-01-19T04:18:13.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d880a7050 con 0x7f1da0155150 2024-01-19T04:18:13.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.572+0000 7f1d9f400640 1 -- 172.21.15.32:0/503535042 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880ab620 con 0x7f1da0155150 2024-01-19T04:18:13.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- 172.21.15.32:0/503535042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da0155150 msgr2=0x7f1da0157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 --2- 172.21.15.32:0/503535042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da0155150 0x7f1da0157cc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1d880097c0 tx=0x7f1d8801c370 comp rx=0 tx=0).stop 2024-01-19T04:18:13.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- 172.21.15.32:0/503535042 shutdown_connections 2024-01-19T04:18:13.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 --2- 172.21.15.32:0/503535042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da0155150 0x7f1da0157cc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- 172.21.15.32:0/503535042 >> 172.21.15.32:0/503535042 conn(0x7f1da00c7d40 msgr2=0x7f1da00c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:13.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- 172.21.15.32:0/503535042 shutdown_connections 2024-01-19T04:18:13.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- 172.21.15.32:0/503535042 wait complete. 2024-01-19T04:18:13.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 Processor -- start 2024-01-19T04:18:13.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- start start 2024-01-19T04:18:13.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da00c6360 0x7f1da014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da0151b80 0x7f1da0149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1da0155150 0x7f1da0153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0155730 con 0x7f1da0151b80 2024-01-19T04:18:13.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0152540 con 0x7f1da00c6360 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da7a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01533a0 con 0x7f1da0155150 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1d9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da0151b80 0x7f1da0149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1d9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da0151b80 0x7f1da0149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58446/0 (socket says 172.21.15.32:58446) 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1d9fe00640 1 -- 172.21.15.32:0/146941748 learned_addr learned my addr 172.21.15.32:0/146941748 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.576+0000 7f1da5000640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da00c6360 0x7f1da014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1da5a00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1da0155150 0x7f1da0153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9fe00640 1 -- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1da0155150 msgr2=0x7f1da0153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9fe00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1da0155150 0x7f1da0153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9fe00640 1 -- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da00c6360 msgr2=0x7f1da014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9fe00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da00c6360 0x7f1da014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9fe00640 1 -- 172.21.15.32:0/146941748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88009420 con 0x7f1da0151b80 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1da5000640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da00c6360 0x7f1da014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:13.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9fe00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da0151b80 0x7f1da0149f90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1d88019fa0 tx=0x7f1d88019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9cc00640 1 -- 172.21.15.32:0/146941748 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88004030 con 0x7f1da0151b80 2024-01-19T04:18:13.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9cc00640 1 -- 172.21.15.32:0/146941748 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88004190 con 0x7f1da0151b80 2024-01-19T04:18:13.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9cc00640 1 -- 172.21.15.32:0/146941748 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88004500 con 0x7f1da0151b80 2024-01-19T04:18:13.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da0152790 con 0x7f1da0151b80 2024-01-19T04:18:13.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da0152d50 con 0x7f1da0151b80 2024-01-19T04:18:13.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0153530 con 0x7f1da0151b80 2024-01-19T04:18:13.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.580+0000 7f1d9cc00640 1 -- 172.21.15.32:0/146941748 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1d880b2040 con 0x7f1da0151b80 2024-01-19T04:18:13.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.584+0000 7f1d9cc00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d78066500 0x7f1d780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.584+0000 7f1d9cc00640 1 -- 172.21.15.32:0/146941748 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1d8811e1e0 con 0x7f1da0151b80 2024-01-19T04:18:13.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.584+0000 7f1da5000640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d78066500 0x7f1d780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.584+0000 7f1da5000640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d78066500 0x7f1d780689c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000fe0 tx=0x7f1d900016a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.588+0000 7f1d9cc00640 1 -- 172.21.15.32:0/146941748 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1d880eb1c0 con 0x7f1da0151b80 2024-01-19T04:18:13.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.744+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1da00749f0 con 0x7f1da0151b80 2024-01-19T04:18:13.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.744+0000 7f1d9cc00640 1 -- 172.21.15.32:0/146941748 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d880ee7e0 con 0x7f1da0151b80 2024-01-19T04:18:13.750 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:13.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d78066500 msgr2=0x7f1d780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d78066500 0x7f1d780689c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000fe0 tx=0x7f1d900016a0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da0151b80 msgr2=0x7f1da0149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da0151b80 0x7f1da0149f90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1d88019fa0 tx=0x7f1d88019110 comp rx=0 tx=0).stop 2024-01-19T04:18:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 shutdown_connections 2024-01-19T04:18:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1d78066500 0x7f1d780689c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1da0155150 0x7f1da0153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da0151b80 0x7f1da0149f90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 --2- 172.21.15.32:0/146941748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1da00c6360 0x7f1da014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 >> 172.21.15.32:0/146941748 conn(0x7f1da00c7d40 msgr2=0x7f1da0157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 shutdown_connections 2024-01-19T04:18:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.748+0000 7f1da7a00640 1 -- 172.21.15.32:0/146941748 wait complete. 2024-01-19T04:18:13.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:18:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.916+0000 7f0ac4600640 1 Processor -- start 2024-01-19T04:18:13.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.916+0000 7f0ac4600640 1 -- start start 2024-01-19T04:18:13.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.916+0000 7f0ac4600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0abc070e60 0x7f0abc0bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.916+0000 7f0ac4600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0bc8d0 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.916+0000 7f0ac4600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0c2bd0 con 0x7f0abc1523a0 2024-01-19T04:18:13.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.916+0000 7f0ac4600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0c1b50 con 0x7f0abc070e60 2024-01-19T04:18:13.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0ac2600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0abc0bd2a0 0x7f0abc15c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35832/0 (socket says 172.21.15.32:35832) 2024-01-19T04:18:13.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0ac2600640 1 -- 172.21.15.32:0/512026373 learned_addr learned my addr 172.21.15.32:0/512026373 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:13.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0ac1200640 1 --2- 172.21.15.32:0/512026373 >> v2:172.21.15.32:3300/0 conn(0x7f0abc070e60 0x7f0abc0bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0ac1200640 1 -- 172.21.15.32:0/512026373 >> v1:172.21.15.67:6789/0 conn(0x7f0abc1523a0 legacy=0x7f0abc0c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0abbe00640 1 -- 172.21.15.32:0/512026373 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615889033 0 0) 0x7f0abc0bc8d0 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0ac1200640 1 -- 172.21.15.32:0/512026373 >> v1:172.21.15.32:6789/0 conn(0x7f0abc0bd2a0 legacy=0x7f0abc15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0ac1200640 1 -- 172.21.15.32:0/512026373 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0bc5a0 con 0x7f0abc070e60 2024-01-19T04:18:13.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.920+0000 7f0ac1200640 1 --2- 172.21.15.32:0/512026373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc070e60 0x7f0abc0bcd60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009740 tx=0x7f0aa401c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7537e4537c007b1e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0abbe00640 1 -- 172.21.15.32:0/512026373 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40ab600 con 0x7f0abc070e60 2024-01-19T04:18:13.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0abbe00640 1 -- 172.21.15.32:0/512026373 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa40a7050 con 0x7f0abc070e60 2024-01-19T04:18:13.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0abbe00640 1 -- 172.21.15.32:0/512026373 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40ab980 con 0x7f0abc070e60 2024-01-19T04:18:13.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 -- 172.21.15.32:0/512026373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc070e60 msgr2=0x7f0abc0bcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 --2- 172.21.15.32:0/512026373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc070e60 0x7f0abc0bcd60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009740 tx=0x7f0aa401c2b0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 -- 172.21.15.32:0/512026373 shutdown_connections 2024-01-19T04:18:13.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 --2- 172.21.15.32:0/512026373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc070e60 0x7f0abc0bcd60 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 -- 172.21.15.32:0/512026373 >> 172.21.15.32:0/512026373 conn(0x7f0abc0c6b30 msgr2=0x7f0abc0c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:13.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 -- 172.21.15.32:0/512026373 shutdown_connections 2024-01-19T04:18:13.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 -- 172.21.15.32:0/512026373 wait complete. 2024-01-19T04:18:13.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 Processor -- start 2024-01-19T04:18:13.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 -- start start 2024-01-19T04:18:13.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.924+0000 7f0ac4600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0abc070e60 0x7f0abc14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc0bd2a0 0x7f0abc06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0abc1523a0 0x7f0abc0bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc14f120 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0a9bf0 con 0x7f0abc070e60 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc155790 con 0x7f0abc1523a0 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc0bd2a0 0x7f0abc06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc0bd2a0 0x7f0abc06db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58452/0 (socket says 172.21.15.32:58452) 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 -- 172.21.15.32:0/68308487 learned_addr learned my addr 172.21.15.32:0/68308487 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1c00640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0abc070e60 0x7f0abc14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac2600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0abc1523a0 0x7f0abc0bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 -- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0abc1523a0 msgr2=0x7f0abc0bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0abc1523a0 0x7f0abc0bdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 -- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0abc070e60 msgr2=0x7f0abc14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0abc070e60 0x7f0abc14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:13.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 -- 172.21.15.32:0/68308487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4009420 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac1200640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc0bd2a0 0x7f0abc06db90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40ae040 tx=0x7f0aa401aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ab9600640 1 -- 172.21.15.32:0/68308487 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4004230 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ab9600640 1 -- 172.21.15.32:0/68308487 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa4004390 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc155a70 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ab9600640 1 -- 172.21.15.32:0/68308487 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4003860 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc150eb0 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc155cb0 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.928+0000 7f0ab9600640 1 -- 172.21.15.32:0/68308487 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0aa40b2050 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.932+0000 7f0ab9600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0a94066530 0x7f0a940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:13.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.932+0000 7f0ab9600640 1 -- 172.21.15.32:0/68308487 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0aa411e480 con 0x7f0abc0bd2a0 2024-01-19T04:18:13.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.932+0000 7f0ac1c00640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0a94066530 0x7f0a940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:13.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.932+0000 7f0ac1c00640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0a94066530 0x7f0a940689f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007fd0 tx=0x7f0aac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:13.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:13.936+0000 7f0ab9600640 1 -- 172.21.15.32:0/68308487 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0aa40eb460 con 0x7f0abc0bd2a0 2024-01-19T04:18:14.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.092+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0abc1558d0 con 0x7f0abc0bd2a0 2024-01-19T04:18:14.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ab9600640 1 -- 172.21.15.32:0/68308487 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0aa40b0020 con 0x7f0abc0bd2a0 2024-01-19T04:18:14.098 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:14.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0a94066530 msgr2=0x7f0a940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0a94066530 0x7f0a940689f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007fd0 tx=0x7f0aac009040 comp rx=0 tx=0).stop 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc0bd2a0 msgr2=0x7f0abc06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc0bd2a0 0x7f0abc06db90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40ae040 tx=0x7f0aa401aaf0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 shutdown_connections 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0a94066530 0x7f0a940689f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f0abc1523a0 0x7f0abc0bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc0bd2a0 0x7f0abc06db90 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 --2- 172.21.15.32:0/68308487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0abc070e60 0x7f0abc14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 >> 172.21.15.32:0/68308487 conn(0x7f0abc0c6b30 msgr2=0x7f0abc06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 shutdown_connections 2024-01-19T04:18:14.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.096+0000 7f0ac4600640 1 -- 172.21.15.32:0/68308487 wait complete. 2024-01-19T04:18:14.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:18:14.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd299000640 1 Processor -- start 2024-01-19T04:18:14.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd299000640 1 -- start start 2024-01-19T04:18:14.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd299000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294155520 0x7fd29406c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd299000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2940bf360 0x7fd2940a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd299000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940beed0 con 0x7fd294072490 2024-01-19T04:18:14.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd299000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29406e0c0 con 0x7fd2940bf360 2024-01-19T04:18:14.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd299000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940c3a80 con 0x7fd294155520 2024-01-19T04:18:14.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd291400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd294072490 0x7fd29406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35842/0 (socket says 172.21.15.32:35842) 2024-01-19T04:18:14.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd291400640 1 -- 172.21.15.32:0/2910276055 learned_addr learned my addr 172.21.15.32:0/2910276055 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:14.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.260+0000 7fd291e00640 1 --2- 172.21.15.32:0/2910276055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294155520 0x7fd29406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd292800640 1 --2- 172.21.15.32:0/2910276055 >> v2:172.21.15.67:3300/0 conn(0x7fd2940bf360 0x7fd2940a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd290a00640 1 -- 172.21.15.32:0/2910276055 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558337077 0 0) 0x7fd2940beed0 con 0x7fd294072490 2024-01-19T04:18:14.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd290a00640 1 -- 172.21.15.32:0/2910276055 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd274003530 con 0x7fd294072490 2024-01-19T04:18:14.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd291e00640 1 -- 172.21.15.32:0/2910276055 >> v2:172.21.15.67:3300/0 conn(0x7fd2940bf360 msgr2=0x7fd2940a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:14.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd291e00640 1 --2- 172.21.15.32:0/2910276055 >> v2:172.21.15.67:3300/0 conn(0x7fd2940bf360 0x7fd2940a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd291e00640 1 -- 172.21.15.32:0/2910276055 >> v1:172.21.15.32:6789/0 conn(0x7fd294072490 legacy=0x7fd29406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd291e00640 1 -- 172.21.15.32:0/2910276055 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2940c3d60 con 0x7fd294155520 2024-01-19T04:18:14.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd292800640 1 --2- 172.21.15.32:0/2910276055 >> v2:172.21.15.67:3300/0 conn(0x7fd2940bf360 0x7fd2940a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:14.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd291e00640 1 --2- 172.21.15.32:0/2910276055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294155520 0x7fd29406c220 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2840097c0 tx=0x7fd28401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=747e6b94dd9a17cf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd290a00640 1 -- 172.21.15.32:0/2910276055 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840ab600 con 0x7fd294155520 2024-01-19T04:18:14.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd290a00640 1 -- 172.21.15.32:0/2910276055 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2840a7050 con 0x7fd294155520 2024-01-19T04:18:14.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.264+0000 7fd290a00640 1 -- 172.21.15.32:0/2910276055 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840ab980 con 0x7fd294155520 2024-01-19T04:18:14.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- 172.21.15.32:0/2910276055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294155520 msgr2=0x7fd29406c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 --2- 172.21.15.32:0/2910276055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294155520 0x7fd29406c220 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2840097c0 tx=0x7fd28401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- 172.21.15.32:0/2910276055 shutdown_connections 2024-01-19T04:18:14.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 --2- 172.21.15.32:0/2910276055 >> v2:172.21.15.67:3300/0 conn(0x7fd2940bf360 0x7fd2940a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 --2- 172.21.15.32:0/2910276055 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294155520 0x7fd29406c220 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- 172.21.15.32:0/2910276055 >> 172.21.15.32:0/2910276055 conn(0x7fd2940c25a0 msgr2=0x7fd2940c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:14.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- 172.21.15.32:0/2910276055 shutdown_connections 2024-01-19T04:18:14.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- 172.21.15.32:0/2910276055 wait complete. 2024-01-19T04:18:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 Processor -- start 2024-01-19T04:18:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- start start 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294072490 0x7fd2940710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2940bf360 0x7fd2941eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd294155520 0x7fd2941f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940a8df0 con 0x7fd2940bf360 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd294158830 con 0x7fd294155520 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd299000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd294158ad0 con 0x7fd294072490 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd291400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2940bf360 0x7fd2941eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd291400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2940bf360 0x7fd2941eee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58456/0 (socket says 172.21.15.32:58456) 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.268+0000 7fd291400640 1 -- 172.21.15.32:0/1573102266 learned_addr learned my addr 172.21.15.32:0/1573102266 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd292800640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd294155520 0x7fd2941f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd291e00640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294072490 0x7fd2940710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd291400640 1 -- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294072490 msgr2=0x7fd2940710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd291400640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294072490 0x7fd2940710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd291400640 1 -- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd294155520 msgr2=0x7fd2941f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd291400640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd294155520 0x7fd2941f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd291400640 1 -- 172.21.15.32:0/1573102266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c009a70 con 0x7fd2940bf360 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd291400640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2940bf360 0x7fd2941eee90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c420 tx=0x7fd27c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd28a000640 1 -- 172.21.15.32:0/1573102266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c005cf0 con 0x7fd2940bf360 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd28a000640 1 -- 172.21.15.32:0/1573102266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c005e70 con 0x7fd2940bf360 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd28a000640 1 -- 172.21.15.32:0/1573102266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0072f0 con 0x7fd2940bf360 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd284009420 con 0x7fd2940bf360 2024-01-19T04:18:14.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2940ab9f0 con 0x7fd2940bf360 2024-01-19T04:18:14.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2940a8f60 con 0x7fd2940bf360 2024-01-19T04:18:14.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd28a000640 1 -- 172.21.15.32:0/1573102266 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd27c007450 con 0x7fd2940bf360 2024-01-19T04:18:14.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd28a000640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd26c066500 0x7fd26c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.272+0000 7fd28a000640 1 -- 172.21.15.32:0/1573102266 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd27c083760 con 0x7fd2940bf360 2024-01-19T04:18:14.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.276+0000 7fd291e00640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd26c066500 0x7fd26c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.276+0000 7fd291e00640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd26c066500 0x7fd26c0689c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd2840ad000 tx=0x7fd2840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.280+0000 7fd28a000640 1 -- 172.21.15.32:0/1573102266 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd27c050800 con 0x7fd2940bf360 2024-01-19T04:18:14.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2940c50e0 con 0x7fd2940bf360 2024-01-19T04:18:14.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd28a000640 1 -- 172.21.15.32:0/1573102266 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd27c017020 con 0x7fd2940bf360 2024-01-19T04:18:14.439 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:14.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd26c066500 msgr2=0x7fd26c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd26c066500 0x7fd26c0689c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd2840ad000 tx=0x7fd2840a6000 comp rx=0 tx=0).stop 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2940bf360 msgr2=0x7fd2941eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2940bf360 0x7fd2941eee90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c420 tx=0x7fd27c00c820 comp rx=0 tx=0).stop 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 shutdown_connections 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd26c066500 0x7fd26c0689c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd294155520 0x7fd2941f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2940bf360 0x7fd2941eee90 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 --2- 172.21.15.32:0/1573102266 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd294072490 0x7fd2940710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 >> 172.21.15.32:0/1573102266 conn(0x7fd2940c25a0 msgr2=0x7fd29415e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 shutdown_connections 2024-01-19T04:18:14.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.436+0000 7fd299000640 1 -- 172.21.15.32:0/1573102266 wait complete. 2024-01-19T04:18:14.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:18:14.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2673c00640 1 Processor -- start 2024-01-19T04:18:14.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2673c00640 1 -- start start 2024-01-19T04:18:14.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2673c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f266c06cab0 0x7f266c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2673c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c0c0eb0 con 0x7f266c0705b0 2024-01-19T04:18:14.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2673c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c0a5330 con 0x7f266c0c55d0 2024-01-19T04:18:14.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2673c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c06e5c0 con 0x7f266c06cab0 2024-01-19T04:18:14.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2671c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f266c0705b0 0x7f266c15b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35848/0 (socket says 172.21.15.32:35848) 2024-01-19T04:18:14.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2671c00640 1 -- 172.21.15.32:0/1661771208 learned_addr learned my addr 172.21.15.32:0/1661771208 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:14.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.600+0000 7f2671200640 1 --2- 172.21.15.32:0/1661771208 >> v2:172.21.15.67:3300/0 conn(0x7f266c06cab0 0x7f266c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f266b400640 1 -- 172.21.15.32:0/1661771208 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596365076 0 0) 0x7f266c0c0eb0 con 0x7f266c0705b0 2024-01-19T04:18:14.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f266b400640 1 -- 172.21.15.32:0/1661771208 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264c003530 con 0x7f266c0705b0 2024-01-19T04:18:14.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f266b400640 1 -- 172.21.15.32:0/1661771208 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198359108 0 0) 0x7f266c0a5330 con 0x7f266c0c55d0 2024-01-19T04:18:14.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f266b400640 1 -- 172.21.15.32:0/1661771208 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f266c0c0eb0 con 0x7f266c0c55d0 2024-01-19T04:18:14.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f2671200640 1 -- 172.21.15.32:0/1661771208 >> v1:172.21.15.67:6789/0 conn(0x7f266c0c55d0 legacy=0x7f266c0c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f2671200640 1 -- 172.21.15.32:0/1661771208 >> v1:172.21.15.32:6789/0 conn(0x7f266c0705b0 legacy=0x7f266c15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f2671200640 1 -- 172.21.15.32:0/1661771208 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c1516f0 con 0x7f266c06cab0 2024-01-19T04:18:14.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f2671200640 1 --2- 172.21.15.32:0/1661771208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c06ce90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097c0 tx=0x7f265c01e660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=660a1f5cacfb1726 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f266b400640 1 -- 172.21.15.32:0/1661771208 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0a8630 con 0x7f266c06cab0 2024-01-19T04:18:14.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f266b400640 1 -- 172.21.15.32:0/1661771208 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0a8790 con 0x7f266c06cab0 2024-01-19T04:18:14.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.604+0000 7f266b400640 1 -- 172.21.15.32:0/1661771208 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0a8b20 con 0x7f266c06cab0 2024-01-19T04:18:14.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- 172.21.15.32:0/1661771208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 msgr2=0x7f266c06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 --2- 172.21.15.32:0/1661771208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c06ce90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097c0 tx=0x7f265c01e660 comp rx=0 tx=0).stop 2024-01-19T04:18:14.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- 172.21.15.32:0/1661771208 shutdown_connections 2024-01-19T04:18:14.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 --2- 172.21.15.32:0/1661771208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c06ce90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- 172.21.15.32:0/1661771208 >> 172.21.15.32:0/1661771208 conn(0x7f266c0c25a0 msgr2=0x7f266c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:14.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- 172.21.15.32:0/1661771208 shutdown_connections 2024-01-19T04:18:14.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- 172.21.15.32:0/1661771208 wait complete. 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 Processor -- start 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- start start 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c14a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f266c0705b0 0x7f266c0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0c55d0 0x7f266c141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c14adb0 con 0x7f266c0705b0 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c145b90 con 0x7f266c06cab0 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2673c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c14ab00 con 0x7f266c0c55d0 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f266be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f266c0705b0 0x7f266c0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2671200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c14a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f266be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f266c0705b0 0x7f266c0bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58460/0 (socket says 172.21.15.32:58460) 2024-01-19T04:18:14.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f266be00640 1 -- 172.21.15.32:0/3224742296 learned_addr learned my addr 172.21.15.32:0/3224742296 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.608+0000 7f2671c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0c55d0 0x7f266c141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2671200640 1 -- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0c55d0 msgr2=0x7f266c141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2671200640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0c55d0 0x7f266c141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2671200640 1 -- 172.21.15.32:0/3224742296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f266c0705b0 msgr2=0x7f266c0bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2671200640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f266c0705b0 0x7f266c0bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2671200640 1 -- 172.21.15.32:0/3224742296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c009420 con 0x7f266c06cab0 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2671200640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c14a5c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f266c0670a0 tx=0x7f265c01b400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2668c00640 1 -- 172.21.15.32:0/3224742296 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0ba640 con 0x7f266c06cab0 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2668c00640 1 -- 172.21.15.32:0/3224742296 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0ba7c0 con 0x7f266c06cab0 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2668c00640 1 -- 172.21.15.32:0/3224742296 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0bab70 con 0x7f266c06cab0 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c15c9b0 con 0x7f266c06cab0 2024-01-19T04:18:14.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c1460a0 con 0x7f266c06cab0 2024-01-19T04:18:14.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c0c0b30 con 0x7f266c06cab0 2024-01-19T04:18:14.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.612+0000 7f2668c00640 1 -- 172.21.15.32:0/3224742296 <== mon.1 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f265c004030 con 0x7f266c06cab0 2024-01-19T04:18:14.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.616+0000 7f2668c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2644066530 0x7f26440689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.616+0000 7f2668c00640 1 -- 172.21.15.32:0/3224742296 <== mon.1 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f265c11eb80 con 0x7f266c06cab0 2024-01-19T04:18:14.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.616+0000 7f266be00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2644066530 0x7f26440689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.616+0000 7f266be00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2644066530 0x7f26440689f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f266c0a7460 tx=0x7f2654009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.616+0000 7f2668c00640 1 -- 172.21.15.32:0/3224742296 <== mon.1 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f265c0ebbe0 con 0x7f266c06cab0 2024-01-19T04:18:14.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.776+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f266c0749f0 con 0x7f266c06cab0 2024-01-19T04:18:14.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.776+0000 7f2668c00640 1 -- 172.21.15.32:0/3224742296 <== mon.1 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f265c0ef200 con 0x7f266c06cab0 2024-01-19T04:18:14.780 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:14.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2644066530 msgr2=0x7f26440689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2644066530 0x7f26440689f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f266c0a7460 tx=0x7f2654009040 comp rx=0 tx=0).stop 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 msgr2=0x7f266c14a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c14a5c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f266c0670a0 tx=0x7f265c01b400 comp rx=0 tx=0).stop 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 shutdown_connections 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2644066530 0x7f26440689f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f266c0c55d0 0x7f266c141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f266c0705b0 0x7f266c0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 --2- 172.21.15.32:0/3224742296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f266c06cab0 0x7f266c14a5c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 >> 172.21.15.32:0/3224742296 conn(0x7f266c0c25a0 msgr2=0x7f266c0a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 shutdown_connections 2024-01-19T04:18:14.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.780+0000 7f2673c00640 1 -- 172.21.15.32:0/3224742296 wait complete. 2024-01-19T04:18:14.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:18:14.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.940+0000 7f2507a00640 1 Processor -- start 2024-01-19T04:18:14.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.940+0000 7f2507a00640 1 -- start start 2024-01-19T04:18:14.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2507a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2500147f90 0x7f2500151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2507a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000c1d40 con 0x7f25000c55e0 2024-01-19T04:18:14.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2507a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000c0810 con 0x7f25000c18b0 2024-01-19T04:18:14.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2507a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250006c5c0 con 0x7f2500147f90 2024-01-19T04:18:14.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f24ffe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f25000c55e0 0x7f250006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35854/0 (socket says 172.21.15.32:35854) 2024-01-19T04:18:14.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f24ffe00640 1 -- 172.21.15.32:0/2983943435 learned_addr learned my addr 172.21.15.32:0/2983943435 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2505000640 1 --2- 172.21.15.32:0/2983943435 >> v2:172.21.15.67:3300/0 conn(0x7f2500147f90 0x7f2500151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f24ff400640 1 -- 172.21.15.32:0/2983943435 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905004004 0 0) 0x7f25000c1d40 con 0x7f25000c55e0 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f24ff400640 1 -- 172.21.15.32:0/2983943435 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e0003530 con 0x7f25000c55e0 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f24ff400640 1 -- 172.21.15.32:0/2983943435 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079640996 0 0) 0x7f25000c0810 con 0x7f25000c18b0 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f24ff400640 1 -- 172.21.15.32:0/2983943435 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25000c1d40 con 0x7f25000c18b0 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2505000640 1 -- 172.21.15.32:0/2983943435 >> v1:172.21.15.67:6789/0 conn(0x7f25000c18b0 legacy=0x7f25000a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2505000640 1 -- 172.21.15.32:0/2983943435 >> v1:172.21.15.32:6789/0 conn(0x7f25000c55e0 legacy=0x7f250006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.944+0000 7f2505000640 1 -- 172.21.15.32:0/2983943435 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000c0af0 con 0x7f2500147f90 2024-01-19T04:18:14.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2505000640 1 --2- 172.21.15.32:0/2983943435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2500147f90 0x7f2500151350 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24f00097c0 tx=0x7f24f001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc086a9628fca112 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f24ff400640 1 -- 172.21.15.32:0/2983943435 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00ac620 con 0x7f2500147f90 2024-01-19T04:18:14.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f24ff400640 1 -- 172.21.15.32:0/2983943435 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f00ac780 con 0x7f2500147f90 2024-01-19T04:18:14.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f24ff400640 1 -- 172.21.15.32:0/2983943435 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00acb10 con 0x7f2500147f90 2024-01-19T04:18:14.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 -- 172.21.15.32:0/2983943435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2500147f90 msgr2=0x7f2500151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 --2- 172.21.15.32:0/2983943435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2500147f90 0x7f2500151350 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24f00097c0 tx=0x7f24f001c3c0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 -- 172.21.15.32:0/2983943435 shutdown_connections 2024-01-19T04:18:14.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 --2- 172.21.15.32:0/2983943435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2500147f90 0x7f2500151350 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 -- 172.21.15.32:0/2983943435 >> 172.21.15.32:0/2983943435 conn(0x7f25000c5b20 msgr2=0x7f25000c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:14.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 -- 172.21.15.32:0/2983943435 shutdown_connections 2024-01-19T04:18:14.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 -- 172.21.15.32:0/2983943435 wait complete. 2024-01-19T04:18:14.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 Processor -- start 2024-01-19T04:18:14.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.948+0000 7f2507a00640 1 -- start start 2024-01-19T04:18:14.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25000c18b0 0x7f2500147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25000c55e0 0x7f25001eb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2500147f90 0x7f250014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2500144c90 con 0x7f2500147f90 2024-01-19T04:18:14.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25001ebcb0 con 0x7f25000c18b0 2024-01-19T04:18:14.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250014a830 con 0x7f25000c55e0 2024-01-19T04:18:14.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2500147f90 0x7f250014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2500147f90 0x7f250014acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58470/0 (socket says 172.21.15.32:58470) 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 -- 172.21.15.32:0/651268761 learned_addr learned my addr 172.21.15.32:0/651268761 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505000640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25000c18b0 0x7f2500147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f24ffe00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25000c55e0 0x7f25001eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 -- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25000c55e0 msgr2=0x7f25001eb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25000c55e0 0x7f25001eb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 -- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25000c18b0 msgr2=0x7f2500147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25000c18b0 0x7f2500147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 -- 172.21.15.32:0/651268761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0009420 con 0x7f2500147f90 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f24ffe00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25000c55e0 0x7f25001eb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:14.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2505a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2500147f90 0x7f250014acc0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c730 tx=0x7f24f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f24fcc00640 1 -- 172.21.15.32:0/651268761 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8003b80 con 0x7f2500147f90 2024-01-19T04:18:14.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f24fcc00640 1 -- 172.21.15.32:0/651268761 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8003ce0 con 0x7f2500147f90 2024-01-19T04:18:14.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f24fcc00640 1 -- 172.21.15.32:0/651268761 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8005310 con 0x7f2500147f90 2024-01-19T04:18:14.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250014b200 con 0x7f2500147f90 2024-01-19T04:18:14.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000a5120 con 0x7f2500147f90 2024-01-19T04:18:14.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.952+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25000749f0 con 0x7f2500147f90 2024-01-19T04:18:14.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.956+0000 7f24fcc00640 1 -- 172.21.15.32:0/651268761 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f24f8005680 con 0x7f2500147f90 2024-01-19T04:18:14.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.956+0000 7f24fcc00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f24d8066500 0x7f24d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:14.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.956+0000 7f24fcc00640 1 -- 172.21.15.32:0/651268761 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f24f80841c0 con 0x7f2500147f90 2024-01-19T04:18:14.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.956+0000 7f2505000640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f24d8066500 0x7f24d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:14.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.956+0000 7f2505000640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f24d8066500 0x7f24d80689c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f24f00ae000 tx=0x7f24f00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:14.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:14.960+0000 7f24fcc00640 1 -- 172.21.15.32:0/651268761 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f24f80510f0 con 0x7f2500147f90 2024-01-19T04:18:15.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.128+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f250006c8c0 con 0x7f2500147f90 2024-01-19T04:18:15.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.128+0000 7f24fcc00640 1 -- 172.21.15.32:0/651268761 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f24f8054710 con 0x7f2500147f90 2024-01-19T04:18:15.133 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f24d8066500 msgr2=0x7f24d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f24d8066500 0x7f24d80689c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f24f00ae000 tx=0x7f24f00a7000 comp rx=0 tx=0).stop 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2500147f90 msgr2=0x7f250014acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2500147f90 0x7f250014acc0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c730 tx=0x7f24f800cbf0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 shutdown_connections 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f24d8066500 0x7f24d80689c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2500147f90 0x7f250014acc0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25000c55e0 0x7f25001eb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 --2- 172.21.15.32:0/651268761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25000c18b0 0x7f2500147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 >> 172.21.15.32:0/651268761 conn(0x7f25000c5b20 msgr2=0x7f25000bfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 shutdown_connections 2024-01-19T04:18:15.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.132+0000 7f2507a00640 1 -- 172.21.15.32:0/651268761 wait complete. 2024-01-19T04:18:15.155 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-19T04:18:15.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:15.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-19T04:18:15.220 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:18:15.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:15.220 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T04:18:15.234 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:15.234 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:15.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:18:15.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:18:15.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.464+0000 7f8da7a00640 1 Processor -- start 2024-01-19T04:18:15.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.464+0000 7f8da7a00640 1 -- start start 2024-01-19T04:18:15.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8da7a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8da00c54b0 0x7f8da006cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:15.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8da7a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00c44f0 con 0x7f8da0155320 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8da7a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00c4980 con 0x7f8da0072310 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8da7a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00c3bc0 con 0x7f8da00c54b0 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8da5000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8da0155320 0x7f8da00a4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35868/0 (socket says 172.21.15.32:35868) 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8da5000640 1 -- 172.21.15.32:0/3740952357 learned_addr learned my addr 172.21.15.32:0/3740952357 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8d9fe00640 1 --2- 172.21.15.32:0/3740952357 >> v2:172.21.15.32:3300/0 conn(0x7f8da00c54b0 0x7f8da006cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8d9f400640 1 -- 172.21.15.32:0/3740952357 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660916251 0 0) 0x7f8da00c44f0 con 0x7f8da0155320 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8d9fe00640 1 -- 172.21.15.32:0/3740952357 >> v1:172.21.15.67:6789/0 conn(0x7f8da0072310 legacy=0x7f8da006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8d9fe00640 1 -- 172.21.15.32:0/3740952357 >> v1:172.21.15.32:6789/0 conn(0x7f8da0155320 legacy=0x7f8da00a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.468+0000 7f8d9fe00640 1 -- 172.21.15.32:0/3740952357 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da00c3ea0 con 0x7f8da00c54b0 2024-01-19T04:18:15.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8d9fe00640 1 --2- 172.21.15.32:0/3740952357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da00c54b0 0x7f8da006cc80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097c0 tx=0x7f8d8801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a752cd3fbd72d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:15.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8d9f400640 1 -- 172.21.15.32:0/3740952357 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880ab670 con 0x7f8da00c54b0 2024-01-19T04:18:15.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8d9f400640 1 -- 172.21.15.32:0/3740952357 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d880ab7d0 con 0x7f8da00c54b0 2024-01-19T04:18:15.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8d9f400640 1 -- 172.21.15.32:0/3740952357 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880abb60 con 0x7f8da00c54b0 2024-01-19T04:18:15.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 -- 172.21.15.32:0/3740952357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da00c54b0 msgr2=0x7f8da006cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 --2- 172.21.15.32:0/3740952357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da00c54b0 0x7f8da006cc80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097c0 tx=0x7f8d8801c450 comp rx=0 tx=0).stop 2024-01-19T04:18:15.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 -- 172.21.15.32:0/3740952357 shutdown_connections 2024-01-19T04:18:15.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 --2- 172.21.15.32:0/3740952357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da00c54b0 0x7f8da006cc80 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 -- 172.21.15.32:0/3740952357 >> 172.21.15.32:0/3740952357 conn(0x7f8da00c5b20 msgr2=0x7f8da00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:15.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 -- 172.21.15.32:0/3740952357 shutdown_connections 2024-01-19T04:18:15.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 -- 172.21.15.32:0/3740952357 wait complete. 2024-01-19T04:18:15.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.472+0000 7f8da7a00640 1 Processor -- start 2024-01-19T04:18:15.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 -- start start 2024-01-19T04:18:15.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da0072310 0x7f8da00a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:15.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da00c54b0 0x7f8da01ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:15.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8da0155320 0x7f8da01ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da0071fe0 con 0x7f8da0072310 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00702e0 con 0x7f8da00c54b0 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00a6d70 con 0x7f8da0155320 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da0072310 0x7f8da00a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da0072310 0x7f8da00a61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58480/0 (socket says 172.21.15.32:58480) 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 -- 172.21.15.32:0/2061563053 learned_addr learned my addr 172.21.15.32:0/2061563053 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8d9fe00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da00c54b0 0x7f8da01ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5a00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8da0155320 0x7f8da01ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 -- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8da0155320 msgr2=0x7f8da01ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8da0155320 0x7f8da01ed160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 -- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da00c54b0 msgr2=0x7f8da01ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da00c54b0 0x7f8da01ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 -- 172.21.15.32:0/2061563053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88009420 con 0x7f8da0072310 2024-01-19T04:18:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da5000640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da0072310 0x7f8da00a61f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c410 tx=0x7f8d9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:15.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8d9cc00640 1 -- 172.21.15.32:0/2061563053 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d900074e0 con 0x7f8da0072310 2024-01-19T04:18:15.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8d9cc00640 1 -- 172.21.15.32:0/2061563053 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90007640 con 0x7f8da0072310 2024-01-19T04:18:15.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8d9cc00640 1 -- 172.21.15.32:0/2061563053 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90004a30 con 0x7f8da0072310 2024-01-19T04:18:15.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da006ffb0 con 0x7f8da0072310 2024-01-19T04:18:15.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da01f0f40 con 0x7f8da0072310 2024-01-19T04:18:15.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.476+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da00749f0 con 0x7f8da0072310 2024-01-19T04:18:15.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.480+0000 7f8d9cc00640 1 -- 172.21.15.32:0/2061563053 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8d90004b90 con 0x7f8da0072310 2024-01-19T04:18:15.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.480+0000 7f8d9cc00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8d78066530 0x7f8d780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:15.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.480+0000 7f8d9cc00640 1 -- 172.21.15.32:0/2061563053 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8d90083fe0 con 0x7f8da0072310 2024-01-19T04:18:15.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.480+0000 7f8d9fe00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8d78066530 0x7f8d780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:15.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.480+0000 7f8d9fe00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8d78066530 0x7f8d780689f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8d880af000 tx=0x7f8d880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:15.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.484+0000 7f8d9cc00640 1 -- 172.21.15.32:0/2061563053 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8d90050f50 con 0x7f8da0072310 2024-01-19T04:18:15.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8da00bfb80 con 0x7f8da0072310 2024-01-19T04:18:15.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8d9cc00640 1 -- 172.21.15.32:0/2061563053 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+149 (secure 0 0 0) 0x7f8d90054570 con 0x7f8da0072310 2024-01-19T04:18:15.683 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:18:15.684 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-19T04:18:15.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8d78066530 msgr2=0x7f8d780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8d78066530 0x7f8d780689f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8d880af000 tx=0x7f8d880a7000 comp rx=0 tx=0).stop 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da0072310 msgr2=0x7f8da00a61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da0072310 0x7f8da00a61f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c410 tx=0x7f8d9000c8d0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 shutdown_connections 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8d78066530 0x7f8d780689f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8da0155320 0x7f8da01ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da00c54b0 0x7f8da01ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 --2- 172.21.15.32:0/2061563053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da0072310 0x7f8da00a61f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 >> 172.21.15.32:0/2061563053 conn(0x7f8da00c5b20 msgr2=0x7f8da0153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 shutdown_connections 2024-01-19T04:18:15.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:15.680+0000 7f8da7a00640 1 -- 172.21.15.32:0/2061563053 wait complete. 2024-01-19T04:18:15.705 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-19T04:18:15.705 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:18:15.705 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-01-19T04:18:15.705 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-19T04:18:15.706 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T04:18:15.706 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-19T04:18:15.706 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:18:15.706 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.79iTGdPOcI 2024-01-19T04:18:15.706 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-01-19T04:18:15.714 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.vGBkBmIlR9 2024-01-19T04:18:15.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /tmp/tmp.79iTGdPOcI /tmp/tmp.vGBkBmIlR9 2024-01-19T04:18:15.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.vGBkBmIlR9 2024-01-19T04:18:15.898 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.vGBkBmIlR9 is 226B 2024-01-19T04:18:15.914 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.vGBkBmIlR9 2024-01-19T04:18:15.923 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-19T04:18:15.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:18:15.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:15.923 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-01-19T04:18:15.974 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:18:15.974 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:18:15.974 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:18:15.974 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:15.974 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42247sec preferred_lft 42247sec 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:15.975 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:1f:1a:e5:73 brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:18:15.976 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:18:15.977 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:15.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:15.977 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:18:16.035 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-01-19T04:18:16.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:16.038 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-01-19T04:18:16.091 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-01-19T04:18:16.091 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:18:16.091 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-19T04:18:16.091 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:18:16.091 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-19T04:18:16.091 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:18:16.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:16.092 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-01-19T04:18:16.092 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-01-19T04:18:16.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-19T04:18:16.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-19T04:18:16.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-19T04:18:16.092 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-01-19T04:18:16.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:16.183 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:18:16.192 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T04:18:16.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:18:16.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:16.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-01-19T04:18:16.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:18:16.253 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T04:18:16.301 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T04:18:16.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:18:16.302 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:18:16.353 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:16.353 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/tmp/tmp.79iTGdPOcI of=/dev/stdout 2024-01-19T04:18:16.406 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2024-01-19T04:18:16.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:16.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:16.501 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,secret=AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:16.501 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:18:16.501 INFO:teuthology.orchestra.run.smithi032.stdout:keyring.get_secret failed 2024-01-19T04:18:16.514 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,secret=AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:16.514 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:18:16.515 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:18:16.515 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: testuser@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs=/ 2024-01-19T04:18:16.515 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:18:16.518 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:18:16.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:16.518 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T04:18:16.536 INFO:teuthology.orchestra.run.smithi032.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2024-01-19T04:18:16.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:18:16.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:16.538 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:18:16.597 INFO:teuthology.orchestra.run.smithi032.stdout:client6053 2024-01-19T04:18:16.597 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:16.597 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:16.650 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-01-19T04:18:16.659 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.IOoJWPcCFa 2024-01-19T04:18:16.659 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:16.660 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/tmp/tmp.IOoJWPcCFa 2024-01-19T04:18:16.709 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:16.710 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:16.760 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:16.761 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:16.813 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:16.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.952+0000 7f1359200640 1 Processor -- start 2024-01-19T04:18:16.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.952+0000 7f1359200640 1 -- start start 2024-01-19T04:18:16.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1359200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f135414fb50 0x7f135406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:16.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1359200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1354071e80 con 0x7f13540a4ec0 2024-01-19T04:18:16.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1359200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540726c0 con 0x7f13540c04a0 2024-01-19T04:18:16.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1359200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13541535c0 con 0x7f135414fb50 2024-01-19T04:18:16.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1352800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f13540a4ec0 0x7f135415cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35880/0 (socket says 172.21.15.32:35880) 2024-01-19T04:18:16.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1352800640 1 -- 172.21.15.32:0/3688774687 learned_addr learned my addr 172.21.15.32:0/3688774687 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1351e00640 1 --2- 172.21.15.32:0/3688774687 >> v2:172.21.15.67:3300/0 conn(0x7f135414fb50 0x7f135406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1350a00640 1 -- 172.21.15.32:0/3688774687 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479834824 0 0) 0x7f1354071e80 con 0x7f13540a4ec0 2024-01-19T04:18:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1350a00640 1 -- 172.21.15.32:0/3688774687 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1334003530 con 0x7f13540a4ec0 2024-01-19T04:18:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1350a00640 1 -- 172.21.15.32:0/3688774687 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 91557316 0 0) 0x7f1334003530 con 0x7f13540a4ec0 2024-01-19T04:18:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1351e00640 1 -- 172.21.15.32:0/3688774687 >> v1:172.21.15.67:6789/0 conn(0x7f13540c04a0 legacy=0x7f13540c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1351e00640 1 -- 172.21.15.32:0/3688774687 >> v1:172.21.15.32:6789/0 conn(0x7f13540a4ec0 legacy=0x7f135415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.956+0000 7f1351e00640 1 -- 172.21.15.32:0/3688774687 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540c0a20 con 0x7f135414fb50 2024-01-19T04:18:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1351e00640 1 --2- 172.21.15.32:0/3688774687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135414fb50 0x7f135406fec0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13440097c0 tx=0x7f134401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11e586c1a0785ad server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1350a00640 1 -- 172.21.15.32:0/3688774687 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c001a00 con 0x7f135414fb50 2024-01-19T04:18:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1350a00640 1 -- 172.21.15.32:0/3688774687 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13440a7050 con 0x7f135414fb50 2024-01-19T04:18:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1350a00640 1 -- 172.21.15.32:0/3688774687 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440ab620 con 0x7f135414fb50 2024-01-19T04:18:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 -- 172.21.15.32:0/3688774687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135414fb50 msgr2=0x7f135406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 --2- 172.21.15.32:0/3688774687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135414fb50 0x7f135406fec0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13440097c0 tx=0x7f134401c310 comp rx=0 tx=0).stop 2024-01-19T04:18:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 -- 172.21.15.32:0/3688774687 shutdown_connections 2024-01-19T04:18:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 --2- 172.21.15.32:0/3688774687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135414fb50 0x7f135406fec0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 -- 172.21.15.32:0/3688774687 >> 172.21.15.32:0/3688774687 conn(0x7f13540c5b20 msgr2=0x7f13540c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 -- 172.21.15.32:0/3688774687 shutdown_connections 2024-01-19T04:18:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 -- 172.21.15.32:0/3688774687 wait complete. 2024-01-19T04:18:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 Processor -- start 2024-01-19T04:18:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.960+0000 7f1359200640 1 -- start start 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13540a4ec0 0x7f135406da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13540c04a0 0x7f13540c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f135414fb50 0x7f13541ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13540a8d20 con 0x7f13540c04a0 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13540ab4e0 con 0x7f13540a4ec0 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540ab7c0 con 0x7f135414fb50 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13540c04a0 0x7f13540c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13540c04a0 0x7f13540c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58482/0 (socket says 172.21.15.32:58482) 2024-01-19T04:18:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 -- 172.21.15.32:0/3979494567 learned_addr learned my addr 172.21.15.32:0/3979494567 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351e00640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13540a4ec0 0x7f135406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1352800640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f135414fb50 0x7f13541ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 -- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f135414fb50 msgr2=0x7f13541ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f135414fb50 0x7f13541ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 -- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13540a4ec0 msgr2=0x7f135406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13540a4ec0 0x7f135406da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 -- 172.21.15.32:0/3979494567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344009420 con 0x7f13540c04a0 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351e00640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13540a4ec0 0x7f135406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1351400640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13540c04a0 0x7f13540c0e10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f133c00c500 tx=0x7f133c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f134a000640 1 -- 172.21.15.32:0/3979494567 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c005220 con 0x7f13540c04a0 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f134a000640 1 -- 172.21.15.32:0/3979494567 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c005380 con 0x7f13540c04a0 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f134a000640 1 -- 172.21.15.32:0/3979494567 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c007270 con 0x7f13540c04a0 2024-01-19T04:18:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13540abaa0 con 0x7f13540c04a0 2024-01-19T04:18:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13540c1350 con 0x7f13540c04a0 2024-01-19T04:18:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1354072b30 con 0x7f13540c04a0 2024-01-19T04:18:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.964+0000 7f134a000640 1 -- 172.21.15.32:0/3979494567 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f133c0073d0 con 0x7f13540c04a0 2024-01-19T04:18:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.968+0000 7f134a000640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f132c066500 0x7f132c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.968+0000 7f134a000640 1 -- 172.21.15.32:0/3979494567 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f133c083bb0 con 0x7f13540c04a0 2024-01-19T04:18:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.968+0000 7f1351e00640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f132c066500 0x7f132c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.968+0000 7f1351e00640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f132c066500 0x7f132c0689c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f13440ad000 tx=0x7f13440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:16.972+0000 7f134a000640 1 -- 172.21.15.32:0/3979494567 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1354072b30 con 0x7f13540c04a0 2024-01-19T04:18:17.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.132+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1354072b30 con 0x7f13540c04a0 2024-01-19T04:18:17.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.132+0000 7f134a000640 1 -- 172.21.15.32:0/3979494567 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7f1354072b30 con 0x7f13540c04a0 2024-01-19T04:18:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:17.136 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:17.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f132c066500 msgr2=0x7f132c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f132c066500 0x7f132c0689c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f13440ad000 tx=0x7f13440a6000 comp rx=0 tx=0).stop 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13540c04a0 msgr2=0x7f13540c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13540c04a0 0x7f13540c0e10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f133c00c500 tx=0x7f133c00c9c0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 shutdown_connections 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f132c066500 0x7f132c0689c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f135414fb50 0x7f13541ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13540c04a0 0x7f13540c0e10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 --2- 172.21.15.32:0/3979494567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13540a4ec0 0x7f135406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 >> 172.21.15.32:0/3979494567 conn(0x7f13540c5b20 msgr2=0x7f13540bf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 shutdown_connections 2024-01-19T04:18:17.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.136+0000 7f1359200640 1 -- 172.21.15.32:0/3979494567 wait complete. 2024-01-19T04:18:17.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:17:47.021907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:17:48.211408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:18:00.535616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:18:01.296998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:18:17.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:18:17.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a16000640 1 Processor -- start 2024-01-19T04:18:17.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a16000640 1 -- start start 2024-01-19T04:18:17.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a16000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a10155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a16000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a1006d440 0x7f2a100c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a16000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100a4ea0 con 0x7f2a100723b0 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a16000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a101524a0 con 0x7f2a1006d440 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a16000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10152a20 con 0x7f2a100c2080 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a1006d440 0x7f2a100c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a1006d440 0x7f2a100c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:53404/0 (socket says 172.21.15.32:53404) 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0fe00640 1 -- 172.21.15.32:0/827105962 learned_addr learned my addr 172.21.15.32:0/827105962 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:17.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0ea00640 1 --2- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a10155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0fe00640 1 -- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 msgr2=0x7f2a10155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:17.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0fe00640 1 --2- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a10155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0fe00640 1 -- 172.21.15.32:0/827105962 >> v1:172.21.15.67:6789/0 conn(0x7f2a100723b0 legacy=0x7f2a10152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.300+0000 7f2a0fe00640 1 -- 172.21.15.32:0/827105962 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100c3430 con 0x7f2a1006d440 2024-01-19T04:18:17.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a0fe00640 1 --2- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a1006d440 0x7f2a100c4e50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009e50 tx=0x7f2a0801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84e6700855f51d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:17.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a0e000640 1 -- 172.21.15.32:0/827105962 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080a5690 con 0x7f2a1006d440 2024-01-19T04:18:17.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a0e000640 1 -- 172.21.15.32:0/827105962 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a080a57f0 con 0x7f2a1006d440 2024-01-19T04:18:17.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a0e000640 1 -- 172.21.15.32:0/827105962 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080a5b80 con 0x7f2a1006d440 2024-01-19T04:18:17.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 -- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a1006d440 msgr2=0x7f2a100c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 --2- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a1006d440 0x7f2a100c4e50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009e50 tx=0x7f2a0801c8c0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 -- 172.21.15.32:0/827105962 shutdown_connections 2024-01-19T04:18:17.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 --2- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a1006d440 0x7f2a100c4e50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 --2- 172.21.15.32:0/827105962 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a10155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 -- 172.21.15.32:0/827105962 >> 172.21.15.32:0/827105962 conn(0x7f2a100c25a0 msgr2=0x7f2a100c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:17.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 -- 172.21.15.32:0/827105962 shutdown_connections 2024-01-19T04:18:17.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.304+0000 7f2a16000640 1 -- 172.21.15.32:0/827105962 wait complete. 2024-01-19T04:18:17.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 Processor -- start 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 -- start start 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a1006d440 0x7f2a1014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a100723b0 0x7f2a10071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a100718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10071df0 con 0x7f2a1006d440 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101f13b0 con 0x7f2a100723b0 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1014d680 con 0x7f2a100c2080 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a1006d440 0x7f2a1014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a1006d440 0x7f2a1014f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58492/0 (socket says 172.21.15.32:58492) 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 -- 172.21.15.32:0/848754827 learned_addr learned my addr 172.21.15.32:0/848754827 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0ea00640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a100723b0 0x7f2a10071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0fe00640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a100718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 -- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 msgr2=0x7f2a100718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a100718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 -- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a100723b0 msgr2=0x7f2a10071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a100723b0 0x7f2a10071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 -- 172.21.15.32:0/848754827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009b30 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a0f400640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a1006d440 0x7f2a1014f6c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000c3a0 tx=0x7f2a0000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a07400640 1 -- 172.21.15.32:0/848754827 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a000052d0 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a07400640 1 -- 172.21.15.32:0/848754827 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a00005430 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a07400640 1 -- 172.21.15.32:0/848754827 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00007260 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1014d960 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.308+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1014df20 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.312+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1014e110 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.312+0000 7f2a07400640 1 -- 172.21.15.32:0/848754827 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2a000073c0 con 0x7f2a1006d440 2024-01-19T04:18:17.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.312+0000 7f2a07400640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29e8066500 0x7f29e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.312+0000 7f2a07400640 1 -- 172.21.15.32:0/848754827 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2a00083590 con 0x7f2a1006d440 2024-01-19T04:18:17.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.312+0000 7f2a0ea00640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29e8066500 0x7f29e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.312+0000 7f2a0ea00640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29e8066500 0x7f29e80689c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2a1015c310 tx=0x7f29f8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:17.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.316+0000 7f2a07400640 1 -- 172.21.15.32:0/848754827 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2a000504e0 con 0x7f2a1006d440 2024-01-19T04:18:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.476+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a100749f0 con 0x7f2a1006d440 2024-01-19T04:18:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.476+0000 7f2a07400640 1 -- 172.21.15.32:0/848754827 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a00053b00 con 0x7f2a1006d440 2024-01-19T04:18:17.480 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:18:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29e8066500 msgr2=0x7f29e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29e8066500 0x7f29e80689c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2a1015c310 tx=0x7f29f8009190 comp rx=0 tx=0).stop 2024-01-19T04:18:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a1006d440 msgr2=0x7f2a1014f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a1006d440 0x7f2a1014f6c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000c3a0 tx=0x7f2a0000c860 comp rx=0 tx=0).stop 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 shutdown_connections 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f29e8066500 0x7f29e80689c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a100c2080 0x7f2a100718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a100723b0 0x7f2a10071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 --2- 172.21.15.32:0/848754827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a1006d440 0x7f2a1014f6c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 >> 172.21.15.32:0/848754827 conn(0x7f2a100c25a0 msgr2=0x7f2a100beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 shutdown_connections 2024-01-19T04:18:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.480+0000 7f2a16000640 1 -- 172.21.15.32:0/848754827 wait complete. 2024-01-19T04:18:17.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:18:17.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 Processor -- start 2024-01-19T04:18:17.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 -- start start 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8cd406cab0 0x7f8cd406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40c55d0 0x7f8cd40c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8cd40705b0 0x7f8cd4154140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd406e5c0 con 0x7f8cd406cab0 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40c0eb0 con 0x7f8cd40705b0 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd9400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40a5330 con 0x7f8cd40c55d0 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8cd406cab0 0x7f8cd406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8cd406cab0 0x7f8cd406ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58496/0 (socket says 172.21.15.32:58496) 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 -- 172.21.15.32:0/2215739521 learned_addr learned my addr 172.21.15.32:0/2215739521 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd1e00640 1 --2- 172.21.15.32:0/2215739521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40c55d0 0x7f8cd40c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd3200640 1 --2- 172.21.15.32:0/2215739521 >> v2:172.21.15.67:3300/0 conn(0x7f8cd40705b0 0x7f8cd4154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 -- 172.21.15.32:0/2215739521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40c55d0 msgr2=0x7f8cd40c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:17.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 --2- 172.21.15.32:0/2215739521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40c55d0 0x7f8cd40c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 -- 172.21.15.32:0/2215739521 >> v2:172.21.15.67:3300/0 conn(0x7f8cd40705b0 msgr2=0x7f8cd4154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:17.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 --2- 172.21.15.32:0/2215739521 >> v2:172.21.15.67:3300/0 conn(0x7f8cd40705b0 0x7f8cd4154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.644+0000 7f8cd2800640 1 -- 172.21.15.32:0/2215739521 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd41516f0 con 0x7f8cd406cab0 2024-01-19T04:18:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd2800640 1 --2- 172.21.15.32:0/2215739521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd406cab0 0x7f8cd406ce90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4074590 tx=0x7f8cc401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd49d68380519a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:17.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd1400640 1 -- 172.21.15.32:0/2215739521 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40aa5f0 con 0x7f8cd406cab0 2024-01-19T04:18:17.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd1400640 1 -- 172.21.15.32:0/2215739521 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40aa750 con 0x7f8cd406cab0 2024-01-19T04:18:17.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd1400640 1 -- 172.21.15.32:0/2215739521 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40aaae0 con 0x7f8cd406cab0 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 -- 172.21.15.32:0/2215739521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd406cab0 msgr2=0x7f8cd406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2215739521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd406cab0 0x7f8cd406ce90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4074590 tx=0x7f8cc401c4d0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 -- 172.21.15.32:0/2215739521 shutdown_connections 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2215739521 >> v2:172.21.15.67:3300/0 conn(0x7f8cd40705b0 0x7f8cd4154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2215739521 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40c55d0 0x7f8cd40c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2215739521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd406cab0 0x7f8cd406ce90 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 -- 172.21.15.32:0/2215739521 >> 172.21.15.32:0/2215739521 conn(0x7f8cd40c25a0 msgr2=0x7f8cd40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 -- 172.21.15.32:0/2215739521 shutdown_connections 2024-01-19T04:18:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 -- 172.21.15.32:0/2215739521 wait complete. 2024-01-19T04:18:17.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.648+0000 7f8cd9400640 1 Processor -- start 2024-01-19T04:18:17.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 -- start start 2024-01-19T04:18:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cd406cab0 0x7f8cd41508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40705b0 0x7f8cd40a6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd40c55d0 0x7f8cd414dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd414faa0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4150e20 con 0x7f8cd406cab0 2024-01-19T04:18:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd4149af0 con 0x7f8cd40705b0 2024-01-19T04:18:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd40c55d0 0x7f8cd414dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd40c55d0 0x7f8cd414dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58506/0 (socket says 172.21.15.32:58506) 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 -- 172.21.15.32:0/2363221441 learned_addr learned my addr 172.21.15.32:0/2363221441 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd2800640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cd406cab0 0x7f8cd41508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd1e00640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40705b0 0x7f8cd40a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 -- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40705b0 msgr2=0x7f8cd40a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40705b0 0x7f8cd40a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 -- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cd406cab0 msgr2=0x7f8cd41508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cd406cab0 0x7f8cd41508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 -- 172.21.15.32:0/2363221441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40094d0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd3200640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd40c55d0 0x7f8cd414dde0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00eed0 tx=0x7f8ccc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:17.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8ccaa00640 1 -- 172.21.15.32:0/2363221441 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc010040 con 0x7f8cd40c55d0 2024-01-19T04:18:17.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8ccaa00640 1 -- 172.21.15.32:0/2363221441 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc014400 con 0x7f8cd40c55d0 2024-01-19T04:18:17.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd414fcb0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8ccaa00640 1 -- 172.21.15.32:0/2363221441 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0147b0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd4150160 con 0x7f8cd40c55d0 2024-01-19T04:18:17.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.652+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd41f14a0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.656+0000 7f8ccaa00640 1 -- 172.21.15.32:0/2363221441 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8ccc014910 con 0x7f8cd40c55d0 2024-01-19T04:18:17.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.656+0000 7f8ccaa00640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cac066500 0x7f8cac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.656+0000 7f8ccaa00640 1 -- 172.21.15.32:0/2363221441 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ccc084be0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.656+0000 7f8cd2800640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cac066500 0x7f8cac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.656+0000 7f8cd2800640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cac066500 0x7f8cac0689c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40ae000 tx=0x7f8cc40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.660+0000 7f8ccaa00640 1 -- 172.21.15.32:0/2363221441 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8cd41f14a0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.816+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8cd41f14a0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.816+0000 7f8ccaa00640 1 -- 172.21.15.32:0/2363221441 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cd41f14a0 con 0x7f8cd40c55d0 2024-01-19T04:18:17.821 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:17.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cac066500 msgr2=0x7f8cac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cac066500 0x7f8cac0689c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40ae000 tx=0x7f8cc40b5040 comp rx=0 tx=0).stop 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd40c55d0 msgr2=0x7f8cd414dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd40c55d0 0x7f8cd414dde0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00eed0 tx=0x7f8ccc00b480 comp rx=0 tx=0).stop 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 shutdown_connections 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8cac066500 0x7f8cac0689c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cd40c55d0 0x7f8cd414dde0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8cd40705b0 0x7f8cd40a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 --2- 172.21.15.32:0/2363221441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cd406cab0 0x7f8cd41508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 >> 172.21.15.32:0/2363221441 conn(0x7f8cd40c25a0 msgr2=0x7f8cd4071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 shutdown_connections 2024-01-19T04:18:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.820+0000 7f8cd9400640 1 -- 172.21.15.32:0/2363221441 wait complete. 2024-01-19T04:18:17.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:18:17.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.984+0000 7fb3b0600640 1 Processor -- start 2024-01-19T04:18:17.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.984+0000 7fb3b0600640 1 -- start start 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3b0600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3a8151b80 0x7fb3a8155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3b0600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a8157cc0 0x7fb3a80c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3b0600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80c2d30 con 0x7fb3a80c4cd0 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3b0600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80c34a0 con 0x7fb3a8151b80 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3b0600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a8155730 con 0x7fb3a8157cc0 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3adc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3a8151b80 0x7fb3a8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3adc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb3a8151b80 0x7fb3a8155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54806/0 (socket says 172.21.15.32:54806) 2024-01-19T04:18:17.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3adc00640 1 -- 172.21.15.32:0/1599412451 learned_addr learned my addr 172.21.15.32:0/1599412451 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:17.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3ad200640 1 --2- 172.21.15.32:0/1599412451 >> v2:172.21.15.67:3300/0 conn(0x7fb3a8157cc0 0x7fb3a80c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:17.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3adc00640 1 -- 172.21.15.32:0/1599412451 >> v2:172.21.15.67:3300/0 conn(0x7fb3a8157cc0 msgr2=0x7fb3a80c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:17.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3adc00640 1 --2- 172.21.15.32:0/1599412451 >> v2:172.21.15.67:3300/0 conn(0x7fb3a8157cc0 0x7fb3a80c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3adc00640 1 -- 172.21.15.32:0/1599412451 >> v1:172.21.15.67:6789/0 conn(0x7fb3a80c4cd0 legacy=0x7fb3a80c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:17.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.988+0000 7fb3adc00640 1 -- 172.21.15.32:0/1599412451 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80c3010 con 0x7fb3a8151b80 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3adc00640 1 --2- 172.21.15.32:0/1599412451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a8151b80 0x7fb3a8155150 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb3a806de10 tx=0x7fb39801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb3d7fef186be8a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3a7e00640 1 -- 172.21.15.32:0/1599412451 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3980ac640 con 0x7fb3a8151b80 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3a7e00640 1 -- 172.21.15.32:0/1599412451 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3980ac7a0 con 0x7fb3a8151b80 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3a7e00640 1 -- 172.21.15.32:0/1599412451 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3980acb30 con 0x7fb3a8151b80 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 -- 172.21.15.32:0/1599412451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a8151b80 msgr2=0x7fb3a8155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 --2- 172.21.15.32:0/1599412451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a8151b80 0x7fb3a8155150 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb3a806de10 tx=0x7fb39801c4d0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 -- 172.21.15.32:0/1599412451 shutdown_connections 2024-01-19T04:18:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 --2- 172.21.15.32:0/1599412451 >> v2:172.21.15.67:3300/0 conn(0x7fb3a8157cc0 0x7fb3a80c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 --2- 172.21.15.32:0/1599412451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a8151b80 0x7fb3a8155150 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:17.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 -- 172.21.15.32:0/1599412451 >> 172.21.15.32:0/1599412451 conn(0x7fb3a80c7d40 msgr2=0x7fb3a80c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:17.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 -- 172.21.15.32:0/1599412451 shutdown_connections 2024-01-19T04:18:17.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 -- 172.21.15.32:0/1599412451 wait complete. 2024-01-19T04:18:17.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 Processor -- start 2024-01-19T04:18:17.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.992+0000 7fb3b0600640 1 -- start start 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a80c4cd0 0x7fb3a81f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a8151b80 0x7fb3a80ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a8157cc0 0x7fb3a81ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80a75e0 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81f13a0 con 0x7fb3a8151b80 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8151970 con 0x7fb3a8157cc0 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a80c4cd0 0x7fb3a81f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a80c4cd0 0x7fb3a81f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54818/0 (socket says 172.21.15.32:54818) 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 -- 172.21.15.32:0/3827091361 learned_addr learned my addr 172.21.15.32:0/3827091361 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:18.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3ad200640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a8151b80 0x7fb3a80ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3ae600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a8157cc0 0x7fb3a81ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 -- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a8157cc0 msgr2=0x7fb3a81ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a8157cc0 0x7fb3a81ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 -- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a8151b80 msgr2=0x7fb3a80ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a8151b80 0x7fb3a80ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 -- 172.21.15.32:0/3827091361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3980094d0 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3ae600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a8157cc0 0x7fb3a81ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3adc00640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a80c4cd0 0x7fb3a81f0e60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb3980af040 tx=0x7fb398019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3a5600640 1 -- 172.21.15.32:0/3827091361 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3980b7670 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3a5600640 1 -- 172.21.15.32:0/3827091361 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3980b77d0 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a81513f0 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3a5600640 1 -- 172.21.15.32:0/3827091361 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3980b7b60 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a8151690 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:17.996+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a80749f0 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.000+0000 7fb3a5600640 1 -- 172.21.15.32:0/3827091361 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb3980b3070 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.000+0000 7fb3a5600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb380066500 0x7fb3800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.000+0000 7fb3a5600640 1 -- 172.21.15.32:0/3827091361 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb39811ec90 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.000+0000 7fb3ad200640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb380066500 0x7fb3800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.000+0000 7fb3ad200640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb380066500 0x7fb3800689c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80c4bf0 tx=0x7fb390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.004+0000 7fb3a5600640 1 -- 172.21.15.32:0/3827091361 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb3980ebbc0 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.164+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3a80c5c40 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.164+0000 7fb3a5600640 1 -- 172.21.15.32:0/3827091361 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3980b1020 con 0x7fb3a80c4cd0 2024-01-19T04:18:18.169 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb380066500 msgr2=0x7fb3800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb380066500 0x7fb3800689c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80c4bf0 tx=0x7fb390008040 comp rx=0 tx=0).stop 2024-01-19T04:18:18.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a80c4cd0 msgr2=0x7fb3a81f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a80c4cd0 0x7fb3a81f0e60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb3980af040 tx=0x7fb398019270 comp rx=0 tx=0).stop 2024-01-19T04:18:18.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 shutdown_connections 2024-01-19T04:18:18.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb380066500 0x7fb3800689c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3a8157cc0 0x7fb3a81ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a8151b80 0x7fb3a80ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 --2- 172.21.15.32:0/3827091361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3a80c4cd0 0x7fb3a81f0e60 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 >> 172.21.15.32:0/3827091361 conn(0x7fb3a80c7d40 msgr2=0x7fb3a80c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:18.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 shutdown_connections 2024-01-19T04:18:18.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.168+0000 7fb3b0600640 1 -- 172.21.15.32:0/3827091361 wait complete. 2024-01-19T04:18:18.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:18:18.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.332+0000 7f1a6b600640 1 Processor -- start 2024-01-19T04:18:18.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.332+0000 7f1a6b600640 1 -- start start 2024-01-19T04:18:18.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a6b600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a64151b80 0x7f1a64155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a6b600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1a640c6360 0x7f1a640c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a6b600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a640c2d30 con 0x7f1a64157cc0 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a6b600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640c34a0 con 0x7f1a640c6360 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a6b600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64155730 con 0x7f1a64151b80 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a63e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1a64157cc0 0x7f1a640c4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42852/0 (socket says 172.21.15.32:42852) 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a69600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1a640c6360 0x7f1a640c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a63e00640 1 -- 172.21.15.32:0/144123096 learned_addr learned my addr 172.21.15.32:0/144123096 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a68c00640 1 --2- 172.21.15.32:0/144123096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a64151b80 0x7f1a64155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a69600640 1 -- 172.21.15.32:0/144123096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a64151b80 msgr2=0x7f1a64155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a69600640 1 --2- 172.21.15.32:0/144123096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a64151b80 0x7f1a64155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a69600640 1 -- 172.21.15.32:0/144123096 >> v1:172.21.15.32:6789/0 conn(0x7f1a64157cc0 legacy=0x7f1a640c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a69600640 1 -- 172.21.15.32:0/144123096 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640c3010 con 0x7f1a640c6360 2024-01-19T04:18:18.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.336+0000 7f1a69600640 1 --2- 172.21.15.32:0/144123096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a640c6360 0x7f1a640c67d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009dc0 tx=0x7f1a5c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d34bb624d22e7c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a63400640 1 -- 172.21.15.32:0/144123096 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0a58d0 con 0x7f1a640c6360 2024-01-19T04:18:18.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a63400640 1 -- 172.21.15.32:0/144123096 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0a5a30 con 0x7f1a640c6360 2024-01-19T04:18:18.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a63400640 1 -- 172.21.15.32:0/144123096 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0a5dc0 con 0x7f1a640c6360 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- 172.21.15.32:0/144123096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a640c6360 msgr2=0x7f1a640c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 --2- 172.21.15.32:0/144123096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a640c6360 0x7f1a640c67d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009dc0 tx=0x7f1a5c01c900 comp rx=0 tx=0).stop 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- 172.21.15.32:0/144123096 shutdown_connections 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 --2- 172.21.15.32:0/144123096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a640c6360 0x7f1a640c67d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 --2- 172.21.15.32:0/144123096 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a64151b80 0x7f1a64155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- 172.21.15.32:0/144123096 >> 172.21.15.32:0/144123096 conn(0x7f1a640c7d40 msgr2=0x7f1a640c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- 172.21.15.32:0/144123096 shutdown_connections 2024-01-19T04:18:18.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- 172.21.15.32:0/144123096 wait complete. 2024-01-19T04:18:18.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 Processor -- start 2024-01-19T04:18:18.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- start start 2024-01-19T04:18:18.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a640c6360 0x7f1a64141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a64151b80 0x7f1a6414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a64157cc0 0x7f1a641535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641f0f20 con 0x7f1a64151b80 2024-01-19T04:18:18.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641f02a0 con 0x7f1a64157cc0 2024-01-19T04:18:18.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.340+0000 7f1a6b600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641f0580 con 0x7f1a640c6360 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a64151b80 0x7f1a6414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a64151b80 0x7f1a6414e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54830/0 (socket says 172.21.15.32:54830) 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 -- 172.21.15.32:0/84552168 learned_addr learned my addr 172.21.15.32:0/84552168 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a69600640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a64157cc0 0x7f1a641535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a68c00640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a640c6360 0x7f1a64141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 -- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a640c6360 msgr2=0x7f1a64141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a640c6360 0x7f1a64141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 -- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a64157cc0 msgr2=0x7f1a641535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a64157cc0 0x7f1a641535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 -- 172.21.15.32:0/84552168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c009a70 con 0x7f1a64151b80 2024-01-19T04:18:18.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a63e00640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a64151b80 0x7f1a6414e840 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00c420 tx=0x7f1a4c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a60c00640 1 -- 172.21.15.32:0/84552168 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c005cf0 con 0x7f1a64151b80 2024-01-19T04:18:18.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a60c00640 1 -- 172.21.15.32:0/84552168 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c005e50 con 0x7f1a64151b80 2024-01-19T04:18:18.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a641f0860 con 0x7f1a64151b80 2024-01-19T04:18:18.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a60c00640 1 -- 172.21.15.32:0/84552168 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0072f0 con 0x7f1a64151b80 2024-01-19T04:18:18.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a641418c0 con 0x7f1a64151b80 2024-01-19T04:18:18.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a641f1060 con 0x7f1a64151b80 2024-01-19T04:18:18.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.344+0000 7f1a60c00640 1 -- 172.21.15.32:0/84552168 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1a4c007450 con 0x7f1a64151b80 2024-01-19T04:18:18.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.348+0000 7f1a60c00640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1a3c066530 0x7f1a3c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.348+0000 7f1a60c00640 1 -- 172.21.15.32:0/84552168 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1a4c0836b0 con 0x7f1a64151b80 2024-01-19T04:18:18.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.348+0000 7f1a68c00640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1a3c066530 0x7f1a3c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.348+0000 7f1a68c00640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1a3c066530 0x7f1a3c0689f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1a54007a60 tx=0x7f1a54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.352+0000 7f1a60c00640 1 -- 172.21.15.32:0/84552168 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1a4c0506b0 con 0x7f1a64151b80 2024-01-19T04:18:18.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.508+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a640749f0 con 0x7f1a64151b80 2024-01-19T04:18:18.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.508+0000 7f1a60c00640 1 -- 172.21.15.32:0/84552168 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1a4c053cd0 con 0x7f1a64151b80 2024-01-19T04:18:18.514 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1a3c066530 msgr2=0x7f1a3c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1a3c066530 0x7f1a3c0689f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1a54007a60 tx=0x7f1a54008040 comp rx=0 tx=0).stop 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a64151b80 msgr2=0x7f1a6414e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a64151b80 0x7f1a6414e840 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00c420 tx=0x7f1a4c00c8e0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 shutdown_connections 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1a3c066530 0x7f1a3c0689f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a64157cc0 0x7f1a641535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a64151b80 0x7f1a6414e840 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 --2- 172.21.15.32:0/84552168 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1a640c6360 0x7f1a64141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 >> 172.21.15.32:0/84552168 conn(0x7f1a640c7d40 msgr2=0x7f1a64155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:18.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 shutdown_connections 2024-01-19T04:18:18.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.512+0000 7f1a6b600640 1 -- 172.21.15.32:0/84552168 wait complete. 2024-01-19T04:18:18.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:18:18.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76f600640 1 Processor -- start 2024-01-19T04:18:18.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76f600640 1 -- start start 2024-01-19T04:18:18.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76f600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff7680c2080 0x7ff768155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76f600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff76806d440 0x7ff7680c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76f600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7680a4ea0 con 0x7ff7680723b0 2024-01-19T04:18:18.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76f600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7681524a0 con 0x7ff7680c2080 2024-01-19T04:18:18.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76f600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff768152a20 con 0x7ff76806d440 2024-01-19T04:18:18.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76cc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff7680723b0 0x7ff768152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42854/0 (socket says 172.21.15.32:42854) 2024-01-19T04:18:18.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff76cc00640 1 -- 172.21.15.32:0/2229629050 learned_addr learned my addr 172.21.15.32:0/2229629050 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:18.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.676+0000 7ff767e00640 1 --2- 172.21.15.32:0/2229629050 >> v2:172.21.15.32:3300/0 conn(0x7ff7680c2080 0x7ff768155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff76d600640 1 --2- 172.21.15.32:0/2229629050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff76806d440 0x7ff7680c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767400640 1 -- 172.21.15.32:0/2229629050 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450657110 0 0) 0x7ff7680a4ea0 con 0x7ff7680723b0 2024-01-19T04:18:18.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767e00640 1 -- 172.21.15.32:0/2229629050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff76806d440 msgr2=0x7ff7680c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:18.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767e00640 1 --2- 172.21.15.32:0/2229629050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff76806d440 0x7ff7680c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767e00640 1 -- 172.21.15.32:0/2229629050 >> v1:172.21.15.32:6789/0 conn(0x7ff7680723b0 legacy=0x7ff768152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767e00640 1 -- 172.21.15.32:0/2229629050 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680c3430 con 0x7ff7680c2080 2024-01-19T04:18:18.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff76d600640 1 --2- 172.21.15.32:0/2229629050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff76806d440 0x7ff7680c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:18.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767e00640 1 --2- 172.21.15.32:0/2229629050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768155a90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff7500097c0 tx=0x7ff75001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a572fe4eab626517 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767400640 1 -- 172.21.15.32:0/2229629050 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500ab600 con 0x7ff7680c2080 2024-01-19T04:18:18.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767400640 1 -- 172.21.15.32:0/2229629050 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7500a7050 con 0x7ff7680c2080 2024-01-19T04:18:18.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.680+0000 7ff767400640 1 -- 172.21.15.32:0/2229629050 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500ab980 con 0x7ff7680c2080 2024-01-19T04:18:18.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- 172.21.15.32:0/2229629050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 msgr2=0x7ff768155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 --2- 172.21.15.32:0/2229629050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768155a90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff7500097c0 tx=0x7ff75001c330 comp rx=0 tx=0).stop 2024-01-19T04:18:18.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- 172.21.15.32:0/2229629050 shutdown_connections 2024-01-19T04:18:18.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 --2- 172.21.15.32:0/2229629050 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff76806d440 0x7ff7680c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 --2- 172.21.15.32:0/2229629050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768155a90 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- 172.21.15.32:0/2229629050 >> 172.21.15.32:0/2229629050 conn(0x7ff7680c25a0 msgr2=0x7ff7680c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:18.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- 172.21.15.32:0/2229629050 shutdown_connections 2024-01-19T04:18:18.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- 172.21.15.32:0/2229629050 wait complete. 2024-01-19T04:18:18.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 Processor -- start 2024-01-19T04:18:18.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- start start 2024-01-19T04:18:18.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76806d440 0x7ff7680c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7680723b0 0x7ff768148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7681497a0 con 0x7ff7680c2080 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76814b100 con 0x7ff76806d440 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76f600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680aa550 con 0x7ff7680723b0 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54836/0 (socket says 172.21.15.32:54836) 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76d600640 1 -- 172.21.15.32:0/3030998355 learned_addr learned my addr 172.21.15.32:0/3030998355 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff76cc00640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76806d440 0x7ff7680c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.684+0000 7ff767e00640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7680723b0 0x7ff768148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76d600640 1 -- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7680723b0 msgr2=0x7ff768148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76d600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7680723b0 0x7ff768148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76d600640 1 -- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76806d440 msgr2=0x7ff7680c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76d600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76806d440 0x7ff7680c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76d600640 1 -- 172.21.15.32:0/3030998355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750009420 con 0x7ff7680c2080 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76d600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768149260 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff760007f20 tx=0x7ff76000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff764c00640 1 -- 172.21.15.32:0/3030998355 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760015600 con 0x7ff7680c2080 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff764c00640 1 -- 172.21.15.32:0/3030998355 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000f040 con 0x7ff7680c2080 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff764c00640 1 -- 172.21.15.32:0/3030998355 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600159a0 con 0x7ff7680c2080 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76814aad0 con 0x7ff7680c2080 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76814ad90 con 0x7ff7680c2080 2024-01-19T04:18:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7680749f0 con 0x7ff7680c2080 2024-01-19T04:18:18.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.688+0000 7ff764c00640 1 -- 172.21.15.32:0/3030998355 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff76001e3b0 con 0x7ff7680c2080 2024-01-19T04:18:18.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.692+0000 7ff764c00640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff740066530 0x7ff7400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:18.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.692+0000 7ff764c00640 1 -- 172.21.15.32:0/3030998355 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff7600844c0 con 0x7ff7680c2080 2024-01-19T04:18:18.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.692+0000 7ff76cc00640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff740066530 0x7ff7400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:18.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.692+0000 7ff76cc00640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff740066530 0x7ff7400689f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff758000f70 tx=0x7ff758007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:18.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.692+0000 7ff764c00640 1 -- 172.21.15.32:0/3030998355 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff7600514a0 con 0x7ff7680c2080 2024-01-19T04:18:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.852+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff76806cc50 con 0x7ff7680c2080 2024-01-19T04:18:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.852+0000 7ff764c00640 1 -- 172.21.15.32:0/3030998355 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff760054ac0 con 0x7ff7680c2080 2024-01-19T04:18:18.856 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff740066530 msgr2=0x7ff7400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff740066530 0x7ff7400689f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff758000f70 tx=0x7ff758007df0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 msgr2=0x7ff768149260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768149260 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff760007f20 tx=0x7ff76000d560 comp rx=0 tx=0).stop 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 shutdown_connections 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff740066530 0x7ff7400689f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7680c2080 0x7ff768149260 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff7680723b0 0x7ff768148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 --2- 172.21.15.32:0/3030998355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76806d440 0x7ff7680c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 >> 172.21.15.32:0/3030998355 conn(0x7ff7680c25a0 msgr2=0x7ff7680c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 shutdown_connections 2024-01-19T04:18:18.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:18.856+0000 7ff76f600640 1 -- 172.21.15.32:0/3030998355 wait complete. 2024-01-19T04:18:18.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:18:19.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.020+0000 7fa9c2600640 1 Processor -- start 2024-01-19T04:18:19.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.020+0000 7fa9c2600640 1 -- start start 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9c2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9c2600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9bc0c06f0 0x7fa9bc0c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9c2600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc0c10a0 con 0x7fa9bc066580 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9c2600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9bc0c1380 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9c2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc066a40 con 0x7fa9bc151b00 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9baa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9bc0c06f0 0x7fa9bc0c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9baa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9bc0c06f0 0x7fa9bc0c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54850/0 (socket says 172.21.15.32:54850) 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9baa00640 1 -- 172.21.15.32:0/729268938 learned_addr learned my addr 172.21.15.32:0/729268938 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9bb400640 1 --2- 172.21.15.32:0/729268938 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9baa00640 1 -- 172.21.15.32:0/729268938 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 msgr2=0x7fa9bc0bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:19.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9baa00640 1 --2- 172.21.15.32:0/729268938 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9baa00640 1 -- 172.21.15.32:0/729268938 >> v1:172.21.15.67:6789/0 conn(0x7fa9bc066580 legacy=0x7fa9bc0c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:19.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.024+0000 7fa9baa00640 1 -- 172.21.15.32:0/729268938 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc1585f0 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9baa00640 1 --2- 172.21.15.32:0/729268938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0c1810 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009870 tx=0x7fa9a401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff35b3654056a3c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:19.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9ba000640 1 -- 172.21.15.32:0/729268938 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40ab610 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9ba000640 1 -- 172.21.15.32:0/729268938 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40ab770 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9ba000640 1 -- 172.21.15.32:0/729268938 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40abb00 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 -- 172.21.15.32:0/729268938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 msgr2=0x7fa9bc0c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 --2- 172.21.15.32:0/729268938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0c1810 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009870 tx=0x7fa9a401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 -- 172.21.15.32:0/729268938 shutdown_connections 2024-01-19T04:18:19.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 --2- 172.21.15.32:0/729268938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0c1810 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 --2- 172.21.15.32:0/729268938 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 -- 172.21.15.32:0/729268938 >> 172.21.15.32:0/729268938 conn(0x7fa9bc0c2f00 msgr2=0x7fa9bc0c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:19.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 -- 172.21.15.32:0/729268938 shutdown_connections 2024-01-19T04:18:19.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 -- 172.21.15.32:0/729268938 wait complete. 2024-01-19T04:18:19.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 Processor -- start 2024-01-19T04:18:19.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.028+0000 7fa9c2600640 1 -- start start 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9bc066580 0x7fa9bc0a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc1544f0 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc0ab260 con 0x7fa9bc066580 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc154210 con 0x7fa9bc151b00 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0aa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54856/0 (socket says 172.21.15.32:54856) 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 -- 172.21.15.32:0/1283129522 learned_addr learned my addr 172.21.15.32:0/1283129522 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9bb400640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9bc066580 0x7fa9bc0a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9bbe00640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 -- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 msgr2=0x7fa9bc0ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 -- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9bc066580 msgr2=0x7fa9bc0a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9bc066580 0x7fa9bc0a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 -- 172.21.15.32:0/1283129522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40094d0 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9bb400640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9bc066580 0x7fa9bc0a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9bbe00640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9baa00640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0aa300 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40ad040 tx=0x7fa9a401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9b3400640 1 -- 172.21.15.32:0/1283129522 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40b4800 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9b3400640 1 -- 172.21.15.32:0/1283129522 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40b4960 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc154f60 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9b3400640 1 -- 172.21.15.32:0/1283129522 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40b4d10 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc1523c0 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.032+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc154dc0 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.036+0000 7fa9b3400640 1 -- 172.21.15.32:0/1283129522 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa9a40be3f0 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.036+0000 7fa9b3400640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa994066530 0x7fa9940689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.036+0000 7fa9b3400640 1 -- 172.21.15.32:0/1283129522 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa9a411ef00 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.036+0000 7fa9bb400640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa994066530 0x7fa9940689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.036+0000 7fa9bb400640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa994066530 0x7fa9940689f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac006fd0 tx=0x7fa9ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.040+0000 7fa9b3400640 1 -- 172.21.15.32:0/1283129522 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa9bc154dc0 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.212+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa9bc0ab430 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.212+0000 7fa9b3400640 1 -- 172.21.15.32:0/1283129522 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa9bc0ab430 con 0x7fa9bc0c06f0 2024-01-19T04:18:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:18:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa994066530 msgr2=0x7fa9940689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa994066530 0x7fa9940689f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac006fd0 tx=0x7fa9ac008040 comp rx=0 tx=0).stop 2024-01-19T04:18:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 msgr2=0x7fa9bc0aa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0aa300 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40ad040 tx=0x7fa9a401ac30 comp rx=0 tx=0).stop 2024-01-19T04:18:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 shutdown_connections 2024-01-19T04:18:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa994066530 0x7fa9940689f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa9bc151b00 0x7fa9bc0ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9bc0c06f0 0x7fa9bc0aa300 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 --2- 172.21.15.32:0/1283129522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9bc066580 0x7fa9bc0a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 >> 172.21.15.32:0/1283129522 conn(0x7fa9bc0c2f00 msgr2=0x7fa9bc150720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 shutdown_connections 2024-01-19T04:18:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.216+0000 7fa9c2600640 1 -- 172.21.15.32:0/1283129522 wait complete. 2024-01-19T04:18:19.238 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-19T04:18:19.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:19.239 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:19.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:18:19.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:19.299 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:18:19.316 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:19.317 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:19.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:18:19.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T04:18:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.508+0000 7f25b0000640 1 Processor -- start 2024-01-19T04:18:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.508+0000 7f25b0000640 1 -- start start 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25b0000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c42b0 0x7f25a80c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25b0000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f25a80c1120 0x7f25a815b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25b0000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a80c0c90 con 0x7f25a80c5740 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25b0000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a8150f90 con 0x7f25a80c1120 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25b0000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8150cb0 con 0x7f25a80c42b0 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25acc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f25a80c5740 0x7f25a806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42860/0 (socket says 172.21.15.32:42860) 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25acc00640 1 -- 172.21.15.32:0/1495944833 learned_addr learned my addr 172.21.15.32:0/1495944833 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25ad600640 1 --2- 172.21.15.32:0/1495944833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c42b0 0x7f25a80c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25ae000640 1 --2- 172.21.15.32:0/1495944833 >> v2:172.21.15.67:3300/0 conn(0x7f25a80c1120 0x7f25a815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25a7e00640 1 -- 172.21.15.32:0/1495944833 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687291422 0 0) 0x7f25a80c0c90 con 0x7f25a80c5740 2024-01-19T04:18:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25a7e00640 1 -- 172.21.15.32:0/1495944833 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2588003530 con 0x7f25a80c5740 2024-01-19T04:18:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25ad600640 1 -- 172.21.15.32:0/1495944833 >> v2:172.21.15.67:3300/0 conn(0x7f25a80c1120 msgr2=0x7f25a815b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:19.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25ad600640 1 --2- 172.21.15.32:0/1495944833 >> v2:172.21.15.67:3300/0 conn(0x7f25a80c1120 0x7f25a815b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25ad600640 1 -- 172.21.15.32:0/1495944833 >> v1:172.21.15.32:6789/0 conn(0x7f25a80c5740 legacy=0x7f25a806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.512+0000 7f25ad600640 1 -- 172.21.15.32:0/1495944833 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80c0640 con 0x7f25a80c42b0 2024-01-19T04:18:19.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25ad600640 1 --2- 172.21.15.32:0/1495944833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c42b0 0x7f25a80c4690 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f25980097c0 tx=0x7f259801ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b0f606710f3c04 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25a7e00640 1 -- 172.21.15.32:0/1495944833 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980ad660 con 0x7f25a80c42b0 2024-01-19T04:18:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25a7e00640 1 -- 172.21.15.32:0/1495944833 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25980ad7c0 con 0x7f25a80c42b0 2024-01-19T04:18:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25a7e00640 1 -- 172.21.15.32:0/1495944833 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980adb30 con 0x7f25a80c42b0 2024-01-19T04:18:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 -- 172.21.15.32:0/1495944833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c42b0 msgr2=0x7f25a80c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 --2- 172.21.15.32:0/1495944833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c42b0 0x7f25a80c4690 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f25980097c0 tx=0x7f259801ce20 comp rx=0 tx=0).stop 2024-01-19T04:18:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 -- 172.21.15.32:0/1495944833 shutdown_connections 2024-01-19T04:18:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 --2- 172.21.15.32:0/1495944833 >> v2:172.21.15.67:3300/0 conn(0x7f25a80c1120 0x7f25a815b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 --2- 172.21.15.32:0/1495944833 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c42b0 0x7f25a80c4690 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 -- 172.21.15.32:0/1495944833 >> 172.21.15.32:0/1495944833 conn(0x7f25a80c5b20 msgr2=0x7f25a80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 -- 172.21.15.32:0/1495944833 shutdown_connections 2024-01-19T04:18:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 -- 172.21.15.32:0/1495944833 wait complete. 2024-01-19T04:18:19.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 Processor -- start 2024-01-19T04:18:19.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.516+0000 7f25b0000640 1 -- start start 2024-01-19T04:18:19.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a80c1120 0x7f25a8151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25a80c42b0 0x7f25a81f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c5740 0x7f25a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81553c0 con 0x7f25a80c42b0 2024-01-19T04:18:19.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81538a0 con 0x7f25a80c1120 2024-01-19T04:18:19.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81f1230 con 0x7f25a80c5740 2024-01-19T04:18:19.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25a80c42b0 0x7f25a81f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25a80c42b0 0x7f25a81f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54870/0 (socket says 172.21.15.32:54870) 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25ad600640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a80c1120 0x7f25a8151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 -- 172.21.15.32:0/1721885501 learned_addr learned my addr 172.21.15.32:0/1721885501 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25ae000640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c5740 0x7f25a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 -- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c5740 msgr2=0x7f25a80a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c5740 0x7f25a80a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 -- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a80c1120 msgr2=0x7f25a8151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a80c1120 0x7f25a8151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 -- 172.21.15.32:0/1721885501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009420 con 0x7f25a80c42b0 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25ad600640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a80c1120 0x7f25a8151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25acc00640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25a80c42b0 0x7f25a81f0cf0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f259000c450 tx=0x7f259000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:19.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25a5600640 1 -- 172.21.15.32:0/1721885501 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590005cf0 con 0x7f25a80c42b0 2024-01-19T04:18:19.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25a5600640 1 -- 172.21.15.32:0/1721885501 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590005e50 con 0x7f25a80c42b0 2024-01-19T04:18:19.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25a5600640 1 -- 172.21.15.32:0/1721885501 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590007290 con 0x7f25a80c42b0 2024-01-19T04:18:19.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a8152510 con 0x7f25a80c42b0 2024-01-19T04:18:19.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a8153530 con 0x7f25a80c42b0 2024-01-19T04:18:19.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.520+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a8153090 con 0x7f25a80c42b0 2024-01-19T04:18:19.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.524+0000 7f25a5600640 1 -- 172.21.15.32:0/1721885501 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f25900073f0 con 0x7f25a80c42b0 2024-01-19T04:18:19.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.524+0000 7f25a5600640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2580066500 0x7f25800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:19.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.524+0000 7f25a5600640 1 -- 172.21.15.32:0/1721885501 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2590083770 con 0x7f25a80c42b0 2024-01-19T04:18:19.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.524+0000 7f25ad600640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2580066500 0x7f25800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:19.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.524+0000 7f25ad600640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2580066500 0x7f25800689c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f25980af000 tx=0x7f2598004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.528+0000 7f25a5600640 1 -- 172.21.15.32:0/1721885501 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f25900506e0 con 0x7f25a80c42b0 2024-01-19T04:18:19.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.720+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25a80749f0 con 0x7f25a80c42b0 2024-01-19T04:18:19.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.720+0000 7f25a5600640 1 -- 172.21.15.32:0/1721885501 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+149 (secure 0 0 0) 0x7f2590053d00 con 0x7f25a80c42b0 2024-01-19T04:18:19.725 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T04:18:19.725 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-19T04:18:19.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2580066500 msgr2=0x7f25800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2580066500 0x7f25800689c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f25980af000 tx=0x7f2598004740 comp rx=0 tx=0).stop 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25a80c42b0 msgr2=0x7f25a81f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25a80c42b0 0x7f25a81f0cf0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f259000c450 tx=0x7f259000c910 comp rx=0 tx=0).stop 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 shutdown_connections 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2580066500 0x7f25800689c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25a80c5740 0x7f25a80a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25a80c42b0 0x7f25a81f0cf0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 --2- 172.21.15.32:0/1721885501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25a80c1120 0x7f25a8151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 >> 172.21.15.32:0/1721885501 conn(0x7f25a80c5b20 msgr2=0x7f25a80c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 shutdown_connections 2024-01-19T04:18:19.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:19.724+0000 7f25b0000640 1 -- 172.21.15.32:0/1721885501 wait complete. 2024-01-19T04:18:19.748 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-19T04:18:19.748 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T04:18:19.748 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-19T04:18:19.748 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-19T04:18:19.749 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:19.749 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-19T04:18:19.749 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-19T04:18:19.749 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.IOoJWPcCFa 2024-01-19T04:18:19.749 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-01-19T04:18:19.759 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.t8eREkRuNH 2024-01-19T04:18:19.760 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /tmp/tmp.IOoJWPcCFa /tmp/tmp.t8eREkRuNH 2024-01-19T04:18:19.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.t8eREkRuNH 2024-01-19T04:18:19.946 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.t8eREkRuNH is 226B 2024-01-19T04:18:19.962 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.t8eREkRuNH 2024-01-19T04:18:19.971 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-19T04:18:19.971 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:18:19.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:19.971 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-19T04:18:20.021 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T04:18:20.021 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T04:18:20.022 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42266sec preferred_lft 42266sec 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:79:8b:32:ad brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:20.023 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T04:18:20.024 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:18:20.024 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T04:18:20.024 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-19T04:18:20.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.025 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T04:18:20.089 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-19T04:18:20.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.091 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T04:18:20.144 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T04:18:20.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.145 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-19T04:18:20.145 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-19T04:18:20.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T04:18:20.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T04:18:20.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T04:18:20.145 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-19T04:18:20.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.238 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:18:20.248 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:18:20.248 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:18:20.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-19T04:18:20.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:18:20.309 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:20.361 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-19T04:18:20.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T04:18:20.361 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:20.412 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:20.412 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/tmp/tmp.IOoJWPcCFa of=/dev/stdout 2024-01-19T04:18:20.460 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2024-01-19T04:18:20.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.460 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:20.557 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,secret=AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:20.557 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:18:20.557 INFO:teuthology.orchestra.run.smithi067.stdout:keyring.get_secret failed 2024-01-19T04:18:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,secret=AQAE+KlljUG5BhAAKYVvAIgN+sfC8VNbbsVU4Q==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-19T04:18:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-19T04:18:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.67:3300,172.21.15.67:3301" 2024-01-19T04:18:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: testuser@d7445317-ddd8-4205-bf5b-c51cd46cffd9.cephfs2=/ 2024-01-19T04:18:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.32:3300/172.21.15.67:3300/172.21.15.67:3301" will pass to kernel 2024-01-19T04:18:20.576 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-19T04:18:20.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.576 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:20.594 INFO:teuthology.orchestra.run.smithi067.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2024-01-19T04:18:20.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:18:20.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.596 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-19T04:18:20.647 INFO:teuthology.orchestra.run.smithi067.stdout:client7014 2024-01-19T04:18:20.648 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:20.648 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:20.697 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2024-01-19T04:18:20.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:20.697 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-01-19T04:18:20.708 INFO:teuthology.orchestra.run.smithi032.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2024-01-19T04:18:20.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:18:20.709 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:20.709 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:20.762 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:20.762 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:20.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:21.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec12400640 1 Processor -- start 2024-01-19T04:18:21.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec12400640 1 -- start start 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec12400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec0c0c04a0 0x7fec0c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec12400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec0c0a4ec0 0x7fec0c0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec12400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c071e80 con 0x7fec0c14fb50 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec12400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c1535c0 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec12400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c0726c0 con 0x7fec0c0c04a0 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec0be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec0c0a4ec0 0x7fec0c0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec0be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec0c0a4ec0 0x7fec0c0c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54880/0 (socket says 172.21.15.32:54880) 2024-01-19T04:18:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec0be00640 1 -- 172.21.15.32:0/2227760100 learned_addr learned my addr 172.21.15.32:0/2227760100 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:21.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec0be00640 1 -- 172.21.15.32:0/2227760100 >> v2:172.21.15.67:3300/0 conn(0x7fec0c0c04a0 msgr2=0x7fec0c0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:21.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec0be00640 1 --2- 172.21.15.32:0/2227760100 >> v2:172.21.15.67:3300/0 conn(0x7fec0c0c04a0 0x7fec0c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec0be00640 1 -- 172.21.15.32:0/2227760100 >> v1:172.21.15.67:6789/0 conn(0x7fec0c14fb50 legacy=0x7fec0c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:21.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.003+0000 7fec0be00640 1 -- 172.21.15.32:0/2227760100 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0c1cb0 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec0be00640 1 --2- 172.21.15.32:0/2227760100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0c1770 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fec0c066fd0 tx=0x7fec0401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6666c115ae8381ff server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec0a000640 1 -- 172.21.15.32:0/2227760100 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec040a55c0 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec0a000640 1 -- 172.21.15.32:0/2227760100 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec040a5720 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec0a000640 1 -- 172.21.15.32:0/2227760100 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec040a5ab0 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 -- 172.21.15.32:0/2227760100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 msgr2=0x7fec0c0c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 --2- 172.21.15.32:0/2227760100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0c1770 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fec0c066fd0 tx=0x7fec0401c900 comp rx=0 tx=0).stop 2024-01-19T04:18:21.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 -- 172.21.15.32:0/2227760100 shutdown_connections 2024-01-19T04:18:21.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 --2- 172.21.15.32:0/2227760100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0c1770 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 --2- 172.21.15.32:0/2227760100 >> v2:172.21.15.67:3300/0 conn(0x7fec0c0c04a0 0x7fec0c0c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 -- 172.21.15.32:0/2227760100 >> 172.21.15.32:0/2227760100 conn(0x7fec0c0c5b20 msgr2=0x7fec0c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:21.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 -- 172.21.15.32:0/2227760100 shutdown_connections 2024-01-19T04:18:21.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.007+0000 7fec12400640 1 -- 172.21.15.32:0/2227760100 wait complete. 2024-01-19T04:18:21.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 Processor -- start 2024-01-19T04:18:21.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 -- start start 2024-01-19T04:18:21.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c0c04a0 0x7fec0c0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec0c14fb50 0x7fec0c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1f0450 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0a8e80 con 0x7fec0c0c04a0 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1f0660 con 0x7fec0c14fb50 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0a8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54892/0 (socket says 172.21.15.32:54892) 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 -- 172.21.15.32:0/3388055364 learned_addr learned my addr 172.21.15.32:0/3388055364 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0aa00640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c0c04a0 0x7fec0c0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0be00640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec0c14fb50 0x7fec0c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 -- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec0c14fb50 msgr2=0x7fec0c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec0c14fb50 0x7fec0c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 -- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c0c04a0 msgr2=0x7fec0c0c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c0c04a0 0x7fec0c0c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 -- 172.21.15.32:0/3388055364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04009b30 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec0b400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0a8940 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7febfc00b410 tx=0x7febfc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec03400640 1 -- 172.21.15.32:0/3388055364 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc004020 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec03400640 1 -- 172.21.15.32:0/3388055364 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc004180 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec03400640 1 -- 172.21.15.32:0/3388055364 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc011630 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c1f0940 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.011+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c1f0f00 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.015+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c072b30 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.015+0000 7fec03400640 1 -- 172.21.15.32:0/3388055364 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7febfc011790 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.015+0000 7fec03400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febe4066500 0x7febe40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.015+0000 7fec03400640 1 -- 172.21.15.32:0/3388055364 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7febfc083ef0 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.015+0000 7fec0aa00640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febe4066500 0x7febe40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.015+0000 7fec0aa00640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febe4066500 0x7febe40689c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec0c156290 tx=0x7febf4009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.019+0000 7fec03400640 1 -- 172.21.15.32:0/3388055364 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fec0c072b30 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.179+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec0c072b30 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.179+0000 7fec03400640 1 -- 172.21.15.32:0/3388055364 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7fec0c072b30 con 0x7fec0c0a4ec0 2024-01-19T04:18:21.185 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:21.185 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:21.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febe4066500 msgr2=0x7febe40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febe4066500 0x7febe40689c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec0c156290 tx=0x7febf4009110 comp rx=0 tx=0).stop 2024-01-19T04:18:21.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 msgr2=0x7fec0c0a8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0a8940 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7febfc00b410 tx=0x7febfc00b8d0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 shutdown_connections 2024-01-19T04:18:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7febe4066500 0x7febe40689c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fec0c14fb50 0x7fec0c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c0c04a0 0x7fec0c0c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 --2- 172.21.15.32:0/3388055364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0c0a4ec0 0x7fec0c0a8940 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 >> 172.21.15.32:0/3388055364 conn(0x7fec0c0c5b20 msgr2=0x7fec0c0bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 shutdown_connections 2024-01-19T04:18:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.183+0000 7fec12400640 1 -- 172.21.15.32:0/3388055364 wait complete. 2024-01-19T04:18:21.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:17:47.021907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:17:48.211408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:18:00.535616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:18:01.296998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:18:21.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:18:21.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.347+0000 7f3e32c00640 1 Processor -- start 2024-01-19T04:18:21.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.347+0000 7f3e32c00640 1 -- start start 2024-01-19T04:18:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.347+0000 7f3e32c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.347+0000 7f3e32c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c0a4ea0 con 0x7f3e2c0723b0 2024-01-19T04:18:21.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.347+0000 7f3e32c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c152a20 con 0x7f3e2c06d440 2024-01-19T04:18:21.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.347+0000 7f3e32c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1524a0 con 0x7f3e2c0c2080 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3e2c0723b0 0x7f3e2c152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42868/0 (socket says 172.21.15.32:42868) 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2be00640 1 -- 172.21.15.32:0/1074406653 learned_addr learned my addr 172.21.15.32:0/1074406653 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2b400640 1 --2- 172.21.15.32:0/1074406653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171172063 0 0) 0x7f3e2c0a4ea0 con 0x7f3e2c0723b0 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e0c003530 con 0x7f3e2c0723b0 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333513558 0 0) 0x7f3e2c152a20 con 0x7f3e2c06d440 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e2c0a4ea0 con 0x7f3e2c06d440 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 13286994 0 0) 0x7f3e0c003530 con 0x7f3e2c0723b0 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2b400640 1 -- 172.21.15.32:0/1074406653 >> v1:172.21.15.67:6789/0 conn(0x7f3e2c06d440 legacy=0x7f3e2c0c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2b400640 1 -- 172.21.15.32:0/1074406653 >> v1:172.21.15.32:6789/0 conn(0x7f3e2c0723b0 legacy=0x7f3e2c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2b400640 1 -- 172.21.15.32:0/1074406653 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0c3430 con 0x7f3e2c0c2080 2024-01-19T04:18:21.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.351+0000 7f3e2b400640 1 --2- 172.21.15.32:0/1074406653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155a90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097f0 tx=0x7f3e1401c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91ba09e5d2d9ef82 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140a4ea0 con 0x7f3e2c0c2080 2024-01-19T04:18:21.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e140a7050 con 0x7f3e2c0c2080 2024-01-19T04:18:21.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e2aa00640 1 -- 172.21.15.32:0/1074406653 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c001680 con 0x7f3e2c0c2080 2024-01-19T04:18:21.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- 172.21.15.32:0/1074406653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 msgr2=0x7f3e2c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 --2- 172.21.15.32:0/1074406653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155a90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097f0 tx=0x7f3e1401c290 comp rx=0 tx=0).stop 2024-01-19T04:18:21.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- 172.21.15.32:0/1074406653 shutdown_connections 2024-01-19T04:18:21.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 --2- 172.21.15.32:0/1074406653 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155a90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- 172.21.15.32:0/1074406653 >> 172.21.15.32:0/1074406653 conn(0x7f3e2c0c25a0 msgr2=0x7f3e2c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:21.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- 172.21.15.32:0/1074406653 shutdown_connections 2024-01-19T04:18:21.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- 172.21.15.32:0/1074406653 wait complete. 2024-01-19T04:18:21.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 Processor -- start 2024-01-19T04:18:21.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- start start 2024-01-19T04:18:21.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e2c06d440 0x7f3e2c144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e2c0723b0 0x7f3e2c147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0702d0 con 0x7f3e2c0723b0 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c154d70 con 0x7f3e2c06d440 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.355+0000 7f3e32c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1448a0 con 0x7f3e2c0c2080 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e2c0723b0 0x7f3e2c147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e2c0723b0 0x7f3e2c147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54896/0 (socket says 172.21.15.32:54896) 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 -- 172.21.15.32:0/2975731745 learned_addr learned my addr 172.21.15.32:0/2975731745 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e30c00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2be00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e2c06d440 0x7f3e2c144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 -- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 msgr2=0x7f3e2c155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 -- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e2c06d440 msgr2=0x7f3e2c144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e2c06d440 0x7f3e2c144b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 -- 172.21.15.32:0/2975731745 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e14009420 con 0x7f3e2c0723b0 2024-01-19T04:18:21.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2be00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e2c06d440 0x7f3e2c144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:21.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e2b400640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e2c0723b0 0x7f3e2c147030 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097f0 tx=0x7f3e14019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e23e00640 1 -- 172.21.15.32:0/2975731745 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14006e20 con 0x7f3e2c0723b0 2024-01-19T04:18:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e23e00640 1 -- 172.21.15.32:0/2975731745 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14004020 con 0x7f3e2c0723b0 2024-01-19T04:18:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c155030 con 0x7f3e2c0723b0 2024-01-19T04:18:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e23e00640 1 -- 172.21.15.32:0/2975731745 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140043d0 con 0x7f3e2c0723b0 2024-01-19T04:18:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c153660 con 0x7f3e2c0723b0 2024-01-19T04:18:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c0749f0 con 0x7f3e2c0723b0 2024-01-19T04:18:21.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.359+0000 7f3e23e00640 1 -- 172.21.15.32:0/2975731745 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3e140b2040 con 0x7f3e2c0723b0 2024-01-19T04:18:21.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.363+0000 7f3e23e00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e04066500 0x7f3e040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.363+0000 7f3e23e00640 1 -- 172.21.15.32:0/2975731745 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3e1411de80 con 0x7f3e2c0723b0 2024-01-19T04:18:21.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.363+0000 7f3e2be00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e04066500 0x7f3e040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.363+0000 7f3e2be00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e04066500 0x7f3e040689c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c000fc0 tx=0x7f3e1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.367+0000 7f3e23e00640 1 -- 172.21.15.32:0/2975731745 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3e140eae60 con 0x7f3e2c0723b0 2024-01-19T04:18:21.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.523+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e2c0c1830 con 0x7f3e2c0723b0 2024-01-19T04:18:21.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.523+0000 7f3e23e00640 1 -- 172.21.15.32:0/2975731745 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e140b00a0 con 0x7f3e2c0723b0 2024-01-19T04:18:21.530 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e04066500 msgr2=0x7f3e040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e04066500 0x7f3e040689c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c000fc0 tx=0x7f3e1c009040 comp rx=0 tx=0).stop 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e2c0723b0 msgr2=0x7f3e2c147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e2c0723b0 0x7f3e2c147030 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3e140097f0 tx=0x7f3e14019030 comp rx=0 tx=0).stop 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 shutdown_connections 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3e04066500 0x7f3e040689c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3e2c0c2080 0x7f3e2c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e2c0723b0 0x7f3e2c147030 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 --2- 172.21.15.32:0/2975731745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e2c06d440 0x7f3e2c144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 >> 172.21.15.32:0/2975731745 conn(0x7f3e2c0c25a0 msgr2=0x7f3e2c0a7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:21.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 shutdown_connections 2024-01-19T04:18:21.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.527+0000 7f3e32c00640 1 -- 172.21.15.32:0/2975731745 wait complete. 2024-01-19T04:18:21.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:18:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 Processor -- start 2024-01-19T04:18:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 -- start start 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbd540c15c0 0x7fbd540c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbd5406f5b0 0x7fbd54154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406ae10 0x7fbd54151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5406a6a0 con 0x7fbd540c15c0 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd54154bd0 con 0x7fbd5406f5b0 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd5aa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54154e70 con 0x7fbd5406ae10 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbd540c15c0 0x7fbd540c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbd540c15c0 0x7fbd540c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54910/0 (socket says 172.21.15.32:54910) 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 -- 172.21.15.32:0/1613984552 learned_addr learned my addr 172.21.15.32:0/1613984552 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53400640 1 --2- 172.21.15.32:0/1613984552 >> v2:172.21.15.67:3300/0 conn(0x7fbd5406f5b0 0x7fbd54154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd58a00640 1 --2- 172.21.15.32:0/1613984552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406ae10 0x7fbd54151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 -- 172.21.15.32:0/1613984552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406ae10 msgr2=0x7fbd54151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 --2- 172.21.15.32:0/1613984552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406ae10 0x7fbd54151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 -- 172.21.15.32:0/1613984552 >> v2:172.21.15.67:3300/0 conn(0x7fbd5406f5b0 msgr2=0x7fbd54154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 --2- 172.21.15.32:0/1613984552 >> v2:172.21.15.67:3300/0 conn(0x7fbd5406f5b0 0x7fbd54154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53e00640 1 -- 172.21.15.32:0/1613984552 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54155150 con 0x7fbd540c15c0 2024-01-19T04:18:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd58a00640 1 --2- 172.21.15.32:0/1613984552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406ae10 0x7fbd54151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.691+0000 7fbd53400640 1 --2- 172.21.15.32:0/1613984552 >> v2:172.21.15.67:3300/0 conn(0x7fbd5406f5b0 0x7fbd54154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:21.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd53e00640 1 --2- 172.21.15.32:0/1613984552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd540c15c0 0x7fbd540c19a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fbd5406c6e0 tx=0x7fbd4401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ef56baa892e2a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd52a00640 1 -- 172.21.15.32:0/1613984552 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440ab600 con 0x7fbd540c15c0 2024-01-19T04:18:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd52a00640 1 -- 172.21.15.32:0/1613984552 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd440a7050 con 0x7fbd540c15c0 2024-01-19T04:18:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd52a00640 1 -- 172.21.15.32:0/1613984552 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440ab980 con 0x7fbd540c15c0 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd5aa00640 1 -- 172.21.15.32:0/1613984552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd540c15c0 msgr2=0x7fbd540c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/1613984552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd540c15c0 0x7fbd540c19a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fbd5406c6e0 tx=0x7fbd4401c470 comp rx=0 tx=0).stop 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd5aa00640 1 -- 172.21.15.32:0/1613984552 shutdown_connections 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/1613984552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406ae10 0x7fbd54151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/1613984552 >> v2:172.21.15.67:3300/0 conn(0x7fbd5406f5b0 0x7fbd54154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/1613984552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd540c15c0 0x7fbd540c19a0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.695+0000 7fbd5aa00640 1 -- 172.21.15.32:0/1613984552 >> 172.21.15.32:0/1613984552 conn(0x7fbd540c36c0 msgr2=0x7fbd540c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 -- 172.21.15.32:0/1613984552 shutdown_connections 2024-01-19T04:18:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 -- 172.21.15.32:0/1613984552 wait complete. 2024-01-19T04:18:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 Processor -- start 2024-01-19T04:18:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 -- start start 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5406ae10 0x7fbd54153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406f5b0 0x7fbd5406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd540c15c0 0x7fbd540aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541532e0 con 0x7fbd5406ae10 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5406d370 con 0x7fbd540c15c0 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd5aa00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54154210 con 0x7fbd5406f5b0 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5406ae10 0x7fbd54153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5406ae10 0x7fbd54153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54922/0 (socket says 172.21.15.32:54922) 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406f5b0 0x7fbd5406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 -- 172.21.15.32:0/209780233 learned_addr learned my addr 172.21.15.32:0/209780233 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd58a00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd540c15c0 0x7fbd540aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 -- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406f5b0 msgr2=0x7fbd5406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406f5b0 0x7fbd5406d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 -- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd540c15c0 msgr2=0x7fbd540aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd540c15c0 0x7fbd540aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 -- 172.21.15.32:0/209780233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440094d0 con 0x7fbd5406ae10 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd53e00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5406ae10 0x7fbd54153cd0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbd44000c10 tx=0x7fbd44019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.699+0000 7fbd4be00640 1 -- 172.21.15.32:0/209780233 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440b6620 con 0x7fbd5406ae10 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd4be00640 1 -- 172.21.15.32:0/209780233 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd440b67a0 con 0x7fbd5406ae10 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd4be00640 1 -- 172.21.15.32:0/209780233 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440b6b50 con 0x7fbd5406ae10 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd541566f0 con 0x7fbd5406ae10 2024-01-19T04:18:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd54156cb0 con 0x7fbd5406ae10 2024-01-19T04:18:21.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5404f1d0 con 0x7fbd5406ae10 2024-01-19T04:18:21.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd4be00640 1 -- 172.21.15.32:0/209780233 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbd440b2040 con 0x7fbd5406ae10 2024-01-19T04:18:21.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd4be00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbd2c066500 0x7fbd2c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:21.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd4be00640 1 -- 172.21.15.32:0/209780233 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbd4411df00 con 0x7fbd5406ae10 2024-01-19T04:18:21.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd53400640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbd2c066500 0x7fbd2c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:21.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.703+0000 7fbd53400640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbd2c066500 0x7fbd2c0689c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbd540ac380 tx=0x7fbd3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:21.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.707+0000 7fbd4be00640 1 -- 172.21.15.32:0/209780233 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbd440eaee0 con 0x7fbd5406ae10 2024-01-19T04:18:21.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd540749f0 con 0x7fbd5406ae10 2024-01-19T04:18:21.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd4be00640 1 -- 172.21.15.32:0/209780233 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd440ee500 con 0x7fbd5406ae10 2024-01-19T04:18:21.876 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbd2c066500 msgr2=0x7fbd2c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbd2c066500 0x7fbd2c0689c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbd540ac380 tx=0x7fbd3c008040 comp rx=0 tx=0).stop 2024-01-19T04:18:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5406ae10 msgr2=0x7fbd54153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5406ae10 0x7fbd54153cd0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbd44000c10 tx=0x7fbd44019210 comp rx=0 tx=0).stop 2024-01-19T04:18:21.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 shutdown_connections 2024-01-19T04:18:21.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fbd2c066500 0x7fbd2c0689c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd540c15c0 0x7fbd540aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fbd5406f5b0 0x7fbd5406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 --2- 172.21.15.32:0/209780233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5406ae10 0x7fbd54153cd0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:21.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 >> 172.21.15.32:0/209780233 conn(0x7fbd540c36c0 msgr2=0x7fbd540c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:21.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 shutdown_connections 2024-01-19T04:18:21.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:21.871+0000 7fbd5aa00640 1 -- 172.21.15.32:0/209780233 wait complete. 2024-01-19T04:18:21.897 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:18:22.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.035+0000 7f4a03c00640 1 Processor -- start 2024-01-19T04:18:22.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.035+0000 7f4a03c00640 1 -- start start 2024-01-19T04:18:22.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a03c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f49fc0c4360 0x7f49fc06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a03c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc070630 0x7f49fc06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a03c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc06c6a0 con 0x7f49fc151dc0 2024-01-19T04:18:22.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a03c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49fc1521a0 con 0x7f49fc0c4360 2024-01-19T04:18:22.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a03c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc154cf0 con 0x7f49fc070630 2024-01-19T04:18:22.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f49fc151dc0 0x7f49fc0c1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42872/0 (socket says 172.21.15.32:42872) 2024-01-19T04:18:22.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01200640 1 -- 172.21.15.32:0/3398605278 learned_addr learned my addr 172.21.15.32:0/3398605278 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc070630 0x7f49fc06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fbe00640 1 --2- 172.21.15.32:0/3398605278 >> v2:172.21.15.67:3300/0 conn(0x7f49fc0c4360 0x7f49fc06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322829280 0 0) 0x7f49fc06c6a0 con 0x7f49fc151dc0 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49dc003530 con 0x7f49fc151dc0 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137368674 0 0) 0x7f49dc003530 con 0x7f49fc151dc0 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc070630 msgr2=0x7f49fc06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc070630 0x7f49fc06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 >> v2:172.21.15.67:3300/0 conn(0x7f49fc0c4360 msgr2=0x7f49fc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 --2- 172.21.15.32:0/3398605278 >> v2:172.21.15.67:3300/0 conn(0x7f49fc0c4360 0x7f49fc06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc154fd0 con 0x7f49fc151dc0 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f49ec001680 con 0x7f49fc151dc0 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 >> v1:172.21.15.32:6789/0 conn(0x7f49fc151dc0 legacy=0x7f49fc0c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49dc003980 0x7f49dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49dc004370 0x7f49dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1521a0 con 0x7f49dc004ec0 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc154cf0 con 0x7f49dc004370 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc00bed0 con 0x7f49dc003980 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc070630 0x7f49fc06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01200640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49dc003980 0x7f49dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f49fbe00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49dc004370 0x7f49dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 -- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49dc003980 msgr2=0x7f49dc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49dc003980 0x7f49dc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 -- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49dc004370 msgr2=0x7f49dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49dc004370 0x7f49dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.039+0000 7f4a01c00640 1 -- 172.21.15.32:0/3398605278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc003530 con 0x7f49dc004ec0 2024-01-19T04:18:22.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49dc00b990 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f49fc070a10 tx=0x7f49f401cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cfe49b0e15ce18 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40a5d50 con 0x7f49dc004ec0 2024-01-19T04:18:22.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f400f040 con 0x7f49dc004ec0 2024-01-19T04:18:22.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f49fb400640 1 -- 172.21.15.32:0/3398605278 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f4003bc0 con 0x7f49dc004ec0 2024-01-19T04:18:22.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a03c00640 1 -- 172.21.15.32:0/3398605278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 msgr2=0x7f49dc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a03c00640 1 --2- 172.21.15.32:0/3398605278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49dc00b990 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f49fc070a10 tx=0x7f49f401cd00 comp rx=0 tx=0).stop 2024-01-19T04:18:22.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a01c00640 1 -- 172.21.15.32:0/3398605278 reap_dead start 2024-01-19T04:18:22.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a03c00640 1 -- 172.21.15.32:0/3398605278 shutdown_connections 2024-01-19T04:18:22.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a03c00640 1 -- 172.21.15.32:0/3398605278 >> 172.21.15.32:0/3398605278 conn(0x7f49fc0c7d00 msgr2=0x7f49fc0c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:22.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a03c00640 1 -- 172.21.15.32:0/3398605278 shutdown_connections 2024-01-19T04:18:22.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.043+0000 7f4a03c00640 1 -- 172.21.15.32:0/3398605278 wait complete. 2024-01-19T04:18:22.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 Processor -- start 2024-01-19T04:18:22.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 -- start start 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49fc1ea550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc1eaf40 0x7f49fc1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc06e5d0 0x7f49fc14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1eaa90 con 0x7f49dc004ec0 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1ece20 con 0x7f49fc06e5d0 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc06fa60 con 0x7f49fc1eaf40 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49fc1ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49fc1ea550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54952/0 (socket says 172.21.15.32:54952) 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 -- 172.21.15.32:0/3930140987 learned_addr learned my addr 172.21.15.32:0/3930140987 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f49fbe00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc1eaf40 0x7f49fc1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc06e5d0 0x7f49fc14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 -- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc1eaf40 msgr2=0x7f49fc1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc1eaf40 0x7f49fc1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 -- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc06e5d0 msgr2=0x7f49fc14ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc06e5d0 0x7f49fc14ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 -- 172.21.15.32:0/3930140987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc06fd40 con 0x7f49dc004ec0 2024-01-19T04:18:22.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc06e5d0 0x7f49fc14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:22.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a01200640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49fc1ea550 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f49ec007310 tx=0x7f49ec007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f49f8c00640 1 -- 172.21.15.32:0/3930140987 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec007c20 con 0x7f49dc004ec0 2024-01-19T04:18:22.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f49f8c00640 1 -- 172.21.15.32:0/3930140987 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec00f9c0 con 0x7f49dc004ec0 2024-01-19T04:18:22.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc070020 con 0x7f49dc004ec0 2024-01-19T04:18:22.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f49f8c00640 1 -- 172.21.15.32:0/3930140987 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec00fd70 con 0x7f49dc004ec0 2024-01-19T04:18:22.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc06e0b0 con 0x7f49dc004ec0 2024-01-19T04:18:22.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.047+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc0749f0 con 0x7f49dc004ec0 2024-01-19T04:18:22.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.051+0000 7f49f8c00640 1 -- 172.21.15.32:0/3930140987 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f49ec01d460 con 0x7f49dc004ec0 2024-01-19T04:18:22.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.051+0000 7f49f8c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49d4066500 0x7f49d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.051+0000 7f49f8c00640 1 -- 172.21.15.32:0/3930140987 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f49ec084370 con 0x7f49dc004ec0 2024-01-19T04:18:22.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.051+0000 7f49fbe00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49d4066500 0x7f49d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.051+0000 7f49fbe00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49d4066500 0x7f49d40689c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f49fc1e7910 tx=0x7f49e4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.055+0000 7f49f8c00640 1 -- 172.21.15.32:0/3930140987 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f49ec0512a0 con 0x7f49dc004ec0 2024-01-19T04:18:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49fc0c1e90 con 0x7f49dc004ec0 2024-01-19T04:18:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f49f8c00640 1 -- 172.21.15.32:0/3930140987 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49ec0548c0 con 0x7f49dc004ec0 2024-01-19T04:18:22.218 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:22.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49d4066500 msgr2=0x7f49d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49d4066500 0x7f49d40689c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f49fc1e7910 tx=0x7f49e4009190 comp rx=0 tx=0).stop 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 msgr2=0x7f49fc1ea550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49fc1ea550 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f49ec007310 tx=0x7f49ec007710 comp rx=0 tx=0).stop 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 shutdown_connections 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f49d4066500 0x7f49d40689c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc06e5d0 0x7f49fc14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f49fc1eaf40 0x7f49fc1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 --2- 172.21.15.32:0/3930140987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49dc004ec0 0x7f49fc1ea550 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 >> 172.21.15.32:0/3930140987 conn(0x7f49fc0c7d00 msgr2=0x7f49fc0c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 shutdown_connections 2024-01-19T04:18:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.215+0000 7f4a03c00640 1 -- 172.21.15.32:0/3930140987 wait complete. 2024-01-19T04:18:22.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:18:22.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5ccac00640 1 Processor -- start 2024-01-19T04:18:22.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5ccac00640 1 -- start start 2024-01-19T04:18:22.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5ccac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc40723b0 0x7f5cc4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5ccac00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cc40c2080 0x7f5cc4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5ccac00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40a4ea0 con 0x7f5cc406d440 2024-01-19T04:18:22.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5ccac00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc41524a0 con 0x7f5cc40c2080 2024-01-19T04:18:22.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5ccac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4152a20 con 0x7f5cc40723b0 2024-01-19T04:18:22.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5cc3e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc40723b0 0x7f5cc4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5cc8c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5cc406d440 0x7f5cc40c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50596/0 (socket says 172.21.15.32:50596) 2024-01-19T04:18:22.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5cc3400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5cc40c2080 0x7f5cc4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.379+0000 7f5cc8c00640 1 -- 172.21.15.32:0/502743118 learned_addr learned my addr 172.21.15.32:0/502743118 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:22.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc3e00640 1 -- 172.21.15.32:0/502743118 >> v2:172.21.15.67:3300/0 conn(0x7f5cc40c2080 msgr2=0x7f5cc4155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:22.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc3e00640 1 --2- 172.21.15.32:0/502743118 >> v2:172.21.15.67:3300/0 conn(0x7f5cc40c2080 0x7f5cc4155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc3e00640 1 -- 172.21.15.32:0/502743118 >> v1:172.21.15.67:6789/0 conn(0x7f5cc406d440 legacy=0x7f5cc40c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc3e00640 1 -- 172.21.15.32:0/502743118 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc41533f0 con 0x7f5cc40723b0 2024-01-19T04:18:22.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc2a00640 1 -- 172.21.15.32:0/502743118 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915701362 0 0) 0x7f5cc40a4ea0 con 0x7f5cc406d440 2024-01-19T04:18:22.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc3e00640 1 --2- 172.21.15.32:0/502743118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc40723b0 0x7f5cc4152eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40097c0 tx=0x7f5cb401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=850abcc7f3b73dd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc2a00640 1 -- 172.21.15.32:0/502743118 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40ad660 con 0x7f5cc40723b0 2024-01-19T04:18:22.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc2a00640 1 -- 172.21.15.32:0/502743118 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb40ad7c0 con 0x7f5cc40723b0 2024-01-19T04:18:22.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.383+0000 7f5cc2a00640 1 -- 172.21.15.32:0/502743118 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40adb50 con 0x7f5cc40723b0 2024-01-19T04:18:22.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- 172.21.15.32:0/502743118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc40723b0 msgr2=0x7f5cc4152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 --2- 172.21.15.32:0/502743118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc40723b0 0x7f5cc4152eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40097c0 tx=0x7f5cb401c360 comp rx=0 tx=0).stop 2024-01-19T04:18:22.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- 172.21.15.32:0/502743118 shutdown_connections 2024-01-19T04:18:22.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 --2- 172.21.15.32:0/502743118 >> v2:172.21.15.67:3300/0 conn(0x7f5cc40c2080 0x7f5cc4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 --2- 172.21.15.32:0/502743118 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc40723b0 0x7f5cc4152eb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- 172.21.15.32:0/502743118 >> 172.21.15.32:0/502743118 conn(0x7f5cc40c25a0 msgr2=0x7f5cc40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:22.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- 172.21.15.32:0/502743118 shutdown_connections 2024-01-19T04:18:22.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- 172.21.15.32:0/502743118 wait complete. 2024-01-19T04:18:22.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 Processor -- start 2024-01-19T04:18:22.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- start start 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc406d440 0x7f5cc40bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc40723b0 0x7f5cc406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc40c2080 0x7f5cc4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc41548e0 con 0x7f5cc40c2080 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4155740 con 0x7f5cc40723b0 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5ccac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4154b30 con 0x7f5cc406d440 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5cc8c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc40c2080 0x7f5cc4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5cc8c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc40c2080 0x7f5cc4070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54966/0 (socket says 172.21.15.32:54966) 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5cc8c00640 1 -- 172.21.15.32:0/4084772217 learned_addr learned my addr 172.21.15.32:0/4084772217 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5cc3e00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc406d440 0x7f5cc40bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.387+0000 7f5cc3400640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc40723b0 0x7f5cc406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cc8c00640 1 -- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc406d440 msgr2=0x7f5cc40bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cc8c00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc406d440 0x7f5cc40bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cc8c00640 1 -- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc40723b0 msgr2=0x7f5cc406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cc8c00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc40723b0 0x7f5cc406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cc8c00640 1 -- 172.21.15.32:0/4084772217 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4009420 con 0x7f5cc40c2080 2024-01-19T04:18:22.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cc8c00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc40c2080 0x7f5cc4070480 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c6d0 tx=0x7f5cbc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cbbe00640 1 -- 172.21.15.32:0/4084772217 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc004d70 con 0x7f5cc40c2080 2024-01-19T04:18:22.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cbbe00640 1 -- 172.21.15.32:0/4084772217 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00a640 con 0x7f5cc40c2080 2024-01-19T04:18:22.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc4154e10 con 0x7f5cc40c2080 2024-01-19T04:18:22.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cbbe00640 1 -- 172.21.15.32:0/4084772217 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00aa70 con 0x7f5cc40c2080 2024-01-19T04:18:22.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc41553d0 con 0x7f5cc40c2080 2024-01-19T04:18:22.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc41558b0 con 0x7f5cc40c2080 2024-01-19T04:18:22.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.391+0000 7f5cbbe00640 1 -- 172.21.15.32:0/4084772217 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5cbc0070d0 con 0x7f5cc40c2080 2024-01-19T04:18:22.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.395+0000 7f5cbbe00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5c9c066500 0x7f5c9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.395+0000 7f5cbbe00640 1 -- 172.21.15.32:0/4084772217 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5cbc083ac0 con 0x7f5cc40c2080 2024-01-19T04:18:22.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.395+0000 7f5cc3e00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5c9c066500 0x7f5c9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.395+0000 7f5cc3e00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5c9c066500 0x7f5c9c0689c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40af000 tx=0x7f5cb40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.399+0000 7f5cbbe00640 1 -- 172.21.15.32:0/4084772217 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5cbc050aa0 con 0x7f5cc40c2080 2024-01-19T04:18:22.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.559+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5cc40749f0 con 0x7f5cc40c2080 2024-01-19T04:18:22.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.559+0000 7f5cbbe00640 1 -- 172.21.15.32:0/4084772217 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5cbc018020 con 0x7f5cc40c2080 2024-01-19T04:18:22.564 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5c9c066500 msgr2=0x7f5c9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5c9c066500 0x7f5c9c0689c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40af000 tx=0x7f5cb40a7000 comp rx=0 tx=0).stop 2024-01-19T04:18:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc40c2080 msgr2=0x7f5cc4070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc40c2080 0x7f5cc4070480 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c6d0 tx=0x7f5cbc00cb90 comp rx=0 tx=0).stop 2024-01-19T04:18:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 shutdown_connections 2024-01-19T04:18:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5c9c066500 0x7f5c9c0689c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cc40c2080 0x7f5cc4070480 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cc40723b0 0x7f5cc406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 --2- 172.21.15.32:0/4084772217 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5cc406d440 0x7f5cc40bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 >> 172.21.15.32:0/4084772217 conn(0x7f5cc40c25a0 msgr2=0x7f5cc4150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 shutdown_connections 2024-01-19T04:18:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.563+0000 7f5ccac00640 1 -- 172.21.15.32:0/4084772217 wait complete. 2024-01-19T04:18:22.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:18:22.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6fc00640 1 Processor -- start 2024-01-19T04:18:22.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6fc00640 1 -- start start 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6fc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c2080 0x7f5a68155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6fc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5a6806d440 0x7f5a680c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6fc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680a4ea0 con 0x7f5a680723b0 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6fc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a681524a0 con 0x7f5a6806d440 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6fc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68152a20 con 0x7f5a680c2080 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5a6806d440 0x7f5a680c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5a6806d440 0x7f5a680c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54982/0 (socket says 172.21.15.32:54982) 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6dc00640 1 -- 172.21.15.32:0/1541059337 learned_addr learned my addr 172.21.15.32:0/1541059337 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6d200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5a680723b0 0x7f5a68152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42884/0 (socket says 172.21.15.32:42884) 2024-01-19T04:18:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a67e00640 1 --2- 172.21.15.32:0/1541059337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c2080 0x7f5a68155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6dc00640 1 -- 172.21.15.32:0/1541059337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c2080 msgr2=0x7f5a68155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6dc00640 1 --2- 172.21.15.32:0/1541059337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c2080 0x7f5a68155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6dc00640 1 -- 172.21.15.32:0/1541059337 >> v1:172.21.15.32:6789/0 conn(0x7f5a680723b0 legacy=0x7f5a68152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.727+0000 7f5a6dc00640 1 -- 172.21.15.32:0/1541059337 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680c3430 con 0x7f5a6806d440 2024-01-19T04:18:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6dc00640 1 --2- 172.21.15.32:0/1541059337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806d440 0x7f5a680c4e50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009e50 tx=0x7f5a6001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0c1df398d5ea93 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a67400640 1 -- 172.21.15.32:0/1541059337 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600a5690 con 0x7f5a6806d440 2024-01-19T04:18:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a67400640 1 -- 172.21.15.32:0/1541059337 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a600a57f0 con 0x7f5a6806d440 2024-01-19T04:18:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a67400640 1 -- 172.21.15.32:0/1541059337 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600a5b80 con 0x7f5a6806d440 2024-01-19T04:18:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 -- 172.21.15.32:0/1541059337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806d440 msgr2=0x7f5a680c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/1541059337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806d440 0x7f5a680c4e50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009e50 tx=0x7f5a6001c8c0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 -- 172.21.15.32:0/1541059337 shutdown_connections 2024-01-19T04:18:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/1541059337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a6806d440 0x7f5a680c4e50 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/1541059337 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a680c2080 0x7f5a68155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 -- 172.21.15.32:0/1541059337 >> 172.21.15.32:0/1541059337 conn(0x7f5a680c25a0 msgr2=0x7f5a680c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:22.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 -- 172.21.15.32:0/1541059337 shutdown_connections 2024-01-19T04:18:22.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.731+0000 7f5a6fc00640 1 -- 172.21.15.32:0/1541059337 wait complete. 2024-01-19T04:18:22.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 Processor -- start 2024-01-19T04:18:22.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 -- start start 2024-01-19T04:18:22.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806d440 0x7f5a680a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680723b0 0x7f5a6814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a680c2080 0x7f5a681ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680abbc0 con 0x7f5a680c2080 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680aaf40 con 0x7f5a680723b0 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680ab5d0 con 0x7f5a6806d440 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a680c2080 0x7f5a681ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a680c2080 0x7f5a681ee6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54996/0 (socket says 172.21.15.32:54996) 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 -- 172.21.15.32:0/2742497210 learned_addr learned my addr 172.21.15.32:0/2742497210 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6d200640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806d440 0x7f5a680a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a67e00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680723b0 0x7f5a6814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 -- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806d440 msgr2=0x7f5a680a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806d440 0x7f5a680a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 -- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680723b0 msgr2=0x7f5a6814e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680723b0 0x7f5a6814e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 -- 172.21.15.32:0/2742497210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009b30 con 0x7f5a680c2080 2024-01-19T04:18:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6dc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a680c2080 0x7f5a681ee6f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5a600af040 tx=0x7f5a60019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a64c00640 1 -- 172.21.15.32:0/2742497210 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600b8670 con 0x7f5a680c2080 2024-01-19T04:18:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a64c00640 1 -- 172.21.15.32:0/2742497210 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a600b87d0 con 0x7f5a680c2080 2024-01-19T04:18:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a680bf5c0 con 0x7f5a680c2080 2024-01-19T04:18:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a64c00640 1 -- 172.21.15.32:0/2742497210 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600b8b80 con 0x7f5a680c2080 2024-01-19T04:18:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.735+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a681eb7f0 con 0x7f5a680c2080 2024-01-19T04:18:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.739+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680abd00 con 0x7f5a680c2080 2024-01-19T04:18:22.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.739+0000 7f5a64c00640 1 -- 172.21.15.32:0/2742497210 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5a600b8ce0 con 0x7f5a680c2080 2024-01-19T04:18:22.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.739+0000 7f5a64c00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:22.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.739+0000 7f5a64c00640 1 -- 172.21.15.32:0/2742497210 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5a6011f5b0 con 0x7f5a680c2080 2024-01-19T04:18:22.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.739+0000 7f5a6d200640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:22.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.743+0000 7f5a6d200640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a58000f70 tx=0x7f5a58007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:22.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:18:22.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.743+0000 7f5a64c00640 1 -- 172.21.15.32:0/2742497210 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5a680abd00 con 0x7f5a680c2080 2024-01-19T04:18:22.751 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:18:22.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.903+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f5a680bf5c0 con 0x7f5a680c2080 2024-01-19T04:18:22.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.903+0000 7f5a64c00640 1 -- 172.21.15.32:0/2742497210 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5a680bf5c0 con 0x7f5a680c2080 2024-01-19T04:18:22.909 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:22.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 msgr2=0x7f5a400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a58000f70 tx=0x7f5a58007cf0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a680c2080 msgr2=0x7f5a681ee6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:22.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a680c2080 0x7f5a681ee6f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f5a600af040 tx=0x7f5a60019660 comp rx=0 tx=0).stop 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 shutdown_connections 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5a40066530 0x7f5a400689f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a680c2080 0x7f5a681ee6f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a680723b0 0x7f5a6814e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 --2- 172.21.15.32:0/2742497210 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5a6806d440 0x7f5a680a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 >> 172.21.15.32:0/2742497210 conn(0x7f5a680c25a0 msgr2=0x7f5a680a57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 shutdown_connections 2024-01-19T04:18:22.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:22.907+0000 7f5a6fc00640 1 -- 172.21.15.32:0/2742497210 wait complete. 2024-01-19T04:18:22.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:18:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.067+0000 7f92f6200640 1 Processor -- start 2024-01-19T04:18:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.067+0000 7f92f6200640 1 -- start start 2024-01-19T04:18:23.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92f6200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f92f0147f90 0x7f92f0151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92f6200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 0x7f92f00a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92f6200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f00c1d40 con 0x7f92f00c55e0 2024-01-19T04:18:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92f6200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f006c5c0 con 0x7f92f0147f90 2024-01-19T04:18:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92f6200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00c0810 con 0x7f92f00c18b0 2024-01-19T04:18:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92eea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f92f00c55e0 0x7f92f006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42888/0 (socket says 172.21.15.32:42888) 2024-01-19T04:18:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92eea00640 1 -- 172.21.15.32:0/2938104621 learned_addr learned my addr 172.21.15.32:0/2938104621 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92efe00640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 0x7f92f00a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ef400640 1 --2- 172.21.15.32:0/2938104621 >> v2:172.21.15.67:3300/0 conn(0x7f92f0147f90 0x7f92f0151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112819097 0 0) 0x7f92f00c1d40 con 0x7f92f00c55e0 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d0003530 con 0x7f92f00c55e0 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1134666736 0 0) 0x7f92d0003530 con 0x7f92f00c55e0 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 msgr2=0x7f92f00a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 0x7f92f00a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 >> v2:172.21.15.67:3300/0 conn(0x7f92f0147f90 msgr2=0x7f92f0151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 --2- 172.21.15.32:0/2938104621 >> v2:172.21.15.67:3300/0 conn(0x7f92f0147f90 0x7f92f0151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00c0af0 con 0x7f92f00c55e0 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f92d8001680 con 0x7f92f00c55e0 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 >> v1:172.21.15.32:6789/0 conn(0x7f92f00c55e0 legacy=0x7f92f006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 0x7f92d0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0003f50 0x7f92d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92d0004d10 0x7f92d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f006c5c0 con 0x7f92d0004d10 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00c0810 con 0x7f92d0003f50 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d000ba40 con 0x7f92f00c18b0 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92efe00640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92d0004d10 0x7f92d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92ef400640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 0x7f92d0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92eea00640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0003f50 0x7f92d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92efe00640 1 -- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 msgr2=0x7f92d0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92efe00640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f00c18b0 0x7f92d0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92efe00640 1 -- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0003f50 msgr2=0x7f92d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92efe00640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0003f50 0x7f92d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.071+0000 7f92efe00640 1 -- 172.21.15.32:0/2938104621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0003530 con 0x7f92d0004d10 2024-01-19T04:18:23.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92efe00640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92d0004d10 0x7f92d0005190 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009fc0 tx=0x7f92e801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bea112bf8732b10 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80a5c70 con 0x7f92d0004d10 2024-01-19T04:18:23.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e800f040 con 0x7f92d0004d10 2024-01-19T04:18:23.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92ee000640 1 -- 172.21.15.32:0/2938104621 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80ad440 con 0x7f92d0004d10 2024-01-19T04:18:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92f6200640 1 -- 172.21.15.32:0/2938104621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92d0004d10 msgr2=0x7f92d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92f6200640 1 --2- 172.21.15.32:0/2938104621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92d0004d10 0x7f92d0005190 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009fc0 tx=0x7f92e801cc60 comp rx=0 tx=0).stop 2024-01-19T04:18:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92efe00640 1 -- 172.21.15.32:0/2938104621 reap_dead start 2024-01-19T04:18:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92f6200640 1 -- 172.21.15.32:0/2938104621 shutdown_connections 2024-01-19T04:18:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92f6200640 1 -- 172.21.15.32:0/2938104621 >> 172.21.15.32:0/2938104621 conn(0x7f92f00c5b20 msgr2=0x7f92f00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92f6200640 1 -- 172.21.15.32:0/2938104621 shutdown_connections 2024-01-19T04:18:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.075+0000 7f92f6200640 1 -- 172.21.15.32:0/2938104621 wait complete. 2024-01-19T04:18:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 Processor -- start 2024-01-19T04:18:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 -- start start 2024-01-19T04:18:23.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0004d10 0x7f92f01e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92f0145600 0x7f92f014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f01e4e10 0x7f92f01ead00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f0148880 con 0x7f92f0145600 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f014d9b0 con 0x7f92d0004d10 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f0142ed0 con 0x7f92f01e4e10 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92f0145600 0x7f92f014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92f0145600 0x7f92f014de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55006/0 (socket says 172.21.15.32:55006) 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 -- 172.21.15.32:0/2205529112 learned_addr learned my addr 172.21.15.32:0/2205529112 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92ef400640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0004d10 0x7f92f01e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92efe00640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f01e4e10 0x7f92f01ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 -- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f01e4e10 msgr2=0x7f92f01ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f01e4e10 0x7f92f01ead00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 -- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0004d10 msgr2=0x7f92f01e8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0004d10 0x7f92f01e8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 -- 172.21.15.32:0/2205529112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f01e9140 con 0x7f92f0145600 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92eea00640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92f0145600 0x7f92f014de40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f92d8001060 tx=0x7f92d80128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92e7400640 1 -- 172.21.15.32:0/2205529112 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8014810 con 0x7f92f0145600 2024-01-19T04:18:23.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92e7400640 1 -- 172.21.15.32:0/2205529112 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d8014990 con 0x7f92f0145600 2024-01-19T04:18:23.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92e7400640 1 -- 172.21.15.32:0/2205529112 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8014d40 con 0x7f92f0145600 2024-01-19T04:18:23.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f00a91c0 con 0x7f92f0145600 2024-01-19T04:18:23.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f00a8c00 con 0x7f92f0145600 2024-01-19T04:18:23.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.079+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f00749f0 con 0x7f92f0145600 2024-01-19T04:18:23.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.083+0000 7f92e7400640 1 -- 172.21.15.32:0/2205529112 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f92d80153e0 con 0x7f92f0145600 2024-01-19T04:18:23.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.083+0000 7f92e7400640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f92c8066530 0x7f92c80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.083+0000 7f92e7400640 1 -- 172.21.15.32:0/2205529112 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f92d80869f0 con 0x7f92f0145600 2024-01-19T04:18:23.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.083+0000 7f92ef400640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f92c8066530 0x7f92c80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.083+0000 7f92ef400640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f92c8066530 0x7f92c80689f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f92f014e660 tx=0x7f92e0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.087+0000 7f92e7400640 1 -- 172.21.15.32:0/2205529112 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f92d8053a90 con 0x7f92f0145600 2024-01-19T04:18:23.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.255+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92f014daf0 con 0x7f92f0145600 2024-01-19T04:18:23.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.255+0000 7f92e7400640 1 -- 172.21.15.32:0/2205529112 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92d801c080 con 0x7f92f0145600 2024-01-19T04:18:23.261 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:18:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f92c8066530 msgr2=0x7f92c80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f92c8066530 0x7f92c80689f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f92f014e660 tx=0x7f92e0009190 comp rx=0 tx=0).stop 2024-01-19T04:18:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92f0145600 msgr2=0x7f92f014de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92f0145600 0x7f92f014de40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f92d8001060 tx=0x7f92d80128e0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 shutdown_connections 2024-01-19T04:18:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f92c8066530 0x7f92c80689f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f92f01e4e10 0x7f92f01ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92f0145600 0x7f92f014de40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 --2- 172.21.15.32:0/2205529112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92d0004d10 0x7f92f01e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 >> 172.21.15.32:0/2205529112 conn(0x7f92f00c5b20 msgr2=0x7f92f00c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 shutdown_connections 2024-01-19T04:18:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.259+0000 7f92f6200640 1 -- 172.21.15.32:0/2205529112 wait complete. 2024-01-19T04:18:23.283 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2024-01-19T04:18:23.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:23.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-19T04:18:23.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:18:23.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:23.310 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T04:18:23.366 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:23.366 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:23.376 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:23.376 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:23.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:23.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa377400640 1 Processor -- start 2024-01-19T04:18:23.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa377400640 1 -- start start 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa377400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa3700c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa377400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3701549f0 0x7fa370154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa377400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3700c3e40 con 0x7fa37014ebb0 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa377400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3700c1b60 con 0x7fa3701549f0 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa377400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700c17e0 con 0x7fa3700c28c0 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa375400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3701549f0 0x7fa370154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa375400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3701549f0 0x7fa370154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55008/0 (socket says 172.21.15.32:55008) 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa375400640 1 -- 172.21.15.32:0/505114386 learned_addr learned my addr 172.21.15.32:0/505114386 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa36fe00640 1 --2- 172.21.15.32:0/505114386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa3700c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa375400640 1 -- 172.21.15.32:0/505114386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 msgr2=0x7fa3700c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:23.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa375400640 1 --2- 172.21.15.32:0/505114386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa3700c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa375400640 1 -- 172.21.15.32:0/505114386 >> v1:172.21.15.67:6789/0 conn(0x7fa37014ebb0 legacy=0x7fa37006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.567+0000 7fa375400640 1 -- 172.21.15.32:0/505114386 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37006adb0 con 0x7fa3701549f0 2024-01-19T04:18:23.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa375400640 1 --2- 172.21.15.32:0/505114386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa370154e80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa368009e50 tx=0x7fa36801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d035e923c5ebdac server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa36f400640 1 -- 172.21.15.32:0/505114386 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680a5640 con 0x7fa3701549f0 2024-01-19T04:18:23.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa36f400640 1 -- 172.21.15.32:0/505114386 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3680a57a0 con 0x7fa3701549f0 2024-01-19T04:18:23.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa36f400640 1 -- 172.21.15.32:0/505114386 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680a5b30 con 0x7fa3701549f0 2024-01-19T04:18:23.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 -- 172.21.15.32:0/505114386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 msgr2=0x7fa370154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 --2- 172.21.15.32:0/505114386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa370154e80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa368009e50 tx=0x7fa36801c980 comp rx=0 tx=0).stop 2024-01-19T04:18:23.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 -- 172.21.15.32:0/505114386 shutdown_connections 2024-01-19T04:18:23.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 --2- 172.21.15.32:0/505114386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa370154e80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 --2- 172.21.15.32:0/505114386 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa3700c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 -- 172.21.15.32:0/505114386 >> 172.21.15.32:0/505114386 conn(0x7fa3700a88e0 msgr2=0x7fa3700c2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:23.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 -- 172.21.15.32:0/505114386 shutdown_connections 2024-01-19T04:18:23.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 -- 172.21.15.32:0/505114386 wait complete. 2024-01-19T04:18:23.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.571+0000 7fa377400640 1 Processor -- start 2024-01-19T04:18:23.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 -- start start 2024-01-19T04:18:23.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa370071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa37014ebb0 0x7fa3701ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa3701f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3701f07e0 con 0x7fa3701549f0 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370070c30 con 0x7fa37014ebb0 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa370072700 con 0x7fa3700c28c0 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa3701f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa3701f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55018/0 (socket says 172.21.15.32:55018) 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 -- 172.21.15.32:0/1863297991 learned_addr learned my addr 172.21.15.32:0/1863297991 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa36fe00640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa37014ebb0 0x7fa3701ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa374a00640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa370071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 -- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 msgr2=0x7fa370071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa370071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 -- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa37014ebb0 msgr2=0x7fa3701ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa37014ebb0 0x7fa3701ecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 -- 172.21.15.32:0/1863297991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368009b30 con 0x7fa3701549f0 2024-01-19T04:18:23.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa374a00640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa370071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:23.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa375400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa3701f0c00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa368009e50 tx=0x7fa368019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa36cc00640 1 -- 172.21.15.32:0/1863297991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680b8670 con 0x7fa3701549f0 2024-01-19T04:18:23.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa36cc00640 1 -- 172.21.15.32:0/1863297991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3680b87d0 con 0x7fa3701549f0 2024-01-19T04:18:23.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa36cc00640 1 -- 172.21.15.32:0/1863297991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680b8b80 con 0x7fa3701549f0 2024-01-19T04:18:23.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa370072140 con 0x7fa3701549f0 2024-01-19T04:18:23.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3701f0400 con 0x7fa3701549f0 2024-01-19T04:18:23.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.575+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3700749f0 con 0x7fa3701549f0 2024-01-19T04:18:23.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.579+0000 7fa36cc00640 1 -- 172.21.15.32:0/1863297991 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa3680b8ce0 con 0x7fa3701549f0 2024-01-19T04:18:23.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.579+0000 7fa36cc00640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa348066500 0x7fa3480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.579+0000 7fa36cc00640 1 -- 172.21.15.32:0/1863297991 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa36811f640 con 0x7fa3701549f0 2024-01-19T04:18:23.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.579+0000 7fa374a00640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa348066500 0x7fa3480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.579+0000 7fa374a00640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa348066500 0x7fa3480689c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa360001670 tx=0x7fa360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.583+0000 7fa36cc00640 1 -- 172.21.15.32:0/1863297991 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa3680ec690 con 0x7fa3701549f0 2024-01-19T04:18:23.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.743+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3701525d0 con 0x7fa3701549f0 2024-01-19T04:18:23.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa36cc00640 1 -- 172.21.15.32:0/1863297991 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7fa368009510 con 0x7fa3701549f0 2024-01-19T04:18:23.751 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:23.751 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:23.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa348066500 msgr2=0x7fa3480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa348066500 0x7fa3480689c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa360001670 tx=0x7fa360009040 comp rx=0 tx=0).stop 2024-01-19T04:18:23.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 msgr2=0x7fa3701f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa3701f0c00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa368009e50 tx=0x7fa368019720 comp rx=0 tx=0).stop 2024-01-19T04:18:23.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 shutdown_connections 2024-01-19T04:18:23.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa348066500 0x7fa3480689c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3701549f0 0x7fa3701f0c00 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa37014ebb0 0x7fa3701ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 --2- 172.21.15.32:0/1863297991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa3700c28c0 0x7fa370071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 >> 172.21.15.32:0/1863297991 conn(0x7fa3700a88e0 msgr2=0x7fa37006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:23.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 shutdown_connections 2024-01-19T04:18:23.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.747+0000 7fa377400640 1 -- 172.21.15.32:0/1863297991 wait complete. 2024-01-19T04:18:23.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:17:47.021907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:17:48.211408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:18:00.535616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:18:01.296998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:18:23.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:18:23.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fd6000640 1 Processor -- start 2024-01-19T04:18:23.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fd6000640 1 -- start start 2024-01-19T04:18:23.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fd6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1fd00c2520 0x7f1fd0152340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fd6000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd00aa6a0 con 0x7f1fd006a6a0 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fd6000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd006b790 con 0x7f1fd00c2900 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fd6000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00c2d10 con 0x7f1fd00c2520 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fcf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1fd00c2520 0x7f1fd0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fcea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1fd006a6a0 0x7f1fd00a8540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42900/0 (socket says 172.21.15.32:42900) 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fcea00640 1 -- 172.21.15.32:0/1834411637 learned_addr learned my addr 172.21.15.32:0/1834411637 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fcf400640 1 -- 172.21.15.32:0/1834411637 >> v1:172.21.15.67:6789/0 conn(0x7f1fd00c2900 legacy=0x7f1fd00a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fcf400640 1 -- 172.21.15.32:0/1834411637 >> v1:172.21.15.32:6789/0 conn(0x7f1fd006a6a0 legacy=0x7f1fd00a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.915+0000 7f1fcf400640 1 -- 172.21.15.32:0/1834411637 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd006ab80 con 0x7f1fd00c2520 2024-01-19T04:18:23.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fcf400640 1 --2- 172.21.15.32:0/1834411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0152340 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00097c0 tx=0x7f1fc001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66e001ce5dd55a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fce000640 1 -- 172.21.15.32:0/1834411637 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00ac620 con 0x7f1fd00c2520 2024-01-19T04:18:23.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fce000640 1 -- 172.21.15.32:0/1834411637 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00ac780 con 0x7f1fd00c2520 2024-01-19T04:18:23.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fce000640 1 -- 172.21.15.32:0/1834411637 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00acb10 con 0x7f1fd00c2520 2024-01-19T04:18:23.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fd6000640 1 -- 172.21.15.32:0/1834411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 msgr2=0x7f1fd0152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fd6000640 1 --2- 172.21.15.32:0/1834411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0152340 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00097c0 tx=0x7f1fc001c3c0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fd6000640 1 -- 172.21.15.32:0/1834411637 shutdown_connections 2024-01-19T04:18:23.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fd6000640 1 --2- 172.21.15.32:0/1834411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0152340 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fd6000640 1 -- 172.21.15.32:0/1834411637 >> 172.21.15.32:0/1834411637 conn(0x7f1fd00c7390 msgr2=0x7f1fd00c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:23.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fd6000640 1 -- 172.21.15.32:0/1834411637 shutdown_connections 2024-01-19T04:18:23.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.919+0000 7f1fd6000640 1 -- 172.21.15.32:0/1834411637 wait complete. 2024-01-19T04:18:23.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 Processor -- start 2024-01-19T04:18:23.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 -- start start 2024-01-19T04:18:23.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fd006a6a0 0x7f1fd0148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1fd00c2900 0x7f1fd0141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0151a60 con 0x7f1fd00c2520 2024-01-19T04:18:23.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd014a330 con 0x7f1fd006a6a0 2024-01-19T04:18:23.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0151e80 con 0x7f1fd00c2900 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55036/0 (socket says 172.21.15.32:55036) 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 -- 172.21.15.32:0/3226578496 learned_addr learned my addr 172.21.15.32:0/3226578496 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcf400640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fd006a6a0 0x7f1fd0148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd4a00640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1fd00c2900 0x7f1fd0141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 -- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1fd00c2900 msgr2=0x7f1fd0141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1fd00c2900 0x7f1fd0141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 -- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fd006a6a0 msgr2=0x7f1fd0148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fd006a6a0 0x7f1fd0148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 -- 172.21.15.32:0/3226578496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0009420 con 0x7f1fd00c2520 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd4a00640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1fd00c2900 0x7f1fd0141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fcea00640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0140ac0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c530 tx=0x7f1fb800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fc7400640 1 -- 172.21.15.32:0/3226578496 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8005cf0 con 0x7f1fd00c2520 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fc7400640 1 -- 172.21.15.32:0/3226578496 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb8005e50 con 0x7f1fd00c2520 2024-01-19T04:18:23.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fc7400640 1 -- 172.21.15.32:0/3226578496 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8007270 con 0x7f1fd00c2520 2024-01-19T04:18:23.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd014b420 con 0x7f1fd00c2520 2024-01-19T04:18:23.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.923+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd01513a0 con 0x7f1fd00c2520 2024-01-19T04:18:23.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.927+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0151ba0 con 0x7f1fd00c2520 2024-01-19T04:18:23.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.927+0000 7f1fc7400640 1 -- 172.21.15.32:0/3226578496 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1fb80073d0 con 0x7f1fd00c2520 2024-01-19T04:18:23.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.927+0000 7f1fc7400640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1fa8066500 0x7f1fa80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:23.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.927+0000 7f1fc7400640 1 -- 172.21.15.32:0/3226578496 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1fb8083630 con 0x7f1fd00c2520 2024-01-19T04:18:23.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.927+0000 7f1fcf400640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1fa8066500 0x7f1fa80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:23.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.927+0000 7f1fcf400640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1fa8066500 0x7f1fa80689c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00ae000 tx=0x7f1fc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:23.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:23.931+0000 7f1fc7400640 1 -- 172.21.15.32:0/3226578496 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1fd0151ba0 con 0x7f1fd00c2520 2024-01-19T04:18:24.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.091+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fd0151ba0 con 0x7f1fd00c2520 2024-01-19T04:18:24.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fc7400640 1 -- 172.21.15.32:0/3226578496 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fd0151ba0 con 0x7f1fd00c2520 2024-01-19T04:18:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1fa8066500 msgr2=0x7f1fa80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1fa8066500 0x7f1fa80689c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00ae000 tx=0x7f1fc0008040 comp rx=0 tx=0).stop 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 msgr2=0x7f1fd0140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0140ac0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c530 tx=0x7f1fb800c9f0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 shutdown_connections 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1fa8066500 0x7f1fa80689c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1fd00c2900 0x7f1fd0141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00c2520 0x7f1fd0140ac0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 --2- 172.21.15.32:0/3226578496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fd006a6a0 0x7f1fd0148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 >> 172.21.15.32:0/3226578496 conn(0x7f1fd00c7390 msgr2=0x7f1fd0071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:24.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 shutdown_connections 2024-01-19T04:18:24.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.095+0000 7f1fd6000640 1 -- 172.21.15.32:0/3226578496 wait complete. 2024-01-19T04:18:24.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:18:24.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea7a00640 1 Processor -- start 2024-01-19T04:18:24.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea7a00640 1 -- start start 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea7a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea7a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4ea00705b0 0x7f4ea015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea7a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea00c0eb0 con 0x7f4ea00c55d0 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea7a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea006e5c0 con 0x7f4ea00705b0 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea7a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea00a5330 con 0x7f4ea006cab0 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4e9fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4ea00c55d0 0x7f4ea00c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42902/0 (socket says 172.21.15.32:42902) 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4e9fe00640 1 -- 172.21.15.32:0/1303164708 learned_addr learned my addr 172.21.15.32:0/1303164708 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea5000640 1 --2- 172.21.15.32:0/1303164708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4ea5a00640 1 --2- 172.21.15.32:0/1303164708 >> v2:172.21.15.67:3300/0 conn(0x7f4ea00705b0 0x7f4ea015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4e9f400640 1 -- 172.21.15.32:0/1303164708 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702343912 0 0) 0x7f4ea00c0eb0 con 0x7f4ea00c55d0 2024-01-19T04:18:24.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.259+0000 7f4e9f400640 1 -- 172.21.15.32:0/1303164708 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e80003530 con 0x7f4ea00c55d0 2024-01-19T04:18:24.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea5000640 1 -- 172.21.15.32:0/1303164708 >> v2:172.21.15.67:3300/0 conn(0x7f4ea00705b0 msgr2=0x7f4ea015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:24.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea5000640 1 --2- 172.21.15.32:0/1303164708 >> v2:172.21.15.67:3300/0 conn(0x7f4ea00705b0 0x7f4ea015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea5000640 1 -- 172.21.15.32:0/1303164708 >> v1:172.21.15.32:6789/0 conn(0x7f4ea00c55d0 legacy=0x7f4ea00c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea5000640 1 -- 172.21.15.32:0/1303164708 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea01516f0 con 0x7f4ea006cab0 2024-01-19T04:18:24.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea5a00640 1 --2- 172.21.15.32:0/1303164708 >> v2:172.21.15.67:3300/0 conn(0x7f4ea00705b0 0x7f4ea015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:24.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea5000640 1 --2- 172.21.15.32:0/1303164708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea006ce90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097c0 tx=0x7f4e9001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b5685fc8d94445d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4e9f400640 1 -- 172.21.15.32:0/1303164708 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e900ab600 con 0x7f4ea006cab0 2024-01-19T04:18:24.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4e9f400640 1 -- 172.21.15.32:0/1303164708 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e900a7050 con 0x7f4ea006cab0 2024-01-19T04:18:24.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4e9f400640 1 -- 172.21.15.32:0/1303164708 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e900ab960 con 0x7f4ea006cab0 2024-01-19T04:18:24.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1303164708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 msgr2=0x7f4ea006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.263+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1303164708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea006ce90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097c0 tx=0x7f4e9001c450 comp rx=0 tx=0).stop 2024-01-19T04:18:24.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1303164708 shutdown_connections 2024-01-19T04:18:24.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1303164708 >> v2:172.21.15.67:3300/0 conn(0x7f4ea00705b0 0x7f4ea015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1303164708 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea006ce90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1303164708 >> 172.21.15.32:0/1303164708 conn(0x7f4ea00c25a0 msgr2=0x7f4ea00c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:24.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1303164708 shutdown_connections 2024-01-19T04:18:24.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1303164708 wait complete. 2024-01-19T04:18:24.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 Processor -- start 2024-01-19T04:18:24.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- start start 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ea00705b0 0x7f4ea014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea00c55d0 0x7f4ea0148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea00a9470 con 0x7f4ea00705b0 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea014a170 con 0x7f4ea00c55d0 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea7a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea014a450 con 0x7f4ea006cab0 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ea00705b0 0x7f4ea014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ea00705b0 0x7f4ea014aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55050/0 (socket says 172.21.15.32:55050) 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 -- 172.21.15.32:0/1658499778 learned_addr learned my addr 172.21.15.32:0/1658499778 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea5000640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea5a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea00c55d0 0x7f4ea0148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 -- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 msgr2=0x7f4ea014bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea014bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 -- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea00c55d0 msgr2=0x7f4ea0148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea00c55d0 0x7f4ea0148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 -- 172.21.15.32:0/1658499778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98009a70 con 0x7f4ea00705b0 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4ea5a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea00c55d0 0x7f4ea0148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.267+0000 7f4e9fe00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ea00705b0 0x7f4ea014aaa0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c3c0 tx=0x7f4e8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4e9cc00640 1 -- 172.21.15.32:0/1658499778 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88005cf0 con 0x7f4ea00705b0 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4e9cc00640 1 -- 172.21.15.32:0/1658499778 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e88005e50 con 0x7f4ea00705b0 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4e9cc00640 1 -- 172.21.15.32:0/1658499778 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e880072f0 con 0x7f4ea00705b0 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e90009420 con 0x7f4ea00705b0 2024-01-19T04:18:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea014c090 con 0x7f4ea00705b0 2024-01-19T04:18:24.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea00a8f60 con 0x7f4ea00705b0 2024-01-19T04:18:24.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4e9cc00640 1 -- 172.21.15.32:0/1658499778 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4e88007450 con 0x7f4ea00705b0 2024-01-19T04:18:24.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4e9cc00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4e78066530 0x7f4e780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4e9cc00640 1 -- 172.21.15.32:0/1658499778 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e880836d0 con 0x7f4ea00705b0 2024-01-19T04:18:24.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.271+0000 7f4ea5000640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4e78066530 0x7f4e780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.275+0000 7f4ea5000640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4e78066530 0x7f4e780689f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00a8810 tx=0x7f4e900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.275+0000 7f4e9cc00640 1 -- 172.21.15.32:0/1658499778 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4ea00a8f60 con 0x7f4ea00705b0 2024-01-19T04:18:24.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ea00a8f60 con 0x7f4ea00705b0 2024-01-19T04:18:24.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4e9cc00640 1 -- 172.21.15.32:0/1658499778 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e88017020 con 0x7f4ea00705b0 2024-01-19T04:18:24.443 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4e78066530 msgr2=0x7f4e780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4e78066530 0x7f4e780689f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00a8810 tx=0x7f4e900a6000 comp rx=0 tx=0).stop 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ea00705b0 msgr2=0x7f4ea014aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ea00705b0 0x7f4ea014aaa0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c3c0 tx=0x7f4e8800c880 comp rx=0 tx=0).stop 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 shutdown_connections 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4e78066530 0x7f4e780689f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea00c55d0 0x7f4ea0148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ea00705b0 0x7f4ea014aaa0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 --2- 172.21.15.32:0/1658499778 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f4ea006cab0 0x7f4ea014bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 >> 172.21.15.32:0/1658499778 conn(0x7f4ea00c25a0 msgr2=0x7f4ea00c4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:24.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 shutdown_connections 2024-01-19T04:18:24.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.439+0000 7f4ea7a00640 1 -- 172.21.15.32:0/1658499778 wait complete. 2024-01-19T04:18:24.465 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:18:24.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.603+0000 7f67e0800640 1 Processor -- start 2024-01-19T04:18:24.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.603+0000 7f67e0800640 1 -- start start 2024-01-19T04:18:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.603+0000 7f67e0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80c2080 0x7f67d8155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67e0800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67d806d440 0x7f67d80c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67e0800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d80a4ea0 con 0x7f67d80723b0 2024-01-19T04:18:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67e0800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d81524a0 con 0x7f67d806d440 2024-01-19T04:18:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67e0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d8152a20 con 0x7f67d80c2080 2024-01-19T04:18:24.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67de800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67d806d440 0x7f67d80c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67dde00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f67d80723b0 0x7f67d8152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42918/0 (socket says 172.21.15.32:42918) 2024-01-19T04:18:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67dde00640 1 -- 172.21.15.32:0/3115039976 learned_addr learned my addr 172.21.15.32:0/3115039976 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67dd400640 1 --2- 172.21.15.32:0/3115039976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80c2080 0x7f67d8155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67de800640 1 -- 172.21.15.32:0/3115039976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80c2080 msgr2=0x7f67d8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:24.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67de800640 1 --2- 172.21.15.32:0/3115039976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80c2080 0x7f67d8155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67de800640 1 -- 172.21.15.32:0/3115039976 >> v1:172.21.15.32:6789/0 conn(0x7f67d80723b0 legacy=0x7f67d8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67de800640 1 -- 172.21.15.32:0/3115039976 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d80c3430 con 0x7f67d806d440 2024-01-19T04:18:24.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67dd400640 1 --2- 172.21.15.32:0/3115039976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80c2080 0x7f67d8155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:24.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67de800640 1 --2- 172.21.15.32:0/3115039976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d80c4e50 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009d90 tx=0x7f67d001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e81ab87cc6e789 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67dca00640 1 -- 172.21.15.32:0/3115039976 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00a57d0 con 0x7f67d806d440 2024-01-19T04:18:24.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67dca00640 1 -- 172.21.15.32:0/3115039976 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d00a5930 con 0x7f67d806d440 2024-01-19T04:18:24.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.607+0000 7f67dca00640 1 -- 172.21.15.32:0/3115039976 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00a5cc0 con 0x7f67d806d440 2024-01-19T04:18:24.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- 172.21.15.32:0/3115039976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 msgr2=0x7f67d80c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 --2- 172.21.15.32:0/3115039976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d80c4e50 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009d90 tx=0x7f67d001c800 comp rx=0 tx=0).stop 2024-01-19T04:18:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- 172.21.15.32:0/3115039976 shutdown_connections 2024-01-19T04:18:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 --2- 172.21.15.32:0/3115039976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d80c4e50 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 --2- 172.21.15.32:0/3115039976 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80c2080 0x7f67d8155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- 172.21.15.32:0/3115039976 >> 172.21.15.32:0/3115039976 conn(0x7f67d80c25a0 msgr2=0x7f67d80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:24.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- 172.21.15.32:0/3115039976 shutdown_connections 2024-01-19T04:18:24.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- 172.21.15.32:0/3115039976 wait complete. 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 Processor -- start 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- start start 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d81ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80723b0 0x7f67d8143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d80c2080 0x7f67d80beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d8071e70 con 0x7f67d806d440 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d81ed6a0 con 0x7f67d80c2080 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67e0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d81ed980 con 0x7f67d80723b0 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67dde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d81ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67dd400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80723b0 0x7f67d8143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67dde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d81ecde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55064/0 (socket says 172.21.15.32:55064) 2024-01-19T04:18:24.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67dde00640 1 -- 172.21.15.32:0/386229260 learned_addr learned my addr 172.21.15.32:0/386229260 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.611+0000 7f67de800640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d80c2080 0x7f67d80beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67dde00640 1 -- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80723b0 msgr2=0x7f67d8143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67dde00640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80723b0 0x7f67d8143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67dde00640 1 -- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d80c2080 msgr2=0x7f67d80beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67dde00640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d80c2080 0x7f67d80beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67dde00640 1 -- 172.21.15.32:0/386229260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d0009a70 con 0x7f67d806d440 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67dde00640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d81ecde0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f67c800c370 tx=0x7f67c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67d6000640 1 -- 172.21.15.32:0/386229260 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8005cf0 con 0x7f67d806d440 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67d6000640 1 -- 172.21.15.32:0/386229260 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c8005e50 con 0x7f67d806d440 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d81edc60 con 0x7f67d806d440 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67d6000640 1 -- 172.21.15.32:0/386229260 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c80072f0 con 0x7f67d806d440 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d8070220 con 0x7f67d806d440 2024-01-19T04:18:24.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d80749f0 con 0x7f67d806d440 2024-01-19T04:18:24.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67d6000640 1 -- 172.21.15.32:0/386229260 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f67c8007450 con 0x7f67d806d440 2024-01-19T04:18:24.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67d6000640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f67b0066500 0x7f67b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.615+0000 7f67d6000640 1 -- 172.21.15.32:0/386229260 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f67c80836a0 con 0x7f67d806d440 2024-01-19T04:18:24.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.619+0000 7f67dd400640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f67b0066500 0x7f67b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.619+0000 7f67dd400640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f67b0066500 0x7f67b00689c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f67d81eac20 tx=0x7f67c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.619+0000 7f67d6000640 1 -- 172.21.15.32:0/386229260 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f67c8050680 con 0x7f67d806d440 2024-01-19T04:18:24.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67d80a7630 con 0x7f67d806d440 2024-01-19T04:18:24.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67d6000640 1 -- 172.21.15.32:0/386229260 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67c8053ca0 con 0x7f67d806d440 2024-01-19T04:18:24.791 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f67b0066500 msgr2=0x7f67b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f67b0066500 0x7f67b00689c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f67d81eac20 tx=0x7f67c0008040 comp rx=0 tx=0).stop 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 msgr2=0x7f67d81ecde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d81ecde0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f67c800c370 tx=0x7f67c800c830 comp rx=0 tx=0).stop 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 shutdown_connections 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f67b0066500 0x7f67b00689c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67d80c2080 0x7f67d80beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f67d80723b0 0x7f67d8143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 --2- 172.21.15.32:0/386229260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d806d440 0x7f67d81ecde0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 >> 172.21.15.32:0/386229260 conn(0x7f67d80c25a0 msgr2=0x7f67d8150fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:24.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 shutdown_connections 2024-01-19T04:18:24.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.787+0000 7f67e0800640 1 -- 172.21.15.32:0/386229260 wait complete. 2024-01-19T04:18:24.813 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:18:24.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b9600640 1 Processor -- start 2024-01-19T04:18:24.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b9600640 1 -- start start 2024-01-19T04:18:24.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b9600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61b40723b0 0x7f61b4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b9600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b9600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b40a4ea0 con 0x7f61b406d440 2024-01-19T04:18:24.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b9600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b41524a0 con 0x7f61b40723b0 2024-01-19T04:18:24.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b9600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4152a20 con 0x7f61b40c2080 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b4155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:50376/0 (socket says 172.21.15.32:50376) 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2000640 1 -- 172.21.15.32:0/3344098269 learned_addr learned my addr 172.21.15.32:0/3344098269 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2a00640 1 --2- 172.21.15.32:0/3344098269 >> v2:172.21.15.67:3300/0 conn(0x7f61b40723b0 0x7f61b4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b1600640 1 -- 172.21.15.32:0/3344098269 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725235636 0 0) 0x7f61b40a4ea0 con 0x7f61b406d440 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2000640 1 -- 172.21.15.32:0/3344098269 >> v2:172.21.15.67:3300/0 conn(0x7f61b40723b0 msgr2=0x7f61b4152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2000640 1 --2- 172.21.15.32:0/3344098269 >> v2:172.21.15.67:3300/0 conn(0x7f61b40723b0 0x7f61b4152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2000640 1 -- 172.21.15.32:0/3344098269 >> v1:172.21.15.67:6789/0 conn(0x7f61b406d440 legacy=0x7f61b40c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2000640 1 -- 172.21.15.32:0/3344098269 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b41533f0 con 0x7f61b40c2080 2024-01-19T04:18:24.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.955+0000 7f61b2a00640 1 --2- 172.21.15.32:0/3344098269 >> v2:172.21.15.67:3300/0 conn(0x7f61b40723b0 0x7f61b4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:24.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b2000640 1 --2- 172.21.15.32:0/3344098269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b4155a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f619c009870 tx=0x7f619c01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27319af1b6a3dc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b1600640 1 -- 172.21.15.32:0/3344098269 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0ab620 con 0x7f61b40c2080 2024-01-19T04:18:24.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b1600640 1 -- 172.21.15.32:0/3344098269 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c0ab780 con 0x7f61b40c2080 2024-01-19T04:18:24.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b1600640 1 -- 172.21.15.32:0/3344098269 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0abb10 con 0x7f61b40c2080 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 -- 172.21.15.32:0/3344098269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 msgr2=0x7f61b4155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 --2- 172.21.15.32:0/3344098269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b4155a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f619c009870 tx=0x7f619c01c420 comp rx=0 tx=0).stop 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 -- 172.21.15.32:0/3344098269 shutdown_connections 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 --2- 172.21.15.32:0/3344098269 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b4155a90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 --2- 172.21.15.32:0/3344098269 >> v2:172.21.15.67:3300/0 conn(0x7f61b40723b0 0x7f61b4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 -- 172.21.15.32:0/3344098269 >> 172.21.15.32:0/3344098269 conn(0x7f61b40c25a0 msgr2=0x7f61b40c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 -- 172.21.15.32:0/3344098269 shutdown_connections 2024-01-19T04:18:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.959+0000 7f61b9600640 1 -- 172.21.15.32:0/3344098269 wait complete. 2024-01-19T04:18:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 Processor -- start 2024-01-19T04:18:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 -- start start 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b406d440 0x7f61b40aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b40723b0 0x7f61b40a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b41ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40ab790 con 0x7f61b40723b0 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41ecf80 con 0x7f61b406d440 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40aaef0 con 0x7f61b40c2080 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b40723b0 0x7f61b40a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b40723b0 0x7f61b40a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55076/0 (socket says 172.21.15.32:55076) 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 -- 172.21.15.32:0/2464901568 learned_addr learned my addr 172.21.15.32:0/2464901568 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2a00640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b406d440 0x7f61b40aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b3400640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b41ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 -- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 msgr2=0x7f61b41ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b41ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 -- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b406d440 msgr2=0x7f61b40aa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b406d440 0x7f61b40aa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 -- 172.21.15.32:0/2464901568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009420 con 0x7f61b40723b0 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b2000640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b40723b0 0x7f61b40a8db0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ad040 tx=0x7f619c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61aaa00640 1 -- 172.21.15.32:0/2464901568 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0abe80 con 0x7f61b40723b0 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61aaa00640 1 -- 172.21.15.32:0/2464901568 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c0be3f0 con 0x7f61b40723b0 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61aaa00640 1 -- 172.21.15.32:0/2464901568 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0be780 con 0x7f61b40723b0 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c0094d0 con 0x7f61b40723b0 2024-01-19T04:18:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.963+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b40ab280 con 0x7f61b40723b0 2024-01-19T04:18:24.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.967+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b40749f0 con 0x7f61b40723b0 2024-01-19T04:18:24.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.967+0000 7f61aaa00640 1 -- 172.21.15.32:0/2464901568 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f619c0b43f0 con 0x7f61b40723b0 2024-01-19T04:18:24.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.967+0000 7f61aaa00640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f618c066500 0x7f618c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:24.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.967+0000 7f61aaa00640 1 -- 172.21.15.32:0/2464901568 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f619c11ea70 con 0x7f61b40723b0 2024-01-19T04:18:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.967+0000 7f61b2a00640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f618c066500 0x7f618c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.967+0000 7f61b2a00640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f618c066500 0x7f618c0689c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c50 tx=0x7f61a4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:24.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:24.971+0000 7f61aaa00640 1 -- 172.21.15.32:0/2464901568 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f619c0eb9c0 con 0x7f61b40723b0 2024-01-19T04:18:25.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61b40c1700 con 0x7f61b40723b0 2024-01-19T04:18:25.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61aaa00640 1 -- 172.21.15.32:0/2464901568 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7f619c0eefe0 con 0x7f61b40723b0 2024-01-19T04:18:25.135 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f618c066500 msgr2=0x7f618c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f618c066500 0x7f618c0689c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c50 tx=0x7f61a4009190 comp rx=0 tx=0).stop 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b40723b0 msgr2=0x7f61b40a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b40723b0 0x7f61b40a8db0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ad040 tx=0x7f619c01ac60 comp rx=0 tx=0).stop 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 shutdown_connections 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f618c066500 0x7f618c0689c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61b40c2080 0x7f61b41ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b40723b0 0x7f61b40a8db0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 --2- 172.21.15.32:0/2464901568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61b406d440 0x7f61b40aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 >> 172.21.15.32:0/2464901568 conn(0x7f61b40c25a0 msgr2=0x7f61b40a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:25.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 shutdown_connections 2024-01-19T04:18:25.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.131+0000 7f61b9600640 1 -- 172.21.15.32:0/2464901568 wait complete. 2024-01-19T04:18:25.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:18:25.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.295+0000 7faf82600640 1 Processor -- start 2024-01-19T04:18:25.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.295+0000 7faf82600640 1 -- start start 2024-01-19T04:18:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf82600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf7c06cab0 0x7faf7c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf82600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf82600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0c0eb0 con 0x7faf7c0c55d0 2024-01-19T04:18:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf82600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c06e5c0 con 0x7faf7c06cab0 2024-01-19T04:18:25.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf82600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0a5330 con 0x7faf7c0705b0 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf7c06cab0 0x7faf7c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faf7c0c55d0 0x7faf7c0c04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42928/0 (socket says 172.21.15.32:42928) 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7aa00640 1 -- 172.21.15.32:0/3248144767 learned_addr learned my addr 172.21.15.32:0/3248144767 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf7c06cab0 0x7faf7c06ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55092/0 (socket says 172.21.15.32:55092) 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7be00640 1 --2- 172.21.15.32:0/3248144767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7b400640 1 -- 172.21.15.32:0/3248144767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 msgr2=0x7faf7c15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7b400640 1 --2- 172.21.15.32:0/3248144767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7b400640 1 -- 172.21.15.32:0/3248144767 >> v1:172.21.15.32:6789/0 conn(0x7faf7c0c55d0 legacy=0x7faf7c0c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7b400640 1 -- 172.21.15.32:0/3248144767 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c1516f0 con 0x7faf7c06cab0 2024-01-19T04:18:25.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.299+0000 7faf7a000640 1 -- 172.21.15.32:0/3248144767 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617439626 0 0) 0x7faf7c0c0eb0 con 0x7faf7c0c55d0 2024-01-19T04:18:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf7b400640 1 --2- 172.21.15.32:0/3248144767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c06ce90 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00a960 tx=0x7faf6c01d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fc170c86addb84 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf7a000640 1 -- 172.21.15.32:0/3248144767 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0a68d0 con 0x7faf7c06cab0 2024-01-19T04:18:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf7a000640 1 -- 172.21.15.32:0/3248144767 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c0a6a30 con 0x7faf7c06cab0 2024-01-19T04:18:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf7a000640 1 -- 172.21.15.32:0/3248144767 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0a6dc0 con 0x7faf7c06cab0 2024-01-19T04:18:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 -- 172.21.15.32:0/3248144767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 msgr2=0x7faf7c06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 --2- 172.21.15.32:0/3248144767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c06ce90 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00a960 tx=0x7faf6c01d820 comp rx=0 tx=0).stop 2024-01-19T04:18:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 -- 172.21.15.32:0/3248144767 shutdown_connections 2024-01-19T04:18:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 --2- 172.21.15.32:0/3248144767 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 --2- 172.21.15.32:0/3248144767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c06ce90 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 -- 172.21.15.32:0/3248144767 >> 172.21.15.32:0/3248144767 conn(0x7faf7c0c25a0 msgr2=0x7faf7c0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 -- 172.21.15.32:0/3248144767 shutdown_connections 2024-01-19T04:18:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 -- 172.21.15.32:0/3248144767 wait complete. 2024-01-19T04:18:25.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 Processor -- start 2024-01-19T04:18:25.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.303+0000 7faf82600640 1 -- start start 2024-01-19T04:18:25.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c0beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c1f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf7c0c55d0 0x7faf7c1f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0a9130 con 0x7faf7c06cab0 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c1f0d60 con 0x7faf7c0c55d0 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0a8980 con 0x7faf7c0705b0 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c0beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c0beed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55094/0 (socket says 172.21.15.32:55094) 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 -- 172.21.15.32:0/1966899338 learned_addr learned my addr 172.21.15.32:0/1966899338 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7aa00640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c1f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7be00640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf7c0c55d0 0x7faf7c1f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 -- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 msgr2=0x7faf7c1f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c1f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 -- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf7c0c55d0 msgr2=0x7faf7c1f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf7c0c55d0 0x7faf7c1f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 -- 172.21.15.32:0/1966899338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c00a5c0 con 0x7faf7c06cab0 2024-01-19T04:18:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7aa00640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c1f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7be00640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf7c0c55d0 0x7faf7c1f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf7b400640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c0beed0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0b1040 tx=0x7faf6c01a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf73400640 1 -- 172.21.15.32:0/1966899338 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c004220 con 0x7faf7c06cab0 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf73400640 1 -- 172.21.15.32:0/1966899338 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c004380 con 0x7faf7c06cab0 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf73400640 1 -- 172.21.15.32:0/1966899338 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0b9870 con 0x7faf7c06cab0 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c0a8c20 con 0x7faf7c06cab0 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c14a780 con 0x7faf7c06cab0 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c0749f0 con 0x7faf7c06cab0 2024-01-19T04:18:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.307+0000 7faf73400640 1 -- 172.21.15.32:0/1966899338 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faf6c0b5040 con 0x7faf7c06cab0 2024-01-19T04:18:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.311+0000 7faf73400640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf54066530 0x7faf540689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.311+0000 7faf73400640 1 -- 172.21.15.32:0/1966899338 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faf6c11e9e0 con 0x7faf7c06cab0 2024-01-19T04:18:25.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.311+0000 7faf7aa00640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf54066530 0x7faf540689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.311+0000 7faf7aa00640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf54066530 0x7faf540689f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faf64007fd0 tx=0x7faf64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:25.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.315+0000 7faf73400640 1 -- 172.21.15.32:0/1966899338 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faf6c0ebad0 con 0x7faf7c06cab0 2024-01-19T04:18:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.475+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7faf7c0a6860 con 0x7faf7c06cab0 2024-01-19T04:18:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.475+0000 7faf73400640 1 -- 172.21.15.32:0/1966899338 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7faf6c0044f0 con 0x7faf7c06cab0 2024-01-19T04:18:25.480 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.475+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf54066530 msgr2=0x7faf540689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.475+0000 7faf82600640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf54066530 0x7faf540689f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faf64007fd0 tx=0x7faf64009040 comp rx=0 tx=0).stop 2024-01-19T04:18:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.475+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 msgr2=0x7faf7c0beed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.475+0000 7faf82600640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c0beed0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0b1040 tx=0x7faf6c01a5c0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 shutdown_connections 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faf54066530 0x7faf540689f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf7c0c55d0 0x7faf7c1f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7faf7c0705b0 0x7faf7c1f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 --2- 172.21.15.32:0/1966899338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf7c06cab0 0x7faf7c0beed0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 >> 172.21.15.32:0/1966899338 conn(0x7faf7c0c25a0 msgr2=0x7faf7c0a5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 shutdown_connections 2024-01-19T04:18:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.479+0000 7faf82600640 1 -- 172.21.15.32:0/1966899338 wait complete. 2024-01-19T04:18:25.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T04:18:25.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.639+0000 7f5d50800640 1 Processor -- start 2024-01-19T04:18:25.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.639+0000 7f5d50800640 1 -- start start 2024-01-19T04:18:25.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d50800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d480c6d70 0x7f5d480c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d50800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4806ed70 con 0x7f5d480c3900 2024-01-19T04:18:25.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d50800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4806e400 con 0x7f5d48155500 2024-01-19T04:18:25.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d50800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d480c7340 con 0x7f5d480c6d70 2024-01-19T04:18:25.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4e800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5d480c3900 0x7f5d480c46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42934/0 (socket says 172.21.15.32:42934) 2024-01-19T04:18:25.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4e800640 1 -- 172.21.15.32:0/1251118648 learned_addr learned my addr 172.21.15.32:0/1251118648 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:25.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4d400640 1 --2- 172.21.15.32:0/1251118648 >> v2:172.21.15.67:3300/0 conn(0x7f5d480c6d70 0x7f5d480c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608804857 0 0) 0x7f5d4806ed70 con 0x7f5d480c3900 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d28003530 con 0x7f5d480c3900 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017436596 0 0) 0x7f5d4806e400 con 0x7f5d48155500 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d4806ed70 con 0x7f5d48155500 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2604453204 0 0) 0x7f5d28003530 con 0x7f5d480c3900 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 >> v2:172.21.15.67:3300/0 conn(0x7f5d480c6d70 msgr2=0x7f5d480c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 --2- 172.21.15.32:0/1251118648 >> v2:172.21.15.67:3300/0 conn(0x7f5d480c6d70 0x7f5d480c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 >> v1:172.21.15.67:6789/0 conn(0x7f5d48155500 legacy=0x7f5d480c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4806efc0 con 0x7f5d480c3900 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f5d40001a00 con 0x7f5d480c3900 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 >> v1:172.21.15.32:6789/0 conn(0x7f5d480c3900 legacy=0x7f5d480c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d28003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d280047d0 0x7f5d28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d28005190 0x7f5d2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480c7340 con 0x7f5d28003b10 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2800c0c0 con 0x7f5d280047d0 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2800c280 con 0x7f5d28005190 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4de00640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d28003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4d400640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d280047d0 0x7f5d28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4e800640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d28005190 0x7f5d2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4de00640 1 -- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d28005190 msgr2=0x7f5d2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4de00640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d28005190 0x7f5d2800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4de00640 1 -- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d280047d0 msgr2=0x7f5d28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4de00640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d280047d0 0x7f5d28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4de00640 1 -- 172.21.15.32:0/1251118648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28003530 con 0x7f5d28003b10 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4d400640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d280047d0 0x7f5d28004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:25.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.643+0000 7f5d4e800640 1 -- 172.21.15.32:0/1251118648 reap_dead start 2024-01-19T04:18:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d4de00640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d28003f10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5d380018d0 tx=0x7f5d3801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aba1ef777db8fb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380050d0 con 0x7f5d28003b10 2024-01-19T04:18:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38005250 con 0x7f5d28003b10 2024-01-19T04:18:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d4ca00640 1 -- 172.21.15.32:0/1251118648 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38003600 con 0x7f5d28003b10 2024-01-19T04:18:25.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 -- 172.21.15.32:0/1251118648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 msgr2=0x7f5d28003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d28003f10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5d380018d0 tx=0x7f5d3801c530 comp rx=0 tx=0).stop 2024-01-19T04:18:25.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 -- 172.21.15.32:0/1251118648 shutdown_connections 2024-01-19T04:18:25.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 --2- 172.21.15.32:0/1251118648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d28003f10 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 -- 172.21.15.32:0/1251118648 >> 172.21.15.32:0/1251118648 conn(0x7f5d480726d0 msgr2=0x7f5d480663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:25.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 -- 172.21.15.32:0/1251118648 shutdown_connections 2024-01-19T04:18:25.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 -- 172.21.15.32:0/1251118648 wait complete. 2024-01-19T04:18:25.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 Processor -- start 2024-01-19T04:18:25.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.647+0000 7f5d50800640 1 -- start start 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d4806d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d480c13d0 0x7f5d480ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d480ab8d0 0x7f5d481defb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480aaf00 con 0x7f5d28003b10 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4806c620 con 0x7f5d480ab8d0 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480ace60 con 0x7f5d480c13d0 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d4806d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d4806d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55116/0 (socket says 172.21.15.32:55116) 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 -- 172.21.15.32:0/1320796339 learned_addr learned my addr 172.21.15.32:0/1320796339 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4e800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d480ab8d0 0x7f5d481defb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4d400640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d480c13d0 0x7f5d480ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 -- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d480c13d0 msgr2=0x7f5d480ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d480c13d0 0x7f5d480ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 -- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d480ab8d0 msgr2=0x7f5d481defb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d480ab8d0 0x7f5d481defb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 -- 172.21.15.32:0/1320796339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4806cba0 con 0x7f5d28003b10 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4d400640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d480c13d0 0x7f5d480ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4e800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d480ab8d0 0x7f5d481defb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d4de00640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d4806d3a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5d380ae040 tx=0x7f5d28005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d46000640 1 -- 172.21.15.32:0/1320796339 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380050d0 con 0x7f5d28003b10 2024-01-19T04:18:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d46000640 1 -- 172.21.15.32:0/1320796339 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38003ca0 con 0x7f5d28003b10 2024-01-19T04:18:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d481f0d20 con 0x7f5d28003b10 2024-01-19T04:18:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d46000640 1 -- 172.21.15.32:0/1320796339 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38007220 con 0x7f5d28003b10 2024-01-19T04:18:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4806c210 con 0x7f5d28003b10 2024-01-19T04:18:25.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.651+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d480749f0 con 0x7f5d28003b10 2024-01-19T04:18:25.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.655+0000 7f5d46000640 1 -- 172.21.15.32:0/1320796339 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5d380b2040 con 0x7f5d28003b10 2024-01-19T04:18:25.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.655+0000 7f5d46000640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5d20066530 0x7f5d200689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:25.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.655+0000 7f5d46000640 1 -- 172.21.15.32:0/1320796339 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5d3811d570 con 0x7f5d28003b10 2024-01-19T04:18:25.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.655+0000 7f5d4d400640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5d20066530 0x7f5d200689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:25.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.655+0000 7f5d4d400640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5d20066530 0x7f5d200689f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5d480c1d00 tx=0x7f5d30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:25.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.659+0000 7f5d46000640 1 -- 172.21.15.32:0/1320796339 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5d380ea520 con 0x7f5d28003b10 2024-01-19T04:18:25.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5d480c5e50 con 0x7f5d28003b10 2024-01-19T04:18:25.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d46000640 1 -- 172.21.15.32:0/1320796339 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5d380edb40 con 0x7f5d28003b10 2024-01-19T04:18:25.835 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5d20066530 msgr2=0x7f5d200689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5d20066530 0x7f5d200689f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5d480c1d00 tx=0x7f5d30008040 comp rx=0 tx=0).stop 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 msgr2=0x7f5d4806d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d4806d3a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5d380ae040 tx=0x7f5d28005800 comp rx=0 tx=0).stop 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 shutdown_connections 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5d20066530 0x7f5d200689f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d480ab8d0 0x7f5d481defb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5d480c13d0 0x7f5d480ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 --2- 172.21.15.32:0/1320796339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d28003b10 0x7f5d4806d3a0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 >> 172.21.15.32:0/1320796339 conn(0x7f5d480726d0 msgr2=0x7f5d481513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 shutdown_connections 2024-01-19T04:18:25.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:25.831+0000 7f5d50800640 1 -- 172.21.15.32:0/1320796339 wait complete. 2024-01-19T04:18:25.857 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2024-01-19T04:18:25.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:25.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-19T04:18:25.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:18:25.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:25.888 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-19T04:18:25.938 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T04:18:25.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:18:26.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T04:18:26.143 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T04:18:26.143 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:26.143 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:26.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:18:26.152 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:26.152 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:26.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:18:26.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:26.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.327+0000 7fb30e200640 1 Processor -- start 2024-01-19T04:18:26.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.327+0000 7fb30e200640 1 -- start start 2024-01-19T04:18:26.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb30e200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3080c04a0 0x7fb3080c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb30e200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 0x7fb3080c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb30e200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb308071e80 con 0x7fb30814fb50 2024-01-19T04:18:26.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb30e200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3081535c0 con 0x7fb3080c04a0 2024-01-19T04:18:26.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb30e200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080726c0 con 0x7fb3080a4ec0 2024-01-19T04:18:26.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb30814fb50 0x7fb30806fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42944/0 (socket says 172.21.15.32:42944) 2024-01-19T04:18:26.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307400640 1 -- 172.21.15.32:0/1813118379 learned_addr learned my addr 172.21.15.32:0/1813118379 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:26.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683434366 0 0) 0x7fb308071e80 con 0x7fb30814fb50 2024-01-19T04:18:26.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307e00640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 0x7fb3080c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e8003530 con 0x7fb30814fb50 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306a00640 1 --2- 172.21.15.32:0/1813118379 >> v2:172.21.15.67:3300/0 conn(0x7fb3080c04a0 0x7fb3080c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448625907 0 0) 0x7fb2e8003530 con 0x7fb30814fb50 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 msgr2=0x7fb3080c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 0x7fb3080c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 >> v2:172.21.15.67:3300/0 conn(0x7fb3080c04a0 msgr2=0x7fb3080c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 --2- 172.21.15.32:0/1813118379 >> v2:172.21.15.67:3300/0 conn(0x7fb3080c04a0 0x7fb3080c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3080c1cb0 con 0x7fb30814fb50 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7fb2f8001680 con 0x7fb30814fb50 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 >> v1:172.21.15.32:6789/0 conn(0x7fb30814fb50 legacy=0x7fb30806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8003980 0x7fb2e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 0x7fb2e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2e8004d10 0x7fb2e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081535c0 con 0x7fb2e8004d10 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080726c0 con 0x7fb2e8003980 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e800b990 con 0x7fb3080a4ec0 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307e00640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2e8004d10 0x7fb2e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb306a00640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 0x7fb2e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307400640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8003980 0x7fb2e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307e00640 1 -- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 msgr2=0x7fb2e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307e00640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080a4ec0 0x7fb2e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307e00640 1 -- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8003980 msgr2=0x7fb2e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307e00640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8003980 0x7fb2e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.331+0000 7fb307e00640 1 -- 172.21.15.32:0/1813118379 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8003530 con 0x7fb2e8004d10 2024-01-19T04:18:26.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb307e00640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2e8004d10 0x7fb2e8005190 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb300009fc0 tx=0x7fb30001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83e948e281f5b68 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:26.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000a5b60 con 0x7fb2e8004d10 2024-01-19T04:18:26.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30000f040 con 0x7fb2e8004d10 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb306000640 1 -- 172.21.15.32:0/1813118379 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000ad440 con 0x7fb2e8004d10 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb30e200640 1 -- 172.21.15.32:0/1813118379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2e8004d10 msgr2=0x7fb2e8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb30e200640 1 --2- 172.21.15.32:0/1813118379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2e8004d10 0x7fb2e8005190 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb300009fc0 tx=0x7fb30001cc60 comp rx=0 tx=0).stop 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb307e00640 1 -- 172.21.15.32:0/1813118379 reap_dead start 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb30e200640 1 -- 172.21.15.32:0/1813118379 shutdown_connections 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb30e200640 1 -- 172.21.15.32:0/1813118379 >> 172.21.15.32:0/1813118379 conn(0x7fb3080c5b20 msgr2=0x7fb3080c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb30e200640 1 -- 172.21.15.32:0/1813118379 shutdown_connections 2024-01-19T04:18:26.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.335+0000 7fb30e200640 1 -- 172.21.15.32:0/1813118379 wait complete. 2024-01-19T04:18:26.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 Processor -- start 2024-01-19T04:18:26.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 -- start start 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8004d10 0x7fb308149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3081ea650 0x7fb3081ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080c3b60 0x7fb30814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081e9960 con 0x7fb3081ea650 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30814a1f0 con 0x7fb2e8004d10 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081ea1c0 con 0x7fb3080c3b60 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3081ea650 0x7fb3081ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3081ea650 0x7fb3081ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55132/0 (socket says 172.21.15.32:55132) 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 -- 172.21.15.32:0/780732409 learned_addr learned my addr 172.21.15.32:0/780732409 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb307400640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8004d10 0x7fb308149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb307e00640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080c3b60 0x7fb30814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 -- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080c3b60 msgr2=0x7fb30814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080c3b60 0x7fb30814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 -- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8004d10 msgr2=0x7fb308149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8004d10 0x7fb308149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 -- 172.21.15.32:0/780732409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3081eddf0 con 0x7fb3081ea650 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb306a00640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3081ea650 0x7fb3081ed8b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0011aa0 tx=0x7fb2f0011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb2ff400640 1 -- 172.21.15.32:0/780732409 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000fa60 con 0x7fb3081ea650 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb2ff400640 1 -- 172.21.15.32:0/780732409 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000fbc0 con 0x7fb3081ea650 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb2ff400640 1 -- 172.21.15.32:0/780732409 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0014440 con 0x7fb3081ea650 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb308149f10 con 0x7fb3081ea650 2024-01-19T04:18:26.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.339+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3081e9e50 con 0x7fb3081ea650 2024-01-19T04:18:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.343+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3080749f0 con 0x7fb3081ea650 2024-01-19T04:18:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.343+0000 7fb2ff400640 1 -- 172.21.15.32:0/780732409 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb2f00145a0 con 0x7fb3081ea650 2024-01-19T04:18:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.343+0000 7fb2ff400640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb2e0066530 0x7fb2e00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.343+0000 7fb2ff400640 1 -- 172.21.15.32:0/780732409 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb2f0084a30 con 0x7fb3081ea650 2024-01-19T04:18:26.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.343+0000 7fb307400640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb2e0066530 0x7fb2e00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.343+0000 7fb307400640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb2e0066530 0x7fb2e00689f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80017b0 tx=0x7fb2f8001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:26.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.347+0000 7fb2ff400640 1 -- 172.21.15.32:0/780732409 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb2f00518d0 con 0x7fb3081ea650 2024-01-19T04:18:26.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3081ea300 con 0x7fb3081ea650 2024-01-19T04:18:26.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb2ff400640 1 -- 172.21.15.32:0/780732409 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6178 (secure 0 0 0) 0x7fb2f0022090 con 0x7fb3081ea650 2024-01-19T04:18:26.543 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:26.543 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:49.203878+0000","modified":"2024-01-19T04:17:52.248717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/208534071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":208534071},{"type":"v1","addr":"172.21.15.67:6837","nonce":208534071}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:26.543 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 52 2024-01-19T04:18:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb2e0066530 msgr2=0x7fb2e00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb2e0066530 0x7fb2e00689f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80017b0 tx=0x7fb2f8001440 comp rx=0 tx=0).stop 2024-01-19T04:18:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3081ea650 msgr2=0x7fb3081ed8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3081ea650 0x7fb3081ed8b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0011aa0 tx=0x7fb2f0011ea0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 shutdown_connections 2024-01-19T04:18:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb2e0066530 0x7fb2e00689f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb3080c3b60 0x7fb30814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3081ea650 0x7fb3081ed8b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 --2- 172.21.15.32:0/780732409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e8004d10 0x7fb308149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 >> 172.21.15.32:0/780732409 conn(0x7fb3080c5b20 msgr2=0x7fb3080bf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 shutdown_connections 2024-01-19T04:18:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.539+0000 7fb30e200640 1 -- 172.21.15.32:0/780732409 wait complete. 2024-01-19T04:18:26.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:26.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6557c00640 1 Processor -- start 2024-01-19T04:18:26.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6557c00640 1 -- start start 2024-01-19T04:18:26.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6557c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f65500a6d30 0x7f65500c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6557c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f65500c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6557c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65501533a0 con 0x7f65500c6e20 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6557c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6550156380 con 0x7f65500a6d30 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6557c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655014fe40 con 0x7f655006fda0 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6555c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f65500c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6555c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f65500c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:50472/0 (socket says 172.21.15.32:50472) 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6555c00640 1 -- 172.21.15.32:0/1348600465 learned_addr learned my addr 172.21.15.32:0/1348600465 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f654fe00640 1 --2- 172.21.15.32:0/1348600465 >> v2:172.21.15.67:3300/0 conn(0x7f65500a6d30 0x7f65500c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6555c00640 1 -- 172.21.15.32:0/1348600465 >> v2:172.21.15.67:3300/0 conn(0x7f65500a6d30 msgr2=0x7f65500c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:26.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6555c00640 1 --2- 172.21.15.32:0/1348600465 >> v2:172.21.15.67:3300/0 conn(0x7f65500a6d30 0x7f65500c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6555c00640 1 -- 172.21.15.32:0/1348600465 >> v1:172.21.15.67:6789/0 conn(0x7f65500c6e20 legacy=0x7f6550152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f654f400640 1 -- 172.21.15.32:0/1348600465 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376499389 0 0) 0x7f6540001120 con 0x7f65500c6e20 2024-01-19T04:18:26.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.703+0000 7f6555c00640 1 -- 172.21.15.32:0/1348600465 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550152800 con 0x7f655006fda0 2024-01-19T04:18:26.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.707+0000 7f6555c00640 1 --2- 172.21.15.32:0/1348600465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f65500c5b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6548009e50 tx=0x7f654801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d526410c305b9e3e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f654f400640 1 -- 172.21.15.32:0/1348600465 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480a5840 con 0x7f655006fda0 2024-01-19T04:18:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f654f400640 1 -- 172.21.15.32:0/1348600465 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65480a59a0 con 0x7f655006fda0 2024-01-19T04:18:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f654f400640 1 -- 172.21.15.32:0/1348600465 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480a5d30 con 0x7f655006fda0 2024-01-19T04:18:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 -- 172.21.15.32:0/1348600465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 msgr2=0x7f65500c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 --2- 172.21.15.32:0/1348600465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f65500c5b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6548009e50 tx=0x7f654801c980 comp rx=0 tx=0).stop 2024-01-19T04:18:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 -- 172.21.15.32:0/1348600465 shutdown_connections 2024-01-19T04:18:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 --2- 172.21.15.32:0/1348600465 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f65500c5b40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 --2- 172.21.15.32:0/1348600465 >> v2:172.21.15.67:3300/0 conn(0x7f65500a6d30 0x7f65500c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 -- 172.21.15.32:0/1348600465 >> 172.21.15.32:0/1348600465 conn(0x7f65500a9870 msgr2=0x7f65500a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 -- 172.21.15.32:0/1348600465 shutdown_connections 2024-01-19T04:18:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.711+0000 7f6557c00640 1 -- 172.21.15.32:0/1348600465 wait complete. 2024-01-19T04:18:26.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 Processor -- start 2024-01-19T04:18:26.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 -- start start 2024-01-19T04:18:26.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f655006b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500a6d30 0x7f655015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65500c6e20 0x7f6550149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65501ed380 con 0x7f65500a6d30 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65501ed660 con 0x7f65500c6e20 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655006d410 con 0x7f655006fda0 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500a6d30 0x7f655015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500a6d30 0x7f655015b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55140/0 (socket says 172.21.15.32:55140) 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 -- 172.21.15.32:0/97243075 learned_addr learned my addr 172.21.15.32:0/97243075 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6555c00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65500c6e20 0x7f6550149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6555200640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f655006b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 -- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 msgr2=0x7f655006b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f655006b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 -- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65500c6e20 msgr2=0x7f6550149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65500c6e20 0x7f6550149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 -- 172.21.15.32:0/97243075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548009b30 con 0x7f65500a6d30 2024-01-19T04:18:26.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654fe00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500a6d30 0x7f655015b340 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f653800e930 tx=0x7f653800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:26.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654cc00640 1 -- 172.21.15.32:0/97243075 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538009690 con 0x7f65500a6d30 2024-01-19T04:18:26.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654cc00640 1 -- 172.21.15.32:0/97243075 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653800ca00 con 0x7f65500a6d30 2024-01-19T04:18:26.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f654cc00640 1 -- 172.21.15.32:0/97243075 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653800cd70 con 0x7f65500a6d30 2024-01-19T04:18:26.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655006d6f0 con 0x7f65500a6d30 2024-01-19T04:18:26.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655006d0a0 con 0x7f65500a6d30 2024-01-19T04:18:26.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.715+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65500749f0 con 0x7f65500a6d30 2024-01-19T04:18:26.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.719+0000 7f654cc00640 1 -- 172.21.15.32:0/97243075 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6538013470 con 0x7f65500a6d30 2024-01-19T04:18:26.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.719+0000 7f654cc00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6528066500 0x7f65280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:26.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.719+0000 7f654cc00640 1 -- 172.21.15.32:0/97243075 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6538084440 con 0x7f65500a6d30 2024-01-19T04:18:26.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.719+0000 7f6555200640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6528066500 0x7f65280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:26.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.719+0000 7f6555200640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6528066500 0x7f65280689c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6540000f70 tx=0x7f6540009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:26.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.723+0000 7f654cc00640 1 -- 172.21.15.32:0/97243075 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6538051450 con 0x7f65500a6d30 2024-01-19T04:18:26.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.887+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65501ed4c0 con 0x7f65500a6d30 2024-01-19T04:18:26.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.887+0000 7f654cc00640 1 -- 172.21.15.32:0/97243075 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7f65501ed4c0 con 0x7f65500a6d30 2024-01-19T04:18:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:26.892 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.887+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6528066500 msgr2=0x7f65280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6528066500 0x7f65280689c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6540000f70 tx=0x7f6540009040 comp rx=0 tx=0).stop 2024-01-19T04:18:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500a6d30 msgr2=0x7f655015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500a6d30 0x7f655015b340 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f653800e930 tx=0x7f653800edf0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 shutdown_connections 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6528066500 0x7f65280689c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65500c6e20 0x7f6550149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500a6d30 0x7f655015b340 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 --2- 172.21.15.32:0/97243075 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f655006fda0 0x7f655006b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 >> 172.21.15.32:0/97243075 conn(0x7f65500a9870 msgr2=0x7f6550070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 shutdown_connections 2024-01-19T04:18:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:26.891+0000 7f6557c00640 1 -- 172.21.15.32:0/97243075 wait complete. 2024-01-19T04:18:26.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T04:17:47.021907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T04:17:48.211408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:18:00.535616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:18:01.296998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:18:26.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:18:27.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff703200640 1 Processor -- start 2024-01-19T04:18:27.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff703200640 1 -- start start 2024-01-19T04:18:27.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff703200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff6fc0c1bc0 0x7ff6fc06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff703200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc157d60 con 0x7ff6fc06fe50 2024-01-19T04:18:27.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff703200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc158040 con 0x7ff6fc0c8290 2024-01-19T04:18:27.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff703200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc158320 con 0x7ff6fc0c1bc0 2024-01-19T04:18:27.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff6fb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff6fc0c1bc0 0x7ff6fc06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff701200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff6fc06fe50 0x7ff6fc154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42946/0 (socket says 172.21.15.32:42946) 2024-01-19T04:18:27.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff701200640 1 -- 172.21.15.32:0/2254393213 learned_addr learned my addr 172.21.15.32:0/2254393213 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:27.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff6fb400640 1 -- 172.21.15.32:0/2254393213 >> v1:172.21.15.67:6789/0 conn(0x7ff6fc0c8290 legacy=0x7ff6fc0a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff6fb400640 1 -- 172.21.15.32:0/2254393213 >> v1:172.21.15.32:6789/0 conn(0x7ff6fc06fe50 legacy=0x7ff6fc154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff6fb400640 1 -- 172.21.15.32:0/2254393213 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc158600 con 0x7ff6fc0c1bc0 2024-01-19T04:18:27.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.059+0000 7ff6faa00640 1 -- 172.21.15.32:0/2254393213 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254869648 0 0) 0x7ff6fc157d60 con 0x7ff6fc06fe50 2024-01-19T04:18:27.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff6fb400640 1 --2- 172.21.15.32:0/2254393213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c1bc0 0x7ff6fc06f910 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40097f0 tx=0x7ff6e401cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d321564a96ce7a17 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff6faa00640 1 -- 172.21.15.32:0/2254393213 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40ab600 con 0x7ff6fc0c1bc0 2024-01-19T04:18:27.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff6faa00640 1 -- 172.21.15.32:0/2254393213 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e40a7050 con 0x7ff6fc0c1bc0 2024-01-19T04:18:27.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff6faa00640 1 -- 172.21.15.32:0/2254393213 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40ab980 con 0x7ff6fc0c1bc0 2024-01-19T04:18:27.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 -- 172.21.15.32:0/2254393213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c1bc0 msgr2=0x7ff6fc06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 --2- 172.21.15.32:0/2254393213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c1bc0 0x7ff6fc06f910 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40097f0 tx=0x7ff6e401cdc0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 -- 172.21.15.32:0/2254393213 shutdown_connections 2024-01-19T04:18:27.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 --2- 172.21.15.32:0/2254393213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c1bc0 0x7ff6fc06f910 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 -- 172.21.15.32:0/2254393213 >> 172.21.15.32:0/2254393213 conn(0x7ff6fc0726d0 msgr2=0x7ff6fc0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:27.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 -- 172.21.15.32:0/2254393213 shutdown_connections 2024-01-19T04:18:27.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 -- 172.21.15.32:0/2254393213 wait complete. 2024-01-19T04:18:27.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 Processor -- start 2024-01-19T04:18:27.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.063+0000 7ff703200640 1 -- start start 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6fc06fe50 0x7ff6fc1f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6fc0c1bc0 0x7ff6fc0ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c8290 0x7ff6fc151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1558d0 con 0x7ff6fc0c8290 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc157c40 con 0x7ff6fc0c1bc0 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1f10f0 con 0x7ff6fc06fe50 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c8290 0x7ff6fc151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c8290 0x7ff6fc151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55150/0 (socket says 172.21.15.32:55150) 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 -- 172.21.15.32:0/4153556689 learned_addr learned my addr 172.21.15.32:0/4153556689 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff6fb400640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6fc0c1bc0 0x7ff6fc0ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff6fbe00640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6fc06fe50 0x7ff6fc1f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 -- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6fc06fe50 msgr2=0x7ff6fc1f0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6fc06fe50 0x7ff6fc1f0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 -- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6fc0c1bc0 msgr2=0x7ff6fc0ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6fc0c1bc0 0x7ff6fc0ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 -- 172.21.15.32:0/4153556689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4009420 con 0x7ff6fc0c8290 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff701200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c8290 0x7ff6fc151060 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400c700 tx=0x7ff6f400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff6f3e00640 1 -- 172.21.15.32:0/4153556689 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400ce10 con 0x7ff6fc0c8290 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff6f3e00640 1 -- 172.21.15.32:0/4153556689 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400a640 con 0x7ff6fc0c8290 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc153d70 con 0x7ff6fc0c8290 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff6f3e00640 1 -- 172.21.15.32:0/4153556689 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400aa70 con 0x7ff6fc0c8290 2024-01-19T04:18:27.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc154330 con 0x7ff6fc0c8290 2024-01-19T04:18:27.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.067+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc155a40 con 0x7ff6fc0c8290 2024-01-19T04:18:27.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.071+0000 7ff6f3e00640 1 -- 172.21.15.32:0/4153556689 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff6f400abd0 con 0x7ff6fc0c8290 2024-01-19T04:18:27.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.071+0000 7ff6f3e00640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff6d4066500 0x7ff6d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.071+0000 7ff6f3e00640 1 -- 172.21.15.32:0/4153556689 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff6f4083a40 con 0x7ff6fc0c8290 2024-01-19T04:18:27.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.071+0000 7ff6fbe00640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff6d4066500 0x7ff6d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.071+0000 7ff6fbe00640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff6d4066500 0x7ff6d40689c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec000f70 tx=0x7ff6ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.075+0000 7ff6f3e00640 1 -- 172.21.15.32:0/4153556689 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff6f40508e0 con 0x7ff6fc0c8290 2024-01-19T04:18:27.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.235+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6fc0c17a0 con 0x7ff6fc0c8290 2024-01-19T04:18:27.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.235+0000 7ff6f3e00640 1 -- 172.21.15.32:0/4153556689 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6f40180a0 con 0x7ff6fc0c8290 2024-01-19T04:18:27.241 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:18:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff6d4066500 msgr2=0x7ff6d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff6d4066500 0x7ff6d40689c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec000f70 tx=0x7ff6ec009040 comp rx=0 tx=0).stop 2024-01-19T04:18:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c8290 msgr2=0x7ff6fc151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c8290 0x7ff6fc151060 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400c700 tx=0x7ff6f400cbc0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 shutdown_connections 2024-01-19T04:18:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff6d4066500 0x7ff6d40689c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc0c8290 0x7ff6fc151060 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6fc0c1bc0 0x7ff6fc0ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 --2- 172.21.15.32:0/4153556689 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff6fc06fe50 0x7ff6fc1f0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 >> 172.21.15.32:0/4153556689 conn(0x7ff6fc0726d0 msgr2=0x7ff6fc0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:27.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 shutdown_connections 2024-01-19T04:18:27.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.239+0000 7ff703200640 1 -- 172.21.15.32:0/4153556689 wait complete. 2024-01-19T04:18:27.263 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T04:18:27.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f5b200640 1 Processor -- start 2024-01-19T04:18:27.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f5b200640 1 -- start start 2024-01-19T04:18:27.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f5b200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1f54155150 0x7f1f54157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f5b200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f540c2d30 con 0x7f1f540c6360 2024-01-19T04:18:27.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f5b200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f540c3010 con 0x7f1f54151b80 2024-01-19T04:18:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f5b200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f540c34a0 con 0x7f1f54155150 2024-01-19T04:18:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f59200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1f540c6360 0x7f1f540c67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42954/0 (socket says 172.21.15.32:42954) 2024-01-19T04:18:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f59200640 1 -- 172.21.15.32:0/4103737763 learned_addr learned my addr 172.21.15.32:0/4103737763 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f53400640 1 --2- 172.21.15.32:0/4103737763 >> v2:172.21.15.32:3300/0 conn(0x7f1f54155150 0x7f1f54157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f52a00640 1 -- 172.21.15.32:0/4103737763 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992345066 0 0) 0x7f1f540c2d30 con 0x7f1f540c6360 2024-01-19T04:18:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f52a00640 1 -- 172.21.15.32:0/4103737763 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f34003530 con 0x7f1f540c6360 2024-01-19T04:18:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f53400640 1 -- 172.21.15.32:0/4103737763 >> v1:172.21.15.67:6789/0 conn(0x7f1f54151b80 legacy=0x7f1f540c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f52a00640 1 -- 172.21.15.32:0/4103737763 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322667598 0 0) 0x7f1f540c3010 con 0x7f1f54151b80 2024-01-19T04:18:27.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f53400640 1 -- 172.21.15.32:0/4103737763 >> v1:172.21.15.32:6789/0 conn(0x7f1f540c6360 legacy=0x7f1f540c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.403+0000 7f1f53400640 1 -- 172.21.15.32:0/4103737763 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540c7700 con 0x7f1f54155150 2024-01-19T04:18:27.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f53400640 1 --2- 172.21.15.32:0/4103737763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f54155150 0x7f1f54157cc0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0097c0 tx=0x7f1f3c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ca916240f47876 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f52a00640 1 -- 172.21.15.32:0/4103737763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0ab610 con 0x7f1f54155150 2024-01-19T04:18:27.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f52a00640 1 -- 172.21.15.32:0/4103737763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0ab770 con 0x7f1f54155150 2024-01-19T04:18:27.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f52a00640 1 -- 172.21.15.32:0/4103737763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0abb00 con 0x7f1f54155150 2024-01-19T04:18:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f5b200640 1 -- 172.21.15.32:0/4103737763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f54155150 msgr2=0x7f1f54157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f5b200640 1 --2- 172.21.15.32:0/4103737763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f54155150 0x7f1f54157cc0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0097c0 tx=0x7f1f3c01c450 comp rx=0 tx=0).stop 2024-01-19T04:18:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f5b200640 1 -- 172.21.15.32:0/4103737763 shutdown_connections 2024-01-19T04:18:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f5b200640 1 --2- 172.21.15.32:0/4103737763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f54155150 0x7f1f54157cc0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f5b200640 1 -- 172.21.15.32:0/4103737763 >> 172.21.15.32:0/4103737763 conn(0x7f1f540c7d40 msgr2=0x7f1f540c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f5b200640 1 -- 172.21.15.32:0/4103737763 shutdown_connections 2024-01-19T04:18:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.407+0000 7f1f5b200640 1 -- 172.21.15.32:0/4103737763 wait complete. 2024-01-19T04:18:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 Processor -- start 2024-01-19T04:18:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 -- start start 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f540c6360 0x7f1f5406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f54151b80 0x7f1f541535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f54155150 0x7f1f54153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54155730 con 0x7f1f540c6360 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5414c460 con 0x7f1f54155150 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5414a390 con 0x7f1f54151b80 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f540c6360 0x7f1f5406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f540c6360 0x7f1f5406e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55168/0 (socket says 172.21.15.32:55168) 2024-01-19T04:18:27.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 -- 172.21.15.32:0/1129264491 learned_addr learned my addr 172.21.15.32:0/1129264491 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:27.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53400640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f54151b80 0x7f1f541535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f59200640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f54155150 0x7f1f54153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 -- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f54151b80 msgr2=0x7f1f541535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f54151b80 0x7f1f541535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 -- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f54155150 msgr2=0x7f1f54153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f54155150 0x7f1f54153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 -- 172.21.15.32:0/1129264491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c009420 con 0x7f1f540c6360 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f53e00640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f540c6360 0x7f1f5406e720 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400c480 tx=0x7f1f4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f4be00640 1 -- 172.21.15.32:0/1129264491 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44005480 con 0x7f1f540c6360 2024-01-19T04:18:27.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f4be00640 1 -- 172.21.15.32:0/1129264491 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44003600 con 0x7f1f540c6360 2024-01-19T04:18:27.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5414a670 con 0x7f1f540c6360 2024-01-19T04:18:27.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f4be00640 1 -- 172.21.15.32:0/1129264491 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440039b0 con 0x7f1f540c6360 2024-01-19T04:18:27.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.411+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f541530d0 con 0x7f1f540c6360 2024-01-19T04:18:27.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.415+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5414ab90 con 0x7f1f540c6360 2024-01-19T04:18:27.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.415+0000 7f1f4be00640 1 -- 172.21.15.32:0/1129264491 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1f44003b10 con 0x7f1f540c6360 2024-01-19T04:18:27.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.415+0000 7f1f4be00640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1f2c066500 0x7f1f2c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.415+0000 7f1f4be00640 1 -- 172.21.15.32:0/1129264491 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1f44083bd0 con 0x7f1f540c6360 2024-01-19T04:18:27.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.415+0000 7f1f53400640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1f2c066500 0x7f1f2c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.419+0000 7f1f53400640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1f2c066500 0x7f1f2c0689c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0af000 tx=0x7f1f3c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.419+0000 7f1f4be00640 1 -- 172.21.15.32:0/1129264491 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1f44050c50 con 0x7f1f540c6360 2024-01-19T04:18:27.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f540749f0 con 0x7f1f540c6360 2024-01-19T04:18:27.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f4be00640 1 -- 172.21.15.32:0/1129264491 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f44054270 con 0x7f1f540c6360 2024-01-19T04:18:27.587 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:27.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1f2c066500 msgr2=0x7f1f2c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1f2c066500 0x7f1f2c0689c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0af000 tx=0x7f1f3c0b6040 comp rx=0 tx=0).stop 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f540c6360 msgr2=0x7f1f5406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f540c6360 0x7f1f5406e720 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400c480 tx=0x7f1f4400c940 comp rx=0 tx=0).stop 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 shutdown_connections 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f1f2c066500 0x7f1f2c0689c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f54155150 0x7f1f54153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f1f54151b80 0x7f1f541535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 --2- 172.21.15.32:0/1129264491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f540c6360 0x7f1f5406e720 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 >> 172.21.15.32:0/1129264491 conn(0x7f1f540c7d40 msgr2=0x7f1f54156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 shutdown_connections 2024-01-19T04:18:27.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.583+0000 7f1f5b200640 1 -- 172.21.15.32:0/1129264491 wait complete. 2024-01-19T04:18:27.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T04:18:27.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ef600640 1 Processor -- start 2024-01-19T04:18:27.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ef600640 1 -- start start 2024-01-19T04:18:27.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ef600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1e80c2080 0x7fb1e8155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ef600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80a4ea0 con 0x7fb1e80723b0 2024-01-19T04:18:27.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ef600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e8152a20 con 0x7fb1e806d440 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ef600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e81524a0 con 0x7fb1e80c2080 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1e7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1e80c2080 0x7fb1e8155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ecc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb1e80723b0 0x7fb1e8152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42964/0 (socket says 172.21.15.32:42964) 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.747+0000 7fb1ecc00640 1 -- 172.21.15.32:0/3187897510 learned_addr learned my addr 172.21.15.32:0/3187897510 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7e00640 1 -- 172.21.15.32:0/3187897510 >> v1:172.21.15.67:6789/0 conn(0x7fb1e806d440 legacy=0x7fb1e80c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7e00640 1 -- 172.21.15.32:0/3187897510 >> v1:172.21.15.32:6789/0 conn(0x7fb1e80723b0 legacy=0x7fb1e8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7e00640 1 -- 172.21.15.32:0/3187897510 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80c3430 con 0x7fb1e80c2080 2024-01-19T04:18:27.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7400640 1 -- 172.21.15.32:0/3187897510 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236112697 0 0) 0x7fb1e80a4ea0 con 0x7fb1e80723b0 2024-01-19T04:18:27.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7e00640 1 --2- 172.21.15.32:0/3187897510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e8155a90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00097c0 tx=0x7fb1d001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e10e9bcb89c920 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7400640 1 -- 172.21.15.32:0/3187897510 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00ab600 con 0x7fb1e80c2080 2024-01-19T04:18:27.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7400640 1 -- 172.21.15.32:0/3187897510 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d00a7050 con 0x7fb1e80c2080 2024-01-19T04:18:27.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.751+0000 7fb1e7400640 1 -- 172.21.15.32:0/3187897510 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00ab980 con 0x7fb1e80c2080 2024-01-19T04:18:27.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- 172.21.15.32:0/3187897510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 msgr2=0x7fb1e8155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 --2- 172.21.15.32:0/3187897510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e8155a90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00097c0 tx=0x7fb1d001c330 comp rx=0 tx=0).stop 2024-01-19T04:18:27.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- 172.21.15.32:0/3187897510 shutdown_connections 2024-01-19T04:18:27.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 --2- 172.21.15.32:0/3187897510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e8155a90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- 172.21.15.32:0/3187897510 >> 172.21.15.32:0/3187897510 conn(0x7fb1e80c25a0 msgr2=0x7fb1e80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:27.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- 172.21.15.32:0/3187897510 shutdown_connections 2024-01-19T04:18:27.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- 172.21.15.32:0/3187897510 wait complete. 2024-01-19T04:18:27.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 Processor -- start 2024-01-19T04:18:27.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- start start 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e806d440 0x7fb1e8154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e80723b0 0x7fb1e81ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e80ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8155110 con 0x7fb1e80c2080 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e81553f0 con 0x7fb1e80723b0 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ef600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8153b10 con 0x7fb1e806d440 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ed600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e80ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ed600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e80ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55176/0 (socket says 172.21.15.32:55176) 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ed600640 1 -- 172.21.15.32:0/4203766656 learned_addr learned my addr 172.21.15.32:0/4203766656 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1ecc00640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e806d440 0x7fb1e8154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.755+0000 7fb1e7e00640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e80723b0 0x7fb1e81ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ed600640 1 -- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e806d440 msgr2=0x7fb1e8154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ed600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e806d440 0x7fb1e8154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ed600640 1 -- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e80723b0 msgr2=0x7fb1e81ebf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ed600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e80723b0 0x7fb1e81ebf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ed600640 1 -- 172.21.15.32:0/4203766656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0009420 con 0x7fb1e80c2080 2024-01-19T04:18:27.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ed600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e80ab460 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c730 tx=0x7fb1e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1e4c00640 1 -- 172.21.15.32:0/4203766656 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0003b80 con 0x7fb1e80c2080 2024-01-19T04:18:27.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1e4c00640 1 -- 172.21.15.32:0/4203766656 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0003ce0 con 0x7fb1e80c2080 2024-01-19T04:18:27.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1e4c00640 1 -- 172.21.15.32:0/4203766656 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000aa30 con 0x7fb1e80c2080 2024-01-19T04:18:27.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e8153df0 con 0x7fb1e80c2080 2024-01-19T04:18:27.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e8154dc0 con 0x7fb1e80c2080 2024-01-19T04:18:27.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e81555b0 con 0x7fb1e80c2080 2024-01-19T04:18:27.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1e4c00640 1 -- 172.21.15.32:0/4203766656 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb1e000ab90 con 0x7fb1e80c2080 2024-01-19T04:18:27.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1e4c00640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb1c0066500 0x7fb1c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:27.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.759+0000 7fb1e4c00640 1 -- 172.21.15.32:0/4203766656 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb1e0083db0 con 0x7fb1e80c2080 2024-01-19T04:18:27.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.763+0000 7fb1ecc00640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb1c0066500 0x7fb1c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:27.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.763+0000 7fb1ecc00640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb1c0066500 0x7fb1c00689c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000f70 tx=0x7fb1d8007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:27.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.763+0000 7fb1e4c00640 1 -- 172.21.15.32:0/4203766656 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb1e0050e30 con 0x7fb1e80c2080 2024-01-19T04:18:27.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.923+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1e8153fe0 con 0x7fb1e80c2080 2024-01-19T04:18:27.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1e4c00640 1 -- 172.21.15.32:0/4203766656 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1e0054450 con 0x7fb1e80c2080 2024-01-19T04:18:27.930 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:27.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb1c0066500 msgr2=0x7fb1c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb1c0066500 0x7fb1c00689c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000f70 tx=0x7fb1d8007240 comp rx=0 tx=0).stop 2024-01-19T04:18:27.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 msgr2=0x7fb1e80ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:27.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e80ab460 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c730 tx=0x7fb1e000cbf0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 shutdown_connections 2024-01-19T04:18:27.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb1c0066500 0x7fb1c00689c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1e80c2080 0x7fb1e80ab460 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e80723b0 0x7fb1e81ebf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 --2- 172.21.15.32:0/4203766656 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb1e806d440 0x7fb1e8154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:27.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 >> 172.21.15.32:0/4203766656 conn(0x7fb1e80c25a0 msgr2=0x7fb1e8150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:27.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 shutdown_connections 2024-01-19T04:18:27.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:27.927+0000 7fb1ef600640 1 -- 172.21.15.32:0/4203766656 wait complete. 2024-01-19T04:18:27.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:18:28.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f3650400640 1 Processor -- start 2024-01-19T04:18:28.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f3650400640 1 -- start start 2024-01-19T04:18:28.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f3650400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3648155520 0x7f364806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f3650400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36480bf360 0x7f36480a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f3650400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480beed0 con 0x7f3648072490 2024-01-19T04:18:28.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f3650400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364806e0c0 con 0x7f3648155520 2024-01-19T04:18:28.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f3650400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480c3a80 con 0x7f36480bf360 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f364e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36480bf360 0x7f36480a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f364e400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36480bf360 0x7f36480a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:53190/0 (socket says 172.21.15.32:53190) 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f364d000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3648072490 0x7f364806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:34242/0 (socket says 172.21.15.32:34242) 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f364e400640 1 -- 172.21.15.32:0/2912532178 learned_addr learned my addr 172.21.15.32:0/2912532178 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.091+0000 7f364da00640 1 --2- 172.21.15.32:0/2912532178 >> v2:172.21.15.67:3300/0 conn(0x7f3648155520 0x7f364806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f364e400640 1 -- 172.21.15.32:0/2912532178 >> v2:172.21.15.67:3300/0 conn(0x7f3648155520 msgr2=0x7f364806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f364e400640 1 --2- 172.21.15.32:0/2912532178 >> v2:172.21.15.67:3300/0 conn(0x7f3648155520 0x7f364806c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f364e400640 1 -- 172.21.15.32:0/2912532178 >> v1:172.21.15.67:6789/0 conn(0x7f3648072490 legacy=0x7f364806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f364e400640 1 -- 172.21.15.32:0/2912532178 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480c3d60 con 0x7f36480bf360 2024-01-19T04:18:28.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f3647e00640 1 -- 172.21.15.32:0/2912532178 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551706592 0 0) 0x7f36480beed0 con 0x7f3648072490 2024-01-19T04:18:28.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f364e400640 1 --2- 172.21.15.32:0/2912532178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36480bf360 0x7f36480a4d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3640009e50 tx=0x7f364001c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12356cbb9a15b507 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f3647e00640 1 -- 172.21.15.32:0/2912532178 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400a5730 con 0x7f36480bf360 2024-01-19T04:18:28.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f3647e00640 1 -- 172.21.15.32:0/2912532178 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400a5890 con 0x7f36480bf360 2024-01-19T04:18:28.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f3647e00640 1 -- 172.21.15.32:0/2912532178 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400a5c20 con 0x7f36480bf360 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f3650400640 1 -- 172.21.15.32:0/2912532178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36480bf360 msgr2=0x7f36480a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.095+0000 7f3650400640 1 --2- 172.21.15.32:0/2912532178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36480bf360 0x7f36480a4d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3640009e50 tx=0x7f364001c980 comp rx=0 tx=0).stop 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- 172.21.15.32:0/2912532178 shutdown_connections 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 --2- 172.21.15.32:0/2912532178 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f36480bf360 0x7f36480a4d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 --2- 172.21.15.32:0/2912532178 >> v2:172.21.15.67:3300/0 conn(0x7f3648155520 0x7f364806c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- 172.21.15.32:0/2912532178 >> 172.21.15.32:0/2912532178 conn(0x7f36480c25a0 msgr2=0x7f36480c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- 172.21.15.32:0/2912532178 shutdown_connections 2024-01-19T04:18:28.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- 172.21.15.32:0/2912532178 wait complete. 2024-01-19T04:18:28.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 Processor -- start 2024-01-19T04:18:28.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- start start 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3648072490 0x7f3648156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480bf360 0x7f364814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3648155520 0x7f36481f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480a9730 con 0x7f3648072490 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480aa650 con 0x7f36480bf360 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f3650400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364814b220 con 0x7f3648155520 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3648072490 0x7f3648156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480bf360 0x7f364814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3648072490 0x7f3648156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49018/0 (socket says 172.21.15.32:49018) 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 -- 172.21.15.32:0/1586282991 learned_addr learned my addr 172.21.15.32:0/1586282991 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364e400640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3648155520 0x7f36481f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 -- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3648155520 msgr2=0x7f36481f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3648155520 0x7f36481f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 -- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480bf360 msgr2=0x7f364814dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480bf360 0x7f364814dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.099+0000 7f364da00640 1 -- 172.21.15.32:0/1586282991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009b30 con 0x7f3648072490 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f364da00640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3648072490 0x7f3648156c40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f363800e930 tx=0x7f363800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3645600640 1 -- 172.21.15.32:0/1586282991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638009690 con 0x7f3648072490 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3645600640 1 -- 172.21.15.32:0/1586282991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363800ca00 con 0x7f3648072490 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36480a8f20 con 0x7f3648072490 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3645600640 1 -- 172.21.15.32:0/1586282991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800cd70 con 0x7f3648072490 2024-01-19T04:18:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364814daa0 con 0x7f3648072490 2024-01-19T04:18:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36481550f0 con 0x7f3648072490 2024-01-19T04:18:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3645600640 1 -- 172.21.15.32:0/1586282991 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3638013470 con 0x7f3648072490 2024-01-19T04:18:28.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3645600640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3620066500 0x7f36200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f3645600640 1 -- 172.21.15.32:0/1586282991 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3638084480 con 0x7f3648072490 2024-01-19T04:18:28.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.103+0000 7f364d000640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3620066500 0x7f36200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.107+0000 7f364d000640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3620066500 0x7f36200689c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f36480a5cc0 tx=0x7f3630007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.107+0000 7f3645600640 1 -- 172.21.15.32:0/1586282991 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3638051410 con 0x7f3648072490 2024-01-19T04:18:28.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.271+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f364814d900 con 0x7f3648072490 2024-01-19T04:18:28.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.271+0000 7f3645600640 1 -- 172.21.15.32:0/1586282991 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7f364814d900 con 0x7f3648072490 2024-01-19T04:18:28.276 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:28.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3620066500 msgr2=0x7f36200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3620066500 0x7f36200689c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f36480a5cc0 tx=0x7f3630007df0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3648072490 msgr2=0x7f3648156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3648072490 0x7f3648156c40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f363800e930 tx=0x7f363800edf0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 shutdown_connections 2024-01-19T04:18:28.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3620066500 0x7f36200689c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3648155520 0x7f36481f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36480bf360 0x7f364814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 --2- 172.21.15.32:0/1586282991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3648072490 0x7f3648156c40 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 >> 172.21.15.32:0/1586282991 conn(0x7f36480c25a0 msgr2=0x7f36480c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:28.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 shutdown_connections 2024-01-19T04:18:28.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.275+0000 7f3650400640 1 -- 172.21.15.32:0/1586282991 wait complete. 2024-01-19T04:18:28.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:18:28.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f3185400640 1 Processor -- start 2024-01-19T04:18:28.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f3185400640 1 -- start start 2024-01-19T04:18:28.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f3185400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c54f0 0x7f31800c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f3185400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31800c3170 con 0x7f31800c1cb0 2024-01-19T04:18:28.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f3185400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31800c4e00 con 0x7f31800aa080 2024-01-19T04:18:28.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f3185400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31800c60a0 con 0x7f31800c54f0 2024-01-19T04:18:28.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317e800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f31800c1cb0 0x7f3180154fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43144/0 (socket says 172.21.15.32:43144) 2024-01-19T04:18:28.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317e800640 1 -- 172.21.15.32:0/2061302669 learned_addr learned my addr 172.21.15.32:0/2061302669 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317de00640 1 --2- 172.21.15.32:0/2061302669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c54f0 0x7f31800c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671339434 0 0) 0x7f31800c3170 con 0x7f31800c1cb0 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3160003530 con 0x7f31800c1cb0 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427986577 0 0) 0x7f31800c4e00 con 0x7f31800aa080 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31800c3170 con 0x7f31800aa080 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3288958804 0 0) 0x7f3160003530 con 0x7f31800c1cb0 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317de00640 1 -- 172.21.15.32:0/2061302669 >> v1:172.21.15.67:6789/0 conn(0x7f31800aa080 legacy=0x7f31800aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317de00640 1 -- 172.21.15.32:0/2061302669 >> v1:172.21.15.32:6789/0 conn(0x7f31800c1cb0 legacy=0x7f3180154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.439+0000 7f317de00640 1 -- 172.21.15.32:0/2061302669 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800c50e0 con 0x7f31800c54f0 2024-01-19T04:18:28.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f317de00640 1 --2- 172.21.15.32:0/2061302669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c54f0 0x7f31800c2090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f31680097f0 tx=0x7f316801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d14157f1ece7a916 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170001680 con 0x7f31800c54f0 2024-01-19T04:18:28.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31680a7050 con 0x7f31800c54f0 2024-01-19T04:18:28.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f317d400640 1 -- 172.21.15.32:0/2061302669 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680ab620 con 0x7f31800c54f0 2024-01-19T04:18:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f3185400640 1 -- 172.21.15.32:0/2061302669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c54f0 msgr2=0x7f31800c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f3185400640 1 --2- 172.21.15.32:0/2061302669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c54f0 0x7f31800c2090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f31680097f0 tx=0x7f316801c3e0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f3185400640 1 -- 172.21.15.32:0/2061302669 shutdown_connections 2024-01-19T04:18:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f3185400640 1 --2- 172.21.15.32:0/2061302669 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c54f0 0x7f31800c2090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f3185400640 1 -- 172.21.15.32:0/2061302669 >> 172.21.15.32:0/2061302669 conn(0x7f31800c36c0 msgr2=0x7f31800c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f3185400640 1 -- 172.21.15.32:0/2061302669 shutdown_connections 2024-01-19T04:18:28.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.443+0000 7f3185400640 1 -- 172.21.15.32:0/2061302669 wait complete. 2024-01-19T04:18:28.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 Processor -- start 2024-01-19T04:18:28.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 -- start start 2024-01-19T04:18:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31800aa080 0x7f3180156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c1cb0 0x7f318006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800c54f0 0x7f3180152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318015ca90 con 0x7f31800c54f0 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31801eca10 con 0x7f31800aa080 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3180155e40 con 0x7f31800c1cb0 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800c54f0 0x7f3180152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800c54f0 0x7f3180152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49034/0 (socket says 172.21.15.32:49034) 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 -- 172.21.15.32:0/227179491 learned_addr learned my addr 172.21.15.32:0/227179491 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317de00640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c1cb0 0x7f318006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317e800640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31800aa080 0x7f3180156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 -- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c1cb0 msgr2=0x7f318006e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c1cb0 0x7f318006e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 -- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31800aa080 msgr2=0x7f3180156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31800aa080 0x7f3180156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 -- 172.21.15.32:0/227179491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3168009420 con 0x7f31800c54f0 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317e800640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31800aa080 0x7f3180156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f317f200640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800c54f0 0x7f3180152040 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f317800c790 tx=0x7f317800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3176a00640 1 -- 172.21.15.32:0/227179491 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800cea0 con 0x7f31800c54f0 2024-01-19T04:18:28.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3176a00640 1 -- 172.21.15.32:0/227179491 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3178003b80 con 0x7f31800c54f0 2024-01-19T04:18:28.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3180156120 con 0x7f31800c54f0 2024-01-19T04:18:28.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3176a00640 1 -- 172.21.15.32:0/227179491 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800a850 con 0x7f31800c54f0 2024-01-19T04:18:28.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.447+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318015c7b0 con 0x7f31800c54f0 2024-01-19T04:18:28.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.451+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318004f1d0 con 0x7f31800c54f0 2024-01-19T04:18:28.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.451+0000 7f3176a00640 1 -- 172.21.15.32:0/227179491 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f317800a9b0 con 0x7f31800c54f0 2024-01-19T04:18:28.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.451+0000 7f3176a00640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3158066500 0x7f31580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.451+0000 7f3176a00640 1 -- 172.21.15.32:0/227179491 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3178083fb0 con 0x7f31800c54f0 2024-01-19T04:18:28.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.451+0000 7f317e800640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3158066500 0x7f31580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.455+0000 7f317e800640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3158066500 0x7f31580689c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f31700011f0 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.455+0000 7f3176a00640 1 -- 172.21.15.32:0/227179491 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f31780b54d0 con 0x7f31800c54f0 2024-01-19T04:18:28.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3180155ca0 con 0x7f31800c54f0 2024-01-19T04:18:28.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3176a00640 1 -- 172.21.15.32:0/227179491 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3180155ca0 con 0x7f31800c54f0 2024-01-19T04:18:28.647 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3158066500 msgr2=0x7f31580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3158066500 0x7f31580689c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f31700011f0 tx=0x7f3170009040 comp rx=0 tx=0).stop 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800c54f0 msgr2=0x7f3180152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800c54f0 0x7f3180152040 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f317800c790 tx=0x7f317800cc50 comp rx=0 tx=0).stop 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 shutdown_connections 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3158066500 0x7f31580689c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800c54f0 0x7f3180152040 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31800c1cb0 0x7f318006e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 --2- 172.21.15.32:0/227179491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31800aa080 0x7f3180156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 >> 172.21.15.32:0/227179491 conn(0x7f31800c36c0 msgr2=0x7f31800c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 shutdown_connections 2024-01-19T04:18:28.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.619+0000 7f3185400640 1 -- 172.21.15.32:0/227179491 wait complete. 2024-01-19T04:18:28.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:28.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f464b400640 1 Processor -- start 2024-01-19T04:18:28.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f464b400640 1 -- start start 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f464b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464414b210 0x7f46440c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f464b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46440c68a0 0x7f46440c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f464b400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440bd810 con 0x7f46441550d0 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f464b400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464406bb20 con 0x7f46440c68a0 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f464b400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464406c9c0 con 0x7f464414b210 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4648a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464414b210 0x7f46440c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4643e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f46441550d0 0x7f464406c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:34260/0 (socket says 172.21.15.32:34260) 2024-01-19T04:18:28.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4643e00640 1 -- 172.21.15.32:0/2543169766 learned_addr learned my addr 172.21.15.32:0/2543169766 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:28.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4649400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46440c68a0 0x7f46440c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4643400640 1 -- 172.21.15.32:0/2543169766 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051689758 0 0) 0x7f46440bd810 con 0x7f46441550d0 2024-01-19T04:18:28.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4643400640 1 -- 172.21.15.32:0/2543169766 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4624003530 con 0x7f46441550d0 2024-01-19T04:18:28.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4649400640 1 -- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464414b210 msgr2=0x7f46440c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:28.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4649400640 1 --2- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464414b210 0x7f46440c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4649400640 1 -- 172.21.15.32:0/2543169766 >> v1:172.21.15.67:6789/0 conn(0x7f46441550d0 legacy=0x7f464406c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4649400640 1 -- 172.21.15.32:0/2543169766 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644155550 con 0x7f46440c68a0 2024-01-19T04:18:28.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.787+0000 7f4648a00640 1 --2- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464414b210 0x7f46440c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:28.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.791+0000 7f4649400640 1 --2- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f46440c6d30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f463c009d90 tx=0x7f463c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d850fd46f907f9e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.791+0000 7f4643400640 1 -- 172.21.15.32:0/2543169766 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0a59e0 con 0x7f46440c68a0 2024-01-19T04:18:28.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.791+0000 7f4643400640 1 -- 172.21.15.32:0/2543169766 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c0a5b40 con 0x7f46440c68a0 2024-01-19T04:18:28.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.791+0000 7f4643400640 1 -- 172.21.15.32:0/2543169766 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0ad440 con 0x7f46440c68a0 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.791+0000 7f464b400640 1 -- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 msgr2=0x7f46440c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.791+0000 7f464b400640 1 --2- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f46440c6d30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f463c009d90 tx=0x7f463c01c920 comp rx=0 tx=0).stop 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- 172.21.15.32:0/2543169766 shutdown_connections 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 --2- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f46440c6d30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 --2- 172.21.15.32:0/2543169766 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f464414b210 0x7f46440c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- 172.21.15.32:0/2543169766 >> 172.21.15.32:0/2543169766 conn(0x7f46440aba20 msgr2=0x7f46440abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- 172.21.15.32:0/2543169766 shutdown_connections 2024-01-19T04:18:28.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- 172.21.15.32:0/2543169766 wait complete. 2024-01-19T04:18:28.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 Processor -- start 2024-01-19T04:18:28.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- start start 2024-01-19T04:18:28.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f464415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f464414b210 0x7f464414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46441550d0 0x7f46441ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644151210 con 0x7f464414b210 2024-01-19T04:18:28.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46440af880 con 0x7f46440c68a0 2024-01-19T04:18:28.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f464b400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4644150f30 con 0x7f46441550d0 2024-01-19T04:18:28.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f464414b210 0x7f464414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f464414b210 0x7f464414a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49040/0 (socket says 172.21.15.32:49040) 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 -- 172.21.15.32:0/1377682128 learned_addr learned my addr 172.21.15.32:0/1377682128 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4648a00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f464415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4649400640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46441550d0 0x7f46441ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 -- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46441550d0 msgr2=0x7f46441ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46441550d0 0x7f46441ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 -- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 msgr2=0x7f464415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f464415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 -- 172.21.15.32:0/1377682128 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634009420 con 0x7f464414b210 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4648a00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f464415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.795+0000 7f4643e00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f464414b210 0x7f464414a340 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c450 tx=0x7f462c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f4640c00640 1 -- 172.21.15.32:0/1377682128 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c005cf0 con 0x7f464414b210 2024-01-19T04:18:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f4640c00640 1 -- 172.21.15.32:0/1377682128 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c005e50 con 0x7f464414b210 2024-01-19T04:18:28.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c009a70 con 0x7f464414b210 2024-01-19T04:18:28.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f4640c00640 1 -- 172.21.15.32:0/1377682128 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c007290 con 0x7f464414b210 2024-01-19T04:18:28.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4644151920 con 0x7f464414b210 2024-01-19T04:18:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46440749f0 con 0x7f464414b210 2024-01-19T04:18:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f4640c00640 1 -- 172.21.15.32:0/1377682128 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f462c0073f0 con 0x7f464414b210 2024-01-19T04:18:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f4640c00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f461c066500 0x7f461c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f4640c00640 1 -- 172.21.15.32:0/1377682128 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f462c083750 con 0x7f464414b210 2024-01-19T04:18:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.799+0000 7f4648a00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f461c066500 0x7f461c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.803+0000 7f4648a00640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f461c066500 0x7f461c0689c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4634009d40 tx=0x7f4634008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:28.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.803+0000 7f4640c00640 1 -- 172.21.15.32:0/1377682128 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f462c050720 con 0x7f464414b210 2024-01-19T04:18:29.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4644067b80 con 0x7f464414b210 2024-01-19T04:18:29.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f4640c00640 1 -- 172.21.15.32:0/1377682128 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6178 (secure 0 0 0) 0x7f462c017090 con 0x7f464414b210 2024-01-19T04:18:29.003 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:29.003 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:49.203878+0000","modified":"2024-01-19T04:17:52.248717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/208534071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":208534071},{"type":"v1","addr":"172.21.15.67:6837","nonce":208534071}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:29.003 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 52 2024-01-19T04:18:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f461c066500 msgr2=0x7f461c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f461c066500 0x7f461c0689c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4634009d40 tx=0x7f4634008040 comp rx=0 tx=0).stop 2024-01-19T04:18:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f464414b210 msgr2=0x7f464414a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f464414b210 0x7f464414a340 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c450 tx=0x7f462c00c910 comp rx=0 tx=0).stop 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 shutdown_connections 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f461c066500 0x7f461c0689c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f46441550d0 0x7f46441ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f464414b210 0x7f464414a340 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 --2- 172.21.15.32:0/1377682128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46440c68a0 0x7f464415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 >> 172.21.15.32:0/1377682128 conn(0x7f46440aba20 msgr2=0x7f46441541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 shutdown_connections 2024-01-19T04:18:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:28.999+0000 7f464b400640 1 -- 172.21.15.32:0/1377682128 wait complete. 2024-01-19T04:18:29.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:29.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915e000640 1 Processor -- start 2024-01-19T04:18:29.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915e000640 1 -- start start 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915e000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9158071f30 0x7f915815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915e000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91581514a0 con 0x7f915806b090 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915e000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91581519d0 con 0x7f915814ac10 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915e000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580a85e0 con 0x7f9158071f30 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915ca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9158071f30 0x7f915815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f9156a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f915806b090 0x7f9158071820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43160/0 (socket says 172.21.15.32:43160) 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f9156a00640 1 -- 172.21.15.32:0/3005617436 learned_addr learned my addr 172.21.15.32:0/3005617436 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915ca00640 1 -- 172.21.15.32:0/3005617436 >> v1:172.21.15.67:6789/0 conn(0x7f915814ac10 legacy=0x7f915806a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915ca00640 1 -- 172.21.15.32:0/3005617436 >> v1:172.21.15.32:6789/0 conn(0x7f915806b090 legacy=0x7f9158071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.163+0000 7f915ca00640 1 -- 172.21.15.32:0/3005617436 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91581516f0 con 0x7f9158071f30 2024-01-19T04:18:29.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915ca00640 1 --2- 172.21.15.32:0/3005617436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f915815c3b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f915000aea0 tx=0x7f915001d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38919e145dfcecc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f9156000640 1 -- 172.21.15.32:0/3005617436 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000a2d0 con 0x7f9158071f30 2024-01-19T04:18:29.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f9156000640 1 -- 172.21.15.32:0/3005617436 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91500a67b0 con 0x7f9158071f30 2024-01-19T04:18:29.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f9156000640 1 -- 172.21.15.32:0/3005617436 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500a6b40 con 0x7f9158071f30 2024-01-19T04:18:29.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915e000640 1 -- 172.21.15.32:0/3005617436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 msgr2=0x7f915815c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915e000640 1 --2- 172.21.15.32:0/3005617436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f915815c3b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f915000aea0 tx=0x7f915001d930 comp rx=0 tx=0).stop 2024-01-19T04:18:29.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915e000640 1 -- 172.21.15.32:0/3005617436 shutdown_connections 2024-01-19T04:18:29.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915e000640 1 --2- 172.21.15.32:0/3005617436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f915815c3b0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915e000640 1 -- 172.21.15.32:0/3005617436 >> 172.21.15.32:0/3005617436 conn(0x7f915806d6c0 msgr2=0x7f915806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:29.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915e000640 1 -- 172.21.15.32:0/3005617436 shutdown_connections 2024-01-19T04:18:29.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.167+0000 7f915e000640 1 -- 172.21.15.32:0/3005617436 wait complete. 2024-01-19T04:18:29.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 Processor -- start 2024-01-19T04:18:29.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 -- start start 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f915806b090 0x7f9158150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f91581458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f915814ac10 0x7f91580c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158151f60 con 0x7f9158071f30 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581ed690 con 0x7f915814ac10 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91581509f0 con 0x7f915806b090 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f91581458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f91581458a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49058/0 (socket says 172.21.15.32:49058) 2024-01-19T04:18:29.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 -- 172.21.15.32:0/1744038298 learned_addr learned my addr 172.21.15.32:0/1744038298 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:29.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915ca00640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f915814ac10 0x7f91580c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9157400640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f915806b090 0x7f9158150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 -- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f915806b090 msgr2=0x7f9158150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f915806b090 0x7f9158150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 -- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f915814ac10 msgr2=0x7f91580c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f915814ac10 0x7f91580c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 -- 172.21.15.32:0/1744038298 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915000ab80 con 0x7f9158071f30 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f9156a00640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f91581458a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f914000c560 tx=0x7f914000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f914f400640 1 -- 172.21.15.32:0/1744038298 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140005cf0 con 0x7f9158071f30 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f914f400640 1 -- 172.21.15.32:0/1744038298 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9140005e50 con 0x7f9158071f30 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f914f400640 1 -- 172.21.15.32:0/1744038298 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140007270 con 0x7f9158071f30 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91581edb20 con 0x7f9158071f30 2024-01-19T04:18:29.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91581ed040 con 0x7f9158071f30 2024-01-19T04:18:29.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.171+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91580726c0 con 0x7f9158071f30 2024-01-19T04:18:29.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.175+0000 7f914f400640 1 -- 172.21.15.32:0/1744038298 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f91400073d0 con 0x7f9158071f30 2024-01-19T04:18:29.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.175+0000 7f914f400640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9130066530 0x7f91300689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.175+0000 7f914f400640 1 -- 172.21.15.32:0/1744038298 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9140083630 con 0x7f9158071f30 2024-01-19T04:18:29.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.175+0000 7f9157400640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9130066530 0x7f91300689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.175+0000 7f9157400640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9130066530 0x7f91300689f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f91580c71f0 tx=0x7f9148009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.179+0000 7f914f400640 1 -- 172.21.15.32:0/1744038298 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9140050610 con 0x7f9158071f30 2024-01-19T04:18:29.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.339+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f915804e980 con 0x7f9158071f30 2024-01-19T04:18:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.339+0000 7f914f400640 1 -- 172.21.15.32:0/1744038298 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7f9140053c30 con 0x7f9158071f30 2024-01-19T04:18:29.344 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:29.344 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.339+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9130066530 msgr2=0x7f91300689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.339+0000 7f915e000640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9130066530 0x7f91300689f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f91580c71f0 tx=0x7f9148009040 comp rx=0 tx=0).stop 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.339+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 msgr2=0x7f91581458a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.339+0000 7f915e000640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f91581458a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f914000c560 tx=0x7f914000ca20 comp rx=0 tx=0).stop 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 shutdown_connections 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9130066530 0x7f91300689f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f915814ac10 0x7f91580c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158071f30 0x7f91581458a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 --2- 172.21.15.32:0/1744038298 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f915806b090 0x7f9158150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 >> 172.21.15.32:0/1744038298 conn(0x7f915806d6c0 msgr2=0x7f915806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:29.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 shutdown_connections 2024-01-19T04:18:29.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.343+0000 7f915e000640 1 -- 172.21.15.32:0/1744038298 wait complete. 2024-01-19T04:18:29.366 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T04:18:29.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:29.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedb0800640 1 Processor -- start 2024-01-19T04:18:29.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedb0800640 1 -- start start 2024-01-19T04:18:29.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedb0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7feda80c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedb0800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda806ed70 con 0x7feda80c3900 2024-01-19T04:18:29.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedb0800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda806e400 con 0x7feda8155500 2024-01-19T04:18:29.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedb0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda80c7340 con 0x7feda80c6d70 2024-01-19T04:18:29.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedae800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7feda80c3900 0x7feda80c46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43170/0 (socket says 172.21.15.32:43170) 2024-01-19T04:18:29.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedae800640 1 -- 172.21.15.32:0/1920928271 learned_addr learned my addr 172.21.15.32:0/1920928271 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedad400640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7feda80c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966389416 0 0) 0x7feda806ed70 con 0x7feda80c3900 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed88003530 con 0x7feda80c3900 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995676037 0 0) 0x7feda806e400 con 0x7feda8155500 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda806ed70 con 0x7feda8155500 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138336597 0 0) 0x7fed88003530 con 0x7feda80c3900 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 msgr2=0x7feda80c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.503+0000 7fedaca00640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7feda80c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 >> v1:172.21.15.67:6789/0 conn(0x7feda8155500 legacy=0x7feda80c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda806efc0 con 0x7feda80c3900 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7feda0001a00 con 0x7feda80c3900 2024-01-19T04:18:29.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7feda80c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 >> v1:172.21.15.32:6789/0 conn(0x7feda80c3900 legacy=0x7feda80c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed88003b40 0x7fed88003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed880047d0 0x7fed88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7fed880051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda80c7340 con 0x7fed880047d0 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8800baa0 con 0x7fed88003b40 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8800bc60 con 0x7feda80c6d70 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed880047d0 0x7fed88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedade00640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed88003b40 0x7fed88003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedae800640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7fed880051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 -- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 msgr2=0x7fed880051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7fed880051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 -- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed88003b40 msgr2=0x7fed88003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:29.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed88003b40 0x7fed88003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 -- 172.21.15.32:0/1920928271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009420 con 0x7fed880047d0 2024-01-19T04:18:29.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedae800640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7feda80c6d70 0x7fed880051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:29.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.507+0000 7fedad400640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed880047d0 0x7fed88004c50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c80 tx=0x7fed9001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b957c27c7be6b8cb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90004020 con 0x7fed880047d0 2024-01-19T04:18:29.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90004180 con 0x7fed880047d0 2024-01-19T04:18:29.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedaca00640 1 -- 172.21.15.32:0/1920928271 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90004510 con 0x7fed880047d0 2024-01-19T04:18:29.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- 172.21.15.32:0/1920928271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed880047d0 msgr2=0x7fed88004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 --2- 172.21.15.32:0/1920928271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fed880047d0 0x7fed88004c50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c80 tx=0x7fed9001cb80 comp rx=0 tx=0).stop 2024-01-19T04:18:29.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedae800640 1 -- 172.21.15.32:0/1920928271 reap_dead start 2024-01-19T04:18:29.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- 172.21.15.32:0/1920928271 shutdown_connections 2024-01-19T04:18:29.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- 172.21.15.32:0/1920928271 >> 172.21.15.32:0/1920928271 conn(0x7feda80726d0 msgr2=0x7feda80663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:29.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- 172.21.15.32:0/1920928271 shutdown_connections 2024-01-19T04:18:29.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- 172.21.15.32:0/1920928271 wait complete. 2024-01-19T04:18:29.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 Processor -- start 2024-01-19T04:18:29.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- start start 2024-01-19T04:18:29.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed880047d0 0x7feda8154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feda806b7b0 0x7feda81f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda80a6dc0 0x7feda814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda814dd70 con 0x7feda806b7b0 2024-01-19T04:18:29.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda80c1550 con 0x7feda80a6dc0 2024-01-19T04:18:29.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.511+0000 7fedb0800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda81f08c0 con 0x7fed880047d0 2024-01-19T04:18:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feda806b7b0 0x7feda81f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feda806b7b0 0x7feda81f0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49086/0 (socket says 172.21.15.32:49086) 2024-01-19T04:18:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 -- 172.21.15.32:0/604797214 learned_addr learned my addr 172.21.15.32:0/604797214 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:29.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedae800640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda80a6dc0 0x7feda814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedade00640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed880047d0 0x7feda8154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 -- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed880047d0 msgr2=0x7feda8154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed880047d0 0x7feda8154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 -- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda80a6dc0 msgr2=0x7feda814f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda80a6dc0 0x7feda814f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 -- 172.21.15.32:0/604797214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8150970 con 0x7feda806b7b0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedad400640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feda806b7b0 0x7feda81f0d50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c80 tx=0x7fed88005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7feda6000640 1 -- 172.21.15.32:0/604797214 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900042f0 con 0x7feda806b7b0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7feda6000640 1 -- 172.21.15.32:0/604797214 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90004450 con 0x7feda806b7b0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda8150c50 con 0x7feda806b7b0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7feda6000640 1 -- 172.21.15.32:0/604797214 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900a5950 con 0x7feda806b7b0 2024-01-19T04:18:29.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda8154680 con 0x7feda806b7b0 2024-01-19T04:18:29.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda8151170 con 0x7feda806b7b0 2024-01-19T04:18:29.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.515+0000 7feda6000640 1 -- 172.21.15.32:0/604797214 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fed900a5ab0 con 0x7feda806b7b0 2024-01-19T04:18:29.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.519+0000 7feda6000640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed80066530 0x7fed800689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.519+0000 7feda6000640 1 -- 172.21.15.32:0/604797214 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fed9011e8c0 con 0x7feda806b7b0 2024-01-19T04:18:29.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.519+0000 7fedade00640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed80066530 0x7fed800689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.519+0000 7fedade00640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed80066530 0x7fed800689f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fed98000c10 tx=0x7fed98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.523+0000 7feda6000640 1 -- 172.21.15.32:0/604797214 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7feda8151170 con 0x7feda806b7b0 2024-01-19T04:18:29.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.715+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feda8151170 con 0x7feda806b7b0 2024-01-19T04:18:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7feda6000640 1 -- 172.21.15.32:0/604797214 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6178 (secure 0 0 0) 0x7feda8151170 con 0x7feda806b7b0 2024-01-19T04:18:29.722 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:29.722 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:49.203878+0000","modified":"2024-01-19T04:17:52.248717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/208534071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":208534071},{"type":"v1","addr":"172.21.15.67:6837","nonce":208534071}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 52 2024-01-19T04:18:29.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed80066530 msgr2=0x7fed800689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed80066530 0x7fed800689f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fed98000c10 tx=0x7fed98009040 comp rx=0 tx=0).stop 2024-01-19T04:18:29.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feda806b7b0 msgr2=0x7feda81f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feda806b7b0 0x7feda81f0d50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c80 tx=0x7fed88005800 comp rx=0 tx=0).stop 2024-01-19T04:18:29.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 shutdown_connections 2024-01-19T04:18:29.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fed80066530 0x7fed800689f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda80a6dc0 0x7feda814f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feda806b7b0 0x7feda81f0d50 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 --2- 172.21.15.32:0/604797214 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fed880047d0 0x7feda8154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 >> 172.21.15.32:0/604797214 conn(0x7feda80726d0 msgr2=0x7feda8152830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 shutdown_connections 2024-01-19T04:18:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.719+0000 7fedb0800640 1 -- 172.21.15.32:0/604797214 wait complete. 2024-01-19T04:18:29.744 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:29.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.883+0000 7f3673e00640 1 Processor -- start 2024-01-19T04:18:29.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.883+0000 7f3673e00640 1 -- start start 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3673e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f366c147f90 0x7f366c151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3673e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f366c0c55e0 0x7f366c0c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3673e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c0c0810 con 0x7f366c06beb0 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3673e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0c1df0 con 0x7f366c0c55e0 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3673e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0c0af0 con 0x7f366c147f90 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3670a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f366c0c55e0 0x7f366c0c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3670a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f366c0c55e0 0x7f366c0c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49092/0 (socket says 172.21.15.32:49092) 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3670a00640 1 -- 172.21.15.32:0/1281915348 learned_addr learned my addr 172.21.15.32:0/1281915348 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:29.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3671400640 1 --2- 172.21.15.32:0/1281915348 >> v2:172.21.15.67:3300/0 conn(0x7f366c147f90 0x7f366c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3670a00640 1 -- 172.21.15.32:0/1281915348 >> v2:172.21.15.67:3300/0 conn(0x7f366c147f90 msgr2=0x7f366c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:29.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3670a00640 1 --2- 172.21.15.32:0/1281915348 >> v2:172.21.15.67:3300/0 conn(0x7f366c147f90 0x7f366c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3670a00640 1 -- 172.21.15.32:0/1281915348 >> v1:172.21.15.67:6789/0 conn(0x7f366c06beb0 legacy=0x7f366c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.887+0000 7f3670a00640 1 -- 172.21.15.32:0/1281915348 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0c0dd0 con 0x7f366c0c55e0 2024-01-19T04:18:29.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3670a00640 1 --2- 172.21.15.32:0/1281915348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c0c55e0 0x7f366c0c18b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f366c06f5f0 tx=0x7f365401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03d1713947a57b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f366be00640 1 -- 172.21.15.32:0/1281915348 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540a7be0 con 0x7f366c0c55e0 2024-01-19T04:18:29.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f366be00640 1 -- 172.21.15.32:0/1281915348 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36540a7d40 con 0x7f366c0c55e0 2024-01-19T04:18:29.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f366be00640 1 -- 172.21.15.32:0/1281915348 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540af660 con 0x7f366c0c55e0 2024-01-19T04:18:29.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 -- 172.21.15.32:0/1281915348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c0c55e0 msgr2=0x7f366c0c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 --2- 172.21.15.32:0/1281915348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c0c55e0 0x7f366c0c18b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f366c06f5f0 tx=0x7f365401eb10 comp rx=0 tx=0).stop 2024-01-19T04:18:29.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 -- 172.21.15.32:0/1281915348 shutdown_connections 2024-01-19T04:18:29.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 --2- 172.21.15.32:0/1281915348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c0c55e0 0x7f366c0c18b0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 --2- 172.21.15.32:0/1281915348 >> v2:172.21.15.67:3300/0 conn(0x7f366c147f90 0x7f366c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 -- 172.21.15.32:0/1281915348 >> 172.21.15.32:0/1281915348 conn(0x7f366c0c5b20 msgr2=0x7f366c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:29.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 -- 172.21.15.32:0/1281915348 shutdown_connections 2024-01-19T04:18:29.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 -- 172.21.15.32:0/1281915348 wait complete. 2024-01-19T04:18:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 Processor -- start 2024-01-19T04:18:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.891+0000 7f3673e00640 1 -- start start 2024-01-19T04:18:29.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c06beb0 0x7f366c0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f366c0c55e0 0x7f366c1ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f366c147f90 0x7f366c1ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c1f14f0 con 0x7f366c06beb0 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c1ecfd0 con 0x7f366c147f90 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c14ba10 con 0x7f366c0c55e0 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c06beb0 0x7f366c0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c06beb0 0x7f366c0bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49098/0 (socket says 172.21.15.32:49098) 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 -- 172.21.15.32:0/1710884820 learned_addr learned my addr 172.21.15.32:0/1710884820 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3670a00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f366c0c55e0 0x7f366c1ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f366c147f90 0x7f366c1ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 -- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f366c0c55e0 msgr2=0x7f366c1ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f366c0c55e0 0x7f366c1ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 -- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f366c147f90 msgr2=0x7f366c1ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f366c147f90 0x7f366c1ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 -- 172.21.15.32:0/1710884820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365400b770 con 0x7f366c06beb0 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f366c147f90 0x7f366c1ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3670a00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f366c0c55e0 0x7f366c1ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3671400640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c06beb0 0x7f366c0bf130 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f365c00d5f0 tx=0x7f365c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3669600640 1 -- 172.21.15.32:0/1710884820 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0125f0 con 0x7f366c06beb0 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3669600640 1 -- 172.21.15.32:0/1710884820 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c012750 con 0x7f366c06beb0 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3669600640 1 -- 172.21.15.32:0/1710884820 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c012b00 con 0x7f366c06beb0 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c1f0f50 con 0x7f366c06beb0 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c0aad30 con 0x7f366c06beb0 2024-01-19T04:18:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c0749f0 con 0x7f366c06beb0 2024-01-19T04:18:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.895+0000 7f3669600640 1 -- 172.21.15.32:0/1710884820 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f365c012c60 con 0x7f366c06beb0 2024-01-19T04:18:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.899+0000 7f3669600640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3644066500 0x7f36440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.899+0000 7f3669600640 1 -- 172.21.15.32:0/1710884820 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f365c0846b0 con 0x7f366c06beb0 2024-01-19T04:18:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.899+0000 7f3670a00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3644066500 0x7f36440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.899+0000 7f3670a00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3644066500 0x7f36440689c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f36540b1000 tx=0x7f36540a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:29.903+0000 7f3669600640 1 -- 172.21.15.32:0/1710884820 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f365c051600 con 0x7f366c06beb0 2024-01-19T04:18:30.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f366c0c21d0 con 0x7f366c06beb0 2024-01-19T04:18:30.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3669600640 1 -- 172.21.15.32:0/1710884820 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6178 (secure 0 0 0) 0x7f365c054c20 con 0x7f366c06beb0 2024-01-19T04:18:30.103 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:17:49.203878+0000","modified":"2024-01-19T04:17:52.248717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6837/208534071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":208534071},{"type":"v1","addr":"172.21.15.67:6837","nonce":208534071}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:30.103 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 52 2024-01-19T04:18:30.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3644066500 msgr2=0x7f36440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3644066500 0x7f36440689c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f36540b1000 tx=0x7f36540a9070 comp rx=0 tx=0).stop 2024-01-19T04:18:30.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c06beb0 msgr2=0x7f366c0bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c06beb0 0x7f366c0bf130 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f365c00d5f0 tx=0x7f365c00dab0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 shutdown_connections 2024-01-19T04:18:30.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3644066500 0x7f36440689c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f366c147f90 0x7f366c1ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f366c0c55e0 0x7f366c1ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 --2- 172.21.15.32:0/1710884820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f366c06beb0 0x7f366c0bf130 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 >> 172.21.15.32:0/1710884820 conn(0x7f366c0c5b20 msgr2=0x7f366c146fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:30.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 shutdown_connections 2024-01-19T04:18:30.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.099+0000 7f3673e00640 1 -- 172.21.15.32:0/1710884820 wait complete. 2024-01-19T04:18:30.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:30.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f5ae00640 1 Processor -- start 2024-01-19T04:18:30.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f5ae00640 1 -- start start 2024-01-19T04:18:30.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f5ae00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f54158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f5ae00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f540c5fd0 0x7f6f540c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f5ae00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f540c7470 con 0x7f6f5406fee0 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f5ae00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540c2d60 con 0x7f6f540c5fd0 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f5ae00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540c3040 con 0x7f6f54158030 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f53400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6f5406fee0 0x7f6f540c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43184/0 (socket says 172.21.15.32:43184) 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f53400640 1 -- 172.21.15.32:0/3161857437 learned_addr learned my addr 172.21.15.32:0/3161857437 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f58e00640 1 --2- 172.21.15.32:0/3161857437 >> v2:172.21.15.67:3300/0 conn(0x7f6f540c5fd0 0x7f6f540c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.263+0000 7f6f53e00640 1 --2- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f54158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f52a00640 1 -- 172.21.15.32:0/3161857437 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154263925 0 0) 0x7f6f540c7470 con 0x7f6f5406fee0 2024-01-19T04:18:30.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f52a00640 1 -- 172.21.15.32:0/3161857437 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f34003530 con 0x7f6f5406fee0 2024-01-19T04:18:30.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f58e00640 1 -- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 msgr2=0x7f6f54158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:30.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f58e00640 1 --2- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f54158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f58e00640 1 -- 172.21.15.32:0/3161857437 >> v1:172.21.15.32:6789/0 conn(0x7f6f5406fee0 legacy=0x7f6f540c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f58e00640 1 -- 172.21.15.32:0/3161857437 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540c76c0 con 0x7f6f540c5fd0 2024-01-19T04:18:30.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f58e00640 1 --2- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f540c5fd0 0x7f6f540c6460 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009d90 tx=0x7f6f4c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6983b073635dd05d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:30.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f52a00640 1 -- 172.21.15.32:0/3161857437 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0a59a0 con 0x7f6f540c5fd0 2024-01-19T04:18:30.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f52a00640 1 -- 172.21.15.32:0/3161857437 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0a5b00 con 0x7f6f540c5fd0 2024-01-19T04:18:30.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.267+0000 7f6f52a00640 1 -- 172.21.15.32:0/3161857437 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0a5e70 con 0x7f6f540c5fd0 2024-01-19T04:18:30.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f540c5fd0 msgr2=0x7f6f540c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f540c5fd0 0x7f6f540c6460 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009d90 tx=0x7f6f4c01c8c0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- 172.21.15.32:0/3161857437 shutdown_connections 2024-01-19T04:18:30.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f540c5fd0 0x7f6f540c6460 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/3161857437 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f54158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- 172.21.15.32:0/3161857437 >> 172.21.15.32:0/3161857437 conn(0x7f6f540a99f0 msgr2=0x7f6f540a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:30.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- 172.21.15.32:0/3161857437 shutdown_connections 2024-01-19T04:18:30.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- 172.21.15.32:0/3161857437 wait complete. 2024-01-19T04:18:30.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 Processor -- start 2024-01-19T04:18:30.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- start start 2024-01-19T04:18:30.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406fee0 0x7f6f54156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f540c5fd0 0x7f6f5406f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f5414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5415dad0 con 0x7f6f540c5fd0 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5415cc20 con 0x7f6f5406fee0 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f5ae00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5415ce50 con 0x7f6f54158030 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f53400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f540c5fd0 0x7f6f5406f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f53400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f540c5fd0 0x7f6f5406f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49112/0 (socket says 172.21.15.32:49112) 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f53400640 1 -- 172.21.15.32:0/4049112728 learned_addr learned my addr 172.21.15.32:0/4049112728 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f58e00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f5414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.271+0000 7f6f53e00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406fee0 0x7f6f54156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f53400640 1 -- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 msgr2=0x7f6f5414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f53400640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f5414de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f53400640 1 -- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406fee0 msgr2=0x7f6f54156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f53400640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406fee0 0x7f6f54156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f53400640 1 -- 172.21.15.32:0/4049112728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009a70 con 0x7f6f540c5fd0 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f53400640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f540c5fd0 0x7f6f5406f630 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c450 tx=0x7f6f3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f4be00640 1 -- 172.21.15.32:0/4049112728 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c005cf0 con 0x7f6f540c5fd0 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f4be00640 1 -- 172.21.15.32:0/4049112728 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c005e50 con 0x7f6f540c5fd0 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f54158b60 con 0x7f6f540c5fd0 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f4be00640 1 -- 172.21.15.32:0/4049112728 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c007290 con 0x7f6f540c5fd0 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5415d410 con 0x7f6f540c5fd0 2024-01-19T04:18:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f540749f0 con 0x7f6f540c5fd0 2024-01-19T04:18:30.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f4be00640 1 -- 172.21.15.32:0/4049112728 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6f3c0073f0 con 0x7f6f540c5fd0 2024-01-19T04:18:30.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.275+0000 7f6f4be00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6f2c066500 0x7f6f2c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.279+0000 7f6f4be00640 1 -- 172.21.15.32:0/4049112728 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6f3c083740 con 0x7f6f540c5fd0 2024-01-19T04:18:30.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.279+0000 7f6f53e00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6f2c066500 0x7f6f2c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.279+0000 7f6f53e00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6f2c066500 0x7f6f2c0689c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009ac0 tx=0x7f6f44009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:30.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.279+0000 7f6f4be00640 1 -- 172.21.15.32:0/4049112728 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6f3c050720 con 0x7f6f540c5fd0 2024-01-19T04:18:30.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.447+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f540c5c00 con 0x7f6f540c5fd0 2024-01-19T04:18:30.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.447+0000 7f6f4be00640 1 -- 172.21.15.32:0/4049112728 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20119 (secure 0 0 0) 0x7f6f3c017090 con 0x7f6f540c5fd0 2024-01-19T04:18:30.454 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:30.454 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":75,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:03.918707+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-19T04:17:47.021907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-19T04:17:48.211408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6f2c066500 msgr2=0x7f6f2c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6f2c066500 0x7f6f2c0689c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009ac0 tx=0x7f6f44009190 comp rx=0 tx=0).stop 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f540c5fd0 msgr2=0x7f6f5406f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f540c5fd0 0x7f6f5406f630 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c450 tx=0x7f6f3c00c910 comp rx=0 tx=0).stop 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 shutdown_connections 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6f2c066500 0x7f6f2c0689c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6f54158030 0x7f6f5414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f540c5fd0 0x7f6f5406f630 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 --2- 172.21.15.32:0/4049112728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5406fee0 0x7f6f54156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 >> 172.21.15.32:0/4049112728 conn(0x7f6f540a99f0 msgr2=0x7f6f540c5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:30.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 shutdown_connections 2024-01-19T04:18:30.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.451+0000 7f6f5ae00640 1 -- 172.21.15.32:0/4049112728 wait complete. 2024-01-19T04:18:30.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-19T04:18:30.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f82800640 1 Processor -- start 2024-01-19T04:18:30.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f82800640 1 -- start start 2024-01-19T04:18:30.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f82800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 0x7f9f7c158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f82800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9f7c0c2740 0x7f9f7c15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f82800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c0a78d0 con 0x7f9f7c158780 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f82800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c48d0 con 0x7f9f7c0c2740 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f82800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c4bb0 con 0x7f9f7c151bc0 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9f7c158780 0x7f9f7c0a6dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43194/0 (socket says 172.21.15.32:43194) 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 -- 172.21.15.32:0/3000156782 learned_addr learned my addr 172.21.15.32:0/3000156782 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7b400640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 0x7f9f7c158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7be00640 1 --2- 172.21.15.32:0/3000156782 >> v2:172.21.15.67:3300/0 conn(0x7f9f7c0c2740 0x7f9f7c15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683429000 0 0) 0x7f9f7c0a78d0 con 0x7f9f7c158780 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f5c003530 con 0x7f9f7c158780 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1499122658 0 0) 0x7f9f5c003530 con 0x7f9f7c158780 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 msgr2=0x7f9f7c158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 0x7f9f7c158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 >> v2:172.21.15.67:3300/0 conn(0x7f9f7c0c2740 msgr2=0x7f9f7c15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:30.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 --2- 172.21.15.32:0/3000156782 >> v2:172.21.15.67:3300/0 conn(0x7f9f7c0c2740 0x7f9f7c15ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0c4e90 con 0x7f9f7c158780 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f9f64001680 con 0x7f9f7c158780 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 >> v1:172.21.15.32:6789/0 conn(0x7f9f7c158780 legacy=0x7f9f7c0a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f5c003980 0x7f9f5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f5c0047d0 0x7f9f5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 0x7f9f5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c48d0 con 0x7f9f5c0047d0 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c4bb0 con 0x7f9f5c003980 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c00b990 con 0x7f9f7c151bc0 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f5c0047d0 0x7f9f5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7be00640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 0x7f9f5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7b400640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f5c003980 0x7f9f5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 -- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 msgr2=0x7f9f5c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f7c151bc0 0x7f9f5c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 -- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f5c003980 msgr2=0x7f9f5c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:30.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f5c003980 0x7f9f5c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7aa00640 1 -- 172.21.15.32:0/3000156782 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c003530 con 0x7f9f5c0047d0 2024-01-19T04:18:30.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.615+0000 7f9f7b400640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f5c003980 0x7f9f5c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f7aa00640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f5c0047d0 0x7f9f5c004c50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c110 tx=0x7f9f6401f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5d2d739f34a314 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640a8c10 con 0x7f9f5c0047d0 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f640a8d90 con 0x7f9f5c0047d0 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f7a000640 1 -- 172.21.15.32:0/3000156782 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64005b20 con 0x7f9f5c0047d0 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f82800640 1 -- 172.21.15.32:0/3000156782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f5c0047d0 msgr2=0x7f9f5c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f82800640 1 --2- 172.21.15.32:0/3000156782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f5c0047d0 0x7f9f5c004c50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c110 tx=0x7f9f6401f290 comp rx=0 tx=0).stop 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f7be00640 1 -- 172.21.15.32:0/3000156782 reap_dead start 2024-01-19T04:18:30.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f82800640 1 -- 172.21.15.32:0/3000156782 shutdown_connections 2024-01-19T04:18:30.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f82800640 1 -- 172.21.15.32:0/3000156782 >> 172.21.15.32:0/3000156782 conn(0x7f9f7c0726d0 msgr2=0x7f9f7c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:30.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f82800640 1 -- 172.21.15.32:0/3000156782 shutdown_connections 2024-01-19T04:18:30.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.619+0000 7f9f82800640 1 -- 172.21.15.32:0/3000156782 wait complete. 2024-01-19T04:18:30.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 Processor -- start 2024-01-19T04:18:30.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 -- start start 2024-01-19T04:18:30.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f5c0047d0 0x7f9f7c06cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f7c155200 0x7f9f7c157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7c154c40 0x7f9f7c157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c1eda70 con 0x7f9f7c154c40 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c155d40 con 0x7f9f7c155200 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c1ede90 con 0x7f9f5c0047d0 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7c154c40 0x7f9f7c157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7c154c40 0x7f9f7c157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49128/0 (socket says 172.21.15.32:49128) 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 -- 172.21.15.32:0/3408197256 learned_addr learned my addr 172.21.15.32:0/3408197256 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7aa00640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f7c155200 0x7f9f7c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7b400640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f5c0047d0 0x7f9f7c06cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 -- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f5c0047d0 msgr2=0x7f9f7c06cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f5c0047d0 0x7f9f7c06cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 -- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f7c155200 msgr2=0x7f9f7c157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f7c155200 0x7f9f7c157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 -- 172.21.15.32:0/3408197256 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c1ed0d0 con 0x7f9f7c154c40 2024-01-19T04:18:30.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f7be00640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7c154c40 0x7f9f7c157750 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c158bc0 tx=0x7f9f7400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:30.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f73400640 1 -- 172.21.15.32:0/3408197256 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400e040 con 0x7f9f7c154c40 2024-01-19T04:18:30.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f73400640 1 -- 172.21.15.32:0/3408197256 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7400f040 con 0x7f9f7c154c40 2024-01-19T04:18:30.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f73400640 1 -- 172.21.15.32:0/3408197256 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74015430 con 0x7f9f7c154c40 2024-01-19T04:18:30.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c1ed3b0 con 0x7f9f7c154c40 2024-01-19T04:18:30.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.623+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c06d4b0 con 0x7f9f7c154c40 2024-01-19T04:18:30.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.627+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c14f260 con 0x7f9f7c154c40 2024-01-19T04:18:30.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.627+0000 7f9f73400640 1 -- 172.21.15.32:0/3408197256 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9f740157a0 con 0x7f9f7c154c40 2024-01-19T04:18:30.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.627+0000 7f9f73400640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f54066500 0x7f9f540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:30.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.627+0000 7f9f73400640 1 -- 172.21.15.32:0/3408197256 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9f74084d60 con 0x7f9f7c154c40 2024-01-19T04:18:30.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.627+0000 7f9f7b400640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f54066500 0x7f9f540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:30.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.631+0000 7f9f7b400640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f54066500 0x7f9f540689c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c006f90 tx=0x7f9f6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:30.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.631+0000 7f9f73400640 1 -- 172.21.15.32:0/3408197256 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9f74051d40 con 0x7f9f7c154c40 2024-01-19T04:18:30.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.827+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9f7c0749f0 con 0x7f9f7c154c40 2024-01-19T04:18:30.834 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-01-19T04:18:30.831+0000 7f2af4c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T04:18:30.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.831+0000 7f9f73400640 1 -- 172.21.15.32:0/3408197256 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9f74055360 con 0x7f9f7c154c40 2024-01-19T04:18:30.836 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T04:18:30.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f54066500 msgr2=0x7f9f540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f54066500 0x7f9f540689c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c006f90 tx=0x7f9f6c008040 comp rx=0 tx=0).stop 2024-01-19T04:18:30.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7c154c40 msgr2=0x7f9f7c157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:30.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7c154c40 0x7f9f7c157750 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c158bc0 tx=0x7f9f7400f580 comp rx=0 tx=0).stop 2024-01-19T04:18:30.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 shutdown_connections 2024-01-19T04:18:30.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f54066500 0x7f9f540689c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7c154c40 0x7f9f7c157750 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f7c155200 0x7f9f7c157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 --2- 172.21.15.32:0/3408197256 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9f5c0047d0 0x7f9f7c06cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:30.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 >> 172.21.15.32:0/3408197256 conn(0x7f9f7c0726d0 msgr2=0x7f9f7c0c2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:30.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 shutdown_connections 2024-01-19T04:18:30.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.835+0000 7f9f82800640 1 -- 172.21.15.32:0/3408197256 wait complete. 2024-01-19T04:18:30.851 INFO:tasks.ceph.mds.d.smithi067.stderr: -5089> 2024-01-19T04:17:55.795+0000 7fba90600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:18:30.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-19T04:18:30.903 INFO:tasks.ceph.mds.d.smithi067.stdout:starting mds.d at 2024-01-19T04:18:31.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96dda00640 1 Processor -- start 2024-01-19T04:18:31.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96dda00640 1 -- start start 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96dda00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96d80c4e50 0x7f96d80c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96dda00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f96d8152620 0x7f96d806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96dda00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d8152bc0 con 0x7f96d806fd50 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96dda00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d806ea00 con 0x7f96d80c4e50 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96dda00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d8152ea0 con 0x7f96d8152620 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96d80c4e50 0x7f96d80c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96d80c4e50 0x7f96d80c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49130/0 (socket says 172.21.15.32:49130) 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6a00640 1 -- 172.21.15.32:0/1264283461 learned_addr learned my addr 172.21.15.32:0/1264283461 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6000640 1 --2- 172.21.15.32:0/1264283461 >> v2:172.21.15.67:3300/0 conn(0x7f96d8152620 0x7f96d806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6a00640 1 -- 172.21.15.32:0/1264283461 >> v2:172.21.15.67:3300/0 conn(0x7f96d8152620 msgr2=0x7f96d806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6a00640 1 --2- 172.21.15.32:0/1264283461 >> v2:172.21.15.67:3300/0 conn(0x7f96d8152620 0x7f96d806f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6a00640 1 -- 172.21.15.32:0/1264283461 >> v1:172.21.15.67:6789/0 conn(0x7f96d806fd50 legacy=0x7f96d80c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:31.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:30.999+0000 7f96d6a00640 1 -- 172.21.15.32:0/1264283461 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8153180 con 0x7f96d80c4e50 2024-01-19T04:18:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96d6a00640 1 --2- 172.21.15.32:0/1264283461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d80c4e50 0x7f96d80c75a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f96d806b420 tx=0x7f96c801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abf6d937069ed4a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96d5600640 1 -- 172.21.15.32:0/1264283461 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80a89f0 con 0x7f96d80c4e50 2024-01-19T04:18:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96d5600640 1 -- 172.21.15.32:0/1264283461 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c80a8b50 con 0x7f96d80c4e50 2024-01-19T04:18:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96d5600640 1 -- 172.21.15.32:0/1264283461 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80b0440 con 0x7f96d80c4e50 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 -- 172.21.15.32:0/1264283461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d80c4e50 msgr2=0x7f96d80c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 --2- 172.21.15.32:0/1264283461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d80c4e50 0x7f96d80c75a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f96d806b420 tx=0x7f96c801ecf0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 -- 172.21.15.32:0/1264283461 shutdown_connections 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 --2- 172.21.15.32:0/1264283461 >> v2:172.21.15.67:3300/0 conn(0x7f96d8152620 0x7f96d806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 --2- 172.21.15.32:0/1264283461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d80c4e50 0x7f96d80c75a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 -- 172.21.15.32:0/1264283461 >> 172.21.15.32:0/1264283461 conn(0x7f96d80c7d40 msgr2=0x7f96d80c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 -- 172.21.15.32:0/1264283461 shutdown_connections 2024-01-19T04:18:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.003+0000 7f96dda00640 1 -- 172.21.15.32:0/1264283461 wait complete. 2024-01-19T04:18:31.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 Processor -- start 2024-01-19T04:18:31.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 -- start start 2024-01-19T04:18:31.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d806fd50 0x7f96d81e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:31.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96d80c4e50 0x7f96d806ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:31.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96d8152620 0x7f96d81ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:31.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81ed070 con 0x7f96d806fd50 2024-01-19T04:18:31.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81ea8a0 con 0x7f96d8152620 2024-01-19T04:18:31.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d806d500 con 0x7f96d80c4e50 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d806fd50 0x7f96d81e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96d80c4e50 0x7f96d806ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d806fd50 0x7f96d81e9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49144/0 (socket says 172.21.15.32:49144) 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 -- 172.21.15.32:0/2398159665 learned_addr learned my addr 172.21.15.32:0/2398159665 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d7400640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96d8152620 0x7f96d81ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 -- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96d80c4e50 msgr2=0x7f96d806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96d80c4e50 0x7f96d806ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 -- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96d8152620 msgr2=0x7f96d81ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96d8152620 0x7f96d81ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 -- 172.21.15.32:0/2398159665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80094d0 con 0x7f96d806fd50 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96d6a00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d806fd50 0x7f96d81e9920 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f96c801b900 tx=0x7f96c801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:31.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96cea00640 1 -- 172.21.15.32:0/2398159665 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80ba600 con 0x7f96d806fd50 2024-01-19T04:18:31.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96cea00640 1 -- 172.21.15.32:0/2398159665 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c80ba760 con 0x7f96d806fd50 2024-01-19T04:18:31.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96cea00640 1 -- 172.21.15.32:0/2398159665 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80bab10 con 0x7f96d806fd50 2024-01-19T04:18:31.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d81ea000 con 0x7f96d806fd50 2024-01-19T04:18:31.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.007+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d81ea5c0 con 0x7f96d806fd50 2024-01-19T04:18:31.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.011+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d806b560 con 0x7f96d806fd50 2024-01-19T04:18:31.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.011+0000 7f96cea00640 1 -- 172.21.15.32:0/2398159665 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96c80bac70 con 0x7f96d806fd50 2024-01-19T04:18:31.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.011+0000 7f96cea00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96b0066530 0x7f96b00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:31.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.011+0000 7f96cea00640 1 -- 172.21.15.32:0/2398159665 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f96c8122700 con 0x7f96d806fd50 2024-01-19T04:18:31.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.011+0000 7f96d6000640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96b0066530 0x7f96b00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:31.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.011+0000 7f96d6000640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96b0066530 0x7f96b00689f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f96d8147f50 tx=0x7f96c0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:31.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.015+0000 7f96cea00640 1 -- 172.21.15.32:0/2398159665 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f96d806b560 con 0x7f96d806fd50 2024-01-19T04:18:31.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.211+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f96d806b560 con 0x7f96d806fd50 2024-01-19T04:18:31.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96cea00640 1 -- 172.21.15.32:0/2398159665 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96d806b560 con 0x7f96d806fd50 2024-01-19T04:18:31.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96b0066530 msgr2=0x7f96b00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96b0066530 0x7f96b00689f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f96d8147f50 tx=0x7f96c0009190 comp rx=0 tx=0).stop 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d806fd50 msgr2=0x7f96d81e9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d806fd50 0x7f96d81e9920 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f96c801b900 tx=0x7f96c801ba90 comp rx=0 tx=0).stop 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 shutdown_connections 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f96b0066530 0x7f96b00689f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96d8152620 0x7f96d81ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96d80c4e50 0x7f96d806ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 --2- 172.21.15.32:0/2398159665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d806fd50 0x7f96d81e9920 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 >> 172.21.15.32:0/2398159665 conn(0x7f96d80c7d40 msgr2=0x7f96d8150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.835+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 shutdown_connections 2024-01-19T04:18:31.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:31.839+0000 7f96dda00640 1 -- 172.21.15.32:0/2398159665 wait complete. 2024-01-19T04:18:31.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-19T04:18:32.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe572e00640 1 Processor -- start 2024-01-19T04:18:32.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe572e00640 1 -- start start 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe572e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe56c14f9a0 0x7fe56c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe572e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe56c072620 0x7fe56c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe572e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c153140 con 0x7fe56c0c20d0 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe572e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c152530 con 0x7fe56c072620 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe572e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c152810 con 0x7fe56c14f9a0 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe570e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe56c072620 0x7fe56c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe56b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe56c0c20d0 0x7fe56c06c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43196/0 (socket says 172.21.15.32:43196) 2024-01-19T04:18:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe56b400640 1 -- 172.21.15.32:0/929285828 learned_addr learned my addr 172.21.15.32:0/929285828 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:32.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe570e00640 1 -- 172.21.15.32:0/929285828 >> v2:172.21.15.67:3300/0 conn(0x7fe56c14f9a0 msgr2=0x7fe56c0720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:32.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe570e00640 1 --2- 172.21.15.32:0/929285828 >> v2:172.21.15.67:3300/0 conn(0x7fe56c14f9a0 0x7fe56c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe570e00640 1 -- 172.21.15.32:0/929285828 >> v1:172.21.15.32:6789/0 conn(0x7fe56c0c20d0 legacy=0x7fe56c06c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:32.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.011+0000 7fe570e00640 1 -- 172.21.15.32:0/929285828 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c152af0 con 0x7fe56c072620 2024-01-19T04:18:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe570e00640 1 --2- 172.21.15.32:0/929285828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c06c930 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06f320 tx=0x7fe56401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4948368b246d3d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe56aa00640 1 -- 172.21.15.32:0/929285828 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640a5850 con 0x7fe56c072620 2024-01-19T04:18:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe56aa00640 1 -- 172.21.15.32:0/929285828 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5640a59b0 con 0x7fe56c072620 2024-01-19T04:18:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe56aa00640 1 -- 172.21.15.32:0/929285828 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640a5d40 con 0x7fe56c072620 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe572e00640 1 -- 172.21.15.32:0/929285828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 msgr2=0x7fe56c06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe572e00640 1 --2- 172.21.15.32:0/929285828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c06c930 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06f320 tx=0x7fe56401c880 comp rx=0 tx=0).stop 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe572e00640 1 -- 172.21.15.32:0/929285828 shutdown_connections 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe572e00640 1 --2- 172.21.15.32:0/929285828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c06c930 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe572e00640 1 --2- 172.21.15.32:0/929285828 >> v2:172.21.15.67:3300/0 conn(0x7fe56c14f9a0 0x7fe56c0720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.015+0000 7fe572e00640 1 -- 172.21.15.32:0/929285828 >> 172.21.15.32:0/929285828 conn(0x7fe56c0c5b40 msgr2=0x7fe56c0c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 -- 172.21.15.32:0/929285828 shutdown_connections 2024-01-19T04:18:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 -- 172.21.15.32:0/929285828 wait complete. 2024-01-19T04:18:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 Processor -- start 2024-01-19T04:18:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 -- start start 2024-01-19T04:18:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c1f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe56c0c20d0 0x7fe56c14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe56c14f9a0 0x7fe56c1edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c156140 con 0x7fe56c072620 2024-01-19T04:18:32.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c1ed420 con 0x7fe56c0c20d0 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe572e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c1f0700 con 0x7fe56c14f9a0 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c1f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c1f0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49160/0 (socket says 172.21.15.32:49160) 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 -- 172.21.15.32:0/2195088808 learned_addr learned my addr 172.21.15.32:0/2195088808 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56b400640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe56c0c20d0 0x7fe56c14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe570e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe56c14f9a0 0x7fe56c1edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 -- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe56c14f9a0 msgr2=0x7fe56c1edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe56c14f9a0 0x7fe56c1edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 -- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe56c0c20d0 msgr2=0x7fe56c14a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe56c0c20d0 0x7fe56c14a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 -- 172.21.15.32:0/2195088808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564009a70 con 0x7fe56c072620 2024-01-19T04:18:32.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.019+0000 7fe56be00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c1f0b90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00b440 tx=0x7fe55c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe563e00640 1 -- 172.21.15.32:0/2195088808 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c011890 con 0x7fe56c072620 2024-01-19T04:18:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe563e00640 1 -- 172.21.15.32:0/2195088808 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c011a10 con 0x7fe56c072620 2024-01-19T04:18:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c1ed650 con 0x7fe56c072620 2024-01-19T04:18:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe563e00640 1 -- 172.21.15.32:0/2195088808 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c011dc0 con 0x7fe56c072620 2024-01-19T04:18:32.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c1f0390 con 0x7fe56c072620 2024-01-19T04:18:32.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c04e980 con 0x7fe56c072620 2024-01-19T04:18:32.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe563e00640 1 -- 172.21.15.32:0/2195088808 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe55c01a400 con 0x7fe56c072620 2024-01-19T04:18:32.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe563e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe544066500 0x7fe5440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:32.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe563e00640 1 -- 172.21.15.32:0/2195088808 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fe55c0843f0 con 0x7fe56c072620 2024-01-19T04:18:32.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.023+0000 7fe56b400640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe544066500 0x7fe5440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:32.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.027+0000 7fe56b400640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe544066500 0x7fe5440689c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe56c1ea8e0 tx=0x7fe554007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:32.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.027+0000 7fe563e00640 1 -- 172.21.15.32:0/2195088808 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe55c051420 con 0x7fe56c072620 2024-01-19T04:18:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.191+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe56c1f0550 con 0x7fe56c072620 2024-01-19T04:18:32.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.839+0000 7fe563e00640 1 -- 172.21.15.32:0/2195088808 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe55c054a40 con 0x7fe56c072620 2024-01-19T04:18:32.846 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-01-19T04:18:32.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe544066500 msgr2=0x7fe5440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:32.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe544066500 0x7fe5440689c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe56c1ea8e0 tx=0x7fe554007e90 comp rx=0 tx=0).stop 2024-01-19T04:18:32.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 msgr2=0x7fe56c1f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:32.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c1f0b90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00b440 tx=0x7fe55c00b900 comp rx=0 tx=0).stop 2024-01-19T04:18:32.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 shutdown_connections 2024-01-19T04:18:32.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe544066500 0x7fe5440689c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe56c14f9a0 0x7fe56c1edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe56c0c20d0 0x7fe56c14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 --2- 172.21.15.32:0/2195088808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe56c072620 0x7fe56c1f0b90 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:32.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.843+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 >> 172.21.15.32:0/2195088808 conn(0x7fe56c0c5b40 msgr2=0x7fe56c14b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:32.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.847+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 shutdown_connections 2024-01-19T04:18:32.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:32.847+0000 7fe572e00640 1 -- 172.21.15.32:0/2195088808 wait complete. 2024-01-19T04:18:32.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-19T04:18:33.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9698e00640 1 Processor -- start 2024-01-19T04:18:33.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9698e00640 1 -- start start 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9698e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96940c49e0 0x7f96940c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9698e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969406b960 0x7f96940a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9698e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9694158020 con 0x7f96940c5cc0 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9698e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96940c73c0 con 0x7f96940c49e0 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9698e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96940c7c60 con 0x7f969406b960 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.027+0000 7f9691e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96940c49e0 0x7f96940c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9691e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96940c49e0 0x7f96940c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49168/0 (socket says 172.21.15.32:49168) 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9691e00640 1 -- 172.21.15.32:0/1510797395 learned_addr learned my addr 172.21.15.32:0/1510797395 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9692800640 1 --2- 172.21.15.32:0/1510797395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969406b960 0x7f96940a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:33.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9691e00640 1 -- 172.21.15.32:0/1510797395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969406b960 msgr2=0x7f96940a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:33.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9691e00640 1 --2- 172.21.15.32:0/1510797395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969406b960 0x7f96940a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9691e00640 1 -- 172.21.15.32:0/1510797395 >> v1:172.21.15.67:6789/0 conn(0x7f96940c5cc0 legacy=0x7f96941584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:33.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9691e00640 1 -- 172.21.15.32:0/1510797395 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940c61d0 con 0x7f96940c49e0 2024-01-19T04:18:33.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9691e00640 1 --2- 172.21.15.32:0/1510797395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96940c49e0 0x7f96940c3030 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e50c141763ebef5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:33.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9690a00640 1 -- 172.21.15.32:0/1510797395 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840ab5f0 con 0x7f96940c49e0 2024-01-19T04:18:33.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9690a00640 1 -- 172.21.15.32:0/1510797395 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840ab750 con 0x7f96940c49e0 2024-01-19T04:18:33.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.031+0000 7f9690a00640 1 -- 172.21.15.32:0/1510797395 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840abae0 con 0x7f96940c49e0 2024-01-19T04:18:33.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- 172.21.15.32:0/1510797395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96940c49e0 msgr2=0x7f96940c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:33.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 --2- 172.21.15.32:0/1510797395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96940c49e0 0x7f96940c3030 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968401c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- 172.21.15.32:0/1510797395 shutdown_connections 2024-01-19T04:18:33.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 --2- 172.21.15.32:0/1510797395 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f969406b960 0x7f96940a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 --2- 172.21.15.32:0/1510797395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96940c49e0 0x7f96940c3030 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- 172.21.15.32:0/1510797395 >> 172.21.15.32:0/1510797395 conn(0x7f96940a9af0 msgr2=0x7f96940a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:33.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- 172.21.15.32:0/1510797395 shutdown_connections 2024-01-19T04:18:33.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- 172.21.15.32:0/1510797395 wait complete. 2024-01-19T04:18:33.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 Processor -- start 2024-01-19T04:18:33.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- start start 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969406b960 0x7f969406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96940c49e0 0x7f96941f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96940c5cc0 0x7f9694146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941f0ff0 con 0x7f969406b960 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969414ace0 con 0x7f96940c49e0 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9698e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969406fa80 con 0x7f96940c5cc0 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9691e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969406b960 0x7f969406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9691e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969406b960 0x7f969406fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49172/0 (socket says 172.21.15.32:49172) 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9691e00640 1 -- 172.21.15.32:0/233503066 learned_addr learned my addr 172.21.15.32:0/233503066 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:33.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9691400640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96940c49e0 0x7f96941f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:33.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.035+0000 7f9692800640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96940c5cc0 0x7f9694146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:33.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9691e00640 1 -- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96940c5cc0 msgr2=0x7f9694146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:33.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9691e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96940c5cc0 0x7f9694146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9691e00640 1 -- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96940c49e0 msgr2=0x7f96941f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:33.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9691e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96940c49e0 0x7f96941f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9691e00640 1 -- 172.21.15.32:0/233503066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840094d0 con 0x7f969406b960 2024-01-19T04:18:33.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9691e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969406b960 0x7f969406fcc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f96840ad040 tx=0x7f968401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:33.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f968a000640 1 -- 172.21.15.32:0/233503066 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b4800 con 0x7f969406b960 2024-01-19T04:18:33.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96941f0d10 con 0x7f969406b960 2024-01-19T04:18:33.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f968a000640 1 -- 172.21.15.32:0/233503066 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840b4980 con 0x7f969406b960 2024-01-19T04:18:33.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f968a000640 1 -- 172.21.15.32:0/233503066 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b4d30 con 0x7f969406b960 2024-01-19T04:18:33.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9694070200 con 0x7f969406b960 2024-01-19T04:18:33.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694068290 con 0x7f969406b960 2024-01-19T04:18:33.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f968a000640 1 -- 172.21.15.32:0/233503066 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f96840c7440 con 0x7f969406b960 2024-01-19T04:18:33.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.039+0000 7f968a000640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f966c066500 0x7f966c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:33.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.043+0000 7f968a000640 1 -- 172.21.15.32:0/233503066 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f96840a8050 con 0x7f969406b960 2024-01-19T04:18:33.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.043+0000 7f9691400640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f966c066500 0x7f966c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:33.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.043+0000 7f9691400640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f966c066500 0x7f966c0689c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f96941eab30 tx=0x7f967c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:33.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.043+0000 7f968a000640 1 -- 172.21.15.32:0/233503066 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f96840ebc90 con 0x7f969406b960 2024-01-19T04:18:33.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.203+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f969414d240 con 0x7f969406b960 2024-01-19T04:18:33.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.843+0000 7f968a000640 1 -- 172.21.15.32:0/233503066 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) v1 ==== 169+0+0 (secure 0 0 0) 0x7f969414d240 con 0x7f969406b960 2024-01-19T04:18:33.848 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-01-19T04:18:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f966c066500 msgr2=0x7f966c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f966c066500 0x7f966c0689c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f96941eab30 tx=0x7f967c009040 comp rx=0 tx=0).stop 2024-01-19T04:18:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969406b960 msgr2=0x7f969406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969406b960 0x7f969406fcc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f96840ad040 tx=0x7f968401ac30 comp rx=0 tx=0).stop 2024-01-19T04:18:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 shutdown_connections 2024-01-19T04:18:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f966c066500 0x7f966c0689c0 secure :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f96941eab30 tx=0x7f967c009040 comp rx=0 tx=0).stop 2024-01-19T04:18:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f96940c5cc0 0x7f9694146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96940c49e0 0x7f96941f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 --2- 172.21.15.32:0/233503066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969406b960 0x7f969406fcc0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 >> 172.21.15.32:0/233503066 conn(0x7f96940a9af0 msgr2=0x7f96940a9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:33.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 shutdown_connections 2024-01-19T04:18:33.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:33.847+0000 7f9698e00640 1 -- 172.21.15.32:0/233503066 wait complete. 2024-01-19T04:18:33.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:34.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.027+0000 7f035fe00640 1 Processor -- start 2024-01-19T04:18:34.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.027+0000 7f035fe00640 1 -- start start 2024-01-19T04:18:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0358147f90 0x7f0358151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c18b0 0x7f03580a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035fe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580c1d40 con 0x7f03580c55e0 2024-01-19T04:18:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035fe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035806c5c0 con 0x7f0358147f90 2024-01-19T04:18:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035fe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03580c0810 con 0x7f03580c18b0 2024-01-19T04:18:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035ca00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f03580c55e0 0x7f035806beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43200/0 (socket says 172.21.15.32:43200) 2024-01-19T04:18:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035ca00640 1 -- 172.21.15.32:0/4254065206 learned_addr learned my addr 172.21.15.32:0/4254065206 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035de00640 1 --2- 172.21.15.32:0/4254065206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c18b0 0x7f03580a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035d400640 1 --2- 172.21.15.32:0/4254065206 >> v2:172.21.15.67:3300/0 conn(0x7f0358147f90 0x7f0358151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f0357e00640 1 -- 172.21.15.32:0/4254065206 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910496223 0 0) 0x7f03580c1d40 con 0x7f03580c55e0 2024-01-19T04:18:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f0357e00640 1 -- 172.21.15.32:0/4254065206 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0338003530 con 0x7f03580c55e0 2024-01-19T04:18:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035de00640 1 -- 172.21.15.32:0/4254065206 >> v2:172.21.15.67:3300/0 conn(0x7f0358147f90 msgr2=0x7f0358151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035de00640 1 --2- 172.21.15.32:0/4254065206 >> v2:172.21.15.67:3300/0 conn(0x7f0358147f90 0x7f0358151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035de00640 1 -- 172.21.15.32:0/4254065206 >> v1:172.21.15.32:6789/0 conn(0x7f03580c55e0 legacy=0x7f035806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.031+0000 7f035de00640 1 -- 172.21.15.32:0/4254065206 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03580c0af0 con 0x7f03580c18b0 2024-01-19T04:18:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035de00640 1 --2- 172.21.15.32:0/4254065206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c18b0 0x7f03580a4d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f035001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d38b958f9408b8a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f0357e00640 1 -- 172.21.15.32:0/4254065206 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500a5950 con 0x7f03580c18b0 2024-01-19T04:18:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f0357e00640 1 -- 172.21.15.32:0/4254065206 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500a5ab0 con 0x7f03580c18b0 2024-01-19T04:18:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f0357e00640 1 -- 172.21.15.32:0/4254065206 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500a5e40 con 0x7f03580c18b0 2024-01-19T04:18:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 -- 172.21.15.32:0/4254065206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c18b0 msgr2=0x7f03580a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 --2- 172.21.15.32:0/4254065206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c18b0 0x7f03580a4d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f035001c890 comp rx=0 tx=0).stop 2024-01-19T04:18:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 -- 172.21.15.32:0/4254065206 shutdown_connections 2024-01-19T04:18:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 --2- 172.21.15.32:0/4254065206 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c18b0 0x7f03580a4d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 --2- 172.21.15.32:0/4254065206 >> v2:172.21.15.67:3300/0 conn(0x7f0358147f90 0x7f0358151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 -- 172.21.15.32:0/4254065206 >> 172.21.15.32:0/4254065206 conn(0x7f03580c5b20 msgr2=0x7f03580c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 -- 172.21.15.32:0/4254065206 shutdown_connections 2024-01-19T04:18:34.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 -- 172.21.15.32:0/4254065206 wait complete. 2024-01-19T04:18:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 Processor -- start 2024-01-19T04:18:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.035+0000 7f035fe00640 1 -- start start 2024-01-19T04:18:34.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03580c18b0 0x7f0358146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c55e0 0x7f0358147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0358147f90 0x7f035814a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03581492b0 con 0x7f0358147f90 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358148370 con 0x7f03580c18b0 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0358148930 con 0x7f03580c55e0 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0358147f90 0x7f035814a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0358147f90 0x7f035814a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49180/0 (socket says 172.21.15.32:49180) 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 -- 172.21.15.32:0/2854162854 learned_addr learned my addr 172.21.15.32:0/2854162854 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035d400640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03580c18b0 0x7f0358146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035ca00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c55e0 0x7f0358147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 -- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c55e0 msgr2=0x7f0358147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c55e0 0x7f0358147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 -- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03580c18b0 msgr2=0x7f0358146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03580c18b0 0x7f0358146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 -- 172.21.15.32:0/2854162854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350009a70 con 0x7f0358147f90 2024-01-19T04:18:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035de00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0358147f90 0x7f035814a3b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f035001af40 tx=0x7f0350019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f0355600640 1 -- 172.21.15.32:0/2854162854 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500adce0 con 0x7f0358147f90 2024-01-19T04:18:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f0355600640 1 -- 172.21.15.32:0/2854162854 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500ade40 con 0x7f0358147f90 2024-01-19T04:18:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f0355600640 1 -- 172.21.15.32:0/2854162854 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500b9670 con 0x7f0358147f90 2024-01-19T04:18:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03581edb80 con 0x7f0358147f90 2024-01-19T04:18:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03581485c0 con 0x7f0358147f90 2024-01-19T04:18:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03580749f0 con 0x7f0358147f90 2024-01-19T04:18:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.039+0000 7f0355600640 1 -- 172.21.15.32:0/2854162854 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f03500b97d0 con 0x7f0358147f90 2024-01-19T04:18:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.043+0000 7f0355600640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0330066500 0x7f03300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.043+0000 7f0355600640 1 -- 172.21.15.32:0/2854162854 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f035011f5b0 con 0x7f0358147f90 2024-01-19T04:18:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.043+0000 7f035d400640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0330066500 0x7f03300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.043+0000 7f035d400640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0330066500 0x7f03300689c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f03581eaea0 tx=0x7f0348009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.047+0000 7f0355600640 1 -- 172.21.15.32:0/2854162854 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f03500ec810 con 0x7f0358147f90 2024-01-19T04:18:34.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.211+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0358148a70 con 0x7f0358147f90 2024-01-19T04:18:34.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f0355600640 1 -- 172.21.15.32:0/2854162854 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16544 (secure 0 0 0) 0x7f0350009450 con 0x7f0358147f90 2024-01-19T04:18:34.218 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:34.219 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":78,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:33.846537+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/208534071":"2024-01-20T04:18:30.834878+0000","172.21.15.67:6835/208534071":"2024-01-20T04:18:30.834878+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0330066500 msgr2=0x7f03300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0330066500 0x7f03300689c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f03581eaea0 tx=0x7f0348009190 comp rx=0 tx=0).stop 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0358147f90 msgr2=0x7f035814a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0358147f90 0x7f035814a3b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f035001af40 tx=0x7f0350019630 comp rx=0 tx=0).stop 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 shutdown_connections 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f0330066500 0x7f03300689c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0358147f90 0x7f035814a3b0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f03580c55e0 0x7f0358147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 --2- 172.21.15.32:0/2854162854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03580c18b0 0x7f0358146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 >> 172.21.15.32:0/2854162854 conn(0x7f03580c5b20 msgr2=0x7f03581511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 shutdown_connections 2024-01-19T04:18:34.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.215+0000 7f035fe00640 1 -- 172.21.15.32:0/2854162854 wait complete. 2024-01-19T04:18:34.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T04:14:50.088600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-19T04:18:00.535616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-19T04:18:01.296998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T04:18:34.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T04:18:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56fc00640 1 Processor -- start 2024-01-19T04:18:34.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56fc00640 1 -- start start 2024-01-19T04:18:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56fc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff568072490 0x7ff56806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56fc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff5680a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56fc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680beed0 con 0x7ff568155520 2024-01-19T04:18:34.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56fc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56806e0c0 con 0x7ff568072490 2024-01-19T04:18:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56fc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680c3a80 con 0x7ff5680bf360 2024-01-19T04:18:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff567e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff568072490 0x7ff56806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff5680a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56d200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff568155520 0x7ff56806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:34308/0 (socket says 172.21.15.32:34308) 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56d200640 1 -- 172.21.15.32:0/2460983554 learned_addr learned my addr 172.21.15.32:0/2460983554 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff567e00640 1 --2- 172.21.15.32:0/2460983554 >> v2:172.21.15.67:3300/0 conn(0x7ff568072490 0x7ff56806c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:43070/0 (socket says 172.21.15.32:43070) 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff567e00640 1 -- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 msgr2=0x7ff5680a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff567e00640 1 --2- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff5680a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff567400640 1 -- 172.21.15.32:0/2460983554 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350828904 0 0) 0x7ff5680beed0 con 0x7ff568155520 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff567e00640 1 -- 172.21.15.32:0/2460983554 >> v1:172.21.15.67:6789/0 conn(0x7ff568155520 legacy=0x7ff56806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff567e00640 1 -- 172.21.15.32:0/2460983554 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680c3d60 con 0x7ff568072490 2024-01-19T04:18:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.383+0000 7ff56dc00640 1 --2- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff5680a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff567e00640 1 --2- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 0x7ff56806c220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff5500097c0 tx=0x7ff55001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7ba1dbe9921624 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff567400640 1 -- 172.21.15.32:0/2460983554 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500ab600 con 0x7ff568072490 2024-01-19T04:18:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff567400640 1 -- 172.21.15.32:0/2460983554 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5500a7050 con 0x7ff568072490 2024-01-19T04:18:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff567400640 1 -- 172.21.15.32:0/2460983554 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500ab980 con 0x7ff568072490 2024-01-19T04:18:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 -- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 msgr2=0x7ff56806c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 --2- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 0x7ff56806c220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff5500097c0 tx=0x7ff55001c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 -- 172.21.15.32:0/2460983554 shutdown_connections 2024-01-19T04:18:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 --2- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff5680a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 --2- 172.21.15.32:0/2460983554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 0x7ff56806c220 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 -- 172.21.15.32:0/2460983554 >> 172.21.15.32:0/2460983554 conn(0x7ff5680c25a0 msgr2=0x7ff5680c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 -- 172.21.15.32:0/2460983554 shutdown_connections 2024-01-19T04:18:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.387+0000 7ff56fc00640 1 -- 172.21.15.32:0/2460983554 wait complete. 2024-01-19T04:18:34.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 Processor -- start 2024-01-19T04:18:34.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 -- start start 2024-01-19T04:18:34.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 0x7ff56814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff568071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff568155520 0x7ff568148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff568152420 con 0x7ff568155520 2024-01-19T04:18:34.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681573f0 con 0x7ff568072490 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff568157e80 con 0x7ff5680bf360 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff568155520 0x7ff568148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff568155520 0x7ff568148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49190/0 (socket says 172.21.15.32:49190) 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 -- 172.21.15.32:0/1681609116 learned_addr learned my addr 172.21.15.32:0/1681609116 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56d200640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 0x7ff56814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff567e00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff568071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 -- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 msgr2=0x7ff568071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff568071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 -- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 msgr2=0x7ff56814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 0x7ff56814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 -- 172.21.15.32:0/1681609116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560009a70 con 0x7ff568155520 2024-01-19T04:18:34.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56dc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff568155520 0x7ff568148e20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ff56000efc0 tx=0x7ff560009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff564c00640 1 -- 172.21.15.32:0/1681609116 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560009d70 con 0x7ff568155520 2024-01-19T04:18:34.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff564c00640 1 -- 172.21.15.32:0/1681609116 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56000f040 con 0x7ff568155520 2024-01-19T04:18:34.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff564c00640 1 -- 172.21.15.32:0/1681609116 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600039a0 con 0x7ff568155520 2024-01-19T04:18:34.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff550009420 con 0x7ff568155520 2024-01-19T04:18:34.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.391+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff568158400 con 0x7ff568155520 2024-01-19T04:18:34.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.395+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5680c05e0 con 0x7ff568155520 2024-01-19T04:18:34.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.395+0000 7ff564c00640 1 -- 172.21.15.32:0/1681609116 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff5600144a0 con 0x7ff568155520 2024-01-19T04:18:34.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.395+0000 7ff564c00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff540066530 0x7ff5400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.395+0000 7ff564c00640 1 -- 172.21.15.32:0/1681609116 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff560084a10 con 0x7ff568155520 2024-01-19T04:18:34.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.395+0000 7ff56d200640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff540066530 0x7ff5400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.395+0000 7ff56d200640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff540066530 0x7ff5400689f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff558000f70 tx=0x7ff558007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.399+0000 7ff564c00640 1 -- 172.21.15.32:0/1681609116 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff560051cf0 con 0x7ff568155520 2024-01-19T04:18:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.559+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5680749f0 con 0x7ff568155520 2024-01-19T04:18:34.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.559+0000 7ff564c00640 1 -- 172.21.15.32:0/1681609116 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5600180a0 con 0x7ff568155520 2024-01-19T04:18:34.564 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-01-19T04:18:34.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff540066530 msgr2=0x7ff5400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff540066530 0x7ff5400689f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff558000f70 tx=0x7ff558007df0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff568155520 msgr2=0x7ff568148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff568155520 0x7ff568148e20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ff56000efc0 tx=0x7ff560009f90 comp rx=0 tx=0).stop 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 shutdown_connections 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7ff540066530 0x7ff5400689f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff568155520 0x7ff568148e20 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7ff5680bf360 0x7ff568071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 --2- 172.21.15.32:0/1681609116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff568072490 0x7ff56814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 >> 172.21.15.32:0/1681609116 conn(0x7ff5680c25a0 msgr2=0x7ff568153660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 shutdown_connections 2024-01-19T04:18:34.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.563+0000 7ff56fc00640 1 -- 172.21.15.32:0/1681609116 wait complete. 2024-01-19T04:18:34.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-19T04:18:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f581ac00640 1 Processor -- start 2024-01-19T04:18:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f581ac00640 1 -- start start 2024-01-19T04:18:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f581ac00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f58140c2080 0x7f5814155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f581ac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 0x7f58140c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f581ac00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58140a4ea0 con 0x7f58140723b0 2024-01-19T04:18:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f581ac00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58141524a0 con 0x7f58140c2080 2024-01-19T04:18:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f581ac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5814152a20 con 0x7f581406d440 2024-01-19T04:18:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5813e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f58140723b0 0x7f5814152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43202/0 (socket says 172.21.15.32:43202) 2024-01-19T04:18:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5813e00640 1 -- 172.21.15.32:0/2752573868 learned_addr learned my addr 172.21.15.32:0/2752573868 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:34.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219248747 0 0) 0x7f58140a4ea0 con 0x7f58140723b0 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f4003530 con 0x7f58140723b0 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5813400640 1 --2- 172.21.15.32:0/2752573868 >> v2:172.21.15.67:3300/0 conn(0x7f58140c2080 0x7f5814155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5818c00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 0x7f58140c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2450200497 0 0) 0x7f57f4003530 con 0x7f58140723b0 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 msgr2=0x7f58140c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 0x7f58140c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 >> v2:172.21.15.67:3300/0 conn(0x7f58140c2080 msgr2=0x7f5814155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 --2- 172.21.15.32:0/2752573868 >> v2:172.21.15.67:3300/0 conn(0x7f58140c2080 0x7f5814155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58140c3430 con 0x7f58140723b0 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f5804001680 con 0x7f58140723b0 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5818c00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 0x7f58140c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 >> v1:172.21.15.32:6789/0 conn(0x7f58140723b0 legacy=0x7f5814152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 0x7f57f4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57f4003ec0 0x7f57f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57f4004d10 0x7f57f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58141524a0 con 0x7f57f4003ec0 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5814152a20 con 0x7f57f4004d10 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f400baf0 con 0x7f581406d440 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.727+0000 7f5813400640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57f4003ec0 0x7f57f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5818c00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57f4004d10 0x7f57f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5813e00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 0x7f57f4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5813400640 1 -- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 msgr2=0x7f57f4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5813400640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f581406d440 0x7f57f4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5813400640 1 -- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57f4004d10 msgr2=0x7f57f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5813400640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57f4004d10 0x7f57f4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5813400640 1 -- 172.21.15.32:0/2752573868 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4003530 con 0x7f57f4003ec0 2024-01-19T04:18:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5818c00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57f4004d10 0x7f57f4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5813400640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57f4003ec0 0x7f57f40047d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009ab0 tx=0x7f57fc01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93182163de39719 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0a5610 con 0x7f57f4003ec0 2024-01-19T04:18:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0a5770 con 0x7f57f4003ec0 2024-01-19T04:18:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.731+0000 7f5812a00640 1 -- 172.21.15.32:0/2752573868 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0a5b20 con 0x7f57f4003ec0 2024-01-19T04:18:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- 172.21.15.32:0/2752573868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57f4003ec0 msgr2=0x7f57f40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 --2- 172.21.15.32:0/2752573868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57f4003ec0 0x7f57f40047d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009ab0 tx=0x7f57fc01ca40 comp rx=0 tx=0).stop 2024-01-19T04:18:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f5818c00640 1 -- 172.21.15.32:0/2752573868 reap_dead start 2024-01-19T04:18:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- 172.21.15.32:0/2752573868 shutdown_connections 2024-01-19T04:18:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- 172.21.15.32:0/2752573868 >> 172.21.15.32:0/2752573868 conn(0x7f58140c25a0 msgr2=0x7f58140c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- 172.21.15.32:0/2752573868 shutdown_connections 2024-01-19T04:18:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- 172.21.15.32:0/2752573868 wait complete. 2024-01-19T04:18:34.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 Processor -- start 2024-01-19T04:18:34.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- start start 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57f4003ec0 0x7f58140aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5814159ae0 0x7f5814147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5814148130 0x7f58141eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581414a680 con 0x7f5814148130 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581414e680 con 0x7f5814159ae0 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f581ac00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581414b520 con 0x7f57f4003ec0 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f5818c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5814148130 0x7f58141eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f5818c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5814148130 0x7f58141eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49210/0 (socket says 172.21.15.32:49210) 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.735+0000 7f5818c00640 1 -- 172.21.15.32:0/180625538 learned_addr learned my addr 172.21.15.32:0/180625538 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5813e00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57f4003ec0 0x7f58140aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5813400640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5814159ae0 0x7f5814147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5818c00640 1 -- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57f4003ec0 msgr2=0x7f58140aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5818c00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57f4003ec0 0x7f58140aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5818c00640 1 -- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5814159ae0 msgr2=0x7f5814147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5818c00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5814159ae0 0x7f5814147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5818c00640 1 -- 172.21.15.32:0/180625538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581414af60 con 0x7f5814148130 2024-01-19T04:18:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f5818c00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5814148130 0x7f58141eacc0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f58140c5ab0 tx=0x7f580c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f580be00640 1 -- 172.21.15.32:0/180625538 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c007cd0 con 0x7f5814148130 2024-01-19T04:18:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f580be00640 1 -- 172.21.15.32:0/180625538 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c00f050 con 0x7f5814148130 2024-01-19T04:18:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f580be00640 1 -- 172.21.15.32:0/180625538 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c014650 con 0x7f5814148130 2024-01-19T04:18:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581414b240 con 0x7f5814148130 2024-01-19T04:18:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58140ab4c0 con 0x7f5814148130 2024-01-19T04:18:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58140749f0 con 0x7f5814148130 2024-01-19T04:18:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f580be00640 1 -- 172.21.15.32:0/180625538 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f580c0147b0 con 0x7f5814148130 2024-01-19T04:18:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f580be00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57ec066500 0x7f57ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.739+0000 7f580be00640 1 -- 172.21.15.32:0/180625538 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f580c084430 con 0x7f5814148130 2024-01-19T04:18:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.743+0000 7f5813e00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57ec066500 0x7f57ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.743+0000 7f5813e00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57ec066500 0x7f57ec0689c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5804000c10 tx=0x7f5804009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:34.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.743+0000 7f580be00640 1 -- 172.21.15.32:0/180625538 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f580c0515d0 con 0x7f5814148130 2024-01-19T04:18:34.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.903+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f581414a9a0 con 0x7f5814148130 2024-01-19T04:18:34.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f580be00640 1 -- 172.21.15.32:0/180625538 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v78) v1 ==== 105+0+11 (secure 0 0 0) 0x7f580c054bf0 con 0x7f5814148130 2024-01-19T04:18:34.910 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57ec066500 msgr2=0x7f57ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57ec066500 0x7f57ec0689c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5804000c10 tx=0x7f5804009040 comp rx=0 tx=0).stop 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5814148130 msgr2=0x7f58141eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5814148130 0x7f58141eacc0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f58140c5ab0 tx=0x7f580c0047b0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 shutdown_connections 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f57ec066500 0x7f57ec0689c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5814148130 0x7f58141eacc0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5814159ae0 0x7f5814147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 --2- 172.21.15.32:0/180625538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f57f4003ec0 0x7f58140aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:34.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 >> 172.21.15.32:0/180625538 conn(0x7f58140c25a0 msgr2=0x7f58141513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:34.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 shutdown_connections 2024-01-19T04:18:34.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:34.907+0000 7f581ac00640 1 -- 172.21.15.32:0/180625538 wait complete. 2024-01-19T04:18:34.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-19T04:18:35.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.071+0000 7fc5a0a00640 1 Processor -- start 2024-01-19T04:18:35.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.071+0000 7fc5a0a00640 1 -- start start 2024-01-19T04:18:35.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc5a0a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc598151b80 0x7fc598155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc5a0a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc598157cc0 0x7fc5980c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc5a0a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc5980c4cd0 0x7fc5980c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc5a0a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980c34a0 con 0x7fc5980c4cd0 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc5a0a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc598155730 con 0x7fc598157cc0 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc5a0a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980c2d30 con 0x7fc598151b80 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc5980c4cd0 0x7fc5980c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc5980c4cd0 0x7fc5980c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49220/0 (socket says 172.21.15.32:49220) 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 -- 172.21.15.32:0/266338615 learned_addr learned my addr 172.21.15.32:0/266338615 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59e000640 1 --2- 172.21.15.32:0/266338615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc598151b80 0x7fc598155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59d600640 1 --2- 172.21.15.32:0/266338615 >> v2:172.21.15.67:3300/0 conn(0x7fc598157cc0 0x7fc5980c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 -- 172.21.15.32:0/266338615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc598151b80 msgr2=0x7fc598155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 --2- 172.21.15.32:0/266338615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc598151b80 0x7fc598155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 -- 172.21.15.32:0/266338615 >> v2:172.21.15.67:3300/0 conn(0x7fc598157cc0 msgr2=0x7fc5980c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:35.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 --2- 172.21.15.32:0/266338615 >> v2:172.21.15.67:3300/0 conn(0x7fc598157cc0 0x7fc5980c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59ea00640 1 -- 172.21.15.32:0/266338615 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5980c3010 con 0x7fc5980c4cd0 2024-01-19T04:18:35.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.075+0000 7fc59d600640 1 --2- 172.21.15.32:0/266338615 >> v2:172.21.15.67:3300/0 conn(0x7fc598157cc0 0x7fc5980c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:35.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc59ea00640 1 --2- 172.21.15.32:0/266338615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5980c4cd0 0x7fc5980c6360 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc59806b360 tx=0x7fc59001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd1ffb800928528 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc59cc00640 1 -- 172.21.15.32:0/266338615 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900af400 con 0x7fc5980c4cd0 2024-01-19T04:18:35.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc59cc00640 1 -- 172.21.15.32:0/266338615 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5900ab050 con 0x7fc5980c4cd0 2024-01-19T04:18:35.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc59cc00640 1 -- 172.21.15.32:0/266338615 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900af780 con 0x7fc5980c4cd0 2024-01-19T04:18:35.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 -- 172.21.15.32:0/266338615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5980c4cd0 msgr2=0x7fc5980c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/266338615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5980c4cd0 0x7fc5980c6360 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc59806b360 tx=0x7fc59001f1c0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 -- 172.21.15.32:0/266338615 shutdown_connections 2024-01-19T04:18:35.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/266338615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5980c4cd0 0x7fc5980c6360 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/266338615 >> v2:172.21.15.67:3300/0 conn(0x7fc598157cc0 0x7fc5980c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/266338615 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc598151b80 0x7fc598155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 -- 172.21.15.32:0/266338615 >> 172.21.15.32:0/266338615 conn(0x7fc5980c7d40 msgr2=0x7fc5980c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:35.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 -- 172.21.15.32:0/266338615 shutdown_connections 2024-01-19T04:18:35.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 -- 172.21.15.32:0/266338615 wait complete. 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 Processor -- start 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.079+0000 7fc5a0a00640 1 -- start start 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5980c4cd0 0x7fc5980ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc598151b80 0x7fc59814e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc598157cc0 0x7fc59814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5981ed250 con 0x7fc598151b80 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980ac4c0 con 0x7fc598157cc0 2024-01-19T04:18:35.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59814eb10 con 0x7fc5980c4cd0 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc598151b80 0x7fc59814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc598151b80 0x7fc59814e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49224/0 (socket says 172.21.15.32:49224) 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 -- 172.21.15.32:0/3052818518 learned_addr learned my addr 172.21.15.32:0/3052818518 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59ea00640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc598157cc0 0x7fc59814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59e000640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5980c4cd0 0x7fc5980ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 -- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5980c4cd0 msgr2=0x7fc5980ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5980c4cd0 0x7fc5980ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 -- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc598157cc0 msgr2=0x7fc59814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc598157cc0 0x7fc59814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 -- 172.21.15.32:0/3052818518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590009b30 con 0x7fc598151b80 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59e000640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5980c4cd0 0x7fc5980ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc59d600640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc598151b80 0x7fc59814e090 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc58000e810 tx=0x7fc58000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc596000640 1 -- 172.21.15.32:0/3052818518 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000c8d0 con 0x7fc598151b80 2024-01-19T04:18:35.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc596000640 1 -- 172.21.15.32:0/3052818518 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000ca30 con 0x7fc598151b80 2024-01-19T04:18:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc596000640 1 -- 172.21.15.32:0/3052818518 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000cdc0 con 0x7fc598151b80 2024-01-19T04:18:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5981ea210 con 0x7fc598151b80 2024-01-19T04:18:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5981ea7d0 con 0x7fc598151b80 2024-01-19T04:18:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.083+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5980749f0 con 0x7fc598151b80 2024-01-19T04:18:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.087+0000 7fc596000640 1 -- 172.21.15.32:0/3052818518 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc580013410 con 0x7fc598151b80 2024-01-19T04:18:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.087+0000 7fc596000640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc570066500 0x7fc5700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.087+0000 7fc596000640 1 -- 172.21.15.32:0/3052818518 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc580083c20 con 0x7fc598151b80 2024-01-19T04:18:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.087+0000 7fc59e000640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc570066500 0x7fc5700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.087+0000 7fc59e000640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc570066500 0x7fc5700689c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc588004660 tx=0x7fc588008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.091+0000 7fc596000640 1 -- 172.21.15.32:0/3052818518 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc580050f00 con 0x7fc598151b80 2024-01-19T04:18:35.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.255+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fc5980c5c40 con 0x7fc598151b80 2024-01-19T04:18:35.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc596000640 1 -- 172.21.15.32:0/3052818518 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v78) v1 ==== 101+0+11 (secure 0 0 0) 0x7fc580009480 con 0x7fc598151b80 2024-01-19T04:18:35.262 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-01-19T04:18:35.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc570066500 msgr2=0x7fc5700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc570066500 0x7fc5700689c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc588004660 tx=0x7fc588008040 comp rx=0 tx=0).stop 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc598151b80 msgr2=0x7fc59814e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc598151b80 0x7fc59814e090 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc58000e810 tx=0x7fc58000ecd0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 shutdown_connections 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc570066500 0x7fc5700689c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc598157cc0 0x7fc59814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc598151b80 0x7fc59814e090 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 --2- 172.21.15.32:0/3052818518 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc5980c4cd0 0x7fc5980ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 >> 172.21.15.32:0/3052818518 conn(0x7fc5980c7d40 msgr2=0x7fc5980aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 shutdown_connections 2024-01-19T04:18:35.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.259+0000 7fc5a0a00640 1 -- 172.21.15.32:0/3052818518 wait complete. 2024-01-19T04:18:35.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:35.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1489000640 1 Processor -- start 2024-01-19T04:18:35.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1489000640 1 -- start start 2024-01-19T04:18:35.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1489000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f14840a7200 0x7f14840c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1489000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f14840c41f0 0x7f1484154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1489000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14841547e0 con 0x7f1484151de0 2024-01-19T04:18:35.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1489000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14841521c0 con 0x7f14840a7200 2024-01-19T04:18:35.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1489000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148406f820 con 0x7f14840c41f0 2024-01-19T04:18:35.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1481400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f14840a7200 0x7f14840c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1481e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1484151de0 0x7f14840c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43216/0 (socket says 172.21.15.32:43216) 2024-01-19T04:18:35.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1481e00640 1 -- 172.21.15.32:0/2939446719 learned_addr learned my addr 172.21.15.32:0/2939446719 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:35.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1482800640 1 --2- 172.21.15.32:0/2939446719 >> v2:172.21.15.67:3300/0 conn(0x7f14840c41f0 0x7f1484154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1481400640 1 -- 172.21.15.32:0/2939446719 >> v2:172.21.15.67:3300/0 conn(0x7f14840c41f0 msgr2=0x7f1484154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:35.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1481400640 1 --2- 172.21.15.32:0/2939446719 >> v2:172.21.15.67:3300/0 conn(0x7f14840c41f0 0x7f1484154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1480a00640 1 -- 172.21.15.32:0/2939446719 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331795274 0 0) 0x7f14841547e0 con 0x7f1484151de0 2024-01-19T04:18:35.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1481400640 1 -- 172.21.15.32:0/2939446719 >> v1:172.21.15.32:6789/0 conn(0x7f1484151de0 legacy=0x7f14840c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.423+0000 7f1481400640 1 -- 172.21.15.32:0/2939446719 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148406fb00 con 0x7f14840a7200 2024-01-19T04:18:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1481400640 1 --2- 172.21.15.32:0/2939446719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14840a7200 0x7f14840c3cb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1484158d40 tx=0x7f146c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda456e909fdbdc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1480a00640 1 -- 172.21.15.32:0/2939446719 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c0ac600 con 0x7f14840a7200 2024-01-19T04:18:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1480a00640 1 -- 172.21.15.32:0/2939446719 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c0a8050 con 0x7f14840a7200 2024-01-19T04:18:35.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1480a00640 1 -- 172.21.15.32:0/2939446719 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c0ac980 con 0x7f14840a7200 2024-01-19T04:18:35.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 -- 172.21.15.32:0/2939446719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14840a7200 msgr2=0x7f14840c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 --2- 172.21.15.32:0/2939446719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14840a7200 0x7f14840c3cb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1484158d40 tx=0x7f146c01c3a0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 -- 172.21.15.32:0/2939446719 shutdown_connections 2024-01-19T04:18:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 --2- 172.21.15.32:0/2939446719 >> v2:172.21.15.67:3300/0 conn(0x7f14840c41f0 0x7f1484154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 --2- 172.21.15.32:0/2939446719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14840a7200 0x7f14840c3cb0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 -- 172.21.15.32:0/2939446719 >> 172.21.15.32:0/2939446719 conn(0x7f14840726d0 msgr2=0x7f14840663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 -- 172.21.15.32:0/2939446719 shutdown_connections 2024-01-19T04:18:35.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.427+0000 7f1489000640 1 -- 172.21.15.32:0/2939446719 wait complete. 2024-01-19T04:18:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 Processor -- start 2024-01-19T04:18:35.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 -- start start 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14840a7200 0x7f148414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14840c41f0 0x7f1484146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1484151de0 0x7f1484146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148414cf60 con 0x7f1484151de0 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840ab290 con 0x7f14840a7200 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840aaa80 con 0x7f14840c41f0 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1484151de0 0x7f1484146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1484151de0 0x7f1484146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49236/0 (socket says 172.21.15.32:49236) 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 -- 172.21.15.32:0/3498412101 learned_addr learned my addr 172.21.15.32:0/3498412101 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1481400640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14840c41f0 0x7f1484146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1481e00640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14840a7200 0x7f148414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 -- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14840c41f0 msgr2=0x7f1484146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14840c41f0 0x7f1484146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 -- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14840a7200 msgr2=0x7f148414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14840a7200 0x7f148414c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 -- 172.21.15.32:0/3498412101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c009420 con 0x7f1484151de0 2024-01-19T04:18:35.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1482800640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1484151de0 0x7f1484146c40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f147c00efc0 tx=0x7f147c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f147a000640 1 -- 172.21.15.32:0/3498412101 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c009b10 con 0x7f1484151de0 2024-01-19T04:18:35.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f147a000640 1 -- 172.21.15.32:0/3498412101 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00f040 con 0x7f1484151de0 2024-01-19T04:18:35.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f147a000640 1 -- 172.21.15.32:0/3498412101 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c0146c0 con 0x7f1484151de0 2024-01-19T04:18:35.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148414e9c0 con 0x7f1484151de0 2024-01-19T04:18:35.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14840aafb0 con 0x7f1484151de0 2024-01-19T04:18:35.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.431+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14840749f0 con 0x7f1484151de0 2024-01-19T04:18:35.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.435+0000 7f147a000640 1 -- 172.21.15.32:0/3498412101 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f147c014820 con 0x7f1484151de0 2024-01-19T04:18:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.435+0000 7f147a000640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f145c066500 0x7f145c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.435+0000 7f147a000640 1 -- 172.21.15.32:0/3498412101 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f147c084d50 con 0x7f1484151de0 2024-01-19T04:18:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.435+0000 7f1481e00640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f145c066500 0x7f145c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.435+0000 7f1481e00640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f145c066500 0x7f145c0689c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1474007fd0 tx=0x7f1474007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.439+0000 7f147a000640 1 -- 172.21.15.32:0/3498412101 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f147c051f80 con 0x7f1484151de0 2024-01-19T04:18:35.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f148414a440 con 0x7f1484151de0 2024-01-19T04:18:35.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f147a000640 1 -- 172.21.15.32:0/3498412101 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f147c018090 con 0x7f1484151de0 2024-01-19T04:18:35.635 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:35.636 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4132918456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4132918456},{"type":"v1","addr":"172.21.15.67:6837","nonce":4132918456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:35.636 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 54 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f145c066500 msgr2=0x7f145c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f145c066500 0x7f145c0689c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1474007fd0 tx=0x7f1474007ba0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1484151de0 msgr2=0x7f1484146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1484151de0 0x7f1484146c40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f147c00efc0 tx=0x7f147c00c490 comp rx=0 tx=0).stop 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 shutdown_connections 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f145c066500 0x7f145c0689c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1484151de0 0x7f1484146c40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f14840c41f0 0x7f1484146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 --2- 172.21.15.32:0/3498412101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14840a7200 0x7f148414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.631+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 >> 172.21.15.32:0/3498412101 conn(0x7f14840726d0 msgr2=0x7f1484066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.635+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 shutdown_connections 2024-01-19T04:18:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.635+0000 7f1489000640 1 -- 172.21.15.32:0/3498412101 wait complete. 2024-01-19T04:18:35.658 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f2042200640 1 Processor -- start 2024-01-19T04:18:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f2042200640 1 -- start start 2024-01-19T04:18:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f2042200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f203c147f90 0x7f203c151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f2042200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f203c0c55e0 0x7f203c0c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f2042200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0c0810 con 0x7f203c06beb0 2024-01-19T04:18:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f2042200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c0c1df0 con 0x7f203c0c55e0 2024-01-19T04:18:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f2042200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c0c0af0 con 0x7f203c147f90 2024-01-19T04:18:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f203c0c55e0 0x7f203c0c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f203c0c55e0 0x7f203c0c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49246/0 (socket says 172.21.15.32:49246) 2024-01-19T04:18:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203aa00640 1 -- 172.21.15.32:0/3424474390 learned_addr learned my addr 172.21.15.32:0/3424474390 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203be00640 1 --1- 172.21.15.32:0/3424474390 >> v1:172.21.15.32:6789/0 conn(0x7f203c06beb0 0x7f203c0a4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43224/0 (socket says 172.21.15.32:43224) 2024-01-19T04:18:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203b400640 1 --2- 172.21.15.32:0/3424474390 >> v2:172.21.15.67:3300/0 conn(0x7f203c147f90 0x7f203c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203aa00640 1 -- 172.21.15.32:0/3424474390 >> v2:172.21.15.67:3300/0 conn(0x7f203c147f90 msgr2=0x7f203c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203aa00640 1 --2- 172.21.15.32:0/3424474390 >> v2:172.21.15.67:3300/0 conn(0x7f203c147f90 0x7f203c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203aa00640 1 -- 172.21.15.32:0/3424474390 >> v1:172.21.15.32:6789/0 conn(0x7f203c06beb0 legacy=0x7f203c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203aa00640 1 -- 172.21.15.32:0/3424474390 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0c0dd0 con 0x7f203c0c55e0 2024-01-19T04:18:35.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.795+0000 7f203a000640 1 -- 172.21.15.32:0/3424474390 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59977307 0 0) 0x7f203c0c0810 con 0x7f203c06beb0 2024-01-19T04:18:35.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f203aa00640 1 --2- 172.21.15.32:0/3424474390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c0c55e0 0x7f203c0c18b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f203c06f5f0 tx=0x7f202401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6bc359721e9855 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f203a000640 1 -- 172.21.15.32:0/3424474390 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240ab640 con 0x7f203c0c55e0 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f203a000640 1 -- 172.21.15.32:0/3424474390 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20240a7070 con 0x7f203c0c55e0 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f203a000640 1 -- 172.21.15.32:0/3424474390 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240ab9c0 con 0x7f203c0c55e0 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 -- 172.21.15.32:0/3424474390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c0c55e0 msgr2=0x7f203c0c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 --2- 172.21.15.32:0/3424474390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c0c55e0 0x7f203c0c18b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f203c06f5f0 tx=0x7f202401c440 comp rx=0 tx=0).stop 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 -- 172.21.15.32:0/3424474390 shutdown_connections 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 --2- 172.21.15.32:0/3424474390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c0c55e0 0x7f203c0c18b0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 --2- 172.21.15.32:0/3424474390 >> v2:172.21.15.67:3300/0 conn(0x7f203c147f90 0x7f203c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 -- 172.21.15.32:0/3424474390 >> 172.21.15.32:0/3424474390 conn(0x7f203c0c5b20 msgr2=0x7f203c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:35.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 -- 172.21.15.32:0/3424474390 shutdown_connections 2024-01-19T04:18:35.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.799+0000 7f2042200640 1 -- 172.21.15.32:0/3424474390 wait complete. 2024-01-19T04:18:35.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 Processor -- start 2024-01-19T04:18:35.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 -- start start 2024-01-19T04:18:35.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f203c06beb0 0x7f203c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f203c0c55e0 0x7f203c0a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c147f90 0x7f203c0a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0aba60 con 0x7f203c147f90 2024-01-19T04:18:35.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c147620 con 0x7f203c0c55e0 2024-01-19T04:18:35.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0ab4a0 con 0x7f203c06beb0 2024-01-19T04:18:35.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c147f90 0x7f203c0a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c147f90 0x7f203c0a8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49260/0 (socket says 172.21.15.32:49260) 2024-01-19T04:18:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 -- 172.21.15.32:0/3730879189 learned_addr learned my addr 172.21.15.32:0/3730879189 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203b400640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f203c06beb0 0x7f203c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203aa00640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f203c0c55e0 0x7f203c0a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 -- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f203c06beb0 msgr2=0x7f203c154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f203c06beb0 0x7f203c154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 -- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f203c0c55e0 msgr2=0x7f203c0a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f203c0c55e0 0x7f203c0a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 -- 172.21.15.32:0/3730879189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240094d0 con 0x7f203c147f90 2024-01-19T04:18:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f203be00640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c147f90 0x7f203c0a8e80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f203400c780 tx=0x7f203400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2033400640 1 -- 172.21.15.32:0/3730879189 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400ce30 con 0x7f203c147f90 2024-01-19T04:18:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2033400640 1 -- 172.21.15.32:0/3730879189 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400a640 con 0x7f203c147f90 2024-01-19T04:18:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c0ab780 con 0x7f203c147f90 2024-01-19T04:18:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2033400640 1 -- 172.21.15.32:0/3730879189 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400aa30 con 0x7f203c147f90 2024-01-19T04:18:35.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.803+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c1556a0 con 0x7f203c147f90 2024-01-19T04:18:35.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.807+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c0749f0 con 0x7f203c147f90 2024-01-19T04:18:35.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.807+0000 7f2033400640 1 -- 172.21.15.32:0/3730879189 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f203400ab90 con 0x7f203c147f90 2024-01-19T04:18:35.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.807+0000 7f2033400640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2014066530 0x7f20140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:35.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.807+0000 7f2033400640 1 -- 172.21.15.32:0/3730879189 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2034083690 con 0x7f203c147f90 2024-01-19T04:18:35.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.807+0000 7f203b400640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2014066530 0x7f20140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:35.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.807+0000 7f203b400640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2014066530 0x7f20140689f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f203c1479b0 tx=0x7f202c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:35.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.811+0000 7f2033400640 1 -- 172.21.15.32:0/3730879189 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2034050970 con 0x7f203c147f90 2024-01-19T04:18:35.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.971+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f203c149ec0 con 0x7f203c147f90 2024-01-19T04:18:35.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2033400640 1 -- 172.21.15.32:0/3730879189 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16544 (secure 0 0 0) 0x7f2034001770 con 0x7f203c147f90 2024-01-19T04:18:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:35.978 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":78,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:33.846537+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/208534071":"2024-01-20T04:18:30.834878+0000","172.21.15.67:6835/208534071":"2024-01-20T04:18:30.834878+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:35.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2014066530 msgr2=0x7f20140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2014066530 0x7f20140689f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f203c1479b0 tx=0x7f202c009190 comp rx=0 tx=0).stop 2024-01-19T04:18:35.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c147f90 msgr2=0x7f203c0a8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c147f90 0x7f203c0a8e80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f203400c780 tx=0x7f203400cc40 comp rx=0 tx=0).stop 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 shutdown_connections 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2014066530 0x7f20140689f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203c147f90 0x7f203c0a8e80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f203c0c55e0 0x7f203c0a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 --2- 172.21.15.32:0/3730879189 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f203c06beb0 0x7f203c154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 >> 172.21.15.32:0/3730879189 conn(0x7f203c0c5b20 msgr2=0x7f203c0a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:35.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 shutdown_connections 2024-01-19T04:18:35.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:35.975+0000 7f2042200640 1 -- 172.21.15.32:0/3730879189 wait complete. 2024-01-19T04:18:36.001 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-19T04:18:36.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:36.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a81200640 1 Processor -- start 2024-01-19T04:18:36.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a81200640 1 -- start start 2024-01-19T04:18:36.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a81200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a7c151f30 0x7f2a7c0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a81200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2a7c06fda0 0x7f2a7c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a81200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0c5b40 con 0x7f2a7c06eb70 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a81200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c1551e0 con 0x7f2a7c06fda0 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a81200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c155710 con 0x7f2a7c151f30 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2a7c06fda0 0x7f2a7c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2a7c06fda0 0x7f2a7c0c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49266/0 (socket says 172.21.15.32:49266) 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79400640 1 -- 172.21.15.32:0/2078315112 learned_addr learned my addr 172.21.15.32:0/2078315112 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79e00640 1 --2- 172.21.15.32:0/2078315112 >> v2:172.21.15.67:3300/0 conn(0x7f2a7c151f30 0x7f2a7c0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79400640 1 -- 172.21.15.32:0/2078315112 >> v2:172.21.15.67:3300/0 conn(0x7f2a7c151f30 msgr2=0x7f2a7c0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:36.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79400640 1 --2- 172.21.15.32:0/2078315112 >> v2:172.21.15.67:3300/0 conn(0x7f2a7c151f30 0x7f2a7c0c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79400640 1 -- 172.21.15.32:0/2078315112 >> v1:172.21.15.67:6789/0 conn(0x7f2a7c06eb70 legacy=0x7f2a7c06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.139+0000 7f2a79400640 1 -- 172.21.15.32:0/2078315112 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0c3fa0 con 0x7f2a7c06fda0 2024-01-19T04:18:36.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a79400640 1 --2- 172.21.15.32:0/2078315112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c06fda0 0x7f2a7c0c4970 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c071b80 tx=0x7f2a6401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60424ba2bfdfaf74 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a78a00640 1 -- 172.21.15.32:0/2078315112 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640ad680 con 0x7f2a7c06fda0 2024-01-19T04:18:36.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a78a00640 1 -- 172.21.15.32:0/2078315112 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a640ad7e0 con 0x7f2a7c06fda0 2024-01-19T04:18:36.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a78a00640 1 -- 172.21.15.32:0/2078315112 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640adb70 con 0x7f2a7c06fda0 2024-01-19T04:18:36.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 -- 172.21.15.32:0/2078315112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c06fda0 msgr2=0x7f2a7c0c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 --2- 172.21.15.32:0/2078315112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c06fda0 0x7f2a7c0c4970 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c071b80 tx=0x7f2a6401c470 comp rx=0 tx=0).stop 2024-01-19T04:18:36.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 -- 172.21.15.32:0/2078315112 shutdown_connections 2024-01-19T04:18:36.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 --2- 172.21.15.32:0/2078315112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c06fda0 0x7f2a7c0c4970 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 --2- 172.21.15.32:0/2078315112 >> v2:172.21.15.67:3300/0 conn(0x7f2a7c151f30 0x7f2a7c0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 -- 172.21.15.32:0/2078315112 >> 172.21.15.32:0/2078315112 conn(0x7f2a7c0a9870 msgr2=0x7f2a7c0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:36.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 -- 172.21.15.32:0/2078315112 shutdown_connections 2024-01-19T04:18:36.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.143+0000 7f2a81200640 1 -- 172.21.15.32:0/2078315112 wait complete. 2024-01-19T04:18:36.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 Processor -- start 2024-01-19T04:18:36.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 -- start start 2024-01-19T04:18:36.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a7c06eb70 0x7f2a7c1f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a7c06fda0 0x7f2a7c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c151f30 0x7f2a7c0bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1f08a0 con 0x7f2a7c151f30 2024-01-19T04:18:36.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c06bb70 con 0x7f2a7c06eb70 2024-01-19T04:18:36.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1ecf90 con 0x7f2a7c06fda0 2024-01-19T04:18:36.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c151f30 0x7f2a7c0bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c151f30 0x7f2a7c0bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49270/0 (socket says 172.21.15.32:49270) 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 -- 172.21.15.32:0/2726259155 learned_addr learned my addr 172.21.15.32:0/2726259155 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a79400640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a7c06fda0 0x7f2a7c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a79e00640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a7c06eb70 0x7f2a7c1f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 -- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a7c06fda0 msgr2=0x7f2a7c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a7c06fda0 0x7f2a7c06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 -- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a7c06eb70 msgr2=0x7f2a7c1f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a7c06eb70 0x7f2a7c1f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 -- 172.21.15.32:0/2726259155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640094d0 con 0x7f2a7c151f30 2024-01-19T04:18:36.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a7a800640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c151f30 0x7f2a7c0bdcb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c760 tx=0x7f2a7400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a72000640 1 -- 172.21.15.32:0/2726259155 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74003b80 con 0x7f2a7c151f30 2024-01-19T04:18:36.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a72000640 1 -- 172.21.15.32:0/2726259155 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74003ce0 con 0x7f2a7c151f30 2024-01-19T04:18:36.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a72000640 1 -- 172.21.15.32:0/2726259155 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400aa30 con 0x7f2a7c151f30 2024-01-19T04:18:36.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c1f0250 con 0x7f2a7c151f30 2024-01-19T04:18:36.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.147+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c1ecc40 con 0x7f2a7c151f30 2024-01-19T04:18:36.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.151+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c1f0a10 con 0x7f2a7c151f30 2024-01-19T04:18:36.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.151+0000 7f2a72000640 1 -- 172.21.15.32:0/2726259155 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2a7400ab90 con 0x7f2a7c151f30 2024-01-19T04:18:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.151+0000 7f2a72000640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a54066500 0x7f2a540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.151+0000 7f2a72000640 1 -- 172.21.15.32:0/2726259155 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2a74083b10 con 0x7f2a7c151f30 2024-01-19T04:18:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.151+0000 7f2a79e00640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a54066500 0x7f2a540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.151+0000 7f2a79e00640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a54066500 0x7f2a540689c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c1562d0 tx=0x7f2a6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.155+0000 7f2a72000640 1 -- 172.21.15.32:0/2726259155 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2a74050df0 con 0x7f2a7c151f30 2024-01-19T04:18:36.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.347+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a7c0749f0 con 0x7f2a7c151f30 2024-01-19T04:18:36.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.347+0000 7f2a72000640 1 -- 172.21.15.32:0/2726259155 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f2a74054410 con 0x7f2a7c151f30 2024-01-19T04:18:36.352 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:36.352 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4132918456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4132918456},{"type":"v1","addr":"172.21.15.67:6837","nonce":4132918456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:36.352 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 54 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.347+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a54066500 msgr2=0x7f2a540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.347+0000 7f2a81200640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a54066500 0x7f2a540689c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c1562d0 tx=0x7f2a6c008040 comp rx=0 tx=0).stop 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.347+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c151f30 msgr2=0x7f2a7c0bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.347+0000 7f2a81200640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c151f30 0x7f2a7c0bdcb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c760 tx=0x7f2a7400cc20 comp rx=0 tx=0).stop 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 shutdown_connections 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a54066500 0x7f2a540689c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c151f30 0x7f2a7c0bdcb0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a7c06fda0 0x7f2a7c06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 --2- 172.21.15.32:0/2726259155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a7c06eb70 0x7f2a7c1f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 >> 172.21.15.32:0/2726259155 conn(0x7f2a7c0a9870 msgr2=0x7f2a7c06ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:36.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 shutdown_connections 2024-01-19T04:18:36.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.351+0000 7f2a81200640 1 -- 172.21.15.32:0/2726259155 wait complete. 2024-01-19T04:18:36.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:18:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2583c00640 1 Processor -- start 2024-01-19T04:18:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2583c00640 1 -- start start 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2583c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f257c14fb50 0x7f257c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2583c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 0x7f257c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2583c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c071e80 con 0x7f257c0a4ec0 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2583c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c1535c0 con 0x7f257c14fb50 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2583c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0726c0 con 0x7f257c0c04a0 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2581c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f257c0a4ec0 0x7f257c155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43236/0 (socket says 172.21.15.32:43236) 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2581c00640 1 -- 172.21.15.32:0/1649502638 learned_addr learned my addr 172.21.15.32:0/1649502638 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.511+0000 7f2581200640 1 --2- 172.21.15.32:0/1649502638 >> v2:172.21.15.67:3300/0 conn(0x7f257c14fb50 0x7f257c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257be00640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 0x7f257c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152104251 0 0) 0x7f257c071e80 con 0x7f257c0a4ec0 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f255c003530 con 0x7f257c0a4ec0 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381225914 0 0) 0x7f255c003530 con 0x7f257c0a4ec0 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 msgr2=0x7f257c0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 0x7f257c0c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 >> v2:172.21.15.67:3300/0 conn(0x7f257c14fb50 msgr2=0x7f257c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 --2- 172.21.15.32:0/1649502638 >> v2:172.21.15.67:3300/0 conn(0x7f257c14fb50 0x7f257c06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0c0a20 con 0x7f257c0a4ec0 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f2574001a00 con 0x7f257c0a4ec0 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 >> v1:172.21.15.32:6789/0 conn(0x7f257c0a4ec0 legacy=0x7f257c155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c003980 0x7f255c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 0x7f255c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255c004d10 0x7f255c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c1535c0 con 0x7f255c003980 2024-01-19T04:18:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0726c0 con 0x7f255c004d10 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c00b9c0 con 0x7f257c0c04a0 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581200640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c003980 0x7f255c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581c00640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255c004d10 0x7f255c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f257be00640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 0x7f255c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581200640 1 -- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 msgr2=0x7f255c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581200640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f257c0c04a0 0x7f255c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581200640 1 -- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255c004d10 msgr2=0x7f255c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581200640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255c004d10 0x7f255c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581200640 1 -- 172.21.15.32:0/1649502638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c003530 con 0x7f255c003980 2024-01-19T04:18:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.515+0000 7f2581c00640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f255c004d10 0x7f255c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:36.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2581200640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c003980 0x7f255c003da0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f256c009ae0 tx=0x7f256c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2229ee1b56a309 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0a6470 con 0x7f255c003980 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c0a65d0 con 0x7f255c003980 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f257b400640 1 -- 172.21.15.32:0/1649502638 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0a6980 con 0x7f255c003980 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- 172.21.15.32:0/1649502638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c003980 msgr2=0x7f255c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 --2- 172.21.15.32:0/1649502638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c003980 0x7f255c003da0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f256c009ae0 tx=0x7f256c01ca90 comp rx=0 tx=0).stop 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2581c00640 1 -- 172.21.15.32:0/1649502638 reap_dead start 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- 172.21.15.32:0/1649502638 shutdown_connections 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- 172.21.15.32:0/1649502638 >> 172.21.15.32:0/1649502638 conn(0x7f257c0c5b20 msgr2=0x7f257c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- 172.21.15.32:0/1649502638 shutdown_connections 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- 172.21.15.32:0/1649502638 wait complete. 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 Processor -- start 2024-01-19T04:18:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- start start 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f255c003980 0x7f257c0aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f257c0a8e40 0x7f257c0a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f257c14c1e0 0x7f257c14c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c155b70 con 0x7f257c14c1e0 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0aa790 con 0x7f257c0a8e40 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.519+0000 7f2583c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c14d0f0 con 0x7f255c003980 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f257c14c1e0 0x7f257c14c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f257c14c1e0 0x7f257c14c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49292/0 (socket says 172.21.15.32:49292) 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 -- 172.21.15.32:0/3680605136 learned_addr learned my addr 172.21.15.32:0/3680605136 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f257be00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f257c0a8e40 0x7f257c0a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581200640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f255c003980 0x7f257c0aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 -- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f255c003980 msgr2=0x7f257c0aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f255c003980 0x7f257c0aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 -- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f257c0a8e40 msgr2=0x7f257c0a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f257c0a8e40 0x7f257c0a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 -- 172.21.15.32:0/3680605136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c14ce10 con 0x7f257c14c1e0 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2581c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f257c14c1e0 0x7f257c14c660 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f257c0c0160 tx=0x7f257400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2578c00640 1 -- 172.21.15.32:0/3680605136 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400eb90 con 0x7f257c14c1e0 2024-01-19T04:18:36.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2578c00640 1 -- 172.21.15.32:0/3680605136 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257400ed10 con 0x7f257c14c1e0 2024-01-19T04:18:36.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c0ab710 con 0x7f257c14c1e0 2024-01-19T04:18:36.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2578c00640 1 -- 172.21.15.32:0/3680605136 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574013660 con 0x7f257c14c1e0 2024-01-19T04:18:36.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c155dc0 con 0x7f257c14c1e0 2024-01-19T04:18:36.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c0c4bc0 con 0x7f257c14c1e0 2024-01-19T04:18:36.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.523+0000 7f2578c00640 1 -- 172.21.15.32:0/3680605136 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f25740137c0 con 0x7f257c14c1e0 2024-01-19T04:18:36.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.527+0000 7f2578c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2554066500 0x7f25540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.527+0000 7f2578c00640 1 -- 172.21.15.32:0/3680605136 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f25740841f0 con 0x7f257c14c1e0 2024-01-19T04:18:36.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.527+0000 7f2581200640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2554066500 0x7f25540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.527+0000 7f2581200640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2554066500 0x7f25540689c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f256c0ad000 tx=0x7f256c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.531+0000 7f2578c00640 1 -- 172.21.15.32:0/3680605136 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2574051590 con 0x7f257c14c1e0 2024-01-19T04:18:36.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f257c0749f0 con 0x7f257c14c1e0 2024-01-19T04:18:36.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2578c00640 1 -- 172.21.15.32:0/3680605136 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f2574054bb0 con 0x7f257c14c1e0 2024-01-19T04:18:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:36.728 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4132918456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4132918456},{"type":"v1","addr":"172.21.15.67:6837","nonce":4132918456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T04:18:02.313111+0000","modified":"2024-01-19T04:18:05.321432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.32:6835/3037787697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3037787697},{"type":"v1","addr":"172.21.15.32:6835","nonce":3037787697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-19T04:18:36.728 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 54 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2554066500 msgr2=0x7f25540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2554066500 0x7f25540689c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f256c0ad000 tx=0x7f256c0b3040 comp rx=0 tx=0).stop 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f257c14c1e0 msgr2=0x7f257c14c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f257c14c1e0 0x7f257c14c660 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f257c0c0160 tx=0x7f257400e530 comp rx=0 tx=0).stop 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 shutdown_connections 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2554066500 0x7f25540689c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f257c14c1e0 0x7f257c14c660 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f257c0a8e40 0x7f257c0a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 --2- 172.21.15.32:0/3680605136 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f255c003980 0x7f257c0aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.723+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 >> 172.21.15.32:0/3680605136 conn(0x7f257c0c5b20 msgr2=0x7f257c0bf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:36.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.727+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 shutdown_connections 2024-01-19T04:18:36.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.727+0000 7f2583c00640 1 -- 172.21.15.32:0/3680605136 wait complete. 2024-01-19T04:18:36.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:36.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc977c00640 1 Processor -- start 2024-01-19T04:18:36.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc977c00640 1 -- start start 2024-01-19T04:18:36.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc977c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9701565d0 0x7fc9700c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc977c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc97006eeb0 0x7fc97006f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc977c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9700c6470 con 0x7fc9700c82f0 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc977c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9700c6ff0 con 0x7fc97006eeb0 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc977c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700c88a0 con 0x7fc9701565d0 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc975c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc97006eeb0 0x7fc97006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc975c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc97006eeb0 0x7fc97006f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49302/0 (socket says 172.21.15.32:49302) 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc975c00640 1 -- 172.21.15.32:0/1014728552 learned_addr learned my addr 172.21.15.32:0/1014728552 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.887+0000 7fc975200640 1 --2- 172.21.15.32:0/1014728552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9701565d0 0x7fc9700c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc975c00640 1 -- 172.21.15.32:0/1014728552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9701565d0 msgr2=0x7fc9700c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc975c00640 1 --2- 172.21.15.32:0/1014728552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9701565d0 0x7fc9700c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc975c00640 1 -- 172.21.15.32:0/1014728552 >> v1:172.21.15.67:6789/0 conn(0x7fc9700c82f0 legacy=0x7fc9700c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc975c00640 1 -- 172.21.15.32:0/1014728552 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700c66c0 con 0x7fc97006eeb0 2024-01-19T04:18:36.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc975c00640 1 --2- 172.21.15.32:0/1014728552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc97006f310 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc968009e50 tx=0x7fc96801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52981879b47e9af0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc96f400640 1 -- 172.21.15.32:0/1014728552 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680a5840 con 0x7fc97006eeb0 2024-01-19T04:18:36.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc96f400640 1 -- 172.21.15.32:0/1014728552 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680a59a0 con 0x7fc97006eeb0 2024-01-19T04:18:36.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc96f400640 1 -- 172.21.15.32:0/1014728552 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680a5d30 con 0x7fc97006eeb0 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc977c00640 1 -- 172.21.15.32:0/1014728552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 msgr2=0x7fc97006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.891+0000 7fc977c00640 1 --2- 172.21.15.32:0/1014728552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc97006f310 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc968009e50 tx=0x7fc96801c980 comp rx=0 tx=0).stop 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- 172.21.15.32:0/1014728552 shutdown_connections 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 --2- 172.21.15.32:0/1014728552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc97006f310 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 --2- 172.21.15.32:0/1014728552 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9701565d0 0x7fc9700c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- 172.21.15.32:0/1014728552 >> 172.21.15.32:0/1014728552 conn(0x7fc9700726d0 msgr2=0x7fc9700663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- 172.21.15.32:0/1014728552 shutdown_connections 2024-01-19T04:18:36.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- 172.21.15.32:0/1014728552 wait complete. 2024-01-19T04:18:36.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 Processor -- start 2024-01-19T04:18:36.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- start start 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc970153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9700c82f0 0x7fc9700c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9701565d0 0x7fc9700c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700ab0d0 con 0x7fc97006eeb0 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700acdd0 con 0x7fc9701565d0 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc977c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700c1b10 con 0x7fc9700c82f0 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc970153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc970153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49312/0 (socket says 172.21.15.32:49312) 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 -- 172.21.15.32:0/817723424 learned_addr learned my addr 172.21.15.32:0/817723424 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:36.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc96fe00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9700c82f0 0x7fc9700c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975c00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9701565d0 0x7fc9700c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 -- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9700c82f0 msgr2=0x7fc9700c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9700c82f0 0x7fc9700c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 -- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9701565d0 msgr2=0x7fc9700c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:36.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9701565d0 0x7fc9700c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:36.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 -- 172.21.15.32:0/817723424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968009b30 con 0x7fc97006eeb0 2024-01-19T04:18:36.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc975200640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc970153730 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc96000e8a0 tx=0x7fc96000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.895+0000 7fc96cc00640 1 -- 172.21.15.32:0/817723424 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960009510 con 0x7fc97006eeb0 2024-01-19T04:18:36.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc96cc00640 1 -- 172.21.15.32:0/817723424 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96000c940 con 0x7fc97006eeb0 2024-01-19T04:18:36.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9701f1110 con 0x7fc97006eeb0 2024-01-19T04:18:36.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc96cc00640 1 -- 172.21.15.32:0/817723424 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96000ccb0 con 0x7fc97006eeb0 2024-01-19T04:18:36.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9701f13d0 con 0x7fc97006eeb0 2024-01-19T04:18:36.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9700c2590 con 0x7fc97006eeb0 2024-01-19T04:18:36.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc96cc00640 1 -- 172.21.15.32:0/817723424 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc960013470 con 0x7fc97006eeb0 2024-01-19T04:18:36.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc96cc00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc948066530 0x7fc9480689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:36.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc96cc00640 1 -- 172.21.15.32:0/817723424 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc960083f40 con 0x7fc97006eeb0 2024-01-19T04:18:36.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc96fe00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc948066530 0x7fc9480689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:36.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.899+0000 7fc96fe00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc948066530 0x7fc9480689f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc9700a6d90 tx=0x7fc958009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:36.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:36.903+0000 7fc96cc00640 1 -- 172.21.15.32:0/817723424 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc960051230 con 0x7fc97006eeb0 2024-01-19T04:18:37.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.067+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9700749f0 con 0x7fc97006eeb0 2024-01-19T04:18:37.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.067+0000 7fc96cc00640 1 -- 172.21.15.32:0/817723424 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16544 (secure 0 0 0) 0x7fc960054850 con 0x7fc97006eeb0 2024-01-19T04:18:37.072 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:37.072 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":78,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:33.846537+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-19T04:18:00.535616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-19T04:18:01.296998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6837/208534071":"2024-01-20T04:18:30.834878+0000","172.21.15.67:6835/208534071":"2024-01-20T04:18:30.834878+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.067+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc948066530 msgr2=0x7fc9480689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.067+0000 7fc977c00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc948066530 0x7fc9480689f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc9700a6d90 tx=0x7fc958009040 comp rx=0 tx=0).stop 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.067+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 msgr2=0x7fc970153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.067+0000 7fc977c00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc970153730 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc96000e8a0 tx=0x7fc96000eca0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 shutdown_connections 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc948066530 0x7fc9480689f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9701565d0 0x7fc9700c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc9700c82f0 0x7fc9700c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 --2- 172.21.15.32:0/817723424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc97006eeb0 0x7fc970153730 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 >> 172.21.15.32:0/817723424 conn(0x7fc9700726d0 msgr2=0x7fc9700c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 shutdown_connections 2024-01-19T04:18:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.071+0000 7fc977c00640 1 -- 172.21.15.32:0/817723424 wait complete. 2024-01-19T04:18:37.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-19T04:18:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 Processor -- start 2024-01-19T04:18:37.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 -- start start 2024-01-19T04:18:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fabf0151de0 0x7fabf00c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00a7200 0x7fabf00c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fabf00c41f0 0x7fabf0154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf01521c0 con 0x7fabf0151de0 2024-01-19T04:18:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf01547e0 con 0x7fabf00c41f0 2024-01-19T04:18:37.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabf5800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c1db0 con 0x7fabf00a7200 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabeea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fabf0151de0 0x7fabf00c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabeea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fabf0151de0 0x7fabf00c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49324/0 (socket says 172.21.15.32:49324) 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.231+0000 7fabeea00640 1 -- 172.21.15.32:0/897172812 learned_addr learned my addr 172.21.15.32:0/897172812 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabef400640 1 --2- 172.21.15.32:0/897172812 >> v2:172.21.15.67:3300/0 conn(0x7fabf00c41f0 0x7fabf0154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabeea00640 1 -- 172.21.15.32:0/897172812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00a7200 msgr2=0x7fabf00c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabee000640 1 --2- 172.21.15.32:0/897172812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00a7200 0x7fabf00c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabeea00640 1 --2- 172.21.15.32:0/897172812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00a7200 0x7fabf00c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabeea00640 1 -- 172.21.15.32:0/897172812 >> v2:172.21.15.67:3300/0 conn(0x7fabf00c41f0 msgr2=0x7fabf0154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabeea00640 1 --2- 172.21.15.32:0/897172812 >> v2:172.21.15.67:3300/0 conn(0x7fabf00c41f0 0x7fabf0154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabeea00640 1 -- 172.21.15.32:0/897172812 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf006f820 con 0x7fabf0151de0 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabef400640 1 --2- 172.21.15.32:0/897172812 >> v2:172.21.15.67:3300/0 conn(0x7fabf00c41f0 0x7fabf0154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabee000640 1 --2- 172.21.15.32:0/897172812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00a7200 0x7fabf00c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:37.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabeea00640 1 --2- 172.21.15.32:0/897172812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf00c1870 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fabf0155810 tx=0x7fabe001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e68439f84f5e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabed600640 1 -- 172.21.15.32:0/897172812 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00ac640 con 0x7fabf0151de0 2024-01-19T04:18:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabed600640 1 -- 172.21.15.32:0/897172812 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe00ac7a0 con 0x7fabf0151de0 2024-01-19T04:18:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabed600640 1 -- 172.21.15.32:0/897172812 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00acb30 con 0x7fabf0151de0 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabf5800640 1 -- 172.21.15.32:0/897172812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 msgr2=0x7fabf00c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.235+0000 7fabf5800640 1 --2- 172.21.15.32:0/897172812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf00c1870 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fabf0155810 tx=0x7fabe001c440 comp rx=0 tx=0).stop 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- 172.21.15.32:0/897172812 shutdown_connections 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 --2- 172.21.15.32:0/897172812 >> v2:172.21.15.67:3300/0 conn(0x7fabf00c41f0 0x7fabf0154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 --2- 172.21.15.32:0/897172812 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00a7200 0x7fabf00c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 --2- 172.21.15.32:0/897172812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf00c1870 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- 172.21.15.32:0/897172812 >> 172.21.15.32:0/897172812 conn(0x7fabf00726d0 msgr2=0x7fabf00663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- 172.21.15.32:0/897172812 shutdown_connections 2024-01-19T04:18:37.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- 172.21.15.32:0/897172812 wait complete. 2024-01-19T04:18:37.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 Processor -- start 2024-01-19T04:18:37.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- start start 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf00a7200 0x7fabf015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00c41f0 0x7fabf015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf01ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00a9050 con 0x7fabf0151de0 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00aa000 con 0x7fabf00a7200 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabf5800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01f1260 con 0x7fabf00c41f0 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf01ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabeea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf00a7200 0x7fabf015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabee000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00c41f0 0x7fabf015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf01ed140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49328/0 (socket says 172.21.15.32:49328) 2024-01-19T04:18:37.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 -- 172.21.15.32:0/4027468305 learned_addr learned my addr 172.21.15.32:0/4027468305 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:37.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabeea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf00a7200 0x7fabf015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:43232/0 (socket says 172.21.15.32:43232) 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 -- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00c41f0 msgr2=0x7fabf015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00c41f0 0x7fabf015e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 -- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf00a7200 msgr2=0x7fabf015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf00a7200 0x7fabf015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.239+0000 7fabef400640 1 -- 172.21.15.32:0/4027468305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00094d0 con 0x7fabf0151de0 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabef400640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf01ed140 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fabe800ce70 tx=0x7fabe800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabe6a00640 1 -- 172.21.15.32:0/4027468305 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800d840 con 0x7fabf0151de0 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabe6a00640 1 -- 172.21.15.32:0/4027468305 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe800d9a0 con 0x7fabf0151de0 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf01f1500 con 0x7fabf0151de0 2024-01-19T04:18:37.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabe6a00640 1 -- 172.21.15.32:0/4027468305 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800dd50 con 0x7fabf0151de0 2024-01-19T04:18:37.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf015dc10 con 0x7fabf0151de0 2024-01-19T04:18:37.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf00749f0 con 0x7fabf0151de0 2024-01-19T04:18:37.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabe6a00640 1 -- 172.21.15.32:0/4027468305 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fabe801e3b0 con 0x7fabf0151de0 2024-01-19T04:18:37.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabe6a00640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fabc8066500 0x7fabc80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabe6a00640 1 -- 172.21.15.32:0/4027468305 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fabe80847b0 con 0x7fabf0151de0 2024-01-19T04:18:37.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.243+0000 7fabeea00640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fabc8066500 0x7fabc80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.247+0000 7fabeea00640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fabc8066500 0x7fabc80689c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ae000 tx=0x7fabe0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:37.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.247+0000 7fabe6a00640 1 -- 172.21.15.32:0/4027468305 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fabe8051b30 con 0x7fabf0151de0 2024-01-19T04:18:37.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.439+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fabf00c50b0 con 0x7fabf0151de0 2024-01-19T04:18:37.443 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-01-19T04:18:37.439+0000 7f2af4c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T04:18:37.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.439+0000 7fabe6a00640 1 -- 172.21.15.32:0/4027468305 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 163+0+0 (secure 0 0 0) 0x7fabe801a090 con 0x7fabf0151de0 2024-01-19T04:18:37.445 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fabc8066500 msgr2=0x7fabc80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fabc8066500 0x7fabc80689c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ae000 tx=0x7fabe0008040 comp rx=0 tx=0).stop 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 msgr2=0x7fabf01ed140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf01ed140 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fabe800ce70 tx=0x7fabe800a710 comp rx=0 tx=0).stop 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 shutdown_connections 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fabc8066500 0x7fabc80689c0 secure :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ae000 tx=0x7fabe0008040 comp rx=0 tx=0).stop 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf0151de0 0x7fabf01ed140 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fabf00c41f0 0x7fabf015e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 --2- 172.21.15.32:0/4027468305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabf00a7200 0x7fabf015cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 >> 172.21.15.32:0/4027468305 conn(0x7fabf00726d0 msgr2=0x7fabf006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:37.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 shutdown_connections 2024-01-19T04:18:37.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.443+0000 7fabf5800640 1 -- 172.21.15.32:0/4027468305 wait complete. 2024-01-19T04:18:37.457 INFO:tasks.ceph.mds.a.smithi032.stderr: -4581> 2024-01-19T04:18:05.796+0000 7f8794600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T04:18:37.469 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-19T04:18:37.507 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-01-19T04:18:37.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.607+0000 7f9fbe600640 1 Processor -- start 2024-01-19T04:18:37.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.607+0000 7f9fbe600640 1 -- start start 2024-01-19T04:18:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fbe600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fb80723b0 0x7f9fb8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fbe600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80a4ea0 con 0x7f9fb806d440 2024-01-19T04:18:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fbe600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb8152a20 con 0x7f9fb80c2080 2024-01-19T04:18:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fbe600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb81524a0 con 0x7f9fb80723b0 2024-01-19T04:18:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9fb806d440 0x7f9fb80c4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43238/0 (socket says 172.21.15.32:43238) 2024-01-19T04:18:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb7e00640 1 -- 172.21.15.32:0/1194682100 learned_addr learned my addr 172.21.15.32:0/1194682100 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:37.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb7400640 1 --2- 172.21.15.32:0/1194682100 >> v2:172.21.15.67:3300/0 conn(0x7f9fb80723b0 0x7f9fb8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb6000640 1 -- 172.21.15.32:0/1194682100 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405221635 0 0) 0x7f9fb80a4ea0 con 0x7f9fb806d440 2024-01-19T04:18:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb6000640 1 -- 172.21.15.32:0/1194682100 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f98003530 con 0x7f9fb806d440 2024-01-19T04:18:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb7400640 1 -- 172.21.15.32:0/1194682100 >> v1:172.21.15.67:6789/0 conn(0x7f9fb80c2080 legacy=0x7f9fb8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb7400640 1 -- 172.21.15.32:0/1194682100 >> v1:172.21.15.32:6789/0 conn(0x7f9fb806d440 legacy=0x7f9fb80c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.611+0000 7f9fb7400640 1 -- 172.21.15.32:0/1194682100 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb81533f0 con 0x7f9fb80723b0 2024-01-19T04:18:37.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fb7400640 1 --2- 172.21.15.32:0/1194682100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80723b0 0x7f9fb8152eb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80097c0 tx=0x7f9fa801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=715fb865c1093c06 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:37.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fb6000640 1 -- 172.21.15.32:0/1194682100 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80ad660 con 0x7f9fb80723b0 2024-01-19T04:18:37.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fb6000640 1 -- 172.21.15.32:0/1194682100 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80ad7c0 con 0x7f9fb80723b0 2024-01-19T04:18:37.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fb6000640 1 -- 172.21.15.32:0/1194682100 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80adb50 con 0x7f9fb80723b0 2024-01-19T04:18:37.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 -- 172.21.15.32:0/1194682100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80723b0 msgr2=0x7f9fb8152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 --2- 172.21.15.32:0/1194682100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80723b0 0x7f9fb8152eb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80097c0 tx=0x7f9fa801c360 comp rx=0 tx=0).stop 2024-01-19T04:18:37.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 -- 172.21.15.32:0/1194682100 shutdown_connections 2024-01-19T04:18:37.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 --2- 172.21.15.32:0/1194682100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80723b0 0x7f9fb8152eb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 -- 172.21.15.32:0/1194682100 >> 172.21.15.32:0/1194682100 conn(0x7f9fb80c25a0 msgr2=0x7f9fb80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:37.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 -- 172.21.15.32:0/1194682100 shutdown_connections 2024-01-19T04:18:37.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 -- 172.21.15.32:0/1194682100 wait complete. 2024-01-19T04:18:37.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.615+0000 7f9fbe600640 1 Processor -- start 2024-01-19T04:18:37.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 -- start start 2024-01-19T04:18:37.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb806d440 0x7f9fb8145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fb80723b0 0x7f9fb814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80c2080 0x7f9fb8154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb814ab80 con 0x7f9fb806d440 2024-01-19T04:18:37.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb814c300 con 0x7f9fb80c2080 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8145a60 con 0x7f9fb80723b0 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb806d440 0x7f9fb8145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb806d440 0x7f9fb8145d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49344/0 (socket says 172.21.15.32:49344) 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 -- 172.21.15.32:0/2771737839 learned_addr learned my addr 172.21.15.32:0/2771737839 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7e00640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80c2080 0x7f9fb8154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb6a00640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fb80723b0 0x7f9fb814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 -- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fb80723b0 msgr2=0x7f9fb814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fb80723b0 0x7f9fb814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 -- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80c2080 msgr2=0x7f9fb8154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80c2080 0x7f9fb8154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 -- 172.21.15.32:0/2771737839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8009420 con 0x7f9fb806d440 2024-01-19T04:18:37.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fb7400640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb806d440 0x7f9fb8145d40 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8018f70 tx=0x7f9fa8019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:37.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9faf400640 1 -- 172.21.15.32:0/2771737839 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b6610 con 0x7f9fb806d440 2024-01-19T04:18:37.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9faf400640 1 -- 172.21.15.32:0/2771737839 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80b6770 con 0x7f9fb806d440 2024-01-19T04:18:37.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb81f1320 con 0x7f9fb806d440 2024-01-19T04:18:37.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9faf400640 1 -- 172.21.15.32:0/2771737839 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b6b20 con 0x7f9fb806d440 2024-01-19T04:18:37.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb80a5ac0 con 0x7f9fb806d440 2024-01-19T04:18:37.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.619+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb80749f0 con 0x7f9fb806d440 2024-01-19T04:18:37.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.623+0000 7f9faf400640 1 -- 172.21.15.32:0/2771737839 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9fa80b4040 con 0x7f9fb806d440 2024-01-19T04:18:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.623+0000 7f9faf400640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f90066500 0x7f9f900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.623+0000 7f9faf400640 1 -- 172.21.15.32:0/2771737839 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f9fa811e210 con 0x7f9fb806d440 2024-01-19T04:18:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.623+0000 7f9fb6a00640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f90066500 0x7f9f900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:37.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.623+0000 7f9fb6a00640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f90066500 0x7f9f900689c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8155a10 tx=0x7f9fa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:37.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.627+0000 7f9faf400640 1 -- 172.21.15.32:0/2771737839 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9fa80eb4a0 con 0x7f9fb806d440 2024-01-19T04:18:37.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:37.819+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9fb80abb80 con 0x7f9fb806d440 2024-01-19T04:18:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.443+0000 7f9faf400640 1 -- 172.21.15.32:0/2771737839 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9fa80eeac0 con 0x7f9fb806d440 2024-01-19T04:18:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f90066500 msgr2=0x7f9f900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f90066500 0x7f9f900689c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8155a10 tx=0x7f9fa0009040 comp rx=0 tx=0).stop 2024-01-19T04:18:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb806d440 msgr2=0x7f9fb8145d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb806d440 0x7f9fb8145d40 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8018f70 tx=0x7f9fa8019100 comp rx=0 tx=0).stop 2024-01-19T04:18:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 shutdown_connections 2024-01-19T04:18:38.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f9f90066500 0x7f9f900689c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fb80c2080 0x7f9fb8154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f9fb80723b0 0x7f9fb814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 --2- 172.21.15.32:0/2771737839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb806d440 0x7f9fb8145d40 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 >> 172.21.15.32:0/2771737839 conn(0x7f9fb80c25a0 msgr2=0x7f9fb80c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 shutdown_connections 2024-01-19T04:18:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.447+0000 7f9fbe600640 1 -- 172.21.15.32:0/2771737839 wait complete. 2024-01-19T04:18:38.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-19T04:18:38.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.659+0000 7f5bf2c00640 1 Processor -- start 2024-01-19T04:18:38.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.659+0000 7f5bf2c00640 1 -- start start 2024-01-19T04:18:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bf2c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec1549a0 0x7f5bec154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bf2c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5bec06c220 0x7f5bec0c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bf2c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0c5380 con 0x7f5bec0c5750 2024-01-19T04:18:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bf2c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0c20e0 con 0x7f5bec06c220 2024-01-19T04:18:38.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bf2c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec155930 con 0x7f5bec1549a0 2024-01-19T04:18:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bf0c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5bec0c5750 0x7f5bec0c4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46980/0 (socket says 172.21.15.32:46980) 2024-01-19T04:18:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bf0c00640 1 -- 172.21.15.32:0/2933752510 learned_addr learned my addr 172.21.15.32:0/2933752510 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bebe00640 1 --2- 172.21.15.32:0/2933752510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec1549a0 0x7f5bec154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5beb400640 1 --2- 172.21.15.32:0/2933752510 >> v2:172.21.15.67:3300/0 conn(0x7f5bec06c220 0x7f5bec0c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5beaa00640 1 -- 172.21.15.32:0/2933752510 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182099677 0 0) 0x7f5bec0c5380 con 0x7f5bec0c5750 2024-01-19T04:18:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5beaa00640 1 -- 172.21.15.32:0/2933752510 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bcc003530 con 0x7f5bec0c5750 2024-01-19T04:18:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5beaa00640 1 -- 172.21.15.32:0/2933752510 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1850623214 0 0) 0x7f5bcc003530 con 0x7f5bec0c5750 2024-01-19T04:18:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bebe00640 1 -- 172.21.15.32:0/2933752510 >> v2:172.21.15.67:3300/0 conn(0x7f5bec06c220 msgr2=0x7f5bec0c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bebe00640 1 --2- 172.21.15.32:0/2933752510 >> v2:172.21.15.67:3300/0 conn(0x7f5bec06c220 0x7f5bec0c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bebe00640 1 -- 172.21.15.32:0/2933752510 >> v1:172.21.15.32:6789/0 conn(0x7f5bec0c5750 legacy=0x7f5bec0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5bebe00640 1 -- 172.21.15.32:0/2933752510 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0a4e90 con 0x7f5bec1549a0 2024-01-19T04:18:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.663+0000 7f5beb400640 1 --2- 172.21.15.32:0/2933752510 >> v2:172.21.15.67:3300/0 conn(0x7f5bec06c220 0x7f5bec0c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:38.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bebe00640 1 --2- 172.21.15.32:0/2933752510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec1549a0 0x7f5bec154d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0097c0 tx=0x7f5bdc01c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1255fab14c58f73 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:38.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5beaa00640 1 -- 172.21.15.32:0/2933752510 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4001a00 con 0x7f5bec1549a0 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5beaa00640 1 -- 172.21.15.32:0/2933752510 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0a7050 con 0x7f5bec1549a0 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5beaa00640 1 -- 172.21.15.32:0/2933752510 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0ab620 con 0x7f5bec1549a0 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 -- 172.21.15.32:0/2933752510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec1549a0 msgr2=0x7f5bec154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/2933752510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec1549a0 0x7f5bec154d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0097c0 tx=0x7f5bdc01c310 comp rx=0 tx=0).stop 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 -- 172.21.15.32:0/2933752510 shutdown_connections 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/2933752510 >> v2:172.21.15.67:3300/0 conn(0x7f5bec06c220 0x7f5bec0c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/2933752510 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec1549a0 0x7f5bec154d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 -- 172.21.15.32:0/2933752510 >> 172.21.15.32:0/2933752510 conn(0x7f5bec0c5b40 msgr2=0x7f5bec0c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 -- 172.21.15.32:0/2933752510 shutdown_connections 2024-01-19T04:18:38.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 -- 172.21.15.32:0/2933752510 wait complete. 2024-01-19T04:18:38.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 Processor -- start 2024-01-19T04:18:38.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.667+0000 7f5bf2c00640 1 -- start start 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec06c220 0x7f5bec146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bec1549a0 0x7f5bec0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bec0c5010 0x7f5bec0aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec144240 con 0x7f5bec0c5010 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1478f0 con 0x7f5bec1549a0 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec144490 con 0x7f5bec06c220 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bec0c5010 0x7f5bec0aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bec0c5010 0x7f5bec0aab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52370/0 (socket says 172.21.15.32:52370) 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 -- 172.21.15.32:0/54557911 learned_addr learned my addr 172.21.15.32:0/54557911 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:38.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5beb400640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bec1549a0 0x7f5bec0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:38.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bebe00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec06c220 0x7f5bec146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:38.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 -- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec06c220 msgr2=0x7f5bec146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:38.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec06c220 0x7f5bec146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 -- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bec1549a0 msgr2=0x7f5bec0bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:38.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bec1549a0 0x7f5bec0bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:38.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 -- 172.21.15.32:0/54557911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4009420 con 0x7f5bec0c5010 2024-01-19T04:18:38.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf0c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bec0c5010 0x7f5bec0aab90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5be400cca0 tx=0x7f5be400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:38.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5be3e00640 1 -- 172.21.15.32:0/54557911 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4012400 con 0x7f5bec0c5010 2024-01-19T04:18:38.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5be3e00640 1 -- 172.21.15.32:0/54557911 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be4012560 con 0x7f5bec0c5010 2024-01-19T04:18:38.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5be3e00640 1 -- 172.21.15.32:0/54557911 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40128f0 con 0x7f5bec0c5010 2024-01-19T04:18:38.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc009420 con 0x7f5bec0c5010 2024-01-19T04:18:38.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec142dc0 con 0x7f5bec0c5010 2024-01-19T04:18:38.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec142fe0 con 0x7f5bec0c5010 2024-01-19T04:18:38.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.671+0000 7f5be3e00640 1 -- 172.21.15.32:0/54557911 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5be4007070 con 0x7f5bec0c5010 2024-01-19T04:18:38.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.675+0000 7f5be3e00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bc4066500 0x7f5bc40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:38.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.675+0000 7f5be3e00640 1 -- 172.21.15.32:0/54557911 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f5be4083fe0 con 0x7f5bec0c5010 2024-01-19T04:18:38.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.675+0000 7f5bebe00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bc4066500 0x7f5bc40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:38.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.675+0000 7f5bebe00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bc4066500 0x7f5bc40689c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0ad000 tx=0x7f5bdc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:38.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.679+0000 7f5be3e00640 1 -- 172.21.15.32:0/54557911 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5be40512b0 con 0x7f5bec0c5010 2024-01-19T04:18:38.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:38.839+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5bec04e980 con 0x7f5bec0c5010 2024-01-19T04:18:39.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.443+0000 7f5be3e00640 1 -- 172.21.15.32:0/54557911 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v80) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5be40170e0 con 0x7f5bec0c5010 2024-01-19T04:18:39.450 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_metadata' removed 2024-01-19T04:18:39.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bc4066500 msgr2=0x7f5bc40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bc4066500 0x7f5bc40689c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0ad000 tx=0x7f5bdc0a6000 comp rx=0 tx=0).stop 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bec0c5010 msgr2=0x7f5bec0aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bec0c5010 0x7f5bec0aab90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5be400cca0 tx=0x7f5be400a430 comp rx=0 tx=0).stop 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 shutdown_connections 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5bc4066500 0x7f5bc40689c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5bec0c5010 0x7f5bec0aab90 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bec1549a0 0x7f5bec0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 --2- 172.21.15.32:0/54557911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f5bec06c220 0x7f5bec146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.447+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 >> 172.21.15.32:0/54557911 conn(0x7f5bec0c5b40 msgr2=0x7f5bec148400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:39.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.451+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 shutdown_connections 2024-01-19T04:18:39.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.451+0000 7f5bf2c00640 1 -- 172.21.15.32:0/54557911 wait complete. 2024-01-19T04:18:39.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-19T04:18:39.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b9800640 1 Processor -- start 2024-01-19T04:18:39.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b9800640 1 -- start start 2024-01-19T04:18:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b9800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31b40c5550 0x7f31b40704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b9800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b4072a00 0x7f31b406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b9800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b4070a20 con 0x7f31b406dd00 2024-01-19T04:18:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b9800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b40c22f0 con 0x7f31b40c5550 2024-01-19T04:18:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b9800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40c1750 con 0x7f31b4072a00 2024-01-19T04:18:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31b40c5550 0x7f31b40704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:39.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31b40c5550 0x7f31b40704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52382/0 (socket says 172.21.15.32:52382) 2024-01-19T04:18:39.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b2a00640 1 -- 172.21.15.32:0/3833184486 learned_addr learned my addr 172.21.15.32:0/3833184486 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:39.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b3400640 1 --2- 172.21.15.32:0/3833184486 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b4072a00 0x7f31b406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:39.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b2a00640 1 -- 172.21.15.32:0/3833184486 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b4072a00 msgr2=0x7f31b406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:39.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b2a00640 1 --2- 172.21.15.32:0/3833184486 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b4072a00 0x7f31b406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b2a00640 1 -- 172.21.15.32:0/3833184486 >> v1:172.21.15.67:6789/0 conn(0x7f31b406dd00 legacy=0x7f31b40c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:39.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b2a00640 1 -- 172.21.15.32:0/3833184486 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4154100 con 0x7f31b40c5550 2024-01-19T04:18:39.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.623+0000 7f31b3400640 1 --2- 172.21.15.32:0/3833184486 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b4072a00 0x7f31b406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b2a00640 1 --2- 172.21.15.32:0/3833184486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b40c5550 0x7f31b40704e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009870 tx=0x7f31a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5b93a599096f69 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b1600640 1 -- 172.21.15.32:0/3833184486 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40ab600 con 0x7f31b40c5550 2024-01-19T04:18:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b1600640 1 -- 172.21.15.32:0/3833184486 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a40ab760 con 0x7f31b40c5550 2024-01-19T04:18:39.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b1600640 1 -- 172.21.15.32:0/3833184486 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40abaf0 con 0x7f31b40c5550 2024-01-19T04:18:39.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 -- 172.21.15.32:0/3833184486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b40c5550 msgr2=0x7f31b40704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:39.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 --2- 172.21.15.32:0/3833184486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b40c5550 0x7f31b40704e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009870 tx=0x7f31a401c480 comp rx=0 tx=0).stop 2024-01-19T04:18:39.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 -- 172.21.15.32:0/3833184486 shutdown_connections 2024-01-19T04:18:39.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 --2- 172.21.15.32:0/3833184486 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b4072a00 0x7f31b406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 --2- 172.21.15.32:0/3833184486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b40c5550 0x7f31b40704e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 -- 172.21.15.32:0/3833184486 >> 172.21.15.32:0/3833184486 conn(0x7f31b40c5b40 msgr2=0x7f31b40c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:39.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 -- 172.21.15.32:0/3833184486 shutdown_connections 2024-01-19T04:18:39.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.627+0000 7f31b9800640 1 -- 172.21.15.32:0/3833184486 wait complete. 2024-01-19T04:18:39.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 Processor -- start 2024-01-19T04:18:39.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 -- start start 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b406dd00 0x7f31b4143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b4072a00 0x7f31b414f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b40c5550 0x7f31b414f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b414e640 con 0x7f31b4072a00 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b414e920 con 0x7f31b406dd00 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4153de0 con 0x7f31b40c5550 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b4072a00 0x7f31b414f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b4072a00 0x7f31b414f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52388/0 (socket says 172.21.15.32:52388) 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 -- 172.21.15.32:0/2717370603 learned_addr learned my addr 172.21.15.32:0/2717370603 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:39.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2a00640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b406dd00 0x7f31b4143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:39.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b3400640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b40c5550 0x7f31b414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 -- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b40c5550 msgr2=0x7f31b414f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b40c5550 0x7f31b414f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 -- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b406dd00 msgr2=0x7f31b4143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b406dd00 0x7f31b4143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 -- 172.21.15.32:0/2717370603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a40094d0 con 0x7f31b4072a00 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b2000640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b4072a00 0x7f31b414f220 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f319c00c460 tx=0x7f319c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31aaa00640 1 -- 172.21.15.32:0/2717370603 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c0052d0 con 0x7f31b4072a00 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31aaa00640 1 -- 172.21.15.32:0/2717370603 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c005430 con 0x7f31b4072a00 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31aaa00640 1 -- 172.21.15.32:0/2717370603 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c007260 con 0x7f31b4072a00 2024-01-19T04:18:39.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b414fca0 con 0x7f31b4072a00 2024-01-19T04:18:39.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b41464d0 con 0x7f31b4072a00 2024-01-19T04:18:39.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.631+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b404e980 con 0x7f31b4072a00 2024-01-19T04:18:39.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.635+0000 7f31aaa00640 1 -- 172.21.15.32:0/2717370603 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f319c0073c0 con 0x7f31b4072a00 2024-01-19T04:18:39.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.635+0000 7f31aaa00640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f318c066500 0x7f318c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:39.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.635+0000 7f31aaa00640 1 -- 172.21.15.32:0/2717370603 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f319c0834f0 con 0x7f31b4072a00 2024-01-19T04:18:39.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.635+0000 7f31b2a00640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f318c066500 0x7f318c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:39.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.635+0000 7f31b2a00640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f318c066500 0x7f318c0689c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f31a40af000 tx=0x7f31a40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:39.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.639+0000 7f31aaa00640 1 -- 172.21.15.32:0/2717370603 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f319c050930 con 0x7f31b4072a00 2024-01-19T04:18:39.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:39.799+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31b40a5480 con 0x7f31b4072a00 2024-01-19T04:18:40.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.447+0000 7f31aaa00640 1 -- 172.21.15.32:0/2717370603 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v81) v1 ==== 172+0+0 (secure 0 0 0) 0x7f319c053f50 con 0x7f31b4072a00 2024-01-19T04:18:40.452 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs2_data' removed 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f318c066500 msgr2=0x7f318c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f318c066500 0x7f318c0689c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f31a40af000 tx=0x7f31a40b6040 comp rx=0 tx=0).stop 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b4072a00 msgr2=0x7f31b414f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b4072a00 0x7f31b414f220 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f319c00c460 tx=0x7f319c00c920 comp rx=0 tx=0).stop 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 shutdown_connections 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f318c066500 0x7f318c0689c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f31b40c5550 0x7f31b414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b4072a00 0x7f31b414f220 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 --2- 172.21.15.32:0/2717370603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b406dd00 0x7f31b4143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 >> 172.21.15.32:0/2717370603 conn(0x7f31b40c5b40 msgr2=0x7f31b4073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:40.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 shutdown_connections 2024-01-19T04:18:40.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.451+0000 7f31b9800640 1 -- 172.21.15.32:0/2717370603 wait complete. 2024-01-19T04:18:40.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-19T04:18:40.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c3200640 1 Processor -- start 2024-01-19T04:18:40.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c3200640 1 -- start start 2024-01-19T04:18:40.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c3200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f58bc0c82f0 0x7f58bc0c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c3200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0c6470 con 0x7f58bc0c3770 2024-01-19T04:18:40.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c3200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0c6ff0 con 0x7f58bc0c82f0 2024-01-19T04:18:40.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c3200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0c88a0 con 0x7f58bc1565d0 2024-01-19T04:18:40.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f58bc0c82f0 0x7f58bc0c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bbe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c1200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f58bc0c3770 0x7f58bc06eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.32:50652/0 (socket says 172.21.15.32:50652) 2024-01-19T04:18:40.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bbe00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc0c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:45532/0 (socket says 172.21.15.32:45532) 2024-01-19T04:18:40.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58c1200640 1 -- 172.21.15.32:0/185301695 learned_addr learned my addr 172.21.15.32:0/185301695 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:40.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bbe00640 1 -- 172.21.15.32:0/185301695 >> v2:172.21.15.67:3300/0 conn(0x7f58bc0c82f0 msgr2=0x7f58bc0c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:40.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bbe00640 1 --2- 172.21.15.32:0/185301695 >> v2:172.21.15.67:3300/0 conn(0x7f58bc0c82f0 0x7f58bc0c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bbe00640 1 -- 172.21.15.32:0/185301695 >> v1:172.21.15.67:6789/0 conn(0x7f58bc0c3770 legacy=0x7f58bc06eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bbe00640 1 -- 172.21.15.32:0/185301695 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0c66c0 con 0x7f58bc1565d0 2024-01-19T04:18:40.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.619+0000 7f58bb400640 1 --2- 172.21.15.32:0/185301695 >> v2:172.21.15.67:3300/0 conn(0x7f58bc0c82f0 0x7f58bc0c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:40.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58bbe00640 1 --2- 172.21.15.32:0/185301695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc0c7db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0097c0 tx=0x7f58ac01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212f02c9a6049015 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:40.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58baa00640 1 -- 172.21.15.32:0/185301695 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0ab600 con 0x7f58bc1565d0 2024-01-19T04:18:40.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58baa00640 1 -- 172.21.15.32:0/185301695 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac0a7050 con 0x7f58bc1565d0 2024-01-19T04:18:40.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58baa00640 1 -- 172.21.15.32:0/185301695 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0ab980 con 0x7f58bc1565d0 2024-01-19T04:18:40.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 -- 172.21.15.32:0/185301695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 msgr2=0x7f58bc0c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 --2- 172.21.15.32:0/185301695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc0c7db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0097c0 tx=0x7f58ac01c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 -- 172.21.15.32:0/185301695 shutdown_connections 2024-01-19T04:18:40.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 --2- 172.21.15.32:0/185301695 >> v2:172.21.15.67:3300/0 conn(0x7f58bc0c82f0 0x7f58bc0c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 --2- 172.21.15.32:0/185301695 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc0c7db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 -- 172.21.15.32:0/185301695 >> 172.21.15.32:0/185301695 conn(0x7f58bc0726d0 msgr2=0x7f58bc0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:40.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 -- 172.21.15.32:0/185301695 shutdown_connections 2024-01-19T04:18:40.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.623+0000 7f58c3200640 1 -- 172.21.15.32:0/185301695 wait complete. 2024-01-19T04:18:40.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 Processor -- start 2024-01-19T04:18:40.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 -- start start 2024-01-19T04:18:40.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58bc0c3770 0x7f58bc0a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58bc0c82f0 0x7f58bc06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc1ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0ab520 con 0x7f58bc0c82f0 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0a8050 con 0x7f58bc0c3770 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc06f1c0 con 0x7f58bc1565d0 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58bc0c82f0 0x7f58bc06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58bc0c82f0 0x7f58bc06cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52398/0 (socket says 172.21.15.32:52398) 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 -- 172.21.15.32:0/377386258 learned_addr learned my addr 172.21.15.32:0/377386258 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bbe00640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58bc0c3770 0x7f58bc0a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c1200640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc1ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 -- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 msgr2=0x7f58bc1ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc1ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 -- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58bc0c3770 msgr2=0x7f58bc0a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58bc0c3770 0x7f58bc0a7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 -- 172.21.15.32:0/377386258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4009420 con 0x7f58bc0c82f0 2024-01-19T04:18:40.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58bb400640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58bc0c82f0 0x7f58bc06cb90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f58a400e980 tx=0x7f58a400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:40.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58b3e00640 1 -- 172.21.15.32:0/377386258 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a400ca00 con 0x7f58bc0c82f0 2024-01-19T04:18:40.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58b3e00640 1 -- 172.21.15.32:0/377386258 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a400cb60 con 0x7f58bc0c82f0 2024-01-19T04:18:40.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac009420 con 0x7f58bc0c82f0 2024-01-19T04:18:40.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58b3e00640 1 -- 172.21.15.32:0/377386258 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4013470 con 0x7f58bc0c82f0 2024-01-19T04:18:40.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.627+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc1f1710 con 0x7f58bc0c82f0 2024-01-19T04:18:40.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.631+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc0c2590 con 0x7f58bc0c82f0 2024-01-19T04:18:40.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.631+0000 7f58b3e00640 1 -- 172.21.15.32:0/377386258 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f58a40135d0 con 0x7f58bc0c82f0 2024-01-19T04:18:40.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.631+0000 7f58b3e00640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5894066500 0x7f58940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.631+0000 7f58b3e00640 1 -- 172.21.15.32:0/377386258 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f58a4083e60 con 0x7f58bc0c82f0 2024-01-19T04:18:40.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.631+0000 7f58bbe00640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5894066500 0x7f58940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.631+0000 7f58bbe00640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5894066500 0x7f58940689c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0ad000 tx=0x7f58ac0a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:40.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.635+0000 7f58b3e00640 1 -- 172.21.15.32:0/377386258 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f58a4051440 con 0x7f58bc0c82f0 2024-01-19T04:18:40.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.799+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f58bc0749f0 con 0x7f58bc0c82f0 2024-01-19T04:18:40.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58b3e00640 1 -- 172.21.15.32:0/377386258 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58a4054a60 con 0x7f58bc0c82f0 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5894066500 msgr2=0x7f58940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5894066500 0x7f58940689c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0ad000 tx=0x7f58ac0a4f90 comp rx=0 tx=0).stop 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58bc0c82f0 msgr2=0x7f58bc06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58bc0c82f0 0x7f58bc06cb90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f58a400e980 tx=0x7f58a400ee40 comp rx=0 tx=0).stop 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 shutdown_connections 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5894066500 0x7f58940689c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f58bc1565d0 0x7f58bc1ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58bc0c82f0 0x7f58bc06cb90 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 --2- 172.21.15.32:0/377386258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58bc0c3770 0x7f58bc0a7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 >> 172.21.15.32:0/377386258 conn(0x7f58bc0726d0 msgr2=0x7f58bc0c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 shutdown_connections 2024-01-19T04:18:40.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.803+0000 7f58c3200640 1 -- 172.21.15.32:0/377386258 wait complete. 2024-01-19T04:18:40.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2024-01-19T04:18:40.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 Processor -- start 2024-01-19T04:18:40.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 -- start start 2024-01-19T04:18:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a34147f90 0x7f2a34151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a340c55e0 0x7f2a340c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2a3406beb0 0x7f2a340a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a340c1df0 con 0x7f2a3406beb0 2024-01-19T04:18:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a340c0810 con 0x7f2a34147f90 2024-01-19T04:18:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a3a600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340c0af0 con 0x7f2a340c55e0 2024-01-19T04:18:40.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a33e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2a3406beb0 0x7f2a340a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a33e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2a3406beb0 0x7f2a340a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52400/0 (socket says 172.21.15.32:52400) 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.967+0000 7f2a33e00640 1 -- 172.21.15.32:0/3085667165 learned_addr learned my addr 172.21.15.32:0/3085667165 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a32a00640 1 --2- 172.21.15.32:0/3085667165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a340c55e0 0x7f2a340c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33e00640 1 -- 172.21.15.32:0/3085667165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a340c55e0 msgr2=0x7f2a340c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33e00640 1 --2- 172.21.15.32:0/3085667165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a340c55e0 0x7f2a340c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33400640 1 --2- 172.21.15.32:0/3085667165 >> v2:172.21.15.67:3300/0 conn(0x7f2a34147f90 0x7f2a34151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33e00640 1 -- 172.21.15.32:0/3085667165 >> v2:172.21.15.67:3300/0 conn(0x7f2a34147f90 msgr2=0x7f2a34151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33e00640 1 --2- 172.21.15.32:0/3085667165 >> v2:172.21.15.67:3300/0 conn(0x7f2a34147f90 0x7f2a34151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33e00640 1 -- 172.21.15.32:0/3085667165 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a340c0dd0 con 0x7f2a3406beb0 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a32a00640 1 --2- 172.21.15.32:0/3085667165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a340c55e0 0x7f2a340c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:40.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33400640 1 --2- 172.21.15.32:0/3085667165 >> v2:172.21.15.67:3300/0 conn(0x7f2a34147f90 0x7f2a34151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:40.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a33e00640 1 --2- 172.21.15.32:0/3085667165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a3406beb0 0x7f2a340a4d10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2a3406f5f0 tx=0x7f2a2c01eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c111fede04a29cb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:40.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a32000640 1 -- 172.21.15.32:0/3085667165 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00b2d0 con 0x7f2a3406beb0 2024-01-19T04:18:40.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a32000640 1 -- 172.21.15.32:0/3085667165 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00b430 con 0x7f2a3406beb0 2024-01-19T04:18:40.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.971+0000 7f2a32000640 1 -- 172.21.15.32:0/3085667165 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0a7bc0 con 0x7f2a3406beb0 2024-01-19T04:18:40.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- 172.21.15.32:0/3085667165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a3406beb0 msgr2=0x7f2a340a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 --2- 172.21.15.32:0/3085667165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a3406beb0 0x7f2a340a4d10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2a3406f5f0 tx=0x7f2a2c01eb10 comp rx=0 tx=0).stop 2024-01-19T04:18:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- 172.21.15.32:0/3085667165 shutdown_connections 2024-01-19T04:18:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 --2- 172.21.15.32:0/3085667165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a3406beb0 0x7f2a340a4d10 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 --2- 172.21.15.32:0/3085667165 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a340c55e0 0x7f2a340c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 --2- 172.21.15.32:0/3085667165 >> v2:172.21.15.67:3300/0 conn(0x7f2a34147f90 0x7f2a34151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- 172.21.15.32:0/3085667165 >> 172.21.15.32:0/3085667165 conn(0x7f2a340c5b20 msgr2=0x7f2a340c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:40.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- 172.21.15.32:0/3085667165 shutdown_connections 2024-01-19T04:18:40.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- 172.21.15.32:0/3085667165 wait complete. 2024-01-19T04:18:40.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 Processor -- start 2024-01-19T04:18:40.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- start start 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3406beb0 0x7f2a340aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a340c55e0 0x7f2a341f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a34147f90 0x7f2a34150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a341f1630 con 0x7f2a340c55e0 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a341ed550 con 0x7f2a3406beb0 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a3a600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340a9220 con 0x7f2a34147f90 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a32a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a340c55e0 0x7f2a341f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a32a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a340c55e0 0x7f2a341f10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52406/0 (socket says 172.21.15.32:52406) 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a32a00640 1 -- 172.21.15.32:0/1804759297 learned_addr learned my addr 172.21.15.32:0/1804759297 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:40.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a33400640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3406beb0 0x7f2a340aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a33e00640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a34147f90 0x7f2a34150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a32a00640 1 -- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a34147f90 msgr2=0x7f2a34150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.975+0000 7f2a32a00640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a34147f90 0x7f2a34150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a32a00640 1 -- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3406beb0 msgr2=0x7f2a340aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a32a00640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3406beb0 0x7f2a340aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a32a00640 1 -- 172.21.15.32:0/1804759297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c00bd40 con 0x7f2a340c55e0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a32a00640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a340c55e0 0x7f2a341f10f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c7f0 tx=0x7f2a1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a2b400640 1 -- 172.21.15.32:0/1804759297 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c004220 con 0x7f2a340c55e0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a2b400640 1 -- 172.21.15.32:0/1804759297 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c004380 con 0x7f2a340c55e0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a2b400640 1 -- 172.21.15.32:0/1804759297 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c003860 con 0x7f2a340c55e0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a340a9500 con 0x7f2a340c55e0 2024-01-19T04:18:40.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a341509b0 con 0x7f2a340c55e0 2024-01-19T04:18:40.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a340749f0 con 0x7f2a340c55e0 2024-01-19T04:18:40.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a2b400640 1 -- 172.21.15.32:0/1804759297 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2a1c003bd0 con 0x7f2a340c55e0 2024-01-19T04:18:40.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a2b400640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a0c066530 0x7f2a0c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:40.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a2b400640 1 -- 172.21.15.32:0/1804759297 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2a1c0839f0 con 0x7f2a340c55e0 2024-01-19T04:18:40.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.979+0000 7f2a33400640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a0c066530 0x7f2a0c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:40.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.983+0000 7f2a33400640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a0c066530 0x7f2a0c0689f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2a3406c900 tx=0x7f2a24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:40.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:40.983+0000 7f2a2b400640 1 -- 172.21.15.32:0/1804759297 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2a1c050fd0 con 0x7f2a340c55e0 2024-01-19T04:18:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.203+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f2a340c53c0 con 0x7f2a340c55e0 2024-01-19T04:18:41.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a2b400640 1 -- 172.21.15.32:0/1804759297 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v233) v1 ==== 159+0+0 (secure 0 0 0) 0x7f2a1c01e0e0 con 0x7f2a340c55e0 2024-01-19T04:18:41.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a0c066530 msgr2=0x7f2a0c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:41.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a0c066530 0x7f2a0c0689f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2a3406c900 tx=0x7f2a24008040 comp rx=0 tx=0).stop 2024-01-19T04:18:41.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a340c55e0 msgr2=0x7f2a341f10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:41.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a340c55e0 0x7f2a341f10f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c7f0 tx=0x7f2a1c00ccb0 comp rx=0 tx=0).stop 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 shutdown_connections 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f2a0c066530 0x7f2a0c0689f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f2a34147f90 0x7f2a34150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a340c55e0 0x7f2a341f10f0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 --2- 172.21.15.32:0/1804759297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3406beb0 0x7f2a340aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 >> 172.21.15.32:0/1804759297 conn(0x7f2a340c5b20 msgr2=0x7f2a340a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 shutdown_connections 2024-01-19T04:18:41.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:41.451+0000 7f2a3a600640 1 -- 172.21.15.32:0/1804759297 wait complete. 2024-01-19T04:18:41.477 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner: 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2024-01-19T04:18:41.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/mount.py", line 749, in read_file 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner: 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-19T04:18:41.479 INFO:tasks.cephfs_test_runner:Ran 3 tests in 194.280s 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2024-01-19T04:18:41.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/mount.py", line 749, in read_file 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2024-01-19T04:18:41.481 INFO:tasks.cephfs_test_runner: 2024-01-19T04:18:41.481 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-19T04:18:41.688 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1c46498cce0b4df8ab1d9b942d035d8a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-19T04:18:41.690 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-19T04:18:41.699 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-19T04:18:41.722 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-19T04:18:41.722 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-01-19T04:18:41.723 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:41.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357748k,nr_inodes=4089437,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T04:18:41.738 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-19T04:18:41.738 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T04:18:41.748 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1978 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-19T04:18:41.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:41.749 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-01-19T04:18:41.790 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T04:18:41.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:41.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T04:18:41.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:41.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-01-19T04:18:42.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:42.064 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-19T04:18:42.074 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-19T04:18:42.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:42.075 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-19T04:18:42.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T04:18:42.139 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-01-19T04:18:42.371 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-19T04:18:42.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-19T04:18:42.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:18:42.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f8a00640 1 Processor -- start 2024-01-19T04:18:42.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f8a00640 1 -- start start 2024-01-19T04:18:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c5740 0x7fd5f00c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f8a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f00c0c90 con 0x7fd5f00c42b0 2024-01-19T04:18:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f8a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f0150cb0 con 0x7fd5f00c1120 2024-01-19T04:18:42.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0150f90 con 0x7fd5f00c5740 2024-01-19T04:18:42.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f6000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd5f00c42b0 0x7fd5f006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46992/0 (socket says 172.21.15.32:46992) 2024-01-19T04:18:42.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f6000640 1 -- 172.21.15.32:0/1089403840 learned_addr learned my addr 172.21.15.32:0/1089403840 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:42.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.523+0000 7fd5f5600640 1 --2- 172.21.15.32:0/1089403840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c5740 0x7fd5f00c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f4c00640 1 -- 172.21.15.32:0/1089403840 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161461768 0 0) 0x7fd5f00c0c90 con 0x7fd5f00c42b0 2024-01-19T04:18:42.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f4c00640 1 -- 172.21.15.32:0/1089403840 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d0003530 con 0x7fd5f00c42b0 2024-01-19T04:18:42.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f4c00640 1 -- 172.21.15.32:0/1089403840 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593490033 0 0) 0x7fd5f0150cb0 con 0x7fd5f00c1120 2024-01-19T04:18:42.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f4c00640 1 -- 172.21.15.32:0/1089403840 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f00c0c90 con 0x7fd5f00c1120 2024-01-19T04:18:42.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f5600640 1 -- 172.21.15.32:0/1089403840 >> v1:172.21.15.67:6789/0 conn(0x7fd5f00c1120 legacy=0x7fd5f015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f5600640 1 -- 172.21.15.32:0/1089403840 >> v1:172.21.15.32:6789/0 conn(0x7fd5f00c42b0 legacy=0x7fd5f006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f5600640 1 -- 172.21.15.32:0/1089403840 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f00c0640 con 0x7fd5f00c5740 2024-01-19T04:18:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f5600640 1 --2- 172.21.15.32:0/1089403840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c5740 0x7fd5f00c4690 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80097f0 tx=0x7fd5d801ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6591dfe301e5d3e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f4c00640 1 -- 172.21.15.32:0/1089403840 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80ac600 con 0x7fd5f00c5740 2024-01-19T04:18:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f4c00640 1 -- 172.21.15.32:0/1089403840 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d80a8050 con 0x7fd5f00c5740 2024-01-19T04:18:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.527+0000 7fd5f4c00640 1 -- 172.21.15.32:0/1089403840 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80ac980 con 0x7fd5f00c5740 2024-01-19T04:18:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- 172.21.15.32:0/1089403840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c5740 msgr2=0x7fd5f00c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/1089403840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c5740 0x7fd5f00c4690 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80097f0 tx=0x7fd5d801ce60 comp rx=0 tx=0).stop 2024-01-19T04:18:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- 172.21.15.32:0/1089403840 shutdown_connections 2024-01-19T04:18:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/1089403840 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c5740 0x7fd5f00c4690 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- 172.21.15.32:0/1089403840 >> 172.21.15.32:0/1089403840 conn(0x7fd5f00c5b20 msgr2=0x7fd5f00c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- 172.21.15.32:0/1089403840 shutdown_connections 2024-01-19T04:18:42.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- 172.21.15.32:0/1089403840 wait complete. 2024-01-19T04:18:42.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 Processor -- start 2024-01-19T04:18:42.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- start start 2024-01-19T04:18:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c1120 0x7fd5f014b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f00c42b0 0x7fd5f01501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5f00c5740 0x7fd5f014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00ab400 con 0x7fd5f00c42b0 2024-01-19T04:18:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00aad60 con 0x7fd5f00c5740 2024-01-19T04:18:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f8a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01ed7e0 con 0x7fd5f00c1120 2024-01-19T04:18:42.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f00c42b0 0x7fd5f01501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f6000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c1120 0x7fd5f014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f00c42b0 0x7fd5f01501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52416/0 (socket says 172.21.15.32:52416) 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5f00c5740 0x7fd5f014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.531+0000 7fd5f5600640 1 -- 172.21.15.32:0/407220011 learned_addr learned my addr 172.21.15.32:0/407220011 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f5600640 1 -- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c1120 msgr2=0x7fd5f014b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f5600640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c1120 0x7fd5f014b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f5600640 1 -- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5f00c5740 msgr2=0x7fd5f014a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f5600640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5f00c5740 0x7fd5f014a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f5600640 1 -- 172.21.15.32:0/407220011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8009420 con 0x7fd5f00c42b0 2024-01-19T04:18:42.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f5600640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f00c42b0 0x7fd5f01501f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8019010 tx=0x7fd5d801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:42.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5ee000640 1 -- 172.21.15.32:0/407220011 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80b5460 con 0x7fd5f00c42b0 2024-01-19T04:18:42.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5ee000640 1 -- 172.21.15.32:0/407220011 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d80b55e0 con 0x7fd5f00c42b0 2024-01-19T04:18:42.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5ee000640 1 -- 172.21.15.32:0/407220011 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80b5990 con 0x7fd5f00c42b0 2024-01-19T04:18:42.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f014c270 con 0x7fd5f00c42b0 2024-01-19T04:18:42.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f014bf90 con 0x7fd5f00c42b0 2024-01-19T04:18:42.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f01ed970 con 0x7fd5f00c42b0 2024-01-19T04:18:42.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5ee000640 1 -- 172.21.15.32:0/407220011 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd5d80b3070 con 0x7fd5f00c42b0 2024-01-19T04:18:42.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5ee000640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd5c8066500 0x7fd5c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.535+0000 7fd5ee000640 1 -- 172.21.15.32:0/407220011 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd5d811d430 con 0x7fd5f00c42b0 2024-01-19T04:18:42.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.539+0000 7fd5f6000640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd5c8066500 0x7fd5c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.539+0000 7fd5f6000640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd5c8066500 0x7fd5c80689c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007fd0 tx=0x7fd5e0007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:42.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.543+0000 7fd5ee000640 1 -- 172.21.15.32:0/407220011 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd5d80ea980 con 0x7fd5f00c42b0 2024-01-19T04:18:42.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.699+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5f00a51f0 con 0x7fd5c8066500 2024-01-19T04:18:42.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.699+0000 7fd5ee000640 1 -- 172.21.15.32:0/407220011 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50586 (secure 0 0 0) 0x7fd5e0001510 con 0x7fd5c8066500 2024-01-19T04:18:42.705 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:18:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd5c8066500 msgr2=0x7fd5c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd5c8066500 0x7fd5c80689c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007fd0 tx=0x7fd5e0007d80 comp rx=0 tx=0).stop 2024-01-19T04:18:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f00c42b0 msgr2=0x7fd5f01501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f00c42b0 0x7fd5f01501f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8019010 tx=0x7fd5d801ac40 comp rx=0 tx=0).stop 2024-01-19T04:18:42.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 shutdown_connections 2024-01-19T04:18:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fd5c8066500 0x7fd5c80689c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5f00c5740 0x7fd5f014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f00c42b0 0x7fd5f01501f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 --2- 172.21.15.32:0/407220011 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fd5f00c1120 0x7fd5f014b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 >> 172.21.15.32:0/407220011 conn(0x7fd5f00c5b20 msgr2=0x7fd5f00c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 shutdown_connections 2024-01-19T04:18:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.703+0000 7fd5f8a00640 1 -- 172.21.15.32:0/407220011 wait complete. 2024-01-19T04:18:42.727 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-01-19T04:18:42.086845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262380,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712340,"statfs":{"total":773094113280,"available":772825436160,"internally_reserved":0,"allocated":8986624,"data_stored":4617648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":259575347},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001739"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":213,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-19T04:18:33.985496+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:18:33.985496+0000","last_peered":"2024-01-19T04:18:33.985496+0000","last_clean":"2024-01-19T04:18:33.985496+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:18:33.985496+0000","last_undegraded":"2024-01-19T04:18:33.985496+0000","last_fullsized":"2024-01-19T04:18:33.985496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476785,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1018617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.036,"15min":1.036},"last":0.622}]},{"osd":1,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":1.228,"15min":1.228},"last":0.755},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84699999999999998,"5min":1.661,"15min":1.661},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81399999999999995,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.878}]},{"osd":3,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.78000000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.86699999999999999,"5min":1.49,"15min":1.49},"last":0.94399999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.046},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.51600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":1.514,"15min":1.514},"last":0.97799999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.65300000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0069999999999999,"5min":1.391,"15min":1.391},"last":1.02},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":1.359,"15min":1.359},"last":0.86499999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476785,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":428789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66300000000000003,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.93100000000000005}]}]},{"osd":5,"up_from":16,"seq":68719476784,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":428207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96399999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83199999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.014,"15min":1.014},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67100000000000004,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80800000000000005,"5min":1.107,"15min":1.107},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94899999999999995,"5min":1.246,"15min":1.246},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.86599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.708,"15min":1.708},"last":1.075}]}]},{"osd":4,"up_from":16,"seq":68719476786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":995328,"data_stored":439404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":0.997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84999999999999998,"5min":1.25,"15min":1.25},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.147,"15min":1.147},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97699999999999998,"5min":1.175,"15min":1.175},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0469999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":1.224,"15min":1.224},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0700000000000001,"5min":1.381,"15min":1.381},"last":0.89300000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.119,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.139,"15min":1.139},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1830000000000001,"5min":1.266,"15min":1.266},"last":0.80000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":428309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64000000000000001,"5min":0.879,"15min":0.879},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.57299999999999995},"min":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81599999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71599999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3480000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.135,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2789999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2350000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.085,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.95899999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":428275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.41699999999999998},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.504},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":1.964,"15min":1.964},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55800000000000005,"15min":0.58599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.628},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64900000000000002,"5min":2.827,"15min":2.827},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56200000000000006,"5min":2.343,"15min":2.343},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":1.665,"15min":1.665},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.042,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92900000000000005,"5min":1.198,"15min":1.198},"last":0.871},{"interface":"front","average":{"1min":0.75,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0089999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0600000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.878,"15min":0.93899999999999995},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.95399999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":1012916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.54500000000000004,"15min":0.60999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.56299999999999994,"15min":0.621},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56899999999999995,"5min":3.129,"15min":3.129},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.624,"15min":0.68600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66400000000000003,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58499999999999996,"15min":0.64500000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68000000000000005,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.73699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.63800000000000001,"5min":3.633,"15min":3.633},"last":0.503},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.64500000000000002,"15min":0.72699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.374}]},{"osd":4,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89000000000000001,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.88300000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.90100000000000002,"15min":0.98599999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91900000000000004,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93200000000000005,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.878},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":1.032},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94599999999999995,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.95699999999999996,"15min":1.0600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88700000000000001,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91400000000000003,"15min":0.98999999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.89100000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.97899999999999998},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.98599999999999999,"15min":1.0800000000000001},"min":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94399999999999995,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.83099999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335540,"statfs":{"total":96636764160,"available":96599592960,"internally_reserved":0,"allocated":978944,"data_stored":433131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.52700000000000002,"15min":0.57299999999999995},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1359999999999999,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.254},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.373,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.70799999999999996,"15min":0.79500000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.67100000000000004},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.8759999999999999,"5min":5.226,"15min":5.226},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67400000000000004,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.972,"5min":5.319,"15min":5.319},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66100000000000003,"15min":0.72699999999999998},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.1759999999999999,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88,"15min":0.93799999999999994},"min":{"1min":0.49099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.501}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.085,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.51800000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.669,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9319999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.93899999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2170000000000001,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3129999999999999,"5min":5.423,"15min":5.423},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.97699999999999998,"15min":1.0609999999999999},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.022,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:18:42.729 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:18:42.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.863+0000 7f7a66e00640 1 Processor -- start 2024-01-19T04:18:42.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.863+0000 7f7a66e00640 1 -- start start 2024-01-19T04:18:42.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a66e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a600a7200 0x7f7a600c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a66e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a600c41f0 0x7f7a60154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a66e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a601547e0 con 0x7f7a60151de0 2024-01-19T04:18:42.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a66e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a601521c0 con 0x7f7a600a7200 2024-01-19T04:18:42.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a66e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6006f820 con 0x7f7a600c41f0 2024-01-19T04:18:42.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a5f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a600a7200 0x7f7a600c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a5f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a600a7200 0x7f7a600c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52422/0 (socket says 172.21.15.32:52422) 2024-01-19T04:18:42.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a5f400640 1 -- 172.21.15.32:0/2520174864 learned_addr learned my addr 172.21.15.32:0/2520174864 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:42.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a64e00640 1 --2- 172.21.15.32:0/2520174864 >> v2:172.21.15.67:3300/0 conn(0x7f7a600c41f0 0x7f7a60154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a5f400640 1 -- 172.21.15.32:0/2520174864 >> v2:172.21.15.67:3300/0 conn(0x7f7a600c41f0 msgr2=0x7f7a60154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:42.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a5f400640 1 --2- 172.21.15.32:0/2520174864 >> v2:172.21.15.67:3300/0 conn(0x7f7a600c41f0 0x7f7a60154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a5f400640 1 -- 172.21.15.32:0/2520174864 >> v1:172.21.15.32:6789/0 conn(0x7f7a60151de0 legacy=0x7f7a600c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.867+0000 7f7a5f400640 1 -- 172.21.15.32:0/2520174864 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6006fb00 con 0x7f7a600a7200 2024-01-19T04:18:42.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a5f400640 1 --2- 172.21.15.32:0/2520174864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600a7200 0x7f7a600c3cb0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7a60158d40 tx=0x7f7a4801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78ea7226ec5b089 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:42.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a5ea00640 1 -- 172.21.15.32:0/2520174864 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480ab640 con 0x7f7a600a7200 2024-01-19T04:18:42.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a5ea00640 1 -- 172.21.15.32:0/2520174864 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480a7070 con 0x7f7a600a7200 2024-01-19T04:18:42.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a5ea00640 1 -- 172.21.15.32:0/2520174864 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480ab9c0 con 0x7f7a600a7200 2024-01-19T04:18:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 -- 172.21.15.32:0/2520174864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600a7200 msgr2=0x7f7a600c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 --2- 172.21.15.32:0/2520174864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600a7200 0x7f7a600c3cb0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7a60158d40 tx=0x7f7a4801c440 comp rx=0 tx=0).stop 2024-01-19T04:18:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 -- 172.21.15.32:0/2520174864 shutdown_connections 2024-01-19T04:18:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 --2- 172.21.15.32:0/2520174864 >> v2:172.21.15.67:3300/0 conn(0x7f7a600c41f0 0x7f7a60154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 --2- 172.21.15.32:0/2520174864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600a7200 0x7f7a600c3cb0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 -- 172.21.15.32:0/2520174864 >> 172.21.15.32:0/2520174864 conn(0x7f7a600726d0 msgr2=0x7f7a600663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 -- 172.21.15.32:0/2520174864 shutdown_connections 2024-01-19T04:18:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 -- 172.21.15.32:0/2520174864 wait complete. 2024-01-19T04:18:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 Processor -- start 2024-01-19T04:18:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.871+0000 7f7a66e00640 1 -- start start 2024-01-19T04:18:42.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a600a7200 0x7f7a601568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600c41f0 0x7f7a6014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a60151de0 0x7f7a6014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a601ee090 con 0x7f7a600c41f0 2024-01-19T04:18:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6014e910 con 0x7f7a600a7200 2024-01-19T04:18:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a60159520 con 0x7f7a60151de0 2024-01-19T04:18:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600c41f0 0x7f7a6014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600c41f0 0x7f7a6014de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52424/0 (socket says 172.21.15.32:52424) 2024-01-19T04:18:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 -- 172.21.15.32:0/1775392117 learned_addr learned my addr 172.21.15.32:0/1775392117 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a64e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a60151de0 0x7f7a6014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5fe00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a600a7200 0x7f7a601568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 -- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a60151de0 msgr2=0x7f7a6014e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a60151de0 0x7f7a6014e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 -- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a600a7200 msgr2=0x7f7a601568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a600a7200 0x7f7a601568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 -- 172.21.15.32:0/1775392117 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480094d0 con 0x7f7a600c41f0 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a64e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a60151de0 0x7f7a6014e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:42.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a5f400640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600c41f0 0x7f7a6014de90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7a48019050 tx=0x7f7a4801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:42.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a57e00640 1 -- 172.21.15.32:0/1775392117 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480abe80 con 0x7f7a600c41f0 2024-01-19T04:18:42.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a57e00640 1 -- 172.21.15.32:0/1775392117 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480be3f0 con 0x7f7a600c41f0 2024-01-19T04:18:42.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a57e00640 1 -- 172.21.15.32:0/1775392117 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480be780 con 0x7f7a600c41f0 2024-01-19T04:18:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a60159800 con 0x7f7a600c41f0 2024-01-19T04:18:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a60159dc0 con 0x7f7a600c41f0 2024-01-19T04:18:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.875+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a600749f0 con 0x7f7a600c41f0 2024-01-19T04:18:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.879+0000 7f7a57e00640 1 -- 172.21.15.32:0/1775392117 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7a480c7440 con 0x7f7a600c41f0 2024-01-19T04:18:42.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.879+0000 7f7a57e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7a38066530 0x7f7a380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:42.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.879+0000 7f7a57e00640 1 -- 172.21.15.32:0/1775392117 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7a4811e3e0 con 0x7f7a600c41f0 2024-01-19T04:18:42.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.879+0000 7f7a5fe00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7a38066530 0x7f7a380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:42.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.879+0000 7f7a5fe00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7a38066530 0x7f7a380689f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7a600c8380 tx=0x7f7a50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:42.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:42.883+0000 7f7a57e00640 1 -- 172.21.15.32:0/1775392117 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7a480eb9b0 con 0x7f7a600c41f0 2024-01-19T04:18:43.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.039+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a600c2740 con 0x7f7a38066530 2024-01-19T04:18:43.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.043+0000 7f7a57e00640 1 -- 172.21.15.32:0/1775392117 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50586 (secure 0 0 0) 0x7f7a500050d0 con 0x7f7a38066530 2024-01-19T04:18:43.049 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:43.049 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:18:43.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7a38066530 msgr2=0x7f7a380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7a38066530 0x7f7a380689f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7a600c8380 tx=0x7f7a50009040 comp rx=0 tx=0).stop 2024-01-19T04:18:43.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600c41f0 msgr2=0x7f7a6014de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600c41f0 0x7f7a6014de90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7a48019050 tx=0x7f7a4801ac80 comp rx=0 tx=0).stop 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 shutdown_connections 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7a38066530 0x7f7a380689f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f7a60151de0 0x7f7a6014e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600c41f0 0x7f7a6014de90 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 --2- 172.21.15.32:0/1775392117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a600a7200 0x7f7a601568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 >> 172.21.15.32:0/1775392117 conn(0x7f7a600726d0 msgr2=0x7f7a601511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 shutdown_connections 2024-01-19T04:18:43.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.047+0000 7f7a66e00640 1 -- 172.21.15.32:0/1775392117 wait complete. 2024-01-19T04:18:43.070 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-01-19T04:18:42.086845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262380,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712340,"statfs":{"total":773094113280,"available":772825436160,"internally_reserved":0,"allocated":8986624,"data_stored":4617648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":259575347},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001739"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":213,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-19T04:18:33.985496+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:18:33.985496+0000","last_peered":"2024-01-19T04:18:33.985496+0000","last_clean":"2024-01-19T04:18:33.985496+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:18:33.985496+0000","last_undegraded":"2024-01-19T04:18:33.985496+0000","last_fullsized":"2024-01-19T04:18:33.985496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476785,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1018617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.036,"15min":1.036},"last":0.622}]},{"osd":1,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":1.228,"15min":1.228},"last":0.755},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84699999999999998,"5min":1.661,"15min":1.661},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81399999999999995,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.878}]},{"osd":3,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.78000000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.86699999999999999,"5min":1.49,"15min":1.49},"last":0.94399999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.046},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.51600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":1.514,"15min":1.514},"last":0.97799999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.65300000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0069999999999999,"5min":1.391,"15min":1.391},"last":1.02},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":1.359,"15min":1.359},"last":0.86499999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476785,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":428789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66300000000000003,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.93100000000000005}]}]},{"osd":5,"up_from":16,"seq":68719476784,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":428207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96399999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83199999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.014,"15min":1.014},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67100000000000004,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80800000000000005,"5min":1.107,"15min":1.107},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94899999999999995,"5min":1.246,"15min":1.246},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.86599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.708,"15min":1.708},"last":1.075}]}]},{"osd":4,"up_from":16,"seq":68719476786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":995328,"data_stored":439404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":0.997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84999999999999998,"5min":1.25,"15min":1.25},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.147,"15min":1.147},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97699999999999998,"5min":1.175,"15min":1.175},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0469999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":1.224,"15min":1.224},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0700000000000001,"5min":1.381,"15min":1.381},"last":0.89300000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.119,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.139,"15min":1.139},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1830000000000001,"5min":1.266,"15min":1.266},"last":0.80000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":428309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64000000000000001,"5min":0.879,"15min":0.879},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.57299999999999995},"min":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81599999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71599999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3480000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.135,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2789999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2350000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.085,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.95899999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":428275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.41699999999999998},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.504},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":1.964,"15min":1.964},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55800000000000005,"15min":0.58599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.628},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64900000000000002,"5min":2.827,"15min":2.827},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56200000000000006,"5min":2.343,"15min":2.343},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":1.665,"15min":1.665},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.042,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92900000000000005,"5min":1.198,"15min":1.198},"last":0.871},{"interface":"front","average":{"1min":0.75,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0089999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0600000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.878,"15min":0.93899999999999995},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.95399999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":1012916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.54500000000000004,"15min":0.60999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.56299999999999994,"15min":0.621},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56899999999999995,"5min":3.129,"15min":3.129},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.624,"15min":0.68600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66400000000000003,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58499999999999996,"15min":0.64500000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68000000000000005,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.73699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.63800000000000001,"5min":3.633,"15min":3.633},"last":0.503},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.64500000000000002,"15min":0.72699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.374}]},{"osd":4,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89000000000000001,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.88300000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.90100000000000002,"15min":0.98599999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91900000000000004,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93200000000000005,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.878},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":1.032},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94599999999999995,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.95699999999999996,"15min":1.0600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88700000000000001,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91400000000000003,"15min":0.98999999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.89100000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.97899999999999998},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.98599999999999999,"15min":1.0800000000000001},"min":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94399999999999995,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.83099999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335540,"statfs":{"total":96636764160,"available":96599592960,"internally_reserved":0,"allocated":978944,"data_stored":433131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.52700000000000002,"15min":0.57299999999999995},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1359999999999999,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.254},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.373,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.70799999999999996,"15min":0.79500000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.67100000000000004},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.8759999999999999,"5min":5.226,"15min":5.226},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67400000000000004,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.972,"5min":5.319,"15min":5.319},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66100000000000003,"15min":0.72699999999999998},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.1759999999999999,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88,"15min":0.93799999999999994},"min":{"1min":0.49099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.501}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.085,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.51800000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.669,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9319999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.93899999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2170000000000001,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3129999999999999,"5min":5.423,"15min":5.423},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.97699999999999998,"15min":1.0609999999999999},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.022,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:18:43.071 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-19T04:18:43.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:18:43.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d3c00640 1 Processor -- start 2024-01-19T04:18:43.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d3c00640 1 -- start start 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d3c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc155500 0x7f21cc0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d3c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f21cc0c6d70 0x7f21cc0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d3c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc06ed70 con 0x7f21cc0c3900 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d3c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc06e400 con 0x7f21cc0c6d70 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d3c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0c7340 con 0x7f21cc155500 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21cbe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f21cc0c6d70 0x7f21cc0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21cbe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f21cc0c6d70 0x7f21cc0c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52440/0 (socket says 172.21.15.32:52440) 2024-01-19T04:18:43.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21cbe00640 1 -- 172.21.15.32:0/584888582 learned_addr learned my addr 172.21.15.32:0/584888582 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:43.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.207+0000 7f21d1200640 1 --2- 172.21.15.32:0/584888582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc155500 0x7f21cc0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cbe00640 1 -- 172.21.15.32:0/584888582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc155500 msgr2=0x7f21cc0c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:43.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cbe00640 1 --2- 172.21.15.32:0/584888582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc155500 0x7f21cc0c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cbe00640 1 -- 172.21.15.32:0/584888582 >> v1:172.21.15.67:6789/0 conn(0x7f21cc0c3900 legacy=0x7f21cc0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cbe00640 1 -- 172.21.15.32:0/584888582 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc06efc0 con 0x7f21cc0c6d70 2024-01-19T04:18:43.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cbe00640 1 --2- 172.21.15.32:0/584888582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc0c6d70 0x7f21cc0c41b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009870 tx=0x7f21b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8097e020639978b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cb400640 1 -- 172.21.15.32:0/584888582 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40ab680 con 0x7f21cc0c6d70 2024-01-19T04:18:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cb400640 1 -- 172.21.15.32:0/584888582 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40ab7e0 con 0x7f21cc0c6d70 2024-01-19T04:18:43.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.211+0000 7f21cb400640 1 -- 172.21.15.32:0/584888582 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40abb70 con 0x7f21cc0c6d70 2024-01-19T04:18:43.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- 172.21.15.32:0/584888582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc0c6d70 msgr2=0x7f21cc0c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 --2- 172.21.15.32:0/584888582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc0c6d70 0x7f21cc0c41b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009870 tx=0x7f21b401c480 comp rx=0 tx=0).stop 2024-01-19T04:18:43.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- 172.21.15.32:0/584888582 shutdown_connections 2024-01-19T04:18:43.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 --2- 172.21.15.32:0/584888582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc0c6d70 0x7f21cc0c41b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 --2- 172.21.15.32:0/584888582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc155500 0x7f21cc0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- 172.21.15.32:0/584888582 >> 172.21.15.32:0/584888582 conn(0x7f21cc0726d0 msgr2=0x7f21cc0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:43.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- 172.21.15.32:0/584888582 shutdown_connections 2024-01-19T04:18:43.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- 172.21.15.32:0/584888582 wait complete. 2024-01-19T04:18:43.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 Processor -- start 2024-01-19T04:18:43.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- start start 2024-01-19T04:18:43.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21cc0c3900 0x7f21cc0ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc0c6d70 0x7f21cc0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc155500 0x7f21cc1f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0ac410 con 0x7f21cc155500 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc157400 con 0x7f21cc0c3900 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d3c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc1570b0 con 0x7f21cc0c6d70 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d1c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc155500 0x7f21cc1f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d1c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc155500 0x7f21cc1f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52454/0 (socket says 172.21.15.32:52454) 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d1c00640 1 -- 172.21.15.32:0/1443709235 learned_addr learned my addr 172.21.15.32:0/1443709235 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21cbe00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc0c6d70 0x7f21cc0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d1200640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21cc0c3900 0x7f21cc0ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.215+0000 7f21d1c00640 1 -- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc0c6d70 msgr2=0x7f21cc0abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d1c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc0c6d70 0x7f21cc0abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d1c00640 1 -- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21cc0c3900 msgr2=0x7f21cc0ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d1c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21cc0c3900 0x7f21cc0ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d1c00640 1 -- 172.21.15.32:0/1443709235 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40094d0 con 0x7f21cc155500 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d1c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc155500 0x7f21cc1f0890 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f21c400c730 tx=0x7f21c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21c8c00640 1 -- 172.21.15.32:0/1443709235 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4006d60 con 0x7f21cc155500 2024-01-19T04:18:43.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21c8c00640 1 -- 172.21.15.32:0/1443709235 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4005020 con 0x7f21cc155500 2024-01-19T04:18:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21c8c00640 1 -- 172.21.15.32:0/1443709235 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4005410 con 0x7f21cc155500 2024-01-19T04:18:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc0ace10 con 0x7f21cc155500 2024-01-19T04:18:43.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc06d360 con 0x7f21cc155500 2024-01-19T04:18:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc0749f0 con 0x7f21cc155500 2024-01-19T04:18:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21c8c00640 1 -- 172.21.15.32:0/1443709235 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f21c4005570 con 0x7f21cc155500 2024-01-19T04:18:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21c8c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21a4066500 0x7f21a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.219+0000 7f21c8c00640 1 -- 172.21.15.32:0/1443709235 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f21c4083670 con 0x7f21cc155500 2024-01-19T04:18:43.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.223+0000 7f21d1200640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21a4066500 0x7f21a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.223+0000 7f21d1200640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21a4066500 0x7f21a40689c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009af0 tx=0x7f21bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:43.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.223+0000 7f21c8c00640 1 -- 172.21.15.32:0/1443709235 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f21c4050ba0 con 0x7f21cc155500 2024-01-19T04:18:43.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.383+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21cc156f30 con 0x7f21a4066500 2024-01-19T04:18:43.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21c8c00640 1 -- 172.21.15.32:0/1443709235 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50586 (secure 0 0 0) 0x7f21bc0119b0 con 0x7f21a4066500 2024-01-19T04:18:43.392 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:43.392 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:18:43.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21a4066500 msgr2=0x7f21a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21a4066500 0x7f21a40689c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009af0 tx=0x7f21bc008040 comp rx=0 tx=0).stop 2024-01-19T04:18:43.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc155500 msgr2=0x7f21cc1f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc155500 0x7f21cc1f0890 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f21c400c730 tx=0x7f21c400cbf0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 shutdown_connections 2024-01-19T04:18:43.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f21a4066500 0x7f21a40689c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21cc155500 0x7f21cc1f0890 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f21cc0c6d70 0x7f21cc0abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 --2- 172.21.15.32:0/1443709235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21cc0c3900 0x7f21cc0ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 >> 172.21.15.32:0/1443709235 conn(0x7f21cc0726d0 msgr2=0x7f21cc0c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:43.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 shutdown_connections 2024-01-19T04:18:43.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.391+0000 7f21d3c00640 1 -- 172.21.15.32:0/1443709235 wait complete. 2024-01-19T04:18:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-01-19T04:18:42.086845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262380,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712340,"statfs":{"total":773094113280,"available":772825436160,"internally_reserved":0,"allocated":8986624,"data_stored":4617648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":259575347},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001739"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":213,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-19T04:18:33.985496+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:18:33.985496+0000","last_peered":"2024-01-19T04:18:33.985496+0000","last_clean":"2024-01-19T04:18:33.985496+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:18:33.985496+0000","last_undegraded":"2024-01-19T04:18:33.985496+0000","last_fullsized":"2024-01-19T04:18:33.985496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476785,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1018617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.036,"15min":1.036},"last":0.622}]},{"osd":1,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":1.228,"15min":1.228},"last":0.755},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84699999999999998,"5min":1.661,"15min":1.661},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81399999999999995,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.878}]},{"osd":3,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.78000000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.86699999999999999,"5min":1.49,"15min":1.49},"last":0.94399999999999995}]},{"osd":4,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.046},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.51600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":1.514,"15min":1.514},"last":0.97799999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.65300000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0069999999999999,"5min":1.391,"15min":1.391},"last":1.02},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":1.359,"15min":1.359},"last":0.86499999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476785,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":428789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66300000000000003,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.93100000000000005}]}]},{"osd":5,"up_from":16,"seq":68719476784,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":428207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96399999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83199999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.014,"15min":1.014},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67100000000000004,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80800000000000005,"5min":1.107,"15min":1.107},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94899999999999995,"5min":1.246,"15min":1.246},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.86599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.708,"15min":1.708},"last":1.075}]}]},{"osd":4,"up_from":16,"seq":68719476786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":995328,"data_stored":439404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":0.997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84999999999999998,"5min":1.25,"15min":1.25},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.147,"15min":1.147},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97699999999999998,"5min":1.175,"15min":1.175},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0469999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":1.224,"15min":1.224},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0700000000000001,"5min":1.381,"15min":1.381},"last":0.89300000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.119,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.139,"15min":1.139},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1830000000000001,"5min":1.266,"15min":1.266},"last":0.80000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":428309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64000000000000001,"5min":0.879,"15min":0.879},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.57299999999999995},"min":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81599999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71599999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3480000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.135,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2789999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2350000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.085,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.95899999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":428275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.41699999999999998},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.504},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":1.964,"15min":1.964},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55800000000000005,"15min":0.58599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.628},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64900000000000002,"5min":2.827,"15min":2.827},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56200000000000006,"5min":2.343,"15min":2.343},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":1.665,"15min":1.665},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.042,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92900000000000005,"5min":1.198,"15min":1.198},"last":0.871},{"interface":"front","average":{"1min":0.75,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0089999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0600000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.878,"15min":0.93899999999999995},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.95399999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":1012916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.54500000000000004,"15min":0.60999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.56299999999999994,"15min":0.621},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56899999999999995,"5min":3.129,"15min":3.129},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.624,"15min":0.68600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66400000000000003,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58499999999999996,"15min":0.64500000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68000000000000005,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.73699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.63800000000000001,"5min":3.633,"15min":3.633},"last":0.503},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.64500000000000002,"15min":0.72699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.374}]},{"osd":4,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89000000000000001,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.88300000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.90100000000000002,"15min":0.98599999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91900000000000004,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93200000000000005,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.878},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":1.032},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94599999999999995,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.95699999999999996,"15min":1.0600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88700000000000001,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91400000000000003,"15min":0.98999999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.89100000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.97899999999999998},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.98599999999999999,"15min":1.0800000000000001},"min":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94399999999999995,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.83099999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335540,"statfs":{"total":96636764160,"available":96599592960,"internally_reserved":0,"allocated":978944,"data_stored":433131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.52700000000000002,"15min":0.57299999999999995},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1359999999999999,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.254},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.373,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.70799999999999996,"15min":0.79500000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.67100000000000004},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.8759999999999999,"5min":5.226,"15min":5.226},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67400000000000004,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.972,"5min":5.319,"15min":5.319},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66100000000000003,"15min":0.72699999999999998},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.1759999999999999,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88,"15min":0.93799999999999994},"min":{"1min":0.49099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.501}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.085,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.51800000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.669,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9319999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.93899999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2170000000000001,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3129999999999999,"5min":5.423,"15min":5.423},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.97699999999999998,"15min":1.0609999999999999},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.022,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:18:43.414 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T04:18:43.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe242000640 1 Processor -- start 2024-01-19T04:18:43.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe242000640 1 -- start start 2024-01-19T04:18:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe242000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06fda0 0x7fe23c0c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe242000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c0c5b40 con 0x7fe23c151f30 2024-01-19T04:18:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe242000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c0c3fa0 con 0x7fe23c06eb70 2024-01-19T04:18:43.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe242000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1551e0 con 0x7fe23c06fda0 2024-01-19T04:18:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe23b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe23c151f30 0x7fe23c0c4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47016/0 (socket says 172.21.15.32:47016) 2024-01-19T04:18:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe23b400640 1 -- 172.21.15.32:0/3458524051 learned_addr learned my addr 172.21.15.32:0/3458524051 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.551+0000 7fe23aa00640 1 --2- 172.21.15.32:0/3458524051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06fda0 0x7fe23c0c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23a000640 1 -- 172.21.15.32:0/3458524051 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811216355 0 0) 0x7fe23c0c5b40 con 0x7fe23c151f30 2024-01-19T04:18:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23a000640 1 -- 172.21.15.32:0/3458524051 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe21c003530 con 0x7fe23c151f30 2024-01-19T04:18:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23a000640 1 -- 172.21.15.32:0/3458524051 <== mon.1 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26485042 0 0) 0x7fe23c0c3fa0 con 0x7fe23c06eb70 2024-01-19T04:18:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23a000640 1 -- 172.21.15.32:0/3458524051 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe23c0c5b40 con 0x7fe23c06eb70 2024-01-19T04:18:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23aa00640 1 -- 172.21.15.32:0/3458524051 >> v1:172.21.15.67:6789/0 conn(0x7fe23c06eb70 legacy=0x7fe23c06f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23aa00640 1 -- 172.21.15.32:0/3458524051 >> v1:172.21.15.32:6789/0 conn(0x7fe23c151f30 legacy=0x7fe23c0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23aa00640 1 -- 172.21.15.32:0/3458524051 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c155710 con 0x7fe23c06fda0 2024-01-19T04:18:43.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23aa00640 1 --2- 172.21.15.32:0/3458524051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06fda0 0x7fe23c0c4b40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2240097f0 tx=0x7fe22401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72cc9176dd93af66 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23a000640 1 -- 172.21.15.32:0/3458524051 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240ab600 con 0x7fe23c06fda0 2024-01-19T04:18:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23a000640 1 -- 172.21.15.32:0/3458524051 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2240a7050 con 0x7fe23c06fda0 2024-01-19T04:18:43.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.555+0000 7fe23a000640 1 -- 172.21.15.32:0/3458524051 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240ab960 con 0x7fe23c06fda0 2024-01-19T04:18:43.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- 172.21.15.32:0/3458524051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06fda0 msgr2=0x7fe23c0c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 --2- 172.21.15.32:0/3458524051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06fda0 0x7fe23c0c4b40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2240097f0 tx=0x7fe22401c430 comp rx=0 tx=0).stop 2024-01-19T04:18:43.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- 172.21.15.32:0/3458524051 shutdown_connections 2024-01-19T04:18:43.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 --2- 172.21.15.32:0/3458524051 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06fda0 0x7fe23c0c4b40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- 172.21.15.32:0/3458524051 >> 172.21.15.32:0/3458524051 conn(0x7fe23c0a9870 msgr2=0x7fe23c0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:43.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- 172.21.15.32:0/3458524051 shutdown_connections 2024-01-19T04:18:43.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- 172.21.15.32:0/3458524051 wait complete. 2024-01-19T04:18:43.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 Processor -- start 2024-01-19T04:18:43.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- start start 2024-01-19T04:18:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06eb70 0x7fe23c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe23c06fda0 0x7fe23c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe23c151f30 0x7fe23c1f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c151b90 con 0x7fe23c151f30 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1505f0 con 0x7fe23c06fda0 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe242000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c14ffe0 con 0x7fe23c06eb70 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe23c151f30 0x7fe23c1f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe23c151f30 0x7fe23c1f0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52464/0 (socket says 172.21.15.32:52464) 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23be00640 1 -- 172.21.15.32:0/1734871867 learned_addr learned my addr 172.21.15.32:0/1734871867 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23b400640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06eb70 0x7fe23c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23aa00640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe23c06fda0 0x7fe23c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23be00640 1 -- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06eb70 msgr2=0x7fe23c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23be00640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06eb70 0x7fe23c0ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23be00640 1 -- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe23c06fda0 msgr2=0x7fe23c151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.559+0000 7fe23be00640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe23c06fda0 0x7fe23c151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe23be00640 1 -- 172.21.15.32:0/1734871867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224009420 con 0x7fe23c151f30 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe23b400640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06eb70 0x7fe23c0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe23aa00640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe23c06fda0 0x7fe23c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe23be00640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe23c151f30 0x7fe23c1f0380 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c730 tx=0x7fe23400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:43.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe233400640 1 -- 172.21.15.32:0/1734871867 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234003b80 con 0x7fe23c151f30 2024-01-19T04:18:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe233400640 1 -- 172.21.15.32:0/1734871867 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234003ce0 con 0x7fe23c151f30 2024-01-19T04:18:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c1f0cd0 con 0x7fe23c151f30 2024-01-19T04:18:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe233400640 1 -- 172.21.15.32:0/1734871867 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400aa90 con 0x7fe23c151f30 2024-01-19T04:18:43.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c1f0fb0 con 0x7fe23c151f30 2024-01-19T04:18:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c0ad5e0 con 0x7fe23c151f30 2024-01-19T04:18:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe233400640 1 -- 172.21.15.32:0/1734871867 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe23400abf0 con 0x7fe23c151f30 2024-01-19T04:18:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe233400640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe214066500 0x7fe2140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:43.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.563+0000 7fe233400640 1 -- 172.21.15.32:0/1734871867 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe2340839c0 con 0x7fe23c151f30 2024-01-19T04:18:43.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.567+0000 7fe23b400640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe214066500 0x7fe2140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:43.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.567+0000 7fe23b400640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe214066500 0x7fe2140689c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0011f0 tx=0x7fe22c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:43.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.567+0000 7fe233400640 1 -- 172.21.15.32:0/1734871867 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe23c0ad5e0 con 0x7fe23c151f30 2024-01-19T04:18:43.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.731+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe23c0ad5e0 con 0x7fe23c151f30 2024-01-19T04:18:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.731+0000 7fe233400640 1 -- 172.21.15.32:0/1734871867 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+13020 (secure 0 0 0) 0x7fe23c0ad5e0 con 0x7fe23c151f30 2024-01-19T04:18:43.737 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:43.737 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":81,"fsid":"d7445317-ddd8-4205-bf5b-c51cd46cffd9","created":"2024-01-19T04:14:36.856372+0000","modified":"2024-01-19T04:18:40.450611+0000","last_up_change":"2024-01-19T04:14:49.396650+0000","last_in_change":"2024-01-19T04:14:39.463353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T04:14:50.088600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740b2d0c-0b17-4d22-b7fe-389e3ef160bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6818","nonce":4180731217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6821","nonce":4180731217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6827","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6829","nonce":4180731217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6823","nonce":4180731217},{"type":"v1","addr":"172.21.15.32:6825","nonce":4180731217}]},"public_addr":"172.21.15.32:6818/4180731217","cluster_addr":"172.21.15.32:6821/4180731217","heartbeat_back_addr":"172.21.15.32:6829/4180731217","heartbeat_front_addr":"172.21.15.32:6825/4180731217","state":["exists","up"]},{"osd":1,"uuid":"53cdbb2c-7315-41b5-8d5b-9529b19ae589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6809","nonce":3082627308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6811","nonce":3082627308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6815","nonce":3082627308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3082627308},{"type":"v1","addr":"172.21.15.32:6813","nonce":3082627308}]},"public_addr":"172.21.15.32:6809/3082627308","cluster_addr":"172.21.15.32:6811/3082627308","heartbeat_back_addr":"172.21.15.32:6815/3082627308","heartbeat_front_addr":"172.21.15.32:6813/3082627308","state":["exists","up"]},{"osd":2,"uuid":"d57a1047-f559-494c-a108-633177df81c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6801","nonce":1746987778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6803","nonce":1746987778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6807","nonce":1746987778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1746987778},{"type":"v1","addr":"172.21.15.32:6805","nonce":1746987778}]},"public_addr":"172.21.15.32:6801/1746987778","cluster_addr":"172.21.15.32:6803/1746987778","heartbeat_back_addr":"172.21.15.32:6807/1746987778","heartbeat_front_addr":"172.21.15.32:6805/1746987778","state":["exists","up"]},{"osd":3,"uuid":"ba489804-04eb-44d3-a7c5-d2d6b09ee0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6819","nonce":3668363434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6824","nonce":3668363434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6831","nonce":3668363434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3668363434},{"type":"v1","addr":"172.21.15.32:6828","nonce":3668363434}]},"public_addr":"172.21.15.32:6819/3668363434","cluster_addr":"172.21.15.32:6824/3668363434","heartbeat_back_addr":"172.21.15.32:6831/3668363434","heartbeat_front_addr":"172.21.15.32:6828/3668363434","state":["exists","up"]},{"osd":4,"uuid":"0d6b8553-b674-45ed-a527-fd8c9d5726ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6801","nonce":73147838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6803","nonce":73147838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6807","nonce":73147838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":73147838},{"type":"v1","addr":"172.21.15.67:6805","nonce":73147838}]},"public_addr":"172.21.15.67:6801/73147838","cluster_addr":"172.21.15.67:6803/73147838","heartbeat_back_addr":"172.21.15.67:6807/73147838","heartbeat_front_addr":"172.21.15.67:6805/73147838","state":["exists","up"]},{"osd":5,"uuid":"335150a5-8328-44fe-9d7f-86b0c525ee43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6810","nonce":1136197459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6814","nonce":1136197459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6821","nonce":1136197459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1136197459},{"type":"v1","addr":"172.21.15.67:6817","nonce":1136197459}]},"public_addr":"172.21.15.67:6810/1136197459","cluster_addr":"172.21.15.67:6814/1136197459","heartbeat_back_addr":"172.21.15.67:6821/1136197459","heartbeat_front_addr":"172.21.15.67:6817/1136197459","state":["exists","up"]},{"osd":6,"uuid":"07623ff6-1566-4024-8990-269e377b9068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6811","nonce":44142691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6813","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6815","nonce":44142691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6823","nonce":44142691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":44142691},{"type":"v1","addr":"172.21.15.67:6820","nonce":44142691}]},"public_addr":"172.21.15.67:6811/44142691","cluster_addr":"172.21.15.67:6815/44142691","heartbeat_back_addr":"172.21.15.67:6823/44142691","heartbeat_front_addr":"172.21.15.67:6820/44142691","state":["exists","up"]},{"osd":7,"uuid":"9788335f-6ed0-4675-8937-356278be3f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6825","nonce":472535671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6827","nonce":472535671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6831","nonce":472535671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":472535671},{"type":"v1","addr":"172.21.15.67:6829","nonce":472535671}]},"public_addr":"172.21.15.67:6825/472535671","cluster_addr":"172.21.15.67:6827/472535671","heartbeat_back_addr":"172.21.15.67:6831/472535671","heartbeat_front_addr":"172.21.15.67:6829/472535671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.145807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.359998+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.304886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.029657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.071981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.139662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.040725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T04:14:45.254189+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6833/3037787697":"2024-01-20T04:18:37.444707+0000","172.21.15.32:6835/3037787697":"2024-01-20T04:18:37.444707+0000","172.21.15.67:6837/208534071":"2024-01-20T04:18:30.834878+0000","172.21.15.67:6835/208534071":"2024-01-20T04:18:30.834878+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T04:18:43.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe214066500 msgr2=0x7fe2140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe214066500 0x7fe2140689c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0011f0 tx=0x7fe22c009040 comp rx=0 tx=0).stop 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe23c151f30 msgr2=0x7fe23c1f0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe23c151f30 0x7fe23c1f0380 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c730 tx=0x7fe23400cbf0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 shutdown_connections 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe214066500 0x7fe2140689c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe23c151f30 0x7fe23c1f0380 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe23c06fda0 0x7fe23c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 --2- 172.21.15.32:0/1734871867 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe23c06eb70 0x7fe23c0ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:43.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 >> 172.21.15.32:0/1734871867 conn(0x7fe23c0a9870 msgr2=0x7fe23c0a8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:43.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 shutdown_connections 2024-01-19T04:18:43.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:43.735+0000 7fe242000640 1 -- 172.21.15.32:0/1734871867 wait complete. 2024-01-19T04:18:44.765 INFO:tasks.ceph:Scrubbing osd.0 2024-01-19T04:18:44.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:44.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.919+0000 7fdf11400640 1 Processor -- start 2024-01-19T04:18:44.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.919+0000 7fdf11400640 1 -- start start 2024-01-19T04:18:44.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.919+0000 7fdf11400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf0c1553d0 0x7fdf0c0bf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:44.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.919+0000 7fdf11400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0c0a70 con 0x7fdf0c06d990 2024-01-19T04:18:44.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.919+0000 7fdf11400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0c44f0 con 0x7fdf0c0a4d10 2024-01-19T04:18:44.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.919+0000 7fdf11400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c3a40 con 0x7fdf0c1553d0 2024-01-19T04:18:44.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf0a800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf0c1553d0 0x7fdf0c0bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:44.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf09e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdf0c06d990 0x7fdf0c06c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47018/0 (socket says 172.21.15.32:47018) 2024-01-19T04:18:44.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf0a800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf0c1553d0 0x7fdf0c0bf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52466/0 (socket says 172.21.15.32:52466) 2024-01-19T04:18:44.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf09e00640 1 -- 172.21.15.32:0/3849162114 learned_addr learned my addr 172.21.15.32:0/3849162114 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:44.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf0a800640 1 -- 172.21.15.32:0/3849162114 >> v1:172.21.15.67:6789/0 conn(0x7fdf0c0a4d10 legacy=0x7fdf0c15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:44.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf0a800640 1 -- 172.21.15.32:0/3849162114 >> v1:172.21.15.32:6789/0 conn(0x7fdf0c06d990 legacy=0x7fdf0c06c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:44.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf0a800640 1 -- 172.21.15.32:0/3849162114 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0bfdf0 con 0x7fdf0c1553d0 2024-01-19T04:18:44.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf0a800640 1 --2- 172.21.15.32:0/3849162114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c0bf520 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0097c0 tx=0x7fdefc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566a92ce83ef7a6e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:44.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf09400640 1 -- 172.21.15.32:0/3849162114 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0ab600 con 0x7fdf0c1553d0 2024-01-19T04:18:44.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf09400640 1 -- 172.21.15.32:0/3849162114 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc0a7050 con 0x7fdf0c1553d0 2024-01-19T04:18:44.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.923+0000 7fdf09400640 1 -- 172.21.15.32:0/3849162114 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0ab980 con 0x7fdf0c1553d0 2024-01-19T04:18:44.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- 172.21.15.32:0/3849162114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 msgr2=0x7fdf0c0bf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:44.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 --2- 172.21.15.32:0/3849162114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c0bf520 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0097c0 tx=0x7fdefc01c3b0 comp rx=0 tx=0).stop 2024-01-19T04:18:44.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- 172.21.15.32:0/3849162114 shutdown_connections 2024-01-19T04:18:44.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 --2- 172.21.15.32:0/3849162114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c0bf520 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:44.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- 172.21.15.32:0/3849162114 >> 172.21.15.32:0/3849162114 conn(0x7fdf0c0c5b40 msgr2=0x7fdf0c0c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:44.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- 172.21.15.32:0/3849162114 shutdown_connections 2024-01-19T04:18:44.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- 172.21.15.32:0/3849162114 wait complete. 2024-01-19T04:18:44.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 Processor -- start 2024-01-19T04:18:44.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- start start 2024-01-19T04:18:44.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf0c06d990 0x7fdf0c1eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0a4d10 0x7fdf0c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1ef110 con 0x7fdf0c1553d0 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c071730 con 0x7fdf0c0a4d10 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf11400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c071a10 con 0x7fdf0c06d990 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf0b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf0b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52470/0 (socket says 172.21.15.32:52470) 2024-01-19T04:18:44.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf0b200640 1 -- 172.21.15.32:0/563975070 learned_addr learned my addr 172.21.15.32:0/563975070 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.927+0000 7fdf0a800640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf0c06d990 0x7fdf0c1eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf09e00640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0a4d10 0x7fdf0c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf0b200640 1 -- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf0c06d990 msgr2=0x7fdf0c1eebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf0b200640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fdf0c06d990 0x7fdf0c1eebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf0b200640 1 -- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0a4d10 msgr2=0x7fdf0c14cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf0b200640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0a4d10 0x7fdf0c14cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf0b200640 1 -- 172.21.15.32:0/563975070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc009420 con 0x7fdf0c1553d0 2024-01-19T04:18:44.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf09e00640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0a4d10 0x7fdf0c14cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:44.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf0b200640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c147920 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c780 tx=0x7fdf0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:44.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04004b70 con 0x7fdf0c1553d0 2024-01-19T04:18:44.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0400ce90 con 0x7fdf0c1553d0 2024-01-19T04:18:44.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c0a5590 con 0x7fdf0c1553d0 2024-01-19T04:18:44.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400a850 con 0x7fdf0c1553d0 2024-01-19T04:18:44.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c071fd0 con 0x7fdf0c1553d0 2024-01-19T04:18:44.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf0c06fdd0 con 0x7fdf0c1553d0 2024-01-19T04:18:44.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.931+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdf0400a9b0 con 0x7fdf0c1553d0 2024-01-19T04:18:44.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf02a00640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdee4066500 0x7fdee40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:44.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdf04084430 con 0x7fdf0c1553d0 2024-01-19T04:18:44.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf02a00640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7fdee406c400 0x7fdee406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:44.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 --> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdee406eed0 con 0x7fdee406c400 2024-01-19T04:18:44.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf040847a0 con 0x7fdf0c1553d0 2024-01-19T04:18:44.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf0a800640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdee4066500 0x7fdee40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:44.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf09e00640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7fdee406c400 0x7fdee406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:44.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf09e00640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7fdee406c400 0x7fdee406e820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:44.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf0a800640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdee4066500 0x7fdee40689c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0ad000 tx=0x7fdefc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:44.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.935+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== osd.0 v2:172.21.15.32:6816/4180731217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdee406eed0 con 0x7fdee406c400 2024-01-19T04:18:44.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 --> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf0c0bf000 con 0x7fdee406c400 2024-01-19T04:18:44.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf02a00640 1 -- 172.21.15.32:0/563975070 <== osd.0 v2:172.21.15.32:6816/4180731217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdef4001880 con 0x7fdee406c400 2024-01-19T04:18:44.954 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:44.954 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:44.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7fdee406c400 msgr2=0x7fdee406e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:44.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:6816/4180731217,v1:172.21.15.32:6818/4180731217] conn(0x7fdee406c400 0x7fdee406e820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdee4066500 msgr2=0x7fdee40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fdee4066500 0x7fdee40689c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0ad000 tx=0x7fdefc0a6000 comp rx=0 tx=0).stop 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 msgr2=0x7fdf0c147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 --2- 172.21.15.32:0/563975070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf0c1553d0 0x7fdf0c147920 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c780 tx=0x7fdf0400cc40 comp rx=0 tx=0).stop 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf0b200640 1 -- 172.21.15.32:0/563975070 reap_dead start 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 shutdown_connections 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 >> 172.21.15.32:0/563975070 conn(0x7fdf0c0c5b40 msgr2=0x7fdf0c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:44.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 shutdown_connections 2024-01-19T04:18:44.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:44.951+0000 7fdf11400640 1 -- 172.21.15.32:0/563975070 wait complete. 2024-01-19T04:18:44.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-19T04:18:45.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f610da00640 1 Processor -- start 2024-01-19T04:18:45.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f610da00640 1 -- start start 2024-01-19T04:18:45.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f610da00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6108151dd0 0x7f61080c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f610da00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f61080c4390 0x7f610815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f610da00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610814eef0 con 0x7f610814eb10 2024-01-19T04:18:45.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f610da00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080a9bb0 con 0x7f6108151dd0 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f610da00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080c47a0 con 0x7f61080c4390 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6108151dd0 0x7f61080c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f610814eb10 0x7f610806a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47022/0 (socket says 172.21.15.32:47022) 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6108151dd0 0x7f61080c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52476/0 (socket says 172.21.15.32:52476) 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106a00640 1 -- 172.21.15.32:0/3207921416 learned_addr learned my addr 172.21.15.32:0/3207921416 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6107e00640 1 --2- 172.21.15.32:0/3207921416 >> v2:172.21.15.67:3300/0 conn(0x7f61080c4390 0x7f610815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106000640 1 -- 172.21.15.32:0/3207921416 >> v2:172.21.15.67:3300/0 conn(0x7f61080c4390 msgr2=0x7f610815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106000640 1 --2- 172.21.15.32:0/3207921416 >> v2:172.21.15.67:3300/0 conn(0x7f61080c4390 0x7f610815bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106000640 1 -- 172.21.15.32:0/3207921416 >> v1:172.21.15.32:6789/0 conn(0x7f610814eb10 legacy=0x7f610806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6106000640 1 -- 172.21.15.32:0/3207921416 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610806f470 con 0x7f6108151dd0 2024-01-19T04:18:45.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.111+0000 7f6105600640 1 -- 172.21.15.32:0/3207921416 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199770188 0 0) 0x7f610814eef0 con 0x7f610814eb10 2024-01-19T04:18:45.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f6106000640 1 --2- 172.21.15.32:0/3207921416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f61080c3e50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f61080a9df0 tx=0x7f60f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3d2698746e96cb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f6105600640 1 -- 172.21.15.32:0/3207921416 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00ab600 con 0x7f6108151dd0 2024-01-19T04:18:45.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f6105600640 1 -- 172.21.15.32:0/3207921416 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f00a7050 con 0x7f6108151dd0 2024-01-19T04:18:45.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f6105600640 1 -- 172.21.15.32:0/3207921416 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00ab980 con 0x7f6108151dd0 2024-01-19T04:18:45.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f610da00640 1 -- 172.21.15.32:0/3207921416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 msgr2=0x7f61080c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f610da00640 1 --2- 172.21.15.32:0/3207921416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f61080c3e50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f61080a9df0 tx=0x7f60f001c3d0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f610da00640 1 -- 172.21.15.32:0/3207921416 shutdown_connections 2024-01-19T04:18:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f610da00640 1 --2- 172.21.15.32:0/3207921416 >> v2:172.21.15.67:3300/0 conn(0x7f61080c4390 0x7f610815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f610da00640 1 --2- 172.21.15.32:0/3207921416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f61080c3e50 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.115+0000 7f610da00640 1 -- 172.21.15.32:0/3207921416 >> 172.21.15.32:0/3207921416 conn(0x7f610806d6c0 msgr2=0x7f610806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 -- 172.21.15.32:0/3207921416 shutdown_connections 2024-01-19T04:18:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 -- 172.21.15.32:0/3207921416 wait complete. 2024-01-19T04:18:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 Processor -- start 2024-01-19T04:18:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 -- start start 2024-01-19T04:18:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61080c4390 0x7f61081f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610814eb10 0x7f6108136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f6108136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108152240 con 0x7f6108151dd0 2024-01-19T04:18:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61081f10f0 con 0x7f610814eb10 2024-01-19T04:18:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f610da00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610814d1e0 con 0x7f61080c4390 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f6108136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f6108136f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52490/0 (socket says 172.21.15.32:52490) 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 -- 172.21.15.32:0/1244241911 learned_addr learned my addr 172.21.15.32:0/1244241911 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6106000640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610814eb10 0x7f6108136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6106a00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61080c4390 0x7f61081f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 -- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61080c4390 msgr2=0x7f61081f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61080c4390 0x7f61081f04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 -- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610814eb10 msgr2=0x7f6108136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610814eb10 0x7f6108136a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 -- 172.21.15.32:0/1244241911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f0009420 con 0x7f6108151dd0 2024-01-19T04:18:45.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.119+0000 7f6107e00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f6108136f60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6100007e90 tx=0x7f610000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f60fea00640 1 -- 172.21.15.32:0/1244241911 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100014420 con 0x7f6108151dd0 2024-01-19T04:18:45.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f60fea00640 1 -- 172.21.15.32:0/1244241911 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100014580 con 0x7f6108151dd0 2024-01-19T04:18:45.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f60fea00640 1 -- 172.21.15.32:0/1244241911 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100014930 con 0x7f6108151dd0 2024-01-19T04:18:45.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6108150760 con 0x7f6108151dd0 2024-01-19T04:18:45.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61081500f0 con 0x7f6108151dd0 2024-01-19T04:18:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610804e980 con 0x7f6108151dd0 2024-01-19T04:18:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f60fea00640 1 -- 172.21.15.32:0/1244241911 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6100014a90 con 0x7f6108151dd0 2024-01-19T04:18:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f60fea00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f60e0066500 0x7f60e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f60fea00640 1 -- 172.21.15.32:0/1244241911 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f61000843b0 con 0x7f6108151dd0 2024-01-19T04:18:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.123+0000 7f6106a00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f60e0066500 0x7f60e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.127+0000 7f6106a00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f60e0066500 0x7f60e00689c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f60f8007fd0 tx=0x7f60f8007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.127+0000 7f60fea00640 1 -- 172.21.15.32:0/1244241911 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6100051990 con 0x7f6108151dd0 2024-01-19T04:18:45.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f61080a92f0 con 0x7f60e0066500 2024-01-19T04:18:45.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f60fea00640 1 -- 172.21.15.32:0/1244241911 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60f8004c80 con 0x7f60e0066500 2024-01-19T04:18:45.295 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2024-01-19T04:18:45.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f60e0066500 msgr2=0x7f60e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f60e0066500 0x7f60e00689c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f60f8007fd0 tx=0x7f60f8007d60 comp rx=0 tx=0).stop 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 msgr2=0x7f6108136f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f6108136f60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6100007e90 tx=0x7f610000e4b0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 shutdown_connections 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f60e0066500 0x7f60e00689c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6108151dd0 0x7f6108136f60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f610814eb10 0x7f6108136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 --2- 172.21.15.32:0/1244241911 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f61080c4390 0x7f61081f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 >> 172.21.15.32:0/1244241911 conn(0x7f610806d6c0 msgr2=0x7f610806daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:45.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 shutdown_connections 2024-01-19T04:18:45.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.291+0000 7f610da00640 1 -- 172.21.15.32:0/1244241911 wait complete. 2024-01-19T04:18:45.316 INFO:tasks.ceph:Scrubbing osd.1 2024-01-19T04:18:45.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:45.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e6c00640 1 Processor -- start 2024-01-19T04:18:45.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e6c00640 1 -- start start 2024-01-19T04:18:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e6c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54e00c5550 0x7f54e00704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e6c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e0072a00 0x7f54e006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e6c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e0070a20 con 0x7f54e006dd00 2024-01-19T04:18:45.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e6c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e00c22f0 con 0x7f54e00c5550 2024-01-19T04:18:45.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e6c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00c1750 con 0x7f54e0072a00 2024-01-19T04:18:45.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54e00c5550 0x7f54e00704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54e00c5550 0x7f54e00704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52506/0 (socket says 172.21.15.32:52506) 2024-01-19T04:18:45.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dfe00640 1 -- 172.21.15.32:0/2419575439 learned_addr learned my addr 172.21.15.32:0/2419575439 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:45.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54e4c00640 1 --2- 172.21.15.32:0/2419575439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e0072a00 0x7f54e006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dfe00640 1 -- 172.21.15.32:0/2419575439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e0072a00 msgr2=0x7f54e006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:45.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dfe00640 1 --2- 172.21.15.32:0/2419575439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e0072a00 0x7f54e006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dfe00640 1 -- 172.21.15.32:0/2419575439 >> v1:172.21.15.32:6789/0 conn(0x7f54e006dd00 legacy=0x7f54e00c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dfe00640 1 -- 172.21.15.32:0/2419575439 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0154100 con 0x7f54e00c5550 2024-01-19T04:18:45.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.459+0000 7f54dea00640 1 -- 172.21.15.32:0/2419575439 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213215582 0 0) 0x7f54e0070a20 con 0x7f54e006dd00 2024-01-19T04:18:45.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54dfe00640 1 --2- 172.21.15.32:0/2419575439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e00c5550 0x7f54e00704e0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009870 tx=0x7f54d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6870defbf6948e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54dea00640 1 -- 172.21.15.32:0/2419575439 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00ab600 con 0x7f54e00c5550 2024-01-19T04:18:45.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54dea00640 1 -- 172.21.15.32:0/2419575439 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d00a7050 con 0x7f54e00c5550 2024-01-19T04:18:45.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54dea00640 1 -- 172.21.15.32:0/2419575439 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00ab980 con 0x7f54e00c5550 2024-01-19T04:18:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 -- 172.21.15.32:0/2419575439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e00c5550 msgr2=0x7f54e00704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 --2- 172.21.15.32:0/2419575439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e00c5550 0x7f54e00704e0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009870 tx=0x7f54d001c480 comp rx=0 tx=0).stop 2024-01-19T04:18:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 -- 172.21.15.32:0/2419575439 shutdown_connections 2024-01-19T04:18:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 --2- 172.21.15.32:0/2419575439 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e0072a00 0x7f54e006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 --2- 172.21.15.32:0/2419575439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e00c5550 0x7f54e00704e0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 -- 172.21.15.32:0/2419575439 >> 172.21.15.32:0/2419575439 conn(0x7f54e00c5b40 msgr2=0x7f54e00c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 -- 172.21.15.32:0/2419575439 shutdown_connections 2024-01-19T04:18:45.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.463+0000 7f54e6c00640 1 -- 172.21.15.32:0/2419575439 wait complete. 2024-01-19T04:18:45.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 Processor -- start 2024-01-19T04:18:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 -- start start 2024-01-19T04:18:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e006dd00 0x7f54e015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e0072a00 0x7f54e014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54e00c5550 0x7f54e014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e014af90 con 0x7f54e0072a00 2024-01-19T04:18:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01eeb60 con 0x7f54e00c5550 2024-01-19T04:18:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01f1120 con 0x7f54e006dd00 2024-01-19T04:18:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e0072a00 0x7f54e014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e0072a00 0x7f54e014a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52516/0 (socket says 172.21.15.32:52516) 2024-01-19T04:18:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 -- 172.21.15.32:0/2348316538 learned_addr learned my addr 172.21.15.32:0/2348316538 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54dfe00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e006dd00 0x7f54e015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e4c00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54e00c5550 0x7f54e014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 -- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e006dd00 msgr2=0x7f54e015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f54e006dd00 0x7f54e015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 -- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54e00c5550 msgr2=0x7f54e014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54e00c5550 0x7f54e014aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 -- 172.21.15.32:0/2348316538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00094d0 con 0x7f54e0072a00 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54df400640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e0072a00 0x7f54e014a510 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c520 tx=0x7f54c800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8003600 con 0x7f54e0072a00 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c8003780 con 0x7f54e0072a00 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e01f1400 con 0x7f54e0072a00 2024-01-19T04:18:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8003b30 con 0x7f54e0072a00 2024-01-19T04:18:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e01ee7f0 con 0x7f54e0072a00 2024-01-19T04:18:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.467+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54e0154380 con 0x7f54e0072a00 2024-01-19T04:18:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f54c8003c90 con 0x7f54e0072a00 2024-01-19T04:18:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54d7e00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f54b8066530 0x7f54b80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f54c8083150 con 0x7f54e0072a00 2024-01-19T04:18:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54d7e00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f54b806c430 0x7f54b806e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 --> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54b806ef00 con 0x7f54b806c430 2024-01-19T04:18:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54c80856d0 con 0x7f54e0072a00 2024-01-19T04:18:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54dfe00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f54b8066530 0x7f54b80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54e4c00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f54b806c430 0x7f54b806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54e4c00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f54b806c430 0x7f54b806e850 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54dfe00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f54b8066530 0x7f54b80689f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ad000 tx=0x7f54d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.471+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== osd.1 v2:172.21.15.32:6808/3082627308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f54b806ef00 con 0x7f54b806c430 2024-01-19T04:18:45.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 --> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f54e01eecd0 con 0x7f54b806c430 2024-01-19T04:18:45.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54d7e00640 1 -- 172.21.15.32:0/2348316538 <== osd.1 v2:172.21.15.32:6808/3082627308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f54e01eecd0 con 0x7f54b806c430 2024-01-19T04:18:45.491 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:45.491 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:45.491 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:45.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f54b806c430 msgr2=0x7f54b806e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:6808/3082627308,v1:172.21.15.32:6809/3082627308] conn(0x7f54b806c430 0x7f54b806e850 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f54b8066530 msgr2=0x7f54b80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f54b8066530 0x7f54b80689f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ad000 tx=0x7f54d0008040 comp rx=0 tx=0).stop 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e0072a00 msgr2=0x7f54e014a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 --2- 172.21.15.32:0/2348316538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e0072a00 0x7f54e014a510 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c520 tx=0x7f54c800c9e0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e4c00640 1 -- 172.21.15.32:0/2348316538 reap_dead start 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 shutdown_connections 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 >> 172.21.15.32:0/2348316538 conn(0x7f54e00c5b40 msgr2=0x7f54e0070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 shutdown_connections 2024-01-19T04:18:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.487+0000 7f54e6c00640 1 -- 172.21.15.32:0/2348316538 wait complete. 2024-01-19T04:18:45.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-19T04:18:45.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8fa600640 1 Processor -- start 2024-01-19T04:18:45.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8fa600640 1 -- start start 2024-01-19T04:18:45.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8fa600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8f414f8f0 0x7fa8f41559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8fa600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8f40c4130 0x7fa8f40c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8fa600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f41530e0 con 0x7fa8f414fcd0 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8fa600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40c3130 con 0x7fa8f40c4130 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8fa600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f41527b0 con 0x7fa8f414f8f0 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8f2a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8f414fcd0 0x7fa8f4155ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47036/0 (socket says 172.21.15.32:47036) 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8f3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8f40c4130 0x7fa8f40c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.647+0000 7fa8f2a00640 1 -- 172.21.15.32:0/2514347767 learned_addr learned my addr 172.21.15.32:0/2514347767 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f3400640 1 --2- 172.21.15.32:0/2514347767 >> v2:172.21.15.67:3300/0 conn(0x7fa8f414f8f0 0x7fa8f41559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f3e00640 1 -- 172.21.15.32:0/2514347767 >> v2:172.21.15.67:3300/0 conn(0x7fa8f414f8f0 msgr2=0x7fa8f41559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:45.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f3e00640 1 --2- 172.21.15.32:0/2514347767 >> v2:172.21.15.67:3300/0 conn(0x7fa8f414f8f0 0x7fa8f41559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f3e00640 1 -- 172.21.15.32:0/2514347767 >> v1:172.21.15.32:6789/0 conn(0x7fa8f414fcd0 legacy=0x7fa8f4155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f3e00640 1 -- 172.21.15.32:0/2514347767 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4152a90 con 0x7fa8f40c4130 2024-01-19T04:18:45.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f2000640 1 -- 172.21.15.32:0/2514347767 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842013768 0 0) 0x7fa8f41530e0 con 0x7fa8f414fcd0 2024-01-19T04:18:45.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f3e00640 1 --2- 172.21.15.32:0/2514347767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40c4130 0x7fa8f40c6bb0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4071c70 tx=0x7fa8ec01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d3284a9aab2385 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f2000640 1 -- 172.21.15.32:0/2514347767 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0a5930 con 0x7fa8f40c4130 2024-01-19T04:18:45.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f2000640 1 -- 172.21.15.32:0/2514347767 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0a5a90 con 0x7fa8f40c4130 2024-01-19T04:18:45.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.651+0000 7fa8f2000640 1 -- 172.21.15.32:0/2514347767 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0a5e20 con 0x7fa8f40c4130 2024-01-19T04:18:45.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- 172.21.15.32:0/2514347767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40c4130 msgr2=0x7fa8f40c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 --2- 172.21.15.32:0/2514347767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40c4130 0x7fa8f40c6bb0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4071c70 tx=0x7fa8ec01c850 comp rx=0 tx=0).stop 2024-01-19T04:18:45.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- 172.21.15.32:0/2514347767 shutdown_connections 2024-01-19T04:18:45.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 --2- 172.21.15.32:0/2514347767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40c4130 0x7fa8f40c6bb0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 --2- 172.21.15.32:0/2514347767 >> v2:172.21.15.67:3300/0 conn(0x7fa8f414f8f0 0x7fa8f41559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- 172.21.15.32:0/2514347767 >> 172.21.15.32:0/2514347767 conn(0x7fa8f406ddb0 msgr2=0x7fa8f406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:45.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- 172.21.15.32:0/2514347767 shutdown_connections 2024-01-19T04:18:45.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- 172.21.15.32:0/2514347767 wait complete. 2024-01-19T04:18:45.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 Processor -- start 2024-01-19T04:18:45.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- start start 2024-01-19T04:18:45.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8f40c4130 0x7fa8f40bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8f414f8f0 0x7fa8f41ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40b68f0 0x7fa8f41ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40bc0f0 con 0x7fa8f40b68f0 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40bac40 con 0x7fa8f414f8f0 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8fa600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40bb200 con 0x7fa8f40c4130 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40b68f0 0x7fa8f41ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40b68f0 0x7fa8f41ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52532/0 (socket says 172.21.15.32:52532) 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 -- 172.21.15.32:0/130492705 learned_addr learned my addr 172.21.15.32:0/130492705 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3400640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8f40c4130 0x7fa8f40bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f2a00640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8f414f8f0 0x7fa8f41ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 -- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8f40c4130 msgr2=0x7fa8f40bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8f40c4130 0x7fa8f40bd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 -- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8f414f8f0 msgr2=0x7fa8f41ed000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8f414f8f0 0x7fa8f41ed000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.655+0000 7fa8f3e00640 1 -- 172.21.15.32:0/130492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec009a70 con 0x7fa8f40b68f0 2024-01-19T04:18:45.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8f3e00640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40b68f0 0x7fa8f41ed540 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b0040 tx=0x7fa8ec0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8eb400640 1 -- 172.21.15.32:0/130492705 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0ade20 con 0x7fa8f40b68f0 2024-01-19T04:18:45.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8eb400640 1 -- 172.21.15.32:0/130492705 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec009450 con 0x7fa8f40b68f0 2024-01-19T04:18:45.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8eb400640 1 -- 172.21.15.32:0/130492705 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b9690 con 0x7fa8f40b68f0 2024-01-19T04:18:45.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f40b62a0 con 0x7fa8f40b68f0 2024-01-19T04:18:45.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f40bae90 con 0x7fa8f40b68f0 2024-01-19T04:18:45.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f40bb370 con 0x7fa8f40b68f0 2024-01-19T04:18:45.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8eb400640 1 -- 172.21.15.32:0/130492705 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa8ec0039a0 con 0x7fa8f40b68f0 2024-01-19T04:18:45.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8eb400640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8cc066530 0x7fa8cc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:45.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8eb400640 1 -- 172.21.15.32:0/130492705 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa8ec11ef50 con 0x7fa8f40b68f0 2024-01-19T04:18:45.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.659+0000 7fa8f3400640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8cc066530 0x7fa8cc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:45.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.663+0000 7fa8f3400640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8cc066530 0x7fa8cc0689f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4007a60 tx=0x7fa8e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:45.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.663+0000 7fa8eb400640 1 -- 172.21.15.32:0/130492705 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa8ec0ec530 con 0x7fa8f40b68f0 2024-01-19T04:18:45.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.827+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8f40c7900 con 0x7fa8cc066530 2024-01-19T04:18:45.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.827+0000 7fa8eb400640 1 -- 172.21.15.32:0/130492705 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa8e4010990 con 0x7fa8cc066530 2024-01-19T04:18:45.832 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2024-01-19T04:18:45.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8cc066530 msgr2=0x7fa8cc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8cc066530 0x7fa8cc0689f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4007a60 tx=0x7fa8e4008040 comp rx=0 tx=0).stop 2024-01-19T04:18:45.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40b68f0 msgr2=0x7fa8f41ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:45.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40b68f0 0x7fa8f41ed540 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b0040 tx=0x7fa8ec0195f0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 shutdown_connections 2024-01-19T04:18:45.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fa8cc066530 0x7fa8cc0689f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8f40b68f0 0x7fa8f41ed540 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8f414f8f0 0x7fa8f41ed000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 --2- 172.21.15.32:0/130492705 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fa8f40c4130 0x7fa8f40bd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:45.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 >> 172.21.15.32:0/130492705 conn(0x7fa8f406ddb0 msgr2=0x7fa8f406d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:45.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 shutdown_connections 2024-01-19T04:18:45.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.831+0000 7fa8fa600640 1 -- 172.21.15.32:0/130492705 wait complete. 2024-01-19T04:18:45.855 INFO:tasks.ceph:Scrubbing osd.2 2024-01-19T04:18:45.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:46.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.995+0000 7f3ac1400640 1 Processor -- start 2024-01-19T04:18:46.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.995+0000 7f3ac1400640 1 -- start start 2024-01-19T04:18:46.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3ac1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3abc0c49e0 0x7f3abc0c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3ac1400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 0x7f3abc0a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3ac1400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc158020 con 0x7f3abc0c5cc0 2024-01-19T04:18:46.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3ac1400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0c73c0 con 0x7f3abc0c49e0 2024-01-19T04:18:46.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3ac1400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0c7c60 con 0x7f3abc06b960 2024-01-19T04:18:46.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3aba800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3abc0c49e0 0x7f3abc0c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3ab9e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3abc0c5cc0 0x7f3abc1584b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47050/0 (socket says 172.21.15.32:47050) 2024-01-19T04:18:46.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3ab9e00640 1 -- 172.21.15.32:0/3003458758 learned_addr learned my addr 172.21.15.32:0/3003458758 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:46.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3abb200640 1 --2- 172.21.15.32:0/3003458758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 0x7f3abc0a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3aba800640 1 -- 172.21.15.32:0/3003458758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 msgr2=0x7f3abc0a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:46.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3aba800640 1 --2- 172.21.15.32:0/3003458758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 0x7f3abc0a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3aba800640 1 -- 172.21.15.32:0/3003458758 >> v1:172.21.15.32:6789/0 conn(0x7f3abc0c5cc0 legacy=0x7f3abc1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3aba800640 1 -- 172.21.15.32:0/3003458758 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc0c61d0 con 0x7f3abc0c49e0 2024-01-19T04:18:46.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:45.999+0000 7f3aba800640 1 --2- 172.21.15.32:0/3003458758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc0c3030 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0097c0 tx=0x7f3aac01bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46f9a4a24392d40 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ab9400640 1 -- 172.21.15.32:0/3003458758 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0a56a0 con 0x7f3abc0c49e0 2024-01-19T04:18:46.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ab9400640 1 -- 172.21.15.32:0/3003458758 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac0a5800 con 0x7f3abc0c49e0 2024-01-19T04:18:46.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ab9400640 1 -- 172.21.15.32:0/3003458758 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0a5b90 con 0x7f3abc0c49e0 2024-01-19T04:18:46.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- 172.21.15.32:0/3003458758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 msgr2=0x7f3abc0c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 --2- 172.21.15.32:0/3003458758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc0c3030 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0097c0 tx=0x7f3aac01bf10 comp rx=0 tx=0).stop 2024-01-19T04:18:46.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- 172.21.15.32:0/3003458758 shutdown_connections 2024-01-19T04:18:46.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 --2- 172.21.15.32:0/3003458758 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 0x7f3abc0a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 --2- 172.21.15.32:0/3003458758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc0c3030 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- 172.21.15.32:0/3003458758 >> 172.21.15.32:0/3003458758 conn(0x7f3abc0a9af0 msgr2=0x7f3abc0a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- 172.21.15.32:0/3003458758 shutdown_connections 2024-01-19T04:18:46.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- 172.21.15.32:0/3003458758 wait complete. 2024-01-19T04:18:46.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 Processor -- start 2024-01-19T04:18:46.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- start start 2024-01-19T04:18:46.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 0x7f3abc0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3abc0c5cc0 0x7f3abc0ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc06f180 con 0x7f3abc0c49e0 2024-01-19T04:18:46.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc06ee80 con 0x7f3abc0c5cc0 2024-01-19T04:18:46.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.003+0000 7f3ac1400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc06faa0 con 0x7f3abc06b960 2024-01-19T04:18:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52554/0 (socket says 172.21.15.32:52554) 2024-01-19T04:18:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 -- 172.21.15.32:0/2205194451 learned_addr learned my addr 172.21.15.32:0/2205194451 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3aba800640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 0x7f3abc0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3abb200640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3abc0c5cc0 0x7f3abc0ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 -- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 msgr2=0x7f3abc0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f3abc06b960 0x7f3abc0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 -- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3abc0c5cc0 msgr2=0x7f3abc0ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3abc0c5cc0 0x7f3abc0ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 -- 172.21.15.32:0/2205194451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009420 con 0x7f3abc0c49e0 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab9e00640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc147d00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c5d0 tx=0x7f3aa400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40074e0 con 0x7f3abc0c49e0 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4007640 con 0x7f3abc0c49e0 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4004a30 con 0x7f3abc0c49e0 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc157540 con 0x7f3abc0c49e0 2024-01-19T04:18:46.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc157800 con 0x7f3abc0c49e0 2024-01-19T04:18:46.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3abc1621d0 con 0x7f3abc0c49e0 2024-01-19T04:18:46.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.007+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3aa4004b90 con 0x7f3abc0c49e0 2024-01-19T04:18:46.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3ab2a00640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a94066500 0x7f3a940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3aa4082ea0 con 0x7f3abc0c49e0 2024-01-19T04:18:46.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3ab2a00640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f3a9406c400 0x7f3a9406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 --> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a9406eed0 con 0x7f3a9406c400 2024-01-19T04:18:46.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3aa4085480 con 0x7f3abc0c49e0 2024-01-19T04:18:46.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3aba800640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a94066500 0x7f3a940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3abb200640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f3a9406c400 0x7f3a9406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3abb200640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f3a9406c400 0x7f3a9406e820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3aba800640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a94066500 0x7f3a940689c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0ad000 tx=0x7f3aac0a8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.011+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== osd.2 v2:172.21.15.32:6800/1746987778 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3a9406eed0 con 0x7f3a9406c400 2024-01-19T04:18:46.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.023+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 --> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3abc06f2c0 con 0x7f3a9406c400 2024-01-19T04:18:46.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.023+0000 7f3ab2a00640 1 -- 172.21.15.32:0/2205194451 <== osd.2 v2:172.21.15.32:6800/1746987778 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3ab40083a0 con 0x7f3a9406c400 2024-01-19T04:18:46.029 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:46.029 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:46.030 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.023+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f3a9406c400 msgr2=0x7f3a9406e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.023+0000 7f3ac1400640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:6800/1746987778,v1:172.21.15.32:6801/1746987778] conn(0x7f3a9406c400 0x7f3a9406e820 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a94066500 msgr2=0x7f3a940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f3a94066500 0x7f3a940689c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0ad000 tx=0x7f3aac0a8040 comp rx=0 tx=0).stop 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 msgr2=0x7f3abc147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 --2- 172.21.15.32:0/2205194451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3abc0c49e0 0x7f3abc147d00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c5d0 tx=0x7f3aa400ca90 comp rx=0 tx=0).stop 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3abb200640 1 -- 172.21.15.32:0/2205194451 reap_dead start 2024-01-19T04:18:46.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 shutdown_connections 2024-01-19T04:18:46.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 >> 172.21.15.32:0/2205194451 conn(0x7f3abc0a9af0 msgr2=0x7f3abc06be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 shutdown_connections 2024-01-19T04:18:46.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.027+0000 7f3ac1400640 1 -- 172.21.15.32:0/2205194451 wait complete. 2024-01-19T04:18:46.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-19T04:18:46.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 Processor -- start 2024-01-19T04:18:46.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 -- start start 2024-01-19T04:18:46.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec14fb50 0x7fadec06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fadec0c04a0 0x7fadec0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fadec0a4ec0 0x7fadec0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec1535c0 con 0x7fadec0a4ec0 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec071e80 con 0x7fadec0c04a0 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadf1c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0726c0 con 0x7fadec14fb50 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fadec0a4ec0 0x7fadec0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fadec0a4ec0 0x7fadec0c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52570/0 (socket says 172.21.15.32:52570) 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 -- 172.21.15.32:0/3636847477 learned_addr learned my addr 172.21.15.32:0/3636847477 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeaa00640 1 --2- 172.21.15.32:0/3636847477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec14fb50 0x7fadec06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadea000640 1 --2- 172.21.15.32:0/3636847477 >> v2:172.21.15.67:3300/0 conn(0x7fadec0c04a0 0x7fadec0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 -- 172.21.15.32:0/3636847477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec14fb50 msgr2=0x7fadec06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:46.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 --2- 172.21.15.32:0/3636847477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec14fb50 0x7fadec06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 -- 172.21.15.32:0/3636847477 >> v2:172.21.15.67:3300/0 conn(0x7fadec0c04a0 msgr2=0x7fadec0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:46.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 --2- 172.21.15.32:0/3636847477 >> v2:172.21.15.67:3300/0 conn(0x7fadec0c04a0 0x7fadec0c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.187+0000 7fadeb400640 1 -- 172.21.15.32:0/3636847477 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0c1cb0 con 0x7fadec0a4ec0 2024-01-19T04:18:46.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadeb400640 1 --2- 172.21.15.32:0/3636847477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec0a4ec0 0x7fadec0c1770 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fade4009e80 tx=0x7fade401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efe96df7ccdc59d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fade9600640 1 -- 172.21.15.32:0/3636847477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40a55a0 con 0x7fadec0a4ec0 2024-01-19T04:18:46.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fade9600640 1 -- 172.21.15.32:0/3636847477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40a5700 con 0x7fadec0a4ec0 2024-01-19T04:18:46.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fade9600640 1 -- 172.21.15.32:0/3636847477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40a5a90 con 0x7fadec0a4ec0 2024-01-19T04:18:46.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 -- 172.21.15.32:0/3636847477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec0a4ec0 msgr2=0x7fadec0c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 --2- 172.21.15.32:0/3636847477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec0a4ec0 0x7fadec0c1770 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fade4009e80 tx=0x7fade401c920 comp rx=0 tx=0).stop 2024-01-19T04:18:46.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 -- 172.21.15.32:0/3636847477 shutdown_connections 2024-01-19T04:18:46.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 --2- 172.21.15.32:0/3636847477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec0a4ec0 0x7fadec0c1770 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 --2- 172.21.15.32:0/3636847477 >> v2:172.21.15.67:3300/0 conn(0x7fadec0c04a0 0x7fadec0c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 --2- 172.21.15.32:0/3636847477 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec14fb50 0x7fadec06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 -- 172.21.15.32:0/3636847477 >> 172.21.15.32:0/3636847477 conn(0x7fadec0c5b20 msgr2=0x7fadec0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 -- 172.21.15.32:0/3636847477 shutdown_connections 2024-01-19T04:18:46.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.191+0000 7fadf1c00640 1 -- 172.21.15.32:0/3636847477 wait complete. 2024-01-19T04:18:46.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 Processor -- start 2024-01-19T04:18:46.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 -- start start 2024-01-19T04:18:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadec0a4ec0 0x7fadec15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec0c04a0 0x7fadec154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec14fb50 0x7fadec155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec148c70 con 0x7fadec14fb50 2024-01-19T04:18:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec1480f0 con 0x7fadec0a4ec0 2024-01-19T04:18:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadf1c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec148340 con 0x7fadec0c04a0 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec14fb50 0x7fadec155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec14fb50 0x7fadec155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52584/0 (socket says 172.21.15.32:52584) 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 -- 172.21.15.32:0/164766702 learned_addr learned my addr 172.21.15.32:0/164766702 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeaa00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadec0a4ec0 0x7fadec15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadea000640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec0c04a0 0x7fadec154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 -- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec0c04a0 msgr2=0x7fadec154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec0c04a0 0x7fadec154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 -- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadec0a4ec0 msgr2=0x7fadec15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadec0a4ec0 0x7fadec15b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 -- 172.21.15.32:0/164766702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4009b30 con 0x7fadec14fb50 2024-01-19T04:18:46.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fadeb400640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec14fb50 0x7fadec155390 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fade401afd0 tx=0x7fade40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.195+0000 7fade2a00640 1 -- 172.21.15.32:0/164766702 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40a55a0 con 0x7fadec14fb50 2024-01-19T04:18:46.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fade2a00640 1 -- 172.21.15.32:0/164766702 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40b8670 con 0x7fadec14fb50 2024-01-19T04:18:46.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fade2a00640 1 -- 172.21.15.32:0/164766702 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40b8a20 con 0x7fadec14fb50 2024-01-19T04:18:46.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec148620 con 0x7fadec14fb50 2024-01-19T04:18:46.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec14a2e0 con 0x7fadec14fb50 2024-01-19T04:18:46.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec154b70 con 0x7fadec14fb50 2024-01-19T04:18:46.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fade2a00640 1 -- 172.21.15.32:0/164766702 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fade40b8b80 con 0x7fadec14fb50 2024-01-19T04:18:46.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fade2a00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fadc4066500 0x7fadc40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fade2a00640 1 -- 172.21.15.32:0/164766702 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fade411ed20 con 0x7fadec14fb50 2024-01-19T04:18:46.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.199+0000 7fadeaa00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fadc4066500 0x7fadc40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.203+0000 7fadeaa00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fadc4066500 0x7fadc40689c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faddc006aa0 tx=0x7faddc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.203+0000 7fade2a00640 1 -- 172.21.15.32:0/164766702 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fadec154b70 con 0x7fadec14fb50 2024-01-19T04:18:46.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.363+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fadec14ff30 con 0x7fadc4066500 2024-01-19T04:18:46.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.363+0000 7fade2a00640 1 -- 172.21.15.32:0/164766702 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faddc004030 con 0x7fadc4066500 2024-01-19T04:18:46.369 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2024-01-19T04:18:46.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fadc4066500 msgr2=0x7fadc40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fadc4066500 0x7fadc40689c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faddc006aa0 tx=0x7faddc008040 comp rx=0 tx=0).stop 2024-01-19T04:18:46.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec14fb50 msgr2=0x7fadec155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec14fb50 0x7fadec155390 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fade401afd0 tx=0x7fade40196c0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 shutdown_connections 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fadc4066500 0x7fadc40689c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fadec14fb50 0x7fadec155390 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fadec0c04a0 0x7fadec154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 --2- 172.21.15.32:0/164766702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadec0a4ec0 0x7fadec15b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 >> 172.21.15.32:0/164766702 conn(0x7fadec0c5b20 msgr2=0x7fadec0c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 shutdown_connections 2024-01-19T04:18:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.367+0000 7fadf1c00640 1 -- 172.21.15.32:0/164766702 wait complete. 2024-01-19T04:18:46.391 INFO:tasks.ceph:Scrubbing osd.3 2024-01-19T04:18:46.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:46.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5309a00640 1 Processor -- start 2024-01-19T04:18:46.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5309a00640 1 -- start start 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5309a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5304151dd0 0x7f53040c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5309a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f53040c6170 0x7f5304154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5309a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530406ebf0 con 0x7f53040a75c0 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5309a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53040708f0 con 0x7f53040c6170 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5309a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530406f600 con 0x7f5304151dd0 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5303400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f53040c6170 0x7f5304154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5303400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f53040c6170 0x7f5304154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52594/0 (socket says 172.21.15.32:52594) 2024-01-19T04:18:46.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5303400640 1 -- 172.21.15.32:0/1760259513 learned_addr learned my addr 172.21.15.32:0/1760259513 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:46.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5302a00640 1 --2- 172.21.15.32:0/1760259513 >> v2:172.21.15.67:3300/0 conn(0x7f5304151dd0 0x7f53040c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5303400640 1 -- 172.21.15.32:0/1760259513 >> v2:172.21.15.67:3300/0 conn(0x7f5304151dd0 msgr2=0x7f53040c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:46.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5303400640 1 --2- 172.21.15.32:0/1760259513 >> v2:172.21.15.67:3300/0 conn(0x7f5304151dd0 0x7f53040c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5303400640 1 -- 172.21.15.32:0/1760259513 >> v1:172.21.15.67:6789/0 conn(0x7f53040a75c0 legacy=0x7f5304154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5303400640 1 -- 172.21.15.32:0/1760259513 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040c74f0 con 0x7f53040c6170 2024-01-19T04:18:46.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.531+0000 7f5302a00640 1 --2- 172.21.15.32:0/1760259513 >> v2:172.21.15.67:3300/0 conn(0x7f5304151dd0 0x7f53040c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:46.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5303400640 1 --2- 172.21.15.32:0/1760259513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f5304154f80 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f53040aaac0 tx=0x7f52fc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3808587777af75d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5301600640 1 -- 172.21.15.32:0/1760259513 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0a5780 con 0x7f53040c6170 2024-01-19T04:18:46.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5301600640 1 -- 172.21.15.32:0/1760259513 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0a58e0 con 0x7f53040c6170 2024-01-19T04:18:46.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5301600640 1 -- 172.21.15.32:0/1760259513 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0a5c70 con 0x7f53040c6170 2024-01-19T04:18:46.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 -- 172.21.15.32:0/1760259513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 msgr2=0x7f5304154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 --2- 172.21.15.32:0/1760259513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f5304154f80 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f53040aaac0 tx=0x7f52fc01c9d0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 -- 172.21.15.32:0/1760259513 shutdown_connections 2024-01-19T04:18:46.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 --2- 172.21.15.32:0/1760259513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f5304154f80 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 --2- 172.21.15.32:0/1760259513 >> v2:172.21.15.67:3300/0 conn(0x7f5304151dd0 0x7f53040c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 -- 172.21.15.32:0/1760259513 >> 172.21.15.32:0/1760259513 conn(0x7f53040c7d30 msgr2=0x7f53040c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 -- 172.21.15.32:0/1760259513 shutdown_connections 2024-01-19T04:18:46.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.535+0000 7f5309a00640 1 -- 172.21.15.32:0/1760259513 wait complete. 2024-01-19T04:18:46.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 Processor -- start 2024-01-19T04:18:46.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 -- start start 2024-01-19T04:18:46.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53040a75c0 0x7f53040c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f53041471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304151dd0 0x7f5304155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5304148010 con 0x7f53040c6170 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53041482b0 con 0x7f5304151dd0 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53040c3560 con 0x7f53040a75c0 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f53041471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302a00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53040a75c0 0x7f53040c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5303400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304151dd0 0x7f5304155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f53041471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52602/0 (socket says 172.21.15.32:52602) 2024-01-19T04:18:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 -- 172.21.15.32:0/2053051568 learned_addr learned my addr 172.21.15.32:0/2053051568 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:46.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 -- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53040a75c0 msgr2=0x7f53040c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f53040a75c0 0x7f53040c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 -- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304151dd0 msgr2=0x7f5304155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5304151dd0 0x7f5304155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 -- 172.21.15.32:0/2053051568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc009b30 con 0x7f53040c6170 2024-01-19T04:18:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5302000640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f53041471e0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c430 tx=0x7f52ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0052d0 con 0x7f53040c6170 2024-01-19T04:18:46.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec005430 con 0x7f53040c6170 2024-01-19T04:18:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec007260 con 0x7f53040c6170 2024-01-19T04:18:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040c3840 con 0x7f53040c6170 2024-01-19T04:18:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.539+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5304147720 con 0x7f53040c6170 2024-01-19T04:18:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f530406f290 con 0x7f53040c6170 2024-01-19T04:18:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f52ec0073c0 con 0x7f53040c6170 2024-01-19T04:18:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f52faa00640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f52dc066530 0x7f52dc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f52ec082f60 con 0x7f53040c6170 2024-01-19T04:18:46.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f52faa00640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f52dc06c430 0x7f52dc06e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 --> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52dc06ef00 con 0x7f52dc06c430 2024-01-19T04:18:46.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52ec085540 con 0x7f53040c6170 2024-01-19T04:18:46.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f5302a00640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f52dc066530 0x7f52dc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f5303400640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f52dc06c430 0x7f52dc06e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f5302a00640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f52dc066530 0x7f52dc0689f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f52f40045f0 tx=0x7f52f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.543+0000 7f5303400640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f52dc06c430 0x7f52dc06e850 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.547+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== osd.3 v2:172.21.15.32:6817/3668363434 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f52dc06ef00 con 0x7f52dc06c430 2024-01-19T04:18:46.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 --> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f530406b4e0 con 0x7f52dc06c430 2024-01-19T04:18:46.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f52faa00640 1 -- 172.21.15.32:0/2053051568 <== osd.3 v2:172.21.15.32:6817/3668363434 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f530406b4e0 con 0x7f52dc06c430 2024-01-19T04:18:46.564 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:46.564 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:46.564 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:46.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f52dc06c430 msgr2=0x7f52dc06e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:6817/3668363434,v1:172.21.15.32:6819/3668363434] conn(0x7f52dc06c430 0x7f52dc06e850 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f52dc066530 msgr2=0x7f52dc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f52dc066530 0x7f52dc0689f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f52f40045f0 tx=0x7f52f4008040 comp rx=0 tx=0).stop 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 msgr2=0x7f53041471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 --2- 172.21.15.32:0/2053051568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53040c6170 0x7f53041471e0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c430 tx=0x7f52ec00c8f0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5303400640 1 -- 172.21.15.32:0/2053051568 reap_dead start 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 shutdown_connections 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 >> 172.21.15.32:0/2053051568 conn(0x7f53040c7d30 msgr2=0x7f53040c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 shutdown_connections 2024-01-19T04:18:46.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.559+0000 7f5309a00640 1 -- 172.21.15.32:0/2053051568 wait complete. 2024-01-19T04:18:46.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-19T04:18:46.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.723+0000 7fe8e9e00640 1 Processor -- start 2024-01-19T04:18:46.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.723+0000 7fe8e9e00640 1 -- start start 2024-01-19T04:18:46.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e40c55e0 0x7fe8e4151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe8e40c18b0 0x7fe8e40a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e9e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e40c1d10 con 0x7fe8e4147f90 2024-01-19T04:18:46.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e9e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e406c5c0 con 0x7fe8e40c18b0 2024-01-19T04:18:46.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e9e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e40c0810 con 0x7fe8e40c55e0 2024-01-19T04:18:46.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe8e40c18b0 0x7fe8e40a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e2a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe8e4147f90 0x7fe8e406beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47058/0 (socket says 172.21.15.32:47058) 2024-01-19T04:18:46.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e2a00640 1 -- 172.21.15.32:0/1148154259 learned_addr learned my addr 172.21.15.32:0/1148154259 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:46.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e2000640 1 --2- 172.21.15.32:0/1148154259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e40c55e0 0x7fe8e4151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e3400640 1 -- 172.21.15.32:0/1148154259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e40c55e0 msgr2=0x7fe8e4151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:46.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e3400640 1 --2- 172.21.15.32:0/1148154259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e40c55e0 0x7fe8e4151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e3400640 1 -- 172.21.15.32:0/1148154259 >> v1:172.21.15.32:6789/0 conn(0x7fe8e4147f90 legacy=0x7fe8e406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e1600640 1 -- 172.21.15.32:0/1148154259 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847324417 0 0) 0x7fe8e40c1d10 con 0x7fe8e4147f90 2024-01-19T04:18:46.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e3400640 1 -- 172.21.15.32:0/1148154259 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e40c0af0 con 0x7fe8e40c18b0 2024-01-19T04:18:46.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.727+0000 7fe8e2000640 1 --2- 172.21.15.32:0/1148154259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e40c55e0 0x7fe8e4151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:46.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e3400640 1 --2- 172.21.15.32:0/1148154259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c18b0 0x7fe8e40a4d10 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009d90 tx=0x7fe8dc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf207c881f54d9b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e1600640 1 -- 172.21.15.32:0/1148154259 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0a5950 con 0x7fe8e40c18b0 2024-01-19T04:18:46.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e1600640 1 -- 172.21.15.32:0/1148154259 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc0a5ab0 con 0x7fe8e40c18b0 2024-01-19T04:18:46.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e1600640 1 -- 172.21.15.32:0/1148154259 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0a5e40 con 0x7fe8e40c18b0 2024-01-19T04:18:46.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 -- 172.21.15.32:0/1148154259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c18b0 msgr2=0x7fe8e40a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/1148154259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c18b0 0x7fe8e40a4d10 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009d90 tx=0x7fe8dc01c890 comp rx=0 tx=0).stop 2024-01-19T04:18:46.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 -- 172.21.15.32:0/1148154259 shutdown_connections 2024-01-19T04:18:46.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/1148154259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c18b0 0x7fe8e40a4d10 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/1148154259 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e40c55e0 0x7fe8e4151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 -- 172.21.15.32:0/1148154259 >> 172.21.15.32:0/1148154259 conn(0x7fe8e40c5b20 msgr2=0x7fe8e40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 -- 172.21.15.32:0/1148154259 shutdown_connections 2024-01-19T04:18:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 -- 172.21.15.32:0/1148154259 wait complete. 2024-01-19T04:18:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 Processor -- start 2024-01-19T04:18:46.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 -- start start 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8e40c18b0 0x7fe8e40aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c55e0 0x7fe8e4152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.731+0000 7fe8e9e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e4147f90 0x7fe8e4153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e9e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4153540 con 0x7fe8e40c55e0 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e9e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e415c280 con 0x7fe8e40c18b0 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e9e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e40a93f0 con 0x7fe8e4147f90 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c55e0 0x7fe8e4152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c55e0 0x7fe8e4152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52614/0 (socket says 172.21.15.32:52614) 2024-01-19T04:18:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 -- 172.21.15.32:0/4248636287 learned_addr learned my addr 172.21.15.32:0/4248636287 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e3400640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e4147f90 0x7fe8e4153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2a00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8e40c18b0 0x7fe8e40aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 -- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e4147f90 msgr2=0x7fe8e4153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e4147f90 0x7fe8e4153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 -- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8e40c18b0 msgr2=0x7fe8e40aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8e40c18b0 0x7fe8e40aabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 -- 172.21.15.32:0/4248636287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc009a70 con 0x7fe8e40c55e0 2024-01-19T04:18:46.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e2000640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c55e0 0x7fe8e4152ac0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c7f0 tx=0x7fe8cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8db400640 1 -- 172.21.15.32:0/4248636287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00cea0 con 0x7fe8e40c55e0 2024-01-19T04:18:46.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8db400640 1 -- 172.21.15.32:0/4248636287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc007a30 con 0x7fe8e40c55e0 2024-01-19T04:18:46.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e40a96d0 con 0x7fe8e40c55e0 2024-01-19T04:18:46.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8db400640 1 -- 172.21.15.32:0/4248636287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc007dc0 con 0x7fe8e40c55e0 2024-01-19T04:18:46.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e40a9c90 con 0x7fe8e40c55e0 2024-01-19T04:18:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e40749f0 con 0x7fe8e40c55e0 2024-01-19T04:18:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.735+0000 7fe8db400640 1 -- 172.21.15.32:0/4248636287 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe8cc0113f0 con 0x7fe8e40c55e0 2024-01-19T04:18:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.739+0000 7fe8db400640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe8bc066530 0x7fe8bc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.739+0000 7fe8db400640 1 -- 172.21.15.32:0/4248636287 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe8cc083ca0 con 0x7fe8e40c55e0 2024-01-19T04:18:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.739+0000 7fe8e2a00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe8bc066530 0x7fe8bc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:46.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.739+0000 7fe8e2a00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe8bc066530 0x7fe8bc0689f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4000f70 tx=0x7fe8d4007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:46.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.743+0000 7fe8db400640 1 -- 172.21.15.32:0/4248636287 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe8cc051280 con 0x7fe8e40c55e0 2024-01-19T04:18:46.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8e40bf9e0 con 0x7fe8bc066530 2024-01-19T04:18:46.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8db400640 1 -- 172.21.15.32:0/4248636287 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe8e40bf9e0 con 0x7fe8bc066530 2024-01-19T04:18:46.907 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2024-01-19T04:18:46.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe8bc066530 msgr2=0x7fe8bc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe8bc066530 0x7fe8bc0689f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4000f70 tx=0x7fe8d4007df0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c55e0 msgr2=0x7fe8e4152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c55e0 0x7fe8e4152ac0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c7f0 tx=0x7fe8cc00ccb0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 shutdown_connections 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe8bc066530 0x7fe8bc0689f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe8e4147f90 0x7fe8e4153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40c55e0 0x7fe8e4152ac0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 --2- 172.21.15.32:0/4248636287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8e40c18b0 0x7fe8e40aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 >> 172.21.15.32:0/4248636287 conn(0x7fe8e40c5b20 msgr2=0x7fe8e41511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 shutdown_connections 2024-01-19T04:18:46.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:46.903+0000 7fe8e9e00640 1 -- 172.21.15.32:0/4248636287 wait complete. 2024-01-19T04:18:46.930 INFO:tasks.ceph:Scrubbing osd.4 2024-01-19T04:18:46.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:47.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc399000640 1 Processor -- start 2024-01-19T04:18:47.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc399000640 1 -- start start 2024-01-19T04:18:47.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc399000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc394151dd0 0x7fc3940c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc399000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3940a75c0 0x7fc394154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc399000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39406ebf0 con 0x7fc3940c6170 2024-01-19T04:18:47.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc399000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940708f0 con 0x7fc3940a75c0 2024-01-19T04:18:47.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc399000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39406f600 con 0x7fc394151dd0 2024-01-19T04:18:47.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc394151dd0 0x7fc3940c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3940a75c0 0x7fc394154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc394151dd0 0x7fc3940c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3301/0 says I am v2:172.21.15.32:45770/0 (socket says 172.21.15.32:45770) 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3940a75c0 0x7fc394154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:55426/0 (socket says 172.21.15.32:55426) 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391e00640 1 -- 172.21.15.32:0/2438185104 learned_addr learned my addr 172.21.15.32:0/2438185104 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391e00640 1 -- 172.21.15.32:0/2438185104 >> v2:172.21.15.67:3300/0 conn(0x7fc3940a75c0 msgr2=0x7fc394154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391e00640 1 --2- 172.21.15.32:0/2438185104 >> v2:172.21.15.67:3300/0 conn(0x7fc3940a75c0 0x7fc394154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.071+0000 7fc391e00640 1 -- 172.21.15.32:0/2438185104 >> v1:172.21.15.67:6789/0 conn(0x7fc3940c6170 legacy=0x7fc394154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc391e00640 1 -- 172.21.15.32:0/2438185104 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940c74f0 con 0x7fc394151dd0 2024-01-19T04:18:47.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc391400640 1 --2- 172.21.15.32:0/2438185104 >> v2:172.21.15.67:3300/0 conn(0x7fc3940a75c0 0x7fc394154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:47.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc391e00640 1 --2- 172.21.15.32:0/2438185104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc394151dd0 0x7fc3940c5c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23775052ce981706 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc390a00640 1 -- 172.21.15.32:0/2438185104 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840a7070 con 0x7fc394151dd0 2024-01-19T04:18:47.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc390a00640 1 -- 172.21.15.32:0/2438185104 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3840ab430 con 0x7fc394151dd0 2024-01-19T04:18:47.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc390a00640 1 -- 172.21.15.32:0/2438185104 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840ab7c0 con 0x7fc394151dd0 2024-01-19T04:18:47.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc399000640 1 -- 172.21.15.32:0/2438185104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc394151dd0 msgr2=0x7fc3940c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.075+0000 7fc399000640 1 --2- 172.21.15.32:0/2438185104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc394151dd0 0x7fc3940c5c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38401c540 comp rx=0 tx=0).stop 2024-01-19T04:18:47.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- 172.21.15.32:0/2438185104 shutdown_connections 2024-01-19T04:18:47.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 --2- 172.21.15.32:0/2438185104 >> v2:172.21.15.67:3300/0 conn(0x7fc3940a75c0 0x7fc394154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 --2- 172.21.15.32:0/2438185104 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc394151dd0 0x7fc3940c5c30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- 172.21.15.32:0/2438185104 >> 172.21.15.32:0/2438185104 conn(0x7fc3940c7d30 msgr2=0x7fc3940c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- 172.21.15.32:0/2438185104 shutdown_connections 2024-01-19T04:18:47.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- 172.21.15.32:0/2438185104 wait complete. 2024-01-19T04:18:47.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 Processor -- start 2024-01-19T04:18:47.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- start start 2024-01-19T04:18:47.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3940a75c0 0x7fc394147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3940c6170 0x7fc3941f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc394151dd0 0x7fc3941f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39414bdf0 con 0x7fc3940a75c0 2024-01-19T04:18:47.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39414b550 con 0x7fc394151dd0 2024-01-19T04:18:47.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc399000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39414b830 con 0x7fc3940c6170 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3940a75c0 0x7fc394147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3940a75c0 0x7fc394147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52624/0 (socket says 172.21.15.32:52624) 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 -- 172.21.15.32:0/3067061582 learned_addr learned my addr 172.21.15.32:0/3067061582 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc392800640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc394151dd0 0x7fc3941f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391400640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3940c6170 0x7fc3941f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 -- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3940c6170 msgr2=0x7fc3941f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3940c6170 0x7fc3941f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 -- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc394151dd0 msgr2=0x7fc3941f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc394151dd0 0x7fc3941f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391e00640 1 -- 172.21.15.32:0/3067061582 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c009420 con 0x7fc3940a75c0 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc391400640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fc3940c6170 0x7fc3941f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.079+0000 7fc392800640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc394151dd0 0x7fc3941f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc391e00640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3940a75c0 0x7fc394147630 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ad040 tx=0x7fc3840192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840b4620 con 0x7fc3940a75c0 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3840b4780 con 0x7fc3940a75c0 2024-01-19T04:18:47.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840b4b10 con 0x7fc3940a75c0 2024-01-19T04:18:47.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3840094d0 con 0x7fc3940a75c0 2024-01-19T04:18:47.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3941eff90 con 0x7fc3940a75c0 2024-01-19T04:18:47.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc39406f290 con 0x7fc3940a75c0 2024-01-19T04:18:47.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc3840b4c70 con 0x7fc3940a75c0 2024-01-19T04:18:47.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc36c066500 0x7fc36c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc38411dfd0 con 0x7fc3940a75c0 2024-01-19T04:18:47.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7fc36c06c400 0x7fc36c06e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 --> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc36c06eed0 con 0x7fc36c06c400 2024-01-19T04:18:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3841205b0 con 0x7fc3940a75c0 2024-01-19T04:18:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc391400640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc36c066500 0x7fc36c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.083+0000 7fc392800640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7fc36c06c400 0x7fc36c06e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.087+0000 7fc391400640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc36c066500 0x7fc36c0689c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc3940a7520 tx=0x7fc37c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.087+0000 7fc392800640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7fc36c06c400 0x7fc36c06e820 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.087+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== osd.4 v2:172.21.15.67:6800/73147838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc36c06eed0 con 0x7fc36c06c400 2024-01-19T04:18:47.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.099+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 --> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc394070610 con 0x7fc36c06c400 2024-01-19T04:18:47.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.099+0000 7fc38a000640 1 -- 172.21.15.32:0/3067061582 <== osd.4 v2:172.21.15.67:6800/73147838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc38c001ef0 con 0x7fc36c06c400 2024-01-19T04:18:47.105 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:47.105 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:47.105 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:47.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.099+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7fc36c06c400 msgr2=0x7fc36c06e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.099+0000 7fc399000640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6800/73147838,v1:172.21.15.67:6801/73147838] conn(0x7fc36c06c400 0x7fc36c06e820 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc36c066500 msgr2=0x7fc36c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fc36c066500 0x7fc36c0689c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc3940a7520 tx=0x7fc37c008040 comp rx=0 tx=0).stop 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3940a75c0 msgr2=0x7fc394147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 --2- 172.21.15.32:0/3067061582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3940a75c0 0x7fc394147630 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ad040 tx=0x7fc3840192e0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc392800640 1 -- 172.21.15.32:0/3067061582 reap_dead start 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 shutdown_connections 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 >> 172.21.15.32:0/3067061582 conn(0x7fc3940c7d30 msgr2=0x7fc3940a8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 shutdown_connections 2024-01-19T04:18:47.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.103+0000 7fc399000640 1 -- 172.21.15.32:0/3067061582 wait complete. 2024-01-19T04:18:47.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-19T04:18:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb560600640 1 Processor -- start 2024-01-19T04:18:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb560600640 1 -- start start 2024-01-19T04:18:47.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb560600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb560600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5580a7200 0x7fb5580c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb560600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5581547e0 con 0x7fb5580c41f0 2024-01-19T04:18:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb560600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5581521c0 con 0x7fb5580a7200 2024-01-19T04:18:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb560600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580c1db0 con 0x7fb558151de0 2024-01-19T04:18:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb55dc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb55d200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5580a7200 0x7fb5580c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb55d200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5580a7200 0x7fb5580c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.32:55442/0 (socket says 172.21.15.32:55442) 2024-01-19T04:18:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.263+0000 7fb55d200640 1 -- 172.21.15.32:0/2038561042 learned_addr learned my addr 172.21.15.32:0/2038561042 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb55d200640 1 -- 172.21.15.32:0/2038561042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 msgr2=0x7fb5580c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb55d200640 1 --2- 172.21.15.32:0/2038561042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb55d200640 1 -- 172.21.15.32:0/2038561042 >> v1:172.21.15.67:6789/0 conn(0x7fb5580c41f0 legacy=0x7fb558154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb55d200640 1 -- 172.21.15.32:0/2038561042 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55806f820 con 0x7fb5580a7200 2024-01-19T04:18:47.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb55d200640 1 --2- 172.21.15.32:0/2038561042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580a7200 0x7fb5580c3cb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb540009870 tx=0x7fb54001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9de1d978359602 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb557e00640 1 -- 172.21.15.32:0/2038561042 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5400ab680 con 0x7fb5580a7200 2024-01-19T04:18:47.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb557e00640 1 -- 172.21.15.32:0/2038561042 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5400ab7e0 con 0x7fb5580a7200 2024-01-19T04:18:47.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.267+0000 7fb557e00640 1 -- 172.21.15.32:0/2038561042 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5400abb70 con 0x7fb5580a7200 2024-01-19T04:18:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- 172.21.15.32:0/2038561042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580a7200 msgr2=0x7fb5580c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 --2- 172.21.15.32:0/2038561042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580a7200 0x7fb5580c3cb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb540009870 tx=0x7fb54001c480 comp rx=0 tx=0).stop 2024-01-19T04:18:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- 172.21.15.32:0/2038561042 shutdown_connections 2024-01-19T04:18:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 --2- 172.21.15.32:0/2038561042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580a7200 0x7fb5580c3cb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 --2- 172.21.15.32:0/2038561042 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- 172.21.15.32:0/2038561042 >> 172.21.15.32:0/2038561042 conn(0x7fb5580726d0 msgr2=0x7fb5580663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- 172.21.15.32:0/2038561042 shutdown_connections 2024-01-19T04:18:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- 172.21.15.32:0/2038561042 wait complete. 2024-01-19T04:18:47.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 Processor -- start 2024-01-19T04:18:47.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- start start 2024-01-19T04:18:47.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5580a7200 0x7fb5580ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580c41f0 0x7fb5580aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5581f14c0 con 0x7fb5580a7200 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55806cc30 con 0x7fb5580c41f0 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb560600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55806ced0 con 0x7fb558151de0 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb55dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5580a7200 0x7fb5580ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb55dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5580a7200 0x7fb5580ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52630/0 (socket says 172.21.15.32:52630) 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb55dc00640 1 -- 172.21.15.32:0/1380819364 learned_addr learned my addr 172.21.15.32:0/1380819364 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:47.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb55d200640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580c41f0 0x7fb5580aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb55e600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb55dc00640 1 -- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 msgr2=0x7fb5580c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.271+0000 7fb55dc00640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb55dc00640 1 -- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580c41f0 msgr2=0x7fb5580aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb55dc00640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580c41f0 0x7fb5580aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb55dc00640 1 -- 172.21.15.32:0/1380819364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400094d0 con 0x7fb5580a7200 2024-01-19T04:18:47.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb55dc00640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5580a7200 0x7fb5580ac890 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb54800e930 tx=0x7fb54800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb555600640 1 -- 172.21.15.32:0/1380819364 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548009690 con 0x7fb5580a7200 2024-01-19T04:18:47.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb555600640 1 -- 172.21.15.32:0/1380819364 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54800ca00 con 0x7fb5580a7200 2024-01-19T04:18:47.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5581f11e0 con 0x7fb5580a7200 2024-01-19T04:18:47.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb555600640 1 -- 172.21.15.32:0/1380819364 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800cd70 con 0x7fb5580a7200 2024-01-19T04:18:47.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5580c7700 con 0x7fb5580a7200 2024-01-19T04:18:47.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5580749f0 con 0x7fb5580a7200 2024-01-19T04:18:47.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb555600640 1 -- 172.21.15.32:0/1380819364 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb548013470 con 0x7fb5580a7200 2024-01-19T04:18:47.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb555600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb530066500 0x7fb5300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb555600640 1 -- 172.21.15.32:0/1380819364 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb548083d90 con 0x7fb5580a7200 2024-01-19T04:18:47.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.275+0000 7fb55d200640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb530066500 0x7fb5300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.279+0000 7fb55d200640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb530066500 0x7fb5300689c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb5400af000 tx=0x7fb5400b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.279+0000 7fb555600640 1 -- 172.21.15.32:0/1380819364 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb5480514d0 con 0x7fb5580a7200 2024-01-19T04:18:47.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.439+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb558067820 con 0x7fb530066500 2024-01-19T04:18:47.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb555600640 1 -- 172.21.15.32:0/1380819364 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb558067820 con 0x7fb530066500 2024-01-19T04:18:47.446 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2024-01-19T04:18:47.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb530066500 msgr2=0x7fb5300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb530066500 0x7fb5300689c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb5400af000 tx=0x7fb5400b6040 comp rx=0 tx=0).stop 2024-01-19T04:18:47.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5580a7200 msgr2=0x7fb5580ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5580a7200 0x7fb5580ac890 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb54800e930 tx=0x7fb54800edf0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 shutdown_connections 2024-01-19T04:18:47.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fb530066500 0x7fb5300689c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fb558151de0 0x7fb5580c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5580c41f0 0x7fb5580aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 --2- 172.21.15.32:0/1380819364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5580a7200 0x7fb5580ac890 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 >> 172.21.15.32:0/1380819364 conn(0x7fb5580726d0 msgr2=0x7fb558154c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 shutdown_connections 2024-01-19T04:18:47.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.443+0000 7fb560600640 1 -- 172.21.15.32:0/1380819364 wait complete. 2024-01-19T04:18:47.468 INFO:tasks.ceph:Scrubbing osd.5 2024-01-19T04:18:47.468 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:47.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.607+0000 7f10dd200640 1 Processor -- start 2024-01-19T04:18:47.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.607+0000 7f10dd200640 1 -- start start 2024-01-19T04:18:47.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10dd200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10d81549a0 0x7f10d8154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10dd200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10d806c220 0x7f10d80c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10dd200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d80c5750 0x7f10d80c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10dd200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d80c20e0 con 0x7f10d806c220 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10dd200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d8155930 con 0x7f10d81549a0 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10dd200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80a4e90 con 0x7f10d80c5750 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10d806c220 0x7f10d80c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10d806c220 0x7f10d80c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52646/0 (socket says 172.21.15.32:52646) 2024-01-19T04:18:47.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 -- 172.21.15.32:0/1494900432 learned_addr learned my addr 172.21.15.32:0/1494900432 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:47.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5e00640 1 --2- 172.21.15.32:0/1494900432 >> v2:172.21.15.67:3300/0 conn(0x7f10d81549a0 0x7f10d8154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d6800640 1 --2- 172.21.15.32:0/1494900432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d80c5750 0x7f10d80c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 -- 172.21.15.32:0/1494900432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d80c5750 msgr2=0x7f10d80c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:47.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 --2- 172.21.15.32:0/1494900432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d80c5750 0x7f10d80c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 -- 172.21.15.32:0/1494900432 >> v2:172.21.15.67:3300/0 conn(0x7f10d81549a0 msgr2=0x7f10d8154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:47.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 --2- 172.21.15.32:0/1494900432 >> v2:172.21.15.67:3300/0 conn(0x7f10d81549a0 0x7f10d8154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.611+0000 7f10d5400640 1 -- 172.21.15.32:0/1494900432 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d81555c0 con 0x7f10d806c220 2024-01-19T04:18:47.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10d5400640 1 --2- 172.21.15.32:0/1494900432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d806c220 0x7f10d80c4730 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f10d8066f10 tx=0x7f10c001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbd36bec1badf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10d4a00640 1 -- 172.21.15.32:0/1494900432 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00a7bf0 con 0x7f10d806c220 2024-01-19T04:18:47.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10d4a00640 1 -- 172.21.15.32:0/1494900432 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00a7d50 con 0x7f10d806c220 2024-01-19T04:18:47.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10d4a00640 1 -- 172.21.15.32:0/1494900432 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00af660 con 0x7f10d806c220 2024-01-19T04:18:47.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 -- 172.21.15.32:0/1494900432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d806c220 msgr2=0x7f10d80c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 --2- 172.21.15.32:0/1494900432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d806c220 0x7f10d80c4730 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f10d8066f10 tx=0x7f10c001eb40 comp rx=0 tx=0).stop 2024-01-19T04:18:47.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 -- 172.21.15.32:0/1494900432 shutdown_connections 2024-01-19T04:18:47.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 --2- 172.21.15.32:0/1494900432 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d80c5750 0x7f10d80c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 --2- 172.21.15.32:0/1494900432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d806c220 0x7f10d80c4730 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 --2- 172.21.15.32:0/1494900432 >> v2:172.21.15.67:3300/0 conn(0x7f10d81549a0 0x7f10d8154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 -- 172.21.15.32:0/1494900432 >> 172.21.15.32:0/1494900432 conn(0x7f10d80c5b40 msgr2=0x7f10d80c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 -- 172.21.15.32:0/1494900432 shutdown_connections 2024-01-19T04:18:47.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 -- 172.21.15.32:0/1494900432 wait complete. 2024-01-19T04:18:47.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 Processor -- start 2024-01-19T04:18:47.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 -- start start 2024-01-19T04:18:47.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d806c220 0x7f10d8147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d81549a0 0x7f10d8147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.615+0000 7f10dd200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80ab0c0 0x7f10d8150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10dd200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d81ee3b0 con 0x7f10d80ab0c0 2024-01-19T04:18:47.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10dd200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d81483c0 con 0x7f10d81549a0 2024-01-19T04:18:47.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10dd200640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d814fce0 con 0x7f10d806c220 2024-01-19T04:18:47.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80ab0c0 0x7f10d8150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80ab0c0 0x7f10d8150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52660/0 (socket says 172.21.15.32:52660) 2024-01-19T04:18:47.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 -- 172.21.15.32:0/4278603152 learned_addr learned my addr 172.21.15.32:0/4278603152 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:47.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d5e00640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d806c220 0x7f10d8147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d5400640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d81549a0 0x7f10d8147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 -- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d806c220 msgr2=0x7f10d8147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f10d806c220 0x7f10d8147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 -- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d81549a0 msgr2=0x7f10d8147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10d81549a0 0x7f10d8147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 -- 172.21.15.32:0/4278603152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c000b770 con 0x7f10d80ab0c0 2024-01-19T04:18:47.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10d6800640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80ab0c0 0x7f10d8150320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f10d000eed0 tx=0x7f10d000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0010040 con 0x7f10d80ab0c0 2024-01-19T04:18:47.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0014400 con 0x7f10d80ab0c0 2024-01-19T04:18:47.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d814ffc0 con 0x7f10d80ab0c0 2024-01-19T04:18:47.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00147b0 con 0x7f10d80ab0c0 2024-01-19T04:18:47.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d81486a0 con 0x7f10d80ab0c0 2024-01-19T04:18:47.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10d8072770 con 0x7f10d80ab0c0 2024-01-19T04:18:47.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.619+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f10d0014910 con 0x7f10d80ab0c0 2024-01-19T04:18:47.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10ce000640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f10b0066500 0x7f10b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f10d0084530 con 0x7f10d80ab0c0 2024-01-19T04:18:47.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10ce000640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7f10b006c400 0x7f10b006e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 --> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10b006eed0 con 0x7f10b006c400 2024-01-19T04:18:47.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d0086b10 con 0x7f10d80ab0c0 2024-01-19T04:18:47.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10d5e00640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f10b0066500 0x7f10b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10d5400640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7f10b006c400 0x7f10b006e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10d5e00640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f10b0066500 0x7f10b00689c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009ac0 tx=0x7f10c8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10d5400640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7f10b006c400 0x7f10b006e820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.623+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== osd.5 v2:172.21.15.67:6808/1136197459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f10b006eed0 con 0x7f10b006c400 2024-01-19T04:18:47.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.635+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 --> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f10d8072ca0 con 0x7f10b006c400 2024-01-19T04:18:47.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10ce000640 1 -- 172.21.15.32:0/4278603152 <== osd.5 v2:172.21.15.67:6808/1136197459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f10d8072ca0 con 0x7f10b006c400 2024-01-19T04:18:47.642 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:47.642 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:47.642 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:47.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7f10b006c400 msgr2=0x7f10b006e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6808/1136197459,v1:172.21.15.67:6810/1136197459] conn(0x7f10b006c400 0x7f10b006e820 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f10b0066500 msgr2=0x7f10b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f10b0066500 0x7f10b00689c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009ac0 tx=0x7f10c8009190 comp rx=0 tx=0).stop 2024-01-19T04:18:47.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80ab0c0 msgr2=0x7f10d8150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 --2- 172.21.15.32:0/4278603152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80ab0c0 0x7f10d8150320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f10d000eed0 tx=0x7f10d000b480 comp rx=0 tx=0).stop 2024-01-19T04:18:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10d6800640 1 -- 172.21.15.32:0/4278603152 reap_dead start 2024-01-19T04:18:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 shutdown_connections 2024-01-19T04:18:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 >> 172.21.15.32:0/4278603152 conn(0x7f10d80c5b40 msgr2=0x7f10d80c4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 shutdown_connections 2024-01-19T04:18:47.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.639+0000 7f10dd200640 1 -- 172.21.15.32:0/4278603152 wait complete. 2024-01-19T04:18:47.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-19T04:18:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d9600640 1 Processor -- start 2024-01-19T04:18:47.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d9600640 1 -- start start 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d9600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f25d40a7200 0x7f25d40c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d9600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f25d40c41f0 0x7f25d4154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d9600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d41547e0 con 0x7f25d4151de0 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d9600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d41521c0 con 0x7f25d40c41f0 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d9600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d406f820 con 0x7f25d40a7200 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d2a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f25d4151de0 0x7f25d40c1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37272/0 (socket says 172.21.15.32:37272) 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d2a00640 1 -- 172.21.15.32:0/3384786368 learned_addr learned my addr 172.21.15.32:0/3384786368 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:47.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d3400640 1 --2- 172.21.15.32:0/3384786368 >> v2:172.21.15.32:3300/0 conn(0x7f25d40c41f0 0x7f25d4154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d2000640 1 --2- 172.21.15.32:0/3384786368 >> v2:172.21.15.67:3300/0 conn(0x7f25d40a7200 0x7f25d40c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d3400640 1 -- 172.21.15.32:0/3384786368 >> v2:172.21.15.67:3300/0 conn(0x7f25d40a7200 msgr2=0x7f25d40c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d1600640 1 -- 172.21.15.32:0/3384786368 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082873610 0 0) 0x7f25d41547e0 con 0x7f25d4151de0 2024-01-19T04:18:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d3400640 1 --2- 172.21.15.32:0/3384786368 >> v2:172.21.15.67:3300/0 conn(0x7f25d40a7200 0x7f25d40c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d3400640 1 -- 172.21.15.32:0/3384786368 >> v1:172.21.15.32:6789/0 conn(0x7f25d4151de0 legacy=0x7f25d40c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.799+0000 7f25d3400640 1 -- 172.21.15.32:0/3384786368 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d406fb00 con 0x7f25d40c41f0 2024-01-19T04:18:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d3400640 1 --2- 172.21.15.32:0/3384786368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40c41f0 0x7f25d4154c70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f25d406e870 tx=0x7f25cc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b55a4c23a11856a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d1600640 1 -- 172.21.15.32:0/3384786368 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0a5820 con 0x7f25d40c41f0 2024-01-19T04:18:47.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d1600640 1 -- 172.21.15.32:0/3384786368 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc0a5980 con 0x7f25d40c41f0 2024-01-19T04:18:47.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d1600640 1 -- 172.21.15.32:0/3384786368 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0a5d10 con 0x7f25d40c41f0 2024-01-19T04:18:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 -- 172.21.15.32:0/3384786368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40c41f0 msgr2=0x7f25d4154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 --2- 172.21.15.32:0/3384786368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40c41f0 0x7f25d4154c70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f25d406e870 tx=0x7f25cc01c850 comp rx=0 tx=0).stop 2024-01-19T04:18:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 -- 172.21.15.32:0/3384786368 shutdown_connections 2024-01-19T04:18:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 --2- 172.21.15.32:0/3384786368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40c41f0 0x7f25d4154c70 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 --2- 172.21.15.32:0/3384786368 >> v2:172.21.15.67:3300/0 conn(0x7f25d40a7200 0x7f25d40c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 -- 172.21.15.32:0/3384786368 >> 172.21.15.32:0/3384786368 conn(0x7f25d40726d0 msgr2=0x7f25d40663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 -- 172.21.15.32:0/3384786368 shutdown_connections 2024-01-19T04:18:47.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.803+0000 7f25d9600640 1 -- 172.21.15.32:0/3384786368 wait complete. 2024-01-19T04:18:47.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 Processor -- start 2024-01-19T04:18:47.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 -- start start 2024-01-19T04:18:47.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40a7200 0x7f25d41f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d40c41f0 0x7f25d4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25d4151de0 0x7f25d4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4159000 con 0x7f25d40a7200 2024-01-19T04:18:47.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d415a570 con 0x7f25d40c41f0 2024-01-19T04:18:47.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4150fa0 con 0x7f25d4151de0 2024-01-19T04:18:47.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40a7200 0x7f25d41f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40a7200 0x7f25d41f0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37550/0 (socket says 172.21.15.32:37550) 2024-01-19T04:18:47.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 -- 172.21.15.32:0/1760757225 learned_addr learned my addr 172.21.15.32:0/1760757225 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:47.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2000640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d40c41f0 0x7f25d4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d3400640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25d4151de0 0x7f25d4157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 -- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25d4151de0 msgr2=0x7f25d4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25d4151de0 0x7f25d4157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 -- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d40c41f0 msgr2=0x7f25d4156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d40c41f0 0x7f25d4156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 -- 172.21.15.32:0/1760757225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc009a70 con 0x7f25d40a7200 2024-01-19T04:18:47.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d2a00640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40a7200 0x7f25d41f0cd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f25c400c440 tx=0x7f25c400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25caa00640 1 -- 172.21.15.32:0/1760757225 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40074e0 con 0x7f25d40a7200 2024-01-19T04:18:47.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25caa00640 1 -- 172.21.15.32:0/1760757225 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c4007640 con 0x7f25d40a7200 2024-01-19T04:18:47.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25caa00640 1 -- 172.21.15.32:0/1760757225 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4004a10 con 0x7f25d40a7200 2024-01-19T04:18:47.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d4159210 con 0x7f25d40a7200 2024-01-19T04:18:47.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.807+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d4150b60 con 0x7f25d40a7200 2024-01-19T04:18:47.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.811+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d40749f0 con 0x7f25d40a7200 2024-01-19T04:18:47.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.811+0000 7f25caa00640 1 -- 172.21.15.32:0/1760757225 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f25c4004b70 con 0x7f25d40a7200 2024-01-19T04:18:47.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.811+0000 7f25caa00640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f25ac066500 0x7f25ac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:47.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.811+0000 7f25caa00640 1 -- 172.21.15.32:0/1760757225 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f25c4082cc0 con 0x7f25d40a7200 2024-01-19T04:18:47.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.811+0000 7f25d2000640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f25ac066500 0x7f25ac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:47.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.811+0000 7f25d2000640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f25ac066500 0x7f25ac0689c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f25d41560b0 tx=0x7f25bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:47.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.815+0000 7f25caa00640 1 -- 172.21.15.32:0/1760757225 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f25c4050340 con 0x7f25d40a7200 2024-01-19T04:18:47.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.975+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f25d40c2740 con 0x7f25ac066500 2024-01-19T04:18:47.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.975+0000 7f25caa00640 1 -- 172.21.15.32:0/1760757225 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25bc011a60 con 0x7f25ac066500 2024-01-19T04:18:47.982 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2024-01-19T04:18:47.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f25ac066500 msgr2=0x7f25ac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f25ac066500 0x7f25ac0689c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f25d41560b0 tx=0x7f25bc009190 comp rx=0 tx=0).stop 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40a7200 msgr2=0x7f25d41f0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40a7200 0x7f25d41f0cd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f25c400c440 tx=0x7f25c400c900 comp rx=0 tx=0).stop 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 shutdown_connections 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f25ac066500 0x7f25ac0689c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f25d4151de0 0x7f25d4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d40c41f0 0x7f25d4156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 --2- 172.21.15.32:0/1760757225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25d40a7200 0x7f25d41f0cd0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:47.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 >> 172.21.15.32:0/1760757225 conn(0x7f25d40726d0 msgr2=0x7f25d4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:47.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 shutdown_connections 2024-01-19T04:18:47.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:47.979+0000 7f25d9600640 1 -- 172.21.15.32:0/1760757225 wait complete. 2024-01-19T04:18:48.003 INFO:tasks.ceph:Scrubbing osd.6 2024-01-19T04:18:48.004 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:48.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.143+0000 7f8c95e00640 1 Processor -- start 2024-01-19T04:18:48.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.143+0000 7f8c95e00640 1 -- start start 2024-01-19T04:18:48.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c95e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8c901549a0 0x7f8c90154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c95e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c900c5750 0x7f8c900c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c95e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c900c5380 con 0x7f8c9006c220 2024-01-19T04:18:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c95e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c900c20e0 con 0x7f8c901549a0 2024-01-19T04:18:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c95e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c90155930 con 0x7f8c900c5750 2024-01-19T04:18:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8e000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8c9006c220 0x7f8c900c4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37274/0 (socket says 172.21.15.32:37274) 2024-01-19T04:18:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8e000640 1 -- 172.21.15.32:0/342010804 learned_addr learned my addr 172.21.15.32:0/342010804 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:48.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8ea00640 1 --2- 172.21.15.32:0/342010804 >> v2:172.21.15.67:3300/0 conn(0x7f8c901549a0 0x7f8c90154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8f400640 1 --2- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c900c5750 0x7f8c900c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8d600640 1 -- 172.21.15.32:0/342010804 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703754005 0 0) 0x7f8c900c5380 con 0x7f8c9006c220 2024-01-19T04:18:48.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8d600640 1 -- 172.21.15.32:0/342010804 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c70003530 con 0x7f8c9006c220 2024-01-19T04:18:48.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8d600640 1 -- 172.21.15.32:0/342010804 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98462997 0 0) 0x7f8c70003530 con 0x7f8c9006c220 2024-01-19T04:18:48.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8ea00640 1 -- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c900c5750 msgr2=0x7f8c900c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:48.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8ea00640 1 --2- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c900c5750 0x7f8c900c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8ea00640 1 -- 172.21.15.32:0/342010804 >> v1:172.21.15.32:6789/0 conn(0x7f8c9006c220 legacy=0x7f8c900c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.147+0000 7f8c8ea00640 1 -- 172.21.15.32:0/342010804 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c900a4e90 con 0x7f8c901549a0 2024-01-19T04:18:48.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c8ea00640 1 --2- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c901549a0 0x7f8c90154d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8c800097c0 tx=0x7f8c8001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6fe4634636f9f83 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c8d600640 1 -- 172.21.15.32:0/342010804 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78001680 con 0x7f8c901549a0 2024-01-19T04:18:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c8d600640 1 -- 172.21.15.32:0/342010804 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c800a7050 con 0x7f8c901549a0 2024-01-19T04:18:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c8d600640 1 -- 172.21.15.32:0/342010804 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800ab620 con 0x7f8c901549a0 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 -- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c901549a0 msgr2=0x7f8c90154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 --2- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c901549a0 0x7f8c90154d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8c800097c0 tx=0x7f8c8001c310 comp rx=0 tx=0).stop 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 -- 172.21.15.32:0/342010804 shutdown_connections 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 --2- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c900c5750 0x7f8c900c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 --2- 172.21.15.32:0/342010804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c901549a0 0x7f8c90154d80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 -- 172.21.15.32:0/342010804 >> 172.21.15.32:0/342010804 conn(0x7f8c900c5b40 msgr2=0x7f8c900c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 -- 172.21.15.32:0/342010804 shutdown_connections 2024-01-19T04:18:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 -- 172.21.15.32:0/342010804 wait complete. 2024-01-19T04:18:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.151+0000 7f8c95e00640 1 Processor -- start 2024-01-19T04:18:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 -- start start 2024-01-19T04:18:48.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c9006c220 0x7f8c9015a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c901549a0 0x7f8c900a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c90150e50 0x7f8c900a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900c1070 con 0x7f8c90150e50 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900a65b0 con 0x7f8c9006c220 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9014f3c0 con 0x7f8c901549a0 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c90150e50 0x7f8c900a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c90150e50 0x7f8c900a6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37558/0 (socket says 172.21.15.32:37558) 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 -- 172.21.15.32:0/896122894 learned_addr learned my addr 172.21.15.32:0/896122894 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8ea00640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c9006c220 0x7f8c9015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8e000640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c901549a0 0x7f8c900a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 -- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c901549a0 msgr2=0x7f8c900a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c901549a0 0x7f8c900a6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 -- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c9006c220 msgr2=0x7f8c9015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c9006c220 0x7f8c9015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 -- 172.21.15.32:0/896122894 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80009420 con 0x7f8c90150e50 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8e000640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f8c901549a0 0x7f8c900a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c8f400640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c90150e50 0x7f8c900a6d60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800efc0 tx=0x7f8c8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88009ca0 con 0x7f8c90150e50 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800f040 con 0x7f8c90150e50 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9014f6a0 con 0x7f8c90150e50 2024-01-19T04:18:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c880146c0 con 0x7f8c90150e50 2024-01-19T04:18:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9014fc60 con 0x7f8c90150e50 2024-01-19T04:18:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.155+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c9014ed00 con 0x7f8c90150e50 2024-01-19T04:18:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8c88014820 con 0x7f8c90150e50 2024-01-19T04:18:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c87400640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8c68066500 0x7f8c680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8c88084b60 con 0x7f8c90150e50 2024-01-19T04:18:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c87400640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f8c6806c400 0x7f8c6806e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 --> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c6806eed0 con 0x7f8c6806c400 2024-01-19T04:18:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c880892a0 con 0x7f8c90150e50 2024-01-19T04:18:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c8ea00640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8c68066500 0x7f8c680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c8e000640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f8c6806c400 0x7f8c6806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c8ea00640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8c68066500 0x7f8c680689c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8c800ad000 tx=0x7f8c800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c8e000640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f8c6806c400 0x7f8c6806e820 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.159+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== osd.6 v2:172.21.15.67:6809/44142691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8c6806eed0 con 0x7f8c6806c400 2024-01-19T04:18:48.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 --> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c9014fe50 con 0x7f8c6806c400 2024-01-19T04:18:48.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c87400640 1 -- 172.21.15.32:0/896122894 <== osd.6 v2:172.21.15.67:6809/44142691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8c9014fe50 con 0x7f8c6806c400 2024-01-19T04:18:48.179 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:48.179 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:48.180 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:48.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f8c6806c400 msgr2=0x7f8c6806e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6809/44142691,v1:172.21.15.67:6811/44142691] conn(0x7f8c6806c400 0x7f8c6806e820 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8c68066500 msgr2=0x7f8c680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f8c68066500 0x7f8c680689c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8c800ad000 tx=0x7f8c800a6000 comp rx=0 tx=0).stop 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c90150e50 msgr2=0x7f8c900a6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 --2- 172.21.15.32:0/896122894 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c90150e50 0x7f8c900a6d60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800efc0 tx=0x7f8c8800c490 comp rx=0 tx=0).stop 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c8f400640 1 -- 172.21.15.32:0/896122894 reap_dead start 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 shutdown_connections 2024-01-19T04:18:48.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 >> 172.21.15.32:0/896122894 conn(0x7f8c900c5b40 msgr2=0x7f8c90148760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:48.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 shutdown_connections 2024-01-19T04:18:48.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.175+0000 7f8c95e00640 1 -- 172.21.15.32:0/896122894 wait complete. 2024-01-19T04:18:48.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-19T04:18:48.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4030c00640 1 Processor -- start 2024-01-19T04:18:48.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4030c00640 1 -- start start 2024-01-19T04:18:48.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4030c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f402c0c55e0 0x7f402c151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4030c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f402c0c18b0 0x7f402c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4030c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402c0c1d40 con 0x7f402c147f90 2024-01-19T04:18:48.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4030c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402c06c5c0 con 0x7f402c0c18b0 2024-01-19T04:18:48.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4030c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402c0c0810 con 0x7f402c0c55e0 2024-01-19T04:18:48.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f402a800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f402c0c18b0 0x7f402c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f402a800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f402c0c18b0 0x7f402c0a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37566/0 (socket says 172.21.15.32:37566) 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f402a800640 1 -- 172.21.15.32:0/94031029 learned_addr learned my addr 172.21.15.32:0/94031029 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4029400640 1 --2- 172.21.15.32:0/94031029 >> v2:172.21.15.67:3300/0 conn(0x7f402c0c55e0 0x7f402c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f402a800640 1 -- 172.21.15.32:0/94031029 >> v2:172.21.15.67:3300/0 conn(0x7f402c0c55e0 msgr2=0x7f402c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f402a800640 1 --2- 172.21.15.32:0/94031029 >> v2:172.21.15.67:3300/0 conn(0x7f402c0c55e0 0x7f402c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f402a800640 1 -- 172.21.15.32:0/94031029 >> v1:172.21.15.32:6789/0 conn(0x7f402c147f90 legacy=0x7f402c06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f402a800640 1 -- 172.21.15.32:0/94031029 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c0c0af0 con 0x7f402c0c18b0 2024-01-19T04:18:48.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.339+0000 7f4028a00640 1 -- 172.21.15.32:0/94031029 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084588381 0 0) 0x7f402c0c1d40 con 0x7f402c147f90 2024-01-19T04:18:48.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f402a800640 1 --2- 172.21.15.32:0/94031029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c0c18b0 0x7f402c0a4d10 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f402c073ee0 tx=0x7f402401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a5c1b7fc0ef966 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4028a00640 1 -- 172.21.15.32:0/94031029 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240a57d0 con 0x7f402c0c18b0 2024-01-19T04:18:48.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4028a00640 1 -- 172.21.15.32:0/94031029 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40240a5930 con 0x7f402c0c18b0 2024-01-19T04:18:48.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4028a00640 1 -- 172.21.15.32:0/94031029 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240a5cc0 con 0x7f402c0c18b0 2024-01-19T04:18:48.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 -- 172.21.15.32:0/94031029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c0c18b0 msgr2=0x7f402c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 --2- 172.21.15.32:0/94031029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c0c18b0 0x7f402c0a4d10 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f402c073ee0 tx=0x7f402401c910 comp rx=0 tx=0).stop 2024-01-19T04:18:48.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 -- 172.21.15.32:0/94031029 shutdown_connections 2024-01-19T04:18:48.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 --2- 172.21.15.32:0/94031029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c0c18b0 0x7f402c0a4d10 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 --2- 172.21.15.32:0/94031029 >> v2:172.21.15.67:3300/0 conn(0x7f402c0c55e0 0x7f402c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 -- 172.21.15.32:0/94031029 >> 172.21.15.32:0/94031029 conn(0x7f402c0c5b20 msgr2=0x7f402c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 -- 172.21.15.32:0/94031029 shutdown_connections 2024-01-19T04:18:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.343+0000 7f4030c00640 1 -- 172.21.15.32:0/94031029 wait complete. 2024-01-19T04:18:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 Processor -- start 2024-01-19T04:18:48.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 -- start start 2024-01-19T04:18:48.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f402c0c18b0 0x7f402c146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f402c0c55e0 0x7f402c0aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c147f90 0x7f402c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0a8940 con 0x7f402c147f90 2024-01-19T04:18:48.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0a8f00 con 0x7f402c0c55e0 2024-01-19T04:18:48.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c147450 con 0x7f402c0c18b0 2024-01-19T04:18:48.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c147f90 0x7f402c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c147f90 0x7f402c14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37582/0 (socket says 172.21.15.32:37582) 2024-01-19T04:18:48.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 -- 172.21.15.32:0/923941065 learned_addr learned my addr 172.21.15.32:0/923941065 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:48.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4029e00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f402c0c18b0 0x7f402c146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4029400640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f402c0c55e0 0x7f402c0aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 -- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f402c0c18b0 msgr2=0x7f402c146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f402c0c18b0 0x7f402c146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 -- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f402c0c55e0 msgr2=0x7f402c0aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f402c0c55e0 0x7f402c0aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 -- 172.21.15.32:0/923941065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024009b30 con 0x7f402c147f90 2024-01-19T04:18:48.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f402a800640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c147f90 0x7f402c14d9f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f402401afc0 tx=0x7f40240196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4022000640 1 -- 172.21.15.32:0/923941065 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240b8470 con 0x7f402c147f90 2024-01-19T04:18:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4022000640 1 -- 172.21.15.32:0/923941065 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40240b85d0 con 0x7f402c147f90 2024-01-19T04:18:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4022000640 1 -- 172.21.15.32:0/923941065 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240b8940 con 0x7f402c147f90 2024-01-19T04:18:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c1ed8c0 con 0x7f402c147f90 2024-01-19T04:18:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c0a8b90 con 0x7f402c147f90 2024-01-19T04:18:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.347+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c0a9070 con 0x7f402c147f90 2024-01-19T04:18:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.351+0000 7f4022000640 1 -- 172.21.15.32:0/923941065 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f40240b8aa0 con 0x7f402c147f90 2024-01-19T04:18:48.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.351+0000 7f4022000640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4004066500 0x7f40040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.351+0000 7f4022000640 1 -- 172.21.15.32:0/923941065 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f402411efe0 con 0x7f402c147f90 2024-01-19T04:18:48.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.351+0000 7f4029e00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4004066500 0x7f40040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.351+0000 7f4029e00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4004066500 0x7f40040689c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f401c007fd0 tx=0x7f401c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.355+0000 7f4022000640 1 -- 172.21.15.32:0/923941065 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f40240ec650 con 0x7f402c147f90 2024-01-19T04:18:48.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.515+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f402c0c04a0 con 0x7f4004066500 2024-01-19T04:18:48.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.515+0000 7f4022000640 1 -- 172.21.15.32:0/923941065 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f401c001470 con 0x7f4004066500 2024-01-19T04:18:48.520 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2024-01-19T04:18:48.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.515+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4004066500 msgr2=0x7f40040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.515+0000 7f4030c00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4004066500 0x7f40040689c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f401c007fd0 tx=0x7f401c009040 comp rx=0 tx=0).stop 2024-01-19T04:18:48.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.515+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c147f90 msgr2=0x7f402c14d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.515+0000 7f4030c00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c147f90 0x7f402c14d9f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f402401afc0 tx=0x7f40240196b0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 shutdown_connections 2024-01-19T04:18:48.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f4004066500 0x7f40040689c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f402c147f90 0x7f402c14d9f0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f402c0c55e0 0x7f402c0aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 --2- 172.21.15.32:0/923941065 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f402c0c18b0 0x7f402c146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 >> 172.21.15.32:0/923941065 conn(0x7f402c0c5b20 msgr2=0x7f402c1511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:48.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 shutdown_connections 2024-01-19T04:18:48.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.519+0000 7f4030c00640 1 -- 172.21.15.32:0/923941065 wait complete. 2024-01-19T04:18:48.542 INFO:tasks.ceph:Scrubbing osd.7 2024-01-19T04:18:48.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-19T04:18:48.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f658cc00640 1 Processor -- start 2024-01-19T04:18:48.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f658cc00640 1 -- start start 2024-01-19T04:18:48.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f658cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f658814f9a0 0x7f65880720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f658cc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f658806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f658cc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6588153140 con 0x7f65880c20d0 2024-01-19T04:18:48.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f658cc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6588152530 con 0x7f658814f9a0 2024-01-19T04:18:48.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f658cc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6588152810 con 0x7f6588072620 2024-01-19T04:18:48.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f6585400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f65880c20d0 0x7f658806c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37294/0 (socket says 172.21.15.32:37294) 2024-01-19T04:18:48.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f6585400640 1 -- 172.21.15.32:0/2945973519 learned_addr learned my addr 172.21.15.32:0/2945973519 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:48.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f6585e00640 1 --2- 172.21.15.32:0/2945973519 >> v2:172.21.15.67:3300/0 conn(0x7f658814f9a0 0x7f65880720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.683+0000 7f6586800640 1 --2- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f658806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6584a00640 1 -- 172.21.15.32:0/2945973519 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264927911 0 0) 0x7f6588153140 con 0x7f65880c20d0 2024-01-19T04:18:48.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6584a00640 1 -- 172.21.15.32:0/2945973519 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6568003530 con 0x7f65880c20d0 2024-01-19T04:18:48.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6585e00640 1 -- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 msgr2=0x7f658806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:48.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6585e00640 1 --2- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f658806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6585e00640 1 -- 172.21.15.32:0/2945973519 >> v1:172.21.15.32:6789/0 conn(0x7f65880c20d0 legacy=0x7f658806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6585e00640 1 -- 172.21.15.32:0/2945973519 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588152af0 con 0x7f658814f9a0 2024-01-19T04:18:48.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6586800640 1 --2- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f658806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:48.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6585e00640 1 --2- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658814f9a0 0x7f65880720e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f65780097c0 tx=0x7f657801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=788bc4515dde37f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6584a00640 1 -- 172.21.15.32:0/2945973519 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780ab600 con 0x7f658814f9a0 2024-01-19T04:18:48.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6584a00640 1 -- 172.21.15.32:0/2945973519 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65780a7050 con 0x7f658814f9a0 2024-01-19T04:18:48.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.687+0000 7f6584a00640 1 -- 172.21.15.32:0/2945973519 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780ab980 con 0x7f658814f9a0 2024-01-19T04:18:48.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658814f9a0 msgr2=0x7f65880720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 --2- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658814f9a0 0x7f65880720e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f65780097c0 tx=0x7f657801c3f0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- 172.21.15.32:0/2945973519 shutdown_connections 2024-01-19T04:18:48.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 --2- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f658806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 --2- 172.21.15.32:0/2945973519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f658814f9a0 0x7f65880720e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- 172.21.15.32:0/2945973519 >> 172.21.15.32:0/2945973519 conn(0x7f65880c5b40 msgr2=0x7f65880c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:48.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- 172.21.15.32:0/2945973519 shutdown_connections 2024-01-19T04:18:48.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- 172.21.15.32:0/2945973519 wait complete. 2024-01-19T04:18:48.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 Processor -- start 2024-01-19T04:18:48.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- start start 2024-01-19T04:18:48.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f65881f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65880c20d0 0x7f658815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658814f9a0 0x7f65881ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65880705c0 con 0x7f658814f9a0 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65881f0b70 con 0x7f65880c20d0 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f658cc00640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65881f1540 con 0x7f6588072620 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f6586800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658814f9a0 0x7f65881ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f6586800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658814f9a0 0x7f65881ed0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37596/0 (socket says 172.21.15.32:37596) 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f6586800640 1 -- 172.21.15.32:0/3630046880 learned_addr learned my addr 172.21.15.32:0/3630046880 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f6585400640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65880c20d0 0x7f658815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.691+0000 7f6585e00640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f65881f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f6586800640 1 -- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 msgr2=0x7f65881f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f6586800640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f6588072620 0x7f65881f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f6586800640 1 -- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65880c20d0 msgr2=0x7f658815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f6586800640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65880c20d0 0x7f658815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f6586800640 1 -- 172.21.15.32:0/3630046880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009a70 con 0x7f658814f9a0 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f6586800640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658814f9a0 0x7f65881ed0f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f658000efc0 tx=0x7f6580009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580009d70 con 0x7f658814f9a0 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000f040 con 0x7f658814f9a0 2024-01-19T04:18:48.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800039a0 con 0x7f658814f9a0 2024-01-19T04:18:48.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6578009420 con 0x7f658814f9a0 2024-01-19T04:18:48.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65880702e0 con 0x7f658814f9a0 2024-01-19T04:18:48.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f658815f5c0 con 0x7f658814f9a0 2024-01-19T04:18:48.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f65800144a0 con 0x7f658814f9a0 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6560066530 0x7f65600689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6580084710 con 0x7f658814f9a0 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f656006c430 0x7f656006e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 --> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f656006ef00 con 0x7f656006c430 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.695+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6580086cf0 con 0x7f658814f9a0 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.699+0000 7f6585e00640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6560066530 0x7f65600689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.699+0000 7f6585400640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f656006c430 0x7f656006e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.699+0000 7f6585e00640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6560066530 0x7f65600689f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f65780ad000 tx=0x7f65780a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.699+0000 7f6585400640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f656006c430 0x7f656006e850 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.699+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== osd.7 v2:172.21.15.67:6824/472535671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f656006ef00 con 0x7f656006c430 2024-01-19T04:18:48.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.711+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 --> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f65881f0ce0 con 0x7f656006c430 2024-01-19T04:18:48.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.711+0000 7f657e000640 1 -- 172.21.15.32:0/3630046880 <== osd.7 v2:172.21.15.67:6824/472535671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f65881f0ce0 con 0x7f656006c430 2024-01-19T04:18:48.718 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-01-19T04:18:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T04:18:48.718 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-01-19T04:18:48.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f656006c430 msgr2=0x7f656006e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6824/472535671,v1:172.21.15.67:6825/472535671] conn(0x7f656006c430 0x7f656006e850 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6560066530 msgr2=0x7f65600689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f6560066530 0x7f65600689f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f65780ad000 tx=0x7f65780a4f90 comp rx=0 tx=0).stop 2024-01-19T04:18:48.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658814f9a0 msgr2=0x7f65881ed0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 --2- 172.21.15.32:0/3630046880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f658814f9a0 0x7f65881ed0f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f658000efc0 tx=0x7f6580009f90 comp rx=0 tx=0).stop 2024-01-19T04:18:48.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f6586800640 1 -- 172.21.15.32:0/3630046880 reap_dead start 2024-01-19T04:18:48.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 shutdown_connections 2024-01-19T04:18:48.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 >> 172.21.15.32:0/3630046880 conn(0x7f65880c5b40 msgr2=0x7f65880c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:48.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 shutdown_connections 2024-01-19T04:18:48.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.715+0000 7f658cc00640 1 -- 172.21.15.32:0/3630046880 wait complete. 2024-01-19T04:18:48.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-19T04:18:48.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5384000640 1 Processor -- start 2024-01-19T04:18:48.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5384000640 1 -- start start 2024-01-19T04:18:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5384000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 0x7f537c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5384000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c071e80 con 0x7f537c14fb50 2024-01-19T04:18:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5384000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c0726c0 con 0x7f537c0a4ec0 2024-01-19T04:18:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5384000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c1535c0 con 0x7f537c0c04a0 2024-01-19T04:18:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5381600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f537c14fb50 0x7f537c06fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37308/0 (socket says 172.21.15.32:37308) 2024-01-19T04:18:48.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5381600640 1 -- 172.21.15.32:0/3422512717 learned_addr learned my addr 172.21.15.32:0/3422512717 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5380c00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 0x7f537c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808293190 0 0) 0x7f537c071e80 con 0x7f537c14fb50 2024-01-19T04:18:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f535c003530 con 0x7f537c14fb50 2024-01-19T04:18:48.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2657236191 0 0) 0x7f535c003530 con 0x7f537c14fb50 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 msgr2=0x7f537c0c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 0x7f537c0c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 >> v1:172.21.15.67:6789/0 conn(0x7f537c0a4ec0 legacy=0x7f537c15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0c0a20 con 0x7f537c14fb50 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1703467325 0 0) 0x7f536c001680 con 0x7f537c14fb50 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 >> v1:172.21.15.32:6789/0 conn(0x7f537c14fb50 legacy=0x7f537c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c0039b0 0x7f535c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f535c004360 0x7f535c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 0x7f535c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c1535c0 con 0x7f535c004360 2024-01-19T04:18:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c00ba40 con 0x7f535c0039b0 2024-01-19T04:18:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c00bc00 con 0x7f537c0c04a0 2024-01-19T04:18:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5380c00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f535c004360 0x7f535c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5382000640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 0x7f535c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.875+0000 7f5381600640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c0039b0 0x7f535c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5380c00640 1 -- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 msgr2=0x7f535c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:48.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5380c00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 0x7f535c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5380c00640 1 -- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c0039b0 msgr2=0x7f535c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:48.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5380c00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c0039b0 0x7f535c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5380c00640 1 -- 172.21.15.32:0/3422512717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c003530 con 0x7f535c004360 2024-01-19T04:18:48.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5381600640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c0039b0 0x7f535c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:48.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5382000640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c0c04a0 0x7f535c005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T04:18:48.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f5380c00640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f535c004360 0x7f535c004830 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5364009ae0 tx=0x7f536401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c5f48cf560469a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640a5640 con 0x7f535c004360 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640a57a0 con 0x7f535c004360 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.879+0000 7f537be00640 1 -- 172.21.15.32:0/3422512717 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640a5b50 con 0x7f535c004360 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- 172.21.15.32:0/3422512717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f535c004360 msgr2=0x7f535c004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 --2- 172.21.15.32:0/3422512717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f535c004360 0x7f535c004830 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5364009ae0 tx=0x7f536401ca50 comp rx=0 tx=0).stop 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5382000640 1 -- 172.21.15.32:0/3422512717 reap_dead start 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- 172.21.15.32:0/3422512717 shutdown_connections 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- 172.21.15.32:0/3422512717 >> 172.21.15.32:0/3422512717 conn(0x7f537c0c5b20 msgr2=0x7f537c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:48.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- 172.21.15.32:0/3422512717 shutdown_connections 2024-01-19T04:18:48.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- 172.21.15.32:0/3422512717 wait complete. 2024-01-19T04:18:48.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 Processor -- start 2024-01-19T04:18:48.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- start start 2024-01-19T04:18:48.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c004360 0x7f537c1eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c06beb0 0x7f537c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f537c0ab050 0x7f537c0c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c06d800 con 0x7f537c0ab050 2024-01-19T04:18:48.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c1ed7b0 con 0x7f535c004360 2024-01-19T04:18:48.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5384000640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c1478a0 con 0x7f537c06beb0 2024-01-19T04:18:48.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5382000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f537c0ab050 0x7f537c0c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5382000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f537c0ab050 0x7f537c0c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37606/0 (socket says 172.21.15.32:37606) 2024-01-19T04:18:48.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5382000640 1 -- 172.21.15.32:0/2005159236 learned_addr learned my addr 172.21.15.32:0/2005159236 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:48.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5381600640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c004360 0x7f537c1eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.883+0000 7f5380c00640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c06beb0 0x7f537c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5382000640 1 -- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c06beb0 msgr2=0x7f537c147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5382000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c06beb0 0x7f537c147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5382000640 1 -- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c004360 msgr2=0x7f537c1eacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:48.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5382000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c004360 0x7f537c1eacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:48.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5382000640 1 -- 172.21.15.32:0/2005159236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c1eda30 con 0x7f537c0ab050 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5381600640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c004360 0x7f537c1eacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5380c00640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c06beb0 0x7f537c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5382000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f537c0ab050 0x7f537c0c25a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f537c0c0160 tx=0x7f5374010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5379600640 1 -- 172.21.15.32:0/2005159236 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374003d90 con 0x7f537c0ab050 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5379600640 1 -- 172.21.15.32:0/2005159236 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400d070 con 0x7f537c0ab050 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0aa020 con 0x7f537c0ab050 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5379600640 1 -- 172.21.15.32:0/2005159236 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400e930 con 0x7f537c0ab050 2024-01-19T04:18:48.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c0aa5e0 con 0x7f537c0ab050 2024-01-19T04:18:48.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c0a76c0 con 0x7f537c0ab050 2024-01-19T04:18:48.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5379600640 1 -- 172.21.15.32:0/2005159236 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f537400ea90 con 0x7f537c0ab050 2024-01-19T04:18:48.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5379600640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5354066530 0x7f53540689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:48.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5379600640 1 -- 172.21.15.32:0/2005159236 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5374086bb0 con 0x7f537c0ab050 2024-01-19T04:18:48.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.887+0000 7f5381600640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5354066530 0x7f53540689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:48.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.891+0000 7f5381600640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5354066530 0x7f53540689f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f536c001cc0 tx=0x7f536c001c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:48.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:48.891+0000 7f5379600640 1 -- 172.21.15.32:0/2005159236 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5374054180 con 0x7f537c0ab050 2024-01-19T04:18:49.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.051+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f537c1532e0 con 0x7f5354066530 2024-01-19T04:18:49.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.051+0000 7f5379600640 1 -- 172.21.15.32:0/2005159236 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f536c00f7f0 con 0x7f5354066530 2024-01-19T04:18:49.057 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2024-01-19T04:18:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5354066530 msgr2=0x7f53540689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5354066530 0x7f53540689f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f536c001cc0 tx=0x7f536c001c30 comp rx=0 tx=0).stop 2024-01-19T04:18:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f537c0ab050 msgr2=0x7f537c0c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f537c0ab050 0x7f537c0c25a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f537c0c0160 tx=0x7f5374010e40 comp rx=0 tx=0).stop 2024-01-19T04:18:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 shutdown_connections 2024-01-19T04:18:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f5354066530 0x7f53540689f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f537c0ab050 0x7f537c0c25a0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f537c06beb0 0x7f537c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 --2- 172.21.15.32:0/2005159236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c004360 0x7f537c1eacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 >> 172.21.15.32:0/2005159236 conn(0x7f537c0c5b20 msgr2=0x7f537c14f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 shutdown_connections 2024-01-19T04:18:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.055+0000 7f5384000640 1 -- 172.21.15.32:0/2005159236 wait complete. 2024-01-19T04:18:49.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:18:49.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.215+0000 7fab15400640 1 Processor -- start 2024-01-19T04:18:49.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab15400640 1 -- start start 2024-01-19T04:18:49.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab15400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab100c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:49.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab15400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab100c1120 0x7fab1015b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:49.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab15400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100c0c90 con 0x7fab100c5740 2024-01-19T04:18:49.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab15400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab10150f90 con 0x7fab100c1120 2024-01-19T04:18:49.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab15400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab10150cb0 con 0x7fab100c42b0 2024-01-19T04:18:49.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fab100c5740 0x7fab1006beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37314/0 (socket says 172.21.15.32:37314) 2024-01-19T04:18:49.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0de00640 1 -- 172.21.15.32:0/3248700148 learned_addr learned my addr 172.21.15.32:0/3248700148 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:18:49.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0f200640 1 --2- 172.21.15.32:0/3248700148 >> v2:172.21.15.67:3300/0 conn(0x7fab100c1120 0x7fab1015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:49.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0e800640 1 --2- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab100c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:49.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0d400640 1 -- 172.21.15.32:0/3248700148 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835085981 0 0) 0x7fab100c0c90 con 0x7fab100c5740 2024-01-19T04:18:49.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0d400640 1 -- 172.21.15.32:0/3248700148 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf0003530 con 0x7fab100c5740 2024-01-19T04:18:49.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0f200640 1 -- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 msgr2=0x7fab100c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:18:49.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0f200640 1 --2- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab100c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0f200640 1 -- 172.21.15.32:0/3248700148 >> v1:172.21.15.32:6789/0 conn(0x7fab100c5740 legacy=0x7fab1006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0f200640 1 -- 172.21.15.32:0/3248700148 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100c0640 con 0x7fab100c1120 2024-01-19T04:18:49.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.219+0000 7fab0e800640 1 --2- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab100c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:18:49.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab0f200640 1 --2- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 0x7fab1015b440 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fab08009d90 tx=0x7fab0801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ee25c1b2292cee9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:49.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab0d400640 1 -- 172.21.15.32:0/3248700148 <== mon.1 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080a57a0 con 0x7fab100c1120 2024-01-19T04:18:49.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab0d400640 1 -- 172.21.15.32:0/3248700148 <== mon.1 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080a5900 con 0x7fab100c1120 2024-01-19T04:18:49.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab0d400640 1 -- 172.21.15.32:0/3248700148 <== mon.1 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080a5c90 con 0x7fab100c1120 2024-01-19T04:18:49.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 -- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 msgr2=0x7fab1015b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 --2- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 0x7fab1015b440 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fab08009d90 tx=0x7fab0801c890 comp rx=0 tx=0).stop 2024-01-19T04:18:49.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 -- 172.21.15.32:0/3248700148 shutdown_connections 2024-01-19T04:18:49.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 --2- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 0x7fab1015b440 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 --2- 172.21.15.32:0/3248700148 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab100c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 -- 172.21.15.32:0/3248700148 >> 172.21.15.32:0/3248700148 conn(0x7fab100c5b20 msgr2=0x7fab100c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 -- 172.21.15.32:0/3248700148 shutdown_connections 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.223+0000 7fab15400640 1 -- 172.21.15.32:0/3248700148 wait complete. 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 Processor -- start 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 -- start start 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 0x7fab101499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab1014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab100c5740 0x7fab100711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:49.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100aaec0 con 0x7fab100c5740 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100aa590 con 0x7fab100c1120 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab10071e70 con 0x7fab100c42b0 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab100c5740 0x7fab100711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab100c5740 0x7fab100711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37622/0 (socket says 172.21.15.32:37622) 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 -- 172.21.15.32:0/4198130772 learned_addr learned my addr 172.21.15.32:0/4198130772 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0de00640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab1014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0e800640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 0x7fab101499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 -- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 msgr2=0x7fab1014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab1014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 -- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 msgr2=0x7fab101499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 0x7fab101499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 -- 172.21.15.32:0/4198130772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00009420 con 0x7fab100c5740 2024-01-19T04:18:49.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab0f200640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab100c5740 0x7fab100711f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fab080b0040 tx=0x7fab08019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab06a00640 1 -- 172.21.15.32:0/4198130772 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b9650 con 0x7fab100c5740 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab06a00640 1 -- 172.21.15.32:0/4198130772 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080b97b0 con 0x7fab100c5740 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab06a00640 1 -- 172.21.15.32:0/4198130772 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b9b40 con 0x7fab100c5740 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab08009a70 con 0x7fab100c5740 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab101f0ec0 con 0x7fab100c5740 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.227+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab101f0d20 con 0x7fab100c5740 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.231+0000 7fab06a00640 1 -- 172.21.15.32:0/4198130772 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fab080b9ca0 con 0x7fab100c5740 2024-01-19T04:18:49.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.231+0000 7fab06a00640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faae8066500 0x7faae80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:18:49.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.231+0000 7fab06a00640 1 -- 172.21.15.32:0/4198130772 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fab0811ec20 con 0x7fab100c5740 2024-01-19T04:18:49.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.231+0000 7fab0e800640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faae8066500 0x7faae80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:18:49.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.231+0000 7fab0e800640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faae8066500 0x7faae80689c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fab100ab770 tx=0x7fab00009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:18:49.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.235+0000 7fab06a00640 1 -- 172.21.15.32:0/4198130772 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fab101f0d20 con 0x7fab100c5740 2024-01-19T04:18:49.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.391+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab100c4f30 con 0x7faae8066500 2024-01-19T04:18:49.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab06a00640 1 -- 172.21.15.32:0/4198130772 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50713 (secure 0 0 0) 0x7fab00009cf0 con 0x7faae8066500 2024-01-19T04:18:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:18:49.399 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:18:49.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faae8066500 msgr2=0x7faae80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faae8066500 0x7faae80689c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fab100ab770 tx=0x7fab00009190 comp rx=0 tx=0).stop 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab100c5740 msgr2=0x7fab100711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab100c5740 0x7fab100711f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fab080b0040 tx=0x7fab08019630 comp rx=0 tx=0).stop 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 shutdown_connections 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7faae8066500 0x7faae80689c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab100c5740 0x7fab100711f0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fab100c42b0 0x7fab1014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 --2- 172.21.15.32:0/4198130772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab100c1120 0x7fab101499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 >> 172.21.15.32:0/4198130772 conn(0x7fab100c5b20 msgr2=0x7fab100a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:18:49.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 shutdown_connections 2024-01-19T04:18:49.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:18:49.395+0000 7fab15400640 1 -- 172.21.15.32:0/4198130772 wait complete. 2024-01-19T04:18:49.420 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-01-19T04:18:48.088066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262576,"kb_used_data":8952,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712144,"statfs":{"total":773094113280,"available":772825235456,"internally_reserved":0,"allocated":9166848,"data_stored":4694147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":259575347},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.633639"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":215,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-01-19T04:18:40.229222+0000","last_change":"2024-01-19T04:14:51.607582+0000","last_active":"2024-01-19T04:18:40.229222+0000","last_peered":"2024-01-19T04:18:40.229222+0000","last_clean":"2024-01-19T04:18:40.229222+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:18:40.229222+0000","last_undegraded":"2024-01-19T04:18:40.229222+0000","last_fullsized":"2024-01-19T04:18:40.229222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T04:14:50.399432+0000","last_clean_scrub_stamp":"2024-01-19T04:14:50.399432+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:25:13.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476786,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1593344,"data_stored":1030251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73399999999999999,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.036,"15min":1.036},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":1.228,"15min":1.228},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84699999999999998,"5min":1.661,"15min":1.661},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81399999999999995,"15min":0.84599999999999997},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63}]},{"osd":3,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76300000000000001,"15min":0.78000000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.86699999999999999,"5min":1.49,"15min":1.49},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.51900000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.51600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":1.514,"15min":1.514},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:17:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.65300000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0069999999999999,"5min":1.391,"15min":1.391},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":1.359,"15min":1.359},"last":0.66800000000000004}]}]},{"osd":6,"up_from":16,"seq":68719476786,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.746}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66300000000000003,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.624}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73099999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.498},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":16,"seq":68719476785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.012,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84299999999999997}]},{"osd":1,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.52800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.88100000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96399999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83199999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.014,"15min":1.014},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.75800000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67100000000000004,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.73899999999999999,"15min":0.77000000000000002},"min":{"1min":0.433,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80800000000000005,"5min":1.107,"15min":1.107},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.753,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94899999999999995,"5min":1.246,"15min":1.246},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.86599999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.85499999999999998,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.708,"15min":1.708},"last":0.93799999999999994}]}]},{"osd":4,"up_from":16,"seq":68719476787,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67500000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":0.997},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.79500000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84999999999999998,"5min":1.25,"15min":1.25},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.147,"15min":1.147},"last":1.1120000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97699999999999998,"5min":1.175,"15min":1.175},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0469999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.1870000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":1.224,"15min":1.224},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.85199999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0700000000000001,"5min":1.381,"15min":1.381},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.46500000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.119,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Jan 19 04:17:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.84099999999999997},"min":{"1min":0.59999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.139,"15min":1.139},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.89000000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1830000000000001,"5min":1.266,"15min":1.266},"last":1.3069999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.32700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68799999999999994,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64000000000000001,"5min":0.879,"15min":0.879},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.57299999999999995},"min":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81599999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71599999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.77700000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81399999999999995,"15min":0.81599999999999995},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3480000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.135,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.746},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2789999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.83999999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:18:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2350000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.085,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.69699999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.41699999999999998},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.64600000000000002,"5min":1.964,"15min":1.964},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55800000000000005,"15min":0.58599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64900000000000002,"5min":2.827,"15min":2.827},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56200000000000006,"5min":2.343,"15min":2.343},"last":0.496},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60799999999999998,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":1.665,"15min":1.665},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.042,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.97699999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92900000000000005,"5min":1.198,"15min":1.198},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0089999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0600000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.873}]},{"osd":7,"last update":"Fri Jan 19 04:17:52 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.878,"15min":0.93899999999999995},"min":{"1min":0.51700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.81200000000000006}]}]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1024598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.54500000000000004,"15min":0.60999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.56299999999999994,"15min":0.621},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56899999999999995,"5min":3.129,"15min":3.129},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.624,"15min":0.68600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66400000000000003,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.495},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58499999999999996,"15min":0.64500000000000002},"min":{"1min":0.32800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68000000000000005,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.73699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.63800000000000001,"5min":3.633,"15min":3.633},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.64500000000000002,"15min":0.72699999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89000000000000001,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.88300000000000001,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.90100000000000002,"15min":0.98599999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88400000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.91900000000000004,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93200000000000005,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":1.032},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94599999999999995,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.95699999999999996,"15min":1.0600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.88700000000000001,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91400000000000003,"15min":0.98999999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.96799999999999997,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:17:58 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.97899999999999998},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.98599999999999999,"15min":1.0800000000000001},"min":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.94399999999999995,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.91700000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36316,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.52700000000000002,"15min":0.57299999999999995},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1359999999999999,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.373,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.70799999999999996,"15min":0.79500000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.61699999999999999,"15min":0.67100000000000004},"min":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.8759999999999999,"5min":5.226,"15min":5.226},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67400000000000004,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.972,"5min":5.319,"15min":5.319},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66100000000000003,"15min":0.72699999999999998},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.1759999999999999,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.83699999999999997,"15min":0.878},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.88,"15min":0.93799999999999994},"min":{"1min":0.49099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0209999999999999,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.88,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.085,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.51800000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.669,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.9319999999999999,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.93899999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2170000000000001,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Jan 19 04:17:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3129999999999999,"5min":5.423,"15min":5.423},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.97699999999999998,"15min":1.0609999999999999},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.022,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:18:49.424 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-19T04:14:50.399432+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=14, tm_sec=50, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=4, tm_min=18, tm_sec=43, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T04:18:49.424 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-19T04:18:52.815 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:18:52.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:19:09.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T04:19:09.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829c600640 1 Processor -- start 2024-01-19T04:19:09.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829c600640 1 -- start start 2024-01-19T04:19:09.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829c600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82940c6e20 0x7f82940c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829c600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f829406fda0 0x7f82940c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829c600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82941533a0 con 0x7f82940a6d30 2024-01-19T04:19:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829c600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8294156380 con 0x7f829406fda0 2024-01-19T04:19:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829c600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829414fe40 con 0x7f82940c6e20 2024-01-19T04:19:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829a600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f829406fda0 0x7f82940c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829a600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f829406fda0 0x7f82940c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35122/0 (socket says 172.21.15.32:35122) 2024-01-19T04:19:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829a600640 1 -- 172.21.15.32:0/2758655192 learned_addr learned my addr 172.21.15.32:0/2758655192 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:19:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f8299c00640 1 --2- 172.21.15.32:0/2758655192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82940c6e20 0x7f82940c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829a600640 1 -- 172.21.15.32:0/2758655192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82940c6e20 msgr2=0x7f82940c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:19:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829a600640 1 --2- 172.21.15.32:0/2758655192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82940c6e20 0x7f82940c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829a600640 1 -- 172.21.15.32:0/2758655192 >> v1:172.21.15.67:6789/0 conn(0x7f82940a6d30 legacy=0x7f8294152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.575+0000 7f829a600640 1 -- 172.21.15.32:0/2758655192 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294152800 con 0x7f829406fda0 2024-01-19T04:19:09.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829a600640 1 --2- 172.21.15.32:0/2758655192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f829406fda0 0x7f82940c5b40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e50 tx=0x7f828c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fc27e5b94ea213 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:09.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f8293e00640 1 -- 172.21.15.32:0/2758655192 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a57b0 con 0x7f829406fda0 2024-01-19T04:19:09.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f8293e00640 1 -- 172.21.15.32:0/2758655192 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0a5910 con 0x7f829406fda0 2024-01-19T04:19:09.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f8293e00640 1 -- 172.21.15.32:0/2758655192 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a5ca0 con 0x7f829406fda0 2024-01-19T04:19:09.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 -- 172.21.15.32:0/2758655192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f829406fda0 msgr2=0x7f82940c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 --2- 172.21.15.32:0/2758655192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f829406fda0 0x7f82940c5b40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e50 tx=0x7f828c01c8f0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 -- 172.21.15.32:0/2758655192 shutdown_connections 2024-01-19T04:19:09.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 --2- 172.21.15.32:0/2758655192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f829406fda0 0x7f82940c5b40 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 --2- 172.21.15.32:0/2758655192 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f82940c6e20 0x7f82940c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 -- 172.21.15.32:0/2758655192 >> 172.21.15.32:0/2758655192 conn(0x7f82940a9870 msgr2=0x7f82940a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:19:09.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 -- 172.21.15.32:0/2758655192 shutdown_connections 2024-01-19T04:19:09.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.579+0000 7f829c600640 1 -- 172.21.15.32:0/2758655192 wait complete. 2024-01-19T04:19:09.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 Processor -- start 2024-01-19T04:19:09.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 -- start start 2024-01-19T04:19:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829406fda0 0x7f8294154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82940a6d30 0x7f82941ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82940c6e20 0x7f82941f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941f0540 con 0x7f82940a6d30 2024-01-19T04:19:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941f07e0 con 0x7f82940c6e20 2024-01-19T04:19:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829406d570 con 0x7f829406fda0 2024-01-19T04:19:09.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82940a6d30 0x7f82941ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299c00640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829406fda0 0x7f8294154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82940a6d30 0x7f82941ecfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35138/0 (socket says 172.21.15.32:35138) 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 -- 172.21.15.32:0/4003989080 learned_addr learned my addr 172.21.15.32:0/4003989080 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829a600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82940c6e20 0x7f82941f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 -- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829406fda0 msgr2=0x7f8294154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829406fda0 0x7f8294154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 -- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82940c6e20 msgr2=0x7f82941f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82940c6e20 0x7f82941f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 -- 172.21.15.32:0/4003989080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009b30 con 0x7f82940a6d30 2024-01-19T04:19:09.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8299200640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82940a6d30 0x7f82941ecfd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c430 tx=0x7f827c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:09.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8291600640 1 -- 172.21.15.32:0/4003989080 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0052d0 con 0x7f82940a6d30 2024-01-19T04:19:09.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8291600640 1 -- 172.21.15.32:0/4003989080 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c005430 con 0x7f82940a6d30 2024-01-19T04:19:09.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8294155150 con 0x7f82940a6d30 2024-01-19T04:19:09.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f8291600640 1 -- 172.21.15.32:0/4003989080 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c007260 con 0x7f82940a6d30 2024-01-19T04:19:09.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.583+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8294155710 con 0x7f82940a6d30 2024-01-19T04:19:09.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.587+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940a7ac0 con 0x7f82940a6d30 2024-01-19T04:19:09.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.587+0000 7f8291600640 1 -- 172.21.15.32:0/4003989080 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f827c0073c0 con 0x7f82940a6d30 2024-01-19T04:19:09.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.587+0000 7f8291600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f826c066500 0x7f826c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.587+0000 7f8291600640 1 -- 172.21.15.32:0/4003989080 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f827c082f00 con 0x7f82940a6d30 2024-01-19T04:19:09.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.587+0000 7f8299c00640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f826c066500 0x7f826c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.587+0000 7f8299c00640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f826c066500 0x7f826c0689c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f82840079c0 tx=0x7f8284008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:09.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.591+0000 7f8291600640 1 -- 172.21.15.32:0/4003989080 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f827c0503d0 con 0x7f82940a6d30 2024-01-19T04:19:09.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.747+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 --> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82940c6b10 con 0x7f826c066500 2024-01-19T04:19:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.751+0000 7f8291600640 1 -- 172.21.15.32:0/4003989080 <== mgr.4100 v2:172.21.15.67:6832/873967597 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50625 (secure 0 0 0) 0x7f82840108d0 con 0x7f826c066500 2024-01-19T04:19:09.757 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:19:09.758 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-01-19T04:19:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f826c066500 msgr2=0x7f826c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f826c066500 0x7f826c0689c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f82840079c0 tx=0x7f8284008040 comp rx=0 tx=0).stop 2024-01-19T04:19:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82940a6d30 msgr2=0x7f82941ecfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82940a6d30 0x7f82941ecfd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c430 tx=0x7f827c00c8f0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 shutdown_connections 2024-01-19T04:19:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f826c066500 0x7f826c0689c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82940c6e20 0x7f82941f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82940a6d30 0x7f82941ecfd0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 --2- 172.21.15.32:0/4003989080 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f829406fda0 0x7f8294154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 >> 172.21.15.32:0/4003989080 conn(0x7f82940a9870 msgr2=0x7f82940a7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:19:09.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 shutdown_connections 2024-01-19T04:19:09.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.755+0000 7f829c600640 1 -- 172.21.15.32:0/4003989080 wait complete. 2024-01-19T04:19:09.779 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-01-19T04:19:08.091960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262584,"kb_used_data":8968,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712136,"statfs":{"total":773094113280,"available":772825227264,"internally_reserved":0,"allocated":9183232,"data_stored":4699800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":259575347},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002425"},"pg_stats":[{"pgid":"1.0","version":"81'119","reported_seq":227,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-01-19T04:18:49.905177+0000","last_change":"2024-01-19T04:18:49.905177+0000","last_active":"2024-01-19T04:18:49.905177+0000","last_peered":"2024-01-19T04:18:49.905177+0000","last_clean":"2024-01-19T04:18:49.905177+0000","last_became_active":"2024-01-19T04:14:51.606583+0000","last_became_peered":"2024-01-19T04:14:51.606583+0000","last_unstale":"2024-01-19T04:18:49.905177+0000","last_undegraded":"2024-01-19T04:18:49.905177+0000","last_fullsized":"2024-01-19T04:18:49.905177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'119","last_scrub_stamp":"2024-01-19T04:18:49.905049+0000","last_deep_scrub":"81'119","last_deep_scrub_stamp":"2024-01-19T04:18:49.905049+0000","last_clean_scrub_stamp":"2024-01-19T04:18:49.905049+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:00.889353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476790,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1593344,"data_stored":1030251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1587,"internal_metadata":31914445},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":6.8179999999999996,"5min":6.8179999999999996,"15min":6.8179999999999996},"last":0.747},{"interface":"front","average":{"1min":2.306,"5min":1.008,"15min":0.80900000000000005},"min":{"1min":0.52200000000000002,"5min":0.437,"15min":0.437},"max":{"1min":36.534999999999997,"5min":36.534999999999997,"15min":36.534999999999997},"last":0.85799999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.752},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":2.347,"5min":1.042,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.434,"15min":0.434},"max":{"1min":36.595999999999997,"5min":36.595999999999997,"15min":36.595999999999997},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.85099999999999998,"15min":0.85799999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":6.8609999999999998,"5min":6.8609999999999998,"15min":6.8609999999999998},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.79100000000000004,"15min":0.83899999999999997},"min":{"1min":0.53900000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0069999999999999,"5min":1.49,"15min":1.49},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:18:54 2024","interfaces":[{"interface":"back","average":{"1min":2.367,"5min":1.0149999999999999,"15min":0.82499999999999996},"min":{"1min":0.47899999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":37.482999999999997,"5min":37.482999999999997,"15min":37.482999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.4099999999999999,"5min":0.88100000000000001,"15min":0.81799999999999995},"min":{"1min":0.46700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":16.265000000000001,"5min":16.265000000000001,"15min":16.265000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.84099999999999997,"15min":0.80900000000000005},"min":{"1min":0.53400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":9.609,"5min":9.609,"15min":9.609},"last":0.94499999999999995},{"interface":"front","average":{"1min":2.4660000000000002,"5min":1.1140000000000001,"15min":0.92800000000000005},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":37.524999999999999,"5min":37.524999999999999,"15min":37.524999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:18:54 2024","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":1.1439999999999999,"15min":0.94499999999999995},"min":{"1min":0.64300000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":36.645000000000003,"5min":36.645000000000003,"15min":36.645000000000003},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.476,"5min":0.93500000000000005,"15min":0.873},"min":{"1min":0.56799999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":16.408000000000001,"5min":16.408000000000001,"15min":16.408000000000001},"last":0.83299999999999996}]}]},{"osd":6,"up_from":16,"seq":68719476790,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.82199999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81999999999999995,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Jan 19 04:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.49099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88100000000000001,"5min":1.663,"15min":1.663},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.69299999999999995,"15min":0.71299999999999997},"min":{"1min":0.437,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81399999999999995,"5min":1.722,"15min":1.722},"last":0.747}]},{"osd":2,"last update":"Fri Jan 19 04:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86499999999999999,"5min":1.073,"15min":1.073},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.5,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86899999999999999,"5min":1.224,"15min":1.224},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.75600000000000001},"min":{"1min":0.53300000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.76400000000000001},"min":{"1min":0.54400000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92100000000000004,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94399999999999995,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Jan 19 04:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.48399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.878,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.59499999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97099999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jan 19 04:18:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0149999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77800000000000002,"15min":0.81200000000000006},"min":{"1min":0.59199999999999997,"5min":0.434,"15min":0.434},"max":{"1min":0.93100000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.57499999999999996}]}]},{"osd":5,"up_from":16,"seq":68719476789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.622,"15min":0.61099999999999999},"min":{"1min":0.505,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.53800000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0329999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.0329999999999999}]},{"osd":1,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.52400000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92100000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90600000000000003}]},{"osd":2,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69399999999999995,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.66700000000000004},"min":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.88100000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72699999999999998},"min":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99199999999999999,"5min":1.014,"15min":1.014},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.93300000000000005}]},{"osd":4,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.68500000000000005},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.76200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.042,"5min":1.107,"15min":1.107},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73299999999999998,"15min":0.77700000000000002},"min":{"1min":0.47699999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89900000000000002,"5min":1.246,"15min":1.246},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0169999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80700000000000005,"15min":0.85899999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.085,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.57699999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.075,"5min":1.708,"15min":1.708},"last":0.85699999999999998}]}]},{"osd":4,"up_from":16,"seq":68719476791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67300000000000004,"15min":0.68500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79500000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2030000000000001,"5min":1.25,"15min":1.25},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1120000000000001,"5min":1.147,"15min":1.147},"last":0.749}]},{"osd":2,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72499999999999998,"15min":0.747},"min":{"1min":0.51100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":1.175,"15min":1.175},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73299999999999998,"15min":0.753},"min":{"1min":0.499,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0860000000000001,"5min":1.224,"15min":1.224},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.623,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2529999999999999,"5min":1.381,"15min":1.381},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":1.202,"15min":1.202},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93700000000000006,"5min":1.141,"15min":1.141},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.78900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93500000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94099999999999995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.80100000000000005,"15min":0.83599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93799999999999994,"5min":1.139,"15min":1.139},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.86699999999999999,"15min":0.90300000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.80300000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44500000000000001,"15min":0.46000000000000002},"min":{"1min":0.33300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.55300000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74199999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77600000000000002,"5min":0.879,"15min":0.879},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53000000000000003,"15min":0.55100000000000005},"min":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.60399999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65400000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78400000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.024,"5min":1.175,"15min":1.175},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.63,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.048,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.53900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.121,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.77500000000000002},"min":{"1min":0.51200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89700000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81999999999999995,"15min":0.84499999999999997},"min":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0780000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79300000000000004,"15min":0.82599999999999996},"min":{"1min":0.626,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1000000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:19:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.80400000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96799999999999997,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.78400000000000003,"15min":0.81100000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.77400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.59799999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.495,"15min":0.52300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67600000000000005,"5min":1.964,"15min":1.964},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jan 19 04:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53400000000000003,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64200000000000002,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.622},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57099999999999995,"15min":0.627},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":2.827,"15min":2.827},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Jan 19 04:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52500000000000002,"15min":0.60299999999999998},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.64900000000000002,"5min":2.343,"15min":2.343},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58699999999999997,"15min":0.625},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66800000000000004,"5min":1.665,"15min":1.665},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Jan 19 04:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.0569999999999999,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0109999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jan 19 04:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93100000000000005,"5min":1.198,"15min":1.198},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78100000000000003,"15min":0.81899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0269999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78100000000000003,"15min":0.83199999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.746},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.82499999999999996},"min":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93300000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80400000000000005,"15min":0.83699999999999997},"min":{"1min":0.59299999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95299999999999996,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.874},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.92300000000000004},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.98299999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.80400000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1593344,"data_stored":1030251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.60399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.1030000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.61599999999999999},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.548,"5min":3.129,"15min":3.129},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58599999999999997,"15min":0.67300000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.407,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.64000000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.7930000000000001,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64700000000000002,"15min":0.72999999999999998},"min":{"1min":0.42299999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.6360000000000001,"5min":3.633,"15min":3.633},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.71799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.0670000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.86499999999999999,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.7160000000000002,"5min":3.5939999999999999,"15min":3.5939999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85599999999999998,"15min":0.97099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.1459999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.87,"15min":0.98399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.488,"5min":4.5629999999999997,"15min":4.5629999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":1.02},"min":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.6779999999999999,"5min":4.1600000000000001,"15min":4.1600000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.89400000000000002,"15min":1.0389999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.45,"5min":4.6470000000000002,"15min":4.6470000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88900000000000001,"15min":0.98199999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.7549999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.86899999999999999,"15min":0.96699999999999997},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.181,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.93200000000000005,"15min":1.0620000000000001},"min":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.534,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.74399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36316,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":999424,"data_stored":439883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.48499999999999999,"15min":0.55900000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56000000000000005,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67500000000000004,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.64000000000000001,"15min":0.77200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65200000000000002,"5min":7.5469999999999997,"15min":7.5469999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.56499999999999995,"15min":0.65400000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56999999999999995,"5min":5.226,"15min":5.226},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.626,"15min":0.70599999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":5.319,"15min":5.319},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.59899999999999998,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61199999999999999,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80100000000000005,"15min":0.86599999999999999},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.82999999999999996,"15min":0.92100000000000004},"min":{"1min":0.501,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89400000000000002,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.82499999999999996,"15min":0.91700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98099999999999998,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80200000000000005,"15min":0.85999999999999999},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.89900000000000002,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83299999999999996,"15min":0.90400000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90600000000000003,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83499999999999996,"15min":0.92300000000000004},"min":{"1min":0.53300000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":5.0220000000000002,"15min":5.0220000000000002},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Jan 19 04:19:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.86099999999999999,"15min":0.94799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.153,"5min":5.423,"15min":5.423},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.90500000000000003,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0660000000000001,"5min":7.4660000000000002,"15min":7.4660000000000002},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T04:19:09.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-19T04:19:09.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9f1400640 1 Processor -- start 2024-01-19T04:19:09.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9f1400640 1 -- start start 2024-01-19T04:19:09.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9f1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9ec14eb90 0x7fe9ec1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9f1400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9f1400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec072730 con 0x7fe9ec06dbc0 2024-01-19T04:19:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9f1400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec072a10 con 0x7fe9ec14eb90 2024-01-19T04:19:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9f1400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec14ef70 con 0x7fe9ec06c670 2024-01-19T04:19:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9ea800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9ec14eb90 0x7fe9ec1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9eb200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe9ec06dbc0 0x7fe9ec0719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:50102/0 (socket says 172.21.15.32:50102) 2024-01-19T04:19:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9eb200640 1 -- 172.21.15.32:0/390536282 learned_addr learned my addr 172.21.15.32:0/390536282 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:19:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9e9e00640 1 --2- 172.21.15.32:0/390536282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.915+0000 7fe9ea800640 1 -- 172.21.15.32:0/390536282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 msgr2=0x7fe9ec154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:19:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9ea800640 1 --2- 172.21.15.32:0/390536282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9ea800640 1 -- 172.21.15.32:0/390536282 >> v1:172.21.15.32:6789/0 conn(0x7fe9ec06dbc0 legacy=0x7fe9ec0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9ea800640 1 -- 172.21.15.32:0/390536282 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec155580 con 0x7fe9ec14eb90 2024-01-19T04:19:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9e9400640 1 -- 172.21.15.32:0/390536282 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247204646 0 0) 0x7fe9ec072730 con 0x7fe9ec06dbc0 2024-01-19T04:19:09.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9ea800640 1 --2- 172.21.15.32:0/390536282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec1549d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0097c0 tx=0x7fe9dc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2691d0bfc3fcd98 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:09.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9e9400640 1 -- 172.21.15.32:0/390536282 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0ab600 con 0x7fe9ec14eb90 2024-01-19T04:19:09.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9e9400640 1 -- 172.21.15.32:0/390536282 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0a7050 con 0x7fe9ec14eb90 2024-01-19T04:19:09.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9e9400640 1 -- 172.21.15.32:0/390536282 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0ab980 con 0x7fe9ec14eb90 2024-01-19T04:19:09.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9f1400640 1 -- 172.21.15.32:0/390536282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 msgr2=0x7fe9ec1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.919+0000 7fe9f1400640 1 --2- 172.21.15.32:0/390536282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec1549d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0097c0 tx=0x7fe9dc01c360 comp rx=0 tx=0).stop 2024-01-19T04:19:09.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- 172.21.15.32:0/390536282 shutdown_connections 2024-01-19T04:19:09.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 --2- 172.21.15.32:0/390536282 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 --2- 172.21.15.32:0/390536282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec1549d0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- 172.21.15.32:0/390536282 >> 172.21.15.32:0/390536282 conn(0x7fe9ec0c25a0 msgr2=0x7fe9ec0c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:19:09.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- 172.21.15.32:0/390536282 shutdown_connections 2024-01-19T04:19:09.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- 172.21.15.32:0/390536282 wait complete. 2024-01-19T04:19:09.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 Processor -- start 2024-01-19T04:19:09.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- start start 2024-01-19T04:19:09.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9ec06dbc0 0x7fe9ec15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0a8e70 con 0x7fe9ec14eb90 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec1485d0 con 0x7fe9ec06dbc0 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9f1400640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec147830 con 0x7fe9ec06c670 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35150/0 (socket says 172.21.15.32:35150) 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 -- 172.21.15.32:0/787248542 learned_addr learned my addr 172.21.15.32:0/787248542 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9ea800640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9e9e00640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9ec06dbc0 0x7fe9ec15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 -- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 msgr2=0x7fe9ec148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 -- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9ec06dbc0 msgr2=0x7fe9ec15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9ec06dbc0 0x7fe9ec15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 -- 172.21.15.32:0/787248542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009420 con 0x7fe9ec14eb90 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9ea800640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.923+0000 7fe9eb200640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec149d10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c6d0 tx=0x7fe9e400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4004d70 con 0x7fe9ec14eb90 2024-01-19T04:19:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e400a640 con 0x7fe9ec14eb90 2024-01-19T04:19:09.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400aa70 con 0x7fe9ec14eb90 2024-01-19T04:19:09.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec1edd10 con 0x7fe9ec14eb90 2024-01-19T04:19:09.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec147d20 con 0x7fe9ec14eb90 2024-01-19T04:19:09.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec1f0560 con 0x7fe9ec14eb90 2024-01-19T04:19:09.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe9e40070d0 con 0x7fe9ec14eb90 2024-01-19T04:19:09.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9e2a00640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe9c4066500 0x7fe9c40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:09.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe9e4083230 con 0x7fe9ec14eb90 2024-01-19T04:19:09.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.927+0000 7fe9ea800640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe9c4066500 0x7fe9c40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:09.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.931+0000 7fe9ea800640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe9c4066500 0x7fe9c40689c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0ad000 tx=0x7fe9dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:09.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:09.931+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe9ec1f0560 con 0x7fe9ec14eb90 2024-01-19T04:19:10.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.095+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe9ec1f0560 con 0x7fe9ec14eb90 2024-01-19T04:19:10.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.099+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe9ec1f0560 con 0x7fe9ec14eb90 2024-01-19T04:19:10.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.099+0000 7fe9e2a00640 1 -- 172.21.15.32:0/787248542 <== mon.0 v2:172.21.15.32:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe9e4083080 con 0x7fe9ec14eb90 2024-01-19T04:19:10.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe9c4066500 msgr2=0x7fe9c40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe9c4066500 0x7fe9c40689c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0ad000 tx=0x7fe9dc0a6000 comp rx=0 tx=0).stop 2024-01-19T04:19:10.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 msgr2=0x7fe9ec149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec149d10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c6d0 tx=0x7fe9e400cb90 comp rx=0 tx=0).stop 2024-01-19T04:19:10.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 shutdown_connections 2024-01-19T04:19:10.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7fe9c4066500 0x7fe9c40689c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9ec14eb90 0x7fe9ec149d10 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9ec06dbc0 0x7fe9ec15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 --2- 172.21.15.32:0/787248542 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7fe9ec06c670 0x7fe9ec148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 >> 172.21.15.32:0/787248542 conn(0x7fe9ec0c25a0 msgr2=0x7fe9ec14e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:19:10.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 shutdown_connections 2024-01-19T04:19:10.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.103+0000 7fe9f1400640 1 -- 172.21.15.32:0/787248542 wait complete. 2024-01-19T04:19:10.128 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T04:19:10.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T04:19:10.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.263+0000 7f7941600640 1 Processor -- start 2024-01-19T04:19:10.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7941600640 1 -- start start 2024-01-19T04:19:10.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7941600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:10.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7941600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f793c072310 0x7f793c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:10.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7941600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793c0c44f0 con 0x7f793c155320 2024-01-19T04:19:10.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7941600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793c0c4980 con 0x7f793c072310 2024-01-19T04:19:10.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7941600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c0c3bc0 con 0x7f793c0c54b0 2024-01-19T04:19:10.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f793c155320 0x7f793c0a4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:50116/0 (socket says 172.21.15.32:50116) 2024-01-19T04:19:10.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793aa00640 1 -- 172.21.15.32:0/305532585 learned_addr learned my addr 172.21.15.32:0/305532585 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-01-19T04:19:10.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793a000640 1 --2- 172.21.15.32:0/305532585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:10.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793b400640 1 --2- 172.21.15.32:0/305532585 >> v2:172.21.15.67:3300/0 conn(0x7f793c072310 0x7f793c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:10.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7939600640 1 -- 172.21.15.32:0/305532585 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015820403 0 0) 0x7f793c0c44f0 con 0x7f793c155320 2024-01-19T04:19:10.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f7939600640 1 -- 172.21.15.32:0/305532585 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f791c003530 con 0x7f793c155320 2024-01-19T04:19:10.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793a000640 1 -- 172.21.15.32:0/305532585 >> v2:172.21.15.67:3300/0 conn(0x7f793c072310 msgr2=0x7f793c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T04:19:10.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793a000640 1 --2- 172.21.15.32:0/305532585 >> v2:172.21.15.67:3300/0 conn(0x7f793c072310 0x7f793c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793a000640 1 -- 172.21.15.32:0/305532585 >> v1:172.21.15.32:6789/0 conn(0x7f793c155320 legacy=0x7f793c0a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.267+0000 7f793a000640 1 -- 172.21.15.32:0/305532585 --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c0c3ea0 con 0x7f793c0c54b0 2024-01-19T04:19:10.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f793a000640 1 --2- 172.21.15.32:0/305532585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c06cc80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f79240097c0 tx=0x7f792401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7032d513f1bc8f1d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:10.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7939600640 1 -- 172.21.15.32:0/305532585 <== mon.2 v2:172.21.15.67:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240ad660 con 0x7f793c0c54b0 2024-01-19T04:19:10.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7939600640 1 -- 172.21.15.32:0/305532585 <== mon.2 v2:172.21.15.67:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f79240ad7c0 con 0x7f793c0c54b0 2024-01-19T04:19:10.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7939600640 1 -- 172.21.15.32:0/305532585 <== mon.2 v2:172.21.15.67:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240adb70 con 0x7f793c0c54b0 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 -- 172.21.15.32:0/305532585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 msgr2=0x7f793c06cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 --2- 172.21.15.32:0/305532585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c06cc80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f79240097c0 tx=0x7f792401c3c0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 -- 172.21.15.32:0/305532585 shutdown_connections 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 --2- 172.21.15.32:0/305532585 >> v2:172.21.15.67:3300/0 conn(0x7f793c072310 0x7f793c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 --2- 172.21.15.32:0/305532585 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c06cc80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 -- 172.21.15.32:0/305532585 >> 172.21.15.32:0/305532585 conn(0x7f793c0c5b20 msgr2=0x7f793c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 -- 172.21.15.32:0/305532585 shutdown_connections 2024-01-19T04:19:10.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.271+0000 7f7941600640 1 -- 172.21.15.32:0/305532585 wait complete. 2024-01-19T04:19:10.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 Processor -- start 2024-01-19T04:19:10.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 -- start start 2024-01-19T04:19:10.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f793c072310 0x7f793c146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:10.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 --2- >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:10.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f793c155320 0x7f793c1ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:10.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c1ecc10 con 0x7f793c155320 2024-01-19T04:19:10.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c1469b0 con 0x7f793c072310 2024-01-19T04:19:10.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 -- --> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c14ac30 con 0x7f793c0c54b0 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f793c155320 0x7f793c1ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f793c155320 0x7f793c1ed600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35166/0 (socket says 172.21.15.32:35166) 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 -- 172.21.15.32:0/3761386054 learned_addr learned my addr 172.21.15.32:0/3761386054 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793aa00640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f793c072310 0x7f793c146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793a000640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 -- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 msgr2=0x7f793c14a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c14a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 -- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f793c072310 msgr2=0x7f793c146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f793c072310 0x7f793c146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 -- 172.21.15.32:0/3761386054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924009420 con 0x7f793c155320 2024-01-19T04:19:10.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793b400640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f793c155320 0x7f793c1ed600 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f793400ec10 tx=0x7f793400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:10.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7932a00640 1 -- 172.21.15.32:0/3761386054 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793400cd20 con 0x7f793c155320 2024-01-19T04:19:10.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7932a00640 1 -- 172.21.15.32:0/3761386054 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f793400f040 con 0x7f793c155320 2024-01-19T04:19:10.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7932a00640 1 -- 172.21.15.32:0/3761386054 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340146e0 con 0x7f793c155320 2024-01-19T04:19:10.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c0a5630 con 0x7f793c155320 2024-01-19T04:19:10.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c1f0b90 con 0x7f793c155320 2024-01-19T04:19:10.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c0749f0 con 0x7f793c155320 2024-01-19T04:19:10.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7932a00640 1 -- 172.21.15.32:0/3761386054 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7934014840 con 0x7f793c155320 2024-01-19T04:19:10.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7932a00640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7914066500 0x7f79140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T04:19:10.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f7932a00640 1 -- 172.21.15.32:0/3761386054 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f79340845d0 con 0x7f793c155320 2024-01-19T04:19:10.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793aa00640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7914066500 0x7f79140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T04:19:10.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.279+0000 7f793aa00640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7914066500 0x7f79140689c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f792c007fd0 tx=0x7f792c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T04:19:10.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.283+0000 7f7932a00640 1 -- 172.21.15.32:0/3761386054 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7934051bb0 con 0x7f793c155320 2024-01-19T04:19:10.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.479+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f793c0bfb80 con 0x7f793c155320 2024-01-19T04:19:10.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.479+0000 7f7932a00640 1 -- 172.21.15.32:0/3761386054 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f79340551d0 con 0x7f793c155320 2024-01-19T04:19:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-01-19T04:19:10.486 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6836/3255954328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":3255954328},{"type":"v1","addr":"172.21.15.67:6836","nonce":3255954328}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/780031176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":780031176},{"type":"v1","addr":"172.21.15.32:6834","nonce":780031176}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/4132918456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6835","nonce":4132918456},{"type":"v1","addr":"172.21.15.67:6837","nonce":4132918456}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2128984880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":2128984880},{"type":"v1","addr":"172.21.15.32:6835","nonce":2128984880}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[]} 2024-01-19T04:19:10.486 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 56 2024-01-19T04:19:10.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7914066500 msgr2=0x7f79140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7914066500 0x7f79140689c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f792c007fd0 tx=0x7f792c009040 comp rx=0 tx=0).stop 2024-01-19T04:19:10.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f793c155320 msgr2=0x7f793c1ed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T04:19:10.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f793c155320 0x7f793c1ed600 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f793400ec10 tx=0x7f793400c490 comp rx=0 tx=0).stop 2024-01-19T04:19:10.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 shutdown_connections 2024-01-19T04:19:10.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:6832/873967597,v1:172.21.15.67:6833/873967597] conn(0x7f7914066500 0x7f79140689c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f793c155320 0x7f793c1ed600 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x7f793c0c54b0 0x7f793c14a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 --2- 172.21.15.32:0/3761386054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f793c072310 0x7f793c146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T04:19:10.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 >> 172.21.15.32:0/3761386054 conn(0x7f793c0c5b20 msgr2=0x7f793c0c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T04:19:10.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 shutdown_connections 2024-01-19T04:19:10.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-01-19T04:19:10.483+0000 7f7941600640 1 -- 172.21.15.32:0/3761386054 wait complete. 2024-01-19T04:19:10.508 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-19T04:19:10.508 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-19T04:19:10.508 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-19T04:19:10.508 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:10.521 INFO:tasks.ceph.mds.a:Stopped 2024-01-19T04:19:10.522 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-19T04:19:10.522 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:10.577 INFO:tasks.ceph.mds.c:Stopped 2024-01-19T04:19:10.577 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-19T04:19:10.578 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:10.593 INFO:tasks.ceph.mds.b:Stopped 2024-01-19T04:19:10.593 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-19T04:19:10.593 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:10.652 INFO:tasks.ceph.mds.d:Stopped 2024-01-19T04:19:10.652 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-19T04:19:10.652 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-19T04:19:10.653 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:10.746 INFO:tasks.ceph.osd.0:Stopped 2024-01-19T04:19:10.746 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-19T04:19:10.746 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:16.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-19T04:19:16.848 INFO:tasks.ceph.osd.1:Stopped 2024-01-19T04:19:16.848 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-19T04:19:16.849 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:16.928 INFO:tasks.ceph.osd.2:Stopped 2024-01-19T04:19:16.928 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-19T04:19:16.929 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.018 INFO:tasks.ceph.osd.3:Stopped 2024-01-19T04:19:17.019 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-19T04:19:17.019 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.090 INFO:tasks.ceph.osd.4:Stopped 2024-01-19T04:19:17.091 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-19T04:19:17.091 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.172 INFO:tasks.ceph.osd.5:Stopped 2024-01-19T04:19:17.173 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-19T04:19:17.173 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.252 INFO:tasks.ceph.osd.6:Stopped 2024-01-19T04:19:17.253 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-19T04:19:17.253 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.320 INFO:tasks.ceph.osd.7:Stopped 2024-01-19T04:19:17.320 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-19T04:19:17.321 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-19T04:19:17.321 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.375 INFO:tasks.ceph.mgr.y:Stopped 2024-01-19T04:19:17.375 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-19T04:19:17.375 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.432 INFO:tasks.ceph.mgr.x:Stopped 2024-01-19T04:19:17.432 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-19T04:19:17.433 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-19T04:19:17.433 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.452 INFO:tasks.ceph.mon.a:Stopped 2024-01-19T04:19:17.452 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-19T04:19:17.452 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.467 INFO:tasks.ceph.mon.b:Stopped 2024-01-19T04:19:17.468 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-19T04:19:17.468 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T04:19:17.529 INFO:tasks.ceph.mon.c:Stopped 2024-01-19T04:19:17.529 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-19T04:19:17.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-19T04:19:17.558 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:19:17.559 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-19T04:19:17.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:19:17.783 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-19T04:19:17.997 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:19:17.997 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-19T04:19:18.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:19:18.297 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-19T04:19:18.479 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:19:18.480 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-19T04:19:18.731 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:19:18.731 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-19T04:19:18.932 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:19:18.932 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-19T04:19:19.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:19:19.083 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-19T04:19:19.233 INFO:tasks.ceph:Archiving mon data... 2024-01-19T04:19:19.235 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/data/mon.a.tgz 2024-01-19T04:19:19.235 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-01-19T04:19:19.244 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.eZvREoAY1x 2024-01-19T04:19:19.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eZvREoAY1x 2024-01-19T04:19:19.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.eZvREoAY1x 2024-01-19T04:19:19.481 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.eZvREoAY1x is 455KB 2024-01-19T04:19:19.548 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.eZvREoAY1x 2024-01-19T04:19:19.557 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/data/mon.b.tgz 2024-01-19T04:19:19.557 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-01-19T04:19:19.566 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.c03JKiUsu6 2024-01-19T04:19:19.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.c03JKiUsu6 2024-01-19T04:19:19.756 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.c03JKiUsu6 2024-01-19T04:19:19.828 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.c03JKiUsu6 is 582KB 2024-01-19T04:19:19.899 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.c03JKiUsu6 2024-01-19T04:19:19.908 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/data/mon.c.tgz 2024-01-19T04:19:19.908 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-01-19T04:19:19.956 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.k8U7NNqYto 2024-01-19T04:19:19.956 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.k8U7NNqYto 2024-01-19T04:19:20.139 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.k8U7NNqYto 2024-01-19T04:19:20.212 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.k8U7NNqYto is 582KB 2024-01-19T04:19:20.278 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.k8U7NNqYto 2024-01-19T04:19:20.287 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-19T04:19:20.287 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-19T04:19:20.291 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-19T04:19:20.362 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-19T04:19:20.396 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-19T04:19:20.396 INFO:tasks.ceph:Archiving crash dumps... 2024-01-19T04:19:20.398 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/remote/smithi032/crash 2024-01-19T04:19:20.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-19T04:19:20.426 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/remote/smithi067/crash 2024-01-19T04:19:20.427 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-19T04:19:20.454 INFO:tasks.ceph:Shutting down logrotate 2024-01-19T04:19:20.454 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:19:20.472 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T04:19:20.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-19T04:19:20.568 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-19T04:19:20.587 INFO:tasks.ceph:Compressing logs... 2024-01-19T04:19:20.588 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-19T04:19:20.612 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-19T04:19:20.640 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42587.log 2024-01-19T04:19:20.641 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2024-01-19T04:19:20.641 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34878.log 2024-01-19T04:19:20.642 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42587.log.gz 2024-01-19T04:19:20.643 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38774.log 2024-01-19T04:19:20.643 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2024-01-19T04:19:20.643 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39533.log 2024-01-19T04:19:20.644 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34878.log.gz 2024-01-19T04:19:20.644 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41687.log 2024-01-19T04:19:20.645 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38774.log.gz 2024-01-19T04:19:20.646 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32024.log 2024-01-19T04:19:20.646 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39533.log.gz 2024-01-19T04:19:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41687.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41687.log.gz 2024-01-19T04:19:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42671.log 2024-01-19T04:19:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36517.log 2024-01-19T04:19:20.648 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32024.log.gz 2024-01-19T04:19:20.649 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37206.log 2024-01-19T04:19:20.649 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42671.log.gz 2024-01-19T04:19:20.650 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39299.log 2024-01-19T04:19:20.650 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36517.log.gz 2024-01-19T04:19:20.651 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40281.log 2024-01-19T04:19:20.651 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37206.log.gz 2024-01-19T04:19:20.652 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39299.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.39299.log.gz --verbose 2024-01-19T04:19:20.652 INFO:teuthology.orchestra.run.smithi032.stderr: -- /var/log/ceph/ceph-client.admin.33587.log 2024-01-19T04:19:20.653 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38616.log 2024-01-19T04:19:20.653 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40281.log.gz 2024-01-19T04:19:20.654 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40675.log 2024-01-19T04:19:20.654 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33587.log.gz 2024-01-19T04:19:20.654 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27229.log 2024-01-19T04:19:20.655 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35680.log 2024-01-19T04:19:20.655 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38616.log.gz 2024-01-19T04:19:20.657 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27277.log 2024-01-19T04:19:20.657 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33291.log 2024-01-19T04:19:20.657 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27229.log.gz 2024-01-19T04:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-01-19T04:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40675.log.gz 2024-01-19T04:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-01-19T04:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35680.log.gz 2024-01-19T04:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36699.log 2024-01-19T04:19:20.658 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-01-19T04:19:20.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37056.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-19T04:19:20.661 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-01-19T04:19:20.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37648.log 2024-01-19T04:19:20.661 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36699.log.gz 2024-01-19T04:19:20.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40229.log 2024-01-19T04:19:20.662 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27277.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-19T04:19:20.662 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27277.log.gz 2024-01-19T04:19:20.662 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.33291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33291.log.gz 2024-01-19T04:19:20.663 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-19T04:19:20.663 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33157.log 2024-01-19T04:19:20.663 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27325.log 2024-01-19T04:19:20.663 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.33157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33157.log.gz 2024-01-19T04:19:20.663 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27253.log 2024-01-19T04:19:20.663 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27325.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-19T04:19:20.663 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27325.log.gz 2024-01-19T04:19:20.666 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27253.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27253.log.gz 2024-01-19T04:19:20.666 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33335.log 2024-01-19T04:19:20.666 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27301.log 2024-01-19T04:19:20.666 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.33335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33335.log.gz 2024-01-19T04:19:20.666 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-19T04:19:20.668 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37966.log 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37648.log.gz 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43009.log 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40229.log.gz 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35060.log 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37966.log.gz 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43009.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-01-19T04:19:20.669 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43009.log.gz 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35992.log 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35060.log.gz 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35810.log 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41850.log 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35992.log.gz 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-01-19T04:19:20.670 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35810.log.gz 2024-01-19T04:19:20.674 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27301.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27301.log.gz 2024-01-19T04:19:20.674 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-19T04:19:20.674 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.33392.log 2024-01-19T04:19:20.675 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-19T04:19:20.675 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.testuser.33392.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-19T04:19:20.675 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.33392.log.gz 2024-01-19T04:19:20.675 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-19T04:19:20.675 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-19T04:19:20.675 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-19T04:19:20.676 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38318.log 2024-01-19T04:19:20.676 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41850.log.gz 2024-01-19T04:19:20.676 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32494.log 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39663.log 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38318.log.gz 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39273.log 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32494.log.gz 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36848.log 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39663.log.gz 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33782.log 2024-01-19T04:19:20.677 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39273.log.gz 2024-01-19T04:19:20.678 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34472.log 2024-01-19T04:19:20.678 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36848.log.gz 2024-01-19T04:19:20.678 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2024-01-19T04:19:20.678 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33782.log.gz 2024-01-19T04:19:20.679 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-19T04:19:20.679 INFO:teuthology.orchestra.run.smithi067.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-19T04:19:20.680 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-19T04:19:20.681 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42697.log 2024-01-19T04:19:20.681 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34472.log.gz 2024-01-19T04:19:20.681 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43847.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2024-01-19T04:19:20.682 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40753.log 2024-01-19T04:19:20.682 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39429.log 2024-01-19T04:19:20.682 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42697.log.gz 2024-01-19T04:19:20.682 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38800.log 2024-01-19T04:19:20.682 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40753.log.gz 2024-01-19T04:19:20.682 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-01-19T04:19:20.682 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39429.log.gz 2024-01-19T04:19:20.683 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-19T04:19:20.684 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38800.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38800.log.gz 2024-01-19T04:19:20.684 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40397.log 2024-01-19T04:19:20.684 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42186.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-01-19T04:19:20.685 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-19T04:19:20.685 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33535.log 2024-01-19T04:19:20.685 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40397.log.gz 2024-01-19T04:19:20.685 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32830.log 2024-01-19T04:19:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35382.log 2024-01-19T04:19:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35470.log 2024-01-19T04:19:20.686 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33535.log.gz 2024-01-19T04:19:20.687 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32952.log 2024-01-19T04:19:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31662.log 2024-01-19T04:19:20.688 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35382.log.gz 2024-01-19T04:19:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34904.log 2024-01-19T04:19:20.688 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35470.log.gz 2024-01-19T04:19:20.689 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.32830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32830.log.gz 2024-01-19T04:19:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34173.log 2024-01-19T04:19:20.690 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31662.log.gz 2024-01-19T04:19:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34904.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.34904.log.gz --verbose 2024-01-19T04:19:20.690 INFO:teuthology.orchestra.run.smithi032.stderr: -- /var/log/ceph/ceph-client.admin.36595.log 2024-01-19T04:19:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-01-19T04:19:20.692 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34173.log.gz 2024-01-19T04:19:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36595.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36595.log.gz 2024-01-19T04:19:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41928.log 2024-01-19T04:19:20.693 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.32952.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27349.log 2024-01-19T04:19:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37730.log 2024-01-19T04:19:20.694 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-01-19T04:19:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41928.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41928.log.gz 2024-01-19T04:19:20.694 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35198.log 2024-01-19T04:19:20.695 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33725.log 2024-01-19T04:19:20.695 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37730.log.gz 2024-01-19T04:19:20.696 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33110.log 2024-01-19T04:19:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41739.log 2024-01-19T04:19:20.696 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35198.log.gz 2024-01-19T04:19:20.698 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.1.32952.log.gz 2024-01-19T04:19:20.698 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27349.log.gz 2024-01-19T04:19:20.698 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32996.log 2024-01-19T04:19:20.699 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44029.log 2024-01-19T04:19:20.699 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33725.log.gz 2024-01-19T04:19:20.699 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41739.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41739.log.gz 2024-01-19T04:19:20.699 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37888.log 2024-01-19T04:19:20.699 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40781.log 2024-01-19T04:19:20.699 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44029.log.gz 2024-01-19T04:19:20.705 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2024-01-19T04:19:20.705 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37888.log.gz 2024-01-19T04:19:20.705 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39116.log 2024-01-19T04:19:20.705 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40781.log.gz 2024-01-19T04:19:20.705 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44057.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz 2024-01-19T04:19:20.706 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31818.log 2024-01-19T04:19:20.706 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log 2024-01-19T04:19:20.706 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39116.log.gz 2024-01-19T04:19:20.706 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35836.log 2024-01-19T04:19:20.706 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31818.log.gz 2024-01-19T04:19:20.706 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2024-01-19T04:19:20.706 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37109.log.gz 2024-01-19T04:19:20.708 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.1.33110.log: /var/log/ceph/ceph-client.1.32996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32996.log.gz 2024-01-19T04:19:20.708 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33110.log.gz 2024-01-19T04:19:20.708 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27373.log 2024-01-19T04:19:20.709 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36100.log 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35836.log.gz 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36100.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.36100.log.gz 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43269.log 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33197.log 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2024-01-19T04:19:20.710 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43269.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43269.log.gz 2024-01-19T04:19:20.711 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35034.log 2024-01-19T04:19:20.712 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27205.log 2024-01-19T04:19:20.712 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27373.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27373.log.gz 2024-01-19T04:19:20.713 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32221.log 2024-01-19T04:19:20.714 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33197.log.gz 2024-01-19T04:19:20.714 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42931.log 2024-01-19T04:19:20.714 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35034.log.gz 2024-01-19T04:19:20.714 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27091.log 2024-01-19T04:19:20.714 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32221.log.gz 2024-01-19T04:19:20.714 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42931.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42931.log.gz 2024-01-19T04:19:20.714 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37992.log 2024-01-19T04:19:20.715 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.27205.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27205.log.gz 2024-01-19T04:19:20.716 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.27091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37258.log 2024-01-19T04:19:20.716 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27091.log.gz 2024-01-19T04:19:20.716 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35110.log 2024-01-19T04:19:20.717 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37258.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37992.log.gz 2024-01-19T04:19:20.717 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37258.log.gz 2024-01-19T04:19:20.717 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-01-19T04:19:20.717 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38694.log 2024-01-19T04:19:20.717 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2024-01-19T04:19:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42535.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gzgzip 2024-01-19T04:19:20.718 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37862.log 2024-01-19T04:19:20.719 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34420.log 2024-01-19T04:19:20.719 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38694.log.gz 2024-01-19T04:19:20.720 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37862.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37862.log.gz 2024-01-19T04:19:20.720 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31820.log 2024-01-19T04:19:20.721 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43471.log 2024-01-19T04:19:20.721 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34420.log.gz 2024-01-19T04:19:20.722 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31280.log 2024-01-19T04:19:20.722 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31820.log.gz 2024-01-19T04:19:20.723 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-01-19T04:19:20.723 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43471.log.gz 2024-01-19T04:19:20.724 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31280.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31280.log.gz 2024-01-19T04:19:20.724 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43717.log 2024-01-19T04:19:20.725 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35172.log 2024-01-19T04:19:20.725 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2024-01-19T04:19:20.726 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34550.log 2024-01-19T04:19:20.726 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43717.log.gz 2024-01-19T04:19:20.727 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35172.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-19T04:19:20.727 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35172.log.gz 2024-01-19T04:19:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34550.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34550.log.gz 2024-01-19T04:19:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39351.log 2024-01-19T04:19:20.729 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37452.log 2024-01-19T04:19:20.730 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38986.log 2024-01-19T04:19:20.730 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39351.log.gz 2024-01-19T04:19:20.731 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34658.log 2024-01-19T04:19:20.731 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37452.log.gz 2024-01-19T04:19:20.732 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38986.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38986.log.gz 2024-01-19T04:19:20.732 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31359.log 2024-01-19T04:19:20.733 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39689.log 2024-01-19T04:19:20.734 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34658.log.gz 2024-01-19T04:19:20.734 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31359.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31359.log.gz 2024-01-19T04:19:20.735 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32005.log 2024-01-19T04:19:20.736 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41453.log 2024-01-19T04:19:20.736 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39689.log.gz 2024-01-19T04:19:20.736 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32005.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32005.log.gz 2024-01-19T04:19:20.737 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33756.log 2024-01-19T04:19:20.738 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36952.log 2024-01-19T04:19:20.738 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41453.log.gz 2024-01-19T04:19:20.739 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41153.log 2024-01-19T04:19:20.739 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33756.log.gz 2024-01-19T04:19:20.740 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36952.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36952.log.gz 2024-01-19T04:19:20.740 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39142.log 2024-01-19T04:19:20.741 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41153.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41153.log.gz 2024-01-19T04:19:20.741 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35354.log 2024-01-19T04:19:20.742 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-01-19T04:19:20.742 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39142.log.gz 2024-01-19T04:19:20.743 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35354.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35354.log.gz 2024-01-19T04:19:20.743 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35862.log 2024-01-19T04:19:20.744 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36180.log 2024-01-19T04:19:20.744 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-01-19T04:19:20.745 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35862.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35862.log.gz 2024-01-19T04:19:20.746 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35732.log 2024-01-19T04:19:20.746 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33119.log 2024-01-19T04:19:20.747 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36180.log.gz 2024-01-19T04:19:20.747 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35732.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35732.log.gz 2024-01-19T04:19:20.747 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33223.log 2024-01-19T04:19:20.748 INFO:teuthology.orchestra.run.smithi067.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-19T04:19:20.749 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2024-01-19T04:19:20.749 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33119.log.gz 2024-01-19T04:19:20.750 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33223.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33223.log.gz 2024-01-19T04:19:20.750 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40541.log 2024-01-19T04:19:20.750 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35524.log 2024-01-19T04:19:20.751 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2024-01-19T04:19:20.752 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40541.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40541.log.gz 2024-01-19T04:19:20.752 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39038.log 2024-01-19T04:19:20.753 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35524.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35524.log.gz 2024-01-19T04:19:20.753 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36725.log 2024-01-19T04:19:20.753 INFO:teuthology.orchestra.run.smithi067.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-19T04:19:20.754 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39038.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39038.log.gz 2024-01-19T04:19:20.754 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38564.log 2024-01-19T04:19:20.755 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36725.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36725.log.gz 2024-01-19T04:19:20.755 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2024-01-19T04:19:20.756 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38564.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38564.log.gz 2024-01-19T04:19:20.756 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-19T04:19:20.757 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43665.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2024-01-19T04:19:20.757 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38209.log 2024-01-19T04:19:20.758 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31098.log 2024-01-19T04:19:20.759 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38209.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38209.log.gz 2024-01-19T04:19:20.759 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36387.log 2024-01-19T04:19:20.760 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31098.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31098.log.gz 2024-01-19T04:19:20.761 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39377.log 2024-01-19T04:19:20.762 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34042.log 2024-01-19T04:19:20.762 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36387.log.gz 2024-01-19T04:19:20.763 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39377.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39377.log.gz 2024-01-19T04:19:20.763 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39741.log 2024-01-19T04:19:20.764 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34042.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34042.log.gz 2024-01-19T04:19:20.764 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41179.log 2024-01-19T04:19:20.765 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34218.log 2024-01-19T04:19:20.766 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39741.log.gz 2024-01-19T04:19:20.767 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41179.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.41179.log.gz 2024-01-19T04:19:20.767 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38590.log 2024-01-19T04:19:20.768 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34218.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34218.log.gz 2024-01-19T04:19:20.768 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34718.log 2024-01-19T04:19:20.769 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31610.log 2024-01-19T04:19:20.770 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38590.log.gz 2024-01-19T04:19:20.770 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34718.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34718.log.gz 2024-01-19T04:19:20.771 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39585.log 2024-01-19T04:19:20.772 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38157.log 2024-01-19T04:19:20.772 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31610.log.gz 2024-01-19T04:19:20.773 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39585.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39585.log.gz 2024-01-19T04:19:20.773 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33483.log 2024-01-19T04:19:20.774 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37836.log 2024-01-19T04:19:20.775 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38157.log.gz 2024-01-19T04:19:20.776 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.36267.log 2024-01-19T04:19:20.776 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33483.log.gz 2024-01-19T04:19:20.777 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37836.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37836.log.gz 2024-01-19T04:19:20.777 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2024-01-19T04:19:20.778 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.testuser.36267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-01-19T04:19:20.778 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.36267.log.gz 2024-01-19T04:19:20.779 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43419.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz -- 2024-01-19T04:19:20.779 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.42346.log 2024-01-19T04:19:20.781 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41101.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-01-19T04:19:20.781 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31812.log 2024-01-19T04:19:20.782 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35602.log 2024-01-19T04:19:20.782 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42346.log.gz 2024-01-19T04:19:20.783 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31812.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31812.log.gz 2024-01-19T04:19:20.783 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-01-19T04:19:20.785 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26980.log 2024-01-19T04:19:20.785 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35602.log.gz 2024-01-19T04:19:20.786 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36074.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-01-19T04:19:20.786 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31189.log 2024-01-19T04:19:20.787 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.26980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40649.log 2024-01-19T04:19:20.788 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31189.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.26980.log.gz 2024-01-19T04:19:20.788 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31189.log.gz 2024-01-19T04:19:20.789 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2024-01-19T04:19:20.789 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40649.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40649.log.gz 2024-01-19T04:19:20.790 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35444.log 2024-01-19T04:19:20.791 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 2024-01-19T04:19:20.791 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2024-01-19T04:19:20.792 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35444.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35444.log.gz 2024-01-19T04:19:20.792 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36569.log 2024-01-19T04:19:20.794 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37232.log 2024-01-19T04:19:20.794 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2024-01-19T04:19:20.795 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36569.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36569.log.gz 2024-01-19T04:19:20.795 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42749.log 2024-01-19T04:19:20.796 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39507.log 2024-01-19T04:19:20.796 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37232.log.gz 2024-01-19T04:19:20.798 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36543.log 87.6% 2024-01-19T04:19:20.798 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42749.log.gz 2024-01-19T04:19:20.798 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39507.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39507.log.gz 2024-01-19T04:19:20.799 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33405.log 2024-01-19T04:19:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37420.log 2024-01-19T04:19:20.800 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36543.log.gz 2024-01-19T04:19:20.801 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33405.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.33405.log.gz /var/log/ceph/ceph-client.admin.42483.log 2024-01-19T04:19:20.801 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-01-19T04:19:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42639.log 2024-01-19T04:19:20.803 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37420.log.gz 2024-01-19T04:19:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42483.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42483.log.gz 2024-01-19T04:19:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40593.log 2024-01-19T04:19:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32018.log 2024-01-19T04:19:20.806 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40593.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42639.log.gz 2024-01-19T04:19:20.806 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40593.log.gz 2024-01-19T04:19:20.806 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39767.log 2024-01-19T04:19:20.807 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41609.log 2024-01-19T04:19:20.808 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32018.log.gz 2024-01-19T04:19:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39767.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39767.log.gz 2024-01-19T04:19:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2024-01-19T04:19:20.810 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37569.log 2024-01-19T04:19:20.810 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41609.log.gz 2024-01-19T04:19:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43821.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2024-01-19T04:19:20.811 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2024-01-19T04:19:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31808.log 2024-01-19T04:19:20.813 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37569.log.gz 2024-01-19T04:19:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34744.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2024-01-19T04:19:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36413.log 2024-01-19T04:19:20.815 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2024-01-19T04:19:20.815 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31808.log.gz 2024-01-19T04:19:20.816 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36413.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36413.log.gz 2024-01-19T04:19:20.817 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32028.log 2024-01-19T04:19:20.817 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43165.log 2024-01-19T04:19:20.818 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2024-01-19T04:19:20.819 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32028.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32028.log.gz 2024-01-19T04:19:20.819 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31385.log 2024-01-19T04:19:20.821 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39325.log 2024-01-19T04:19:20.821 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43165.log.gz 2024-01-19T04:19:20.822 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41505.log 2024-01-19T04:19:20.822 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31385.log.gz 2024-01-19T04:19:20.823 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39325.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39325.log.gz 2024-01-19T04:19:20.823 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39949.log 2024-01-19T04:19:20.824 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42905.log 2024-01-19T04:19:20.825 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gz 2024-01-19T04:19:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39949.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39949.log.gz 2024-01-19T04:19:20.826 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38432.log 2024-01-19T04:19:20.827 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42905.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42905.log.gz 2024-01-19T04:19:20.828 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43113.log 2024-01-19T04:19:20.829 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27217.log 2024-01-19T04:19:20.829 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38432.log.gz 2024-01-19T04:19:20.830 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43113.log.gz 2024-01-19T04:19:20.830 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34982.log 2024-01-19T04:19:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.27217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37336.log 2024-01-19T04:19:20.832 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27217.log.gz 2024-01-19T04:19:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34982.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34982.log.gz 2024-01-19T04:19:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42561.log 2024-01-19T04:19:20.834 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37336.log: gzip 88.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.37336.log.gz -- 2024-01-19T04:19:20.834 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.42108.log 2024-01-19T04:19:20.836 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41049.log 2024-01-19T04:19:20.836 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42561.log.gz 2024-01-19T04:19:20.837 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42108.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42108.log.gz 2024-01-19T04:19:20.837 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40151.log 2024-01-19T04:19:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32019.log 2024-01-19T04:19:20.838 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41049.log.gz 2024-01-19T04:19:20.839 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40151.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40151.log.gz 2024-01-19T04:19:20.839 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2024-01-19T04:19:20.841 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42264.log 2024-01-19T04:19:20.841 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32019.log.gz 2024-01-19T04:19:20.842 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41824.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2024-01-19T04:19:20.842 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38380.log 2024-01-19T04:19:20.843 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41231.log 2024-01-19T04:19:20.844 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42264.log.gz 2024-01-19T04:19:20.844 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38380.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38380.log.gz 2024-01-19T04:19:20.845 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42613.log 2024-01-19T04:19:20.846 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 2024-01-19T04:19:20.846 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41231.log.gz 2024-01-19T04:19:20.847 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42613.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42613.log.gz 2024-01-19T04:19:20.847 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37622.log 2024-01-19T04:19:20.848 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40911.log 2024-01-19T04:19:20.849 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-01-19T04:19:20.850 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36283.log 2024-01-19T04:19:20.850 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37622.log.gz 2024-01-19T04:19:20.851 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40911.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40911.log.gz 2024-01-19T04:19:20.851 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37517.log 2024-01-19T04:19:20.852 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39174.log 2024-01-19T04:19:20.853 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36283.log.gz 2024-01-19T04:19:20.853 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37517.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37517.log.gz 2024-01-19T04:19:20.854 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43535.log 2024-01-19T04:19:20.855 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43035.log 2024-01-19T04:19:20.855 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39174.log.gz 2024-01-19T04:19:20.856 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43535.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43535.log.gz 2024-01-19T04:19:20.856 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2024-01-19T04:19:20.857 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43035.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-19T04:19:20.857 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43035.log.gz 2024-01-19T04:19:20.859 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33808.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2024-01-19T04:19:20.859 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31254.log 2024-01-19T04:19:20.860 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43899.log 2024-01-19T04:19:20.861 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38904.log 2024-01-19T04:19:20.862 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31254.log.gz 2024-01-19T04:19:20.863 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43691.log 2024-01-19T04:19:20.864 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43899.log.gz 2024-01-19T04:19:20.864 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39637.log 2024-01-19T04:19:20.865 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38904.log.gz 2024-01-19T04:19:20.866 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-01-19T04:19:20.866 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43691.log.gz 2024-01-19T04:19:20.867 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40567.log 2024-01-19T04:19:20.867 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39637.log.gz 2024-01-19T04:19:20.868 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35550.log 2024-01-19T04:19:20.869 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-01-19T04:19:20.870 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40365.log 2024-01-19T04:19:20.870 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40567.log.gz 2024-01-19T04:19:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40333.log 2024-01-19T04:19:20.871 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35550.log.gz 2024-01-19T04:19:20.873 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32728.log 2024-01-19T04:19:20.873 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40365.log.gz 2024-01-19T04:19:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36022.log 2024-01-19T04:19:20.874 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40333.log.gz 2024-01-19T04:19:20.875 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-01-19T04:19:20.875 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32728.log.gz 2024-01-19T04:19:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31740.log 2024-01-19T04:19:20.877 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36022.log.gz 2024-01-19T04:19:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33621.log 2024-01-19T04:19:20.878 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-01-19T04:19:20.879 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40514.log 2024-01-19T04:19:20.879 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31740.log.gz 2024-01-19T04:19:20.881 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35496.log 2024-01-19T04:19:20.881 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33621.log.gz 2024-01-19T04:19:20.882 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38512.log 2024-01-19T04:19:20.882 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40514.log.gz 2024-01-19T04:19:20.883 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-19T04:19:20.883 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35966.log 2024-01-19T04:19:20.883 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35496.log.gz 2024-01-19T04:19:20.885 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2024-01-19T04:19:20.885 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38512.log.gz 2024-01-19T04:19:20.886 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41033.log 2024-01-19T04:19:20.886 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35966.log.gz 2024-01-19T04:19:20.887 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34524.log 2024-01-19T04:19:20.888 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2024-01-19T04:19:20.888 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.41033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41033.log.gz 2024-01-19T04:19:20.889 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37704.log 2024-01-19T04:19:20.890 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40203.log 2024-01-19T04:19:20.890 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34524.log.gz 2024-01-19T04:19:20.891 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43639.log 2024-01-19T04:19:20.892 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37704.log.gz 2024-01-19T04:19:20.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38131.log 2024-01-19T04:19:20.893 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40203.log.gz 2024-01-19T04:19:20.894 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32208.log 2024-01-19T04:19:20.894 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43639.log.gz 2024-01-19T04:19:20.895 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-01-19T04:19:20.896 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38131.log.gz 2024-01-19T04:19:20.897 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38668.log 2024-01-19T04:19:20.897 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32208.log.gz 2024-01-19T04:19:20.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33379.log 2024-01-19T04:19:20.899 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-01-19T04:19:20.900 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31307.log 2024-01-19T04:19:20.900 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38668.log.gz 2024-01-19T04:19:20.901 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33990.log 2024-01-19T04:19:20.901 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33379.log.gz 2024-01-19T04:19:20.902 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31307.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-19T04:19:20.902 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31307.log.gz 2024-01-19T04:19:20.904 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35276.log 2024-01-19T04:19:20.904 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33990.log.gz 2024-01-19T04:19:20.905 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36673.log 2024-01-19T04:19:20.906 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38089.log 2024-01-19T04:19:20.906 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35276.log.gz 2024-01-19T04:19:20.908 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36673.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36673.log.gz 2024-01-19T04:19:20.908 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37782.log 2024-01-19T04:19:20.909 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.38089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38089.log.gz 2024-01-19T04:19:20.909 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35888.log 2024-01-19T04:19:20.911 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37782.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.37782.log.gz --verbose 2024-01-19T04:19:20.911 INFO:teuthology.orchestra.run.smithi032.stderr: -- /var/log/ceph/ceph-client.admin.36621.log 2024-01-19T04:19:20.911 INFO:teuthology.orchestra.run.smithi067.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-19T04:19:20.912 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35888.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35888.log.gz 2024-01-19T04:19:20.912 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41479.log 2024-01-19T04:19:20.914 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36621.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36621.log.gz 2024-01-19T04:19:20.914 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35302.log 2024-01-19T04:19:20.915 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41479.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41479.log.gz 2024-01-19T04:19:20.915 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35008.log 2024-01-19T04:19:20.917 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-01-19T04:19:20.917 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35302.log.gz 2024-01-19T04:19:20.918 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34095.log 2024-01-19T04:19:20.918 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35008.log.gz 2024-01-19T04:19:20.920 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33171.log 2024-01-19T04:19:20.920 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-01-19T04:19:20.921 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-01-19T04:19:20.921 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34095.log.gz 2024-01-19T04:19:20.923 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2024-01-19T04:19:20.923 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33171.log.gz 2024-01-19T04:19:20.924 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37135.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-01-19T04:19:20.924 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2024-01-19T04:19:20.925 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34930.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2024-01-19T04:19:20.925 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41635.log 2024-01-19T04:19:20.927 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42509.log 2024-01-19T04:19:20.927 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2024-01-19T04:19:20.928 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43321.log 2024-01-19T04:19:20.929 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41635.log.gz 2024-01-19T04:19:20.930 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42509.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42509.log.gz 2024-01-19T04:19:20.930 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41075.log 2024-01-19T04:19:20.931 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34630.log 2024-01-19T04:19:20.931 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43321.log.gz 2024-01-19T04:19:20.932 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41075.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41075.log.gz 2024-01-19T04:19:20.933 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36212.log 2024-01-19T04:19:20.934 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34630.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34630.log.gz 2024-01-19T04:19:20.934 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31636.log 2024-01-19T04:19:20.936 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43217.log 2024-01-19T04:19:20.936 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36212.log.gz 2024-01-19T04:19:20.937 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31636.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31636.log.gz 2024-01-19T04:19:20.937 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32520.log 2024-01-19T04:19:20.939 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38642.log 2024-01-19T04:19:20.939 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43217.log.gz 2024-01-19T04:19:20.940 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32520.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32520.log.gz 2024-01-19T04:19:20.940 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39871.log 2024-01-19T04:19:20.941 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38642.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38642.log.gz 2024-01-19T04:19:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39064.log 2024-01-19T04:19:20.943 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37596.log 2024-01-19T04:19:20.943 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39871.log.gz 2024-01-19T04:19:20.944 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41902.log 2024-01-19T04:19:20.945 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39064.log.gz 2024-01-19T04:19:20.946 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32650.log 2024-01-19T04:19:20.946 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37596.log.gz 2024-01-19T04:19:20.947 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41768.log 2024-01-19T04:19:20.947 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41902.log.gz 2024-01-19T04:19:20.949 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42827.log 2024-01-19T04:19:20.949 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32650.log.gz 2024-01-19T04:19:20.950 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41768.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41768.log.gz 2024-01-19T04:19:20.950 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39403.log 2024-01-19T04:19:20.952 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2024-01-19T04:19:20.952 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42827.log.gz 2024-01-19T04:19:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41661.log 2024-01-19T04:19:20.953 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39403.log.gz 2024-01-19T04:19:20.954 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2024-01-19T04:19:20.954 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2024-01-19T04:19:20.956 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33860.log 2024-01-19T04:19:20.956 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41661.log.gz 2024-01-19T04:19:20.957 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40462.log 2024-01-19T04:19:20.957 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2024-01-19T04:19:20.959 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33860.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33860.log.gz 2024-01-19T04:19:20.959 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34826.log 2024-01-19T04:19:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34852.log 2024-01-19T04:19:20.960 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40462.log.gz 2024-01-19T04:19:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-01-19T04:19:20.962 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34826.log.gz 2024-01-19T04:19:20.963 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42398.log 2024-01-19T04:19:20.963 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34852.log.gz 2024-01-19T04:19:20.964 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37161.log 2024-01-19T04:19:20.964 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-01-19T04:19:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32230.log 2024-01-19T04:19:20.966 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42398.log.gz 2024-01-19T04:19:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35576.log 2024-01-19T04:19:20.967 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37161.log.gz 2024-01-19T04:19:20.969 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32230.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32230.log.gz 2024-01-19T04:19:20.969 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32624.log 2024-01-19T04:19:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35576.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35576.log.gz 2024-01-19T04:19:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-19T04:19:20.972 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2024-01-19T04:19:20.972 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32624.log.gz 2024-01-19T04:19:20.974 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39819.log 2024-01-19T04:19:20.975 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43561.log: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-19T04:19:20.975 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-01-19T04:19:20.975 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-01-19T04:19:20.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42801.log 2024-01-19T04:19:20.977 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39819.log.gz 2024-01-19T04:19:20.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2024-01-19T04:19:20.978 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-01-19T04:19:20.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42801.log: gzip 88.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42801.log.gz -- 2024-01-19T04:19:20.979 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.32226.log 2024-01-19T04:19:20.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42879.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2024-01-19T04:19:20.981 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36926.log 2024-01-19T04:19:20.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32226.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32226.log.gz 2024-01-19T04:19:20.983 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31802.log 2024-01-19T04:19:20.984 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34244.log 2024-01-19T04:19:20.984 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36926.log.gz 2024-01-19T04:19:20.985 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31802.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31802.log.gz 2024-01-19T04:19:20.986 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37004.log 2024-01-19T04:19:20.987 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36335.log 2024-01-19T04:19:20.987 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34244.log.gz 2024-01-19T04:19:20.988 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38826.log 2024-01-19T04:19:20.989 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37004.log.gz 2024-01-19T04:19:20.990 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36335.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.36126.log 2024-01-19T04:19:20.990 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36335.log.gz 2024-01-19T04:19:20.991 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-01-19T04:19:20.991 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38826.log.gz 2024-01-19T04:19:20.993 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36126.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.34602.log -- replaced with /var/log/ceph/ceph-client.admin.36126.log.gz 2024-01-19T04:19:20.993 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-01-19T04:19:20.994 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33275.log 2024-01-19T04:19:20.994 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-01-19T04:19:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37676.log 2024-01-19T04:19:20.996 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34602.log.gz 2024-01-19T04:19:20.997 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33275.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33275.log.gz 2024-01-19T04:19:20.998 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42212.log 2024-01-19T04:19:20.999 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37676.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37676.log.gz 2024-01-19T04:19:20.999 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39090.log 2024-01-19T04:19:21.001 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-19T04:19:21.001 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40053.log 2024-01-19T04:19:21.001 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42212.log.gz 2024-01-19T04:19:21.002 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33964.log 2024-01-19T04:19:21.002 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39090.log.gz 2024-01-19T04:19:21.003 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40053.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2024-01-19T04:19:21.004 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32232.log 2024-01-19T04:19:21.005 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33964.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33964.log.gz 2024-01-19T04:19:21.005 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32416.log 2024-01-19T04:19:21.006 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32975.log 2024-01-19T04:19:21.007 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32232.log.gz 2024-01-19T04:19:21.008 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41347.log 2024-01-19T04:19:21.008 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32416.log.gz 2024-01-19T04:19:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.32975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.32975.log.gz 2024-01-19T04:19:21.009 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35410.log 2024-01-19T04:19:21.011 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36465.log 2024-01-19T04:19:21.011 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41347.log.gz 2024-01-19T04:19:21.012 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35784.log 2024-01-19T04:19:21.012 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35410.log.gz 2024-01-19T04:19:21.013 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31819.log 2024-01-19T04:19:21.014 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36465.log.gz 2024-01-19T04:19:21.015 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35784.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35784.log.gz 2024-01-19T04:19:21.015 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32598.log 2024-01-19T04:19:21.016 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42082.log 2024-01-19T04:19:21.017 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31819.log.gz 2024-01-19T04:19:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40255.log 2024-01-19T04:19:21.018 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32598.log.gz 2024-01-19T04:19:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42082.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42082.log.gz 2024-01-19T04:19:21.020 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40255.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40255.log.gz 2024-01-19T04:19:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36491.log 2024-01-19T04:19:21.022 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43243.log 2024-01-19T04:19:21.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35914.log 2024-01-19T04:19:21.024 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2024-01-19T04:19:21.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31156.log 2024-01-19T04:19:21.025 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43243.log.gz 2024-01-19T04:19:21.026 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-19T04:19:21.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2024-01-19T04:19:21.027 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35914.log.gz 2024-01-19T04:19:21.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42775.log 2024-01-19T04:19:21.028 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31156.log.gz 2024-01-19T04:19:21.029 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43743.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.31804.log 2024-01-19T04:19:21.029 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2024-01-19T04:19:21.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42853.log 2024-01-19T04:19:21.031 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42775.log.gz 2024-01-19T04:19:21.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31804.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31804.log.gz 2024-01-19T04:19:21.034 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31470.log 2024-01-19T04:19:21.034 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42853.log.gz 2024-01-19T04:19:21.035 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33834.log 2024-01-19T04:19:21.037 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-01-19T04:19:21.037 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31470.log.gz 2024-01-19T04:19:21.038 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33834.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33834.log.gz 2024-01-19T04:19:21.039 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36048.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-01-19T04:19:21.039 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37914.log 2024-01-19T04:19:21.041 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31556.log 2024-01-19T04:19:21.042 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36647.log 2024-01-19T04:19:21.042 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37914.log.gz 2024-01-19T04:19:21.043 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31556.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31556.log.gz 2024-01-19T04:19:21.045 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36647.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36647.log.gz 2024-01-19T04:19:21.045 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40079.log 2024-01-19T04:19:21.046 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-19T04:19:21.046 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44003.log 2024-01-19T04:19:21.048 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38930.log 2024-01-19T04:19:21.049 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40079.log.gz 2024-01-19T04:19:21.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43295.log 2024-01-19T04:19:21.050 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44003.log.gz 2024-01-19T04:19:21.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38930.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38930.log.gz 2024-01-19T04:19:21.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2024-01-19T04:19:21.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37756.log 2024-01-19T04:19:21.053 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43295.log.gz 2024-01-19T04:19:21.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40488.log 2024-01-19T04:19:21.054 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2024-01-19T04:19:21.055 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37756.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37756.log.gz 2024-01-19T04:19:21.056 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33886.log 2024-01-19T04:19:21.056 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40488.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40488.log.gz 2024-01-19T04:19:21.057 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33431.log 2024-01-19T04:19:21.059 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37940.log 2024-01-19T04:19:21.059 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33886.log.gz 2024-01-19T04:19:21.060 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33431.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33431.log.gz 2024-01-19T04:19:21.061 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37940.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37940.log.gz 2024-01-19T04:19:21.062 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38406.log 2024-01-19T04:19:21.063 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38460.log 2024-01-19T04:19:21.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-01-19T04:19:21.065 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38406.log.gz 2024-01-19T04:19:21.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38460.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38460.log.gz 2024-01-19T04:19:21.067 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43139.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-01-19T04:19:21.068 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36751.log 2024-01-19T04:19:21.069 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39455.log 2024-01-19T04:19:21.071 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36751.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36751.log.gz 2024-01-19T04:19:21.071 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38042.log 2024-01-19T04:19:21.072 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39455.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39455.log.gz 2024-01-19T04:19:21.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38042.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38042.log.gz 2024-01-19T04:19:21.074 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33509.log 2024-01-19T04:19:21.075 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-19T04:19:21.075 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31504.log 2024-01-19T04:19:21.076 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2024-01-19T04:19:21.077 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33509.log: /var/log/ceph/ceph-client.admin.31504.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33509.log.gz 2024-01-19T04:19:21.077 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31504.log.gz 2024-01-19T04:19:21.078 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38878.log 2024-01-19T04:19:21.079 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34147.log 2024-01-19T04:19:21.079 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2024-01-19T04:19:21.080 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38878.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38878.log.gz 2024-01-19T04:19:21.080 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37810.log 2024-01-19T04:19:21.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36361.log 2024-01-19T04:19:21.082 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34147.log.gz 2024-01-19T04:19:21.082 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37810.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37810.log.gz 2024-01-19T04:19:21.082 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42957.log 2024-01-19T04:19:21.083 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32225.log 2024-01-19T04:19:21.084 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36361.log.gz 2024-01-19T04:19:21.084 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42957.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42957.log.gz 2024-01-19T04:19:21.084 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42012.log 2024-01-19T04:19:21.085 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.42067.log 2024-01-19T04:19:21.086 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32225.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32225.log.gz 2024-01-19T04:19:21.086 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42012.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42012.log.gz 2024-01-19T04:19:21.087 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33301.log 2024-01-19T04:19:21.088 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.testuser.42067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37362.log 2024-01-19T04:19:21.088 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.42067.log.gz 2024-01-19T04:19:21.089 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33301.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33301.log.gz 2024-01-19T04:19:21.089 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32442.log 2024-01-19T04:19:21.090 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31530.log 2024-01-19T04:19:21.091 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37362.log: /var/log/ceph/ceph-client.admin.32442.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37362.log.gz 2024-01-19T04:19:21.091 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32442.log.gz 2024-01-19T04:19:21.092 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39793.log 2024-01-19T04:19:21.092 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39845.log 2024-01-19T04:19:21.093 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31530.log.gz 2024-01-19T04:19:21.093 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39793.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39793.log.gz 2024-01-19T04:19:21.094 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32016.log 2024-01-19T04:19:21.095 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39559.log 2024-01-19T04:19:21.095 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39845.log.gz 2024-01-19T04:19:21.096 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32016.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32016.log.gz 2024-01-19T04:19:21.096 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35250.log 2024-01-19T04:19:21.097 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39559.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-19T04:19:21.098 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39559.log.gz 2024-01-19T04:19:21.098 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35250.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35250.log.gz 2024-01-19T04:19:21.098 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-19T04:19:21.099 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33353.log 2024-01-19T04:19:21.102 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36900.log 2024-01-19T04:19:21.103 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33353.log.gz 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-19T04:19:21.103 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-01-19T04:19:21.104 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-19T04:19:21.104 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36900.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36900.log.gz 2024-01-19T04:19:21.104 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41794.log 2024-01-19T04:19:21.106 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37030.log 2024-01-19T04:19:21.107 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-01-19T04:19:21.107 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m0.472s 2024-01-19T04:19:21.107 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m1.983s 2024-01-19T04:19:21.107 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m0.211s 2024-01-19T04:19:21.108 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43191.log 2024-01-19T04:19:21.108 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41794.log.gz 2024-01-19T04:19:21.108 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-01-19T04:19:21.109 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37030.log.gz 2024-01-19T04:19:21.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34342.log 2024-01-19T04:19:21.110 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43191.log.gz 2024-01-19T04:19:21.110 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-19T04:19:21.111 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33093.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-19T04:19:21.111 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-01-19T04:19:21.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2024-01-19T04:19:21.113 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34342.log.gz 2024-01-19T04:19:21.114 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35706.log 2024-01-19T04:19:21.115 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-01-19T04:19:21.115 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2024-01-19T04:19:21.116 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35706.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35706.log.gz 2024-01-19T04:19:21.117 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2024-01-19T04:19:21.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43445.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz -5 2024-01-19T04:19:21.118 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43587.log 2024-01-19T04:19:21.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2024-01-19T04:19:21.120 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz 2024-01-19T04:19:21.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43587.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43587.log.gz 2024-01-19T04:19:21.122 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38538.log 2024-01-19T04:19:21.122 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41401.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2024-01-19T04:19:21.123 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33561.log 2024-01-19T04:19:21.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35328.log 2024-01-19T04:19:21.125 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38538.log.gz 2024-01-19T04:19:21.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33561.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33561.log.gz 2024-01-19T04:19:21.127 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35328.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35328.log.gz 2024-01-19T04:19:21.128 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39923.log 2024-01-19T04:19:21.129 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40307.log 2024-01-19T04:19:21.131 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39923.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22145.log 2024-01-19T04:19:21.131 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39923.log.gz 2024-01-19T04:19:21.132 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32572.log 2024-01-19T04:19:21.132 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40307.log.gz 2024-01-19T04:19:21.133 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.tmp-client.admin.22145.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22145.log.gz 2024-01-19T04:19:21.134 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33457.log 2024-01-19T04:19:21.134 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32572.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32572.log.gz 2024-01-19T04:19:21.135 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2024-01-19T04:19:21.137 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34121.log 2024-01-19T04:19:21.137 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33457.log.gz 2024-01-19T04:19:21.137 INFO:teuthology.orchestra.run.smithi032.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-19T04:19:21.137 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-01-19T04:19:21.138 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2024-01-19T04:19:21.138 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34121.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34121.log.gz 2024-01-19T04:19:21.139 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36874.log 2024-01-19T04:19:21.140 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38852.log 2024-01-19T04:19:21.141 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-01-19T04:19:21.141 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36874.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36874.log.gz 2024-01-19T04:19:21.141 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32546.log 2024-01-19T04:19:21.142 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.admin.38852.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39897.log 2024-01-19T04:19:21.143 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38852.log.gz 2024-01-19T04:19:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32546.log.gz 2024-01-19T04:19:21.144 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35940.log 2024-01-19T04:19:21.145 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33039.log 2024-01-19T04:19:21.145 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39897.log.gz 2024-01-19T04:19:21.146 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35940.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35940.log.gz 2024-01-19T04:19:21.146 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38956.log 2024-01-19T04:19:21.147 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33912.log 2024-01-19T04:19:21.148 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33039.log.gz 2024-01-19T04:19:21.148 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35224.log 2024-01-19T04:19:21.148 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38956.log.gz 2024-01-19T04:19:21.149 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33912.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33912.log.gz 2024-01-19T04:19:21.150 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2024-01-19T04:19:21.151 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37083.log 2024-01-19T04:19:21.151 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35224.log.gz 2024-01-19T04:19:21.152 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38264.log 2024-01-19T04:19:21.152 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2024-01-19T04:19:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41583.log 2024-01-19T04:19:21.154 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37083.log.gz 2024-01-19T04:19:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38264.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.38264.log.gz --verbose 2024-01-19T04:19:21.155 INFO:teuthology.orchestra.run.smithi032.stderr: -- /var/log/ceph/ceph-client.admin.31815.log 2024-01-19T04:19:21.156 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-01-19T04:19:21.156 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41583.log.gz 2024-01-19T04:19:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31815.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31815.log.gz 2024-01-19T04:19:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42983.log 2024-01-19T04:19:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34772.log 2024-01-19T04:19:21.159 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-01-19T04:19:21.160 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42983.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42983.log.gz 2024-01-19T04:19:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40885.log 2024-01-19T04:19:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33145.log 2024-01-19T04:19:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40885.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34772.log.gz 2024-01-19T04:19:21.162 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40885.log.gz 2024-01-19T04:19:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38346.log 2024-01-19T04:19:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33145.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33145.log.gz 2024-01-19T04:19:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38183.log 2024-01-19T04:19:21.166 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43977.log 2024-01-19T04:19:21.166 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38346.log.gz 2024-01-19T04:19:21.167 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-01-19T04:19:21.168 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38183.log.gz 2024-01-19T04:19:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43977.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43977.log.gz 2024-01-19T04:19:21.169 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2024-01-19T04:19:21.170 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37388.log 2024-01-19T04:19:21.170 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-01-19T04:19:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42238.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2024-01-19T04:19:21.171 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34368.log 2024-01-19T04:19:21.172 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.admin.37388.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39975.log 2024-01-19T04:19:21.172 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7%/var/log/ceph/ceph-client.admin.34368.log: -- replaced with /var/log/ceph/ceph-client.admin.37388.log.gz 2024-01-19T04:19:21.173 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34368.log.gz 2024-01-19T04:19:21.173 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40177.log 2024-01-19T04:19:21.175 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40107.log 2024-01-19T04:19:21.175 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39975.log.gz 2024-01-19T04:19:21.175 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40177.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40177.log.gz 2024-01-19T04:19:21.176 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42294.log 2024-01-19T04:19:21.177 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41321.log 2024-01-19T04:19:21.177 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40107.log.gz 2024-01-19T04:19:21.178 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42294.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42294.log.gz 2024-01-19T04:19:21.178 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-01-19T04:19:21.179 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34446.log 2024-01-19T04:19:21.179 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41321.log.gz 2024-01-19T04:19:21.181 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41427.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gzgzip 2024-01-19T04:19:21.181 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34394.log 2024-01-19T04:19:21.182 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34446.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34446.log.gz 2024-01-19T04:19:21.182 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2024-01-19T04:19:21.183 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42723.log 2024-01-19T04:19:21.183 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34394.log.gz 2024-01-19T04:19:21.185 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34692.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz -5 2024-01-19T04:19:21.185 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39715.log 2024-01-19T04:19:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42723.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42723.log.gz 2024-01-19T04:19:21.186 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33699.log 2024-01-19T04:19:21.187 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32023.log 2024-01-19T04:19:21.187 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39715.log.gz 2024-01-19T04:19:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33699.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33699.log.gz 2024-01-19T04:19:21.188 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41373.log 2024-01-19T04:19:21.190 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32236.log 2024-01-19T04:19:21.190 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32023.log.gz 2024-01-19T04:19:21.191 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41373.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41373.log.gz 2024-01-19T04:19:21.191 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33327.log 2024-01-19T04:19:21.192 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39247.log 2024-01-19T04:19:21.193 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32236.log.gz 2024-01-19T04:19:21.193 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33327.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33327.log.gz 2024-01-19T04:19:21.194 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40937.log 2024-01-19T04:19:21.194 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39247.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39247.log.gz 2024-01-19T04:19:21.195 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33647.log 2024-01-19T04:19:21.196 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36439.log 2024-01-19T04:19:21.197 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33647.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40937.log.gz 2024-01-19T04:19:21.197 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.33647.log.gz -5 2024-01-19T04:19:21.197 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37310.log 2024-01-19T04:19:21.198 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36439.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36439.log.gz 2024-01-19T04:19:21.199 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36777.log 2024-01-19T04:19:21.199 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32806.log 2024-01-19T04:19:21.200 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37310.log.gz 2024-01-19T04:19:21.201 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36777.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36777.log.gz 2024-01-19T04:19:21.201 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31439.log 2024-01-19T04:19:21.203 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-01-19T04:19:21.203 INFO:teuthology.orchestra.run.smithi032.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.32806.log.gz 2024-01-19T04:19:21.204 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31439.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31439.log.gz 2024-01-19T04:19:21.204 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38238.log 2024-01-19T04:19:21.205 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31411.log 2024-01-19T04:19:21.206 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-01-19T04:19:21.206 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38238.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38238.log.gz 2024-01-19T04:19:21.207 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36978.log 2024-01-19T04:19:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31411.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31411.log.gz 2024-01-19T04:19:21.208 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40001.log 2024-01-19T04:19:21.210 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35628.log 2024-01-19T04:19:21.210 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36978.log.gz 2024-01-19T04:19:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40001.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40001.log.gz 2024-01-19T04:19:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40807.log 2024-01-19T04:19:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-01-19T04:19:21.212 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35628.log.gz 2024-01-19T04:19:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40807.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40807.log.gz 2024-01-19T04:19:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.39231.log 2024-01-19T04:19:21.214 INFO:teuthology.orchestra.run.smithi032.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-19T04:19:21.215 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42452.log 2024-01-19T04:19:21.215 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-01-19T04:19:21.216 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.testuser.39231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.39231.log.gz 2024-01-19T04:19:21.216 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41980.log 2024-01-19T04:19:21.217 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42452.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42452.log.gz 2024-01-19T04:19:21.217 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35156.log 2024-01-19T04:19:21.218 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41980.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41980.log.gz 2024-01-19T04:19:21.218 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-19T04:19:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2024-01-19T04:19:21.219 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.35156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35156.log.gz 2024-01-19T04:19:21.220 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34800.log 2024-01-19T04:19:21.221 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37284.log 2024-01-19T04:19:21.221 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2024-01-19T04:19:21.222 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34800.log.gz 2024-01-19T04:19:21.222 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38720.log 2024-01-19T04:19:21.223 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2024-01-19T04:19:21.223 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37284.log.gz 2024-01-19T04:19:21.224 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38720.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38720.log.gz 2024-01-19T04:19:21.224 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40859.log 2024-01-19T04:19:21.225 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40987.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2024-01-19T04:19:21.225 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32754.log 2024-01-19T04:19:21.226 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40859.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40859.log.gz 2024-01-19T04:19:21.226 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35758.log 2024-01-19T04:19:21.227 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34276.log 2024-01-19T04:19:21.227 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32754.log.gz 2024-01-19T04:19:21.228 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35758.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35758.log.gz 2024-01-19T04:19:21.228 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32468.log 2024-01-19T04:19:21.229 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33065.log 2024-01-19T04:19:21.229 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34276.log.gz 2024-01-19T04:19:21.230 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32468.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32468.log.gz 2024-01-19T04:19:21.230 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32702.log 2024-01-19T04:19:21.231 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34576.log 2024-01-19T04:19:21.231 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33065.log.gz 2024-01-19T04:19:21.232 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32702.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32702.log.gz 2024-01-19T04:19:21.232 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41713.log 2024-01-19T04:19:21.233 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38746.log 2024-01-19T04:19:21.233 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34576.log.gz 2024-01-19T04:19:21.234 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41713.log.gz 2024-01-19T04:19:21.234 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41259.log 2024-01-19T04:19:21.235 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38746.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38746.log.gz -5 2024-01-19T04:19:21.235 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32231.log 2024-01-19T04:19:21.236 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41259.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41259.log.gz 2024-01-19T04:19:21.236 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41205.log 2024-01-19T04:19:21.237 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41287.log 2024-01-19T04:19:21.237 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32231.log.gz 2024-01-19T04:19:21.238 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41205.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41205.log.gz 2024-01-19T04:19:21.238 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38105.log 2024-01-19T04:19:21.239 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42372.log 2024-01-19T04:19:21.239 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41287.log.gz 2024-01-19T04:19:21.240 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38105.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38105.log.gz 2024-01-19T04:19:21.240 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31766.log 2024-01-19T04:19:21.241 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38290.log 2024-01-19T04:19:21.241 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42372.log.gz 2024-01-19T04:19:21.243 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31766.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31766.log.gz 2024-01-19T04:19:21.243 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2024-01-19T04:19:21.244 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40701.log 2024-01-19T04:19:21.244 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38290.log.gz 2024-01-19T04:19:21.244 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44107.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2024-01-19T04:19:21.245 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-01-19T04:19:21.246 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34956.log 2024-01-19T04:19:21.246 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40701.log.gz 2024-01-19T04:19:21.247 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34498.log 2024-01-19T04:19:21.247 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2024-01-19T04:19:21.248 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35654.log 2024-01-19T04:19:21.248 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34956.log.gz 2024-01-19T04:19:21.249 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34498.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34498.log.gz 2024-01-19T04:19:21.249 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-01-19T04:19:21.250 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31584.log 2024-01-19T04:19:21.250 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35654.log.gz 2024-01-19T04:19:21.251 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42134.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-01-19T04:19:21.251 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39481.log 2024-01-19T04:19:21.252 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40833.log 2024-01-19T04:19:21.252 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31584.log.gz 2024-01-19T04:19:21.253 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39481.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39481.log.gz 2024-01-19T04:19:21.253 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36803.log 2024-01-19T04:19:21.254 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38486.log 2024-01-19T04:19:21.254 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40833.log.gz 2024-01-19T04:19:21.255 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36803.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36803.log.gz 2024-01-19T04:19:21.255 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40621.log 2024-01-19T04:19:21.256 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38486.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38486.log.gz 2024-01-19T04:19:21.256 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31688.log 2024-01-19T04:19:21.257 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40621.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40621.log.gz 2024-01-19T04:19:21.258 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32861.log 2024-01-19T04:19:21.258 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31688.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31688.log.gz 2024-01-19T04:19:21.259 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32861.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32861.log.gz 2024-01-19T04:19:21.269 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-19T04:19:21.324 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-19T04:19:21.326 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-01-19T04:19:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m0.710s 2024-01-19T04:19:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m2.617s 2024-01-19T04:19:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m0.991s 2024-01-19T04:19:21.327 INFO:tasks.ceph:Archiving logs... 2024-01-19T04:19:21.327 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/remote/smithi032/log 2024-01-19T04:19:21.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-19T04:19:21.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-19T04:19:21.956 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/remote/smithi067/log 2024-01-19T04:19:21.957 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-19T04:19:22.211 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-19T04:19:22.220 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-19T04:19:22.220 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-19T04:19:22.224 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-19T04:19:22.301 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-19T04:19:22.311 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-19T04:19:22.311 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T04:19:22.315 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T04:19:22.327 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T04:19:22.328 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-01-19T04:19:22.328 INFO:teuthology.orchestra.run.smithi032.stdout:*hv01.front.sepi 44.4.53.2 2 u 32 64 377 0.133 -1.438 0.535 2024-01-19T04:19:22.328 INFO:teuthology.orchestra.run.smithi032.stdout:+hv02.front.sepi 63.231.80.2 3 u 37 64 377 0.113 -0.123 0.627 2024-01-19T04:19:22.328 INFO:teuthology.orchestra.run.smithi032.stdout:+hv03.front.sepi 74.6.168.72 3 u 35 64 377 0.131 -0.996 0.603 2024-01-19T04:19:22.328 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:19:22.331 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T04:19:22.331 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-01-19T04:19:22.331 INFO:teuthology.orchestra.run.smithi067.stdout:*hv01.front.sepi 44.4.53.2 2 u 34 64 377 0.095 -1.619 0.734 2024-01-19T04:19:22.331 INFO:teuthology.orchestra.run.smithi067.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.087 -0.272 0.777 2024-01-19T04:19:22.331 INFO:teuthology.orchestra.run.smithi067.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.089 -1.134 0.659 2024-01-19T04:19:22.331 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T04:19:22.332 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-19T04:19:22.342 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-19T04:19:22.343 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-19T04:19:22.391 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-19T04:19:22.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-19T04:19:22.453 INFO:teuthology.task.internal:Duration was 955.768869 seconds 2024-01-19T04:19:22.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-19T04:19:22.480 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-19T04:19:22.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-19T04:19:22.483 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-19T04:19:22.591 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-19T04:19:22.591 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-01-19T04:19:22.591 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-19T04:19:22.612 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-01-19T04:19:22.613 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-19T04:19:22.634 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-19T04:19:22.634 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-19T04:19:22.656 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-19T04:19:22.719 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-19T04:19:22.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-19T04:19:22.740 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-19T04:19:22.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-19T04:19:22.845 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-19T04:19:22.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-19T04:19:22.867 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-19T04:19:22.888 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-19T04:19:22.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-19T04:19:22.912 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-19T04:19:22.926 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-01-19T04:19:22.949 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-01-19T04:19:22.969 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-19T04:19:22.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:19:22.992 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-19T04:19:23.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T04:19:23.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-19T04:19:23.033 INFO:teuthology.task.internal:Transferring archived files... 2024-01-19T04:19:23.034 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/remote/smithi032 2024-01-19T04:19:23.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-19T04:19:23.061 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983/remote/smithi067 2024-01-19T04:19:23.062 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-19T04:19:23.090 INFO:teuthology.task.internal:Removing archive directory... 2024-01-19T04:19:23.091 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-19T04:19:23.104 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-19T04:19:23.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-19T04:19:23.147 INFO:teuthology.task.internal:Not uploading archives. 2024-01-19T04:19:23.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-19T04:19:23.185 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-19T04:19:23.186 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-19T04:19:23.189 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-19T04:19:23.194 INFO:teuthology.orchestra.run.smithi032.stdout: 658073 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 19 04:19 /home/ubuntu/cephtest 2024-01-19T04:19:23.197 INFO:teuthology.orchestra.run.smithi067.stdout: 658071 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 19 04:19 /home/ubuntu/cephtest 2024-01-19T04:19:23.199 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-19T04:19:23.257 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-19T04:19:23.303 INFO:teuthology.nuke:Checking targets against current locks 2024-01-19T04:19:23.330 DEBUG:teuthology.nuke:shortname: smithi032 2024-01-19T04:19:23.330 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T04:19:23.353 DEBUG:teuthology.nuke:shortname: smithi067 2024-01-19T04:19:23.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T04:19:23.357 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 03:53:27.773425', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmDdSsxv9WcJ1PZ9Jkx++eMHWGS8ZjfY//Ppc41DiHzNz2a0RfpIlaepu8H+26Ti/KB+0ITqjumF9g3TjIJb3I='} 2024-01-19T04:19:23.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 03:53:27.771838', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ/Mu9fYV8m1G+znEw6THx2hpuWOW7pGAgxKZxsI2PI3OgYKsM9ZT+Dz2MR6wxX8wK+xWWAAILMLzdjTFAWUtZ8='} 2024-01-19T04:19:23.403 INFO:teuthology.orchestra.console.smithi032:Power off 2024-01-19T04:19:23.403 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T04:19:23.425 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-01-19T04:19:23.426 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:19:23.444 INFO:teuthology.orchestra.console.smithi067:Power off 2024-01-19T04:19:23.445 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T04:19:23.454 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-01-19T04:19:23.468 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-01-19T04:19:23.469 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:19:23.490 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-19T04:19:27.456 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:19:27.492 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:19:27.569 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-01-19T04:19:27.601 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-19T04:19:31.572 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:19:31.602 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:19:31.682 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-01-19T04:19:31.712 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-19T04:19:31.783 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-01-19T04:19:35.716 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T04:19:35.825 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-19T04:19:35.926 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-01-19T04:19:36.031 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 client.1-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 955.7688686847687 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1c46498cce0b4df8ab1d9b942d035d8a status: fail success: false 2024-01-19T04:19:36.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T04:19:36.117 INFO:teuthology.run:FAIL